2024-03-04T08:53:26.140 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-03-04T08:53:26.140 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_leonidus@teuthology --name leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi --archive /home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580833 --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-workunit/fs/norstats}} --verbose -- /home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580833/orig.config.yaml 2024-03-04T08:53:26.194 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T08:53:26.290 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580833 branch: wip-lusov-qdb description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-workunit/fs/norstats}} email: null first_in_suite: false job_id: '7580833' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-lusov-qdb ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client dirsize rbytes: false client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_export_ephemeral_random_max: 0.1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount install: ceph: flavor: default sha1: 1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd kclient: client.0: mount_subvol_num: 1 rbytes: false selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-lusov-qdb sha1: 1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd owner: scheduled_leonidus@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 5072 sha1: 1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd sleep_before_teardown: 0 subset: 246/10000 suite: fs suite_branch: wip-lusov-qdb suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi082.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNkJl6qKdFFd+hCetNTz+Sj09O2DX4EqS+OHaEacWiPnT5+78BLMcS0HR3p1weM/7T2D244a8dmBx4cPws00I20= smithi102.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCw3z+3rETOuzwHAuJv9tIIu+rKlRGjmjmXVAqg3nLWIC2ucVtRc1Ohz9FWVzVCh6PKe8e520t/u5QiTHULmPNc= smithi190.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHotIUDfKIbXUI+k9LibLRlp8ZVxj/0vbN4SDOhUzVpEqe1KgExTqhV066NtxATEbsmQ7cIndRH64gf/kXQifZU= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - ceph-fuse: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - exec: mon.a: - ceph mgr module enable snap_schedule - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - workunit: clients: all: - fs/norstats teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: b1dac5519c57c269ea98a22fb7729016a1d0e4d2 timestamp: 2024-03-04_07:05:03 tube: smithi user: leonidus verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-04T08:53:26.291 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/qa; will attempt to use it 2024-03-04T08:53:26.291 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/qa/tasks 2024-03-04T08:53:26.291 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-04T08:53:26.293 INFO:teuthology.task.internal:Checking packages... 2024-03-04T08:53:26.316 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd' 2024-03-04T08:53:26.316 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-04T08:53:26.316 INFO:teuthology.packaging:ref: None 2024-03-04T08:53:26.316 INFO:teuthology.packaging:tag: None 2024-03-04T08:53:26.316 INFO:teuthology.packaging:branch: wip-lusov-qdb 2024-03-04T08:53:26.316 INFO:teuthology.packaging:sha1: 1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd 2024-03-04T08:53:26.317 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-lusov-qdb 2024-03-04T08:53:26.459 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1739.g1bc250c7 2024-03-04T08:53:26.461 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-04T08:53:26.467 INFO:teuthology.task.internal:no buildpackages task found 2024-03-04T08:53:26.467 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-04T08:53:26.474 INFO:teuthology.task.internal:Saving configuration 2024-03-04T08:53:26.492 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-04T08:53:26.498 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-04T08:53:26.520 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi082.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580833', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-04 08:48:31.609026', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNkJl6qKdFFd+hCetNTz+Sj09O2DX4EqS+OHaEacWiPnT5+78BLMcS0HR3p1weM/7T2D244a8dmBx4cPws00I20='} 2024-03-04T08:53:26.542 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580833', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-04 08:48:31.611589', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCw3z+3rETOuzwHAuJv9tIIu+rKlRGjmjmXVAqg3nLWIC2ucVtRc1Ohz9FWVzVCh6PKe8e520t/u5QiTHULmPNc='} 2024-03-04T08:53:26.559 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi190.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580833', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-04 08:48:31.610380', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHotIUDfKIbXUI+k9LibLRlp8ZVxj/0vbN4SDOhUzVpEqe1KgExTqhV066NtxATEbsmQ7cIndRH64gf/kXQifZU='} 2024-03-04T08:53:26.559 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-04T08:53:26.566 INFO:teuthology.task.internal:roles: ubuntu@smithi082.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-03-04T08:53:26.566 INFO:teuthology.task.internal:roles: ubuntu@smithi102.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-03-04T08:53:26.566 INFO:teuthology.task.internal:roles: ubuntu@smithi190.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-03-04T08:53:26.566 INFO:teuthology.run_tasks:Running task console_log... 2024-03-04T08:53:26.666 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f829a1e80d0>, signals=[15]) 2024-03-04T08:53:26.666 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-04T08:53:26.672 INFO:teuthology.task.internal:Opening connections... 2024-03-04T08:53:26.673 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi082.front.sepia.ceph.com 2024-03-04T08:53:26.675 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T08:53:26.763 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi102.front.sepia.ceph.com 2024-03-04T08:53:26.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T08:53:26.854 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi190.front.sepia.ceph.com 2024-03-04T08:53:26.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T08:53:26.942 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-04T08:53:26.950 DEBUG:teuthology.orchestra.run.smithi082:> uname -m 2024-03-04T08:53:26.967 INFO:teuthology.orchestra.run.smithi082.stdout:x86_64 2024-03-04T08:53:26.968 DEBUG:teuthology.orchestra.run.smithi082:> cat /etc/os-release 2024-03-04T08:53:27.025 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="CentOS Stream" 2024-03-04T08:53:27.026 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="9" 2024-03-04T08:53:27.026 INFO:teuthology.orchestra.run.smithi082.stdout:ID="centos" 2024-03-04T08:53:27.026 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE="rhel fedora" 2024-03-04T08:53:27.026 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="9" 2024-03-04T08:53:27.026 INFO:teuthology.orchestra.run.smithi082.stdout:PLATFORM_ID="platform:el9" 2024-03-04T08:53:27.026 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-04T08:53:27.026 INFO:teuthology.orchestra.run.smithi082.stdout:ANSI_COLOR="0;31" 2024-03-04T08:53:27.026 INFO:teuthology.orchestra.run.smithi082.stdout:LOGO="fedora-logo-icon" 2024-03-04T08:53:27.026 INFO:teuthology.orchestra.run.smithi082.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-04T08:53:27.026 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://centos.org/" 2024-03-04T08:53:27.026 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-04T08:53:27.026 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-04T08:53:27.026 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-04T08:53:27.027 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2024-03-04T08:53:27.052 DEBUG:teuthology.orchestra.run.smithi102:> uname -m 2024-03-04T08:53:27.069 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64 2024-03-04T08:53:27.069 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2024-03-04T08:53:27.125 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="CentOS Stream" 2024-03-04T08:53:27.126 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="9" 2024-03-04T08:53:27.126 INFO:teuthology.orchestra.run.smithi102.stdout:ID="centos" 2024-03-04T08:53:27.126 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="rhel fedora" 2024-03-04T08:53:27.126 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="9" 2024-03-04T08:53:27.126 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el9" 2024-03-04T08:53:27.126 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-04T08:53:27.126 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31" 2024-03-04T08:53:27.126 INFO:teuthology.orchestra.run.smithi102.stdout:LOGO="fedora-logo-icon" 2024-03-04T08:53:27.126 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-04T08:53:27.127 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://centos.org/" 2024-03-04T08:53:27.127 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-04T08:53:27.127 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-04T08:53:27.127 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-04T08:53:27.127 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2024-03-04T08:53:27.152 DEBUG:teuthology.orchestra.run.smithi190:> uname -m 2024-03-04T08:53:27.170 INFO:teuthology.orchestra.run.smithi190.stdout:x86_64 2024-03-04T08:53:27.170 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2024-03-04T08:53:27.226 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="CentOS Stream" 2024-03-04T08:53:27.226 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="9" 2024-03-04T08:53:27.226 INFO:teuthology.orchestra.run.smithi190.stdout:ID="centos" 2024-03-04T08:53:27.226 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="rhel fedora" 2024-03-04T08:53:27.227 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="9" 2024-03-04T08:53:27.227 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el9" 2024-03-04T08:53:27.227 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-04T08:53:27.227 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31" 2024-03-04T08:53:27.227 INFO:teuthology.orchestra.run.smithi190.stdout:LOGO="fedora-logo-icon" 2024-03-04T08:53:27.227 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-04T08:53:27.227 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://centos.org/" 2024-03-04T08:53:27.227 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-04T08:53:27.227 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-04T08:53:27.227 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-04T08:53:27.227 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2024-03-04T08:53:27.252 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-04T08:53:27.262 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-04T08:53:27.267 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-04T08:53:27.268 DEBUG:teuthology.orchestra.run.smithi082:> test '!' -e /home/ubuntu/cephtest 2024-03-04T08:53:27.270 DEBUG:teuthology.orchestra.run.smithi102:> test '!' -e /home/ubuntu/cephtest 2024-03-04T08:53:27.272 DEBUG:teuthology.orchestra.run.smithi190:> test '!' -e /home/ubuntu/cephtest 2024-03-04T08:53:27.288 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-04T08:53:27.293 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-04T08:53:27.294 DEBUG:teuthology.orchestra.run.smithi082:> test -z $(ls -A /var/lib/ceph) 2024-03-04T08:53:27.326 DEBUG:teuthology.orchestra.run.smithi102:> test -z $(ls -A /var/lib/ceph) 2024-03-04T08:53:27.329 DEBUG:teuthology.orchestra.run.smithi190:> test -z $(ls -A /var/lib/ceph) 2024-03-04T08:53:27.426 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-04T08:53:27.509 INFO:teuthology.run_tasks:Running task kernel... 2024-03-04T08:53:27.524 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-03-04T08:53:27.524 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-03-04T08:53:27.525 DEBUG:teuthology.orchestra.run.smithi082:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-04T08:53:27.525 DEBUG:teuthology.orchestra.run.smithi102:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-04T08:53:27.526 DEBUG:teuthology.orchestra.run.smithi190:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-04T08:53:27.541 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T08:53:27.542 DEBUG:teuthology.orchestra.run.smithi102:> uname -r 2024-03-04T08:53:27.543 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T08:53:27.543 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T08:53:27.544 DEBUG:teuthology.orchestra.run.smithi190:> uname -r 2024-03-04T08:53:27.544 DEBUG:teuthology.orchestra.run.smithi082:> uname -r 2024-03-04T08:53:27.598 INFO:teuthology.orchestra.run.smithi102.stdout:5.14.0-361.el9.x86_64 2024-03-04T08:53:27.600 INFO:teuthology.task.kernel:Running kernel on smithi102: 5.14.0-361.el9.x86_64 2024-03-04T08:53:27.600 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum install -y kernel 2024-03-04T08:53:27.601 INFO:teuthology.orchestra.run.smithi082.stdout:5.14.0-361.el9.x86_64 2024-03-04T08:53:27.601 INFO:teuthology.task.kernel:Running kernel on smithi082: 5.14.0-361.el9.x86_64 2024-03-04T08:53:27.601 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum install -y kernel 2024-03-04T08:53:27.602 INFO:teuthology.orchestra.run.smithi190.stdout:5.14.0-361.el9.x86_64 2024-03-04T08:53:27.602 INFO:teuthology.task.kernel:Running kernel on smithi190: 5.14.0-361.el9.x86_64 2024-03-04T08:53:27.602 DEBUG:teuthology.orchestra.run.smithi190:> sudo yum install -y kernel 2024-03-04T08:53:30.213 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS-9 - AppStream 6.9 MB/s | 6.7 MB 00:00 2024-03-04T08:53:30.217 INFO:teuthology.orchestra.run.smithi190.stdout:CentOS-9 - AppStream 7.3 MB/s | 6.7 MB 00:00 2024-03-04T08:53:30.259 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS-9 - AppStream 6.7 MB/s | 6.7 MB 00:01 2024-03-04T08:53:31.833 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS-9 - BaseOS 4.4 MB/s | 2.0 MB 00:00 2024-03-04T08:53:31.887 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS-9 - BaseOS 3.3 MB/s | 2.0 MB 00:00 2024-03-04T08:53:32.051 INFO:teuthology.orchestra.run.smithi190.stdout:CentOS-9 - BaseOS 2.8 MB/s | 2.0 MB 00:00 2024-03-04T08:53:32.640 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.0 MB 00:00 2024-03-04T08:53:33.766 INFO:teuthology.orchestra.run.smithi190.stdout:CentOS Stream 9 - BaseOS 5.9 MB/s | 8.0 MB 00:01 2024-03-04T08:53:34.161 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - BaseOS 3.8 MB/s | 8.0 MB 00:02 2024-03-04T08:53:35.274 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - AppStream 12 MB/s | 19 MB 00:01 2024-03-04T08:53:35.887 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - AppStream 27 MB/s | 19 MB 00:00 2024-03-04T08:53:37.151 INFO:teuthology.orchestra.run.smithi190.stdout:CentOS Stream 9 - AppStream 8.3 MB/s | 19 MB 00:02 2024-03-04T08:53:39.517 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - CRB 8.4 MB/s | 6.1 MB 00:00 2024-03-04T08:53:41.310 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - Extras packages 23 kB/s | 15 kB 00:00 2024-03-04T08:53:42.253 INFO:teuthology.orchestra.run.smithi102.stdout:Extra Packages for Enterprise Linux 25 MB/s | 20 MB 00:00 2024-03-04T08:53:42.393 INFO:teuthology.orchestra.run.smithi190.stdout:CentOS Stream 9 - CRB 3.7 MB/s | 6.1 MB 00:01 2024-03-04T08:53:43.835 INFO:teuthology.orchestra.run.smithi190.stdout:CentOS Stream 9 - Extras packages 46 kB/s | 15 kB 00:00 2024-03-04T08:53:45.031 INFO:teuthology.orchestra.run.smithi190.stdout:Extra Packages for Enterprise Linux 19 MB/s | 20 MB 00:01 2024-03-04T08:53:47.094 INFO:teuthology.orchestra.run.smithi102.stdout:lab-extras 36 kB/s | 1.7 kB 00:00 2024-03-04T08:53:47.602 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - CRB 766 kB/s | 6.1 MB 00:08 2024-03-04T08:53:48.928 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - Extras packages 79 kB/s | 15 kB 00:00 2024-03-04T08:53:49.309 INFO:teuthology.orchestra.run.smithi102.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-03-04T08:53:49.309 INFO:teuthology.orchestra.run.smithi102.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-03-04T08:53:49.405 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-03-04T08:53:49.409 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-03-04T08:53:49.409 INFO:teuthology.orchestra.run.smithi102.stdout: Package Architecture Version Repository Size 2024-03-04T08:53:49.409 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-03-04T08:53:49.410 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-03-04T08:53:49.410 INFO:teuthology.orchestra.run.smithi102.stdout: kernel x86_64 5.14.0-427.el9 baseos 6.0 M 2024-03-04T08:53:49.410 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-03-04T08:53:49.410 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-core x86_64 5.14.0-427.el9 baseos 21 M 2024-03-04T08:53:49.410 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-modules x86_64 5.14.0-427.el9 baseos 39 M 2024-03-04T08:53:49.410 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-modules-core x86_64 5.14.0-427.el9 baseos 33 M 2024-03-04T08:53:49.410 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-04T08:53:49.410 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-03-04T08:53:49.410 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-03-04T08:53:49.410 INFO:teuthology.orchestra.run.smithi102.stdout:Install 4 Packages 2024-03-04T08:53:49.410 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-04T08:53:49.411 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 100 M 2024-03-04T08:53:49.411 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 123 M 2024-03-04T08:53:49.411 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-03-04T08:53:49.953 INFO:teuthology.orchestra.run.smithi190.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-03-04T08:53:50.129 INFO:teuthology.orchestra.run.smithi102.stdout:(1/4): kernel-5.14.0-427.el9.x86_64.rpm 14 MB/s | 6.0 MB 00:00 2024-03-04T08:53:50.871 INFO:teuthology.orchestra.run.smithi102.stdout:(2/4): kernel-core-5.14.0-427.el9.x86_64.rpm 18 MB/s | 21 MB 00:01 2024-03-04T08:53:51.213 INFO:teuthology.orchestra.run.smithi082.stdout:Extra Packages for Enterprise Linux 9.5 MB/s | 20 MB 00:02 2024-03-04T08:53:51.521 INFO:teuthology.orchestra.run.smithi102.stdout:(3/4): kernel-modules-core-5.14.0-427.el9.x86_6 24 MB/s | 33 MB 00:01 2024-03-04T08:53:51.971 INFO:teuthology.orchestra.run.smithi102.stdout:(4/4): kernel-modules-5.14.0-427.el9.x86_64.rpm 17 MB/s | 39 MB 00:02 2024-03-04T08:53:51.974 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-03-04T08:53:51.974 INFO:teuthology.orchestra.run.smithi102.stdout:Total 39 MB/s | 100 MB 00:02 2024-03-04T08:53:52.193 INFO:teuthology.orchestra.run.smithi190.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-03-04T08:53:52.193 INFO:teuthology.orchestra.run.smithi190.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-03-04T08:53:52.275 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. 2024-03-04T08:53:52.283 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2024-03-04T08:53:52.283 INFO:teuthology.orchestra.run.smithi190.stdout: Package Architecture Version Repository Size 2024-03-04T08:53:52.283 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2024-03-04T08:53:52.283 INFO:teuthology.orchestra.run.smithi190.stdout:Installing: 2024-03-04T08:53:52.283 INFO:teuthology.orchestra.run.smithi190.stdout: kernel x86_64 5.14.0-427.el9 baseos 6.0 M 2024-03-04T08:53:52.283 INFO:teuthology.orchestra.run.smithi190.stdout:Installing dependencies: 2024-03-04T08:53:52.283 INFO:teuthology.orchestra.run.smithi190.stdout: kernel-core x86_64 5.14.0-427.el9 baseos 21 M 2024-03-04T08:53:52.283 INFO:teuthology.orchestra.run.smithi190.stdout: kernel-modules x86_64 5.14.0-427.el9 baseos 39 M 2024-03-04T08:53:52.284 INFO:teuthology.orchestra.run.smithi190.stdout: kernel-modules-core x86_64 5.14.0-427.el9 baseos 33 M 2024-03-04T08:53:52.284 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-03-04T08:53:52.284 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction Summary 2024-03-04T08:53:52.284 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2024-03-04T08:53:52.284 INFO:teuthology.orchestra.run.smithi190.stdout:Install 4 Packages 2024-03-04T08:53:52.284 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-03-04T08:53:52.284 INFO:teuthology.orchestra.run.smithi190.stdout:Total download size: 100 M 2024-03-04T08:53:52.285 INFO:teuthology.orchestra.run.smithi190.stdout:Installed size: 123 M 2024-03-04T08:53:52.285 INFO:teuthology.orchestra.run.smithi190.stdout:Downloading Packages: 2024-03-04T08:53:52.856 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-03-04T08:53:52.896 INFO:teuthology.orchestra.run.smithi190.stdout:(1/4): kernel-5.14.0-427.el9.x86_64.rpm 12 MB/s | 6.0 MB 00:00 2024-03-04T08:53:53.201 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-03-04T08:53:53.201 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-03-04T08:53:53.471 INFO:teuthology.orchestra.run.smithi190.stdout:(2/4): kernel-core-5.14.0-427.el9.x86_64.rpm 20 MB/s | 21 MB 00:01 2024-03-04T08:53:54.138 INFO:teuthology.orchestra.run.smithi190.stdout:(3/4): kernel-modules-5.14.0-427.el9.x86_64.rpm 23 MB/s | 39 MB 00:01 2024-03-04T08:53:54.534 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-03-04T08:53:54.535 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-03-04T08:53:54.738 INFO:teuthology.orchestra.run.smithi190.stdout:(4/4): kernel-modules-core-5.14.0-427.el9.x86_6 18 MB/s | 33 MB 00:01 2024-03-04T08:53:54.739 INFO:teuthology.orchestra.run.smithi190.stdout:-------------------------------------------------------------------------------- 2024-03-04T08:53:54.739 INFO:teuthology.orchestra.run.smithi190.stdout:Total 41 MB/s | 100 MB 00:02 2024-03-04T08:53:55.624 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction check 2024-03-04T08:53:55.986 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction check succeeded. 2024-03-04T08:53:55.987 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction test 2024-03-04T08:53:56.129 INFO:teuthology.orchestra.run.smithi082.stdout:lab-extras 17 kB/s | 1.7 kB 00:00 2024-03-04T08:53:57.222 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-03-04T08:53:57.318 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction test succeeded. 2024-03-04T08:53:57.319 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction 2024-03-04T08:53:57.857 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : kernel-modules-core-5.14.0-427.el9.x86_64 1/4 2024-03-04T08:53:58.014 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-04T08:53:58.310 INFO:teuthology.orchestra.run.smithi082.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-03-04T08:53:58.310 INFO:teuthology.orchestra.run.smithi082.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-03-04T08:53:58.405 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-03-04T08:53:58.413 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-03-04T08:53:58.413 INFO:teuthology.orchestra.run.smithi082.stdout: Package Architecture Version Repository Size 2024-03-04T08:53:58.413 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-03-04T08:53:58.413 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-03-04T08:53:58.414 INFO:teuthology.orchestra.run.smithi082.stdout: kernel x86_64 5.14.0-427.el9 baseos 6.0 M 2024-03-04T08:53:58.414 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2024-03-04T08:53:58.414 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-core x86_64 5.14.0-427.el9 baseos 21 M 2024-03-04T08:53:58.414 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-modules x86_64 5.14.0-427.el9 baseos 39 M 2024-03-04T08:53:58.414 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-modules-core x86_64 5.14.0-427.el9 baseos 33 M 2024-03-04T08:53:58.414 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T08:53:58.414 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-03-04T08:53:58.414 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-03-04T08:53:58.414 INFO:teuthology.orchestra.run.smithi082.stdout:Install 4 Packages 2024-03-04T08:53:58.414 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T08:53:58.414 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 100 M 2024-03-04T08:53:58.414 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 123 M 2024-03-04T08:53:58.414 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-03-04T08:53:58.863 INFO:teuthology.orchestra.run.smithi082.stdout:(1/4): kernel-5.14.0-427.el9.x86_64.rpm 21 MB/s | 6.0 MB 00:00 2024-03-04T08:53:59.197 INFO:teuthology.orchestra.run.smithi082.stdout:(2/4): kernel-core-5.14.0-427.el9.x86_64.rpm 34 MB/s | 21 MB 00:00 2024-03-04T08:53:59.580 INFO:teuthology.orchestra.run.smithi082.stdout:(3/4): kernel-modules-core-5.14.0-427.el9.x86_6 47 MB/s | 33 MB 00:00 2024-03-04T08:53:59.995 INFO:teuthology.orchestra.run.smithi190.stdout: Preparing : 1/1 2024-03-04T08:53:59.997 INFO:teuthology.orchestra.run.smithi082.stdout:(4/4): kernel-modules-5.14.0-427.el9.x86_64.rpm 28 MB/s | 39 MB 00:01 2024-03-04T08:53:59.997 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-03-04T08:53:59.997 INFO:teuthology.orchestra.run.smithi082.stdout:Total 63 MB/s | 100 MB 00:01 2024-03-04T08:54:00.632 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : kernel-modules-core-5.14.0-427.el9.x86_64 1/4 2024-03-04T08:54:00.764 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-04T08:54:00.798 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-04T08:54:00.880 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-03-04T08:54:00.985 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-04T08:54:01.243 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-03-04T08:54:01.243 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-03-04T08:54:02.582 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-03-04T08:54:02.582 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-03-04T08:54:03.535 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-04T08:54:03.716 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-04T08:54:05.308 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-03-04T08:54:05.712 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-04T08:54:05.943 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : kernel-modules-core-5.14.0-427.el9.x86_64 1/4 2024-03-04T08:54:05.945 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : kernel-5.14.0-427.el9.x86_64 4/4 2024-03-04T08:54:06.064 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-04T08:54:08.447 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-04T08:54:08.640 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : kernel-5.14.0-427.el9.x86_64 4/4 2024-03-04T08:54:08.832 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-04T08:54:09.009 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-04T08:54:10.700 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-modules-core-5.14.0-427.el9.x86_64 4/4 2024-03-04T08:54:13.397 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: kernel-modules-core-5.14.0-427.el9.x86_64 4/4 2024-03-04T08:54:13.763 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-04T08:54:13.877 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : kernel-5.14.0-427.el9.x86_64 4/4 2024-03-04T08:54:18.624 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-modules-core-5.14.0-427.el9.x86_64 4/4 2024-03-04T08:54:39.710 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-core-5.14.0-427.el9.x86_64 4/4 2024-03-04T08:54:39.711 INFO:teuthology.orchestra.run.smithi102.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-04T08:54:39.711 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-04T08:54:39.796 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-modules-5.14.0-427.el9.x86_64 4/4 2024-03-04T08:54:40.231 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-5.14.0-427.el9.x86_64 4/4 2024-03-04T08:54:40.231 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : kernel-5.14.0-427.el9.x86_64 1/4 2024-03-04T08:54:40.231 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-04T08:54:40.231 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-04T08:54:40.653 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : kernel-modules-core-5.14.0-427.el9.x86_64 4/4 2024-03-04T08:54:40.653 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-04T08:54:40.653 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-03-04T08:54:40.653 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-5.14.0-427.el9.x86_64 2024-03-04T08:54:40.653 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-core-5.14.0-427.el9.x86_64 2024-03-04T08:54:40.653 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-modules-5.14.0-427.el9.x86_64 2024-03-04T08:54:40.654 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-modules-core-5.14.0-427.el9.x86_64 2024-03-04T08:54:40.654 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-04T08:54:40.654 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-03-04T08:54:41.165 DEBUG:teuthology.orchestra.run.smithi102:> rpm -q kernel | sort -rV | head -n 1 2024-03-04T08:54:41.302 INFO:teuthology.orchestra.run.smithi102.stdout:kernel-5.14.0-427.el9.x86_64 2024-03-04T08:54:41.302 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-427.el9.x86_64 2024-03-04T08:54:41.302 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-427.el9.x86_64 2024-03-04T08:54:41.303 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-04T08:54:41.303 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-04T08:54:41.303 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-03-04T08:54:41.303 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi102.front.sepia.ceph.com, path=None, version=distro) 2024-03-04T08:54:41.303 DEBUG:teuthology.orchestra.run.smithi102:> rpm -q kernel | sort -rV | head -n 1 2024-03-04T08:54:41.422 INFO:teuthology.orchestra.run.smithi102.stdout:kernel-5.14.0-427.el9.x86_64 2024-03-04T08:54:41.423 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-427.el9.x86_64 2024-03-04T08:54:41.423 DEBUG:teuthology.orchestra.run.smithi102:> sudo rpm -qi grub2-tools 2024-03-04T08:54:41.456 INFO:teuthology.orchestra.run.smithi102.stdout:Name : grub2-tools 2024-03-04T08:54:41.457 INFO:teuthology.orchestra.run.smithi102.stdout:Epoch : 1 2024-03-04T08:54:41.457 INFO:teuthology.orchestra.run.smithi102.stdout:Version : 2.06 2024-03-04T08:54:41.457 INFO:teuthology.orchestra.run.smithi102.stdout:Release : 68.el9 2024-03-04T08:54:41.457 INFO:teuthology.orchestra.run.smithi102.stdout:Architecture: x86_64 2024-03-04T08:54:41.457 INFO:teuthology.orchestra.run.smithi102.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-04T08:54:41.457 INFO:teuthology.orchestra.run.smithi102.stdout:Group : Unspecified 2024-03-04T08:54:41.457 INFO:teuthology.orchestra.run.smithi102.stdout:Size : 8264254 2024-03-04T08:54:41.457 INFO:teuthology.orchestra.run.smithi102.stdout:License : GPLv3+ 2024-03-04T08:54:41.457 INFO:teuthology.orchestra.run.smithi102.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-04T08:54:41.457 INFO:teuthology.orchestra.run.smithi102.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-04T08:54:41.457 INFO:teuthology.orchestra.run.smithi102.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-04T08:54:41.457 INFO:teuthology.orchestra.run.smithi102.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-04T08:54:41.457 INFO:teuthology.orchestra.run.smithi102.stdout:Packager : builder@centos.org 2024-03-04T08:54:41.457 INFO:teuthology.orchestra.run.smithi102.stdout:Vendor : CentOS 2024-03-04T08:54:41.458 INFO:teuthology.orchestra.run.smithi102.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-04T08:54:41.458 INFO:teuthology.orchestra.run.smithi102.stdout:Summary : Support tools for GRUB. 2024-03-04T08:54:41.458 INFO:teuthology.orchestra.run.smithi102.stdout:Description : 2024-03-04T08:54:41.458 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-04T08:54:41.458 INFO:teuthology.orchestra.run.smithi102.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-04T08:54:41.458 INFO:teuthology.orchestra.run.smithi102.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-04T08:54:41.458 INFO:teuthology.orchestra.run.smithi102.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-04T08:54:41.458 INFO:teuthology.orchestra.run.smithi102.stdout:hardware devices. 2024-03-04T08:54:41.458 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-04T08:54:41.458 INFO:teuthology.orchestra.run.smithi102.stdout:This subpackage provides tools for support of all platforms. 2024-03-04T08:54:41.459 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-04T08:54:41.459 INFO:teuthology.task.kernel:Updating grub on smithi102 to boot 5.14.0-427.el9.x86_64 2024-03-04T08:54:41.459 DEBUG:teuthology.orchestra.run.smithi102:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-04T08:54:42.090 INFO:teuthology.orchestra.run.smithi102.stderr:Generating grub configuration file ... 2024-03-04T08:54:42.704 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: kernel-core-5.14.0-427.el9.x86_64 4/4 2024-03-04T08:54:42.704 INFO:teuthology.orchestra.run.smithi190.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-04T08:54:42.705 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-03-04T08:54:42.788 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: kernel-modules-5.14.0-427.el9.x86_64 4/4 2024-03-04T08:54:43.244 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: kernel-5.14.0-427.el9.x86_64 4/4 2024-03-04T08:54:43.244 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : kernel-5.14.0-427.el9.x86_64 1/4 2024-03-04T08:54:43.245 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-04T08:54:43.245 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-04T08:54:43.470 INFO:teuthology.orchestra.run.smithi102.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-04T08:54:43.490 INFO:teuthology.orchestra.run.smithi102.stderr:done 2024-03-04T08:54:43.492 DEBUG:teuthology.orchestra.run.smithi102:> mktemp 2024-03-04T08:54:43.508 INFO:teuthology.orchestra.run.smithi102.stdout:/tmp/tmp.uiqIXXIfzA 2024-03-04T08:54:43.509 DEBUG:teuthology.orchestra.run.smithi102:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.uiqIXXIfzA 2024-03-04T08:54:43.576 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0666 /tmp/tmp.uiqIXXIfzA 2024-03-04T08:54:43.640 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : kernel-modules-core-5.14.0-427.el9.x86_64 4/4 2024-03-04T08:54:43.641 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-03-04T08:54:43.641 INFO:teuthology.orchestra.run.smithi190.stdout:Installed: 2024-03-04T08:54:43.641 INFO:teuthology.orchestra.run.smithi190.stdout: kernel-5.14.0-427.el9.x86_64 2024-03-04T08:54:43.641 INFO:teuthology.orchestra.run.smithi190.stdout: kernel-core-5.14.0-427.el9.x86_64 2024-03-04T08:54:43.641 INFO:teuthology.orchestra.run.smithi190.stdout: kernel-modules-5.14.0-427.el9.x86_64 2024-03-04T08:54:43.641 INFO:teuthology.orchestra.run.smithi190.stdout: kernel-modules-core-5.14.0-427.el9.x86_64 2024-03-04T08:54:43.641 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-03-04T08:54:43.642 INFO:teuthology.orchestra.run.smithi190.stdout:Complete! 2024-03-04T08:54:43.719 DEBUG:teuthology.orchestra.remote:smithi102:/tmp/tmp.uiqIXXIfzA is 6KB 2024-03-04T08:54:43.767 DEBUG:teuthology.orchestra.run.smithi102:> rm -fr /tmp/tmp.uiqIXXIfzA 2024-03-04T08:54:43.781 DEBUG:teuthology.orchestra.run.smithi102:> sudo /bin/ls /boot/loader/entries || true 2024-03-04T08:54:43.852 INFO:teuthology.orchestra.run.smithi102.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-04T08:54:43.852 INFO:teuthology.orchestra.run.smithi102.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-04T08:54:43.852 INFO:teuthology.orchestra.run.smithi102.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-04T08:54:43.852 INFO:teuthology.orchestra.run.smithi102.stdout:15949e3c88704300882482eddfd7baae-5.14.0-427.el9.x86_64.conf 2024-03-04T08:54:43.854 DEBUG:teuthology.orchestra.run.smithi102:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-427.el9.x86_64 2024-03-04T08:54:44.009 DEBUG:teuthology.orchestra.run.smithi102:> sudo shutdown -r now 2024-03-04T08:54:44.119 DEBUG:teuthology.orchestra.run.smithi190:> rpm -q kernel | sort -rV | head -n 1 2024-03-04T08:54:44.262 INFO:teuthology.orchestra.run.smithi190.stdout:kernel-5.14.0-427.el9.x86_64 2024-03-04T08:54:44.262 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-427.el9.x86_64 2024-03-04T08:54:44.262 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-427.el9.x86_64 2024-03-04T08:54:44.262 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-04T08:54:44.262 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-04T08:54:44.262 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2024-03-04T08:54:44.262 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi190.front.sepia.ceph.com, path=None, version=distro) 2024-03-04T08:54:44.262 DEBUG:teuthology.orchestra.run.smithi190:> rpm -q kernel | sort -rV | head -n 1 2024-03-04T08:54:44.383 INFO:teuthology.orchestra.run.smithi190.stdout:kernel-5.14.0-427.el9.x86_64 2024-03-04T08:54:44.383 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-427.el9.x86_64 2024-03-04T08:54:44.384 DEBUG:teuthology.orchestra.run.smithi190:> sudo rpm -qi grub2-tools 2024-03-04T08:54:44.418 INFO:teuthology.orchestra.run.smithi190.stdout:Name : grub2-tools 2024-03-04T08:54:44.418 INFO:teuthology.orchestra.run.smithi190.stdout:Epoch : 1 2024-03-04T08:54:44.418 INFO:teuthology.orchestra.run.smithi190.stdout:Version : 2.06 2024-03-04T08:54:44.418 INFO:teuthology.orchestra.run.smithi190.stdout:Release : 68.el9 2024-03-04T08:54:44.418 INFO:teuthology.orchestra.run.smithi190.stdout:Architecture: x86_64 2024-03-04T08:54:44.418 INFO:teuthology.orchestra.run.smithi190.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-04T08:54:44.418 INFO:teuthology.orchestra.run.smithi190.stdout:Group : Unspecified 2024-03-04T08:54:44.419 INFO:teuthology.orchestra.run.smithi190.stdout:Size : 8264254 2024-03-04T08:54:44.419 INFO:teuthology.orchestra.run.smithi190.stdout:License : GPLv3+ 2024-03-04T08:54:44.419 INFO:teuthology.orchestra.run.smithi190.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-04T08:54:44.419 INFO:teuthology.orchestra.run.smithi190.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-04T08:54:44.419 INFO:teuthology.orchestra.run.smithi190.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-04T08:54:44.419 INFO:teuthology.orchestra.run.smithi190.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-04T08:54:44.419 INFO:teuthology.orchestra.run.smithi190.stdout:Packager : builder@centos.org 2024-03-04T08:54:44.419 INFO:teuthology.orchestra.run.smithi190.stdout:Vendor : CentOS 2024-03-04T08:54:44.419 INFO:teuthology.orchestra.run.smithi190.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-04T08:54:44.419 INFO:teuthology.orchestra.run.smithi190.stdout:Summary : Support tools for GRUB. 2024-03-04T08:54:44.419 INFO:teuthology.orchestra.run.smithi190.stdout:Description : 2024-03-04T08:54:44.419 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-03-04T08:54:44.419 INFO:teuthology.orchestra.run.smithi190.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-04T08:54:44.419 INFO:teuthology.orchestra.run.smithi190.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-04T08:54:44.419 INFO:teuthology.orchestra.run.smithi190.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-04T08:54:44.420 INFO:teuthology.orchestra.run.smithi190.stdout:hardware devices. 2024-03-04T08:54:44.420 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-03-04T08:54:44.420 INFO:teuthology.orchestra.run.smithi190.stdout:This subpackage provides tools for support of all platforms. 2024-03-04T08:54:44.420 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-04T08:54:44.421 INFO:teuthology.task.kernel:Updating grub on smithi190 to boot 5.14.0-427.el9.x86_64 2024-03-04T08:54:44.421 DEBUG:teuthology.orchestra.run.smithi190:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-04T08:54:45.005 INFO:teuthology.orchestra.run.smithi190.stderr:Generating grub configuration file ... 2024-03-04T08:54:46.435 INFO:teuthology.orchestra.run.smithi190.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-04T08:54:46.469 INFO:teuthology.orchestra.run.smithi190.stderr:done 2024-03-04T08:54:46.471 DEBUG:teuthology.orchestra.run.smithi190:> mktemp 2024-03-04T08:54:46.486 INFO:teuthology.orchestra.run.smithi190.stdout:/tmp/tmp.NyEgAzDgyV 2024-03-04T08:54:46.486 DEBUG:teuthology.orchestra.run.smithi190:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.NyEgAzDgyV 2024-03-04T08:54:46.553 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 0666 /tmp/tmp.NyEgAzDgyV 2024-03-04T08:54:46.698 DEBUG:teuthology.orchestra.remote:smithi190:/tmp/tmp.NyEgAzDgyV is 6KB 2024-03-04T08:54:46.747 DEBUG:teuthology.orchestra.run.smithi190:> rm -fr /tmp/tmp.NyEgAzDgyV 2024-03-04T08:54:46.760 DEBUG:teuthology.orchestra.run.smithi190:> sudo /bin/ls /boot/loader/entries || true 2024-03-04T08:54:46.825 INFO:teuthology.orchestra.run.smithi190.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-04T08:54:46.826 INFO:teuthology.orchestra.run.smithi190.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-04T08:54:46.826 INFO:teuthology.orchestra.run.smithi190.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-04T08:54:46.826 INFO:teuthology.orchestra.run.smithi190.stdout:15949e3c88704300882482eddfd7baae-5.14.0-427.el9.x86_64.conf 2024-03-04T08:54:46.827 DEBUG:teuthology.orchestra.run.smithi190:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-427.el9.x86_64 2024-03-04T08:54:46.962 DEBUG:teuthology.orchestra.run.smithi190:> sudo shutdown -r now 2024-03-04T08:54:47.839 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-core-5.14.0-427.el9.x86_64 4/4 2024-03-04T08:54:47.839 INFO:teuthology.orchestra.run.smithi082.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-04T08:54:47.839 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T08:54:47.923 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-modules-5.14.0-427.el9.x86_64 4/4 2024-03-04T08:54:48.373 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-5.14.0-427.el9.x86_64 4/4 2024-03-04T08:54:48.374 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : kernel-5.14.0-427.el9.x86_64 1/4 2024-03-04T08:54:48.374 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-04T08:54:48.374 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-04T08:54:48.832 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : kernel-modules-core-5.14.0-427.el9.x86_64 4/4 2024-03-04T08:54:48.832 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T08:54:48.832 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-03-04T08:54:48.833 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-5.14.0-427.el9.x86_64 2024-03-04T08:54:48.833 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-core-5.14.0-427.el9.x86_64 2024-03-04T08:54:48.833 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-modules-5.14.0-427.el9.x86_64 2024-03-04T08:54:48.833 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-modules-core-5.14.0-427.el9.x86_64 2024-03-04T08:54:48.833 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T08:54:48.833 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-03-04T08:54:49.362 DEBUG:teuthology.orchestra.run.smithi082:> rpm -q kernel | sort -rV | head -n 1 2024-03-04T08:54:49.525 INFO:teuthology.orchestra.run.smithi082.stdout:kernel-5.14.0-427.el9.x86_64 2024-03-04T08:54:49.526 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-427.el9.x86_64 2024-03-04T08:54:49.526 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-427.el9.x86_64 2024-03-04T08:54:49.526 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-04T08:54:49.526 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-04T08:54:49.526 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-03-04T08:54:49.526 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi082.front.sepia.ceph.com, path=None, version=distro) 2024-03-04T08:54:49.527 DEBUG:teuthology.orchestra.run.smithi082:> rpm -q kernel | sort -rV | head -n 1 2024-03-04T08:54:49.648 INFO:teuthology.orchestra.run.smithi082.stdout:kernel-5.14.0-427.el9.x86_64 2024-03-04T08:54:49.648 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-427.el9.x86_64 2024-03-04T08:54:49.649 DEBUG:teuthology.orchestra.run.smithi082:> sudo rpm -qi grub2-tools 2024-03-04T08:54:49.693 INFO:teuthology.orchestra.run.smithi082.stdout:Name : grub2-tools 2024-03-04T08:54:49.693 INFO:teuthology.orchestra.run.smithi082.stdout:Epoch : 1 2024-03-04T08:54:49.693 INFO:teuthology.orchestra.run.smithi082.stdout:Version : 2.06 2024-03-04T08:54:49.693 INFO:teuthology.orchestra.run.smithi082.stdout:Release : 68.el9 2024-03-04T08:54:49.694 INFO:teuthology.orchestra.run.smithi082.stdout:Architecture: x86_64 2024-03-04T08:54:49.694 INFO:teuthology.orchestra.run.smithi082.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-04T08:54:49.694 INFO:teuthology.orchestra.run.smithi082.stdout:Group : Unspecified 2024-03-04T08:54:49.694 INFO:teuthology.orchestra.run.smithi082.stdout:Size : 8264254 2024-03-04T08:54:49.694 INFO:teuthology.orchestra.run.smithi082.stdout:License : GPLv3+ 2024-03-04T08:54:49.695 INFO:teuthology.orchestra.run.smithi082.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-04T08:54:49.695 INFO:teuthology.orchestra.run.smithi082.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-04T08:54:49.695 INFO:teuthology.orchestra.run.smithi082.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-04T08:54:49.695 INFO:teuthology.orchestra.run.smithi082.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-04T08:54:49.695 INFO:teuthology.orchestra.run.smithi082.stdout:Packager : builder@centos.org 2024-03-04T08:54:49.696 INFO:teuthology.orchestra.run.smithi082.stdout:Vendor : CentOS 2024-03-04T08:54:49.696 INFO:teuthology.orchestra.run.smithi082.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-04T08:54:49.696 INFO:teuthology.orchestra.run.smithi082.stdout:Summary : Support tools for GRUB. 2024-03-04T08:54:49.696 INFO:teuthology.orchestra.run.smithi082.stdout:Description : 2024-03-04T08:54:49.696 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T08:54:49.696 INFO:teuthology.orchestra.run.smithi082.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-04T08:54:49.697 INFO:teuthology.orchestra.run.smithi082.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-04T08:54:49.697 INFO:teuthology.orchestra.run.smithi082.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-04T08:54:49.697 INFO:teuthology.orchestra.run.smithi082.stdout:hardware devices. 2024-03-04T08:54:49.697 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T08:54:49.697 INFO:teuthology.orchestra.run.smithi082.stdout:This subpackage provides tools for support of all platforms. 2024-03-04T08:54:49.699 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-04T08:54:49.699 INFO:teuthology.task.kernel:Updating grub on smithi082 to boot 5.14.0-427.el9.x86_64 2024-03-04T08:54:49.699 DEBUG:teuthology.orchestra.run.smithi082:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-04T08:54:50.297 INFO:teuthology.orchestra.run.smithi082.stderr:Generating grub configuration file ... 2024-03-04T08:54:51.670 INFO:teuthology.orchestra.run.smithi082.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-04T08:54:51.703 INFO:teuthology.orchestra.run.smithi082.stderr:done 2024-03-04T08:54:51.705 DEBUG:teuthology.orchestra.run.smithi082:> mktemp 2024-03-04T08:54:51.721 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/tmp.tDSMHrvkgf 2024-03-04T08:54:51.722 DEBUG:teuthology.orchestra.run.smithi082:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.tDSMHrvkgf 2024-03-04T08:54:51.789 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0666 /tmp/tmp.tDSMHrvkgf 2024-03-04T08:54:51.928 DEBUG:teuthology.orchestra.remote:smithi082:/tmp/tmp.tDSMHrvkgf is 6KB 2024-03-04T08:54:51.977 DEBUG:teuthology.orchestra.run.smithi082:> rm -fr /tmp/tmp.tDSMHrvkgf 2024-03-04T08:54:51.991 DEBUG:teuthology.orchestra.run.smithi082:> sudo /bin/ls /boot/loader/entries || true 2024-03-04T08:54:52.069 INFO:teuthology.orchestra.run.smithi082.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-04T08:54:52.069 INFO:teuthology.orchestra.run.smithi082.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-04T08:54:52.069 INFO:teuthology.orchestra.run.smithi082.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-04T08:54:52.069 INFO:teuthology.orchestra.run.smithi082.stdout:15949e3c88704300882482eddfd7baae-5.14.0-427.el9.x86_64.conf 2024-03-04T08:54:52.070 DEBUG:teuthology.orchestra.run.smithi082:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-427.el9.x86_64 2024-03-04T08:54:52.229 DEBUG:teuthology.orchestra.run.smithi082:> sudo shutdown -r now 2024-03-04T08:55:14.034 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-03-04T08:55:14.035 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-03-04T08:55:14.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T08:55:16.968 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2024-03-04T08:55:16.968 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2024-03-04T08:55:16.969 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T08:55:22.236 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-03-04T08:55:22.236 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-03-04T08:55:22.237 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T08:55:32.416 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.102 2024-03-04T08:55:35.488 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.190 2024-03-04T08:55:40.608 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-03-04T08:55:41.418 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-03-04T08:55:41.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T08:55:44.492 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2024-03-04T08:55:44.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T08:55:47.548 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.190 2024-03-04T08:55:49.611 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-03-04T08:55:49.611 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T08:55:52.668 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-03-04T08:55:59.556 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2024-03-04T08:55:59.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T08:56:04.672 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-03-04T08:56:04.673 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T08:56:23.100 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-03-04T08:56:31.446 DEBUG:teuthology.orchestra.run.smithi190:> true 2024-03-04T08:56:31.886 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi190.front.sepia.ceph.com' 2024-03-04T08:56:31.887 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-427.el9.x86_64"... 2024-03-04T08:56:31.887 DEBUG:teuthology.orchestra.run.smithi190:> uname -r 2024-03-04T08:56:31.900 INFO:teuthology.orchestra.run.smithi190.stdout:5.14.0-427.el9.x86_64 2024-03-04T08:56:31.901 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-427.el9.x86_64 vs 5.14.0-427.el9.x86_64 2024-03-04T08:56:31.901 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-04T08:56:31.901 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-04T08:56:32.901 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2024-03-04T08:56:32.902 DEBUG:teuthology.orchestra.run.smithi190:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-04T08:56:32.964 INFO:teuthology.orchestra.run.smithi190.stdout:ttyS1 2024-03-04T08:56:33.014 DEBUG:teuthology.parallel:result is None 2024-03-04T08:56:38.102 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-03-04T08:56:38.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T08:56:38.500 DEBUG:teuthology.orchestra.run.smithi082:> true 2024-03-04T08:56:38.905 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-03-04T08:56:38.905 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-427.el9.x86_64"... 2024-03-04T08:56:38.905 DEBUG:teuthology.orchestra.run.smithi082:> uname -r 2024-03-04T08:56:38.920 INFO:teuthology.orchestra.run.smithi082.stdout:5.14.0-427.el9.x86_64 2024-03-04T08:56:38.920 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-427.el9.x86_64 vs 5.14.0-427.el9.x86_64 2024-03-04T08:56:38.920 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-04T08:56:38.920 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-04T08:56:39.921 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-03-04T08:56:39.921 DEBUG:teuthology.orchestra.run.smithi082:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-04T08:56:39.997 INFO:teuthology.orchestra.run.smithi082.stdout:ttyS1 2024-03-04T08:56:40.039 DEBUG:teuthology.parallel:result is None 2024-03-04T08:56:41.421 DEBUG:teuthology.orchestra.remote:timed out 2024-03-04T08:56:53.423 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-03-04T08:56:53.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T08:56:53.717 DEBUG:teuthology.orchestra.run.smithi102:> true 2024-03-04T08:56:54.114 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-03-04T08:56:54.114 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-427.el9.x86_64"... 2024-03-04T08:56:54.114 DEBUG:teuthology.orchestra.run.smithi102:> uname -r 2024-03-04T08:56:54.129 INFO:teuthology.orchestra.run.smithi102.stdout:5.14.0-427.el9.x86_64 2024-03-04T08:56:54.129 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-427.el9.x86_64 vs 5.14.0-427.el9.x86_64 2024-03-04T08:56:54.129 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-04T08:56:54.130 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-04T08:56:55.131 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-03-04T08:56:55.131 DEBUG:teuthology.orchestra.run.smithi102:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-04T08:56:55.219 INFO:teuthology.orchestra.run.smithi102.stdout:ttyS1 2024-03-04T08:56:55.260 DEBUG:teuthology.parallel:result is None 2024-03-04T08:56:55.260 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-04T08:56:55.268 INFO:teuthology.task.internal:Creating test directory... 2024-03-04T08:56:55.268 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-04T08:56:55.271 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-04T08:56:55.273 DEBUG:teuthology.orchestra.run.smithi190:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-04T08:56:55.291 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-04T08:56:55.298 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-04T08:56:55.306 INFO:teuthology.task.internal:Creating archive directory... 2024-03-04T08:56:55.306 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-04T08:56:55.330 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-04T08:56:55.332 DEBUG:teuthology.orchestra.run.smithi190:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-04T08:56:55.418 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-04T08:56:55.425 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-04T08:56:55.425 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-04T08:56:55.427 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-04T08:56:55.429 DEBUG:teuthology.orchestra.run.smithi190:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-04T08:56:55.466 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-04T08:56:55.467 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-04T08:56:55.480 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-04T08:56:55.480 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-04T08:56:55.481 INFO:teuthology.orchestra.run.smithi190.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-04T08:56:55.496 INFO:teuthology.orchestra.run.smithi190.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-04T08:56:55.498 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-04T08:56:55.504 INFO:teuthology.task.internal:Configuring sudo... 2024-03-04T08:56:55.504 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-04T08:56:55.524 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-04T08:56:55.526 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-04T08:56:55.556 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-04T08:56:55.565 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-04T08:56:55.566 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-04T08:56:55.594 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-04T08:56:55.597 DEBUG:teuthology.orchestra.run.smithi190:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-04T08:56:55.613 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-04T08:56:55.699 DEBUG:teuthology.orchestra.run.smithi082:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-04T08:56:55.738 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-04T08:56:55.828 DEBUG:teuthology.orchestra.run.smithi082:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-04T08:56:55.862 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-03-04T08:56:55.862 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-04T08:56:55.929 DEBUG:teuthology.orchestra.run.smithi102:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-04T08:56:55.979 DEBUG:teuthology.orchestra.run.smithi102:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-04T08:56:56.024 DEBUG:teuthology.orchestra.run.smithi102:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-04T08:56:56.117 DEBUG:teuthology.orchestra.run.smithi102:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-04T08:56:56.150 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-03-04T08:56:56.150 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-04T08:56:56.218 DEBUG:teuthology.orchestra.run.smithi190:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-04T08:56:56.273 DEBUG:teuthology.orchestra.run.smithi190:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-04T08:56:56.340 DEBUG:teuthology.orchestra.run.smithi190:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-04T08:56:56.395 DEBUG:teuthology.orchestra.run.smithi190:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-04T08:56:56.427 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-03-04T08:56:56.427 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-04T08:56:56.495 DEBUG:teuthology.orchestra.run.smithi082:> sudo service rsyslog restart 2024-03-04T08:56:56.498 DEBUG:teuthology.orchestra.run.smithi102:> sudo service rsyslog restart 2024-03-04T08:56:56.500 DEBUG:teuthology.orchestra.run.smithi190:> sudo service rsyslog restart 2024-03-04T08:56:56.546 INFO:teuthology.orchestra.run.smithi102.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-04T08:56:56.547 INFO:teuthology.orchestra.run.smithi082.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-04T08:56:56.595 INFO:teuthology.orchestra.run.smithi190.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-04T08:56:56.961 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-04T08:56:56.969 INFO:teuthology.task.internal:Starting timer... 2024-03-04T08:56:56.970 INFO:teuthology.run_tasks:Running task pcp... 2024-03-04T08:56:56.995 INFO:teuthology.run_tasks:Running task selinux... 2024-03-04T08:56:57.004 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-03-04T08:56:57.004 DEBUG:teuthology.orchestra.run.smithi082:> sudo service auditd rotate 2024-03-04T08:56:57.057 INFO:teuthology.orchestra.run.smithi082.stdout:Rotating logs: 2024-03-04T08:56:57.059 DEBUG:teuthology.orchestra.run.smithi102:> sudo service auditd rotate 2024-03-04T08:56:57.114 INFO:teuthology.orchestra.run.smithi102.stdout:Rotating logs: 2024-03-04T08:56:57.116 DEBUG:teuthology.orchestra.run.smithi190:> sudo service auditd rotate 2024-03-04T08:56:57.170 INFO:teuthology.orchestra.run.smithi190.stdout:Rotating logs: 2024-03-04T08:56:57.172 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-04T08:56:57.172 DEBUG:teuthology.orchestra.run.smithi082:> /usr/sbin/getenforce 2024-03-04T08:56:57.198 INFO:teuthology.orchestra.run.smithi082.stdout:Permissive 2024-03-04T08:56:57.198 DEBUG:teuthology.orchestra.run.smithi102:> /usr/sbin/getenforce 2024-03-04T08:56:57.217 INFO:teuthology.orchestra.run.smithi102.stdout:Permissive 2024-03-04T08:56:57.218 DEBUG:teuthology.orchestra.run.smithi190:> /usr/sbin/getenforce 2024-03-04T08:56:57.239 INFO:teuthology.orchestra.run.smithi190.stdout:Permissive 2024-03-04T08:56:57.239 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi082.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi102.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi190.front.sepia.ceph.com': 'permissive'} 2024-03-04T08:56:57.240 DEBUG:teuthology.orchestra.run.smithi082:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-04T08:56:57.269 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T08:56:57.270 DEBUG:teuthology.orchestra.run.smithi102:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-04T08:56:57.297 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T08:56:57.298 DEBUG:teuthology.orchestra.run.smithi190:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-04T08:56:57.325 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T08:56:57.326 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-04T08:56:57.326 DEBUG:teuthology.orchestra.run.smithi082:> sudo /usr/sbin/setenforce permissive 2024-03-04T08:56:57.366 DEBUG:teuthology.orchestra.run.smithi102:> sudo /usr/sbin/setenforce permissive 2024-03-04T08:56:57.403 DEBUG:teuthology.orchestra.run.smithi190:> sudo /usr/sbin/setenforce permissive 2024-03-04T08:56:57.441 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-04T08:56:57.451 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-04T08:56:57.468 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-04T08:56:57.469 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi082.front.sepia.ceph.com,smithi102.front.sepia.ceph.com,smithi190.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-04T09:01:11.913 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi082.front.sepia.ceph.com'), Remote(name='ubuntu@smithi102.front.sepia.ceph.com'), Remote(name='ubuntu@smithi190.front.sepia.ceph.com')] 2024-03-04T09:01:11.915 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-03-04T09:01:11.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T09:01:12.061 DEBUG:teuthology.orchestra.run.smithi082:> true 2024-03-04T09:01:12.142 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-03-04T09:01:12.143 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-03-04T09:01:12.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T09:01:12.243 DEBUG:teuthology.orchestra.run.smithi102:> true 2024-03-04T09:01:12.319 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-03-04T09:01:12.320 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2024-03-04T09:01:12.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T09:01:12.420 DEBUG:teuthology.orchestra.run.smithi190:> true 2024-03-04T09:01:12.499 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi190.front.sepia.ceph.com' 2024-03-04T09:01:12.500 INFO:teuthology.run_tasks:Running task clock... 2024-03-04T09:01:12.510 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-04T09:01:12.511 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-04T09:01:12.511 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-04T09:01:12.514 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-04T09:01:12.514 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-04T09:01:12.516 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-04T09:01:12.516 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-04T09:01:12.543 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-04T09:01:12.545 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-04T09:01:12.560 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-04T09:01:12.561 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-04T09:01:12.575 INFO:teuthology.orchestra.run.smithi190.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-04T09:01:12.590 INFO:teuthology.orchestra.run.smithi082.stderr:sudo: ntpd: command not found 2024-03-04T09:01:12.590 INFO:teuthology.orchestra.run.smithi102.stderr:sudo: ntpd: command not found 2024-03-04T09:01:12.592 INFO:teuthology.orchestra.run.smithi190.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-04T09:01:12.603 INFO:teuthology.orchestra.run.smithi082.stdout:506 Cannot talk to daemon 2024-03-04T09:01:12.604 INFO:teuthology.orchestra.run.smithi102.stdout:506 Cannot talk to daemon 2024-03-04T09:01:12.620 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-04T09:01:12.620 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-04T09:01:12.622 INFO:teuthology.orchestra.run.smithi190.stderr:sudo: ntpd: command not found 2024-03-04T09:01:12.636 INFO:teuthology.orchestra.run.smithi190.stdout:506 Cannot talk to daemon 2024-03-04T09:01:12.636 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-04T09:01:12.637 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-04T09:01:12.652 INFO:teuthology.orchestra.run.smithi190.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-04T09:01:12.668 INFO:teuthology.orchestra.run.smithi190.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-04T09:01:12.685 INFO:teuthology.orchestra.run.smithi082.stderr:bash: line 1: ntpq: command not found 2024-03-04T09:01:12.689 INFO:teuthology.orchestra.run.smithi082.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-04T09:01:12.689 INFO:teuthology.orchestra.run.smithi082.stdout:=============================================================================== 2024-03-04T09:01:12.689 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T09:01:12.689 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T09:01:12.689 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T09:01:12.689 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T09:01:12.691 INFO:teuthology.orchestra.run.smithi102.stderr:bash: line 1: ntpq: command not found 2024-03-04T09:01:12.694 INFO:teuthology.orchestra.run.smithi102.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-04T09:01:12.694 INFO:teuthology.orchestra.run.smithi102.stdout:=============================================================================== 2024-03-04T09:01:12.694 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T09:01:12.694 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T09:01:12.694 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T09:01:12.695 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T09:01:12.727 INFO:teuthology.orchestra.run.smithi190.stderr:bash: line 1: ntpq: command not found 2024-03-04T09:01:12.729 INFO:teuthology.orchestra.run.smithi190.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-04T09:01:12.730 INFO:teuthology.orchestra.run.smithi190.stdout:=============================================================================== 2024-03-04T09:01:12.730 INFO:teuthology.orchestra.run.smithi190.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T09:01:12.730 INFO:teuthology.orchestra.run.smithi190.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T09:01:12.730 INFO:teuthology.orchestra.run.smithi190.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T09:01:12.730 INFO:teuthology.orchestra.run.smithi190.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T09:01:12.731 INFO:teuthology.run_tasks:Running task install... 2024-03-04T09:01:12.739 DEBUG:teuthology.task.install:project ceph 2024-03-04T09:01:12.740 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd'}} 2024-03-04T09:01:12.740 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd'} 2024-03-04T09:01:12.740 INFO:teuthology.task.install:Using flavor: default 2024-03-04T09:01:12.746 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-04T09:01:12.746 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-03-04T09:01:12.746 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd', 'tag': None, 'wait_for_package': False} 2024-03-04T09:01:12.747 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd 2024-03-04T09:01:12.752 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd', 'tag': None, 'wait_for_package': False} 2024-03-04T09:01:12.752 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd 2024-03-04T09:01:12.753 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd', 'tag': None, 'wait_for_package': False} 2024-03-04T09:01:12.753 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd 2024-03-04T09:01:12.941 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb/1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/centos/9/flavors/default/ 2024-03-04T09:01:12.941 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1739.g1bc250c7 2024-03-04T09:01:13.019 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb/1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/centos/9/flavors/default/ 2024-03-04T09:01:13.019 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1739.g1bc250c7 2024-03-04T09:01:13.020 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb/1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/centos/9/flavors/default/ 2024-03-04T09:01:13.021 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1739.g1bc250c7 2024-03-04T09:01:13.087 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb/1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb/1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb/1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-04T09:01:13.087 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-03-04T09:01:13.087 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-04T09:01:13.125 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-04T09:01:13.125 DEBUG:teuthology.orchestra.run.smithi190:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-04T09:01:13.193 DEBUG:teuthology.orchestra.run.smithi190:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-04T09:01:13.215 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb/1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb/1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb/1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-04T09:01:13.215 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-03-04T09:01:13.215 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-04T09:01:13.226 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb/1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb/1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb/1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-04T09:01:13.226 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-03-04T09:01:13.226 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-04T09:01:13.244 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-04T09:01:13.244 DEBUG:teuthology.orchestra.run.smithi082:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-04T09:01:13.255 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-04T09:01:13.256 DEBUG:teuthology.orchestra.run.smithi102:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-04T09:01:13.273 DEBUG:teuthology.orchestra.run.smithi190:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-04T09:01:13.313 DEBUG:teuthology.orchestra.run.smithi082:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-04T09:01:13.324 DEBUG:teuthology.orchestra.run.smithi102:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-04T09:01:13.339 INFO:teuthology.orchestra.run.smithi190.stdout:check_obsoletes = 1 2024-03-04T09:01:13.340 DEBUG:teuthology.orchestra.run.smithi190:> sudo yum clean all 2024-03-04T09:01:13.393 DEBUG:teuthology.orchestra.run.smithi082:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-04T09:01:13.404 DEBUG:teuthology.orchestra.run.smithi102:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-04T09:01:13.460 INFO:teuthology.orchestra.run.smithi082.stdout:check_obsoletes = 1 2024-03-04T09:01:13.462 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum clean all 2024-03-04T09:01:13.470 INFO:teuthology.orchestra.run.smithi102.stdout:check_obsoletes = 1 2024-03-04T09:01:13.472 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum clean all 2024-03-04T09:01:13.581 INFO:teuthology.orchestra.run.smithi190.stdout:74 files removed 2024-03-04T09:01:13.608 DEBUG:teuthology.orchestra.run.smithi190:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-04T09:01:13.727 INFO:teuthology.orchestra.run.smithi082.stdout:74 files removed 2024-03-04T09:01:13.730 INFO:teuthology.orchestra.run.smithi102.stdout:74 files removed 2024-03-04T09:01:13.754 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-04T09:01:13.757 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-04T09:01:14.392 INFO:teuthology.orchestra.run.smithi082.stdout:ceph packages for x86_64 259 kB/s | 83 kB 00:00 2024-03-04T09:01:14.613 INFO:teuthology.orchestra.run.smithi102.stdout:ceph packages for x86_64 155 kB/s | 83 kB 00:00 2024-03-04T09:01:14.650 INFO:teuthology.orchestra.run.smithi190.stdout:ceph packages for x86_64 114 kB/s | 83 kB 00:00 2024-03-04T09:01:14.834 INFO:teuthology.orchestra.run.smithi082.stdout:ceph noarch packages 25 kB/s | 10 kB 00:00 2024-03-04T09:01:15.125 INFO:teuthology.orchestra.run.smithi190.stdout:ceph noarch packages 23 kB/s | 10 kB 00:00 2024-03-04T09:01:15.238 INFO:teuthology.orchestra.run.smithi102.stdout:ceph noarch packages 17 kB/s | 10 kB 00:00 2024-03-04T09:01:15.318 INFO:teuthology.orchestra.run.smithi082.stdout:ceph source packages 4.3 kB/s | 1.9 kB 00:00 2024-03-04T09:01:15.631 INFO:teuthology.orchestra.run.smithi102.stdout:ceph source packages 5.4 kB/s | 1.9 kB 00:00 2024-03-04T09:01:15.676 INFO:teuthology.orchestra.run.smithi190.stdout:ceph source packages 3.7 kB/s | 1.9 kB 00:00 2024-03-04T09:01:15.929 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS-9 - AppStream 12 MB/s | 6.7 MB 00:00 2024-03-04T09:01:16.544 INFO:teuthology.orchestra.run.smithi190.stdout:CentOS-9 - AppStream 8.1 MB/s | 6.7 MB 00:00 2024-03-04T09:01:16.675 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS-9 - AppStream 6.7 MB/s | 6.7 MB 00:01 2024-03-04T09:01:17.454 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS-9 - BaseOS 4.9 MB/s | 2.0 MB 00:00 2024-03-04T09:01:17.945 INFO:teuthology.orchestra.run.smithi190.stdout:CentOS-9 - BaseOS 6.9 MB/s | 2.0 MB 00:00 2024-03-04T09:01:18.308 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS-9 - BaseOS 3.8 MB/s | 2.0 MB 00:00 2024-03-04T09:01:18.697 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - BaseOS 8.8 MB/s | 8.0 MB 00:00 2024-03-04T09:01:19.385 INFO:teuthology.orchestra.run.smithi190.stdout:CentOS Stream 9 - BaseOS 7.2 MB/s | 8.0 MB 00:01 2024-03-04T09:01:21.137 INFO:teuthology.orchestra.run.smithi190.stdout:CentOS Stream 9 - AppStream 28 MB/s | 19 MB 00:00 2024-03-04T09:01:25.298 INFO:teuthology.orchestra.run.smithi190.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.1 MB 00:00 2024-03-04T09:01:27.321 INFO:teuthology.orchestra.run.smithi190.stdout:CentOS Stream 9 - Extras packages 22 kB/s | 15 kB 00:00 2024-03-04T09:01:27.515 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - BaseOS 925 kB/s | 8.0 MB 00:08 2024-03-04T09:01:28.406 INFO:teuthology.orchestra.run.smithi190.stdout:Extra Packages for Enterprise Linux 21 MB/s | 20 MB 00:00 2024-03-04T09:01:30.282 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - AppStream 11 MB/s | 19 MB 00:01 2024-03-04T09:01:35.572 INFO:teuthology.orchestra.run.smithi190.stdout:lab-extras 751 B/s | 1.7 kB 00:02 2024-03-04T09:01:36.800 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - CRB 2.1 MB/s | 6.1 MB 00:02 2024-03-04T09:01:38.192 INFO:teuthology.orchestra.run.smithi190.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-04T09:01:38.193 INFO:teuthology.orchestra.run.smithi190.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-04T09:01:38.205 INFO:teuthology.orchestra.run.smithi190.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-04T09:01:38.205 INFO:teuthology.orchestra.run.smithi190.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-04T09:01:38.206 INFO:teuthology.orchestra.run.smithi190.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-04T09:01:38.207 INFO:teuthology.orchestra.run.smithi190.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-04T09:01:38.209 INFO:teuthology.orchestra.run.smithi190.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-04T09:01:38.211 INFO:teuthology.orchestra.run.smithi190.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-04T09:01:38.212 INFO:teuthology.orchestra.run.smithi190.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-04T09:01:38.292 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. 2024-03-04T09:01:38.314 INFO:teuthology.orchestra.run.smithi190.stdout:============================================================================================ 2024-03-04T09:01:38.314 INFO:teuthology.orchestra.run.smithi190.stdout: Package Arch Version Repository Size 2024-03-04T09:01:38.314 INFO:teuthology.orchestra.run.smithi190.stdout:============================================================================================ 2024-03-04T09:01:38.314 INFO:teuthology.orchestra.run.smithi190.stdout:Installing: 2024-03-04T09:01:38.314 INFO:teuthology.orchestra.run.smithi190.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-04T09:01:38.315 INFO:teuthology.orchestra.run.smithi190.stdout: ceph x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 6.6 k 2024-03-04T09:01:38.315 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-base x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 5.3 M 2024-03-04T09:01:38.315 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-fuse x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 888 k 2024-03-04T09:01:38.315 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 145 k 2024-03-04T09:01:38.315 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 1.5 M 2024-03-04T09:01:38.315 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 138 k 2024-03-04T09:01:38.315 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 1.8 M 2024-03-04T09:01:38.315 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 7.4 M 2024-03-04T09:01:38.315 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-rook noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 49 k 2024-03-04T09:01:38.315 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-radosgw x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 9.8 M 2024-03-04T09:01:38.315 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-test x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 47 M 2024-03-04T09:01:38.315 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-volume noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 264 k 2024-03-04T09:01:38.315 INFO:teuthology.orchestra.run.smithi190.stdout: cephadm noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 748 k 2024-03-04T09:01:38.316 INFO:teuthology.orchestra.run.smithi190.stdout: cephfs-mirror x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 220 k 2024-03-04T09:01:38.316 INFO:teuthology.orchestra.run.smithi190.stdout: cephfs-shell x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 27 k 2024-03-04T09:01:38.316 INFO:teuthology.orchestra.run.smithi190.stdout: cephfs-top noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 18 k 2024-03-04T09:01:38.316 INFO:teuthology.orchestra.run.smithi190.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 CentOS-AppStream 20 k 2024-03-04T09:01:38.316 INFO:teuthology.orchestra.run.smithi190.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-04T09:01:38.316 INFO:teuthology.orchestra.run.smithi190.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-04T09:01:38.316 INFO:teuthology.orchestra.run.smithi190.stdout: libcephfs-devel x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 31 k 2024-03-04T09:01:38.316 INFO:teuthology.orchestra.run.smithi190.stdout: libcephfs2 x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 747 k 2024-03-04T09:01:38.316 INFO:teuthology.orchestra.run.smithi190.stdout: librados-devel x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 127 k 2024-03-04T09:01:38.316 INFO:teuthology.orchestra.run.smithi190.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-04T09:01:38.316 INFO:teuthology.orchestra.run.smithi190.stdout: libuuid-devel x86_64 2.37.4-18.el9 CentOS-AppStream 24 k 2024-03-04T09:01:38.317 INFO:teuthology.orchestra.run.smithi190.stdout: openssl-devel x86_64 1:3.0.7-27.el9 CentOS-AppStream 3.0 M 2024-03-04T09:01:38.317 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-03-04T09:01:38.317 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-03-04T09:01:38.317 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-03-04T09:01:38.317 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cephfs x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 162 k 2024-03-04T09:01:38.317 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rados x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 321 k 2024-03-04T09:01:38.317 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rbd x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 298 k 2024-03-04T09:01:38.317 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rgw x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 99 k 2024-03-04T09:01:38.317 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-fuse x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 85 k 2024-03-04T09:01:38.317 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-mirror x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 3.1 M 2024-03-04T09:01:38.317 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-nbd x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 171 k 2024-03-04T09:01:38.318 INFO:teuthology.orchestra.run.smithi190.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 CentOS-AppStream 87 k 2024-03-04T09:01:38.318 INFO:teuthology.orchestra.run.smithi190.stdout:Upgrading: 2024-03-04T09:01:38.318 INFO:teuthology.orchestra.run.smithi190.stdout: NetworkManager x86_64 1:1.46.0-1.el9 CentOS-BaseOS 2.3 M 2024-03-04T09:01:38.318 INFO:teuthology.orchestra.run.smithi190.stdout: NetworkManager-libnm x86_64 1:1.46.0-1.el9 CentOS-BaseOS 1.8 M 2024-03-04T09:01:38.318 INFO:teuthology.orchestra.run.smithi190.stdout: NetworkManager-team x86_64 1:1.46.0-1.el9 CentOS-BaseOS 41 k 2024-03-04T09:01:38.318 INFO:teuthology.orchestra.run.smithi190.stdout: NetworkManager-tui x86_64 1:1.46.0-1.el9 CentOS-BaseOS 247 k 2024-03-04T09:01:38.318 INFO:teuthology.orchestra.run.smithi190.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2024-03-04T09:01:38.318 INFO:teuthology.orchestra.run.smithi190.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 CentOS-BaseOS 35 k 2024-03-04T09:01:38.318 INFO:teuthology.orchestra.run.smithi190.stdout: elfutils-libelf x86_64 0.190-2.el9 CentOS-BaseOS 191 k 2024-03-04T09:01:38.318 INFO:teuthology.orchestra.run.smithi190.stdout: elfutils-libs x86_64 0.190-2.el9 CentOS-BaseOS 254 k 2024-03-04T09:01:38.318 INFO:teuthology.orchestra.run.smithi190.stdout: iproute x86_64 6.7.0-2.el9 CentOS-BaseOS 802 k 2024-03-04T09:01:38.319 INFO:teuthology.orchestra.run.smithi190.stdout: iproute-tc x86_64 6.7.0-2.el9 CentOS-BaseOS 433 k 2024-03-04T09:01:38.319 INFO:teuthology.orchestra.run.smithi190.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2024-03-04T09:01:38.319 INFO:teuthology.orchestra.run.smithi190.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2024-03-04T09:01:38.319 INFO:teuthology.orchestra.run.smithi190.stdout: libblkid x86_64 2.37.4-18.el9 CentOS-BaseOS 107 k 2024-03-04T09:01:38.320 INFO:teuthology.orchestra.run.smithi190.stdout: libfdisk x86_64 2.37.4-18.el9 CentOS-BaseOS 154 k 2024-03-04T09:01:38.320 INFO:teuthology.orchestra.run.smithi190.stdout: libmount x86_64 2.37.4-18.el9 CentOS-BaseOS 135 k 2024-03-04T09:01:38.320 INFO:teuthology.orchestra.run.smithi190.stdout: librados2 x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 3.4 M 2024-03-04T09:01:38.320 INFO:teuthology.orchestra.run.smithi190.stdout: librbd1 x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 3.1 M 2024-03-04T09:01:38.320 INFO:teuthology.orchestra.run.smithi190.stdout: libsmartcols x86_64 2.37.4-18.el9 CentOS-BaseOS 63 k 2024-03-04T09:01:38.320 INFO:teuthology.orchestra.run.smithi190.stdout: libuuid x86_64 2.37.4-18.el9 CentOS-BaseOS 28 k 2024-03-04T09:01:38.320 INFO:teuthology.orchestra.run.smithi190.stdout: openssl x86_64 1:3.0.7-27.el9 CentOS-BaseOS 1.2 M 2024-03-04T09:01:38.320 INFO:teuthology.orchestra.run.smithi190.stdout: openssl-libs x86_64 1:3.0.7-27.el9 CentOS-BaseOS 2.2 M 2024-03-04T09:01:38.320 INFO:teuthology.orchestra.run.smithi190.stdout: util-linux x86_64 2.37.4-18.el9 CentOS-BaseOS 2.2 M 2024-03-04T09:01:38.320 INFO:teuthology.orchestra.run.smithi190.stdout: util-linux-core x86_64 2.37.4-18.el9 CentOS-BaseOS 438 k 2024-03-04T09:01:38.320 INFO:teuthology.orchestra.run.smithi190.stdout: util-linux-user x86_64 2.37.4-18.el9 CentOS-BaseOS 30 k 2024-03-04T09:01:38.320 INFO:teuthology.orchestra.run.smithi190.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-04T09:01:38.321 INFO:teuthology.orchestra.run.smithi190.stdout: xfsprogs x86_64 6.3.0-1.el9 CentOS-BaseOS 1.1 M 2024-03-04T09:01:38.321 INFO:teuthology.orchestra.run.smithi190.stdout:Installing dependencies: 2024-03-04T09:01:38.321 INFO:teuthology.orchestra.run.smithi190.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-04T09:01:38.321 INFO:teuthology.orchestra.run.smithi190.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-04T09:01:38.321 INFO:teuthology.orchestra.run.smithi190.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-04T09:01:38.321 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-common x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 20 M 2024-03-04T09:01:38.321 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 31 k 2024-03-04T09:01:38.321 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mds x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 2.3 M 2024-03-04T09:01:38.321 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 248 k 2024-03-04T09:01:38.321 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mon x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 4.7 M 2024-03-04T09:01:38.321 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-osd x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 17 M 2024-03-04T09:01:38.321 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 15 k 2024-03-04T09:01:38.321 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-selinux x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 25 k 2024-03-04T09:01:38.321 INFO:teuthology.orchestra.run.smithi190.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-04T09:01:38.322 INFO:teuthology.orchestra.run.smithi190.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-04T09:01:38.322 INFO:teuthology.orchestra.run.smithi190.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-04T09:01:38.322 INFO:teuthology.orchestra.run.smithi190.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-04T09:01:38.322 INFO:teuthology.orchestra.run.smithi190.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-04T09:01:38.322 INFO:teuthology.orchestra.run.smithi190.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-04T09:01:38.322 INFO:teuthology.orchestra.run.smithi190.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-03-04T09:01:38.322 INFO:teuthology.orchestra.run.smithi190.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-04T09:01:38.322 INFO:teuthology.orchestra.run.smithi190.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-04T09:01:38.322 INFO:teuthology.orchestra.run.smithi190.stdout: libcephsqlite x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 163 k 2024-03-04T09:01:38.322 INFO:teuthology.orchestra.run.smithi190.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-03-04T09:01:38.322 INFO:teuthology.orchestra.run.smithi190.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-04T09:01:38.323 INFO:teuthology.orchestra.run.smithi190.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-04T09:01:38.323 INFO:teuthology.orchestra.run.smithi190.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-03-04T09:01:38.323 INFO:teuthology.orchestra.run.smithi190.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-04T09:01:38.323 INFO:teuthology.orchestra.run.smithi190.stdout: libradosstriper1 x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 501 k 2024-03-04T09:01:38.323 INFO:teuthology.orchestra.run.smithi190.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-04T09:01:38.323 INFO:teuthology.orchestra.run.smithi190.stdout: librgw2 x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 5.1 M 2024-03-04T09:01:38.323 INFO:teuthology.orchestra.run.smithi190.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-04T09:01:38.323 INFO:teuthology.orchestra.run.smithi190.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-04T09:01:38.323 INFO:teuthology.orchestra.run.smithi190.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-04T09:01:38.323 INFO:teuthology.orchestra.run.smithi190.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-04T09:01:38.323 INFO:teuthology.orchestra.run.smithi190.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-04T09:01:38.323 INFO:teuthology.orchestra.run.smithi190.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-04T09:01:38.323 INFO:teuthology.orchestra.run.smithi190.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-03-04T09:01:38.324 INFO:teuthology.orchestra.run.smithi190.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-04T09:01:38.324 INFO:teuthology.orchestra.run.smithi190.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-04T09:01:38.324 INFO:teuthology.orchestra.run.smithi190.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-04T09:01:38.324 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-03-04T09:01:38.324 INFO:teuthology.orchestra.run.smithi190.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-04T09:01:38.324 INFO:teuthology.orchestra.run.smithi190.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-04T09:01:38.324 INFO:teuthology.orchestra.run.smithi190.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-03-04T09:01:38.324 INFO:teuthology.orchestra.run.smithi190.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-04T09:01:38.324 INFO:teuthology.orchestra.run.smithi190.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-04T09:01:38.324 INFO:teuthology.orchestra.run.smithi190.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-04T09:01:38.324 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-04T09:01:38.324 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ceph-argparse x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 45 k 2024-03-04T09:01:38.324 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ceph-common x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 131 k 2024-03-04T09:01:38.324 INFO:teuthology.orchestra.run.smithi190.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-04T09:01:38.325 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-04T09:01:38.325 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-04T09:01:38.325 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-04T09:01:38.325 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-04T09:01:38.325 INFO:teuthology.orchestra.run.smithi190.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-04T09:01:38.325 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-04T09:01:38.325 INFO:teuthology.orchestra.run.smithi190.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-04T09:01:38.325 INFO:teuthology.orchestra.run.smithi190.stdout: python3-google-auth noarch 1:2.28.0-1.el9 epel 203 k 2024-03-04T09:01:38.325 INFO:teuthology.orchestra.run.smithi190.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-04T09:01:38.325 INFO:teuthology.orchestra.run.smithi190.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-04T09:01:38.325 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-04T09:01:38.325 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-04T09:01:38.325 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-04T09:01:38.325 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-04T09:01:38.326 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-04T09:01:38.326 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jinja2 noarch 2.11.3-5.el9 CentOS-AppStream 227 k 2024-03-04T09:01:38.326 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-04T09:01:38.326 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-04T09:01:38.326 INFO:teuthology.orchestra.run.smithi190.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-04T09:01:38.326 INFO:teuthology.orchestra.run.smithi190.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-04T09:01:38.326 INFO:teuthology.orchestra.run.smithi190.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-04T09:01:38.326 INFO:teuthology.orchestra.run.smithi190.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-04T09:01:38.326 INFO:teuthology.orchestra.run.smithi190.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-04T09:01:38.326 INFO:teuthology.orchestra.run.smithi190.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-04T09:01:38.326 INFO:teuthology.orchestra.run.smithi190.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-04T09:01:38.326 INFO:teuthology.orchestra.run.smithi190.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-04T09:01:38.326 INFO:teuthology.orchestra.run.smithi190.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-04T09:01:38.326 INFO:teuthology.orchestra.run.smithi190.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-04T09:01:38.327 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-04T09:01:38.327 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-04T09:01:38.327 INFO:teuthology.orchestra.run.smithi190.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-04T09:01:38.327 INFO:teuthology.orchestra.run.smithi190.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-04T09:01:38.327 INFO:teuthology.orchestra.run.smithi190.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-04T09:01:38.327 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-04T09:01:38.327 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-04T09:01:38.327 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-04T09:01:38.327 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-04T09:01:38.327 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-04T09:01:38.327 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-04T09:01:38.328 INFO:teuthology.orchestra.run.smithi190.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-04T09:01:38.328 INFO:teuthology.orchestra.run.smithi190.stdout: python3-requests noarch 2.25.1-8.el9 CentOS-BaseOS 113 k 2024-03-04T09:01:38.328 INFO:teuthology.orchestra.run.smithi190.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-04T09:01:38.328 INFO:teuthology.orchestra.run.smithi190.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-04T09:01:38.328 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-04T09:01:38.328 INFO:teuthology.orchestra.run.smithi190.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-04T09:01:38.328 INFO:teuthology.orchestra.run.smithi190.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-04T09:01:38.328 INFO:teuthology.orchestra.run.smithi190.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-04T09:01:38.328 INFO:teuthology.orchestra.run.smithi190.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-04T09:01:38.328 INFO:teuthology.orchestra.run.smithi190.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-04T09:01:38.328 INFO:teuthology.orchestra.run.smithi190.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-04T09:01:38.328 INFO:teuthology.orchestra.run.smithi190.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-04T09:01:38.328 INFO:teuthology.orchestra.run.smithi190.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-04T09:01:38.328 INFO:teuthology.orchestra.run.smithi190.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-04T09:01:38.329 INFO:teuthology.orchestra.run.smithi190.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-04T09:01:38.329 INFO:teuthology.orchestra.run.smithi190.stdout: qatlib x86_64 23.11.0-1.el9 CentOS-AppStream 215 k 2024-03-04T09:01:38.329 INFO:teuthology.orchestra.run.smithi190.stdout: qatzip-libs x86_64 1.1.2-2.el9 CentOS-AppStream 43 k 2024-03-04T09:01:38.329 INFO:teuthology.orchestra.run.smithi190.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-04T09:01:38.329 INFO:teuthology.orchestra.run.smithi190.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-04T09:01:38.329 INFO:teuthology.orchestra.run.smithi190.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-04T09:01:38.329 INFO:teuthology.orchestra.run.smithi190.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-04T09:01:38.329 INFO:teuthology.orchestra.run.smithi190.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-04T09:01:38.329 INFO:teuthology.orchestra.run.smithi190.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-04T09:01:38.329 INFO:teuthology.orchestra.run.smithi190.stdout:Installing weak dependencies: 2024-03-04T09:01:38.330 INFO:teuthology.orchestra.run.smithi190.stdout: qatlib-service x86_64 23.11.0-1.el9 CentOS-AppStream 34 k 2024-03-04T09:01:38.330 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-03-04T09:01:38.330 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction Summary 2024-03-04T09:01:38.330 INFO:teuthology.orchestra.run.smithi190.stdout:============================================================================================ 2024-03-04T09:01:38.330 INFO:teuthology.orchestra.run.smithi190.stdout:Install 150 Packages 2024-03-04T09:01:38.330 INFO:teuthology.orchestra.run.smithi190.stdout:Upgrade 26 Packages 2024-03-04T09:01:38.330 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-03-04T09:01:38.331 INFO:teuthology.orchestra.run.smithi190.stdout:Total download size: 224 M 2024-03-04T09:01:38.331 INFO:teuthology.orchestra.run.smithi190.stdout:Downloading Packages: 2024-03-04T09:01:38.609 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 15 kB 00:00 2024-03-04T09:01:40.975 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - AppStream 926 kB/s | 19 MB 00:21 2024-03-04T09:01:41.307 INFO:teuthology.orchestra.run.smithi190.stdout:(1/176): ceph-19.0.0-1739.g1bc250c7.el9.x86_64. 15 kB/s | 6.6 kB 00:00 2024-03-04T09:01:41.600 INFO:teuthology.orchestra.run.smithi190.stdout:(2/176): ceph-base-19.0.0-1739.g1bc250c7.el9.x8 7.3 MB/s | 5.3 MB 00:00 2024-03-04T09:01:41.657 INFO:teuthology.orchestra.run.smithi190.stdout:(3/176): ceph-immutable-object-cache-19.0.0-173 2.4 MB/s | 145 kB 00:00 2024-03-04T09:01:41.816 INFO:teuthology.orchestra.run.smithi190.stdout:(4/176): ceph-fuse-19.0.0-1739.g1bc250c7.el9.x8 1.7 MB/s | 888 kB 00:00 2024-03-04T09:01:41.866 INFO:teuthology.orchestra.run.smithi190.stdout:(5/176): ceph-mds-19.0.0-1739.g1bc250c7.el9.x86 11 MB/s | 2.3 MB 00:00 2024-03-04T09:01:42.249 INFO:teuthology.orchestra.run.smithi190.stdout:(6/176): ceph-mon-19.0.0-1739.g1bc250c7.el9.x86 12 MB/s | 4.7 MB 00:00 2024-03-04T09:01:42.291 INFO:teuthology.orchestra.run.smithi190.stdout:(7/176): ceph-mgr-19.0.0-1739.g1bc250c7.el9.x86 3.1 MB/s | 1.5 MB 00:00 2024-03-04T09:01:43.775 INFO:teuthology.orchestra.run.smithi190.stdout:(8/176): ceph-common-19.0.0-1739.g1bc250c7.el9. 7.0 MB/s | 20 MB 00:02 2024-03-04T09:01:43.950 INFO:teuthology.orchestra.run.smithi190.stdout:(9/176): ceph-osd-19.0.0-1739.g1bc250c7.el9.x86 9.9 MB/s | 17 MB 00:01 2024-03-04T09:01:43.975 INFO:teuthology.orchestra.run.smithi190.stdout:(10/176): ceph-selinux-19.0.0-1739.g1bc250c7.el 126 kB/s | 25 kB 00:00 2024-03-04T09:01:44.092 INFO:teuthology.orchestra.run.smithi190.stdout:(11/176): ceph-radosgw-19.0.0-1739.g1bc250c7.el 5.4 MB/s | 9.8 MB 00:01 2024-03-04T09:01:44.128 INFO:teuthology.orchestra.run.smithi190.stdout:(12/176): cephfs-mirror-19.0.0-1739.g1bc250c7.e 1.4 MB/s | 220 kB 00:00 2024-03-04T09:01:44.176 INFO:teuthology.orchestra.run.smithi190.stdout:(13/176): cephfs-shell-19.0.0-1739.g1bc250c7.el 325 kB/s | 27 kB 00:00 2024-03-04T09:01:44.218 INFO:teuthology.orchestra.run.smithi190.stdout:(14/176): libcephfs-devel-19.0.0-1739.g1bc250c7 348 kB/s | 31 kB 00:00 2024-03-04T09:01:44.310 INFO:teuthology.orchestra.run.smithi190.stdout:(15/176): libcephsqlite-19.0.0-1739.g1bc250c7.e 1.7 MB/s | 163 kB 00:00 2024-03-04T09:01:44.327 INFO:teuthology.orchestra.run.smithi102.stdout:Extra Packages for Enterprise Linux 3.7 MB/s | 20 MB 00:05 2024-03-04T09:01:44.335 INFO:teuthology.orchestra.run.smithi190.stdout:(16/176): libcephfs2-19.0.0-1739.g1bc250c7.el9. 4.6 MB/s | 747 kB 00:00 2024-03-04T09:01:44.386 INFO:teuthology.orchestra.run.smithi190.stdout:(17/176): librados-devel-19.0.0-1739.g1bc250c7. 1.6 MB/s | 127 kB 00:00 2024-03-04T09:01:44.435 INFO:teuthology.orchestra.run.smithi190.stdout:(18/176): libradosstriper1-19.0.0-1739.g1bc250c 4.9 MB/s | 501 kB 00:00 2024-03-04T09:01:44.503 INFO:teuthology.orchestra.run.smithi190.stdout:(19/176): python3-ceph-argparse-19.0.0-1739.g1b 674 kB/s | 45 kB 00:00 2024-03-04T09:01:44.595 INFO:teuthology.orchestra.run.smithi190.stdout:(20/176): python3-ceph-common-19.0.0-1739.g1bc2 1.4 MB/s | 131 kB 00:00 2024-03-04T09:01:44.712 INFO:teuthology.orchestra.run.smithi190.stdout:(21/176): python3-cephfs-19.0.0-1739.g1bc250c7. 1.4 MB/s | 162 kB 00:00 2024-03-04T09:01:44.820 INFO:teuthology.orchestra.run.smithi190.stdout:(22/176): python3-rados-19.0.0-1739.g1bc250c7.e 2.9 MB/s | 321 kB 00:00 2024-03-04T09:01:44.962 INFO:teuthology.orchestra.run.smithi190.stdout:(23/176): librgw2-19.0.0-1739.g1bc250c7.el9.x86 8.9 MB/s | 5.1 MB 00:00 2024-03-04T09:01:44.967 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.1 MB 00:00 2024-03-04T09:01:44.988 INFO:teuthology.orchestra.run.smithi190.stdout:(24/176): python3-rbd-19.0.0-1739.g1bc250c7.el9 1.7 MB/s | 298 kB 00:00 2024-03-04T09:01:45.038 INFO:teuthology.orchestra.run.smithi190.stdout:(25/176): python3-rgw-19.0.0-1739.g1bc250c7.el9 1.3 MB/s | 99 kB 00:00 2024-03-04T09:01:45.063 INFO:teuthology.orchestra.run.smithi190.stdout:(26/176): rbd-fuse-19.0.0-1739.g1bc250c7.el9.x8 1.1 MB/s | 85 kB 00:00 2024-03-04T09:01:45.172 INFO:teuthology.orchestra.run.smithi190.stdout:(27/176): rbd-nbd-19.0.0-1739.g1bc250c7.el9.x86 1.5 MB/s | 171 kB 00:00 2024-03-04T09:01:45.263 INFO:teuthology.orchestra.run.smithi190.stdout:(28/176): ceph-grafana-dashboards-19.0.0-1739.g 344 kB/s | 31 kB 00:00 2024-03-04T09:01:45.389 INFO:teuthology.orchestra.run.smithi190.stdout:(29/176): rbd-mirror-19.0.0-1739.g1bc250c7.el9. 8.8 MB/s | 3.1 MB 00:00 2024-03-04T09:01:45.414 INFO:teuthology.orchestra.run.smithi190.stdout:(30/176): ceph-mgr-cephadm-19.0.0-1739.g1bc250c 920 kB/s | 138 kB 00:00 2024-03-04T09:01:45.639 INFO:teuthology.orchestra.run.smithi190.stdout:(31/176): ceph-mgr-dashboard-19.0.0-1739.g1bc25 7.1 MB/s | 1.8 MB 00:00 2024-03-04T09:01:45.723 INFO:teuthology.orchestra.run.smithi190.stdout:(32/176): ceph-mgr-modules-core-19.0.0-1739.g1b 2.9 MB/s | 248 kB 00:00 2024-03-04T09:01:45.840 INFO:teuthology.orchestra.run.smithi190.stdout:(33/176): ceph-mgr-rook-19.0.0-1739.g1bc250c7.e 423 kB/s | 49 kB 00:00 2024-03-04T09:01:45.923 INFO:teuthology.orchestra.run.smithi190.stdout:(34/176): ceph-prometheus-alerts-19.0.0-1739.g1 184 kB/s | 15 kB 00:00 2024-03-04T09:01:46.024 INFO:teuthology.orchestra.run.smithi190.stdout:(35/176): ceph-volume-19.0.0-1739.g1bc250c7.el9 2.6 MB/s | 264 kB 00:00 2024-03-04T09:01:46.141 INFO:teuthology.orchestra.run.smithi190.stdout:(36/176): cephadm-19.0.0-1739.g1bc250c7.el9.noa 6.3 MB/s | 748 kB 00:00 2024-03-04T09:01:46.216 INFO:teuthology.orchestra.run.smithi190.stdout:(37/176): cephfs-top-19.0.0-1739.g1bc250c7.el9. 244 kB/s | 18 kB 00:00 2024-03-04T09:01:46.309 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - Extras packages 71 kB/s | 15 kB 00:00 2024-03-04T09:01:46.391 INFO:teuthology.orchestra.run.smithi190.stdout:(38/176): ceph-mgr-diskprediction-local-19.0.0- 7.6 MB/s | 7.4 MB 00:00 2024-03-04T09:01:46.416 INFO:teuthology.orchestra.run.smithi190.stdout:(39/176): automake-1.16.2-8.el9.noarch.rpm 3.2 MB/s | 662 kB 00:00 2024-03-04T09:01:46.467 INFO:teuthology.orchestra.run.smithi190.stdout:(40/176): bison-3.7.4-5.el9.x86_64.rpm 12 MB/s | 920 kB 00:00 2024-03-04T09:01:46.492 INFO:teuthology.orchestra.run.smithi190.stdout:(41/176): boost-program-options-1.75.0-8.el9.x8 1.4 MB/s | 106 kB 00:00 2024-03-04T09:01:46.509 INFO:teuthology.orchestra.run.smithi190.stdout:(42/176): elfutils-libelf-devel-0.190-2.el9.x86 491 kB/s | 20 kB 00:00 2024-03-04T09:01:46.534 INFO:teuthology.orchestra.run.smithi190.stdout:(43/176): flex-2.6.4-9.el9.x86_64.rpm 7.2 MB/s | 307 kB 00:00 2024-03-04T09:01:46.551 INFO:teuthology.orchestra.run.smithi190.stdout:(44/176): flexiblas-3.0.4-8.el9.x86_64.rpm 764 kB/s | 32 kB 00:00 2024-03-04T09:01:46.985 INFO:teuthology.orchestra.run.smithi190.stdout:(45/176): ceph-test-19.0.0-1739.g1bc250c7.el9.x 16 MB/s | 47 MB 00:03 2024-03-04T09:01:47.043 INFO:teuthology.orchestra.run.smithi190.stdout:(46/176): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.9 MB/s | 3.0 MB 00:00 2024-03-04T09:01:47.068 INFO:teuthology.orchestra.run.smithi190.stdout:(47/176): flexiblas-openblas-openmp-3.0.4-8.el9 33 kB/s | 17 kB 00:00 2024-03-04T09:01:47.094 INFO:teuthology.orchestra.run.smithi190.stdout:(48/176): libaio-devel-0.3.111-13.el9.x86_64.rp 93 kB/s | 10 kB 00:00 2024-03-04T09:01:47.119 INFO:teuthology.orchestra.run.smithi190.stdout:(49/176): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 159 kB 00:00 2024-03-04T09:01:47.144 INFO:teuthology.orchestra.run.smithi190.stdout:(50/176): librabbitmq-0.11.0-7.el9.x86_64.rpm 587 kB/s | 44 kB 00:00 2024-03-04T09:01:47.178 INFO:teuthology.orchestra.run.smithi190.stdout:(51/176): librdkafka-1.6.1-102.el9.x86_64.rpm 7.7 MB/s | 661 kB 00:00 2024-03-04T09:01:47.203 INFO:teuthology.orchestra.run.smithi190.stdout:(52/176): libuuid-devel-2.37.4-18.el9.x86_64.rp 426 kB/s | 24 kB 00:00 2024-03-04T09:01:47.228 INFO:teuthology.orchestra.run.smithi190.stdout:(53/176): libtool-2.4.6-45.el9.x86_64.rpm 6.9 MB/s | 578 kB 00:00 2024-03-04T09:01:47.253 INFO:teuthology.orchestra.run.smithi190.stdout:(54/176): libzstd-devel-1.5.1-2.el9.x86_64.rpm 616 kB/s | 46 kB 00:00 2024-03-04T09:01:47.279 INFO:teuthology.orchestra.run.smithi190.stdout:(55/176): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.7 MB/s | 282 kB 00:00 2024-03-04T09:01:47.312 INFO:teuthology.orchestra.run.smithi190.stdout:(56/176): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 187 kB 00:00 2024-03-04T09:01:47.337 INFO:teuthology.orchestra.run.smithi190.stdout:(57/176): openblas-0.3.21-2.el9.x86_64.rpm 410 kB/s | 34 kB 00:00 2024-03-04T09:01:47.438 INFO:teuthology.orchestra.run.smithi190.stdout:(58/176): openblas-openmp-0.3.21-2.el9.x86_64.r 30 MB/s | 4.7 MB 00:00 2024-03-04T09:01:47.521 INFO:teuthology.orchestra.run.smithi190.stdout:(59/176): openssl-devel-3.0.7-27.el9.x86_64.rpm 14 MB/s | 3.0 MB 00:00 2024-03-04T09:01:47.563 INFO:teuthology.orchestra.run.smithi190.stdout:(60/176): postgresql-13.11-1.el9.x86_64.rpm 6.8 MB/s | 1.5 MB 00:00 2024-03-04T09:01:47.597 INFO:teuthology.orchestra.run.smithi190.stdout:(61/176): postgresql-contrib-13.11-1.el9.x86_64 5.1 MB/s | 811 kB 00:00 2024-03-04T09:01:47.622 INFO:teuthology.orchestra.run.smithi190.stdout:(62/176): postgresql-private-libs-13.11-1.el9.x 1.3 MB/s | 134 kB 00:00 2024-03-04T09:01:47.656 INFO:teuthology.orchestra.run.smithi190.stdout:(63/176): protobuf-3.14.0-13.el9.x86_64.rpm 17 MB/s | 1.0 MB 00:00 2024-03-04T09:01:47.685 INFO:teuthology.orchestra.run.smithi082.stdout:Extra Packages for Enterprise Linux 16 MB/s | 20 MB 00:01 2024-03-04T09:01:47.764 INFO:teuthology.orchestra.run.smithi190.stdout:(64/176): postgresql-server-13.11-1.el9.x86_64. 34 MB/s | 5.7 MB 00:00 2024-03-04T09:01:47.789 INFO:teuthology.orchestra.run.smithi190.stdout:(65/176): python3-attrs-20.3.0-7.el9.noarch.rpm 467 kB/s | 78 kB 00:00 2024-03-04T09:01:47.873 INFO:teuthology.orchestra.run.smithi190.stdout:(66/176): python3-babel-2.9.1-2.el9.noarch.rpm 27 MB/s | 5.8 MB 00:00 2024-03-04T09:01:47.898 INFO:teuthology.orchestra.run.smithi190.stdout:(67/176): python3-jinja2-2.11.3-5.el9.noarch.rp 1.7 MB/s | 227 kB 00:00 2024-03-04T09:01:47.923 INFO:teuthology.orchestra.run.smithi190.stdout:(68/176): python3-jsonpatch-1.21-16.el9.noarch. 186 kB/s | 24 kB 00:00 2024-03-04T09:01:47.949 INFO:teuthology.orchestra.run.smithi190.stdout:(69/176): python3-jsonpointer-2.0-4.el9.noarch. 241 kB/s | 18 kB 00:00 2024-03-04T09:01:47.991 INFO:teuthology.orchestra.run.smithi190.stdout:(70/176): python3-markupsafe-1.1.1-12.el9.x86_6 473 kB/s | 32 kB 00:00 2024-03-04T09:01:48.016 INFO:teuthology.orchestra.run.smithi190.stdout:(71/176): python3-mako-1.1.4-6.el9.noarch.rpm 1.5 MB/s | 144 kB 00:00 2024-03-04T09:01:48.103 INFO:teuthology.orchestra.run.smithi190.stdout:(72/176): python3-numpy-1.20.1-5.el9.x86_64.rpm 31 MB/s | 4.8 MB 00:00 2024-03-04T09:01:48.133 INFO:teuthology.orchestra.run.smithi190.stdout:(73/176): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.5 MB/s | 217 kB 00:00 2024-03-04T09:01:48.158 INFO:teuthology.orchestra.run.smithi190.stdout:(74/176): python3-oauthlib-3.1.1-5.el9.noarch.r 1.2 MB/s | 174 kB 00:00 2024-03-04T09:01:48.183 INFO:teuthology.orchestra.run.smithi190.stdout:(75/176): python3-packaging-20.9-5.el9.noarch.r 860 kB/s | 69 kB 00:00 2024-03-04T09:01:48.209 INFO:teuthology.orchestra.run.smithi190.stdout:(76/176): python3-prettytable-0.7.2-27.el9.noar 825 kB/s | 41 kB 00:00 2024-03-04T09:01:48.234 INFO:teuthology.orchestra.run.smithi190.stdout:(77/176): python3-protobuf-3.14.0-13.el9.noarch 3.1 MB/s | 238 kB 00:00 2024-03-04T09:01:48.259 INFO:teuthology.orchestra.run.smithi190.stdout:(78/176): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 132 kB 00:00 2024-03-04T09:01:48.276 INFO:teuthology.orchestra.run.smithi190.stdout:(79/176): python3-pytz-2021.1-5.el9.noarch.rpm 1.1 MB/s | 47 kB 00:00 2024-03-04T09:01:48.301 INFO:teuthology.orchestra.run.smithi190.stdout:(80/176): python3-pyasn1-modules-0.4.8-6.el9.no 3.1 MB/s | 211 kB 00:00 2024-03-04T09:01:48.318 INFO:teuthology.orchestra.run.smithi190.stdout:(81/176): python3-requests-oauthlib-1.3.0-12.el 732 kB/s | 43 kB 00:00 2024-03-04T09:01:48.627 INFO:teuthology.orchestra.run.smithi190.stdout:(82/176): python3-scipy-1.6.2-8.el9.x86_64.rpm 45 MB/s | 16 MB 00:00 2024-03-04T09:01:48.643 INFO:teuthology.orchestra.run.smithi190.stdout:(83/176): python3-toml-0.10.2-6.el9.noarch.rpm 120 kB/s | 39 kB 00:00 2024-03-04T09:01:48.660 INFO:teuthology.orchestra.run.smithi190.stdout:(84/176): python3-wcwidth-0.2.5-8.el9.noarch.rp 121 kB/s | 41 kB 00:00 2024-03-04T09:01:48.686 INFO:teuthology.orchestra.run.smithi190.stdout:(85/176): qatlib-23.11.0-1.el9.x86_64.rpm 3.6 MB/s | 215 kB 00:00 2024-03-04T09:01:48.703 INFO:teuthology.orchestra.run.smithi190.stdout:(86/176): qatzip-libs-1.1.2-2.el9.x86_64.rpm 1.0 MB/s | 43 kB 00:00 2024-03-04T09:01:48.720 INFO:teuthology.orchestra.run.smithi190.stdout:(87/176): qatlib-service-23.11.0-1.el9.x86_64.r 576 kB/s | 34 kB 00:00 2024-03-04T09:01:48.745 INFO:teuthology.orchestra.run.smithi190.stdout:(88/176): socat-1.7.4.1-5.el9.x86_64.rpm 5.0 MB/s | 300 kB 00:00 2024-03-04T09:01:48.761 INFO:teuthology.orchestra.run.smithi190.stdout:(89/176): uuid-1.6.2-55.el9.x86_64.rpm 969 kB/s | 56 kB 00:00 2024-03-04T09:01:48.787 INFO:teuthology.orchestra.run.smithi190.stdout:(90/176): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 2.0 MB/s | 87 kB 00:00 2024-03-04T09:01:48.804 INFO:teuthology.orchestra.run.smithi190.stdout:(91/176): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.0 MB/s | 63 kB 00:00 2024-03-04T09:01:48.821 INFO:teuthology.orchestra.run.smithi190.stdout:(92/176): zlib-devel-1.2.11-40.el9.x86_64.rpm 751 kB/s | 44 kB 00:00 2024-03-04T09:01:48.846 INFO:teuthology.orchestra.run.smithi190.stdout:(93/176): fuse-2.9.9-15.el9.x86_64.rpm 1.8 MB/s | 79 kB 00:00 2024-03-04T09:01:48.871 INFO:teuthology.orchestra.run.smithi190.stdout:(94/176): jq-1.6-16.el9.x86_64.rpm 2.7 MB/s | 186 kB 00:00 2024-03-04T09:01:48.896 INFO:teuthology.orchestra.run.smithi190.stdout:(95/176): libgfortran-11.4.1-3.el9.x86_64.rpm 10 MB/s | 802 kB 00:00 2024-03-04T09:01:48.922 INFO:teuthology.orchestra.run.smithi190.stdout:(96/176): libquadmath-11.4.1-3.el9.x86_64.rpm 2.6 MB/s | 194 kB 00:00 2024-03-04T09:01:48.947 INFO:teuthology.orchestra.run.smithi190.stdout:(97/176): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-03-04T09:01:48.972 INFO:teuthology.orchestra.run.smithi190.stdout:(98/176): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.8 MB/s | 217 kB 00:00 2024-03-04T09:01:49.006 INFO:teuthology.orchestra.run.smithi190.stdout:(99/176): python3-cryptography-36.0.1-4.el9.x86 14 MB/s | 1.1 MB 00:00 2024-03-04T09:01:49.031 INFO:teuthology.orchestra.run.smithi190.stdout:(100/176): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 103 kB 00:00 2024-03-04T09:01:49.056 INFO:teuthology.orchestra.run.smithi190.stdout:(101/176): python3-pycparser-2.20-6.el9.noarch. 2.4 MB/s | 124 kB 00:00 2024-03-04T09:01:49.082 INFO:teuthology.orchestra.run.smithi190.stdout:(102/176): python3-requests-2.25.1-8.el9.noarch 1.5 MB/s | 113 kB 00:00 2024-03-04T09:01:49.106 INFO:teuthology.orchestra.run.smithi190.stdout:(103/176): python3-urllib3-1.26.5-5.el9.noarch. 2.4 MB/s | 187 kB 00:00 2024-03-04T09:01:49.219 INFO:teuthology.orchestra.run.smithi102.stdout:lab-extras 38 kB/s | 1.7 kB 00:00 2024-03-04T09:01:49.691 INFO:teuthology.orchestra.run.smithi190.stdout:(104/176): python3-devel-3.9.17-2.el9.x86_64.rp 403 kB/s | 245 kB 00:00 2024-03-04T09:01:50.007 INFO:teuthology.orchestra.run.smithi190.stdout:(105/176): abseil-cpp-20211102.0-3.el9.x86_64.r 1.7 MB/s | 548 kB 00:00 2024-03-04T09:01:50.074 INFO:teuthology.orchestra.run.smithi190.stdout:(106/176): gperftools-libs-2.9.1-2.el9.x86_64.r 4.5 MB/s | 309 kB 00:00 2024-03-04T09:01:50.141 INFO:teuthology.orchestra.run.smithi190.stdout:(107/176): grpc-data-1.46.7-10.el9.noarch.rpm 291 kB/s | 19 kB 00:00 2024-03-04T09:01:50.608 INFO:teuthology.orchestra.run.smithi190.stdout:(108/176): libarrow-9.0.0-10.el9.x86_64.rpm 9.5 MB/s | 4.4 MB 00:00 2024-03-04T09:01:50.675 INFO:teuthology.orchestra.run.smithi190.stdout:(109/176): libarrow-doc-9.0.0-10.el9.noarch.rpm 390 kB/s | 26 kB 00:00 2024-03-04T09:01:50.742 INFO:teuthology.orchestra.run.smithi190.stdout:(110/176): liboath-2.6.7-2.el9.x86_64.rpm 729 kB/s | 49 kB 00:00 2024-03-04T09:01:50.809 INFO:teuthology.orchestra.run.smithi190.stdout:(111/176): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2024-03-04T09:01:50.876 INFO:teuthology.orchestra.run.smithi190.stdout:(112/176): luarocks-3.9.2-1.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-03-04T09:01:50.993 INFO:teuthology.orchestra.run.smithi190.stdout:(113/176): parquet-libs-9.0.0-10.el9.x86_64.rpm 7.0 MB/s | 838 kB 00:00 2024-03-04T09:01:51.068 INFO:teuthology.orchestra.run.smithi190.stdout:(114/176): python3-asyncssh-2.13.2-4.el9.noarch 7.2 MB/s | 548 kB 00:00 2024-03-04T09:01:51.134 INFO:teuthology.orchestra.run.smithi190.stdout:(115/176): python3-bcrypt-3.2.2-1.el9.x86_64.rp 652 kB/s | 43 kB 00:00 2024-03-04T09:01:51.202 INFO:teuthology.orchestra.run.smithi190.stdout:(116/176): python3-cachetools-4.2.4-1.el9.noarc 482 kB/s | 32 kB 00:00 2024-03-04T09:01:51.269 INFO:teuthology.orchestra.run.smithi190.stdout:(117/176): python3-certifi-2021.10.8-2.el9.noar 225 kB/s | 15 kB 00:00 2024-03-04T09:01:51.336 INFO:teuthology.orchestra.run.smithi190.stdout:(118/176): python3-cheroot-8.6.0-4.el9.noarch.r 2.5 MB/s | 172 kB 00:00 2024-03-04T09:01:51.419 INFO:teuthology.orchestra.run.smithi190.stdout:(119/176): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-03-04T09:01:51.486 INFO:teuthology.orchestra.run.smithi190.stdout:(120/176): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-03-04T09:01:51.553 INFO:teuthology.orchestra.run.smithi190.stdout:(121/176): python3-colorama-0.4.4-12.el9.noarch 530 kB/s | 35 kB 00:00 2024-03-04T09:01:51.620 INFO:teuthology.orchestra.run.smithi190.stdout:(122/176): python3-google-auth-2.28.0-1.el9.noa 3.0 MB/s | 203 kB 00:00 2024-03-04T09:01:51.775 INFO:teuthology.orchestra.run.smithi102.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-04T09:01:51.776 INFO:teuthology.orchestra.run.smithi102.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-04T09:01:51.790 INFO:teuthology.orchestra.run.smithi102.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-04T09:01:51.791 INFO:teuthology.orchestra.run.smithi102.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-04T09:01:51.792 INFO:teuthology.orchestra.run.smithi102.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-04T09:01:51.793 INFO:teuthology.orchestra.run.smithi102.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-04T09:01:51.795 INFO:teuthology.orchestra.run.smithi102.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-04T09:01:51.798 INFO:teuthology.orchestra.run.smithi102.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-04T09:01:51.799 INFO:teuthology.orchestra.run.smithi102.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-04T09:01:51.881 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-03-04T09:01:51.893 INFO:teuthology.orchestra.run.smithi102.stdout:============================================================================================ 2024-03-04T09:01:51.894 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-03-04T09:01:51.894 INFO:teuthology.orchestra.run.smithi102.stdout:============================================================================================ 2024-03-04T09:01:51.894 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-03-04T09:01:51.894 INFO:teuthology.orchestra.run.smithi102.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-04T09:01:51.894 INFO:teuthology.orchestra.run.smithi102.stdout: ceph x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 6.6 k 2024-03-04T09:01:51.894 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-base x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 5.3 M 2024-03-04T09:01:51.894 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-fuse x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 888 k 2024-03-04T09:01:51.894 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 145 k 2024-03-04T09:01:51.894 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 1.5 M 2024-03-04T09:01:51.894 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 138 k 2024-03-04T09:01:51.894 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 1.8 M 2024-03-04T09:01:51.895 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 7.4 M 2024-03-04T09:01:51.895 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-rook noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 49 k 2024-03-04T09:01:51.895 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-radosgw x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 9.8 M 2024-03-04T09:01:51.895 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-test x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 47 M 2024-03-04T09:01:51.895 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-volume noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 264 k 2024-03-04T09:01:51.895 INFO:teuthology.orchestra.run.smithi102.stdout: cephadm noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 748 k 2024-03-04T09:01:51.895 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-mirror x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 220 k 2024-03-04T09:01:51.895 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-shell x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 27 k 2024-03-04T09:01:51.895 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-top noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 18 k 2024-03-04T09:01:51.895 INFO:teuthology.orchestra.run.smithi102.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 CentOS-AppStream 20 k 2024-03-04T09:01:51.895 INFO:teuthology.orchestra.run.smithi102.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-04T09:01:51.895 INFO:teuthology.orchestra.run.smithi102.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-04T09:01:51.896 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs-devel x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 31 k 2024-03-04T09:01:51.896 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs2 x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 747 k 2024-03-04T09:01:51.896 INFO:teuthology.orchestra.run.smithi102.stdout: librados-devel x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 127 k 2024-03-04T09:01:51.896 INFO:teuthology.orchestra.run.smithi102.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-04T09:01:51.896 INFO:teuthology.orchestra.run.smithi102.stdout: libuuid-devel x86_64 2.37.4-18.el9 CentOS-AppStream 24 k 2024-03-04T09:01:51.896 INFO:teuthology.orchestra.run.smithi102.stdout: openssl-devel x86_64 1:3.0.7-27.el9 CentOS-AppStream 3.0 M 2024-03-04T09:01:51.896 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-03-04T09:01:51.896 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-03-04T09:01:51.896 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-03-04T09:01:51.896 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cephfs x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 162 k 2024-03-04T09:01:51.896 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rados x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 321 k 2024-03-04T09:01:51.897 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rbd x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 298 k 2024-03-04T09:01:51.897 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rgw x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 99 k 2024-03-04T09:01:51.897 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-fuse x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 85 k 2024-03-04T09:01:51.897 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-mirror x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 3.1 M 2024-03-04T09:01:51.897 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-nbd x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 171 k 2024-03-04T09:01:51.897 INFO:teuthology.orchestra.run.smithi102.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 CentOS-AppStream 87 k 2024-03-04T09:01:51.897 INFO:teuthology.orchestra.run.smithi102.stdout:Upgrading: 2024-03-04T09:01:51.897 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager x86_64 1:1.46.0-1.el9 CentOS-BaseOS 2.3 M 2024-03-04T09:01:51.897 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-libnm x86_64 1:1.46.0-1.el9 CentOS-BaseOS 1.8 M 2024-03-04T09:01:51.897 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-team x86_64 1:1.46.0-1.el9 CentOS-BaseOS 41 k 2024-03-04T09:01:51.897 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-tui x86_64 1:1.46.0-1.el9 CentOS-BaseOS 247 k 2024-03-04T09:01:51.897 INFO:teuthology.orchestra.run.smithi102.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2024-03-04T09:01:51.897 INFO:teuthology.orchestra.run.smithi102.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 CentOS-BaseOS 35 k 2024-03-04T09:01:51.898 INFO:teuthology.orchestra.run.smithi102.stdout: elfutils-libelf x86_64 0.190-2.el9 CentOS-BaseOS 191 k 2024-03-04T09:01:51.898 INFO:teuthology.orchestra.run.smithi102.stdout: elfutils-libs x86_64 0.190-2.el9 CentOS-BaseOS 254 k 2024-03-04T09:01:51.898 INFO:teuthology.orchestra.run.smithi102.stdout: iproute x86_64 6.7.0-2.el9 CentOS-BaseOS 802 k 2024-03-04T09:01:51.898 INFO:teuthology.orchestra.run.smithi102.stdout: iproute-tc x86_64 6.7.0-2.el9 CentOS-BaseOS 433 k 2024-03-04T09:01:51.898 INFO:teuthology.orchestra.run.smithi102.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2024-03-04T09:01:51.898 INFO:teuthology.orchestra.run.smithi102.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2024-03-04T09:01:51.898 INFO:teuthology.orchestra.run.smithi102.stdout: libblkid x86_64 2.37.4-18.el9 CentOS-BaseOS 107 k 2024-03-04T09:01:51.898 INFO:teuthology.orchestra.run.smithi102.stdout: libfdisk x86_64 2.37.4-18.el9 CentOS-BaseOS 154 k 2024-03-04T09:01:51.898 INFO:teuthology.orchestra.run.smithi102.stdout: libmount x86_64 2.37.4-18.el9 CentOS-BaseOS 135 k 2024-03-04T09:01:51.898 INFO:teuthology.orchestra.run.smithi102.stdout: librados2 x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 3.4 M 2024-03-04T09:01:51.898 INFO:teuthology.orchestra.run.smithi102.stdout: librbd1 x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 3.1 M 2024-03-04T09:01:51.898 INFO:teuthology.orchestra.run.smithi102.stdout: libsmartcols x86_64 2.37.4-18.el9 CentOS-BaseOS 63 k 2024-03-04T09:01:51.899 INFO:teuthology.orchestra.run.smithi102.stdout: libuuid x86_64 2.37.4-18.el9 CentOS-BaseOS 28 k 2024-03-04T09:01:51.899 INFO:teuthology.orchestra.run.smithi102.stdout: openssl x86_64 1:3.0.7-27.el9 CentOS-BaseOS 1.2 M 2024-03-04T09:01:51.899 INFO:teuthology.orchestra.run.smithi102.stdout: openssl-libs x86_64 1:3.0.7-27.el9 CentOS-BaseOS 2.2 M 2024-03-04T09:01:51.899 INFO:teuthology.orchestra.run.smithi102.stdout: util-linux x86_64 2.37.4-18.el9 CentOS-BaseOS 2.2 M 2024-03-04T09:01:51.899 INFO:teuthology.orchestra.run.smithi102.stdout: util-linux-core x86_64 2.37.4-18.el9 CentOS-BaseOS 438 k 2024-03-04T09:01:51.899 INFO:teuthology.orchestra.run.smithi102.stdout: util-linux-user x86_64 2.37.4-18.el9 CentOS-BaseOS 30 k 2024-03-04T09:01:51.899 INFO:teuthology.orchestra.run.smithi102.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-04T09:01:51.900 INFO:teuthology.orchestra.run.smithi102.stdout: xfsprogs x86_64 6.3.0-1.el9 CentOS-BaseOS 1.1 M 2024-03-04T09:01:51.900 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-03-04T09:01:51.900 INFO:teuthology.orchestra.run.smithi102.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-04T09:01:51.900 INFO:teuthology.orchestra.run.smithi102.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-04T09:01:51.900 INFO:teuthology.orchestra.run.smithi102.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-04T09:01:51.900 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-common x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 20 M 2024-03-04T09:01:51.900 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 31 k 2024-03-04T09:01:51.900 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mds x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 2.3 M 2024-03-04T09:01:51.900 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 248 k 2024-03-04T09:01:51.900 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mon x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 4.7 M 2024-03-04T09:01:51.900 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-osd x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 17 M 2024-03-04T09:01:51.901 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 15 k 2024-03-04T09:01:51.901 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-selinux x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 25 k 2024-03-04T09:01:51.901 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-04T09:01:51.901 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-04T09:01:51.901 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-04T09:01:51.901 INFO:teuthology.orchestra.run.smithi102.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-04T09:01:51.901 INFO:teuthology.orchestra.run.smithi102.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-04T09:01:51.901 INFO:teuthology.orchestra.run.smithi102.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-04T09:01:51.901 INFO:teuthology.orchestra.run.smithi102.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-03-04T09:01:51.901 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-04T09:01:51.901 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-04T09:01:51.901 INFO:teuthology.orchestra.run.smithi102.stdout: libcephsqlite x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 163 k 2024-03-04T09:01:51.902 INFO:teuthology.orchestra.run.smithi102.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-03-04T09:01:51.902 INFO:teuthology.orchestra.run.smithi102.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-04T09:01:51.902 INFO:teuthology.orchestra.run.smithi102.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-04T09:01:51.902 INFO:teuthology.orchestra.run.smithi102.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-03-04T09:01:51.902 INFO:teuthology.orchestra.run.smithi102.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-04T09:01:51.902 INFO:teuthology.orchestra.run.smithi102.stdout: libradosstriper1 x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 501 k 2024-03-04T09:01:51.902 INFO:teuthology.orchestra.run.smithi102.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-04T09:01:51.902 INFO:teuthology.orchestra.run.smithi102.stdout: librgw2 x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 5.1 M 2024-03-04T09:01:51.902 INFO:teuthology.orchestra.run.smithi102.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-04T09:01:51.902 INFO:teuthology.orchestra.run.smithi102.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-04T09:01:51.902 INFO:teuthology.orchestra.run.smithi102.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-04T09:01:51.902 INFO:teuthology.orchestra.run.smithi102.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-04T09:01:51.902 INFO:teuthology.orchestra.run.smithi102.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-04T09:01:51.903 INFO:teuthology.orchestra.run.smithi102.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-04T09:01:51.903 INFO:teuthology.orchestra.run.smithi102.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-03-04T09:01:51.903 INFO:teuthology.orchestra.run.smithi102.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-04T09:01:51.903 INFO:teuthology.orchestra.run.smithi102.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-04T09:01:51.903 INFO:teuthology.orchestra.run.smithi102.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-04T09:01:51.903 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-03-04T09:01:51.903 INFO:teuthology.orchestra.run.smithi102.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-04T09:01:51.903 INFO:teuthology.orchestra.run.smithi102.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-04T09:01:51.903 INFO:teuthology.orchestra.run.smithi102.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-03-04T09:01:51.903 INFO:teuthology.orchestra.run.smithi102.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-04T09:01:51.903 INFO:teuthology.orchestra.run.smithi102.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-04T09:01:51.903 INFO:teuthology.orchestra.run.smithi102.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-04T09:01:51.904 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-04T09:01:51.904 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-argparse x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 45 k 2024-03-04T09:01:51.904 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-common x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 131 k 2024-03-04T09:01:51.904 INFO:teuthology.orchestra.run.smithi102.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-04T09:01:51.904 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-04T09:01:51.904 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-04T09:01:51.904 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-04T09:01:51.904 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-04T09:01:51.904 INFO:teuthology.orchestra.run.smithi102.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-04T09:01:51.904 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-04T09:01:51.904 INFO:teuthology.orchestra.run.smithi102.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-04T09:01:51.904 INFO:teuthology.orchestra.run.smithi102.stdout: python3-google-auth noarch 1:2.28.0-1.el9 epel 203 k 2024-03-04T09:01:51.905 INFO:teuthology.orchestra.run.smithi102.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-04T09:01:51.905 INFO:teuthology.orchestra.run.smithi102.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-04T09:01:51.905 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-04T09:01:51.905 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-04T09:01:51.905 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-04T09:01:51.905 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-04T09:01:51.905 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-04T09:01:51.905 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jinja2 noarch 2.11.3-5.el9 CentOS-AppStream 227 k 2024-03-04T09:01:51.905 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-04T09:01:51.905 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-04T09:01:51.905 INFO:teuthology.orchestra.run.smithi102.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-04T09:01:51.905 INFO:teuthology.orchestra.run.smithi102.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-04T09:01:51.905 INFO:teuthology.orchestra.run.smithi102.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-04T09:01:51.906 INFO:teuthology.orchestra.run.smithi102.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-04T09:01:51.906 INFO:teuthology.orchestra.run.smithi102.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-04T09:01:51.906 INFO:teuthology.orchestra.run.smithi102.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-04T09:01:51.906 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-04T09:01:51.906 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-04T09:01:51.906 INFO:teuthology.orchestra.run.smithi102.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-04T09:01:51.906 INFO:teuthology.orchestra.run.smithi102.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-04T09:01:51.906 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-04T09:01:51.906 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-04T09:01:51.906 INFO:teuthology.orchestra.run.smithi102.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-04T09:01:51.906 INFO:teuthology.orchestra.run.smithi102.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-04T09:01:51.906 INFO:teuthology.orchestra.run.smithi102.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-04T09:01:51.906 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-04T09:01:51.906 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-04T09:01:51.907 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-04T09:01:51.907 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-04T09:01:51.907 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-04T09:01:51.907 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-04T09:01:51.907 INFO:teuthology.orchestra.run.smithi102.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-04T09:01:51.907 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests noarch 2.25.1-8.el9 CentOS-BaseOS 113 k 2024-03-04T09:01:51.907 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-04T09:01:51.907 INFO:teuthology.orchestra.run.smithi102.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-04T09:01:51.907 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-04T09:01:51.907 INFO:teuthology.orchestra.run.smithi102.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-04T09:01:51.907 INFO:teuthology.orchestra.run.smithi102.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-04T09:01:51.907 INFO:teuthology.orchestra.run.smithi102.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-04T09:01:51.907 INFO:teuthology.orchestra.run.smithi102.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-04T09:01:51.907 INFO:teuthology.orchestra.run.smithi102.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-04T09:01:51.907 INFO:teuthology.orchestra.run.smithi102.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-04T09:01:51.908 INFO:teuthology.orchestra.run.smithi102.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-04T09:01:51.908 INFO:teuthology.orchestra.run.smithi102.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-04T09:01:51.908 INFO:teuthology.orchestra.run.smithi102.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-04T09:01:51.908 INFO:teuthology.orchestra.run.smithi102.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-04T09:01:51.908 INFO:teuthology.orchestra.run.smithi102.stdout: qatlib x86_64 23.11.0-1.el9 CentOS-AppStream 215 k 2024-03-04T09:01:51.908 INFO:teuthology.orchestra.run.smithi102.stdout: qatzip-libs x86_64 1.1.2-2.el9 CentOS-AppStream 43 k 2024-03-04T09:01:51.908 INFO:teuthology.orchestra.run.smithi102.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-04T09:01:51.908 INFO:teuthology.orchestra.run.smithi102.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-04T09:01:51.908 INFO:teuthology.orchestra.run.smithi102.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-04T09:01:51.908 INFO:teuthology.orchestra.run.smithi102.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-04T09:01:51.908 INFO:teuthology.orchestra.run.smithi102.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-04T09:01:51.908 INFO:teuthology.orchestra.run.smithi102.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-04T09:01:51.909 INFO:teuthology.orchestra.run.smithi102.stdout:Installing weak dependencies: 2024-03-04T09:01:51.909 INFO:teuthology.orchestra.run.smithi102.stdout: qatlib-service x86_64 23.11.0-1.el9 CentOS-AppStream 34 k 2024-03-04T09:01:51.909 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-04T09:01:51.909 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-03-04T09:01:51.909 INFO:teuthology.orchestra.run.smithi102.stdout:============================================================================================ 2024-03-04T09:01:51.909 INFO:teuthology.orchestra.run.smithi102.stdout:Install 150 Packages 2024-03-04T09:01:51.909 INFO:teuthology.orchestra.run.smithi102.stdout:Upgrade 26 Packages 2024-03-04T09:01:51.909 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-04T09:01:51.910 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 224 M 2024-03-04T09:01:51.910 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-03-04T09:01:51.937 INFO:teuthology.orchestra.run.smithi190.stdout:(123/176): python3-grpcio-1.46.7-10.el9.x86_64. 6.4 MB/s | 2.0 MB 00:00 2024-03-04T09:01:52.004 INFO:teuthology.orchestra.run.smithi190.stdout:(124/176): python3-grpcio-tools-1.46.7-10.el9.x 2.1 MB/s | 144 kB 00:00 2024-03-04T09:01:52.062 INFO:teuthology.orchestra.run.smithi190.stdout:(125/176): python3-jaraco-8.2.1-3.el9.noarch.rp 183 kB/s | 11 kB 00:00 2024-03-04T09:01:52.121 INFO:teuthology.orchestra.run.smithi190.stdout:(126/176): python3-jaraco-classes-3.2.1-5.el9.n 304 kB/s | 18 kB 00:00 2024-03-04T09:01:52.196 INFO:teuthology.orchestra.run.smithi190.stdout:(127/176): python3-jaraco-collections-3.0.0-8.e 308 kB/s | 23 kB 00:00 2024-03-04T09:01:52.255 INFO:teuthology.orchestra.run.smithi190.stdout:(128/176): python3-jaraco-functools-3.5.0-2.el9 334 kB/s | 19 kB 00:00 2024-03-04T09:01:52.295 INFO:teuthology.orchestra.run.smithi102.stdout:(1/176): ceph-19.0.0-1739.g1bc250c7.el9.x86_64. 40 kB/s | 6.6 kB 00:00 2024-03-04T09:01:52.313 INFO:teuthology.orchestra.run.smithi190.stdout:(129/176): python3-jaraco-text-3.2.0-6.el9.noar 337 kB/s | 20 kB 00:00 2024-03-04T09:01:52.438 INFO:teuthology.orchestra.run.smithi190.stdout:(130/176): python3-kubernetes-26.1.0-2.el9.noar 8.2 MB/s | 1.0 MB 00:00 2024-03-04T09:01:52.479 INFO:teuthology.orchestra.run.smithi102.stdout:(2/176): ceph-fuse-19.0.0-1739.g1bc250c7.el9.x8 4.7 MB/s | 888 kB 00:00 2024-03-04T09:01:52.497 INFO:teuthology.orchestra.run.smithi190.stdout:(131/176): python3-logutils-0.3.5-21.el9.noarch 793 kB/s | 46 kB 00:00 2024-03-04T09:01:52.502 INFO:teuthology.orchestra.run.smithi082.stdout:lab-extras 41 kB/s | 1.7 kB 00:00 2024-03-04T09:01:52.537 INFO:teuthology.orchestra.run.smithi102.stdout:(3/176): ceph-immutable-object-cache-19.0.0-173 2.4 MB/s | 145 kB 00:00 2024-03-04T09:01:52.564 INFO:teuthology.orchestra.run.smithi190.stdout:(132/176): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2024-03-04T09:01:52.623 INFO:teuthology.orchestra.run.smithi190.stdout:(133/176): python3-natsort-7.1.1-5.el9.noarch.r 990 kB/s | 58 kB 00:00 2024-03-04T09:01:52.690 INFO:teuthology.orchestra.run.smithi190.stdout:(134/176): python3-pecan-1.4.2-3.el9.noarch.rpm 4.0 MB/s | 272 kB 00:00 2024-03-04T09:01:52.756 INFO:teuthology.orchestra.run.smithi190.stdout:(135/176): python3-portend-3.1.0-2.el9.noarch.r 247 kB/s | 16 kB 00:00 2024-03-04T09:01:52.771 INFO:teuthology.orchestra.run.smithi102.stdout:(4/176): ceph-base-19.0.0-1739.g1bc250c7.el9.x8 8.3 MB/s | 5.3 MB 00:00 2024-03-04T09:01:52.821 INFO:teuthology.orchestra.run.smithi102.stdout:(5/176): ceph-mds-19.0.0-1739.g1bc250c7.el9.x86 8.1 MB/s | 2.3 MB 00:00 2024-03-04T09:01:52.823 INFO:teuthology.orchestra.run.smithi190.stdout:(136/176): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-03-04T09:01:52.890 INFO:teuthology.orchestra.run.smithi190.stdout:(137/176): python3-pyperclip-1.8.2-2.el9.noarch 423 kB/s | 28 kB 00:00 2024-03-04T09:01:52.921 INFO:teuthology.orchestra.run.smithi102.stdout:(6/176): ceph-mgr-19.0.0-1739.g1bc250c7.el9.x86 10 MB/s | 1.5 MB 00:00 2024-03-04T09:01:52.957 INFO:teuthology.orchestra.run.smithi190.stdout:(138/176): python3-repoze-lru-0.7-16.el9.noarch 462 kB/s | 31 kB 00:00 2024-03-04T09:01:53.024 INFO:teuthology.orchestra.run.smithi190.stdout:(139/176): python3-routes-2.5.1-5.el9.noarch.rp 2.8 MB/s | 188 kB 00:00 2024-03-04T09:01:53.091 INFO:teuthology.orchestra.run.smithi190.stdout:(140/176): python3-rsa-4.9-2.el9.noarch.rpm 890 kB/s | 59 kB 00:00 2024-03-04T09:01:53.158 INFO:teuthology.orchestra.run.smithi190.stdout:(141/176): python3-tempora-5.0.0-2.el9.noarch.r 535 kB/s | 36 kB 00:00 2024-03-04T09:01:53.225 INFO:teuthology.orchestra.run.smithi190.stdout:(142/176): python3-typing-extensions-4.4.0-2.el 766 kB/s | 51 kB 00:00 2024-03-04T09:01:53.280 INFO:teuthology.orchestra.run.smithi102.stdout:(7/176): ceph-mon-19.0.0-1739.g1bc250c7.el9.x86 10 MB/s | 4.7 MB 00:00 2024-03-04T09:01:53.292 INFO:teuthology.orchestra.run.smithi190.stdout:(143/176): python3-webob-1.8.7-6.el9.noarch.rpm 3.4 MB/s | 230 kB 00:00 2024-03-04T09:01:53.359 INFO:teuthology.orchestra.run.smithi190.stdout:(144/176): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-03-04T09:01:53.425 INFO:teuthology.orchestra.run.smithi190.stdout:(145/176): python3-werkzeug-2.0.3-3.el9.1.noarc 6.3 MB/s | 427 kB 00:00 2024-03-04T09:01:53.493 INFO:teuthology.orchestra.run.smithi190.stdout:(146/176): python3-zc-lockfile-2.0-10.el9.noarc 299 kB/s | 20 kB 00:00 2024-03-04T09:01:53.559 INFO:teuthology.orchestra.run.smithi190.stdout:(147/176): re2-20211101-3.el9.x86_64.rpm 2.8 MB/s | 192 kB 00:00 2024-03-04T09:01:53.701 INFO:teuthology.orchestra.run.smithi190.stdout:(148/176): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-03-04T09:01:54.363 INFO:teuthology.orchestra.run.smithi102.stdout:(8/176): ceph-osd-19.0.0-1739.g1bc250c7.el9.x86 12 MB/s | 17 MB 00:01 2024-03-04T09:01:54.472 INFO:teuthology.orchestra.run.smithi102.stdout:(9/176): ceph-radosgw-19.0.0-1739.g1bc250c7.el9 8.2 MB/s | 9.8 MB 00:01 2024-03-04T09:01:54.497 INFO:teuthology.orchestra.run.smithi102.stdout:(10/176): ceph-selinux-19.0.0-1739.g1bc250c7.el 188 kB/s | 25 kB 00:00 2024-03-04T09:01:54.547 INFO:teuthology.orchestra.run.smithi102.stdout:(11/176): cephfs-mirror-19.0.0-1739.g1bc250c7.e 4.3 MB/s | 220 kB 00:00 2024-03-04T09:01:54.576 INFO:teuthology.orchestra.run.smithi190.stdout:(149/176): librados2-19.0.0-1739.g1bc250c7.el9. 3.9 MB/s | 3.4 MB 00:00 2024-03-04T09:01:54.622 INFO:teuthology.orchestra.run.smithi102.stdout:(12/176): cephfs-shell-19.0.0-1739.g1bc250c7.el 361 kB/s | 27 kB 00:00 2024-03-04T09:01:54.706 INFO:teuthology.orchestra.run.smithi102.stdout:(13/176): libcephfs-devel-19.0.0-1739.g1bc250c7 375 kB/s | 31 kB 00:00 2024-03-04T09:01:55.063 INFO:teuthology.orchestra.run.smithi082.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-04T09:01:55.064 INFO:teuthology.orchestra.run.smithi082.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-04T09:01:55.076 INFO:teuthology.orchestra.run.smithi082.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-04T09:01:55.077 INFO:teuthology.orchestra.run.smithi082.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-04T09:01:55.078 INFO:teuthology.orchestra.run.smithi082.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-04T09:01:55.079 INFO:teuthology.orchestra.run.smithi082.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-04T09:01:55.081 INFO:teuthology.orchestra.run.smithi082.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-04T09:01:55.083 INFO:teuthology.orchestra.run.smithi082.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-04T09:01:55.084 INFO:teuthology.orchestra.run.smithi082.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-04T09:01:55.166 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-03-04T09:01:55.168 INFO:teuthology.orchestra.run.smithi190.stdout:(150/176): librbd1-19.0.0-1739.g1bc250c7.el9.x8 5.3 MB/s | 3.1 MB 00:00 2024-03-04T09:01:55.184 INFO:teuthology.orchestra.run.smithi082.stdout:============================================================================================ 2024-03-04T09:01:55.184 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2024-03-04T09:01:55.184 INFO:teuthology.orchestra.run.smithi082.stdout:============================================================================================ 2024-03-04T09:01:55.184 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-03-04T09:01:55.185 INFO:teuthology.orchestra.run.smithi082.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-04T09:01:55.185 INFO:teuthology.orchestra.run.smithi082.stdout: ceph x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 6.6 k 2024-03-04T09:01:55.185 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-base x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 5.3 M 2024-03-04T09:01:55.185 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-fuse x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 888 k 2024-03-04T09:01:55.185 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 145 k 2024-03-04T09:01:55.185 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 1.5 M 2024-03-04T09:01:55.185 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 138 k 2024-03-04T09:01:55.185 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 1.8 M 2024-03-04T09:01:55.185 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 7.4 M 2024-03-04T09:01:55.185 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-rook noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 49 k 2024-03-04T09:01:55.185 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-radosgw x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 9.8 M 2024-03-04T09:01:55.185 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-test x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 47 M 2024-03-04T09:01:55.185 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-volume noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 264 k 2024-03-04T09:01:55.186 INFO:teuthology.orchestra.run.smithi082.stdout: cephadm noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 748 k 2024-03-04T09:01:55.186 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-mirror x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 220 k 2024-03-04T09:01:55.186 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-shell x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 27 k 2024-03-04T09:01:55.186 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-top noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 18 k 2024-03-04T09:01:55.186 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 CentOS-AppStream 20 k 2024-03-04T09:01:55.186 INFO:teuthology.orchestra.run.smithi082.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-04T09:01:55.186 INFO:teuthology.orchestra.run.smithi082.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-04T09:01:55.186 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs-devel x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 31 k 2024-03-04T09:01:55.186 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs2 x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 747 k 2024-03-04T09:01:55.186 INFO:teuthology.orchestra.run.smithi082.stdout: librados-devel x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 127 k 2024-03-04T09:01:55.186 INFO:teuthology.orchestra.run.smithi082.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-04T09:01:55.186 INFO:teuthology.orchestra.run.smithi082.stdout: libuuid-devel x86_64 2.37.4-18.el9 CentOS-AppStream 24 k 2024-03-04T09:01:55.186 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-devel x86_64 1:3.0.7-27.el9 CentOS-AppStream 3.0 M 2024-03-04T09:01:55.186 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-03-04T09:01:55.187 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-03-04T09:01:55.187 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-03-04T09:01:55.187 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cephfs x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 162 k 2024-03-04T09:01:55.187 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rados x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 321 k 2024-03-04T09:01:55.187 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rbd x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 298 k 2024-03-04T09:01:55.187 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rgw x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 99 k 2024-03-04T09:01:55.187 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-fuse x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 85 k 2024-03-04T09:01:55.187 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-mirror x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 3.1 M 2024-03-04T09:01:55.187 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-nbd x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 171 k 2024-03-04T09:01:55.187 INFO:teuthology.orchestra.run.smithi082.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 CentOS-AppStream 87 k 2024-03-04T09:01:55.187 INFO:teuthology.orchestra.run.smithi082.stdout:Upgrading: 2024-03-04T09:01:55.187 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager x86_64 1:1.46.0-1.el9 CentOS-BaseOS 2.3 M 2024-03-04T09:01:55.187 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-libnm x86_64 1:1.46.0-1.el9 CentOS-BaseOS 1.8 M 2024-03-04T09:01:55.188 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-team x86_64 1:1.46.0-1.el9 CentOS-BaseOS 41 k 2024-03-04T09:01:55.188 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-tui x86_64 1:1.46.0-1.el9 CentOS-BaseOS 247 k 2024-03-04T09:01:55.188 INFO:teuthology.orchestra.run.smithi082.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2024-03-04T09:01:55.188 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 CentOS-BaseOS 35 k 2024-03-04T09:01:55.188 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libelf x86_64 0.190-2.el9 CentOS-BaseOS 191 k 2024-03-04T09:01:55.188 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libs x86_64 0.190-2.el9 CentOS-BaseOS 254 k 2024-03-04T09:01:55.188 INFO:teuthology.orchestra.run.smithi082.stdout: iproute x86_64 6.7.0-2.el9 CentOS-BaseOS 802 k 2024-03-04T09:01:55.188 INFO:teuthology.orchestra.run.smithi082.stdout: iproute-tc x86_64 6.7.0-2.el9 CentOS-BaseOS 433 k 2024-03-04T09:01:55.188 INFO:teuthology.orchestra.run.smithi082.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2024-03-04T09:01:55.188 INFO:teuthology.orchestra.run.smithi082.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2024-03-04T09:01:55.188 INFO:teuthology.orchestra.run.smithi082.stdout: libblkid x86_64 2.37.4-18.el9 CentOS-BaseOS 107 k 2024-03-04T09:01:55.188 INFO:teuthology.orchestra.run.smithi082.stdout: libfdisk x86_64 2.37.4-18.el9 CentOS-BaseOS 154 k 2024-03-04T09:01:55.189 INFO:teuthology.orchestra.run.smithi082.stdout: libmount x86_64 2.37.4-18.el9 CentOS-BaseOS 135 k 2024-03-04T09:01:55.189 INFO:teuthology.orchestra.run.smithi082.stdout: librados2 x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 3.4 M 2024-03-04T09:01:55.190 INFO:teuthology.orchestra.run.smithi082.stdout: librbd1 x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 3.1 M 2024-03-04T09:01:55.190 INFO:teuthology.orchestra.run.smithi082.stdout: libsmartcols x86_64 2.37.4-18.el9 CentOS-BaseOS 63 k 2024-03-04T09:01:55.190 INFO:teuthology.orchestra.run.smithi082.stdout: libuuid x86_64 2.37.4-18.el9 CentOS-BaseOS 28 k 2024-03-04T09:01:55.190 INFO:teuthology.orchestra.run.smithi082.stdout: openssl x86_64 1:3.0.7-27.el9 CentOS-BaseOS 1.2 M 2024-03-04T09:01:55.190 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-libs x86_64 1:3.0.7-27.el9 CentOS-BaseOS 2.2 M 2024-03-04T09:01:55.190 INFO:teuthology.orchestra.run.smithi082.stdout: util-linux x86_64 2.37.4-18.el9 CentOS-BaseOS 2.2 M 2024-03-04T09:01:55.190 INFO:teuthology.orchestra.run.smithi082.stdout: util-linux-core x86_64 2.37.4-18.el9 CentOS-BaseOS 438 k 2024-03-04T09:01:55.190 INFO:teuthology.orchestra.run.smithi082.stdout: util-linux-user x86_64 2.37.4-18.el9 CentOS-BaseOS 30 k 2024-03-04T09:01:55.190 INFO:teuthology.orchestra.run.smithi082.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-04T09:01:55.190 INFO:teuthology.orchestra.run.smithi082.stdout: xfsprogs x86_64 6.3.0-1.el9 CentOS-BaseOS 1.1 M 2024-03-04T09:01:55.191 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2024-03-04T09:01:55.191 INFO:teuthology.orchestra.run.smithi082.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-04T09:01:55.191 INFO:teuthology.orchestra.run.smithi082.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-04T09:01:55.191 INFO:teuthology.orchestra.run.smithi082.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-04T09:01:55.191 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-common x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 20 M 2024-03-04T09:01:55.191 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 31 k 2024-03-04T09:01:55.191 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mds x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 2.3 M 2024-03-04T09:01:55.191 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 248 k 2024-03-04T09:01:55.191 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mon x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 4.7 M 2024-03-04T09:01:55.191 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-osd x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 17 M 2024-03-04T09:01:55.191 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1739.g1bc250c7.el9 ceph-noarch 15 k 2024-03-04T09:01:55.191 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-selinux x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 25 k 2024-03-04T09:01:55.191 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-04T09:01:55.191 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-04T09:01:55.191 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-04T09:01:55.192 INFO:teuthology.orchestra.run.smithi082.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-04T09:01:55.192 INFO:teuthology.orchestra.run.smithi082.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-04T09:01:55.192 INFO:teuthology.orchestra.run.smithi082.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-04T09:01:55.192 INFO:teuthology.orchestra.run.smithi082.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-03-04T09:01:55.192 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-04T09:01:55.192 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-04T09:01:55.192 INFO:teuthology.orchestra.run.smithi082.stdout: libcephsqlite x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 163 k 2024-03-04T09:01:55.192 INFO:teuthology.orchestra.run.smithi082.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-03-04T09:01:55.192 INFO:teuthology.orchestra.run.smithi082.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-04T09:01:55.192 INFO:teuthology.orchestra.run.smithi082.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-04T09:01:55.192 INFO:teuthology.orchestra.run.smithi082.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-03-04T09:01:55.192 INFO:teuthology.orchestra.run.smithi082.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-04T09:01:55.193 INFO:teuthology.orchestra.run.smithi082.stdout: libradosstriper1 x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 501 k 2024-03-04T09:01:55.193 INFO:teuthology.orchestra.run.smithi082.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-04T09:01:55.193 INFO:teuthology.orchestra.run.smithi082.stdout: librgw2 x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 5.1 M 2024-03-04T09:01:55.193 INFO:teuthology.orchestra.run.smithi082.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-04T09:01:55.193 INFO:teuthology.orchestra.run.smithi082.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-04T09:01:55.193 INFO:teuthology.orchestra.run.smithi082.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-04T09:01:55.193 INFO:teuthology.orchestra.run.smithi082.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-04T09:01:55.193 INFO:teuthology.orchestra.run.smithi082.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-04T09:01:55.193 INFO:teuthology.orchestra.run.smithi082.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-04T09:01:55.193 INFO:teuthology.orchestra.run.smithi082.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-03-04T09:01:55.193 INFO:teuthology.orchestra.run.smithi082.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-04T09:01:55.193 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-04T09:01:55.193 INFO:teuthology.orchestra.run.smithi082.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-04T09:01:55.193 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-03-04T09:01:55.194 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-04T09:01:55.194 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-04T09:01:55.194 INFO:teuthology.orchestra.run.smithi082.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-03-04T09:01:55.194 INFO:teuthology.orchestra.run.smithi082.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-04T09:01:55.194 INFO:teuthology.orchestra.run.smithi082.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-04T09:01:55.194 INFO:teuthology.orchestra.run.smithi082.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-04T09:01:55.194 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-04T09:01:55.194 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-argparse x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 45 k 2024-03-04T09:01:55.194 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-common x86_64 2:19.0.0-1739.g1bc250c7.el9 ceph 131 k 2024-03-04T09:01:55.194 INFO:teuthology.orchestra.run.smithi082.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-04T09:01:55.194 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-04T09:01:55.194 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-04T09:01:55.194 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-04T09:01:55.195 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-04T09:01:55.195 INFO:teuthology.orchestra.run.smithi082.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-04T09:01:55.195 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-04T09:01:55.195 INFO:teuthology.orchestra.run.smithi082.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-04T09:01:55.195 INFO:teuthology.orchestra.run.smithi082.stdout: python3-google-auth noarch 1:2.28.0-1.el9 epel 203 k 2024-03-04T09:01:55.195 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-04T09:01:55.195 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-04T09:01:55.195 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-04T09:01:55.195 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-04T09:01:55.195 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-04T09:01:55.195 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-04T09:01:55.195 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-04T09:01:55.195 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jinja2 noarch 2.11.3-5.el9 CentOS-AppStream 227 k 2024-03-04T09:01:55.195 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-04T09:01:55.196 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-04T09:01:55.196 INFO:teuthology.orchestra.run.smithi082.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-04T09:01:55.196 INFO:teuthology.orchestra.run.smithi082.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-04T09:01:55.196 INFO:teuthology.orchestra.run.smithi082.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-04T09:01:55.196 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-04T09:01:55.196 INFO:teuthology.orchestra.run.smithi082.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-04T09:01:55.196 INFO:teuthology.orchestra.run.smithi082.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-04T09:01:55.196 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-04T09:01:55.196 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-04T09:01:55.196 INFO:teuthology.orchestra.run.smithi082.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-04T09:01:55.196 INFO:teuthology.orchestra.run.smithi082.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-04T09:01:55.196 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-04T09:01:55.196 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-04T09:01:55.196 INFO:teuthology.orchestra.run.smithi082.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-04T09:01:55.197 INFO:teuthology.orchestra.run.smithi082.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-04T09:01:55.197 INFO:teuthology.orchestra.run.smithi082.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-04T09:01:55.197 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-04T09:01:55.197 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-04T09:01:55.197 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-04T09:01:55.197 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-04T09:01:55.197 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-04T09:01:55.197 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-04T09:01:55.197 INFO:teuthology.orchestra.run.smithi082.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-04T09:01:55.197 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests noarch 2.25.1-8.el9 CentOS-BaseOS 113 k 2024-03-04T09:01:55.197 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-04T09:01:55.197 INFO:teuthology.orchestra.run.smithi082.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-04T09:01:55.197 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-04T09:01:55.197 INFO:teuthology.orchestra.run.smithi082.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-04T09:01:55.198 INFO:teuthology.orchestra.run.smithi082.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-04T09:01:55.198 INFO:teuthology.orchestra.run.smithi082.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-04T09:01:55.198 INFO:teuthology.orchestra.run.smithi082.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-04T09:01:55.198 INFO:teuthology.orchestra.run.smithi082.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-04T09:01:55.198 INFO:teuthology.orchestra.run.smithi082.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-04T09:01:55.198 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-04T09:01:55.198 INFO:teuthology.orchestra.run.smithi082.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-04T09:01:55.198 INFO:teuthology.orchestra.run.smithi082.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-04T09:01:55.198 INFO:teuthology.orchestra.run.smithi082.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-04T09:01:55.198 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib x86_64 23.11.0-1.el9 CentOS-AppStream 215 k 2024-03-04T09:01:55.198 INFO:teuthology.orchestra.run.smithi082.stdout: qatzip-libs x86_64 1.1.2-2.el9 CentOS-AppStream 43 k 2024-03-04T09:01:55.198 INFO:teuthology.orchestra.run.smithi082.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-04T09:01:55.198 INFO:teuthology.orchestra.run.smithi082.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-04T09:01:55.198 INFO:teuthology.orchestra.run.smithi082.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-04T09:01:55.199 INFO:teuthology.orchestra.run.smithi082.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-04T09:01:55.199 INFO:teuthology.orchestra.run.smithi082.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-04T09:01:55.199 INFO:teuthology.orchestra.run.smithi082.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-04T09:01:55.199 INFO:teuthology.orchestra.run.smithi082.stdout:Installing weak dependencies: 2024-03-04T09:01:55.199 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib-service x86_64 23.11.0-1.el9 CentOS-AppStream 34 k 2024-03-04T09:01:55.199 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:01:55.199 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-03-04T09:01:55.199 INFO:teuthology.orchestra.run.smithi082.stdout:============================================================================================ 2024-03-04T09:01:55.199 INFO:teuthology.orchestra.run.smithi082.stdout:Install 150 Packages 2024-03-04T09:01:55.199 INFO:teuthology.orchestra.run.smithi082.stdout:Upgrade 26 Packages 2024-03-04T09:01:55.199 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:01:55.200 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 224 M 2024-03-04T09:01:55.200 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-03-04T09:01:55.210 INFO:teuthology.orchestra.run.smithi190.stdout:(151/176): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.6 MB/s | 68 kB 00:00 2024-03-04T09:01:55.294 INFO:teuthology.orchestra.run.smithi190.stdout:(152/176): NetworkManager-1.46.0-1.el9.x86_64.r 27 MB/s | 2.3 MB 00:00 2024-03-04T09:01:55.394 INFO:teuthology.orchestra.run.smithi190.stdout:(153/176): NetworkManager-libnm-1.46.0-1.el9.x8 18 MB/s | 1.8 MB 00:00 2024-03-04T09:01:55.423 INFO:teuthology.orchestra.run.smithi102.stdout:(14/176): ceph-common-19.0.0-1739.g1bc250c7.el9 6.2 MB/s | 20 MB 00:03 2024-03-04T09:01:55.428 INFO:teuthology.orchestra.run.smithi190.stdout:(154/176): NetworkManager-team-1.46.0-1.el9.x86 1.2 MB/s | 41 kB 00:00 2024-03-04T09:01:55.448 INFO:teuthology.orchestra.run.smithi102.stdout:(15/176): libcephfs2-19.0.0-1739.g1bc250c7.el9. 1.0 MB/s | 747 kB 00:00 2024-03-04T09:01:55.462 INFO:teuthology.orchestra.run.smithi190.stdout:(155/176): NetworkManager-tui-1.46.0-1.el9.x86_ 7.3 MB/s | 247 kB 00:00 2024-03-04T09:01:55.495 INFO:teuthology.orchestra.run.smithi190.stdout:(156/176): acl-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 69 kB 00:00 2024-03-04T09:01:55.499 INFO:teuthology.orchestra.run.smithi102.stdout:(16/176): libcephsqlite-19.0.0-1739.g1bc250c7.e 2.1 MB/s | 163 kB 00:00 2024-03-04T09:01:55.524 INFO:teuthology.orchestra.run.smithi102.stdout:(17/176): librados-devel-19.0.0-1739.g1bc250c7. 1.6 MB/s | 127 kB 00:00 2024-03-04T09:01:55.529 INFO:teuthology.orchestra.run.smithi190.stdout:(157/176): elfutils-debuginfod-client-0.190-2.e 1.0 MB/s | 35 kB 00:00 2024-03-04T09:01:55.570 INFO:teuthology.orchestra.run.smithi190.stdout:(158/176): elfutils-libelf-0.190-2.el9.x86_64.r 4.5 MB/s | 191 kB 00:00 2024-03-04T09:01:55.591 INFO:teuthology.orchestra.run.smithi102.stdout:(18/176): libradosstriper1-19.0.0-1739.g1bc250c 5.3 MB/s | 501 kB 00:00 2024-03-04T09:01:55.612 INFO:teuthology.orchestra.run.smithi190.stdout:(159/176): elfutils-libs-0.190-2.el9.x86_64.rpm 6.0 MB/s | 254 kB 00:00 2024-03-04T09:01:55.663 INFO:teuthology.orchestra.run.smithi190.stdout:(160/176): iproute-6.7.0-2.el9.x86_64.rpm 16 MB/s | 802 kB 00:00 2024-03-04T09:01:55.675 INFO:teuthology.orchestra.run.smithi102.stdout:(19/176): python3-ceph-argparse-19.0.0-1739.g1b 542 kB/s | 45 kB 00:00 2024-03-04T09:01:55.705 INFO:teuthology.orchestra.run.smithi190.stdout:(161/176): iproute-tc-6.7.0-2.el9.x86_64.rpm 10 MB/s | 433 kB 00:00 2024-03-04T09:01:55.738 INFO:teuthology.orchestra.run.smithi190.stdout:(162/176): libacl-2.3.1-4.el9.x86_64.rpm 661 kB/s | 22 kB 00:00 2024-03-04T09:01:55.758 INFO:teuthology.orchestra.run.smithi102.stdout:(20/176): python3-ceph-common-19.0.0-1739.g1bc2 1.5 MB/s | 131 kB 00:00 2024-03-04T09:01:55.763 INFO:teuthology.orchestra.run.smithi190.stdout:(163/176): libblkid-2.37.4-18.el9.x86_64.rpm 4.2 MB/s | 107 kB 00:00 2024-03-04T09:01:55.797 INFO:teuthology.orchestra.run.smithi190.stdout:(164/176): libfdisk-2.37.4-18.el9.x86_64.rpm 4.5 MB/s | 154 kB 00:00 2024-03-04T09:01:55.831 INFO:teuthology.orchestra.run.smithi190.stdout:(165/176): libmount-2.37.4-18.el9.x86_64.rpm 3.9 MB/s | 135 kB 00:00 2024-03-04T09:01:55.842 INFO:teuthology.orchestra.run.smithi102.stdout:(21/176): python3-cephfs-19.0.0-1739.g1bc250c7. 1.9 MB/s | 162 kB 00:00 2024-03-04T09:01:55.864 INFO:teuthology.orchestra.run.smithi190.stdout:(166/176): libsmartcols-2.37.4-18.el9.x86_64.rp 1.8 MB/s | 63 kB 00:00 2024-03-04T09:01:55.898 INFO:teuthology.orchestra.run.smithi190.stdout:(167/176): libuuid-2.37.4-18.el9.x86_64.rpm 829 kB/s | 28 kB 00:00 2024-03-04T09:01:55.934 INFO:teuthology.orchestra.run.smithi102.stdout:(22/176): python3-rados-19.0.0-1739.g1bc250c7.e 3.4 MB/s | 321 kB 00:00 2024-03-04T09:01:55.956 INFO:teuthology.orchestra.run.smithi190.stdout:(168/176): openssl-3.0.7-27.el9.x86_64.rpm 20 MB/s | 1.2 MB 00:00 2024-03-04T09:01:56.018 INFO:teuthology.orchestra.run.smithi102.stdout:(23/176): librgw2-19.0.0-1739.g1bc250c7.el9.x86 10 MB/s | 5.1 MB 00:00 2024-03-04T09:01:56.043 INFO:teuthology.orchestra.run.smithi102.stdout:(24/176): python3-rbd-19.0.0-1739.g1bc250c7.el9 2.7 MB/s | 298 kB 00:00 2024-03-04T09:01:56.048 INFO:teuthology.orchestra.run.smithi190.stdout:(169/176): openssl-libs-3.0.7-27.el9.x86_64.rpm 23 MB/s | 2.2 MB 00:00 2024-03-04T09:01:56.068 INFO:teuthology.orchestra.run.smithi102.stdout:(25/176): python3-rgw-19.0.0-1739.g1bc250c7.el9 1.9 MB/s | 99 kB 00:00 2024-03-04T09:01:56.119 INFO:teuthology.orchestra.run.smithi102.stdout:(26/176): rbd-fuse-19.0.0-1739.g1bc250c7.el9.x8 1.1 MB/s | 85 kB 00:00 2024-03-04T09:01:56.136 INFO:teuthology.orchestra.run.smithi082.stdout:(1/176): ceph-19.0.0-1739.g1bc250c7.el9.x86_64. 27 kB/s | 6.6 kB 00:00 2024-03-04T09:01:56.140 INFO:teuthology.orchestra.run.smithi190.stdout:(170/176): util-linux-2.37.4-18.el9.x86_64.rpm 24 MB/s | 2.2 MB 00:00 2024-03-04T09:01:56.182 INFO:teuthology.orchestra.run.smithi190.stdout:(171/176): util-linux-core-2.37.4-18.el9.x86_64 10 MB/s | 438 kB 00:00 2024-03-04T09:01:56.207 INFO:teuthology.orchestra.run.smithi190.stdout:(172/176): util-linux-user-2.37.4-18.el9.x86_64 1.2 MB/s | 30 kB 00:00 2024-03-04T09:01:56.219 INFO:teuthology.orchestra.run.smithi102.stdout:(27/176): rbd-nbd-19.0.0-1739.g1bc250c7.el9.x86 1.7 MB/s | 171 kB 00:00 2024-03-04T09:01:56.249 INFO:teuthology.orchestra.run.smithi190.stdout:(173/176): xfsdump-3.1.12-4.el9.x86_64.rpm 7.5 MB/s | 321 kB 00:00 2024-03-04T09:01:56.311 INFO:teuthology.orchestra.run.smithi102.stdout:(28/176): ceph-grafana-dashboards-19.0.0-1739.g 343 kB/s | 31 kB 00:00 2024-03-04T09:01:56.324 INFO:teuthology.orchestra.run.smithi190.stdout:(174/176): xfsprogs-6.3.0-1.el9.x86_64.rpm 14 MB/s | 1.1 MB 00:00 2024-03-04T09:01:56.380 INFO:teuthology.orchestra.run.smithi102.stdout:(29/176): rbd-mirror-19.0.0-1739.g1bc250c7.el9. 10 MB/s | 3.1 MB 00:00 2024-03-04T09:01:56.403 INFO:teuthology.orchestra.run.smithi102.stdout:(30/176): ceph-mgr-cephadm-19.0.0-1739.g1bc250c 1.5 MB/s | 138 kB 00:00 2024-03-04T09:01:56.620 INFO:teuthology.orchestra.run.smithi102.stdout:(31/176): ceph-mgr-dashboard-19.0.0-1739.g1bc25 7.4 MB/s | 1.8 MB 00:00 2024-03-04T09:01:56.712 INFO:teuthology.orchestra.run.smithi102.stdout:(32/176): ceph-mgr-modules-core-19.0.0-1739.g1b 2.7 MB/s | 248 kB 00:00 2024-03-04T09:01:56.787 INFO:teuthology.orchestra.run.smithi102.stdout:(33/176): ceph-mgr-rook-19.0.0-1739.g1bc250c7.e 659 kB/s | 49 kB 00:00 2024-03-04T09:01:56.871 INFO:teuthology.orchestra.run.smithi102.stdout:(34/176): ceph-prometheus-alerts-19.0.0-1739.g1 184 kB/s | 15 kB 00:00 2024-03-04T09:01:56.963 INFO:teuthology.orchestra.run.smithi102.stdout:(35/176): ceph-volume-19.0.0-1739.g1bc250c7.el9 2.8 MB/s | 264 kB 00:00 2024-03-04T09:01:57.128 INFO:teuthology.orchestra.run.smithi082.stdout:(2/176): ceph-fuse-19.0.0-1739.g1bc250c7.el9.x8 896 kB/s | 888 kB 00:00 2024-03-04T09:01:57.179 INFO:teuthology.orchestra.run.smithi102.stdout:(36/176): cephadm-19.0.0-1739.g1bc250c7.el9.noa 3.4 MB/s | 748 kB 00:00 2024-03-04T09:01:57.247 INFO:teuthology.orchestra.run.smithi102.stdout:(37/176): cephfs-top-19.0.0-1739.g1bc250c7.el9. 273 kB/s | 18 kB 00:00 2024-03-04T09:01:57.336 INFO:teuthology.orchestra.run.smithi082.stdout:(3/176): ceph-immutable-object-cache-19.0.0-173 697 kB/s | 145 kB 00:00 2024-03-04T09:01:57.447 INFO:teuthology.orchestra.run.smithi102.stdout:(38/176): ceph-mgr-diskprediction-local-19.0.0- 7.1 MB/s | 7.4 MB 00:01 2024-03-04T09:01:57.622 INFO:teuthology.orchestra.run.smithi102.stdout:(39/176): automake-1.16.2-8.el9.noarch.rpm 1.7 MB/s | 662 kB 00:00 2024-03-04T09:01:57.670 INFO:teuthology.orchestra.run.smithi082.stdout:(4/176): ceph-base-19.0.0-1739.g1bc250c7.el9.x8 3.0 MB/s | 5.3 MB 00:01 2024-03-04T09:01:57.689 INFO:teuthology.orchestra.run.smithi102.stdout:(40/176): bison-3.7.4-5.el9.x86_64.rpm 3.7 MB/s | 920 kB 00:00 2024-03-04T09:01:57.714 INFO:teuthology.orchestra.run.smithi102.stdout:(41/176): boost-program-options-1.75.0-8.el9.x8 1.1 MB/s | 106 kB 00:00 2024-03-04T09:01:57.739 INFO:teuthology.orchestra.run.smithi102.stdout:(42/176): elfutils-libelf-devel-0.190-2.el9.x86 410 kB/s | 20 kB 00:00 2024-03-04T09:01:57.765 INFO:teuthology.orchestra.run.smithi102.stdout:(43/176): flex-2.6.4-9.el9.x86_64.rpm 6.0 MB/s | 307 kB 00:00 2024-03-04T09:01:57.790 INFO:teuthology.orchestra.run.smithi102.stdout:(44/176): flexiblas-3.0.4-8.el9.x86_64.rpm 636 kB/s | 32 kB 00:00 2024-03-04T09:01:57.932 INFO:teuthology.orchestra.run.smithi102.stdout:(45/176): flexiblas-netlib-3.0.4-8.el9.x86_64.r 18 MB/s | 3.0 MB 00:00 2024-03-04T09:01:57.958 INFO:teuthology.orchestra.run.smithi102.stdout:(46/176): flexiblas-openblas-openmp-3.0.4-8.el9 103 kB/s | 17 kB 00:00 2024-03-04T09:01:57.991 INFO:teuthology.orchestra.run.smithi102.stdout:(47/176): libaio-devel-0.3.111-13.el9.x86_64.rp 304 kB/s | 10 kB 00:00 2024-03-04T09:01:58.016 INFO:teuthology.orchestra.run.smithi102.stdout:(48/176): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 159 kB 00:00 2024-03-04T09:01:58.041 INFO:teuthology.orchestra.run.smithi102.stdout:(49/176): librabbitmq-0.11.0-7.el9.x86_64.rpm 888 kB/s | 44 kB 00:00 2024-03-04T09:01:58.075 INFO:teuthology.orchestra.run.smithi102.stdout:(50/176): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 661 kB 00:00 2024-03-04T09:01:58.078 INFO:teuthology.orchestra.run.smithi082.stdout:(5/176): ceph-mgr-19.0.0-1739.g1bc250c7.el9.x86 3.7 MB/s | 1.5 MB 00:00 2024-03-04T09:01:58.109 INFO:teuthology.orchestra.run.smithi102.stdout:(51/176): libtool-2.4.6-45.el9.x86_64.rpm 8.6 MB/s | 578 kB 00:00 2024-03-04T09:01:58.142 INFO:teuthology.orchestra.run.smithi102.stdout:(52/176): libuuid-devel-2.37.4-18.el9.x86_64.rp 369 kB/s | 24 kB 00:00 2024-03-04T09:01:58.168 INFO:teuthology.orchestra.run.smithi102.stdout:(53/176): libzstd-devel-1.5.1-2.el9.x86_64.rpm 794 kB/s | 46 kB 00:00 2024-03-04T09:01:58.193 INFO:teuthology.orchestra.run.smithi102.stdout:(54/176): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.5 MB/s | 282 kB 00:00 2024-03-04T09:01:58.220 INFO:teuthology.orchestra.run.smithi102.stdout:(55/176): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2024-03-04T09:01:58.244 INFO:teuthology.orchestra.run.smithi102.stdout:(56/176): openblas-0.3.21-2.el9.x86_64.rpm 686 kB/s | 34 kB 00:00 2024-03-04T09:01:58.320 INFO:teuthology.orchestra.run.smithi082.stdout:(6/176): ceph-mds-19.0.0-1739.g1bc250c7.el9.x86 2.3 MB/s | 2.3 MB 00:00 2024-03-04T09:01:58.411 INFO:teuthology.orchestra.run.smithi102.stdout:(57/176): openblas-openmp-0.3.21-2.el9.x86_64.r 25 MB/s | 4.7 MB 00:00 2024-03-04T09:01:58.478 INFO:teuthology.orchestra.run.smithi102.stdout:(58/176): openssl-devel-3.0.7-27.el9.x86_64.rpm 13 MB/s | 3.0 MB 00:00 2024-03-04T09:01:58.528 INFO:teuthology.orchestra.run.smithi102.stdout:(59/176): postgresql-13.11-1.el9.x86_64.rpm 13 MB/s | 1.5 MB 00:00 2024-03-04T09:01:58.553 INFO:teuthology.orchestra.run.smithi102.stdout:(60/176): postgresql-contrib-13.11-1.el9.x86_64 11 MB/s | 811 kB 00:00 2024-03-04T09:01:58.578 INFO:teuthology.orchestra.run.smithi102.stdout:(61/176): postgresql-private-libs-13.11-1.el9.x 2.7 MB/s | 134 kB 00:00 2024-03-04T09:01:58.804 INFO:teuthology.orchestra.run.smithi082.stdout:(7/176): ceph-common-19.0.0-1739.g1bc250c7.el9. 7.0 MB/s | 20 MB 00:02 2024-03-04T09:01:59.004 INFO:teuthology.orchestra.run.smithi102.stdout:(62/176): ceph-test-19.0.0-1739.g1bc250c7.el9.x 10 MB/s | 47 MB 00:04 2024-03-04T09:01:59.096 INFO:teuthology.orchestra.run.smithi102.stdout:(63/176): postgresql-server-13.11-1.el9.x86_64. 10 MB/s | 5.7 MB 00:00 2024-03-04T09:01:59.129 INFO:teuthology.orchestra.run.smithi102.stdout:(64/176): protobuf-3.14.0-13.el9.x86_64.rpm 1.8 MB/s | 1.0 MB 00:00 2024-03-04T09:01:59.154 INFO:teuthology.orchestra.run.smithi102.stdout:(65/176): python3-attrs-20.3.0-7.el9.noarch.rpm 527 kB/s | 78 kB 00:00 2024-03-04T09:01:59.305 INFO:teuthology.orchestra.run.smithi102.stdout:(66/176): python3-babel-2.9.1-2.el9.noarch.rpm 28 MB/s | 5.8 MB 00:00 2024-03-04T09:01:59.330 INFO:teuthology.orchestra.run.smithi102.stdout:(67/176): python3-jinja2-2.11.3-5.el9.noarch.rp 1.3 MB/s | 227 kB 00:00 2024-03-04T09:01:59.355 INFO:teuthology.orchestra.run.smithi102.stdout:(68/176): python3-jsonpatch-1.21-16.el9.noarch. 124 kB/s | 24 kB 00:00 2024-03-04T09:01:59.389 INFO:teuthology.orchestra.run.smithi102.stdout:(69/176): python3-jsonpointer-2.0-4.el9.noarch. 218 kB/s | 18 kB 00:00 2024-03-04T09:01:59.395 INFO:teuthology.orchestra.run.smithi082.stdout:(8/176): ceph-radosgw-19.0.0-1739.g1bc250c7.el9 17 MB/s | 9.8 MB 00:00 2024-03-04T09:01:59.422 INFO:teuthology.orchestra.run.smithi102.stdout:(70/176): python3-mako-1.1.4-6.el9.noarch.rpm 2.1 MB/s | 144 kB 00:00 2024-03-04T09:01:59.447 INFO:teuthology.orchestra.run.smithi102.stdout:(71/176): python3-markupsafe-1.1.1-12.el9.x86_6 344 kB/s | 32 kB 00:00 2024-03-04T09:01:59.470 INFO:teuthology.orchestra.run.smithi082.stdout:(9/176): ceph-mon-19.0.0-1739.g1bc250c7.el9.x86 3.4 MB/s | 4.7 MB 00:01 2024-03-04T09:01:59.496 INFO:teuthology.orchestra.run.smithi082.stdout:(10/176): ceph-selinux-19.0.0-1739.g1bc250c7.el 252 kB/s | 25 kB 00:00 2024-03-04T09:01:59.546 INFO:teuthology.orchestra.run.smithi082.stdout:(11/176): cephfs-mirror-19.0.0-1739.g1bc250c7.e 4.3 MB/s | 220 kB 00:00 2024-03-04T09:01:59.581 INFO:teuthology.orchestra.run.smithi102.stdout:(72/176): python3-numpy-1.20.1-5.el9.x86_64.rpm 25 MB/s | 4.8 MB 00:00 2024-03-04T09:01:59.604 INFO:teuthology.orchestra.run.smithi082.stdout:(12/176): cephfs-shell-19.0.0-1739.g1bc250c7.el 464 kB/s | 27 kB 00:00 2024-03-04T09:01:59.606 INFO:teuthology.orchestra.run.smithi102.stdout:(73/176): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.4 MB/s | 217 kB 00:00 2024-03-04T09:01:59.631 INFO:teuthology.orchestra.run.smithi102.stdout:(74/176): python3-oauthlib-3.1.1-5.el9.noarch.r 965 kB/s | 174 kB 00:00 2024-03-04T09:01:59.657 INFO:teuthology.orchestra.run.smithi102.stdout:(75/176): python3-packaging-20.9-5.el9.noarch.r 921 kB/s | 69 kB 00:00 2024-03-04T09:01:59.672 INFO:teuthology.orchestra.run.smithi082.stdout:(13/176): libcephfs-devel-19.0.0-1739.g1bc250c7 467 kB/s | 31 kB 00:00 2024-03-04T09:01:59.690 INFO:teuthology.orchestra.run.smithi102.stdout:(76/176): python3-prettytable-0.7.2-27.el9.noar 704 kB/s | 41 kB 00:00 2024-03-04T09:01:59.756 INFO:teuthology.orchestra.run.smithi102.stdout:(77/176): python3-protobuf-3.14.0-13.el9.noarch 1.9 MB/s | 238 kB 00:00 2024-03-04T09:01:59.772 INFO:teuthology.orchestra.run.smithi082.stdout:(14/176): libcephfs2-19.0.0-1739.g1bc250c7.el9. 7.3 MB/s | 747 kB 00:00 2024-03-04T09:01:59.783 INFO:teuthology.orchestra.run.smithi102.stdout:(78/176): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.0 MB/s | 132 kB 00:00 2024-03-04T09:01:59.808 INFO:teuthology.orchestra.run.smithi102.stdout:(79/176): python3-pyasn1-modules-0.4.8-6.el9.no 4.0 MB/s | 211 kB 00:00 2024-03-04T09:01:59.831 INFO:teuthology.orchestra.run.smithi082.stdout:(15/176): libcephsqlite-19.0.0-1739.g1bc250c7.e 2.7 MB/s | 163 kB 00:00 2024-03-04T09:01:59.833 INFO:teuthology.orchestra.run.smithi102.stdout:(80/176): python3-pytz-2021.1-5.el9.noarch.rpm 615 kB/s | 47 kB 00:00 2024-03-04T09:01:59.858 INFO:teuthology.orchestra.run.smithi102.stdout:(81/176): python3-requests-oauthlib-1.3.0-12.el 571 kB/s | 43 kB 00:00 2024-03-04T09:01:59.889 INFO:teuthology.orchestra.run.smithi082.stdout:(16/176): librados-devel-19.0.0-1739.g1bc250c7. 2.1 MB/s | 127 kB 00:00 2024-03-04T09:01:59.934 INFO:teuthology.orchestra.run.smithi102.stdout:(82/176): python3-toml-0.10.2-6.el9.noarch.rpm 387 kB/s | 39 kB 00:00 2024-03-04T09:01:59.965 INFO:teuthology.orchestra.run.smithi082.stdout:(17/176): libradosstriper1-19.0.0-1739.g1bc250c 6.6 MB/s | 501 kB 00:00 2024-03-04T09:02:00.100 INFO:teuthology.orchestra.run.smithi102.stdout:(83/176): python3-wcwidth-0.2.5-8.el9.noarch.rp 170 kB/s | 41 kB 00:00 2024-03-04T09:02:00.292 INFO:teuthology.orchestra.run.smithi102.stdout:(84/176): python3-scipy-1.6.2-8.el9.x86_64.rpm 34 MB/s | 16 MB 00:00 2024-03-04T09:02:00.315 INFO:teuthology.orchestra.run.smithi082.stdout:(18/176): librgw2-19.0.0-1739.g1bc250c7.el9.x86 15 MB/s | 5.1 MB 00:00 2024-03-04T09:02:00.318 INFO:teuthology.orchestra.run.smithi102.stdout:(85/176): qatlib-23.11.0-1.el9.x86_64.rpm 565 kB/s | 215 kB 00:00 2024-03-04T09:02:00.343 INFO:teuthology.orchestra.run.smithi102.stdout:(86/176): qatlib-service-23.11.0-1.el9.x86_64.r 141 kB/s | 34 kB 00:00 2024-03-04T09:02:00.365 INFO:teuthology.orchestra.run.smithi082.stdout:(19/176): python3-ceph-argparse-19.0.0-1739.g1b 909 kB/s | 45 kB 00:00 2024-03-04T09:02:00.368 INFO:teuthology.orchestra.run.smithi102.stdout:(87/176): qatzip-libs-1.1.2-2.el9.x86_64.rpm 582 kB/s | 43 kB 00:00 2024-03-04T09:02:00.393 INFO:teuthology.orchestra.run.smithi102.stdout:(88/176): socat-1.7.4.1-5.el9.x86_64.rpm 5.9 MB/s | 300 kB 00:00 2024-03-04T09:02:00.410 INFO:teuthology.orchestra.run.smithi102.stdout:(89/176): uuid-1.6.2-55.el9.x86_64.rpm 847 kB/s | 56 kB 00:00 2024-03-04T09:02:00.423 INFO:teuthology.orchestra.run.smithi082.stdout:(20/176): python3-ceph-common-19.0.0-1739.g1bc2 2.2 MB/s | 131 kB 00:00 2024-03-04T09:02:00.460 INFO:teuthology.orchestra.run.smithi102.stdout:(90/176): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 950 kB/s | 87 kB 00:00 2024-03-04T09:02:00.477 INFO:teuthology.orchestra.run.smithi102.stdout:(91/176): xmlstarlet-1.6.1-20.el9.x86_64.rpm 938 kB/s | 63 kB 00:00 2024-03-04T09:02:00.490 INFO:teuthology.orchestra.run.smithi082.stdout:(21/176): python3-cephfs-19.0.0-1739.g1bc250c7. 2.4 MB/s | 162 kB 00:00 2024-03-04T09:02:00.494 INFO:teuthology.orchestra.run.smithi102.stdout:(92/176): zlib-devel-1.2.11-40.el9.x86_64.rpm 528 kB/s | 44 kB 00:00 2024-03-04T09:02:00.520 INFO:teuthology.orchestra.run.smithi102.stdout:(93/176): fuse-2.9.9-15.el9.x86_64.rpm 1.3 MB/s | 79 kB 00:00 2024-03-04T09:02:00.545 INFO:teuthology.orchestra.run.smithi102.stdout:(94/176): jq-1.6-16.el9.x86_64.rpm 3.6 MB/s | 186 kB 00:00 2024-03-04T09:02:00.549 INFO:teuthology.orchestra.run.smithi082.stdout:(22/176): python3-rados-19.0.0-1739.g1bc250c7.e 5.4 MB/s | 321 kB 00:00 2024-03-04T09:02:00.570 INFO:teuthology.orchestra.run.smithi102.stdout:(95/176): libgfortran-11.4.1-3.el9.x86_64.rpm 10 MB/s | 802 kB 00:00 2024-03-04T09:02:00.595 INFO:teuthology.orchestra.run.smithi102.stdout:(96/176): libquadmath-11.4.1-3.el9.x86_64.rpm 2.6 MB/s | 194 kB 00:00 2024-03-04T09:02:00.616 INFO:teuthology.orchestra.run.smithi082.stdout:(23/176): python3-rbd-19.0.0-1739.g1bc250c7.el9 4.4 MB/s | 298 kB 00:00 2024-03-04T09:02:00.620 INFO:teuthology.orchestra.run.smithi102.stdout:(97/176): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.3 MB/s | 217 kB 00:00 2024-03-04T09:02:00.646 INFO:teuthology.orchestra.run.smithi102.stdout:(98/176): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.1 MB/s | 241 kB 00:00 2024-03-04T09:02:00.688 INFO:teuthology.orchestra.run.smithi102.stdout:(99/176): python3-cryptography-36.0.1-4.el9.x86 13 MB/s | 1.1 MB 00:00 2024-03-04T09:02:00.705 INFO:teuthology.orchestra.run.smithi102.stdout:(100/176): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 103 kB 00:00 2024-03-04T09:02:00.730 INFO:teuthology.orchestra.run.smithi102.stdout:(101/176): python3-pycparser-2.20-6.el9.noarch. 1.5 MB/s | 124 kB 00:00 2024-03-04T09:02:00.755 INFO:teuthology.orchestra.run.smithi102.stdout:(102/176): python3-requests-2.25.1-8.el9.noarch 1.7 MB/s | 113 kB 00:00 2024-03-04T09:02:00.780 INFO:teuthology.orchestra.run.smithi102.stdout:(103/176): python3-urllib3-1.26.5-5.el9.noarch. 3.7 MB/s | 187 kB 00:00 2024-03-04T09:02:00.783 INFO:teuthology.orchestra.run.smithi082.stdout:(24/176): ceph-osd-19.0.0-1739.g1bc250c7.el9.x8 6.8 MB/s | 17 MB 00:02 2024-03-04T09:02:00.808 INFO:teuthology.orchestra.run.smithi082.stdout:(25/176): python3-rgw-19.0.0-1739.g1bc250c7.el9 518 kB/s | 99 kB 00:00 2024-03-04T09:02:00.842 INFO:teuthology.orchestra.run.smithi082.stdout:(26/176): rbd-fuse-19.0.0-1739.g1bc250c7.el9.x8 1.4 MB/s | 85 kB 00:00 2024-03-04T09:02:00.872 INFO:teuthology.orchestra.run.smithi102.stdout:(104/176): lua-devel-5.4.4-4.el9.x86_64.rpm 191 kB/s | 22 kB 00:00 2024-03-04T09:02:00.934 INFO:teuthology.orchestra.run.smithi082.stdout:(27/176): rbd-nbd-19.0.0-1739.g1bc250c7.el9.x86 1.8 MB/s | 171 kB 00:00 2024-03-04T09:02:00.947 INFO:teuthology.orchestra.run.smithi102.stdout:(105/176): python3-devel-3.9.17-2.el9.x86_64.rp 1.1 MB/s | 245 kB 00:00 2024-03-04T09:02:00.998 INFO:teuthology.orchestra.run.smithi102.stdout:(106/176): protobuf-compiler-3.14.0-13.el9.x86_ 3.9 MB/s | 863 kB 00:00 2024-03-04T09:02:01.009 INFO:teuthology.orchestra.run.smithi082.stdout:(28/176): rbd-mirror-19.0.0-1739.g1bc250c7.el9. 15 MB/s | 3.1 MB 00:00 2024-03-04T09:02:01.026 INFO:teuthology.orchestra.run.smithi082.stdout:(29/176): ceph-grafana-dashboards-19.0.0-1739.g 342 kB/s | 31 kB 00:00 2024-03-04T09:02:01.060 INFO:teuthology.orchestra.run.smithi082.stdout:(30/176): ceph-mgr-cephadm-19.0.0-1739.g1bc250c 2.7 MB/s | 138 kB 00:00 2024-03-04T09:02:01.106 INFO:teuthology.orchestra.run.smithi102.stdout:(107/176): grpc-data-1.46.7-10.el9.noarch.rpm 234 kB/s | 19 kB 00:00 2024-03-04T09:02:01.198 INFO:teuthology.orchestra.run.smithi102.stdout:(108/176): gperftools-libs-2.9.1-2.el9.x86_64.r 1.2 MB/s | 309 kB 00:00 2024-03-04T09:02:01.223 INFO:teuthology.orchestra.run.smithi102.stdout:(109/176): abseil-cpp-20211102.0-3.el9.x86_64.r 1.5 MB/s | 548 kB 00:00 2024-03-04T09:02:01.274 INFO:teuthology.orchestra.run.smithi102.stdout:(110/176): libarrow-doc-9.0.0-10.el9.noarch.rpm 346 kB/s | 26 kB 00:00 2024-03-04T09:02:01.307 INFO:teuthology.orchestra.run.smithi102.stdout:(111/176): liboath-2.6.7-2.el9.x86_64.rpm 579 kB/s | 49 kB 00:00 2024-03-04T09:02:01.318 INFO:teuthology.orchestra.run.smithi082.stdout:(31/176): ceph-mgr-dashboard-19.0.0-1739.g1bc25 6.1 MB/s | 1.8 MB 00:00 2024-03-04T09:02:01.349 INFO:teuthology.orchestra.run.smithi102.stdout:(112/176): libunwind-1.6.2-1.el9.x86_64.rpm 902 kB/s | 67 kB 00:00 2024-03-04T09:02:01.418 INFO:teuthology.orchestra.run.smithi082.stdout:(32/176): ceph-mgr-modules-core-19.0.0-1739.g1b 2.4 MB/s | 248 kB 00:00 2024-03-04T09:02:01.433 INFO:teuthology.orchestra.run.smithi102.stdout:(113/176): luarocks-3.9.2-1.el9.noarch.rpm 1.2 MB/s | 151 kB 00:00 2024-03-04T09:02:01.519 INFO:teuthology.orchestra.run.smithi082.stdout:(33/176): ceph-mgr-diskprediction-local-19.0.0- 16 MB/s | 7.4 MB 00:00 2024-03-04T09:02:01.544 INFO:teuthology.orchestra.run.smithi082.stdout:(34/176): ceph-mgr-rook-19.0.0-1739.g1bc250c7.e 394 kB/s | 49 kB 00:00 2024-03-04T09:02:01.569 INFO:teuthology.orchestra.run.smithi082.stdout:(35/176): ceph-prometheus-alerts-19.0.0-1739.g1 306 kB/s | 15 kB 00:00 2024-03-04T09:02:01.611 INFO:teuthology.orchestra.run.smithi082.stdout:(36/176): ceph-volume-19.0.0-1739.g1bc250c7.el9 3.9 MB/s | 264 kB 00:00 2024-03-04T09:02:01.625 INFO:teuthology.orchestra.run.smithi102.stdout:(114/176): python3-asyncssh-2.13.2-4.el9.noarch 2.8 MB/s | 548 kB 00:00 2024-03-04T09:02:01.670 INFO:teuthology.orchestra.run.smithi082.stdout:(37/176): cephadm-19.0.0-1739.g1bc250c7.el9.noa 7.3 MB/s | 748 kB 00:00 2024-03-04T09:02:01.675 INFO:teuthology.orchestra.run.smithi102.stdout:(115/176): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.5 MB/s | 838 kB 00:00 2024-03-04T09:02:01.695 INFO:teuthology.orchestra.run.smithi082.stdout:(38/176): cephfs-top-19.0.0-1739.g1bc250c7.el9. 218 kB/s | 18 kB 00:00 2024-03-04T09:02:01.700 INFO:teuthology.orchestra.run.smithi102.stdout:(116/176): python3-bcrypt-3.2.2-1.el9.x86_64.rp 579 kB/s | 43 kB 00:00 2024-03-04T09:02:01.743 INFO:teuthology.orchestra.run.smithi102.stdout:(117/176): python3-cachetools-4.2.4-1.el9.noarc 485 kB/s | 32 kB 00:00 2024-03-04T09:02:01.768 INFO:teuthology.orchestra.run.smithi102.stdout:(118/176): python3-certifi-2021.10.8-2.el9.noar 225 kB/s | 15 kB 00:00 2024-03-04T09:02:01.853 INFO:teuthology.orchestra.run.smithi082.stdout:(39/176): automake-1.16.2-8.el9.noarch.rpm 3.5 MB/s | 662 kB 00:00 2024-03-04T09:02:01.887 INFO:teuthology.orchestra.run.smithi082.stdout:(40/176): bison-3.7.4-5.el9.x86_64.rpm 4.7 MB/s | 920 kB 00:00 2024-03-04T09:02:01.893 INFO:teuthology.orchestra.run.smithi102.stdout:(119/176): libarrow-9.0.0-10.el9.x86_64.rpm 5.6 MB/s | 4.4 MB 00:00 2024-03-04T09:02:01.912 INFO:teuthology.orchestra.run.smithi082.stdout:(41/176): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 106 kB 00:00 2024-03-04T09:02:01.919 INFO:teuthology.orchestra.run.smithi102.stdout:(120/176): python3-cheroot-8.6.0-4.el9.noarch.r 982 kB/s | 172 kB 00:00 2024-03-04T09:02:01.938 INFO:teuthology.orchestra.run.smithi082.stdout:(42/176): elfutils-libelf-devel-0.190-2.el9.x86 407 kB/s | 20 kB 00:00 2024-03-04T09:02:01.944 INFO:teuthology.orchestra.run.smithi102.stdout:(121/176): python3-cherrypy-18.6.1-2.el9.noarch 2.0 MB/s | 358 kB 00:00 2024-03-04T09:02:01.971 INFO:teuthology.orchestra.run.smithi082.stdout:(43/176): flex-2.6.4-9.el9.x86_64.rpm 5.1 MB/s | 307 kB 00:00 2024-03-04T09:02:01.994 INFO:teuthology.orchestra.run.smithi102.stdout:(122/176): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.0 MB/s | 303 kB 00:00 2024-03-04T09:02:01.997 INFO:teuthology.orchestra.run.smithi082.stdout:(44/176): flexiblas-3.0.4-8.el9.x86_64.rpm 543 kB/s | 32 kB 00:00 2024-03-04T09:02:02.019 INFO:teuthology.orchestra.run.smithi102.stdout:(123/176): python3-colorama-0.4.4-12.el9.noarch 475 kB/s | 35 kB 00:00 2024-03-04T09:02:02.044 INFO:teuthology.orchestra.run.smithi102.stdout:(124/176): python3-google-auth-2.28.0-1.el9.noa 2.0 MB/s | 203 kB 00:00 2024-03-04T09:02:02.080 INFO:teuthology.orchestra.run.smithi082.stdout:(45/176): flexiblas-netlib-3.0.4-8.el9.x86_64.r 28 MB/s | 3.0 MB 00:00 2024-03-04T09:02:02.097 INFO:teuthology.orchestra.run.smithi082.stdout:(46/176): flexiblas-openblas-openmp-3.0.4-8.el9 174 kB/s | 17 kB 00:00 2024-03-04T09:02:02.111 INFO:teuthology.orchestra.run.smithi102.stdout:(125/176): python3-jaraco-8.2.1-3.el9.noarch.rp 161 kB/s | 11 kB 00:00 2024-03-04T09:02:02.114 INFO:teuthology.orchestra.run.smithi082.stdout:(47/176): libaio-devel-0.3.111-13.el9.x86_64.rp 300 kB/s | 10 kB 00:00 2024-03-04T09:02:02.137 INFO:teuthology.orchestra.run.smithi102.stdout:(126/176): python3-grpcio-tools-1.46.7-10.el9.x 1.2 MB/s | 144 kB 00:00 2024-03-04T09:02:02.140 INFO:teuthology.orchestra.run.smithi082.stdout:(48/176): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.7 MB/s | 159 kB 00:00 2024-03-04T09:02:02.156 INFO:teuthology.orchestra.run.smithi082.stdout:(49/176): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.0 MB/s | 44 kB 00:00 2024-03-04T09:02:02.178 INFO:teuthology.orchestra.run.smithi102.stdout:(127/176): python3-jaraco-classes-3.2.1-5.el9.n 265 kB/s | 18 kB 00:00 2024-03-04T09:02:02.190 INFO:teuthology.orchestra.run.smithi082.stdout:(50/176): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2024-03-04T09:02:02.195 INFO:teuthology.orchestra.run.smithi102.stdout:(128/176): python3-jaraco-collections-3.0.0-8.e 399 kB/s | 23 kB 00:00 2024-03-04T09:02:02.224 INFO:teuthology.orchestra.run.smithi082.stdout:(51/176): libtool-2.4.6-45.el9.x86_64.rpm 8.5 MB/s | 578 kB 00:00 2024-03-04T09:02:02.237 INFO:teuthology.orchestra.run.smithi102.stdout:(129/176): python3-jaraco-functools-3.5.0-2.el9 334 kB/s | 19 kB 00:00 2024-03-04T09:02:02.240 INFO:teuthology.orchestra.run.smithi082.stdout:(52/176): libuuid-devel-2.37.4-18.el9.x86_64.rp 494 kB/s | 24 kB 00:00 2024-03-04T09:02:02.255 INFO:teuthology.orchestra.run.smithi102.stdout:(130/176): python3-jaraco-text-3.2.0-6.el9.noar 337 kB/s | 20 kB 00:00 2024-03-04T09:02:02.258 INFO:teuthology.orchestra.run.smithi082.stdout:(53/176): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 46 kB 00:00 2024-03-04T09:02:02.283 INFO:teuthology.orchestra.run.smithi082.stdout:(54/176): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.6 MB/s | 282 kB 00:00 2024-03-04T09:02:02.305 INFO:teuthology.orchestra.run.smithi102.stdout:(131/176): python3-grpcio-1.46.7-10.el9.x86_64. 6.6 MB/s | 2.0 MB 00:00 2024-03-04T09:02:02.308 INFO:teuthology.orchestra.run.smithi082.stdout:(55/176): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2024-03-04T09:02:02.327 INFO:teuthology.orchestra.run.smithi082.stdout:(56/176): openblas-0.3.21-2.el9.x86_64.rpm 824 kB/s | 34 kB 00:00 2024-03-04T09:02:02.338 INFO:teuthology.orchestra.run.smithi102.stdout:(132/176): python3-logutils-0.3.5-21.el9.noarch 556 kB/s | 46 kB 00:00 2024-03-04T09:02:02.380 INFO:teuthology.orchestra.run.smithi102.stdout:(133/176): python3-more-itertools-8.12.0-2.el9. 1.0 MB/s | 79 kB 00:00 2024-03-04T09:02:02.397 INFO:teuthology.orchestra.run.smithi102.stdout:(134/176): python3-natsort-7.1.1-5.el9.noarch.r 991 kB/s | 58 kB 00:00 2024-03-04T09:02:02.431 INFO:teuthology.orchestra.run.smithi102.stdout:(135/176): python3-kubernetes-26.1.0-2.el9.noar 5.8 MB/s | 1.0 MB 00:00 2024-03-04T09:02:02.442 INFO:teuthology.orchestra.run.smithi082.stdout:(57/176): openblas-openmp-0.3.21-2.el9.x86_64.r 36 MB/s | 4.7 MB 00:00 2024-03-04T09:02:02.481 INFO:teuthology.orchestra.run.smithi102.stdout:(136/176): python3-pecan-1.4.2-3.el9.noarch.rpm 2.7 MB/s | 272 kB 00:00 2024-03-04T09:02:02.506 INFO:teuthology.orchestra.run.smithi102.stdout:(137/176): python3-portend-3.1.0-2.el9.noarch.r 151 kB/s | 16 kB 00:00 2024-03-04T09:02:02.509 INFO:teuthology.orchestra.run.smithi082.stdout:(58/176): openssl-devel-3.0.7-27.el9.x86_64.rpm 16 MB/s | 3.0 MB 00:00 2024-03-04T09:02:02.532 INFO:teuthology.orchestra.run.smithi102.stdout:(138/176): python3-pyOpenSSL-21.0.0-1.el9.noarc 900 kB/s | 90 kB 00:00 2024-03-04T09:02:02.551 INFO:teuthology.orchestra.run.smithi082.stdout:(59/176): postgresql-13.11-1.el9.x86_64.rpm 14 MB/s | 1.5 MB 00:00 2024-03-04T09:02:02.556 INFO:teuthology.orchestra.run.smithi102.stdout:(139/176): python3-pyperclip-1.8.2-2.el9.noarch 567 kB/s | 28 kB 00:00 2024-03-04T09:02:02.582 INFO:teuthology.orchestra.run.smithi102.stdout:(140/176): python3-repoze-lru-0.7-16.el9.noarch 410 kB/s | 31 kB 00:00 2024-03-04T09:02:02.584 INFO:teuthology.orchestra.run.smithi082.stdout:(60/176): postgresql-contrib-13.11-1.el9.x86_64 11 MB/s | 811 kB 00:00 2024-03-04T09:02:02.607 INFO:teuthology.orchestra.run.smithi102.stdout:(141/176): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-03-04T09:02:02.609 INFO:teuthology.orchestra.run.smithi082.stdout:(61/176): postgresql-private-libs-13.11-1.el9.x 2.3 MB/s | 134 kB 00:00 2024-03-04T09:02:02.633 INFO:teuthology.orchestra.run.smithi102.stdout:(142/176): python3-rsa-4.9-2.el9.noarch.rpm 782 kB/s | 59 kB 00:00 2024-03-04T09:02:02.658 INFO:teuthology.orchestra.run.smithi102.stdout:(143/176): python3-tempora-5.0.0-2.el9.noarch.r 474 kB/s | 36 kB 00:00 2024-03-04T09:02:02.683 INFO:teuthology.orchestra.run.smithi102.stdout:(144/176): python3-typing-extensions-4.4.0-2.el 677 kB/s | 51 kB 00:00 2024-03-04T09:02:02.709 INFO:teuthology.orchestra.run.smithi102.stdout:(145/176): python3-webob-1.8.7-6.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-03-04T09:02:02.725 INFO:teuthology.orchestra.run.smithi102.stdout:(146/176): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-03-04T09:02:02.743 INFO:teuthology.orchestra.run.smithi082.stdout:(62/176): postgresql-server-13.11-1.el9.x86_64. 36 MB/s | 5.7 MB 00:00 2024-03-04T09:02:02.767 INFO:teuthology.orchestra.run.smithi102.stdout:(147/176): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-03-04T09:02:02.777 INFO:teuthology.orchestra.run.smithi082.stdout:(63/176): protobuf-3.14.0-13.el9.x86_64.rpm 6.1 MB/s | 1.0 MB 00:00 2024-03-04T09:02:02.792 INFO:teuthology.orchestra.run.smithi102.stdout:(148/176): python3-zc-lockfile-2.0-10.el9.noarc 240 kB/s | 20 kB 00:00 2024-03-04T09:02:02.802 INFO:teuthology.orchestra.run.smithi082.stdout:(64/176): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 78 kB 00:00 2024-03-04T09:02:02.818 INFO:teuthology.orchestra.run.smithi102.stdout:(149/176): re2-20211101-3.el9.x86_64.rpm 2.0 MB/s | 192 kB 00:00 2024-03-04T09:02:02.944 INFO:teuthology.orchestra.run.smithi082.stdout:(65/176): python3-babel-2.9.1-2.el9.noarch.rpm 35 MB/s | 5.8 MB 00:00 2024-03-04T09:02:02.960 INFO:teuthology.orchestra.run.smithi102.stdout:(150/176): thrift-0.15.0-2.el9.x86_64.rpm 8.3 MB/s | 1.6 MB 00:00 2024-03-04T09:02:02.969 INFO:teuthology.orchestra.run.smithi082.stdout:(66/176): python3-jinja2-2.11.3-5.el9.noarch.rp 1.3 MB/s | 227 kB 00:00 2024-03-04T09:02:02.986 INFO:teuthology.orchestra.run.smithi082.stdout:(67/176): python3-jsonpatch-1.21-16.el9.noarch. 590 kB/s | 24 kB 00:00 2024-03-04T09:02:03.001 INFO:teuthology.orchestra.run.smithi102.stdout:(151/176): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.6 MB/s | 68 kB 00:00 2024-03-04T09:02:03.011 INFO:teuthology.orchestra.run.smithi082.stdout:(68/176): python3-jsonpointer-2.0-4.el9.noarch. 432 kB/s | 18 kB 00:00 2024-03-04T09:02:03.037 INFO:teuthology.orchestra.run.smithi082.stdout:(69/176): python3-mako-1.1.4-6.el9.noarch.rpm 2.8 MB/s | 144 kB 00:00 2024-03-04T09:02:03.062 INFO:teuthology.orchestra.run.smithi082.stdout:(70/176): python3-markupsafe-1.1.1-12.el9.x86_6 632 kB/s | 32 kB 00:00 2024-03-04T09:02:03.085 INFO:teuthology.orchestra.run.smithi102.stdout:(152/176): NetworkManager-1.46.0-1.el9.x86_64.r 27 MB/s | 2.3 MB 00:00 2024-03-04T09:02:03.160 INFO:teuthology.orchestra.run.smithi102.stdout:(153/176): NetworkManager-libnm-1.46.0-1.el9.x8 24 MB/s | 1.8 MB 00:00 2024-03-04T09:02:03.171 INFO:teuthology.orchestra.run.smithi082.stdout:(71/176): python3-numpy-1.20.1-5.el9.x86_64.rpm 36 MB/s | 4.8 MB 00:00 2024-03-04T09:02:03.196 INFO:teuthology.orchestra.run.smithi082.stdout:(72/176): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.6 MB/s | 217 kB 00:00 2024-03-04T09:02:03.210 INFO:teuthology.orchestra.run.smithi102.stdout:(154/176): librados2-19.0.0-1739.g1bc250c7.el9. 8.7 MB/s | 3.4 MB 00:00 2024-03-04T09:02:03.230 INFO:teuthology.orchestra.run.smithi082.stdout:(73/176): python3-oauthlib-3.1.1-5.el9.noarch.r 2.9 MB/s | 174 kB 00:00 2024-03-04T09:02:03.236 INFO:teuthology.orchestra.run.smithi102.stdout:(155/176): NetworkManager-team-1.46.0-1.el9.x86 549 kB/s | 41 kB 00:00 2024-03-04T09:02:03.246 INFO:teuthology.orchestra.run.smithi082.stdout:(74/176): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 69 kB 00:00 2024-03-04T09:02:03.261 INFO:teuthology.orchestra.run.smithi102.stdout:(156/176): NetworkManager-tui-1.46.0-1.el9.x86_ 4.8 MB/s | 247 kB 00:00 2024-03-04T09:02:03.272 INFO:teuthology.orchestra.run.smithi082.stdout:(75/176): python3-prettytable-0.7.2-27.el9.noar 985 kB/s | 41 kB 00:00 2024-03-04T09:02:03.286 INFO:teuthology.orchestra.run.smithi102.stdout:(157/176): acl-2.3.1-4.el9.x86_64.rpm 1.3 MB/s | 69 kB 00:00 2024-03-04T09:02:03.297 INFO:teuthology.orchestra.run.smithi082.stdout:(76/176): python3-protobuf-3.14.0-13.el9.noarch 4.6 MB/s | 238 kB 00:00 2024-03-04T09:02:03.312 INFO:teuthology.orchestra.run.smithi102.stdout:(158/176): elfutils-debuginfod-client-0.190-2.e 704 kB/s | 35 kB 00:00 2024-03-04T09:02:03.322 INFO:teuthology.orchestra.run.smithi082.stdout:(77/176): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 132 kB 00:00 2024-03-04T09:02:03.337 INFO:teuthology.orchestra.run.smithi102.stdout:(159/176): elfutils-libelf-0.190-2.el9.x86_64.r 3.7 MB/s | 191 kB 00:00 2024-03-04T09:02:03.348 INFO:teuthology.orchestra.run.smithi082.stdout:(78/176): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 211 kB 00:00 2024-03-04T09:02:03.362 INFO:teuthology.orchestra.run.smithi102.stdout:(160/176): elfutils-libs-0.190-2.el9.x86_64.rpm 5.0 MB/s | 254 kB 00:00 2024-03-04T09:02:03.373 INFO:teuthology.orchestra.run.smithi082.stdout:(79/176): python3-pytz-2021.1-5.el9.noarch.rpm 947 kB/s | 47 kB 00:00 2024-03-04T09:02:03.388 INFO:teuthology.orchestra.run.smithi102.stdout:(161/176): iproute-6.7.0-2.el9.x86_64.rpm 16 MB/s | 802 kB 00:00 2024-03-04T09:02:03.398 INFO:teuthology.orchestra.run.smithi082.stdout:(80/176): python3-requests-oauthlib-1.3.0-12.el 856 kB/s | 43 kB 00:00 2024-03-04T09:02:03.421 INFO:teuthology.orchestra.run.smithi102.stdout:(162/176): iproute-tc-6.7.0-2.el9.x86_64.rpm 7.4 MB/s | 433 kB 00:00 2024-03-04T09:02:03.446 INFO:teuthology.orchestra.run.smithi102.stdout:(163/176): libacl-2.3.1-4.el9.x86_64.rpm 380 kB/s | 22 kB 00:00 2024-03-04T09:02:03.472 INFO:teuthology.orchestra.run.smithi102.stdout:(164/176): libblkid-2.37.4-18.el9.x86_64.rpm 2.1 MB/s | 107 kB 00:00 2024-03-04T09:02:03.497 INFO:teuthology.orchestra.run.smithi102.stdout:(165/176): libfdisk-2.37.4-18.el9.x86_64.rpm 3.0 MB/s | 154 kB 00:00 2024-03-04T09:02:03.514 INFO:teuthology.orchestra.run.smithi102.stdout:(166/176): libmount-2.37.4-18.el9.x86_64.rpm 3.2 MB/s | 135 kB 00:00 2024-03-04T09:02:03.548 INFO:teuthology.orchestra.run.smithi102.stdout:(167/176): libsmartcols-2.37.4-18.el9.x86_64.rp 1.2 MB/s | 63 kB 00:00 2024-03-04T09:02:03.548 INFO:teuthology.orchestra.run.smithi082.stdout:(81/176): python3-toml-0.10.2-6.el9.noarch.rpm 260 kB/s | 39 kB 00:00 2024-03-04T09:02:03.573 INFO:teuthology.orchestra.run.smithi102.stdout:(168/176): libuuid-2.37.4-18.el9.x86_64.rpm 470 kB/s | 28 kB 00:00 2024-03-04T09:02:03.623 INFO:teuthology.orchestra.run.smithi102.stdout:(169/176): openssl-3.0.7-27.el9.x86_64.rpm 15 MB/s | 1.2 MB 00:00 2024-03-04T09:02:03.673 INFO:teuthology.orchestra.run.smithi102.stdout:(170/176): openssl-libs-3.0.7-27.el9.x86_64.rpm 22 MB/s | 2.2 MB 00:00 2024-03-04T09:02:03.732 INFO:teuthology.orchestra.run.smithi102.stdout:(171/176): util-linux-2.37.4-18.el9.x86_64.rpm 21 MB/s | 2.2 MB 00:00 2024-03-04T09:02:03.757 INFO:teuthology.orchestra.run.smithi082.stdout:(82/176): python3-scipy-1.6.2-8.el9.x86_64.rpm 41 MB/s | 16 MB 00:00 2024-03-04T09:02:03.774 INFO:teuthology.orchestra.run.smithi082.stdout:(83/176): python3-wcwidth-0.2.5-8.el9.noarch.rp 184 kB/s | 41 kB 00:00 2024-03-04T09:02:03.775 INFO:teuthology.orchestra.run.smithi102.stdout:(172/176): util-linux-core-2.37.4-18.el9.x86_64 4.4 MB/s | 438 kB 00:00 2024-03-04T09:02:03.799 INFO:teuthology.orchestra.run.smithi082.stdout:(84/176): qatlib-23.11.0-1.el9.x86_64.rpm 5.1 MB/s | 215 kB 00:00 2024-03-04T09:02:03.816 INFO:teuthology.orchestra.run.smithi082.stdout:(85/176): qatlib-service-23.11.0-1.el9.x86_64.r 811 kB/s | 34 kB 00:00 2024-03-04T09:02:03.824 INFO:teuthology.orchestra.run.smithi102.stdout:(173/176): librbd1-19.0.0-1739.g1bc250c7.el9.x8 3.1 MB/s | 3.1 MB 00:01 2024-03-04T09:02:03.842 INFO:teuthology.orchestra.run.smithi082.stdout:(86/176): qatzip-libs-1.1.2-2.el9.x86_64.rpm 1.0 MB/s | 43 kB 00:00 2024-03-04T09:02:03.850 INFO:teuthology.orchestra.run.smithi102.stdout:(174/176): util-linux-user-2.37.4-18.el9.x86_64 257 kB/s | 30 kB 00:00 2024-03-04T09:02:03.867 INFO:teuthology.orchestra.run.smithi082.stdout:(87/176): socat-1.7.4.1-5.el9.x86_64.rpm 5.9 MB/s | 300 kB 00:00 2024-03-04T09:02:03.883 INFO:teuthology.orchestra.run.smithi102.stdout:(175/176): xfsdump-3.1.12-4.el9.x86_64.rpm 2.9 MB/s | 321 kB 00:00 2024-03-04T09:02:03.892 INFO:teuthology.orchestra.run.smithi082.stdout:(88/176): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 56 kB 00:00 2024-03-04T09:02:03.917 INFO:teuthology.orchestra.run.smithi102.stdout:(176/176): xfsprogs-6.3.0-1.el9.x86_64.rpm 16 MB/s | 1.1 MB 00:00 2024-03-04T09:02:03.917 INFO:teuthology.orchestra.run.smithi082.stdout:(89/176): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2024-03-04T09:02:03.922 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-03-04T09:02:03.922 INFO:teuthology.orchestra.run.smithi102.stdout:Total 19 MB/s | 224 MB 00:12 2024-03-04T09:02:03.942 INFO:teuthology.orchestra.run.smithi082.stdout:(90/176): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 63 kB 00:00 2024-03-04T09:02:03.968 INFO:teuthology.orchestra.run.smithi082.stdout:(91/176): zlib-devel-1.2.11-40.el9.x86_64.rpm 882 kB/s | 44 kB 00:00 2024-03-04T09:02:03.971 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-03-04T09:02:03.993 INFO:teuthology.orchestra.run.smithi082.stdout:(92/176): fuse-2.9.9-15.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2024-03-04T09:02:04.018 INFO:teuthology.orchestra.run.smithi082.stdout:(93/176): jq-1.6-16.el9.x86_64.rpm 3.6 MB/s | 186 kB 00:00 2024-03-04T09:02:04.060 INFO:teuthology.orchestra.run.smithi082.stdout:(94/176): libgfortran-11.4.1-3.el9.x86_64.rpm 12 MB/s | 802 kB 00:00 2024-03-04T09:02:04.086 INFO:teuthology.orchestra.run.smithi082.stdout:(95/176): libquadmath-11.4.1-3.el9.x86_64.rpm 2.9 MB/s | 194 kB 00:00 2024-03-04T09:02:04.111 INFO:teuthology.orchestra.run.smithi082.stdout:(96/176): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.2 MB/s | 217 kB 00:00 2024-03-04T09:02:04.136 INFO:teuthology.orchestra.run.smithi082.stdout:(97/176): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-03-04T09:02:04.171 INFO:teuthology.orchestra.run.smithi082.stdout:(98/176): python3-cryptography-36.0.1-4.el9.x86 20 MB/s | 1.1 MB 00:00 2024-03-04T09:02:04.195 INFO:teuthology.orchestra.run.smithi082.stdout:(99/176): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 103 kB 00:00 2024-03-04T09:02:04.221 INFO:teuthology.orchestra.run.smithi082.stdout:(100/176): python3-pycparser-2.20-6.el9.noarch. 2.4 MB/s | 124 kB 00:00 2024-03-04T09:02:04.246 INFO:teuthology.orchestra.run.smithi082.stdout:(101/176): python3-requests-2.25.1-8.el9.noarch 2.2 MB/s | 113 kB 00:00 2024-03-04T09:02:04.271 INFO:teuthology.orchestra.run.smithi082.stdout:(102/176): python3-urllib3-1.26.5-5.el9.noarch. 3.7 MB/s | 187 kB 00:00 2024-03-04T09:02:04.282 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-03-04T09:02:04.283 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-03-04T09:02:04.388 INFO:teuthology.orchestra.run.smithi082.stdout:(103/176): lua-devel-5.4.4-4.el9.x86_64.rpm 191 kB/s | 22 kB 00:00 2024-03-04T09:02:04.497 INFO:teuthology.orchestra.run.smithi082.stdout:(104/176): python3-devel-3.9.17-2.el9.x86_64.rp 980 kB/s | 245 kB 00:00 2024-03-04T09:02:04.530 INFO:teuthology.orchestra.run.smithi082.stdout:(105/176): protobuf-compiler-3.14.0-13.el9.x86_ 6.0 MB/s | 863 kB 00:00 2024-03-04T09:02:04.572 INFO:teuthology.orchestra.run.smithi082.stdout:(106/176): gperftools-libs-2.9.1-2.el9.x86_64.r 7.3 MB/s | 309 kB 00:00 2024-03-04T09:02:04.614 INFO:teuthology.orchestra.run.smithi082.stdout:(107/176): grpc-data-1.46.7-10.el9.noarch.rpm 467 kB/s | 19 kB 00:00 2024-03-04T09:02:04.673 INFO:teuthology.orchestra.run.smithi082.stdout:(108/176): abseil-cpp-20211102.0-3.el9.x86_64.r 3.0 MB/s | 548 kB 00:00 2024-03-04T09:02:04.715 INFO:teuthology.orchestra.run.smithi082.stdout:(109/176): libarrow-doc-9.0.0-10.el9.noarch.rpm 627 kB/s | 26 kB 00:00 2024-03-04T09:02:04.790 INFO:teuthology.orchestra.run.smithi082.stdout:(110/176): libarrow-9.0.0-10.el9.x86_64.rpm 25 MB/s | 4.4 MB 00:00 2024-03-04T09:02:04.807 INFO:teuthology.orchestra.run.smithi082.stdout:(111/176): liboath-2.6.7-2.el9.x86_64.rpm 528 kB/s | 49 kB 00:00 2024-03-04T09:02:04.832 INFO:teuthology.orchestra.run.smithi082.stdout:(112/176): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-03-04T09:02:04.858 INFO:teuthology.orchestra.run.smithi082.stdout:(113/176): luarocks-3.9.2-1.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-03-04T09:02:04.891 INFO:teuthology.orchestra.run.smithi082.stdout:(114/176): parquet-libs-9.0.0-10.el9.x86_64.rpm 14 MB/s | 838 kB 00:00 2024-03-04T09:02:04.933 INFO:teuthology.orchestra.run.smithi082.stdout:(115/176): python3-asyncssh-2.13.2-4.el9.noarch 7.1 MB/s | 548 kB 00:00 2024-03-04T09:02:04.958 INFO:teuthology.orchestra.run.smithi082.stdout:(116/176): python3-bcrypt-3.2.2-1.el9.x86_64.rp 649 kB/s | 43 kB 00:00 2024-03-04T09:02:04.984 INFO:teuthology.orchestra.run.smithi082.stdout:(117/176): python3-cachetools-4.2.4-1.el9.noarc 643 kB/s | 32 kB 00:00 2024-03-04T09:02:05.009 INFO:teuthology.orchestra.run.smithi082.stdout:(118/176): python3-certifi-2021.10.8-2.el9.noar 299 kB/s | 15 kB 00:00 2024-03-04T09:02:05.043 INFO:teuthology.orchestra.run.smithi082.stdout:(119/176): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-03-04T09:02:05.068 INFO:teuthology.orchestra.run.smithi082.stdout:(120/176): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-03-04T09:02:05.093 INFO:teuthology.orchestra.run.smithi082.stdout:(121/176): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-03-04T09:02:05.118 INFO:teuthology.orchestra.run.smithi082.stdout:(122/176): python3-colorama-0.4.4-12.el9.noarch 703 kB/s | 35 kB 00:00 2024-03-04T09:02:05.143 INFO:teuthology.orchestra.run.smithi082.stdout:(123/176): python3-google-auth-2.28.0-1.el9.noa 4.0 MB/s | 203 kB 00:00 2024-03-04T09:02:05.185 INFO:teuthology.orchestra.run.smithi082.stdout:(124/176): python3-grpcio-tools-1.46.7-10.el9.x 3.4 MB/s | 144 kB 00:00 2024-03-04T09:02:05.236 INFO:teuthology.orchestra.run.smithi082.stdout:(125/176): python3-grpcio-1.46.7-10.el9.x86_64. 17 MB/s | 2.0 MB 00:00 2024-03-04T09:02:05.261 INFO:teuthology.orchestra.run.smithi082.stdout:(126/176): python3-jaraco-8.2.1-3.el9.noarch.rp 142 kB/s | 11 kB 00:00 2024-03-04T09:02:05.286 INFO:teuthology.orchestra.run.smithi082.stdout:(127/176): python3-jaraco-classes-3.2.1-5.el9.n 353 kB/s | 18 kB 00:00 2024-03-04T09:02:05.311 INFO:teuthology.orchestra.run.smithi082.stdout:(128/176): python3-jaraco-collections-3.0.0-8.e 460 kB/s | 23 kB 00:00 2024-03-04T09:02:05.337 INFO:teuthology.orchestra.run.smithi082.stdout:(129/176): python3-jaraco-functools-3.5.0-2.el9 389 kB/s | 19 kB 00:00 2024-03-04T09:02:05.362 INFO:teuthology.orchestra.run.smithi082.stdout:(130/176): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-03-04T09:02:05.404 INFO:teuthology.orchestra.run.smithi082.stdout:(131/176): python3-kubernetes-26.1.0-2.el9.noar 15 MB/s | 1.0 MB 00:00 2024-03-04T09:02:05.429 INFO:teuthology.orchestra.run.smithi082.stdout:(132/176): python3-logutils-0.3.5-21.el9.noarch 691 kB/s | 46 kB 00:00 2024-03-04T09:02:05.463 INFO:teuthology.orchestra.run.smithi082.stdout:(133/176): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-03-04T09:02:05.488 INFO:teuthology.orchestra.run.smithi082.stdout:(134/176): python3-natsort-7.1.1-5.el9.noarch.r 984 kB/s | 58 kB 00:00 2024-03-04T09:02:05.514 INFO:teuthology.orchestra.run.smithi082.stdout:(135/176): python3-pecan-1.4.2-3.el9.noarch.rpm 5.3 MB/s | 272 kB 00:00 2024-03-04T09:02:05.539 INFO:teuthology.orchestra.run.smithi082.stdout:(136/176): python3-portend-3.1.0-2.el9.noarch.r 327 kB/s | 16 kB 00:00 2024-03-04T09:02:05.564 INFO:teuthology.orchestra.run.smithi082.stdout:(137/176): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-03-04T09:02:05.590 INFO:teuthology.orchestra.run.smithi082.stdout:(138/176): python3-pyperclip-1.8.2-2.el9.noarch 564 kB/s | 28 kB 00:00 2024-03-04T09:02:05.615 INFO:teuthology.orchestra.run.smithi082.stdout:(139/176): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-03-04T09:02:05.640 INFO:teuthology.orchestra.run.smithi082.stdout:(140/176): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2024-03-04T09:02:05.665 INFO:teuthology.orchestra.run.smithi082.stdout:(141/176): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-03-04T09:02:05.691 INFO:teuthology.orchestra.run.smithi082.stdout:(142/176): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-03-04T09:02:05.716 INFO:teuthology.orchestra.run.smithi082.stdout:(143/176): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-03-04T09:02:05.741 INFO:teuthology.orchestra.run.smithi082.stdout:(144/176): python3-webob-1.8.7-6.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-03-04T09:02:05.767 INFO:teuthology.orchestra.run.smithi082.stdout:(145/176): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-03-04T09:02:05.800 INFO:teuthology.orchestra.run.smithi082.stdout:(146/176): python3-werkzeug-2.0.3-3.el9.1.noarc 7.1 MB/s | 427 kB 00:00 2024-03-04T09:02:05.825 INFO:teuthology.orchestra.run.smithi082.stdout:(147/176): python3-zc-lockfile-2.0-10.el9.noarc 342 kB/s | 20 kB 00:00 2024-03-04T09:02:05.851 INFO:teuthology.orchestra.run.smithi082.stdout:(148/176): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-03-04T09:02:06.246 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-03-04T09:02:06.247 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-03-04T09:02:06.284 INFO:teuthology.orchestra.run.smithi082.stdout:(149/176): ceph-test-19.0.0-1739.g1bc250c7.el9. 7.0 MB/s | 47 MB 00:06 2024-03-04T09:02:06.326 INFO:teuthology.orchestra.run.smithi082.stdout:(150/176): thrift-0.15.0-2.el9.x86_64.rpm 3.2 MB/s | 1.6 MB 00:00 2024-03-04T09:02:06.368 INFO:teuthology.orchestra.run.smithi082.stdout:(151/176): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.6 MB/s | 68 kB 00:00 2024-03-04T09:02:06.493 INFO:teuthology.orchestra.run.smithi082.stdout:(152/176): NetworkManager-1.46.0-1.el9.x86_64.r 18 MB/s | 2.3 MB 00:00 2024-03-04T09:02:06.577 INFO:teuthology.orchestra.run.smithi082.stdout:(153/176): NetworkManager-libnm-1.46.0-1.el9.x8 22 MB/s | 1.8 MB 00:00 2024-03-04T09:02:06.636 INFO:teuthology.orchestra.run.smithi082.stdout:(154/176): librados2-19.0.0-1739.g1bc250c7.el9. 4.3 MB/s | 3.4 MB 00:00 2024-03-04T09:02:06.652 INFO:teuthology.orchestra.run.smithi082.stdout:(155/176): NetworkManager-team-1.46.0-1.el9.x86 550 kB/s | 41 kB 00:00 2024-03-04T09:02:06.678 INFO:teuthology.orchestra.run.smithi082.stdout:(156/176): NetworkManager-tui-1.46.0-1.el9.x86_ 5.8 MB/s | 247 kB 00:00 2024-03-04T09:02:06.703 INFO:teuthology.orchestra.run.smithi082.stdout:(157/176): acl-2.3.1-4.el9.x86_64.rpm 1.4 MB/s | 69 kB 00:00 2024-03-04T09:02:06.728 INFO:teuthology.orchestra.run.smithi082.stdout:(158/176): elfutils-debuginfod-client-0.190-2.e 709 kB/s | 35 kB 00:00 2024-03-04T09:02:06.753 INFO:teuthology.orchestra.run.smithi082.stdout:(159/176): elfutils-libelf-0.190-2.el9.x86_64.r 3.7 MB/s | 191 kB 00:00 2024-03-04T09:02:06.778 INFO:teuthology.orchestra.run.smithi082.stdout:(160/176): elfutils-libs-0.190-2.el9.x86_64.rpm 5.0 MB/s | 254 kB 00:00 2024-03-04T09:02:06.812 INFO:teuthology.orchestra.run.smithi082.stdout:(161/176): iproute-6.7.0-2.el9.x86_64.rpm 14 MB/s | 802 kB 00:00 2024-03-04T09:02:06.839 INFO:teuthology.orchestra.run.smithi082.stdout:(162/176): iproute-tc-6.7.0-2.el9.x86_64.rpm 7.4 MB/s | 433 kB 00:00 2024-03-04T09:02:06.863 INFO:teuthology.orchestra.run.smithi082.stdout:(163/176): libacl-2.3.1-4.el9.x86_64.rpm 440 kB/s | 22 kB 00:00 2024-03-04T09:02:06.897 INFO:teuthology.orchestra.run.smithi082.stdout:(164/176): libblkid-2.37.4-18.el9.x86_64.rpm 1.8 MB/s | 107 kB 00:00 2024-03-04T09:02:06.922 INFO:teuthology.orchestra.run.smithi082.stdout:(165/176): libfdisk-2.37.4-18.el9.x86_64.rpm 2.6 MB/s | 154 kB 00:00 2024-03-04T09:02:06.947 INFO:teuthology.orchestra.run.smithi082.stdout:(166/176): libmount-2.37.4-18.el9.x86_64.rpm 2.6 MB/s | 135 kB 00:00 2024-03-04T09:02:06.972 INFO:teuthology.orchestra.run.smithi082.stdout:(167/176): libsmartcols-2.37.4-18.el9.x86_64.rp 1.2 MB/s | 63 kB 00:00 2024-03-04T09:02:07.006 INFO:teuthology.orchestra.run.smithi082.stdout:(168/176): libuuid-2.37.4-18.el9.x86_64.rpm 472 kB/s | 28 kB 00:00 2024-03-04T09:02:07.048 INFO:teuthology.orchestra.run.smithi082.stdout:(169/176): openssl-3.0.7-27.el9.x86_64.rpm 15 MB/s | 1.2 MB 00:00 2024-03-04T09:02:07.107 INFO:teuthology.orchestra.run.smithi082.stdout:(170/176): librbd1-19.0.0-1739.g1bc250c7.el9.x8 3.8 MB/s | 3.1 MB 00:00 2024-03-04T09:02:07.148 INFO:teuthology.orchestra.run.smithi082.stdout:(171/176): openssl-libs-3.0.7-27.el9.x86_64.rpm 15 MB/s | 2.2 MB 00:00 2024-03-04T09:02:07.191 INFO:teuthology.orchestra.run.smithi082.stdout:(172/176): util-linux-2.37.4-18.el9.x86_64.rpm 16 MB/s | 2.2 MB 00:00 2024-03-04T09:02:07.215 INFO:teuthology.orchestra.run.smithi082.stdout:(173/176): util-linux-core-2.37.4-18.el9.x86_64 4.1 MB/s | 438 kB 00:00 2024-03-04T09:02:07.241 INFO:teuthology.orchestra.run.smithi082.stdout:(174/176): util-linux-user-2.37.4-18.el9.x86_64 333 kB/s | 30 kB 00:00 2024-03-04T09:02:07.274 INFO:teuthology.orchestra.run.smithi082.stdout:(175/176): xfsdump-3.1.12-4.el9.x86_64.rpm 5.4 MB/s | 321 kB 00:00 2024-03-04T09:02:07.308 INFO:teuthology.orchestra.run.smithi082.stdout:(176/176): xfsprogs-6.3.0-1.el9.x86_64.rpm 12 MB/s | 1.1 MB 00:00 2024-03-04T09:02:07.314 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-03-04T09:02:07.314 INFO:teuthology.orchestra.run.smithi082.stdout:Total 18 MB/s | 224 MB 00:12 2024-03-04T09:02:07.359 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-03-04T09:02:07.670 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-03-04T09:02:07.670 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-03-04T09:02:09.630 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-03-04T09:02:09.630 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-03-04T09:02:13.239 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-03-04T09:02:13.330 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/202 2024-03-04T09:02:13.364 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/202 2024-03-04T09:02:13.402 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/202 2024-03-04T09:02:13.424 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/202 2024-03-04T09:02:13.490 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 4/202 2024-03-04T09:02:13.535 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 5/202 2024-03-04T09:02:13.592 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/202 2024-03-04T09:02:13.623 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : thrift-0.15.0-2.el9.x86_64 7/202 2024-03-04T09:02:13.699 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 8/202 2024-03-04T09:02:13.769 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 9/202 2024-03-04T09:02:14.100 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 10/202 2024-03-04T09:02:14.164 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : librados2-2:19.0.0-1739.g1bc250c7.el9.x86_64 11/202 2024-03-04T09:02:14.311 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librados2-2:19.0.0-1739.g1bc250c7.el9.x86_64 11/202 2024-03-04T09:02:14.340 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libcephfs2-2:19.0.0-1739.g1bc250c7.el9.x86_64 12/202 2024-03-04T09:02:14.432 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libcephfs2-2:19.0.0-1739.g1bc250c7.el9.x86_64 12/202 2024-03-04T09:02:14.464 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rados-2:19.0.0-1739.g1bc250c7.el9.x86_64 13/202 2024-03-04T09:02:14.631 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 14/202 2024-03-04T09:02:14.684 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/202 2024-03-04T09:02:14.711 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libcephsqlite-2:19.0.0-1739.g1bc250c7.el9.x86_64 16/202 2024-03-04T09:02:14.816 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1739.g1bc250c7.el9.x86_64 16/202 2024-03-04T09:02:14.837 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libradosstriper1-2:19.0.0-1739.g1bc250c7.el9.x86 17/202 2024-03-04T09:02:14.886 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1739.g1bc250c7.el9.x86 17/202 2024-03-04T09:02:14.933 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/202 2024-03-04T09:02:14.956 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 19/202 2024-03-04T09:02:14.971 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 19/202 2024-03-04T09:02:15.106 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 20/202 2024-03-04T09:02:15.137 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 20/202 2024-03-04T09:02:15.160 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/202 2024-03-04T09:02:15.350 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/202 2024-03-04T09:02:15.455 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 23/202 2024-03-04T09:02:15.499 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 23/202 2024-03-04T09:02:15.600 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 24/202 2024-03-04T09:02:15.658 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : NetworkManager-1:1.46.0-1.el9.x86_64 24/202 2024-03-04T09:02:15.867 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 24/202 2024-03-04T09:02:15.973 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/202 2024-03-04T09:02:16.066 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/202 2024-03-04T09:02:16.097 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/202 2024-03-04T09:02:16.173 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/202 2024-03-04T09:02:16.227 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 29/202 2024-03-04T09:02:16.259 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 30/202 2024-03-04T09:02:16.306 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 31/202 2024-03-04T09:02:16.350 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 32/202 2024-03-04T09:02:16.415 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/202 2024-03-04T09:02:16.458 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/202 2024-03-04T09:02:16.501 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/202 2024-03-04T09:02:16.534 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/202 2024-03-04T09:02:16.558 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-03-04T09:02:16.561 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/202 2024-03-04T09:02:16.630 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/202 2024-03-04T09:02:16.666 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-ceph-common-2:19.0.0-1739.g1bc250c7.el9. 39/202 2024-03-04T09:02:16.696 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/202 2024-03-04T09:02:16.710 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-ceph-argparse-2:19.0.0-1739.g1bc250c7.el 40/202 2024-03-04T09:02:16.739 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cephfs-2:19.0.0-1739.g1bc250c7.el9.x86_6 41/202 2024-03-04T09:02:16.807 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/202 2024-03-04T09:02:16.844 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/202 2024-03-04T09:02:16.853 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/202 2024-03-04T09:02:16.935 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/202 2024-03-04T09:02:16.959 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/202 2024-03-04T09:02:16.986 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/202 2024-03-04T09:02:17.030 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 4/202 2024-03-04T09:02:17.069 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/202 2024-03-04T09:02:17.070 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 5/202 2024-03-04T09:02:17.122 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/202 2024-03-04T09:02:17.124 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/202 2024-03-04T09:02:17.164 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : thrift-0.15.0-2.el9.x86_64 7/202 2024-03-04T09:02:17.199 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 8/202 2024-03-04T09:02:17.247 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 9/202 2024-03-04T09:02:17.584 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 10/202 2024-03-04T09:02:17.633 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : librados2-2:19.0.0-1739.g1bc250c7.el9.x86_64 11/202 2024-03-04T09:02:17.653 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/202 2024-03-04T09:02:17.735 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/202 2024-03-04T09:02:17.755 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librados2-2:19.0.0-1739.g1bc250c7.el9.x86_64 11/202 2024-03-04T09:02:17.792 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephfs2-2:19.0.0-1739.g1bc250c7.el9.x86_64 12/202 2024-03-04T09:02:17.813 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/202 2024-03-04T09:02:17.864 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/202 2024-03-04T09:02:17.873 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/202 2024-03-04T09:02:17.884 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libcephfs2-2:19.0.0-1739.g1bc250c7.el9.x86_64 12/202 2024-03-04T09:02:17.911 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 51/202 2024-03-04T09:02:17.918 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rados-2:19.0.0-1739.g1bc250c7.el9.x86_64 13/202 2024-03-04T09:02:17.949 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librados-devel-2:19.0.0-1739.g1bc250c7.el9.x86_6 52/202 2024-03-04T09:02:17.981 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 53/202 2024-03-04T09:02:18.074 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 14/202 2024-03-04T09:02:18.081 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 54/202 2024-03-04T09:02:18.128 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/202 2024-03-04T09:02:18.150 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : iproute-6.7.0-2.el9.x86_64 55/202 2024-03-04T09:02:18.154 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephsqlite-2:19.0.0-1739.g1bc250c7.el9.x86_64 16/202 2024-03-04T09:02:18.259 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1739.g1bc250c7.el9.x86_64 16/202 2024-03-04T09:02:18.289 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libradosstriper1-2:19.0.0-1739.g1bc250c7.el9.x86 17/202 2024-03-04T09:02:18.354 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1739.g1bc250c7.el9.x86 17/202 2024-03-04T09:02:18.393 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/202 2024-03-04T09:02:18.410 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 56/202 2024-03-04T09:02:18.415 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 19/202 2024-03-04T09:02:18.431 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 19/202 2024-03-04T09:02:18.575 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 20/202 2024-03-04T09:02:18.582 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 57/202 2024-03-04T09:02:18.605 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 20/202 2024-03-04T09:02:18.646 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/202 2024-03-04T09:02:18.659 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 58/202 2024-03-04T09:02:18.703 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 59/202 2024-03-04T09:02:18.836 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 60/202 2024-03-04T09:02:18.840 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/202 2024-03-04T09:02:18.881 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 61/202 2024-03-04T09:02:18.935 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 62/202 2024-03-04T09:02:18.971 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 23/202 2024-03-04T09:02:19.000 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 63/202 2024-03-04T09:02:19.031 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 23/202 2024-03-04T09:02:19.032 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 64/202 2024-03-04T09:02:19.068 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 65/202 2024-03-04T09:02:19.115 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 66/202 2024-03-04T09:02:19.133 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 24/202 2024-03-04T09:02:19.151 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 67/202 2024-03-04T09:02:19.191 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : NetworkManager-1:1.46.0-1.el9.x86_64 24/202 2024-03-04T09:02:19.286 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 68/202 2024-03-04T09:02:19.399 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 24/202 2024-03-04T09:02:19.454 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 69/202 2024-03-04T09:02:19.504 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/202 2024-03-04T09:02:19.587 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 70/202 2024-03-04T09:02:19.599 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/202 2024-03-04T09:02:19.630 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/202 2024-03-04T09:02:19.641 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 71/202 2024-03-04T09:02:19.672 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 72/202 2024-03-04T09:02:19.696 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/202 2024-03-04T09:02:19.714 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 73/202 2024-03-04T09:02:19.759 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 29/202 2024-03-04T09:02:19.791 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 30/202 2024-03-04T09:02:19.807 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 74/202 2024-03-04T09:02:19.826 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 31/202 2024-03-04T09:02:19.839 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-google-auth-1:2.28.0-1.el9.noarch 75/202 2024-03-04T09:02:19.866 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 32/202 2024-03-04T09:02:19.879 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 76/202 2024-03-04T09:02:19.913 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 77/202 2024-03-04T09:02:19.930 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/202 2024-03-04T09:02:19.937 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 78/202 2024-03-04T09:02:19.965 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/202 2024-03-04T09:02:20.008 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/202 2024-03-04T09:02:20.013 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 79/202 2024-03-04T09:02:20.041 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/202 2024-03-04T09:02:20.096 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/202 2024-03-04T09:02:20.140 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 80/202 2024-03-04T09:02:20.173 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/202 2024-03-04T09:02:20.209 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ceph-common-2:19.0.0-1739.g1bc250c7.el9. 39/202 2024-03-04T09:02:20.245 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ceph-argparse-2:19.0.0-1739.g1bc250c7.el 40/202 2024-03-04T09:02:20.245 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 81/202 2024-03-04T09:02:20.273 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cephfs-2:19.0.0-1739.g1bc250c7.el9.x86_6 41/202 2024-03-04T09:02:20.312 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 82/202 2024-03-04T09:02:20.342 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/202 2024-03-04T09:02:20.361 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-ply-3.11-14.el9.noarch 83/202 2024-03-04T09:02:20.387 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/202 2024-03-04T09:02:20.425 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 84/202 2024-03-04T09:02:20.460 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/202 2024-03-04T09:02:20.595 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/202 2024-03-04T09:02:20.606 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 85/202 2024-03-04T09:02:20.648 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/202 2024-03-04T09:02:20.649 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 86/202 2024-03-04T09:02:20.781 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/202 2024-03-04T09:02:21.024 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 88/202 2024-03-04T09:02:21.157 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/202 2024-03-04T09:02:21.189 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 89/202 2024-03-04T09:02:21.221 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 90/202 2024-03-04T09:02:21.234 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/202 2024-03-04T09:02:21.256 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : jq-1.6-16.el9.x86_64 91/202 2024-03-04T09:02:21.287 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : fuse-2.9.9-15.el9.x86_64 92/202 2024-03-04T09:02:21.313 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/202 2024-03-04T09:02:21.315 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 93/202 2024-03-04T09:02:21.350 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 94/202 2024-03-04T09:02:21.372 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/202 2024-03-04T09:02:21.381 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/202 2024-03-04T09:02:21.389 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : uuid-1.6.2-55.el9.x86_64 95/202 2024-03-04T09:02:21.418 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 51/202 2024-03-04T09:02:21.420 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 96/202 2024-03-04T09:02:21.450 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 97/202 2024-03-04T09:02:21.456 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librados-devel-2:19.0.0-1739.g1bc250c7.el9.x86_6 52/202 2024-03-04T09:02:21.489 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 53/202 2024-03-04T09:02:21.526 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 98/202 2024-03-04T09:02:21.560 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 99/202 2024-03-04T09:02:21.583 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 54/202 2024-03-04T09:02:21.594 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 100/202 2024-03-04T09:02:21.635 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 101/202 2024-03-04T09:02:21.647 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : iproute-6.7.0-2.el9.x86_64 55/202 2024-03-04T09:02:21.670 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 102/202 2024-03-04T09:02:21.759 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 103/202 2024-03-04T09:02:21.841 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 104/202 2024-03-04T09:02:21.884 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 105/202 2024-03-04T09:02:21.916 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 106/202 2024-03-04T09:02:21.931 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 56/202 2024-03-04T09:02:21.962 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 107/202 2024-03-04T09:02:22.069 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-packaging-20.9-5.el9.noarch 108/202 2024-03-04T09:02:22.108 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 57/202 2024-03-04T09:02:22.125 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 109/202 2024-03-04T09:02:22.216 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 58/202 2024-03-04T09:02:22.260 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 59/202 2024-03-04T09:02:22.551 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 60/202 2024-03-04T09:02:22.605 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 61/202 2024-03-04T09:02:22.659 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 62/202 2024-03-04T09:02:22.724 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 63/202 2024-03-04T09:02:22.764 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 64/202 2024-03-04T09:02:22.800 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 65/202 2024-03-04T09:02:22.847 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 66/202 2024-03-04T09:02:22.860 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 110/202 2024-03-04T09:02:22.883 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 67/202 2024-03-04T09:02:22.906 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 111/202 2024-03-04T09:02:22.926 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 68/202 2024-03-04T09:02:22.941 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 112/202 2024-03-04T09:02:22.969 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 69/202 2024-03-04T09:02:22.990 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 113/202 2024-03-04T09:02:23.085 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 114/202 2024-03-04T09:02:23.104 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 70/202 2024-03-04T09:02:23.126 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 115/202 2024-03-04T09:02:23.166 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 71/202 2024-03-04T09:02:23.196 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 72/202 2024-03-04T09:02:23.237 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 73/202 2024-03-04T09:02:23.306 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : openblas-0.3.21-2.el9.x86_64 116/202 2024-03-04T09:02:23.331 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 74/202 2024-03-04T09:02:23.332 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 117/202 2024-03-04T09:02:23.371 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-google-auth-1:2.28.0-1.el9.noarch 75/202 2024-03-04T09:02:23.411 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 118/202 2024-03-04T09:02:23.411 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 76/202 2024-03-04T09:02:23.437 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 77/202 2024-03-04T09:02:23.462 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 78/202 2024-03-04T09:02:23.539 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 79/202 2024-03-04T09:02:23.662 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 80/202 2024-03-04T09:02:23.768 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 81/202 2024-03-04T09:02:23.811 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 82/202 2024-03-04T09:02:23.860 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ply-3.11-14.el9.noarch 83/202 2024-03-04T09:02:23.916 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 84/202 2024-03-04T09:02:24.044 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 119/202 2024-03-04T09:02:24.100 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 85/202 2024-03-04T09:02:24.146 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 120/202 2024-03-04T09:02:24.158 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 86/202 2024-03-04T09:02:24.293 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/202 2024-03-04T09:02:24.331 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 88/202 2024-03-04T09:02:24.363 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 89/202 2024-03-04T09:02:24.396 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 90/202 2024-03-04T09:02:24.431 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : jq-1.6-16.el9.x86_64 91/202 2024-03-04T09:02:24.470 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : fuse-2.9.9-15.el9.x86_64 92/202 2024-03-04T09:02:24.498 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 93/202 2024-03-04T09:02:24.532 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 94/202 2024-03-04T09:02:24.572 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : uuid-1.6.2-55.el9.x86_64 95/202 2024-03-04T09:02:24.603 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 96/202 2024-03-04T09:02:24.633 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 97/202 2024-03-04T09:02:24.709 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 98/202 2024-03-04T09:02:24.744 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 99/202 2024-03-04T09:02:24.777 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 100/202 2024-03-04T09:02:24.818 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 101/202 2024-03-04T09:02:24.853 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 102/202 2024-03-04T09:02:24.941 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 103/202 2024-03-04T09:02:25.033 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 104/202 2024-03-04T09:02:25.076 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 105/202 2024-03-04T09:02:25.107 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 106/202 2024-03-04T09:02:25.154 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 107/202 2024-03-04T09:02:25.252 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-packaging-20.9-5.el9.noarch 108/202 2024-03-04T09:02:25.301 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 109/202 2024-03-04T09:02:25.361 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 121/202 2024-03-04T09:02:25.444 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 122/202 2024-03-04T09:02:25.472 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 123/202 2024-03-04T09:02:25.783 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 124/202 2024-03-04T09:02:25.810 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : librbd1-2:19.0.0-1739.g1bc250c7.el9.x86_64 125/202 2024-03-04T09:02:25.900 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librbd1-2:19.0.0-1739.g1bc250c7.el9.x86_64 125/202 2024-03-04T09:02:25.931 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rbd-2:19.0.0-1739.g1bc250c7.el9.x86_64 126/202 2024-03-04T09:02:25.967 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 127/202 2024-03-04T09:02:26.033 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 110/202 2024-03-04T09:02:26.081 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 111/202 2024-03-04T09:02:26.115 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 112/202 2024-03-04T09:02:26.166 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 113/202 2024-03-04T09:02:26.254 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 114/202 2024-03-04T09:02:26.294 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 115/202 2024-03-04T09:02:26.419 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 128/202 2024-03-04T09:02:26.446 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librgw2-2:19.0.0-1739.g1bc250c7.el9.x86_64 129/202 2024-03-04T09:02:26.472 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openblas-0.3.21-2.el9.x86_64 116/202 2024-03-04T09:02:26.500 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 117/202 2024-03-04T09:02:26.500 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librgw2-2:19.0.0-1739.g1bc250c7.el9.x86_64 129/202 2024-03-04T09:02:26.523 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rgw-2:19.0.0-1739.g1bc250c7.el9.x86_64 130/202 2024-03-04T09:02:26.577 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 118/202 2024-03-04T09:02:27.217 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 119/202 2024-03-04T09:02:27.322 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 120/202 2024-03-04T09:02:28.525 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 121/202 2024-03-04T09:02:28.596 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 122/202 2024-03-04T09:02:28.623 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 123/202 2024-03-04T09:02:28.738 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-common-2:19.0.0-1739.g1bc250c7.el9.x86_64 131/202 2024-03-04T09:02:28.770 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-common-2:19.0.0-1739.g1bc250c7.el9.x86_64 131/202 2024-03-04T09:02:28.934 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 124/202 2024-03-04T09:02:28.961 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : librbd1-2:19.0.0-1739.g1bc250c7.el9.x86_64 125/202 2024-03-04T09:02:29.035 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librbd1-2:19.0.0-1739.g1bc250c7.el9.x86_64 125/202 2024-03-04T09:02:29.066 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rbd-2:19.0.0-1739.g1bc250c7.el9.x86_64 126/202 2024-03-04T09:02:29.102 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 127/202 2024-03-04T09:02:29.311 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-common-2:19.0.0-1739.g1bc250c7.el9.x86_64 131/202 2024-03-04T09:02:29.348 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-base-2:19.0.0-1739.g1bc250c7.el9.x86_64 132/202 2024-03-04T09:02:29.441 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-base-2:19.0.0-1739.g1bc250c7.el9.x86_64 132/202 2024-03-04T09:02:29.441 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-04T09:02:29.441 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-04T09:02:29.442 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-04T09:02:29.474 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-selinux-2:19.0.0-1739.g1bc250c7.el9.x86_64 133/202 2024-03-04T09:02:29.556 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 128/202 2024-03-04T09:02:29.589 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librgw2-2:19.0.0-1739.g1bc250c7.el9.x86_64 129/202 2024-03-04T09:02:29.644 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librgw2-2:19.0.0-1739.g1bc250c7.el9.x86_64 129/202 2024-03-04T09:02:29.674 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rgw-2:19.0.0-1739.g1bc250c7.el9.x86_64 130/202 2024-03-04T09:02:31.910 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-common-2:19.0.0-1739.g1bc250c7.el9.x86_64 131/202 2024-03-04T09:02:31.946 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-common-2:19.0.0-1739.g1bc250c7.el9.x86_64 131/202 2024-03-04T09:02:32.486 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-common-2:19.0.0-1739.g1bc250c7.el9.x86_64 131/202 2024-03-04T09:02:32.524 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-base-2:19.0.0-1739.g1bc250c7.el9.x86_64 132/202 2024-03-04T09:02:32.614 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-base-2:19.0.0-1739.g1bc250c7.el9.x86_64 132/202 2024-03-04T09:02:32.615 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-04T09:02:32.615 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-04T09:02:32.615 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:02:32.659 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-selinux-2:19.0.0-1739.g1bc250c7.el9.x86_64 133/202 2024-03-04T09:02:41.094 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1739.g1bc250c7.el9.x86_64 133/202 2024-03-04T09:02:41.094 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /sys 2024-03-04T09:02:41.094 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /proc 2024-03-04T09:02:41.094 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /mnt 2024-03-04T09:02:41.094 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /var/tmp 2024-03-04T09:02:41.094 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /home 2024-03-04T09:02:41.094 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /root 2024-03-04T09:02:41.094 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /tmp 2024-03-04T09:02:41.094 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-04T09:02:41.272 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-volume-2:19.0.0-1739.g1bc250c7.el9.noarch 134/202 2024-03-04T09:02:41.288 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-volume-2:19.0.0-1739.g1bc250c7.el9.noarch 134/202 2024-03-04T09:02:41.288 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T09:02:41.288 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-04T09:02:41.288 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-04T09:02:42.750 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-osd-2:19.0.0-1739.g1bc250c7.el9.x86_64 135/202 2024-03-04T09:02:42.776 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-osd-2:19.0.0-1739.g1bc250c7.el9.x86_64 135/202 2024-03-04T09:02:42.776 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T09:02:42.776 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-04T09:02:42.776 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-04T09:02:42.776 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-04T09:02:42.776 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-04T09:02:42.992 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mds-2:19.0.0-1739.g1bc250c7.el9.x86_64 136/202 2024-03-04T09:02:43.015 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mds-2:19.0.0-1739.g1bc250c7.el9.x86_64 136/202 2024-03-04T09:02:43.015 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T09:02:43.015 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-04T09:02:43.015 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-04T09:02:43.016 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-04T09:02:43.016 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-04T09:02:43.451 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mon-2:19.0.0-1739.g1bc250c7.el9.x86_64 137/202 2024-03-04T09:02:43.474 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mon-2:19.0.0-1739.g1bc250c7.el9.x86_64 137/202 2024-03-04T09:02:43.474 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T09:02:43.474 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-04T09:02:43.474 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-04T09:02:43.474 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-04T09:02:43.474 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-04T09:02:43.570 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : automake-1.16.2-8.el9.noarch 138/202 2024-03-04T09:02:43.912 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: cephadm-2:19.0.0-1739.g1bc250c7.el9.noarch 139/202 2024-03-04T09:02:43.943 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : cephadm-2:19.0.0-1739.g1bc250c7.el9.noarch 139/202 2024-03-04T09:02:43.974 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1739.g1bc250c7.e 140/202 2024-03-04T09:02:44.035 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1739.g1bc250c7. 141/202 2024-03-04T09:02:44.058 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1739.g1bc250c7.el9.noa 142/202 2024-03-04T09:02:44.289 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1739.g1bc250c7.el9.noa 142/202 2024-03-04T09:02:44.317 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1739.g1bc250c7.el9.n 143/202 2024-03-04T09:02:44.503 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1739.g1bc250c7.el9.x86_64 133/202 2024-03-04T09:02:44.503 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /sys 2024-03-04T09:02:44.503 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /proc 2024-03-04T09:02:44.503 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /mnt 2024-03-04T09:02:44.503 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /var/tmp 2024-03-04T09:02:44.503 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /home 2024-03-04T09:02:44.503 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /root 2024-03-04T09:02:44.503 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /tmp 2024-03-04T09:02:44.503 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:02:44.671 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-volume-2:19.0.0-1739.g1bc250c7.el9.noarch 134/202 2024-03-04T09:02:44.687 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-volume-2:19.0.0-1739.g1bc250c7.el9.noarch 134/202 2024-03-04T09:02:44.687 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T09:02:44.687 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-04T09:02:44.687 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:02:45.273 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1739.g1bc250c7.el9.n 143/202 2024-03-04T09:02:45.301 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1739.g1bc 144/202 2024-03-04T09:02:45.401 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1739.g1bc 144/202 2024-03-04T09:02:45.563 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1739.g1bc250c7.el 145/202 2024-03-04T09:02:45.595 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-2:19.0.0-1739.g1bc250c7.el9.x86_64 146/202 2024-03-04T09:02:45.617 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1739.g1bc250c7.el9.x86_64 146/202 2024-03-04T09:02:45.618 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T09:02:45.618 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-04T09:02:45.618 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-04T09:02:45.618 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-04T09:02:45.618 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-04T09:02:45.662 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-rook-2:19.0.0-1739.g1bc250c7.el9.noarch 147/202 2024-03-04T09:02:45.673 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1739.g1bc250c7.el9.noarch 147/202 2024-03-04T09:02:45.728 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-2:19.0.0-1739.g1bc250c7.el9.x86_64 148/202 2024-03-04T09:02:46.193 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-osd-2:19.0.0-1739.g1bc250c7.el9.x86_64 135/202 2024-03-04T09:02:46.218 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-osd-2:19.0.0-1739.g1bc250c7.el9.x86_64 135/202 2024-03-04T09:02:46.218 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T09:02:46.218 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-04T09:02:46.218 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-04T09:02:46.218 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-04T09:02:46.218 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:02:46.435 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mds-2:19.0.0-1739.g1bc250c7.el9.x86_64 136/202 2024-03-04T09:02:46.457 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mds-2:19.0.0-1739.g1bc250c7.el9.x86_64 136/202 2024-03-04T09:02:46.458 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T09:02:46.458 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-04T09:02:46.458 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-04T09:02:46.458 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-04T09:02:46.458 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:02:46.586 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libtool-2.4.6-45.el9.x86_64 149/202 2024-03-04T09:02:46.622 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-radosgw-2:19.0.0-1739.g1bc250c7.el9.x86_64 150/202 2024-03-04T09:02:46.645 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1739.g1bc250c7.el9.x86_64 150/202 2024-03-04T09:02:46.645 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T09:02:46.645 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-04T09:02:46.645 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-04T09:02:46.645 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-04T09:02:46.645 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-04T09:02:46.690 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1739.g1bc25 151/202 2024-03-04T09:02:46.712 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1739.g1bc25 151/202 2024-03-04T09:02:46.712 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T09:02:46.712 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-04T09:02:46.712 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-04T09:02:46.757 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : cephfs-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 152/202 2024-03-04T09:02:46.780 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 152/202 2024-03-04T09:02:46.780 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T09:02:46.780 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-04T09:02:46.780 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-04T09:02:46.780 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-04T09:02:46.780 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-04T09:02:46.894 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mon-2:19.0.0-1739.g1bc250c7.el9.x86_64 137/202 2024-03-04T09:02:46.916 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mon-2:19.0.0-1739.g1bc250c7.el9.x86_64 137/202 2024-03-04T09:02:46.917 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T09:02:46.917 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-04T09:02:46.917 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-04T09:02:46.917 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-04T09:02:46.917 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:02:47.021 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : automake-1.16.2-8.el9.noarch 138/202 2024-03-04T09:02:47.091 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : rbd-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 153/202 2024-03-04T09:02:47.114 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 153/202 2024-03-04T09:02:47.114 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T09:02:47.114 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-04T09:02:47.114 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-04T09:02:47.114 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-04T09:02:47.115 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-04T09:02:47.437 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: cephadm-2:19.0.0-1739.g1bc250c7.el9.noarch 139/202 2024-03-04T09:02:47.469 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephadm-2:19.0.0-1739.g1bc250c7.el9.noarch 139/202 2024-03-04T09:02:47.501 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1739.g1bc250c7.e 140/202 2024-03-04T09:02:47.561 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1739.g1bc250c7. 141/202 2024-03-04T09:02:47.584 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1739.g1bc250c7.el9.noa 142/202 2024-03-04T09:02:47.813 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1739.g1bc250c7.el9.noa 142/202 2024-03-04T09:02:47.852 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1739.g1bc250c7.el9.n 143/202 2024-03-04T09:02:48.816 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1739.g1bc250c7.el9.n 143/202 2024-03-04T09:02:48.844 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1739.g1bc 144/202 2024-03-04T09:02:48.944 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1739.g1bc 144/202 2024-03-04T09:02:49.114 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1739.g1bc250c7.el 145/202 2024-03-04T09:02:49.154 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-2:19.0.0-1739.g1bc250c7.el9.x86_64 146/202 2024-03-04T09:02:49.177 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1739.g1bc250c7.el9.x86_64 146/202 2024-03-04T09:02:49.177 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T09:02:49.177 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-04T09:02:49.177 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-04T09:02:49.178 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-04T09:02:49.178 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:02:49.222 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-rook-2:19.0.0-1739.g1bc250c7.el9.noarch 147/202 2024-03-04T09:02:49.233 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1739.g1bc250c7.el9.noarch 147/202 2024-03-04T09:02:49.282 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-2:19.0.0-1739.g1bc250c7.el9.x86_64 148/202 2024-03-04T09:02:50.144 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libtool-2.4.6-45.el9.x86_64 149/202 2024-03-04T09:02:50.173 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-radosgw-2:19.0.0-1739.g1bc250c7.el9.x86_64 150/202 2024-03-04T09:02:50.196 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1739.g1bc250c7.el9.x86_64 150/202 2024-03-04T09:02:50.196 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T09:02:50.196 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-04T09:02:50.196 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-04T09:02:50.196 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-04T09:02:50.196 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:02:50.241 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1739.g1bc25 151/202 2024-03-04T09:02:50.263 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1739.g1bc25 151/202 2024-03-04T09:02:50.263 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T09:02:50.263 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-04T09:02:50.263 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:02:50.308 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephfs-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 152/202 2024-03-04T09:02:50.330 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 152/202 2024-03-04T09:02:50.330 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T09:02:50.330 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-04T09:02:50.330 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-04T09:02:50.331 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-04T09:02:50.331 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:02:50.659 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 153/202 2024-03-04T09:02:50.681 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 153/202 2024-03-04T09:02:50.681 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T09:02:50.681 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-04T09:02:50.681 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-04T09:02:50.681 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-04T09:02:50.681 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:02:51.563 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-test-2:19.0.0-1739.g1bc250c7.el9.x86_64 154/202 2024-03-04T09:02:51.603 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : rbd-fuse-2:19.0.0-1739.g1bc250c7.el9.x86_64 155/202 2024-03-04T09:02:51.634 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : rbd-nbd-2:19.0.0-1739.g1bc250c7.el9.x86_64 156/202 2024-03-04T09:02:51.661 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 157/202 2024-03-04T09:02:51.848 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : cephfs-shell-2:19.0.0-1739.g1bc250c7.el9.x86_64 158/202 2024-03-04T09:02:51.969 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 159/202 2024-03-04T09:02:52.018 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-fuse-2:19.0.0-1739.g1bc250c7.el9.x86_64 160/202 2024-03-04T09:02:52.070 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 161/202 2024-03-04T09:02:52.117 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 162/202 2024-03-04T09:02:52.194 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 163/202 2024-03-04T09:02:52.236 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : iproute-tc-6.7.0-2.el9.x86_64 164/202 2024-03-04T09:02:52.301 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 165/202 2024-03-04T09:02:52.327 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libcephfs-devel-2:19.0.0-1739.g1bc250c7.el9.x86_ 166/202 2024-03-04T09:02:52.356 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : NetworkManager-team-1:1.46.0-1.el9.x86_64 167/202 2024-03-04T09:02:52.428 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : NetworkManager-tui-1:1.46.0-1.el9.x86_64 168/202 2024-03-04T09:02:52.481 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 169/202 2024-03-04T09:02:52.513 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 170/202 2024-03-04T09:02:53.128 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 171/202 2024-03-04T09:02:53.170 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 171/202 2024-03-04T09:02:53.190 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 171/202 2024-03-04T09:02:54.000 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : cephfs-top-2:19.0.0-1739.g1bc250c7.el9.noarch 172/202 2024-03-04T09:02:54.065 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 173/202 2024-03-04T09:02:54.106 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 174/202 2024-03-04T09:02:54.188 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flex-2.6.4-9.el9.x86_64 175/202 2024-03-04T09:02:54.219 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : bison-3.7.4-5.el9.x86_64 176/202 2024-03-04T09:02:54.244 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 177/202 2024-03-04T09:02:54.269 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 178/202 2024-03-04T09:02:54.295 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 179/202 2024-03-04T09:02:54.296 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 180/202 2024-03-04T09:02:54.380 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 180/202 2024-03-04T09:02:54.408 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 181/202 2024-03-04T09:02:54.438 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 182/202 2024-03-04T09:02:54.438 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 183/202 2024-03-04T09:02:54.515 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 183/202 2024-03-04T09:02:54.541 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 184/202 2024-03-04T09:02:54.575 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 185/202 2024-03-04T09:02:54.599 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : iproute-tc-6.2.0-5.el9.x86_64 186/202 2024-03-04T09:02:54.630 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 187/202 2024-03-04T09:02:54.667 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : iproute-6.2.0-5.el9.x86_64 188/202 2024-03-04T09:02:54.700 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 189/202 2024-03-04T09:02:54.758 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 190/202 2024-03-04T09:02:54.791 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 191/202 2024-03-04T09:02:54.824 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 192/202 2024-03-04T09:02:54.849 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 193/202 2024-03-04T09:02:54.875 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 194/202 2024-03-04T09:02:54.900 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 195/202 2024-03-04T09:02:54.907 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-03-04T09:02:54.907 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-03-04T09:02:55.095 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-03-04T09:02:55.095 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 197/202 2024-03-04T09:02:55.096 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-test-2:19.0.0-1739.g1bc250c7.el9.x86_64 154/202 2024-03-04T09:02:55.137 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-fuse-2:19.0.0-1739.g1bc250c7.el9.x86_64 155/202 2024-03-04T09:02:55.168 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-nbd-2:19.0.0-1739.g1bc250c7.el9.x86_64 156/202 2024-03-04T09:02:55.177 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 197/202 2024-03-04T09:02:55.195 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 157/202 2024-03-04T09:02:55.209 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 198/202 2024-03-04T09:02:55.236 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 199/202 2024-03-04T09:02:55.261 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 200/202 2024-03-04T09:02:55.287 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 201/202 2024-03-04T09:02:55.361 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 202/202 2024-03-04T09:02:55.388 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephfs-shell-2:19.0.0-1739.g1bc250c7.el9.x86_64 158/202 2024-03-04T09:02:55.504 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 159/202 2024-03-04T09:02:55.551 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-fuse-2:19.0.0-1739.g1bc250c7.el9.x86_64 160/202 2024-03-04T09:02:55.603 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 161/202 2024-03-04T09:02:55.651 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 162/202 2024-03-04T09:02:55.723 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 163/202 2024-03-04T09:02:55.753 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : iproute-tc-6.7.0-2.el9.x86_64 164/202 2024-03-04T09:02:55.789 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 165/202 2024-03-04T09:02:55.812 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephfs-devel-2:19.0.0-1739.g1bc250c7.el9.x86_ 166/202 2024-03-04T09:02:55.850 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : NetworkManager-team-1:1.46.0-1.el9.x86_64 167/202 2024-03-04T09:02:55.926 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : NetworkManager-tui-1:1.46.0-1.el9.x86_64 168/202 2024-03-04T09:02:55.991 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 169/202 2024-03-04T09:02:56.031 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 170/202 2024-03-04T09:02:56.612 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 171/202 2024-03-04T09:02:56.648 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 171/202 2024-03-04T09:02:56.667 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 171/202 2024-03-04T09:02:57.483 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephfs-top-2:19.0.0-1739.g1bc250c7.el9.noarch 172/202 2024-03-04T09:02:57.568 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 173/202 2024-03-04T09:02:57.609 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 174/202 2024-03-04T09:02:57.691 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flex-2.6.4-9.el9.x86_64 175/202 2024-03-04T09:02:57.722 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : bison-3.7.4-5.el9.x86_64 176/202 2024-03-04T09:02:57.747 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 177/202 2024-03-04T09:02:57.772 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 178/202 2024-03-04T09:02:57.799 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 179/202 2024-03-04T09:02:57.799 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 180/202 2024-03-04T09:02:57.867 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 180/202 2024-03-04T09:02:57.895 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 181/202 2024-03-04T09:02:57.925 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 182/202 2024-03-04T09:02:57.925 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 183/202 2024-03-04T09:02:58.010 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 183/202 2024-03-04T09:02:58.036 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 184/202 2024-03-04T09:02:58.069 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 185/202 2024-03-04T09:02:58.094 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : iproute-tc-6.2.0-5.el9.x86_64 186/202 2024-03-04T09:02:58.129 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 187/202 2024-03-04T09:02:58.196 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : iproute-6.2.0-5.el9.x86_64 188/202 2024-03-04T09:02:58.232 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 189/202 2024-03-04T09:02:58.268 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 190/202 2024-03-04T09:02:58.300 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 191/202 2024-03-04T09:02:58.326 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 192/202 2024-03-04T09:02:58.360 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 193/202 2024-03-04T09:02:58.385 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 194/202 2024-03-04T09:02:58.410 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 195/202 2024-03-04T09:02:58.417 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-03-04T09:02:58.417 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-03-04T09:02:58.597 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-03-04T09:02:58.597 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 197/202 2024-03-04T09:02:58.688 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 197/202 2024-03-04T09:02:58.727 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 198/202 2024-03-04T09:02:58.755 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 199/202 2024-03-04T09:02:58.780 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 200/202 2024-03-04T09:02:58.806 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 201/202 2024-03-04T09:02:58.879 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 202/202 2024-03-04T09:03:00.245 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: openssl-libs-1:3.0.7-24.el9.x86_64 202/202 2024-03-04T09:03:00.245 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-2:19.0.0-1739.g1bc250c7.el9.x86_64 1/202 2024-03-04T09:03:00.246 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-base-2:19.0.0-1739.g1bc250c7.el9.x86_64 2/202 2024-03-04T09:03:00.246 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-common-2:19.0.0-1739.g1bc250c7.el9.x86_64 3/202 2024-03-04T09:03:00.246 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-fuse-2:19.0.0-1739.g1bc250c7.el9.x86_64 4/202 2024-03-04T09:03:00.246 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1739.g1bc25 5/202 2024-03-04T09:03:00.246 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mds-2:19.0.0-1739.g1bc250c7.el9.x86_64 6/202 2024-03-04T09:03:00.246 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-2:19.0.0-1739.g1bc250c7.el9.x86_64 7/202 2024-03-04T09:03:00.246 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mon-2:19.0.0-1739.g1bc250c7.el9.x86_64 8/202 2024-03-04T09:03:00.246 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-osd-2:19.0.0-1739.g1bc250c7.el9.x86_64 9/202 2024-03-04T09:03:00.246 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-radosgw-2:19.0.0-1739.g1bc250c7.el9.x86_64 10/202 2024-03-04T09:03:00.246 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-selinux-2:19.0.0-1739.g1bc250c7.el9.x86_64 11/202 2024-03-04T09:03:00.246 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-test-2:19.0.0-1739.g1bc250c7.el9.x86_64 12/202 2024-03-04T09:03:00.246 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : cephfs-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 13/202 2024-03-04T09:03:00.246 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : cephfs-shell-2:19.0.0-1739.g1bc250c7.el9.x86_64 14/202 2024-03-04T09:03:00.246 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libcephfs-devel-2:19.0.0-1739.g1bc250c7.el9.x86_ 15/202 2024-03-04T09:03:00.247 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libcephfs2-2:19.0.0-1739.g1bc250c7.el9.x86_64 16/202 2024-03-04T09:03:00.247 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libcephsqlite-2:19.0.0-1739.g1bc250c7.el9.x86_64 17/202 2024-03-04T09:03:00.247 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librados-devel-2:19.0.0-1739.g1bc250c7.el9.x86_6 18/202 2024-03-04T09:03:00.247 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libradosstriper1-2:19.0.0-1739.g1bc250c7.el9.x86 19/202 2024-03-04T09:03:00.247 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librgw2-2:19.0.0-1739.g1bc250c7.el9.x86_64 20/202 2024-03-04T09:03:00.247 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1739.g1bc250c7.el 21/202 2024-03-04T09:03:00.247 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-ceph-common-2:19.0.0-1739.g1bc250c7.el9. 22/202 2024-03-04T09:03:00.247 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cephfs-2:19.0.0-1739.g1bc250c7.el9.x86_6 23/202 2024-03-04T09:03:00.247 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rados-2:19.0.0-1739.g1bc250c7.el9.x86_64 24/202 2024-03-04T09:03:00.247 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rbd-2:19.0.0-1739.g1bc250c7.el9.x86_64 25/202 2024-03-04T09:03:00.247 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rgw-2:19.0.0-1739.g1bc250c7.el9.x86_64 26/202 2024-03-04T09:03:00.247 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : rbd-fuse-2:19.0.0-1739.g1bc250c7.el9.x86_64 27/202 2024-03-04T09:03:00.247 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : rbd-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 28/202 2024-03-04T09:03:00.247 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : rbd-nbd-2:19.0.0-1739.g1bc250c7.el9.x86_64 29/202 2024-03-04T09:03:00.248 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1739.g1bc250c7. 30/202 2024-03-04T09:03:00.248 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1739.g1bc250c7.el9.noa 31/202 2024-03-04T09:03:00.248 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1739.g1bc250c7.el9.n 32/202 2024-03-04T09:03:00.248 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1739.g1bc 33/202 2024-03-04T09:03:00.248 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1739.g1bc250c7.el 34/202 2024-03-04T09:03:00.248 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1739.g1bc250c7.el9.noarch 35/202 2024-03-04T09:03:00.248 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1739.g1bc250c7.e 36/202 2024-03-04T09:03:00.248 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-volume-2:19.0.0-1739.g1bc250c7.el9.noarch 37/202 2024-03-04T09:03:00.248 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : cephadm-2:19.0.0-1739.g1bc250c7.el9.noarch 38/202 2024-03-04T09:03:00.248 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : cephfs-top-2:19.0.0-1739.g1bc250c7.el9.noarch 39/202 2024-03-04T09:03:00.248 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/202 2024-03-04T09:03:00.248 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/202 2024-03-04T09:03:00.248 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/202 2024-03-04T09:03:00.248 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 43/202 2024-03-04T09:03:00.249 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/202 2024-03-04T09:03:00.249 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/202 2024-03-04T09:03:00.249 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/202 2024-03-04T09:03:00.249 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/202 2024-03-04T09:03:00.249 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/202 2024-03-04T09:03:00.249 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/202 2024-03-04T09:03:00.249 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/202 2024-03-04T09:03:00.249 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/202 2024-03-04T09:03:00.249 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/202 2024-03-04T09:03:00.249 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 53/202 2024-03-04T09:03:00.249 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/202 2024-03-04T09:03:00.249 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/202 2024-03-04T09:03:00.249 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : lua-5.4.4-4.el9.x86_64 56/202 2024-03-04T09:03:00.249 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/202 2024-03-04T09:03:00.250 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/202 2024-03-04T09:03:00.250 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 59/202 2024-03-04T09:03:00.250 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/202 2024-03-04T09:03:00.250 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/202 2024-03-04T09:03:00.250 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/202 2024-03-04T09:03:00.250 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/202 2024-03-04T09:03:00.250 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 64/202 2024-03-04T09:03:00.250 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 65/202 2024-03-04T09:03:00.250 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 66/202 2024-03-04T09:03:00.250 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 67/202 2024-03-04T09:03:00.250 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 68/202 2024-03-04T09:03:00.250 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 69/202 2024-03-04T09:03:00.250 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 70/202 2024-03-04T09:03:00.250 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 71/202 2024-03-04T09:03:00.251 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 72/202 2024-03-04T09:03:00.251 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 73/202 2024-03-04T09:03:00.251 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 74/202 2024-03-04T09:03:00.251 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 75/202 2024-03-04T09:03:00.251 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 76/202 2024-03-04T09:03:00.251 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 77/202 2024-03-04T09:03:00.251 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 78/202 2024-03-04T09:03:00.251 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 79/202 2024-03-04T09:03:00.251 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 80/202 2024-03-04T09:03:00.251 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/202 2024-03-04T09:03:00.251 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 82/202 2024-03-04T09:03:00.251 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 83/202 2024-03-04T09:03:00.251 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 84/202 2024-03-04T09:03:00.251 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 85/202 2024-03-04T09:03:00.251 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 86/202 2024-03-04T09:03:00.252 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 87/202 2024-03-04T09:03:00.252 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 88/202 2024-03-04T09:03:00.252 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 89/202 2024-03-04T09:03:00.252 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 90/202 2024-03-04T09:03:00.252 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 91/202 2024-03-04T09:03:00.252 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 92/202 2024-03-04T09:03:00.252 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 93/202 2024-03-04T09:03:00.252 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : jq-1.6-16.el9.x86_64 94/202 2024-03-04T09:03:00.252 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 95/202 2024-03-04T09:03:00.252 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 96/202 2024-03-04T09:03:00.252 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 97/202 2024-03-04T09:03:00.252 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 98/202 2024-03-04T09:03:00.252 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 99/202 2024-03-04T09:03:00.252 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-ply-3.11-14.el9.noarch 100/202 2024-03-04T09:03:00.253 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 101/202 2024-03-04T09:03:00.253 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 102/202 2024-03-04T09:03:00.253 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 103/202 2024-03-04T09:03:00.253 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 104/202 2024-03-04T09:03:00.253 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/202 2024-03-04T09:03:00.253 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/202 2024-03-04T09:03:00.253 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/202 2024-03-04T09:03:00.253 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/202 2024-03-04T09:03:00.253 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/202 2024-03-04T09:03:00.253 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/202 2024-03-04T09:03:00.253 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/202 2024-03-04T09:03:00.253 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/202 2024-03-04T09:03:00.253 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/202 2024-03-04T09:03:00.253 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/202 2024-03-04T09:03:00.253 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/202 2024-03-04T09:03:00.254 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 116/202 2024-03-04T09:03:00.254 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/202 2024-03-04T09:03:00.254 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/202 2024-03-04T09:03:00.254 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/202 2024-03-04T09:03:00.254 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/202 2024-03-04T09:03:00.254 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/202 2024-03-04T09:03:00.254 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/202 2024-03-04T09:03:00.254 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/202 2024-03-04T09:03:00.254 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-google-auth-1:2.28.0-1.el9.noarch 124/202 2024-03-04T09:03:00.254 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/202 2024-03-04T09:03:00.254 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/202 2024-03-04T09:03:00.254 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/202 2024-03-04T09:03:00.254 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/202 2024-03-04T09:03:00.254 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/202 2024-03-04T09:03:00.255 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/202 2024-03-04T09:03:00.255 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/202 2024-03-04T09:03:00.255 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/202 2024-03-04T09:03:00.255 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/202 2024-03-04T09:03:00.255 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/202 2024-03-04T09:03:00.255 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/202 2024-03-04T09:03:00.255 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/202 2024-03-04T09:03:00.255 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/202 2024-03-04T09:03:00.255 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/202 2024-03-04T09:03:00.255 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/202 2024-03-04T09:03:00.255 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/202 2024-03-04T09:03:00.255 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/202 2024-03-04T09:03:00.255 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/202 2024-03-04T09:03:00.255 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/202 2024-03-04T09:03:00.256 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/202 2024-03-04T09:03:00.256 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/202 2024-03-04T09:03:00.256 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/202 2024-03-04T09:03:00.256 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/202 2024-03-04T09:03:00.256 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/202 2024-03-04T09:03:00.256 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/202 2024-03-04T09:03:00.256 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/202 2024-03-04T09:03:00.256 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librados2-2:19.0.0-1739.g1bc250c7.el9.x86_64 151/202 2024-03-04T09:03:00.256 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/202 2024-03-04T09:03:00.256 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librbd1-2:19.0.0-1739.g1bc250c7.el9.x86_64 153/202 2024-03-04T09:03:00.256 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/202 2024-03-04T09:03:00.256 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 155/202 2024-03-04T09:03:00.256 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 156/202 2024-03-04T09:03:00.256 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-1:1.46.0-1.el9.x86_64 157/202 2024-03-04T09:03:00.257 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/202 2024-03-04T09:03:00.257 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 159/202 2024-03-04T09:03:00.257 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/202 2024-03-04T09:03:00.257 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-team-1:1.46.0-1.el9.x86_64 161/202 2024-03-04T09:03:00.257 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/202 2024-03-04T09:03:00.257 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-tui-1:1.46.0-1.el9.x86_64 163/202 2024-03-04T09:03:00.257 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/202 2024-03-04T09:03:00.257 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/202 2024-03-04T09:03:00.257 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/202 2024-03-04T09:03:00.257 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/202 2024-03-04T09:03:00.257 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/202 2024-03-04T09:03:00.257 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/202 2024-03-04T09:03:00.257 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/202 2024-03-04T09:03:00.257 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/202 2024-03-04T09:03:00.257 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/202 2024-03-04T09:03:00.257 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : iproute-6.7.0-2.el9.x86_64 173/202 2024-03-04T09:03:00.258 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : iproute-6.2.0-5.el9.x86_64 174/202 2024-03-04T09:03:00.258 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : iproute-tc-6.7.0-2.el9.x86_64 175/202 2024-03-04T09:03:00.258 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : iproute-tc-6.2.0-5.el9.x86_64 176/202 2024-03-04T09:03:00.258 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 177/202 2024-03-04T09:03:00.258 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 178/202 2024-03-04T09:03:00.258 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 179/202 2024-03-04T09:03:00.258 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 180/202 2024-03-04T09:03:00.258 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 181/202 2024-03-04T09:03:00.258 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 182/202 2024-03-04T09:03:00.258 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 183/202 2024-03-04T09:03:00.258 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 184/202 2024-03-04T09:03:00.258 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 185/202 2024-03-04T09:03:00.258 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 186/202 2024-03-04T09:03:00.258 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 187/202 2024-03-04T09:03:00.258 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 188/202 2024-03-04T09:03:00.259 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 189/202 2024-03-04T09:03:00.259 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 190/202 2024-03-04T09:03:00.259 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 191/202 2024-03-04T09:03:00.259 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 192/202 2024-03-04T09:03:00.259 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 193/202 2024-03-04T09:03:00.259 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 194/202 2024-03-04T09:03:00.259 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 195/202 2024-03-04T09:03:00.259 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 196/202 2024-03-04T09:03:00.259 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 197/202 2024-03-04T09:03:00.259 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 198/202 2024-03-04T09:03:00.259 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 199/202 2024-03-04T09:03:00.259 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 200/202 2024-03-04T09:03:00.259 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 201/202 2024-03-04T09:03:03.058 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 202/202 2024-03-04T09:03:03.058 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-04T09:03:03.058 INFO:teuthology.orchestra.run.smithi102.stdout:Upgraded: 2024-03-04T09:03:03.058 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-1:1.46.0-1.el9.x86_64 2024-03-04T09:03:03.058 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 2024-03-04T09:03:03.059 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-team-1:1.46.0-1.el9.x86_64 2024-03-04T09:03:03.059 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-tui-1:1.46.0-1.el9.x86_64 2024-03-04T09:03:03.059 INFO:teuthology.orchestra.run.smithi102.stdout: acl-2.3.1-4.el9.x86_64 2024-03-04T09:03:03.059 INFO:teuthology.orchestra.run.smithi102.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-04T09:03:03.059 INFO:teuthology.orchestra.run.smithi102.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-04T09:03:03.059 INFO:teuthology.orchestra.run.smithi102.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-04T09:03:03.059 INFO:teuthology.orchestra.run.smithi102.stdout: iproute-6.7.0-2.el9.x86_64 2024-03-04T09:03:03.059 INFO:teuthology.orchestra.run.smithi102.stdout: iproute-tc-6.7.0-2.el9.x86_64 2024-03-04T09:03:03.059 INFO:teuthology.orchestra.run.smithi102.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-04T09:03:03.059 INFO:teuthology.orchestra.run.smithi102.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-04T09:03:03.059 INFO:teuthology.orchestra.run.smithi102.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-04T09:03:03.059 INFO:teuthology.orchestra.run.smithi102.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-04T09:03:03.059 INFO:teuthology.orchestra.run.smithi102.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-04T09:03:03.059 INFO:teuthology.orchestra.run.smithi102.stdout: librados2-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:03.059 INFO:teuthology.orchestra.run.smithi102.stdout: librbd1-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:03.059 INFO:teuthology.orchestra.run.smithi102.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-04T09:03:03.060 INFO:teuthology.orchestra.run.smithi102.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-04T09:03:03.060 INFO:teuthology.orchestra.run.smithi102.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-04T09:03:03.060 INFO:teuthology.orchestra.run.smithi102.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-04T09:03:03.060 INFO:teuthology.orchestra.run.smithi102.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-04T09:03:03.060 INFO:teuthology.orchestra.run.smithi102.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-04T09:03:03.060 INFO:teuthology.orchestra.run.smithi102.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-04T09:03:03.060 INFO:teuthology.orchestra.run.smithi102.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-04T09:03:03.060 INFO:teuthology.orchestra.run.smithi102.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-04T09:03:03.060 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-03-04T09:03:03.060 INFO:teuthology.orchestra.run.smithi102.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-04T09:03:03.060 INFO:teuthology.orchestra.run.smithi102.stdout: automake-1.16.2-8.el9.noarch 2024-03-04T09:03:03.060 INFO:teuthology.orchestra.run.smithi102.stdout: bison-3.7.4-5.el9.x86_64 2024-03-04T09:03:03.060 INFO:teuthology.orchestra.run.smithi102.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-04T09:03:03.060 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:03.061 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-base-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:03.061 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-common-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:03.061 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-fuse-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:03.061 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-grafana-dashboards-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T09:03:03.061 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-immutable-object-cache-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:03.061 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mds-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:03.061 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:03.061 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-cephadm-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T09:03:03.061 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-dashboard-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T09:03:03.061 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T09:03:03.061 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-modules-core-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T09:03:03.061 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-rook-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T09:03:03.061 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mon-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:03.061 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-osd-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:03.061 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-prometheus-alerts-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T09:03:03.062 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-radosgw-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:03.062 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-selinux-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:03.062 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-test-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:03.062 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-volume-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T09:03:03.062 INFO:teuthology.orchestra.run.smithi102.stdout: cephadm-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T09:03:03.062 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:03.062 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-shell-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:03.062 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-top-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T09:03:03.062 INFO:teuthology.orchestra.run.smithi102.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-04T09:03:03.062 INFO:teuthology.orchestra.run.smithi102.stdout: flex-2.6.4-9.el9.x86_64 2024-03-04T09:03:03.062 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-04T09:03:03.062 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-04T09:03:03.062 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-04T09:03:03.062 INFO:teuthology.orchestra.run.smithi102.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-04T09:03:03.062 INFO:teuthology.orchestra.run.smithi102.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-04T09:03:03.063 INFO:teuthology.orchestra.run.smithi102.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-04T09:03:03.063 INFO:teuthology.orchestra.run.smithi102.stdout: jq-1.6-16.el9.x86_64 2024-03-04T09:03:03.063 INFO:teuthology.orchestra.run.smithi102.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-04T09:03:03.063 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-04T09:03:03.063 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-04T09:03:03.063 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs-devel-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:03.063 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs2-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:03.063 INFO:teuthology.orchestra.run.smithi102.stdout: libcephsqlite-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:03.063 INFO:teuthology.orchestra.run.smithi102.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-04T09:03:03.063 INFO:teuthology.orchestra.run.smithi102.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-04T09:03:03.063 INFO:teuthology.orchestra.run.smithi102.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-04T09:03:03.063 INFO:teuthology.orchestra.run.smithi102.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-04T09:03:03.063 INFO:teuthology.orchestra.run.smithi102.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-04T09:03:03.063 INFO:teuthology.orchestra.run.smithi102.stdout: librados-devel-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:03.063 INFO:teuthology.orchestra.run.smithi102.stdout: libradosstriper1-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:03.063 INFO:teuthology.orchestra.run.smithi102.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-04T09:03:03.064 INFO:teuthology.orchestra.run.smithi102.stdout: librgw2-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:03.064 INFO:teuthology.orchestra.run.smithi102.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-04T09:03:03.064 INFO:teuthology.orchestra.run.smithi102.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-04T09:03:03.064 INFO:teuthology.orchestra.run.smithi102.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-04T09:03:03.064 INFO:teuthology.orchestra.run.smithi102.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-04T09:03:03.064 INFO:teuthology.orchestra.run.smithi102.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-04T09:03:03.064 INFO:teuthology.orchestra.run.smithi102.stdout: lua-5.4.4-4.el9.x86_64 2024-03-04T09:03:03.064 INFO:teuthology.orchestra.run.smithi102.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-04T09:03:03.064 INFO:teuthology.orchestra.run.smithi102.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-04T09:03:03.064 INFO:teuthology.orchestra.run.smithi102.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-04T09:03:03.064 INFO:teuthology.orchestra.run.smithi102.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-04T09:03:03.064 INFO:teuthology.orchestra.run.smithi102.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-04T09:03:03.064 INFO:teuthology.orchestra.run.smithi102.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-04T09:03:03.064 INFO:teuthology.orchestra.run.smithi102.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-04T09:03:03.065 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-13.11-1.el9.x86_64 2024-03-04T09:03:03.065 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-03-04T09:03:03.065 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-03-04T09:03:03.065 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-server-13.11-1.el9.x86_64 2024-03-04T09:03:03.065 INFO:teuthology.orchestra.run.smithi102.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-04T09:03:03.065 INFO:teuthology.orchestra.run.smithi102.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-04T09:03:03.065 INFO:teuthology.orchestra.run.smithi102.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-03-04T09:03:03.065 INFO:teuthology.orchestra.run.smithi102.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-04T09:03:03.065 INFO:teuthology.orchestra.run.smithi102.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-04T09:03:03.065 INFO:teuthology.orchestra.run.smithi102.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-04T09:03:03.065 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-04T09:03:03.065 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-argparse-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:03.065 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-common-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:03.065 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cephfs-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:03.066 INFO:teuthology.orchestra.run.smithi102.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-04T09:03:03.066 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-04T09:03:03.066 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-04T09:03:03.066 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-04T09:03:03.066 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-04T09:03:03.066 INFO:teuthology.orchestra.run.smithi102.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-04T09:03:03.066 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-04T09:03:03.066 INFO:teuthology.orchestra.run.smithi102.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-04T09:03:03.066 INFO:teuthology.orchestra.run.smithi102.stdout: python3-google-auth-1:2.28.0-1.el9.noarch 2024-03-04T09:03:03.066 INFO:teuthology.orchestra.run.smithi102.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-04T09:03:03.066 INFO:teuthology.orchestra.run.smithi102.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-04T09:03:03.066 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-04T09:03:03.066 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-04T09:03:03.066 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-04T09:03:03.066 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-04T09:03:03.066 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-04T09:03:03.067 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-04T09:03:03.067 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-04T09:03:03.067 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-04T09:03:03.067 INFO:teuthology.orchestra.run.smithi102.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-04T09:03:03.067 INFO:teuthology.orchestra.run.smithi102.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-04T09:03:03.067 INFO:teuthology.orchestra.run.smithi102.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-04T09:03:03.067 INFO:teuthology.orchestra.run.smithi102.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-04T09:03:03.067 INFO:teuthology.orchestra.run.smithi102.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-04T09:03:03.067 INFO:teuthology.orchestra.run.smithi102.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-04T09:03:03.067 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-04T09:03:03.067 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-04T09:03:03.067 INFO:teuthology.orchestra.run.smithi102.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-04T09:03:03.067 INFO:teuthology.orchestra.run.smithi102.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-04T09:03:03.067 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-04T09:03:03.067 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ply-3.11-14.el9.noarch 2024-03-04T09:03:03.068 INFO:teuthology.orchestra.run.smithi102.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-04T09:03:03.068 INFO:teuthology.orchestra.run.smithi102.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-04T09:03:03.068 INFO:teuthology.orchestra.run.smithi102.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-04T09:03:03.068 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-04T09:03:03.068 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-04T09:03:03.068 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-04T09:03:03.068 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-04T09:03:03.068 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-04T09:03:03.068 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-04T09:03:03.068 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rados-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:03.068 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rbd-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:03.068 INFO:teuthology.orchestra.run.smithi102.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-04T09:03:03.068 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-04T09:03:03.068 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-04T09:03:03.069 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rgw-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:03.069 INFO:teuthology.orchestra.run.smithi102.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-04T09:03:03.069 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-04T09:03:03.069 INFO:teuthology.orchestra.run.smithi102.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-04T09:03:03.069 INFO:teuthology.orchestra.run.smithi102.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-04T09:03:03.069 INFO:teuthology.orchestra.run.smithi102.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-04T09:03:03.069 INFO:teuthology.orchestra.run.smithi102.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-04T09:03:03.069 INFO:teuthology.orchestra.run.smithi102.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-04T09:03:03.069 INFO:teuthology.orchestra.run.smithi102.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-04T09:03:03.069 INFO:teuthology.orchestra.run.smithi102.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-04T09:03:03.069 INFO:teuthology.orchestra.run.smithi102.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-04T09:03:03.069 INFO:teuthology.orchestra.run.smithi102.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-04T09:03:03.069 INFO:teuthology.orchestra.run.smithi102.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-04T09:03:03.069 INFO:teuthology.orchestra.run.smithi102.stdout: qatlib-23.11.0-1.el9.x86_64 2024-03-04T09:03:03.069 INFO:teuthology.orchestra.run.smithi102.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-03-04T09:03:03.069 INFO:teuthology.orchestra.run.smithi102.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-03-04T09:03:03.070 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-fuse-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:03.070 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:03.070 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-nbd-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:03.070 INFO:teuthology.orchestra.run.smithi102.stdout: re2-1:20211101-3.el9.x86_64 2024-03-04T09:03:03.070 INFO:teuthology.orchestra.run.smithi102.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-04T09:03:03.070 INFO:teuthology.orchestra.run.smithi102.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-04T09:03:03.070 INFO:teuthology.orchestra.run.smithi102.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-04T09:03:03.070 INFO:teuthology.orchestra.run.smithi102.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-04T09:03:03.070 INFO:teuthology.orchestra.run.smithi102.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-04T09:03:03.070 INFO:teuthology.orchestra.run.smithi102.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-04T09:03:03.070 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-03-04T09:03:03.070 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-03-04T09:03:03.637 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: openssl-libs-1:3.0.7-24.el9.x86_64 202/202 2024-03-04T09:03:03.637 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-2:19.0.0-1739.g1bc250c7.el9.x86_64 1/202 2024-03-04T09:03:03.637 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-base-2:19.0.0-1739.g1bc250c7.el9.x86_64 2/202 2024-03-04T09:03:03.637 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-common-2:19.0.0-1739.g1bc250c7.el9.x86_64 3/202 2024-03-04T09:03:03.637 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-fuse-2:19.0.0-1739.g1bc250c7.el9.x86_64 4/202 2024-03-04T09:03:03.637 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1739.g1bc25 5/202 2024-03-04T09:03:03.638 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mds-2:19.0.0-1739.g1bc250c7.el9.x86_64 6/202 2024-03-04T09:03:03.638 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-2:19.0.0-1739.g1bc250c7.el9.x86_64 7/202 2024-03-04T09:03:03.638 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mon-2:19.0.0-1739.g1bc250c7.el9.x86_64 8/202 2024-03-04T09:03:03.638 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-osd-2:19.0.0-1739.g1bc250c7.el9.x86_64 9/202 2024-03-04T09:03:03.638 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-radosgw-2:19.0.0-1739.g1bc250c7.el9.x86_64 10/202 2024-03-04T09:03:03.638 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-selinux-2:19.0.0-1739.g1bc250c7.el9.x86_64 11/202 2024-03-04T09:03:03.638 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-test-2:19.0.0-1739.g1bc250c7.el9.x86_64 12/202 2024-03-04T09:03:03.638 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephfs-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 13/202 2024-03-04T09:03:03.638 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephfs-shell-2:19.0.0-1739.g1bc250c7.el9.x86_64 14/202 2024-03-04T09:03:03.638 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephfs-devel-2:19.0.0-1739.g1bc250c7.el9.x86_ 15/202 2024-03-04T09:03:03.638 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephfs2-2:19.0.0-1739.g1bc250c7.el9.x86_64 16/202 2024-03-04T09:03:03.638 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephsqlite-2:19.0.0-1739.g1bc250c7.el9.x86_64 17/202 2024-03-04T09:03:03.639 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados-devel-2:19.0.0-1739.g1bc250c7.el9.x86_6 18/202 2024-03-04T09:03:03.639 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libradosstriper1-2:19.0.0-1739.g1bc250c7.el9.x86 19/202 2024-03-04T09:03:03.639 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librgw2-2:19.0.0-1739.g1bc250c7.el9.x86_64 20/202 2024-03-04T09:03:03.639 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1739.g1bc250c7.el 21/202 2024-03-04T09:03:03.639 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ceph-common-2:19.0.0-1739.g1bc250c7.el9. 22/202 2024-03-04T09:03:03.639 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cephfs-2:19.0.0-1739.g1bc250c7.el9.x86_6 23/202 2024-03-04T09:03:03.639 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rados-2:19.0.0-1739.g1bc250c7.el9.x86_64 24/202 2024-03-04T09:03:03.639 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rbd-2:19.0.0-1739.g1bc250c7.el9.x86_64 25/202 2024-03-04T09:03:03.639 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rgw-2:19.0.0-1739.g1bc250c7.el9.x86_64 26/202 2024-03-04T09:03:03.639 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-fuse-2:19.0.0-1739.g1bc250c7.el9.x86_64 27/202 2024-03-04T09:03:03.639 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 28/202 2024-03-04T09:03:03.655 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-nbd-2:19.0.0-1739.g1bc250c7.el9.x86_64 29/202 2024-03-04T09:03:03.655 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1739.g1bc250c7. 30/202 2024-03-04T09:03:03.655 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1739.g1bc250c7.el9.noa 31/202 2024-03-04T09:03:03.655 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1739.g1bc250c7.el9.n 32/202 2024-03-04T09:03:03.655 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1739.g1bc 33/202 2024-03-04T09:03:03.655 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1739.g1bc250c7.el 34/202 2024-03-04T09:03:03.655 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1739.g1bc250c7.el9.noarch 35/202 2024-03-04T09:03:03.655 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1739.g1bc250c7.e 36/202 2024-03-04T09:03:03.656 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-volume-2:19.0.0-1739.g1bc250c7.el9.noarch 37/202 2024-03-04T09:03:03.656 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephadm-2:19.0.0-1739.g1bc250c7.el9.noarch 38/202 2024-03-04T09:03:03.656 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephfs-top-2:19.0.0-1739.g1bc250c7.el9.noarch 39/202 2024-03-04T09:03:03.656 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/202 2024-03-04T09:03:03.656 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/202 2024-03-04T09:03:03.656 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/202 2024-03-04T09:03:03.656 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 43/202 2024-03-04T09:03:03.656 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/202 2024-03-04T09:03:03.656 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/202 2024-03-04T09:03:03.656 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/202 2024-03-04T09:03:03.656 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/202 2024-03-04T09:03:03.656 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/202 2024-03-04T09:03:03.656 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/202 2024-03-04T09:03:03.656 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/202 2024-03-04T09:03:03.657 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/202 2024-03-04T09:03:03.657 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/202 2024-03-04T09:03:03.657 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 53/202 2024-03-04T09:03:03.657 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/202 2024-03-04T09:03:03.657 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/202 2024-03-04T09:03:03.657 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lua-5.4.4-4.el9.x86_64 56/202 2024-03-04T09:03:03.657 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/202 2024-03-04T09:03:03.657 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/202 2024-03-04T09:03:03.657 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 59/202 2024-03-04T09:03:03.657 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/202 2024-03-04T09:03:03.657 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/202 2024-03-04T09:03:03.657 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/202 2024-03-04T09:03:03.657 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/202 2024-03-04T09:03:03.657 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 64/202 2024-03-04T09:03:03.658 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 65/202 2024-03-04T09:03:03.658 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 66/202 2024-03-04T09:03:03.658 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 67/202 2024-03-04T09:03:03.658 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 68/202 2024-03-04T09:03:03.658 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 69/202 2024-03-04T09:03:03.658 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 70/202 2024-03-04T09:03:03.658 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 71/202 2024-03-04T09:03:03.658 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 72/202 2024-03-04T09:03:03.658 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 73/202 2024-03-04T09:03:03.658 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 74/202 2024-03-04T09:03:03.658 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 75/202 2024-03-04T09:03:03.658 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 76/202 2024-03-04T09:03:03.658 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 77/202 2024-03-04T09:03:03.658 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 78/202 2024-03-04T09:03:03.658 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 79/202 2024-03-04T09:03:03.659 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 80/202 2024-03-04T09:03:03.659 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/202 2024-03-04T09:03:03.659 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 82/202 2024-03-04T09:03:03.659 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 83/202 2024-03-04T09:03:03.659 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 84/202 2024-03-04T09:03:03.659 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 85/202 2024-03-04T09:03:03.659 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 86/202 2024-03-04T09:03:03.659 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 87/202 2024-03-04T09:03:03.659 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 88/202 2024-03-04T09:03:03.659 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 89/202 2024-03-04T09:03:03.659 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 90/202 2024-03-04T09:03:03.659 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 91/202 2024-03-04T09:03:03.659 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 92/202 2024-03-04T09:03:03.659 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 93/202 2024-03-04T09:03:03.660 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : jq-1.6-16.el9.x86_64 94/202 2024-03-04T09:03:03.660 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 95/202 2024-03-04T09:03:03.660 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 96/202 2024-03-04T09:03:03.660 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 97/202 2024-03-04T09:03:03.660 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 98/202 2024-03-04T09:03:03.660 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 99/202 2024-03-04T09:03:03.660 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ply-3.11-14.el9.noarch 100/202 2024-03-04T09:03:03.660 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 101/202 2024-03-04T09:03:03.660 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 102/202 2024-03-04T09:03:03.660 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 103/202 2024-03-04T09:03:03.660 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 104/202 2024-03-04T09:03:03.660 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/202 2024-03-04T09:03:03.660 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/202 2024-03-04T09:03:03.660 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/202 2024-03-04T09:03:03.661 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/202 2024-03-04T09:03:03.661 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/202 2024-03-04T09:03:03.661 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/202 2024-03-04T09:03:03.661 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/202 2024-03-04T09:03:03.661 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/202 2024-03-04T09:03:03.661 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/202 2024-03-04T09:03:03.661 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/202 2024-03-04T09:03:03.661 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/202 2024-03-04T09:03:03.661 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 116/202 2024-03-04T09:03:03.661 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/202 2024-03-04T09:03:03.661 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/202 2024-03-04T09:03:03.661 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/202 2024-03-04T09:03:03.661 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/202 2024-03-04T09:03:03.661 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/202 2024-03-04T09:03:03.661 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/202 2024-03-04T09:03:03.661 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/202 2024-03-04T09:03:03.662 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-google-auth-1:2.28.0-1.el9.noarch 124/202 2024-03-04T09:03:03.662 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/202 2024-03-04T09:03:03.662 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/202 2024-03-04T09:03:03.662 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/202 2024-03-04T09:03:03.662 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/202 2024-03-04T09:03:03.662 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/202 2024-03-04T09:03:03.662 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/202 2024-03-04T09:03:03.662 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/202 2024-03-04T09:03:03.662 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/202 2024-03-04T09:03:03.662 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/202 2024-03-04T09:03:03.662 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/202 2024-03-04T09:03:03.662 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/202 2024-03-04T09:03:03.662 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/202 2024-03-04T09:03:03.662 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/202 2024-03-04T09:03:03.663 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/202 2024-03-04T09:03:03.663 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/202 2024-03-04T09:03:03.663 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/202 2024-03-04T09:03:03.663 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/202 2024-03-04T09:03:03.663 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/202 2024-03-04T09:03:03.663 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/202 2024-03-04T09:03:03.663 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/202 2024-03-04T09:03:03.663 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/202 2024-03-04T09:03:03.663 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/202 2024-03-04T09:03:03.663 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/202 2024-03-04T09:03:03.663 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/202 2024-03-04T09:03:03.663 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/202 2024-03-04T09:03:03.663 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/202 2024-03-04T09:03:03.663 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados2-2:19.0.0-1739.g1bc250c7.el9.x86_64 151/202 2024-03-04T09:03:03.663 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/202 2024-03-04T09:03:03.664 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librbd1-2:19.0.0-1739.g1bc250c7.el9.x86_64 153/202 2024-03-04T09:03:03.664 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/202 2024-03-04T09:03:03.664 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 155/202 2024-03-04T09:03:03.664 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 156/202 2024-03-04T09:03:03.664 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-1:1.46.0-1.el9.x86_64 157/202 2024-03-04T09:03:03.664 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/202 2024-03-04T09:03:03.664 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 159/202 2024-03-04T09:03:03.664 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/202 2024-03-04T09:03:03.664 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-team-1:1.46.0-1.el9.x86_64 161/202 2024-03-04T09:03:03.664 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/202 2024-03-04T09:03:03.664 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-tui-1:1.46.0-1.el9.x86_64 163/202 2024-03-04T09:03:03.664 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/202 2024-03-04T09:03:03.664 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/202 2024-03-04T09:03:03.664 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/202 2024-03-04T09:03:03.665 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/202 2024-03-04T09:03:03.665 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/202 2024-03-04T09:03:03.665 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/202 2024-03-04T09:03:03.665 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/202 2024-03-04T09:03:03.665 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/202 2024-03-04T09:03:03.665 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/202 2024-03-04T09:03:03.665 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : iproute-6.7.0-2.el9.x86_64 173/202 2024-03-04T09:03:03.665 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : iproute-6.2.0-5.el9.x86_64 174/202 2024-03-04T09:03:03.665 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : iproute-tc-6.7.0-2.el9.x86_64 175/202 2024-03-04T09:03:03.665 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : iproute-tc-6.2.0-5.el9.x86_64 176/202 2024-03-04T09:03:03.665 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 177/202 2024-03-04T09:03:03.665 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 178/202 2024-03-04T09:03:03.665 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 179/202 2024-03-04T09:03:03.665 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 180/202 2024-03-04T09:03:03.665 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 181/202 2024-03-04T09:03:03.666 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 182/202 2024-03-04T09:03:03.666 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 183/202 2024-03-04T09:03:03.666 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 184/202 2024-03-04T09:03:03.666 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 185/202 2024-03-04T09:03:03.666 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 186/202 2024-03-04T09:03:03.666 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 187/202 2024-03-04T09:03:03.666 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 188/202 2024-03-04T09:03:03.666 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 189/202 2024-03-04T09:03:03.666 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 190/202 2024-03-04T09:03:03.666 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 191/202 2024-03-04T09:03:03.666 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 192/202 2024-03-04T09:03:03.666 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 193/202 2024-03-04T09:03:03.666 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 194/202 2024-03-04T09:03:03.666 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 195/202 2024-03-04T09:03:03.666 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 196/202 2024-03-04T09:03:03.667 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 197/202 2024-03-04T09:03:03.667 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 198/202 2024-03-04T09:03:03.667 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 199/202 2024-03-04T09:03:03.667 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 200/202 2024-03-04T09:03:03.667 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 201/202 2024-03-04T09:03:03.716 DEBUG:teuthology.parallel:result is None 2024-03-04T09:03:06.500 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 202/202 2024-03-04T09:03:06.501 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:03:06.501 INFO:teuthology.orchestra.run.smithi082.stdout:Upgraded: 2024-03-04T09:03:06.501 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-1:1.46.0-1.el9.x86_64 2024-03-04T09:03:06.501 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 2024-03-04T09:03:06.501 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-team-1:1.46.0-1.el9.x86_64 2024-03-04T09:03:06.501 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-tui-1:1.46.0-1.el9.x86_64 2024-03-04T09:03:06.501 INFO:teuthology.orchestra.run.smithi082.stdout: acl-2.3.1-4.el9.x86_64 2024-03-04T09:03:06.501 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-04T09:03:06.501 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-04T09:03:06.501 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-04T09:03:06.501 INFO:teuthology.orchestra.run.smithi082.stdout: iproute-6.7.0-2.el9.x86_64 2024-03-04T09:03:06.502 INFO:teuthology.orchestra.run.smithi082.stdout: iproute-tc-6.7.0-2.el9.x86_64 2024-03-04T09:03:06.502 INFO:teuthology.orchestra.run.smithi082.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-04T09:03:06.502 INFO:teuthology.orchestra.run.smithi082.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-04T09:03:06.502 INFO:teuthology.orchestra.run.smithi082.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-04T09:03:06.502 INFO:teuthology.orchestra.run.smithi082.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-04T09:03:06.502 INFO:teuthology.orchestra.run.smithi082.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-04T09:03:06.502 INFO:teuthology.orchestra.run.smithi082.stdout: librados2-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:06.502 INFO:teuthology.orchestra.run.smithi082.stdout: librbd1-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:06.502 INFO:teuthology.orchestra.run.smithi082.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-04T09:03:06.502 INFO:teuthology.orchestra.run.smithi082.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-04T09:03:06.502 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-04T09:03:06.502 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-04T09:03:06.502 INFO:teuthology.orchestra.run.smithi082.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-04T09:03:06.503 INFO:teuthology.orchestra.run.smithi082.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-04T09:03:06.503 INFO:teuthology.orchestra.run.smithi082.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-04T09:03:06.503 INFO:teuthology.orchestra.run.smithi082.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-04T09:03:06.503 INFO:teuthology.orchestra.run.smithi082.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-04T09:03:06.503 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-03-04T09:03:06.503 INFO:teuthology.orchestra.run.smithi082.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-04T09:03:06.503 INFO:teuthology.orchestra.run.smithi082.stdout: automake-1.16.2-8.el9.noarch 2024-03-04T09:03:06.503 INFO:teuthology.orchestra.run.smithi082.stdout: bison-3.7.4-5.el9.x86_64 2024-03-04T09:03:06.503 INFO:teuthology.orchestra.run.smithi082.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-04T09:03:06.503 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:06.503 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-base-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:06.503 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-common-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:06.503 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-fuse-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:06.504 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-grafana-dashboards-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T09:03:06.504 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-immutable-object-cache-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:06.504 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mds-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:06.504 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:06.504 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-cephadm-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T09:03:06.504 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-dashboard-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T09:03:06.504 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T09:03:06.504 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-modules-core-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T09:03:06.504 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-rook-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T09:03:06.504 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mon-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:06.504 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-osd-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:06.504 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-prometheus-alerts-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T09:03:06.505 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-radosgw-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:06.505 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-selinux-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:06.505 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-test-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:06.505 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-volume-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T09:03:06.505 INFO:teuthology.orchestra.run.smithi082.stdout: cephadm-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T09:03:06.505 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:06.505 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-shell-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:06.505 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-top-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T09:03:06.505 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-04T09:03:06.505 INFO:teuthology.orchestra.run.smithi082.stdout: flex-2.6.4-9.el9.x86_64 2024-03-04T09:03:06.505 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-04T09:03:06.506 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-04T09:03:06.506 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-04T09:03:06.506 INFO:teuthology.orchestra.run.smithi082.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-04T09:03:06.506 INFO:teuthology.orchestra.run.smithi082.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-04T09:03:06.506 INFO:teuthology.orchestra.run.smithi082.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-04T09:03:06.506 INFO:teuthology.orchestra.run.smithi082.stdout: jq-1.6-16.el9.x86_64 2024-03-04T09:03:06.506 INFO:teuthology.orchestra.run.smithi082.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-04T09:03:06.506 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-04T09:03:06.506 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-04T09:03:06.506 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs-devel-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:06.506 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs2-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:06.506 INFO:teuthology.orchestra.run.smithi082.stdout: libcephsqlite-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:06.506 INFO:teuthology.orchestra.run.smithi082.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-04T09:03:06.507 INFO:teuthology.orchestra.run.smithi082.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-04T09:03:06.507 INFO:teuthology.orchestra.run.smithi082.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-04T09:03:06.507 INFO:teuthology.orchestra.run.smithi082.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-04T09:03:06.507 INFO:teuthology.orchestra.run.smithi082.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-04T09:03:06.507 INFO:teuthology.orchestra.run.smithi082.stdout: librados-devel-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:06.507 INFO:teuthology.orchestra.run.smithi082.stdout: libradosstriper1-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:06.507 INFO:teuthology.orchestra.run.smithi082.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-04T09:03:06.507 INFO:teuthology.orchestra.run.smithi082.stdout: librgw2-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:06.507 INFO:teuthology.orchestra.run.smithi082.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-04T09:03:06.507 INFO:teuthology.orchestra.run.smithi082.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-04T09:03:06.507 INFO:teuthology.orchestra.run.smithi082.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-04T09:03:06.507 INFO:teuthology.orchestra.run.smithi082.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-04T09:03:06.507 INFO:teuthology.orchestra.run.smithi082.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-04T09:03:06.507 INFO:teuthology.orchestra.run.smithi082.stdout: lua-5.4.4-4.el9.x86_64 2024-03-04T09:03:06.508 INFO:teuthology.orchestra.run.smithi082.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-04T09:03:06.508 INFO:teuthology.orchestra.run.smithi082.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-04T09:03:06.508 INFO:teuthology.orchestra.run.smithi082.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-04T09:03:06.508 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-04T09:03:06.508 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-04T09:03:06.508 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-04T09:03:06.508 INFO:teuthology.orchestra.run.smithi082.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-04T09:03:06.508 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-13.11-1.el9.x86_64 2024-03-04T09:03:06.508 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-03-04T09:03:06.508 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-03-04T09:03:06.508 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-server-13.11-1.el9.x86_64 2024-03-04T09:03:06.508 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-04T09:03:06.508 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-04T09:03:06.509 INFO:teuthology.orchestra.run.smithi082.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-03-04T09:03:06.509 INFO:teuthology.orchestra.run.smithi082.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-04T09:03:06.509 INFO:teuthology.orchestra.run.smithi082.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-04T09:03:06.509 INFO:teuthology.orchestra.run.smithi082.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-04T09:03:06.509 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-04T09:03:06.509 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-argparse-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:06.509 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-common-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:06.509 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cephfs-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:06.509 INFO:teuthology.orchestra.run.smithi082.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-04T09:03:06.509 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-04T09:03:06.509 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-04T09:03:06.509 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-04T09:03:06.509 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-04T09:03:06.509 INFO:teuthology.orchestra.run.smithi082.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-04T09:03:06.510 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-04T09:03:06.510 INFO:teuthology.orchestra.run.smithi082.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-04T09:03:06.510 INFO:teuthology.orchestra.run.smithi082.stdout: python3-google-auth-1:2.28.0-1.el9.noarch 2024-03-04T09:03:06.510 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-04T09:03:06.510 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-04T09:03:06.510 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-04T09:03:06.510 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-04T09:03:06.510 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-04T09:03:06.510 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-04T09:03:06.510 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-04T09:03:06.510 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-04T09:03:06.510 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-04T09:03:06.510 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-04T09:03:06.510 INFO:teuthology.orchestra.run.smithi082.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-04T09:03:06.511 INFO:teuthology.orchestra.run.smithi082.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-04T09:03:06.511 INFO:teuthology.orchestra.run.smithi082.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-04T09:03:06.511 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-04T09:03:06.511 INFO:teuthology.orchestra.run.smithi082.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-04T09:03:06.511 INFO:teuthology.orchestra.run.smithi082.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-04T09:03:06.511 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-04T09:03:06.511 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-04T09:03:06.511 INFO:teuthology.orchestra.run.smithi082.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-04T09:03:06.511 INFO:teuthology.orchestra.run.smithi082.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-04T09:03:06.511 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-04T09:03:06.511 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ply-3.11-14.el9.noarch 2024-03-04T09:03:06.511 INFO:teuthology.orchestra.run.smithi082.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-04T09:03:06.511 INFO:teuthology.orchestra.run.smithi082.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-04T09:03:06.511 INFO:teuthology.orchestra.run.smithi082.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-04T09:03:06.511 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-04T09:03:06.512 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-04T09:03:06.512 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-04T09:03:06.512 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-04T09:03:06.512 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-04T09:03:06.512 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-04T09:03:06.512 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rados-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:06.512 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rbd-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:06.512 INFO:teuthology.orchestra.run.smithi082.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-04T09:03:06.512 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-04T09:03:06.512 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-04T09:03:06.512 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rgw-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:06.512 INFO:teuthology.orchestra.run.smithi082.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-04T09:03:06.512 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-04T09:03:06.513 INFO:teuthology.orchestra.run.smithi082.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-04T09:03:06.513 INFO:teuthology.orchestra.run.smithi082.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-04T09:03:06.513 INFO:teuthology.orchestra.run.smithi082.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-04T09:03:06.513 INFO:teuthology.orchestra.run.smithi082.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-04T09:03:06.513 INFO:teuthology.orchestra.run.smithi082.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-04T09:03:06.513 INFO:teuthology.orchestra.run.smithi082.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-04T09:03:06.513 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-04T09:03:06.513 INFO:teuthology.orchestra.run.smithi082.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-04T09:03:06.513 INFO:teuthology.orchestra.run.smithi082.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-04T09:03:06.513 INFO:teuthology.orchestra.run.smithi082.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-04T09:03:06.513 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib-23.11.0-1.el9.x86_64 2024-03-04T09:03:06.513 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-03-04T09:03:06.513 INFO:teuthology.orchestra.run.smithi082.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-03-04T09:03:06.513 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-fuse-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:06.514 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:06.514 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-nbd-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:03:06.514 INFO:teuthology.orchestra.run.smithi082.stdout: re2-1:20211101-3.el9.x86_64 2024-03-04T09:03:06.514 INFO:teuthology.orchestra.run.smithi082.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-04T09:03:06.514 INFO:teuthology.orchestra.run.smithi082.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-04T09:03:06.514 INFO:teuthology.orchestra.run.smithi082.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-04T09:03:06.514 INFO:teuthology.orchestra.run.smithi082.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-04T09:03:06.514 INFO:teuthology.orchestra.run.smithi082.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-04T09:03:06.515 INFO:teuthology.orchestra.run.smithi082.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-04T09:03:06.515 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:03:06.515 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-03-04T09:03:07.078 DEBUG:teuthology.parallel:result is None 2024-03-04T09:03:16.497 INFO:teuthology.orchestra.run.smithi190.stdout:(175/176): lua-devel-5.4.4-4.el9.x86_64.rpm 261 B/s | 22 kB 01:27 2024-03-04T09:03:16.564 INFO:teuthology.orchestra.run.smithi190.stdout:(176/176): protobuf-compiler-3.14.0-13.el9.x86_ 9.9 kB/s | 863 kB 01:27 2024-03-04T09:03:16.569 INFO:teuthology.orchestra.run.smithi190.stdout:-------------------------------------------------------------------------------- 2024-03-04T09:03:16.569 INFO:teuthology.orchestra.run.smithi190.stdout:Total 2.3 MB/s | 224 MB 01:38 2024-03-04T09:03:16.618 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction check 2024-03-04T09:03:16.930 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction check succeeded. 2024-03-04T09:03:16.931 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction test 2024-03-04T09:03:18.907 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction test succeeded. 2024-03-04T09:03:18.908 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction 2024-03-04T09:03:25.870 INFO:teuthology.orchestra.run.smithi190.stdout: Preparing : 1/1 2024-03-04T09:03:25.985 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/202 2024-03-04T09:03:26.020 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/202 2024-03-04T09:03:26.066 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/202 2024-03-04T09:03:26.087 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/202 2024-03-04T09:03:26.128 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 4/202 2024-03-04T09:03:26.166 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 5/202 2024-03-04T09:03:26.220 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/202 2024-03-04T09:03:26.253 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : thrift-0.15.0-2.el9.x86_64 7/202 2024-03-04T09:03:26.279 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 8/202 2024-03-04T09:03:26.327 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 9/202 2024-03-04T09:03:26.657 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 10/202 2024-03-04T09:03:26.722 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : librados2-2:19.0.0-1739.g1bc250c7.el9.x86_64 11/202 2024-03-04T09:03:26.835 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: librados2-2:19.0.0-1739.g1bc250c7.el9.x86_64 11/202 2024-03-04T09:03:26.864 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libcephfs2-2:19.0.0-1739.g1bc250c7.el9.x86_64 12/202 2024-03-04T09:03:26.955 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: libcephfs2-2:19.0.0-1739.g1bc250c7.el9.x86_64 12/202 2024-03-04T09:03:26.992 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-rados-2:19.0.0-1739.g1bc250c7.el9.x86_64 13/202 2024-03-04T09:03:27.152 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 14/202 2024-03-04T09:03:27.208 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/202 2024-03-04T09:03:27.235 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libcephsqlite-2:19.0.0-1739.g1bc250c7.el9.x86_64 16/202 2024-03-04T09:03:27.339 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1739.g1bc250c7.el9.x86_64 16/202 2024-03-04T09:03:27.361 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libradosstriper1-2:19.0.0-1739.g1bc250c7.el9.x86 17/202 2024-03-04T09:03:27.409 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1739.g1bc250c7.el9.x86 17/202 2024-03-04T09:03:27.448 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/202 2024-03-04T09:03:27.471 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 19/202 2024-03-04T09:03:27.486 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 19/202 2024-03-04T09:03:27.673 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 20/202 2024-03-04T09:03:27.702 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 20/202 2024-03-04T09:03:27.734 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/202 2024-03-04T09:03:27.930 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/202 2024-03-04T09:03:28.036 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 23/202 2024-03-04T09:03:28.104 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 23/202 2024-03-04T09:03:28.221 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 24/202 2024-03-04T09:03:28.271 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : NetworkManager-1:1.46.0-1.el9.x86_64 24/202 2024-03-04T09:03:28.491 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 24/202 2024-03-04T09:03:28.597 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/202 2024-03-04T09:03:28.706 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/202 2024-03-04T09:03:28.743 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/202 2024-03-04T09:03:28.811 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/202 2024-03-04T09:03:28.865 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 29/202 2024-03-04T09:03:28.897 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 30/202 2024-03-04T09:03:28.931 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 31/202 2024-03-04T09:03:28.971 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 32/202 2024-03-04T09:03:29.035 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/202 2024-03-04T09:03:29.079 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/202 2024-03-04T09:03:29.122 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/202 2024-03-04T09:03:29.155 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/202 2024-03-04T09:03:29.183 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/202 2024-03-04T09:03:29.251 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/202 2024-03-04T09:03:29.287 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-ceph-common-2:19.0.0-1739.g1bc250c7.el9. 39/202 2024-03-04T09:03:29.331 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-ceph-argparse-2:19.0.0-1739.g1bc250c7.el 40/202 2024-03-04T09:03:29.360 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cephfs-2:19.0.0-1739.g1bc250c7.el9.x86_6 41/202 2024-03-04T09:03:29.427 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/202 2024-03-04T09:03:29.482 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/202 2024-03-04T09:03:29.556 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/202 2024-03-04T09:03:29.692 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/202 2024-03-04T09:03:29.744 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/202 2024-03-04T09:03:30.254 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/202 2024-03-04T09:03:30.339 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/202 2024-03-04T09:03:30.416 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/202 2024-03-04T09:03:30.458 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/202 2024-03-04T09:03:30.468 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/202 2024-03-04T09:03:30.513 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 51/202 2024-03-04T09:03:30.551 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : librados-devel-2:19.0.0-1739.g1bc250c7.el9.x86_6 52/202 2024-03-04T09:03:30.592 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 53/202 2024-03-04T09:03:30.681 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 54/202 2024-03-04T09:03:30.728 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : iproute-6.7.0-2.el9.x86_64 55/202 2024-03-04T09:03:31.002 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 56/202 2024-03-04T09:03:31.181 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 57/202 2024-03-04T09:03:31.263 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 58/202 2024-03-04T09:03:31.306 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 59/202 2024-03-04T09:03:31.449 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 60/202 2024-03-04T09:03:31.493 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 61/202 2024-03-04T09:03:31.548 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 62/202 2024-03-04T09:03:31.612 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 63/202 2024-03-04T09:03:31.644 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 64/202 2024-03-04T09:03:31.681 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 65/202 2024-03-04T09:03:31.727 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 66/202 2024-03-04T09:03:31.763 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 67/202 2024-03-04T09:03:31.806 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 68/202 2024-03-04T09:03:31.857 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 69/202 2024-03-04T09:03:31.990 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 70/202 2024-03-04T09:03:32.037 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 71/202 2024-03-04T09:03:32.068 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 72/202 2024-03-04T09:03:32.109 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 73/202 2024-03-04T09:03:32.203 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 74/202 2024-03-04T09:03:32.243 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-google-auth-1:2.28.0-1.el9.noarch 75/202 2024-03-04T09:03:32.275 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 76/202 2024-03-04T09:03:32.300 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 77/202 2024-03-04T09:03:32.325 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 78/202 2024-03-04T09:03:32.404 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 79/202 2024-03-04T09:03:32.533 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 80/202 2024-03-04T09:03:32.635 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 81/202 2024-03-04T09:03:32.688 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 82/202 2024-03-04T09:03:32.741 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-ply-3.11-14.el9.noarch 83/202 2024-03-04T09:03:32.805 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 84/202 2024-03-04T09:03:32.989 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 85/202 2024-03-04T09:03:33.029 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 86/202 2024-03-04T09:03:33.157 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/202 2024-03-04T09:03:33.203 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 88/202 2024-03-04T09:03:33.235 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 89/202 2024-03-04T09:03:33.267 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 90/202 2024-03-04T09:03:33.303 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : jq-1.6-16.el9.x86_64 91/202 2024-03-04T09:03:33.333 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : fuse-2.9.9-15.el9.x86_64 92/202 2024-03-04T09:03:33.361 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 93/202 2024-03-04T09:03:33.396 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 94/202 2024-03-04T09:03:33.434 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : uuid-1.6.2-55.el9.x86_64 95/202 2024-03-04T09:03:33.466 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 96/202 2024-03-04T09:03:33.496 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 97/202 2024-03-04T09:03:33.589 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 98/202 2024-03-04T09:03:33.623 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 99/202 2024-03-04T09:03:33.657 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 100/202 2024-03-04T09:03:33.698 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 101/202 2024-03-04T09:03:33.732 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 102/202 2024-03-04T09:03:33.821 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 103/202 2024-03-04T09:03:33.903 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 104/202 2024-03-04T09:03:33.947 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 105/202 2024-03-04T09:03:33.987 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 106/202 2024-03-04T09:03:34.034 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 107/202 2024-03-04T09:03:34.138 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-packaging-20.9-5.el9.noarch 108/202 2024-03-04T09:03:34.189 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 109/202 2024-03-04T09:03:34.907 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 110/202 2024-03-04T09:03:34.952 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 111/202 2024-03-04T09:03:34.986 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 112/202 2024-03-04T09:03:35.026 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 113/202 2024-03-04T09:03:35.112 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 114/202 2024-03-04T09:03:35.156 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 115/202 2024-03-04T09:03:35.333 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : openblas-0.3.21-2.el9.x86_64 116/202 2024-03-04T09:03:35.363 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 117/202 2024-03-04T09:03:35.441 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 118/202 2024-03-04T09:03:36.073 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 119/202 2024-03-04T09:03:36.184 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 120/202 2024-03-04T09:03:37.394 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 121/202 2024-03-04T09:03:37.701 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 122/202 2024-03-04T09:03:37.736 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 123/202 2024-03-04T09:03:38.046 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 124/202 2024-03-04T09:03:38.074 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : librbd1-2:19.0.0-1739.g1bc250c7.el9.x86_64 125/202 2024-03-04T09:03:38.164 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: librbd1-2:19.0.0-1739.g1bc250c7.el9.x86_64 125/202 2024-03-04T09:03:38.195 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-rbd-2:19.0.0-1739.g1bc250c7.el9.x86_64 126/202 2024-03-04T09:03:38.232 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 127/202 2024-03-04T09:03:38.686 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 128/202 2024-03-04T09:03:38.710 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : librgw2-2:19.0.0-1739.g1bc250c7.el9.x86_64 129/202 2024-03-04T09:03:38.781 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: librgw2-2:19.0.0-1739.g1bc250c7.el9.x86_64 129/202 2024-03-04T09:03:38.812 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-rgw-2:19.0.0-1739.g1bc250c7.el9.x86_64 130/202 2024-03-04T09:03:40.986 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-common-2:19.0.0-1739.g1bc250c7.el9.x86_64 131/202 2024-03-04T09:03:41.033 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-common-2:19.0.0-1739.g1bc250c7.el9.x86_64 131/202 2024-03-04T09:03:41.569 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-common-2:19.0.0-1739.g1bc250c7.el9.x86_64 131/202 2024-03-04T09:03:41.612 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-base-2:19.0.0-1739.g1bc250c7.el9.x86_64 132/202 2024-03-04T09:03:41.703 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-base-2:19.0.0-1739.g1bc250c7.el9.x86_64 132/202 2024-03-04T09:03:41.704 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-04T09:03:41.704 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-04T09:03:41.704 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-03-04T09:03:41.738 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-selinux-2:19.0.0-1739.g1bc250c7.el9.x86_64 133/202 2024-03-04T09:03:53.325 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1739.g1bc250c7.el9.x86_64 133/202 2024-03-04T09:03:53.326 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /sys 2024-03-04T09:03:53.326 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /proc 2024-03-04T09:03:53.326 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /mnt 2024-03-04T09:03:53.326 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /var/tmp 2024-03-04T09:03:53.326 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /home 2024-03-04T09:03:53.326 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /root 2024-03-04T09:03:53.326 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /tmp 2024-03-04T09:03:53.326 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-03-04T09:03:53.494 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-volume-2:19.0.0-1739.g1bc250c7.el9.noarch 134/202 2024-03-04T09:03:53.509 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-volume-2:19.0.0-1739.g1bc250c7.el9.noarch 134/202 2024-03-04T09:03:53.509 INFO:teuthology.orchestra.run.smithi190.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T09:03:53.509 INFO:teuthology.orchestra.run.smithi190.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-04T09:03:53.510 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-03-04T09:03:54.998 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-osd-2:19.0.0-1739.g1bc250c7.el9.x86_64 135/202 2024-03-04T09:03:55.023 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-osd-2:19.0.0-1739.g1bc250c7.el9.x86_64 135/202 2024-03-04T09:03:55.023 INFO:teuthology.orchestra.run.smithi190.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T09:03:55.023 INFO:teuthology.orchestra.run.smithi190.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-04T09:03:55.023 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-04T09:03:55.023 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-04T09:03:55.023 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-03-04T09:03:55.240 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mds-2:19.0.0-1739.g1bc250c7.el9.x86_64 136/202 2024-03-04T09:03:55.262 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mds-2:19.0.0-1739.g1bc250c7.el9.x86_64 136/202 2024-03-04T09:03:55.262 INFO:teuthology.orchestra.run.smithi190.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T09:03:55.262 INFO:teuthology.orchestra.run.smithi190.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-04T09:03:55.262 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-04T09:03:55.262 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-04T09:03:55.262 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-03-04T09:03:55.707 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mon-2:19.0.0-1739.g1bc250c7.el9.x86_64 137/202 2024-03-04T09:03:55.730 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mon-2:19.0.0-1739.g1bc250c7.el9.x86_64 137/202 2024-03-04T09:03:55.730 INFO:teuthology.orchestra.run.smithi190.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T09:03:55.730 INFO:teuthology.orchestra.run.smithi190.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-04T09:03:55.730 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-04T09:03:55.730 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-04T09:03:55.730 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-03-04T09:03:55.817 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : automake-1.16.2-8.el9.noarch 138/202 2024-03-04T09:03:56.251 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: cephadm-2:19.0.0-1739.g1bc250c7.el9.noarch 139/202 2024-03-04T09:03:56.282 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : cephadm-2:19.0.0-1739.g1bc250c7.el9.noarch 139/202 2024-03-04T09:03:56.314 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1739.g1bc250c7.e 140/202 2024-03-04T09:03:56.374 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1739.g1bc250c7. 141/202 2024-03-04T09:03:56.397 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1739.g1bc250c7.el9.noa 142/202 2024-03-04T09:03:56.626 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1739.g1bc250c7.el9.noa 142/202 2024-03-04T09:03:56.665 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1739.g1bc250c7.el9.n 143/202 2024-03-04T09:03:57.623 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1739.g1bc250c7.el9.n 143/202 2024-03-04T09:03:57.649 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1739.g1bc 144/202 2024-03-04T09:03:57.747 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1739.g1bc 144/202 2024-03-04T09:03:57.903 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1739.g1bc250c7.el 145/202 2024-03-04T09:03:57.934 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-2:19.0.0-1739.g1bc250c7.el9.x86_64 146/202 2024-03-04T09:03:57.957 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1739.g1bc250c7.el9.x86_64 146/202 2024-03-04T09:03:57.957 INFO:teuthology.orchestra.run.smithi190.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T09:03:57.957 INFO:teuthology.orchestra.run.smithi190.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-04T09:03:57.957 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-04T09:03:57.958 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-04T09:03:57.958 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-03-04T09:03:58.001 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-rook-2:19.0.0-1739.g1bc250c7.el9.noarch 147/202 2024-03-04T09:03:58.012 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1739.g1bc250c7.el9.noarch 147/202 2024-03-04T09:03:58.060 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-2:19.0.0-1739.g1bc250c7.el9.x86_64 148/202 2024-03-04T09:03:58.928 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libtool-2.4.6-45.el9.x86_64 149/202 2024-03-04T09:03:58.954 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-radosgw-2:19.0.0-1739.g1bc250c7.el9.x86_64 150/202 2024-03-04T09:03:58.976 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1739.g1bc250c7.el9.x86_64 150/202 2024-03-04T09:03:58.976 INFO:teuthology.orchestra.run.smithi190.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T09:03:58.976 INFO:teuthology.orchestra.run.smithi190.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-04T09:03:58.977 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-04T09:03:58.977 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-04T09:03:58.977 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-03-04T09:03:59.021 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1739.g1bc25 151/202 2024-03-04T09:03:59.042 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1739.g1bc25 151/202 2024-03-04T09:03:59.043 INFO:teuthology.orchestra.run.smithi190.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T09:03:59.043 INFO:teuthology.orchestra.run.smithi190.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-04T09:03:59.043 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-03-04T09:03:59.088 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : cephfs-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 152/202 2024-03-04T09:03:59.111 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 152/202 2024-03-04T09:03:59.111 INFO:teuthology.orchestra.run.smithi190.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T09:03:59.111 INFO:teuthology.orchestra.run.smithi190.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-04T09:03:59.111 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-04T09:03:59.111 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-04T09:03:59.111 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-03-04T09:03:59.423 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : rbd-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 153/202 2024-03-04T09:03:59.445 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 153/202 2024-03-04T09:03:59.445 INFO:teuthology.orchestra.run.smithi190.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T09:03:59.445 INFO:teuthology.orchestra.run.smithi190.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-04T09:03:59.445 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-04T09:03:59.445 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-04T09:03:59.445 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-03-04T09:04:03.852 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-test-2:19.0.0-1739.g1bc250c7.el9.x86_64 154/202 2024-03-04T09:04:03.893 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : rbd-fuse-2:19.0.0-1739.g1bc250c7.el9.x86_64 155/202 2024-03-04T09:04:03.924 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : rbd-nbd-2:19.0.0-1739.g1bc250c7.el9.x86_64 156/202 2024-03-04T09:04:03.951 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 157/202 2024-03-04T09:04:04.140 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : cephfs-shell-2:19.0.0-1739.g1bc250c7.el9.x86_64 158/202 2024-03-04T09:04:04.250 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 159/202 2024-03-04T09:04:04.291 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-fuse-2:19.0.0-1739.g1bc250c7.el9.x86_64 160/202 2024-03-04T09:04:04.343 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 161/202 2024-03-04T09:04:04.414 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 162/202 2024-03-04T09:04:04.482 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 163/202 2024-03-04T09:04:04.526 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : iproute-tc-6.7.0-2.el9.x86_64 164/202 2024-03-04T09:04:04.561 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 165/202 2024-03-04T09:04:04.584 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libcephfs-devel-2:19.0.0-1739.g1bc250c7.el9.x86_ 166/202 2024-03-04T09:04:04.613 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : NetworkManager-team-1:1.46.0-1.el9.x86_64 167/202 2024-03-04T09:04:04.694 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : NetworkManager-tui-1:1.46.0-1.el9.x86_64 168/202 2024-03-04T09:04:04.759 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 169/202 2024-03-04T09:04:04.795 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 170/202 2024-03-04T09:04:05.431 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 171/202 2024-03-04T09:04:05.469 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 171/202 2024-03-04T09:04:05.488 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 171/202 2024-03-04T09:04:06.292 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : cephfs-top-2:19.0.0-1739.g1bc250c7.el9.noarch 172/202 2024-03-04T09:04:06.380 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 173/202 2024-03-04T09:04:06.421 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 174/202 2024-03-04T09:04:06.520 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : flex-2.6.4-9.el9.x86_64 175/202 2024-03-04T09:04:06.553 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : bison-3.7.4-5.el9.x86_64 176/202 2024-03-04T09:04:06.578 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 177/202 2024-03-04T09:04:06.603 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 178/202 2024-03-04T09:04:06.630 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 179/202 2024-03-04T09:04:06.630 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 180/202 2024-03-04T09:04:06.714 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 180/202 2024-03-04T09:04:06.742 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 181/202 2024-03-04T09:04:06.800 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 182/202 2024-03-04T09:04:06.801 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 183/202 2024-03-04T09:04:06.857 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 183/202 2024-03-04T09:04:06.884 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 184/202 2024-03-04T09:04:06.917 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 185/202 2024-03-04T09:04:06.942 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : iproute-tc-6.2.0-5.el9.x86_64 186/202 2024-03-04T09:04:06.972 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 187/202 2024-03-04T09:04:07.010 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : iproute-6.2.0-5.el9.x86_64 188/202 2024-03-04T09:04:07.043 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 189/202 2024-03-04T09:04:07.083 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 190/202 2024-03-04T09:04:07.115 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 191/202 2024-03-04T09:04:07.140 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 192/202 2024-03-04T09:04:07.166 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 193/202 2024-03-04T09:04:07.191 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 194/202 2024-03-04T09:04:07.216 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 195/202 2024-03-04T09:04:07.222 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-03-04T09:04:07.222 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-03-04T09:04:07.411 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-03-04T09:04:07.411 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 197/202 2024-03-04T09:04:07.486 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 197/202 2024-03-04T09:04:07.518 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 198/202 2024-03-04T09:04:07.544 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 199/202 2024-03-04T09:04:07.569 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 200/202 2024-03-04T09:04:07.595 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 201/202 2024-03-04T09:04:07.661 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 202/202 2024-03-04T09:04:12.665 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: openssl-libs-1:3.0.7-24.el9.x86_64 202/202 2024-03-04T09:04:12.665 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-2:19.0.0-1739.g1bc250c7.el9.x86_64 1/202 2024-03-04T09:04:12.665 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-base-2:19.0.0-1739.g1bc250c7.el9.x86_64 2/202 2024-03-04T09:04:12.666 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-common-2:19.0.0-1739.g1bc250c7.el9.x86_64 3/202 2024-03-04T09:04:12.666 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-fuse-2:19.0.0-1739.g1bc250c7.el9.x86_64 4/202 2024-03-04T09:04:12.666 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1739.g1bc25 5/202 2024-03-04T09:04:12.666 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mds-2:19.0.0-1739.g1bc250c7.el9.x86_64 6/202 2024-03-04T09:04:12.666 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-2:19.0.0-1739.g1bc250c7.el9.x86_64 7/202 2024-03-04T09:04:12.666 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mon-2:19.0.0-1739.g1bc250c7.el9.x86_64 8/202 2024-03-04T09:04:12.666 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-osd-2:19.0.0-1739.g1bc250c7.el9.x86_64 9/202 2024-03-04T09:04:12.666 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-radosgw-2:19.0.0-1739.g1bc250c7.el9.x86_64 10/202 2024-03-04T09:04:12.666 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-selinux-2:19.0.0-1739.g1bc250c7.el9.x86_64 11/202 2024-03-04T09:04:12.666 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-test-2:19.0.0-1739.g1bc250c7.el9.x86_64 12/202 2024-03-04T09:04:12.666 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : cephfs-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 13/202 2024-03-04T09:04:12.666 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : cephfs-shell-2:19.0.0-1739.g1bc250c7.el9.x86_64 14/202 2024-03-04T09:04:12.666 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libcephfs-devel-2:19.0.0-1739.g1bc250c7.el9.x86_ 15/202 2024-03-04T09:04:12.667 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libcephfs2-2:19.0.0-1739.g1bc250c7.el9.x86_64 16/202 2024-03-04T09:04:12.667 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libcephsqlite-2:19.0.0-1739.g1bc250c7.el9.x86_64 17/202 2024-03-04T09:04:12.667 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librados-devel-2:19.0.0-1739.g1bc250c7.el9.x86_6 18/202 2024-03-04T09:04:12.667 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libradosstriper1-2:19.0.0-1739.g1bc250c7.el9.x86 19/202 2024-03-04T09:04:12.667 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librgw2-2:19.0.0-1739.g1bc250c7.el9.x86_64 20/202 2024-03-04T09:04:12.667 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1739.g1bc250c7.el 21/202 2024-03-04T09:04:12.667 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-ceph-common-2:19.0.0-1739.g1bc250c7.el9. 22/202 2024-03-04T09:04:12.667 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cephfs-2:19.0.0-1739.g1bc250c7.el9.x86_6 23/202 2024-03-04T09:04:12.667 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-rados-2:19.0.0-1739.g1bc250c7.el9.x86_64 24/202 2024-03-04T09:04:12.667 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-rbd-2:19.0.0-1739.g1bc250c7.el9.x86_64 25/202 2024-03-04T09:04:12.668 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-rgw-2:19.0.0-1739.g1bc250c7.el9.x86_64 26/202 2024-03-04T09:04:12.668 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : rbd-fuse-2:19.0.0-1739.g1bc250c7.el9.x86_64 27/202 2024-03-04T09:04:12.668 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : rbd-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 28/202 2024-03-04T09:04:12.668 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : rbd-nbd-2:19.0.0-1739.g1bc250c7.el9.x86_64 29/202 2024-03-04T09:04:12.668 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1739.g1bc250c7. 30/202 2024-03-04T09:04:12.668 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1739.g1bc250c7.el9.noa 31/202 2024-03-04T09:04:12.668 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1739.g1bc250c7.el9.n 32/202 2024-03-04T09:04:12.668 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1739.g1bc 33/202 2024-03-04T09:04:12.668 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1739.g1bc250c7.el 34/202 2024-03-04T09:04:12.668 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1739.g1bc250c7.el9.noarch 35/202 2024-03-04T09:04:12.668 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1739.g1bc250c7.e 36/202 2024-03-04T09:04:12.668 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-volume-2:19.0.0-1739.g1bc250c7.el9.noarch 37/202 2024-03-04T09:04:12.669 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : cephadm-2:19.0.0-1739.g1bc250c7.el9.noarch 38/202 2024-03-04T09:04:12.669 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : cephfs-top-2:19.0.0-1739.g1bc250c7.el9.noarch 39/202 2024-03-04T09:04:12.669 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/202 2024-03-04T09:04:12.669 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/202 2024-03-04T09:04:12.669 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/202 2024-03-04T09:04:12.669 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 43/202 2024-03-04T09:04:12.669 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/202 2024-03-04T09:04:12.669 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/202 2024-03-04T09:04:12.669 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/202 2024-03-04T09:04:12.669 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/202 2024-03-04T09:04:12.669 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/202 2024-03-04T09:04:12.669 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/202 2024-03-04T09:04:12.669 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/202 2024-03-04T09:04:12.670 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/202 2024-03-04T09:04:12.670 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/202 2024-03-04T09:04:12.670 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 53/202 2024-03-04T09:04:12.670 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/202 2024-03-04T09:04:12.670 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/202 2024-03-04T09:04:12.670 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : lua-5.4.4-4.el9.x86_64 56/202 2024-03-04T09:04:12.670 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/202 2024-03-04T09:04:12.670 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/202 2024-03-04T09:04:12.671 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 59/202 2024-03-04T09:04:12.671 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/202 2024-03-04T09:04:12.671 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/202 2024-03-04T09:04:12.671 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/202 2024-03-04T09:04:12.671 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/202 2024-03-04T09:04:12.671 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 64/202 2024-03-04T09:04:12.671 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 65/202 2024-03-04T09:04:12.671 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 66/202 2024-03-04T09:04:12.671 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 67/202 2024-03-04T09:04:12.671 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 68/202 2024-03-04T09:04:12.671 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 69/202 2024-03-04T09:04:12.671 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 70/202 2024-03-04T09:04:12.671 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 71/202 2024-03-04T09:04:12.672 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 72/202 2024-03-04T09:04:12.672 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 73/202 2024-03-04T09:04:12.672 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 74/202 2024-03-04T09:04:12.672 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 75/202 2024-03-04T09:04:12.672 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 76/202 2024-03-04T09:04:12.672 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 77/202 2024-03-04T09:04:12.672 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 78/202 2024-03-04T09:04:12.672 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 79/202 2024-03-04T09:04:12.672 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 80/202 2024-03-04T09:04:12.672 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/202 2024-03-04T09:04:12.672 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 82/202 2024-03-04T09:04:12.672 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 83/202 2024-03-04T09:04:12.672 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 84/202 2024-03-04T09:04:12.673 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 85/202 2024-03-04T09:04:12.673 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 86/202 2024-03-04T09:04:12.673 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 87/202 2024-03-04T09:04:12.673 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 88/202 2024-03-04T09:04:12.673 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 89/202 2024-03-04T09:04:12.673 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 90/202 2024-03-04T09:04:12.673 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 91/202 2024-03-04T09:04:12.673 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 92/202 2024-03-04T09:04:12.673 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 93/202 2024-03-04T09:04:12.673 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : jq-1.6-16.el9.x86_64 94/202 2024-03-04T09:04:12.673 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 95/202 2024-03-04T09:04:12.673 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 96/202 2024-03-04T09:04:12.673 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 97/202 2024-03-04T09:04:12.674 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 98/202 2024-03-04T09:04:12.674 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 99/202 2024-03-04T09:04:12.674 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-ply-3.11-14.el9.noarch 100/202 2024-03-04T09:04:12.674 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 101/202 2024-03-04T09:04:12.674 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 102/202 2024-03-04T09:04:12.674 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 103/202 2024-03-04T09:04:12.674 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 104/202 2024-03-04T09:04:12.674 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/202 2024-03-04T09:04:12.674 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/202 2024-03-04T09:04:12.674 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/202 2024-03-04T09:04:12.674 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/202 2024-03-04T09:04:12.675 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/202 2024-03-04T09:04:12.675 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/202 2024-03-04T09:04:12.675 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/202 2024-03-04T09:04:12.675 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/202 2024-03-04T09:04:12.675 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/202 2024-03-04T09:04:12.675 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/202 2024-03-04T09:04:12.675 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/202 2024-03-04T09:04:12.675 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 116/202 2024-03-04T09:04:12.675 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/202 2024-03-04T09:04:12.675 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/202 2024-03-04T09:04:12.675 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/202 2024-03-04T09:04:12.675 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/202 2024-03-04T09:04:12.676 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/202 2024-03-04T09:04:12.676 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/202 2024-03-04T09:04:12.676 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/202 2024-03-04T09:04:12.676 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-google-auth-1:2.28.0-1.el9.noarch 124/202 2024-03-04T09:04:12.676 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/202 2024-03-04T09:04:12.676 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/202 2024-03-04T09:04:12.676 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/202 2024-03-04T09:04:12.676 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/202 2024-03-04T09:04:12.676 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/202 2024-03-04T09:04:12.676 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/202 2024-03-04T09:04:12.676 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/202 2024-03-04T09:04:12.676 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/202 2024-03-04T09:04:12.676 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/202 2024-03-04T09:04:12.677 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/202 2024-03-04T09:04:12.677 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/202 2024-03-04T09:04:12.677 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/202 2024-03-04T09:04:12.677 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/202 2024-03-04T09:04:12.677 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/202 2024-03-04T09:04:12.677 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/202 2024-03-04T09:04:12.677 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/202 2024-03-04T09:04:12.677 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/202 2024-03-04T09:04:12.677 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/202 2024-03-04T09:04:12.677 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/202 2024-03-04T09:04:12.677 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/202 2024-03-04T09:04:12.677 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/202 2024-03-04T09:04:12.678 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/202 2024-03-04T09:04:12.678 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/202 2024-03-04T09:04:12.678 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/202 2024-03-04T09:04:12.678 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/202 2024-03-04T09:04:12.678 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/202 2024-03-04T09:04:12.678 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librados2-2:19.0.0-1739.g1bc250c7.el9.x86_64 151/202 2024-03-04T09:04:12.678 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/202 2024-03-04T09:04:12.678 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librbd1-2:19.0.0-1739.g1bc250c7.el9.x86_64 153/202 2024-03-04T09:04:12.678 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/202 2024-03-04T09:04:12.678 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 155/202 2024-03-04T09:04:12.678 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 156/202 2024-03-04T09:04:12.678 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : NetworkManager-1:1.46.0-1.el9.x86_64 157/202 2024-03-04T09:04:12.679 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/202 2024-03-04T09:04:12.679 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 159/202 2024-03-04T09:04:12.679 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/202 2024-03-04T09:04:12.679 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : NetworkManager-team-1:1.46.0-1.el9.x86_64 161/202 2024-03-04T09:04:12.679 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/202 2024-03-04T09:04:12.679 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : NetworkManager-tui-1:1.46.0-1.el9.x86_64 163/202 2024-03-04T09:04:12.679 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/202 2024-03-04T09:04:12.679 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/202 2024-03-04T09:04:12.679 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/202 2024-03-04T09:04:12.679 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/202 2024-03-04T09:04:12.679 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/202 2024-03-04T09:04:12.679 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/202 2024-03-04T09:04:12.679 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/202 2024-03-04T09:04:12.680 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/202 2024-03-04T09:04:12.680 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/202 2024-03-04T09:04:12.680 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : iproute-6.7.0-2.el9.x86_64 173/202 2024-03-04T09:04:12.680 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : iproute-6.2.0-5.el9.x86_64 174/202 2024-03-04T09:04:12.680 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : iproute-tc-6.7.0-2.el9.x86_64 175/202 2024-03-04T09:04:12.680 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : iproute-tc-6.2.0-5.el9.x86_64 176/202 2024-03-04T09:04:12.680 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 177/202 2024-03-04T09:04:12.680 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 178/202 2024-03-04T09:04:12.680 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 179/202 2024-03-04T09:04:12.680 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 180/202 2024-03-04T09:04:12.680 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 181/202 2024-03-04T09:04:12.680 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 182/202 2024-03-04T09:04:12.680 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 183/202 2024-03-04T09:04:12.681 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 184/202 2024-03-04T09:04:12.681 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 185/202 2024-03-04T09:04:12.681 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 186/202 2024-03-04T09:04:12.681 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 187/202 2024-03-04T09:04:12.681 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 188/202 2024-03-04T09:04:12.681 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 189/202 2024-03-04T09:04:12.681 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 190/202 2024-03-04T09:04:12.681 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 191/202 2024-03-04T09:04:12.681 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 192/202 2024-03-04T09:04:12.682 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 193/202 2024-03-04T09:04:12.682 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 194/202 2024-03-04T09:04:12.682 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 195/202 2024-03-04T09:04:12.682 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 196/202 2024-03-04T09:04:12.682 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 197/202 2024-03-04T09:04:12.682 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 198/202 2024-03-04T09:04:12.682 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 199/202 2024-03-04T09:04:12.682 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 200/202 2024-03-04T09:04:12.682 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 201/202 2024-03-04T09:04:15.427 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 202/202 2024-03-04T09:04:15.427 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-03-04T09:04:15.428 INFO:teuthology.orchestra.run.smithi190.stdout:Upgraded: 2024-03-04T09:04:15.428 INFO:teuthology.orchestra.run.smithi190.stdout: NetworkManager-1:1.46.0-1.el9.x86_64 2024-03-04T09:04:15.428 INFO:teuthology.orchestra.run.smithi190.stdout: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 2024-03-04T09:04:15.428 INFO:teuthology.orchestra.run.smithi190.stdout: NetworkManager-team-1:1.46.0-1.el9.x86_64 2024-03-04T09:04:15.428 INFO:teuthology.orchestra.run.smithi190.stdout: NetworkManager-tui-1:1.46.0-1.el9.x86_64 2024-03-04T09:04:15.428 INFO:teuthology.orchestra.run.smithi190.stdout: acl-2.3.1-4.el9.x86_64 2024-03-04T09:04:15.428 INFO:teuthology.orchestra.run.smithi190.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-04T09:04:15.428 INFO:teuthology.orchestra.run.smithi190.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-04T09:04:15.428 INFO:teuthology.orchestra.run.smithi190.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-04T09:04:15.428 INFO:teuthology.orchestra.run.smithi190.stdout: iproute-6.7.0-2.el9.x86_64 2024-03-04T09:04:15.428 INFO:teuthology.orchestra.run.smithi190.stdout: iproute-tc-6.7.0-2.el9.x86_64 2024-03-04T09:04:15.429 INFO:teuthology.orchestra.run.smithi190.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-04T09:04:15.429 INFO:teuthology.orchestra.run.smithi190.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-04T09:04:15.429 INFO:teuthology.orchestra.run.smithi190.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-04T09:04:15.429 INFO:teuthology.orchestra.run.smithi190.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-04T09:04:15.429 INFO:teuthology.orchestra.run.smithi190.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-04T09:04:15.429 INFO:teuthology.orchestra.run.smithi190.stdout: librados2-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:04:15.429 INFO:teuthology.orchestra.run.smithi190.stdout: librbd1-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:04:15.429 INFO:teuthology.orchestra.run.smithi190.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-04T09:04:15.429 INFO:teuthology.orchestra.run.smithi190.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-04T09:04:15.429 INFO:teuthology.orchestra.run.smithi190.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-04T09:04:15.429 INFO:teuthology.orchestra.run.smithi190.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-04T09:04:15.429 INFO:teuthology.orchestra.run.smithi190.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-04T09:04:15.429 INFO:teuthology.orchestra.run.smithi190.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-04T09:04:15.429 INFO:teuthology.orchestra.run.smithi190.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-04T09:04:15.430 INFO:teuthology.orchestra.run.smithi190.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-04T09:04:15.430 INFO:teuthology.orchestra.run.smithi190.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-04T09:04:15.430 INFO:teuthology.orchestra.run.smithi190.stdout:Installed: 2024-03-04T09:04:15.430 INFO:teuthology.orchestra.run.smithi190.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-04T09:04:15.430 INFO:teuthology.orchestra.run.smithi190.stdout: automake-1.16.2-8.el9.noarch 2024-03-04T09:04:15.430 INFO:teuthology.orchestra.run.smithi190.stdout: bison-3.7.4-5.el9.x86_64 2024-03-04T09:04:15.430 INFO:teuthology.orchestra.run.smithi190.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-04T09:04:15.430 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:04:15.431 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-base-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:04:15.431 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-common-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:04:15.431 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-fuse-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:04:15.431 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-grafana-dashboards-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T09:04:15.431 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-immutable-object-cache-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:04:15.431 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mds-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:04:15.431 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:04:15.432 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-cephadm-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T09:04:15.432 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-dashboard-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T09:04:15.432 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T09:04:15.432 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-modules-core-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T09:04:15.432 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-rook-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T09:04:15.433 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mon-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:04:15.433 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-osd-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:04:15.433 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-prometheus-alerts-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T09:04:15.433 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-radosgw-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:04:15.433 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-selinux-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:04:15.433 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-test-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:04:15.433 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-volume-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T09:04:15.433 INFO:teuthology.orchestra.run.smithi190.stdout: cephadm-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T09:04:15.433 INFO:teuthology.orchestra.run.smithi190.stdout: cephfs-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:04:15.434 INFO:teuthology.orchestra.run.smithi190.stdout: cephfs-shell-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:04:15.434 INFO:teuthology.orchestra.run.smithi190.stdout: cephfs-top-2:19.0.0-1739.g1bc250c7.el9.noarch 2024-03-04T09:04:15.434 INFO:teuthology.orchestra.run.smithi190.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-04T09:04:15.434 INFO:teuthology.orchestra.run.smithi190.stdout: flex-2.6.4-9.el9.x86_64 2024-03-04T09:04:15.434 INFO:teuthology.orchestra.run.smithi190.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-04T09:04:15.434 INFO:teuthology.orchestra.run.smithi190.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-04T09:04:15.434 INFO:teuthology.orchestra.run.smithi190.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-04T09:04:15.434 INFO:teuthology.orchestra.run.smithi190.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-04T09:04:15.434 INFO:teuthology.orchestra.run.smithi190.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-04T09:04:15.434 INFO:teuthology.orchestra.run.smithi190.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-04T09:04:15.434 INFO:teuthology.orchestra.run.smithi190.stdout: jq-1.6-16.el9.x86_64 2024-03-04T09:04:15.434 INFO:teuthology.orchestra.run.smithi190.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-04T09:04:15.434 INFO:teuthology.orchestra.run.smithi190.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-04T09:04:15.435 INFO:teuthology.orchestra.run.smithi190.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-04T09:04:15.435 INFO:teuthology.orchestra.run.smithi190.stdout: libcephfs-devel-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:04:15.435 INFO:teuthology.orchestra.run.smithi190.stdout: libcephfs2-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:04:15.435 INFO:teuthology.orchestra.run.smithi190.stdout: libcephsqlite-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:04:15.435 INFO:teuthology.orchestra.run.smithi190.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-04T09:04:15.435 INFO:teuthology.orchestra.run.smithi190.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-04T09:04:15.435 INFO:teuthology.orchestra.run.smithi190.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-04T09:04:15.436 INFO:teuthology.orchestra.run.smithi190.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-04T09:04:15.436 INFO:teuthology.orchestra.run.smithi190.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-04T09:04:15.436 INFO:teuthology.orchestra.run.smithi190.stdout: librados-devel-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:04:15.436 INFO:teuthology.orchestra.run.smithi190.stdout: libradosstriper1-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:04:15.436 INFO:teuthology.orchestra.run.smithi190.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-04T09:04:15.436 INFO:teuthology.orchestra.run.smithi190.stdout: librgw2-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:04:15.437 INFO:teuthology.orchestra.run.smithi190.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-04T09:04:15.437 INFO:teuthology.orchestra.run.smithi190.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-04T09:04:15.437 INFO:teuthology.orchestra.run.smithi190.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-04T09:04:15.437 INFO:teuthology.orchestra.run.smithi190.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-04T09:04:15.437 INFO:teuthology.orchestra.run.smithi190.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-04T09:04:15.438 INFO:teuthology.orchestra.run.smithi190.stdout: lua-5.4.4-4.el9.x86_64 2024-03-04T09:04:15.438 INFO:teuthology.orchestra.run.smithi190.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-04T09:04:15.438 INFO:teuthology.orchestra.run.smithi190.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-04T09:04:15.438 INFO:teuthology.orchestra.run.smithi190.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-04T09:04:15.438 INFO:teuthology.orchestra.run.smithi190.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-04T09:04:15.438 INFO:teuthology.orchestra.run.smithi190.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-04T09:04:15.438 INFO:teuthology.orchestra.run.smithi190.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-04T09:04:15.438 INFO:teuthology.orchestra.run.smithi190.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-04T09:04:15.438 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-13.11-1.el9.x86_64 2024-03-04T09:04:15.438 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-03-04T09:04:15.438 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-03-04T09:04:15.438 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-server-13.11-1.el9.x86_64 2024-03-04T09:04:15.439 INFO:teuthology.orchestra.run.smithi190.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-04T09:04:15.439 INFO:teuthology.orchestra.run.smithi190.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-04T09:04:15.439 INFO:teuthology.orchestra.run.smithi190.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-03-04T09:04:15.439 INFO:teuthology.orchestra.run.smithi190.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-04T09:04:15.439 INFO:teuthology.orchestra.run.smithi190.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-04T09:04:15.439 INFO:teuthology.orchestra.run.smithi190.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-04T09:04:15.439 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-04T09:04:15.439 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ceph-argparse-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:04:15.439 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ceph-common-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:04:15.439 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cephfs-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:04:15.439 INFO:teuthology.orchestra.run.smithi190.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-04T09:04:15.439 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-04T09:04:15.439 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-04T09:04:15.440 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-04T09:04:15.440 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-04T09:04:15.440 INFO:teuthology.orchestra.run.smithi190.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-04T09:04:15.440 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-04T09:04:15.440 INFO:teuthology.orchestra.run.smithi190.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-04T09:04:15.440 INFO:teuthology.orchestra.run.smithi190.stdout: python3-google-auth-1:2.28.0-1.el9.noarch 2024-03-04T09:04:15.440 INFO:teuthology.orchestra.run.smithi190.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-04T09:04:15.440 INFO:teuthology.orchestra.run.smithi190.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-04T09:04:15.440 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-04T09:04:15.440 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-04T09:04:15.440 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-04T09:04:15.440 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-04T09:04:15.440 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-04T09:04:15.441 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-04T09:04:15.441 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-04T09:04:15.441 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-04T09:04:15.441 INFO:teuthology.orchestra.run.smithi190.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-04T09:04:15.441 INFO:teuthology.orchestra.run.smithi190.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-04T09:04:15.441 INFO:teuthology.orchestra.run.smithi190.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-04T09:04:15.441 INFO:teuthology.orchestra.run.smithi190.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-04T09:04:15.441 INFO:teuthology.orchestra.run.smithi190.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-04T09:04:15.441 INFO:teuthology.orchestra.run.smithi190.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-04T09:04:15.441 INFO:teuthology.orchestra.run.smithi190.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-04T09:04:15.441 INFO:teuthology.orchestra.run.smithi190.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-04T09:04:15.441 INFO:teuthology.orchestra.run.smithi190.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-04T09:04:15.441 INFO:teuthology.orchestra.run.smithi190.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-04T09:04:15.441 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-04T09:04:15.441 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ply-3.11-14.el9.noarch 2024-03-04T09:04:15.442 INFO:teuthology.orchestra.run.smithi190.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-04T09:04:15.442 INFO:teuthology.orchestra.run.smithi190.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-04T09:04:15.442 INFO:teuthology.orchestra.run.smithi190.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-04T09:04:15.442 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-04T09:04:15.442 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-04T09:04:15.442 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-04T09:04:15.442 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-04T09:04:15.442 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-04T09:04:15.442 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-04T09:04:15.442 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rados-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:04:15.442 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rbd-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:04:15.442 INFO:teuthology.orchestra.run.smithi190.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-04T09:04:15.442 INFO:teuthology.orchestra.run.smithi190.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-04T09:04:15.443 INFO:teuthology.orchestra.run.smithi190.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-04T09:04:15.443 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rgw-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:04:15.443 INFO:teuthology.orchestra.run.smithi190.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-04T09:04:15.443 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-04T09:04:15.443 INFO:teuthology.orchestra.run.smithi190.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-04T09:04:15.443 INFO:teuthology.orchestra.run.smithi190.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-04T09:04:15.443 INFO:teuthology.orchestra.run.smithi190.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-04T09:04:15.443 INFO:teuthology.orchestra.run.smithi190.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-04T09:04:15.443 INFO:teuthology.orchestra.run.smithi190.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-04T09:04:15.443 INFO:teuthology.orchestra.run.smithi190.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-04T09:04:15.443 INFO:teuthology.orchestra.run.smithi190.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-04T09:04:15.443 INFO:teuthology.orchestra.run.smithi190.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-04T09:04:15.443 INFO:teuthology.orchestra.run.smithi190.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-04T09:04:15.443 INFO:teuthology.orchestra.run.smithi190.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-04T09:04:15.444 INFO:teuthology.orchestra.run.smithi190.stdout: qatlib-23.11.0-1.el9.x86_64 2024-03-04T09:04:15.444 INFO:teuthology.orchestra.run.smithi190.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-03-04T09:04:15.444 INFO:teuthology.orchestra.run.smithi190.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-03-04T09:04:15.444 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-fuse-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:04:15.444 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-mirror-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:04:15.444 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-nbd-2:19.0.0-1739.g1bc250c7.el9.x86_64 2024-03-04T09:04:15.444 INFO:teuthology.orchestra.run.smithi190.stdout: re2-1:20211101-3.el9.x86_64 2024-03-04T09:04:15.444 INFO:teuthology.orchestra.run.smithi190.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-04T09:04:15.444 INFO:teuthology.orchestra.run.smithi190.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-04T09:04:15.447 INFO:teuthology.orchestra.run.smithi190.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-04T09:04:15.447 INFO:teuthology.orchestra.run.smithi190.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-04T09:04:15.447 INFO:teuthology.orchestra.run.smithi190.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-04T09:04:15.447 INFO:teuthology.orchestra.run.smithi190.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-04T09:04:15.447 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-03-04T09:04:15.447 INFO:teuthology.orchestra.run.smithi190.stdout:Complete! 2024-03-04T09:04:15.983 DEBUG:teuthology.parallel:result is None 2024-03-04T09:04:15.985 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd 2024-03-04T09:04:16.213 DEBUG:teuthology.orchestra.run.smithi082:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-04T09:04:16.239 INFO:teuthology.orchestra.run.smithi082.stdout:19.0.0-1739.g1bc250c7.el9 2024-03-04T09:04:16.240 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1739.g1bc250c7.el9 2024-03-04T09:04:16.240 INFO:teuthology.task.install:The correct ceph version 19.0.0-1739.g1bc250c7 is installed. 2024-03-04T09:04:16.242 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd 2024-03-04T09:04:16.392 DEBUG:teuthology.orchestra.run.smithi102:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-04T09:04:16.418 INFO:teuthology.orchestra.run.smithi102.stdout:19.0.0-1739.g1bc250c7.el9 2024-03-04T09:04:16.418 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1739.g1bc250c7.el9 2024-03-04T09:04:16.418 INFO:teuthology.task.install:The correct ceph version 19.0.0-1739.g1bc250c7 is installed. 2024-03-04T09:04:16.420 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd 2024-03-04T09:04:16.566 DEBUG:teuthology.orchestra.run.smithi190:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-04T09:04:16.590 INFO:teuthology.orchestra.run.smithi190.stdout:19.0.0-1739.g1bc250c7.el9 2024-03-04T09:04:16.591 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1739.g1bc250c7.el9 2024-03-04T09:04:16.591 INFO:teuthology.task.install:The correct ceph version 19.0.0-1739.g1bc250c7 is installed. 2024-03-04T09:04:16.593 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-04T09:04:16.593 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-03-04T09:04:16.593 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-04T09:04:16.628 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-03-04T09:04:16.628 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-04T09:04:16.663 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-03-04T09:04:16.664 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-04T09:04:16.696 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-04T09:04:16.696 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-03-04T09:04:16.696 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/daemon-helper 2024-03-04T09:04:16.727 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-04T09:04:16.796 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-03-04T09:04:16.796 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/daemon-helper 2024-03-04T09:04:16.826 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-04T09:04:16.896 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-03-04T09:04:16.896 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/usr/bin/daemon-helper 2024-03-04T09:04:16.925 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-04T09:04:16.994 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-04T09:04:16.994 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-03-04T09:04:16.994 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-04T09:04:17.023 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-04T09:04:17.092 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-03-04T09:04:17.092 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-04T09:04:17.122 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-04T09:04:17.192 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-03-04T09:04:17.192 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-04T09:04:17.221 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-04T09:04:17.289 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-04T09:04:17.289 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-03-04T09:04:17.289 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/stdin-killer 2024-03-04T09:04:17.317 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-04T09:04:17.394 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-03-04T09:04:17.394 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/stdin-killer 2024-03-04T09:04:17.425 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-04T09:04:17.494 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-03-04T09:04:17.494 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/usr/bin/stdin-killer 2024-03-04T09:04:17.523 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-04T09:04:17.591 INFO:teuthology.run_tasks:Running task cephadm... 2024-03-04T09:04:17.692 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client dirsize rbytes': False, 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-03-04T09:04:17.692 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd 2024-03-04T09:04:17.693 INFO:tasks.cephadm:Cluster fsid is 2e533fc8-da06-11ee-95c6-87774f69a715 2024-03-04T09:04:17.693 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-03-04T09:04:17.693 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.82', 'mon.b': '172.21.15.102', 'mon.c': '172.21.15.190'} 2024-03-04T09:04:17.693 INFO:tasks.cephadm:First mon is mon.a on smithi082 2024-03-04T09:04:17.693 INFO:tasks.cephadm:First mgr is x 2024-03-04T09:04:17.693 INFO:tasks.cephadm:Normalizing hostnames... 2024-03-04T09:04:17.694 DEBUG:teuthology.orchestra.run.smithi082:> sudo hostname $(hostname -s) 2024-03-04T09:04:17.723 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname $(hostname -s) 2024-03-04T09:04:17.753 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname $(hostname -s) 2024-03-04T09:04:17.782 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-03-04T09:04:17.783 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd 2024-03-04T09:04:18.004 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/77279/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-1739-g1bc250c7', 'node_name': '172.21.5.36+adami06', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-1739.g1bc250c7'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb/1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-03-04 00:06:26.635980', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-lusov-qdb', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-lusov-qdb/1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-03-04T09:04:18.148 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref wip-lusov-qdb, sha1 1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd 2024-03-04T09:04:18.150 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/wip-lusov-qdb/1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/centos/9/x86_64/flavors/default/cephadm 2024-03-04T09:04:18.150 DEBUG:teuthology.orchestra.run.smithi082:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-lusov-qdb/1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-03-04T09:04:18.556 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r--. 1 ubuntu ubuntu 766895 Mar 4 09:04 /home/ubuntu/cephtest/cephadm 2024-03-04T09:04:18.556 DEBUG:teuthology.orchestra.run.smithi102:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-lusov-qdb/1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-03-04T09:04:18.955 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r--. 1 ubuntu ubuntu 766895 Mar 4 09:04 /home/ubuntu/cephtest/cephadm 2024-03-04T09:04:18.955 DEBUG:teuthology.orchestra.run.smithi190:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-lusov-qdb/1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-03-04T09:04:19.369 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-r--r--. 1 ubuntu ubuntu 766895 Mar 4 09:04 /home/ubuntu/cephtest/cephadm 2024-03-04T09:04:19.369 DEBUG:teuthology.orchestra.run.smithi082:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-03-04T09:04:19.388 DEBUG:teuthology.orchestra.run.smithi102:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-03-04T09:04:19.407 DEBUG:teuthology.orchestra.run.smithi190:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-03-04T09:04:19.443 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd on all hosts... 2024-03-04T09:04:19.443 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd pull 2024-03-04T09:04:19.445 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd pull 2024-03-04T09:04:19.449 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd pull 2024-03-04T09:04:20.263 INFO:teuthology.orchestra.run.smithi082.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd... 2024-03-04T09:04:20.311 INFO:teuthology.orchestra.run.smithi102.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd... 2024-03-04T09:04:20.327 INFO:teuthology.orchestra.run.smithi190.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd... 2024-03-04T09:04:48.169 INFO:teuthology.orchestra.run.smithi190.stdout:{ 2024-03-04T09:04:48.170 INFO:teuthology.orchestra.run.smithi190.stdout: "ceph_version": "ceph version 19.0.0-1739-g1bc250c7 (1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd) squid (dev)", 2024-03-04T09:04:48.170 INFO:teuthology.orchestra.run.smithi190.stdout: "image_id": "f88ffb32aa6a7d5dfdc954d9f096f0c9cc47981d05ec8d117ba859a22d8185ba", 2024-03-04T09:04:48.170 INFO:teuthology.orchestra.run.smithi190.stdout: "repo_digests": [ 2024-03-04T09:04:48.170 INFO:teuthology.orchestra.run.smithi190.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5" 2024-03-04T09:04:48.170 INFO:teuthology.orchestra.run.smithi190.stdout: ] 2024-03-04T09:04:48.170 INFO:teuthology.orchestra.run.smithi190.stdout:} 2024-03-04T09:04:53.652 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-03-04T09:04:53.652 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_version": "ceph version 19.0.0-1739-g1bc250c7 (1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd) squid (dev)", 2024-03-04T09:04:53.652 INFO:teuthology.orchestra.run.smithi102.stdout: "image_id": "f88ffb32aa6a7d5dfdc954d9f096f0c9cc47981d05ec8d117ba859a22d8185ba", 2024-03-04T09:04:53.652 INFO:teuthology.orchestra.run.smithi102.stdout: "repo_digests": [ 2024-03-04T09:04:53.652 INFO:teuthology.orchestra.run.smithi102.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5" 2024-03-04T09:04:53.652 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-03-04T09:04:53.652 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-03-04T09:04:56.060 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-04T09:04:56.061 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_version": "ceph version 19.0.0-1739-g1bc250c7 (1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd) squid (dev)", 2024-03-04T09:04:56.061 INFO:teuthology.orchestra.run.smithi082.stdout: "image_id": "f88ffb32aa6a7d5dfdc954d9f096f0c9cc47981d05ec8d117ba859a22d8185ba", 2024-03-04T09:04:56.061 INFO:teuthology.orchestra.run.smithi082.stdout: "repo_digests": [ 2024-03-04T09:04:56.061 INFO:teuthology.orchestra.run.smithi082.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5" 2024-03-04T09:04:56.061 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-03-04T09:04:56.061 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-04T09:04:56.085 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /etc/ceph 2024-03-04T09:04:56.127 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /etc/ceph 2024-03-04T09:04:56.162 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /etc/ceph 2024-03-04T09:04:56.198 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 777 /etc/ceph 2024-03-04T09:04:56.225 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 777 /etc/ceph 2024-03-04T09:04:56.257 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 777 /etc/ceph 2024-03-04T09:04:56.288 INFO:tasks.cephadm:Writing seed config... 2024-03-04T09:04:56.289 INFO:tasks.cephadm: override: [client] client dirsize rbytes = False 2024-03-04T09:04:56.290 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-03-04T09:04:56.290 INFO:tasks.cephadm: override: [client] debug client = 20 2024-03-04T09:04:56.290 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-03-04T09:04:56.290 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-03-04T09:04:56.290 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-03-04T09:04:56.290 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-03-04T09:04:56.290 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-03-04T09:04:56.290 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-03-04T09:04:56.290 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-03-04T09:04:56.290 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-03-04T09:04:56.290 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-03-04T09:04:56.290 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-03-04T09:04:56.290 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-03-04T09:04:56.290 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-03-04T09:04:56.291 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-03-04T09:04:56.291 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-03-04T09:04:56.291 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-03-04T09:04:56.291 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-03-04T09:04:56.291 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-03-04T09:04:56.291 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-03-04T09:04:56.291 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-03-04T09:04:56.291 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-03-04T09:04:56.291 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-03-04T09:04:56.291 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-03-04T09:04:56.292 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-03-04T09:04:56.292 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-03-04T09:04:56.292 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-03-04T09:04:56.292 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-03-04T09:04:56.292 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-03-04T09:04:56.292 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-03-04T09:04:56.292 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-03-04T09:04:56.292 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-03-04T09:04:56.292 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-03-04T09:04:56.292 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-03-04T09:04:56.292 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-03-04T09:04:56.292 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-03-04T09:04:56.293 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-03-04T09:04:56.293 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-03-04T09:04:56.293 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-03-04T09:04:56.293 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-03-04T09:04:56.293 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-03-04T09:04:56.293 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-03-04T09:04:56.293 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-03-04T09:04:56.293 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-03-04T09:04:56.294 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-03-04T09:04:56.294 DEBUG:teuthology.orchestra.run.smithi082:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-03-04T09:04:56.309 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 2e533fc8-da06-11ee-95c6-87774f69a715 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client dirsize rbytes = False client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_export_ephemeral_random_max = 0.1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-03-04T09:04:56.309 DEBUG:teuthology.orchestra.run.smithi082:mon.a> sudo journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mon.a.service 2024-03-04T09:04:56.351 DEBUG:teuthology.orchestra.run.smithi082:mgr.x> sudo journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mgr.x.service 2024-03-04T09:04:56.394 INFO:tasks.cephadm:Bootstrapping... 2024-03-04T09:04:56.395 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd -v bootstrap --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.82 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-03-04T09:04:56.585 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-03-04T09:04:56.585 INFO:teuthology.orchestra.run.smithi082.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd', '-v', 'bootstrap', '--fsid', '2e533fc8-da06-11ee-95c6-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.82', '--skip-admin-label'] 2024-03-04T09:04:56.610 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stdout 4.9.3-dev 2024-03-04T09:04:56.610 INFO:teuthology.orchestra.run.smithi082.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-03-04T09:04:56.610 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying podman|docker is present... 2024-03-04T09:04:56.634 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stdout 4.9.3-dev 2024-03-04T09:04:56.634 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying lvm2 is present... 2024-03-04T09:04:56.634 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying time synchronization is in place... 2024-03-04T09:04:56.641 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-03-04T09:04:56.641 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-03-04T09:04:56.647 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-03-04T09:04:56.647 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout inactive 2024-03-04T09:04:56.653 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout enabled 2024-03-04T09:04:56.659 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout active 2024-03-04T09:04:56.660 INFO:teuthology.orchestra.run.smithi082.stdout:Unit chronyd.service is enabled and running 2024-03-04T09:04:56.660 INFO:teuthology.orchestra.run.smithi082.stdout:Repeating the final host check... 2024-03-04T09:04:56.682 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stdout 4.9.3-dev 2024-03-04T09:04:56.682 INFO:teuthology.orchestra.run.smithi082.stdout:podman (/bin/podman) version 4.9.3 is present 2024-03-04T09:04:56.683 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl is present 2024-03-04T09:04:56.683 INFO:teuthology.orchestra.run.smithi082.stdout:lvcreate is present 2024-03-04T09:04:56.689 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-03-04T09:04:56.689 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-03-04T09:04:56.694 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-03-04T09:04:56.694 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout inactive 2024-03-04T09:04:56.700 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout enabled 2024-03-04T09:04:56.707 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout active 2024-03-04T09:04:56.707 INFO:teuthology.orchestra.run.smithi082.stdout:Unit chronyd.service is enabled and running 2024-03-04T09:04:56.707 INFO:teuthology.orchestra.run.smithi082.stdout:Host looks OK 2024-03-04T09:04:56.707 INFO:teuthology.orchestra.run.smithi082.stdout:Cluster fsid: 2e533fc8-da06-11ee-95c6-87774f69a715 2024-03-04T09:04:56.707 INFO:teuthology.orchestra.run.smithi082.stdout:Acquiring lock 140633796994672 on /run/cephadm/2e533fc8-da06-11ee-95c6-87774f69a715.lock 2024-03-04T09:04:56.707 INFO:teuthology.orchestra.run.smithi082.stdout:Lock 140633796994672 acquired on /run/cephadm/2e533fc8-da06-11ee-95c6-87774f69a715.lock 2024-03-04T09:04:56.708 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying IP 172.21.15.82 port 3300 ... 2024-03-04T09:04:56.708 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying IP 172.21.15.82 port 6789 ... 2024-03-04T09:04:56.708 INFO:teuthology.orchestra.run.smithi082.stdout:Base mon IP(s) is [172.21.15.82:3300, 172.21.15.82:6789], mon addrv is [v2:172.21.15.82:3300,v1:172.21.15.82:6789] 2024-03-04T09:04:56.711 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.82 metric 100 2024-03-04T09:04:56.711 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.82 metric 100 2024-03-04T09:04:56.714 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-03-04T09:04:56.714 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-03-04T09:04:56.714 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1797sec hoplimit 64 pref medium 2024-03-04T09:04:56.717 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-03-04T09:04:56.717 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-03-04T09:04:56.717 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-03-04T09:04:56.717 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-03-04T09:04:56.717 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2024-03-04T09:04:56.717 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-03-04T09:04:56.717 INFO:teuthology.orchestra.run.smithi082.stdout:Mon IP `172.21.15.82` is in CIDR network `172.21.0.0/20` 2024-03-04T09:04:56.717 INFO:teuthology.orchestra.run.smithi082.stdout:Mon IP `172.21.15.82` is in CIDR network `172.21.0.0/20` 2024-03-04T09:04:56.718 INFO:teuthology.orchestra.run.smithi082.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-03-04T09:04:56.718 INFO:teuthology.orchestra.run.smithi082.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-03-04T09:04:56.718 INFO:teuthology.orchestra.run.smithi082.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd... 2024-03-04T09:04:57.114 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stdout f88ffb32aa6a7d5dfdc954d9f096f0c9cc47981d05ec8d117ba859a22d8185ba 2024-03-04T09:04:57.114 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd... 2024-03-04T09:04:57.114 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Getting image source signatures 2024-03-04T09:04:57.114 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Copying blob sha256:5d74734bfa4d1f8e0a72f8c221d93ca0d3a68fb40764a44763479cacf5cffcb4 2024-03-04T09:04:57.114 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Copying blob sha256:7feca07754707458c3945cf0062cf4dabc512f6d90fe1a9a1370b362b6011124 2024-03-04T09:04:57.114 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Copying config sha256:f88ffb32aa6a7d5dfdc954d9f096f0c9cc47981d05ec8d117ba859a22d8185ba 2024-03-04T09:04:57.114 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Writing manifest to image destination 2024-03-04T09:04:57.985 INFO:teuthology.orchestra.run.smithi082.stdout:ceph: stdout ceph version 19.0.0-1739-g1bc250c7 (1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd) squid (dev) 2024-03-04T09:04:57.985 INFO:teuthology.orchestra.run.smithi082.stdout:Ceph version: ceph version 19.0.0-1739-g1bc250c7 (1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd) squid (dev) 2024-03-04T09:04:57.985 INFO:teuthology.orchestra.run.smithi082.stdout:Extracting ceph user uid/gid from container image... 2024-03-04T09:04:58.890 INFO:teuthology.orchestra.run.smithi082.stdout:stat: stdout 167 167 2024-03-04T09:04:58.891 INFO:teuthology.orchestra.run.smithi082.stdout:Creating initial keys... 2024-03-04T09:04:59.823 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph-authtool: stdout AQC7juVlhCmjDRAA4ZqtNK7SDCmaOEmseiaEYg== 2024-03-04T09:05:07.511 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph-authtool: stdout AQC9juVlxt4fARAAj3nPol7dyfXHFu8pMW2cBQ== 2024-03-04T09:05:12.763 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph-authtool: stdout AQDGjuVlpYU+DxAAhrYajmezLbjdlEXs3nt3cQ== 2024-03-04T09:05:12.764 INFO:teuthology.orchestra.run.smithi082.stdout:Creating initial monmap... 2024-03-04T09:05:13.669 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-03-04T09:05:13.669 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-03-04T09:05:13.669 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 2e533fc8-da06-11ee-95c6-87774f69a715 2024-03-04T09:05:13.670 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-03-04T09:05:13.670 INFO:teuthology.orchestra.run.smithi082.stdout:monmaptool for a [v2:172.21.15.82:3300,v1:172.21.15.82:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-03-04T09:05:13.670 INFO:teuthology.orchestra.run.smithi082.stdout:setting min_mon_release = quincy 2024-03-04T09:05:13.670 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/monmaptool: set fsid to 2e533fc8-da06-11ee-95c6-87774f69a715 2024-03-04T09:05:13.670 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-03-04T09:05:13.670 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:05:13.670 INFO:teuthology.orchestra.run.smithi082.stdout:Creating mon... 2024-03-04T09:05:14.592 INFO:teuthology.orchestra.run.smithi082.stdout:create mon.a on 2024-03-04T09:05:14.799 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-03-04T09:05:15.030 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-03-04T09:05:15.477 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-2e533fc8-da06-11ee-95c6-87774f69a715.target → /etc/systemd/system/ceph-2e533fc8-da06-11ee-95c6-87774f69a715.target. 2024-03-04T09:05:15.478 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-2e533fc8-da06-11ee-95c6-87774f69a715.target → /etc/systemd/system/ceph-2e533fc8-da06-11ee-95c6-87774f69a715.target. 2024-03-04T09:05:15.727 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mon.a 2024-03-04T09:05:15.727 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Failed to reset failed state of unit ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mon.a.service: Unit ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mon.a.service not loaded. 2024-03-04T09:05:15.900 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-2e533fc8-da06-11ee-95c6-87774f69a715.target.wants/ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mon.a.service → /etc/systemd/system/ceph-2e533fc8-da06-11ee-95c6-87774f69a715@.service. 2024-03-04T09:05:16.158 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:16 smithi082 podman[32481]: 2024-03-04 09:05:16.162506013 +0000 UTC m=+0.125316190 container create 0241b877894d0586be3664fbbea1784debc1b658d53d920549d9db9e4100f741 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mon-a, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-lusov-qdb-1bc250c, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, CEPH_POINT_RELEASE=) 2024-03-04T09:05:16.540 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-03-04T09:05:16.541 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout disabled 2024-03-04T09:05:16.547 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-03-04T09:05:16.547 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout inactive 2024-03-04T09:05:16.547 INFO:teuthology.orchestra.run.smithi082.stdout:firewalld.service is not enabled 2024-03-04T09:05:16.547 INFO:teuthology.orchestra.run.smithi082.stdout:Not possible to enable service . firewalld.service is not available 2024-03-04T09:05:16.548 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for mon to start... 2024-03-04T09:05:16.548 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for mon... 2024-03-04T09:05:16.670 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:16 smithi082 podman[32481]: 2024-03-04 09:05:16.417212676 +0000 UTC m=+0.380022854 container init 0241b877894d0586be3664fbbea1784debc1b658d53d920549d9db9e4100f741 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mon-a, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-qdb-1bc250c) 2024-03-04T09:05:16.670 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:16 smithi082 podman[32481]: 2024-03-04 09:05:16.420409634 +0000 UTC m=+0.383219814 container start 0241b877894d0586be3664fbbea1784debc1b658d53d920549d9db9e4100f741 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mon-a, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, RELEASE=wip-lusov-qdb-1bc250c, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-03-04T09:05:16.670 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:16 smithi082 ceph-mon[32501]: mkfs 2e533fc8-da06-11ee-95c6-87774f69a715 2024-03-04T09:05:16.670 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:16 smithi082 ceph-mon[32501]: mon.a is new leader, mons a in quorum (ranks 0) 2024-03-04T09:05:16.670 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:16 smithi082 bash[32481]: 0241b877894d0586be3664fbbea1784debc1b658d53d920549d9db9e4100f741 2024-03-04T09:05:16.670 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:16 smithi082 systemd[1]: Started Ceph mon.a for 2e533fc8-da06-11ee-95c6-87774f69a715. 2024-03-04T09:05:17.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:17 smithi082 ceph-mon[32501]: mon.a is new leader, mons a in quorum (ranks 0) 2024-03-04T09:05:17.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:17 smithi082 ceph-mon[32501]: monmap e1: 1 mons at {a=[v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-04T09:05:17.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:17 smithi082 ceph-mon[32501]: fsmap 2024-03-04T09:05:17.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:17 smithi082 ceph-mon[32501]: osdmap e1: 0 total, 0 up, 0 in 2024-03-04T09:05:17.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:17 smithi082 ceph-mon[32501]: mgrmap e1: no daemons active 2024-03-04T09:05:17.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:17 smithi082 ceph-mon[32501]: from='client.? 172.21.15.82:0/1907620' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-03-04T09:05:19.092 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout cluster: 2024-03-04T09:05:19.093 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout id: 2e533fc8-da06-11ee-95c6-87774f69a715 2024-03-04T09:05:19.093 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-03-04T09:05:19.093 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-03-04T09:05:19.093 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout services: 2024-03-04T09:05:19.093 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.580167s) 2024-03-04T09:05:19.093 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-03-04T09:05:19.093 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-03-04T09:05:19.093 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-03-04T09:05:19.093 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout data: 2024-03-04T09:05:19.093 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-03-04T09:05:19.093 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-03-04T09:05:19.093 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-03-04T09:05:19.094 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout pgs: 2024-03-04T09:05:19.094 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-03-04T09:05:19.094 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:16.991+0000 7f29cbb77700 1 Processor -- start 2024-03-04T09:05:19.094 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:16.991+0000 7f29cbb77700 1 -- start start 2024-03-04T09:05:19.094 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:16.991+0000 7f29cbb77700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29c4107b30 0x7f29c4107f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:05:19.094 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:16.991+0000 7f29cbb77700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c4108520 con 0x7f29c4107b30 2024-03-04T09:05:19.094 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:16.992+0000 7f29c9913700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29c4107b30 0x7f29c4107f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:05:19.094 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:16.992+0000 7f29c9913700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29c4107b30 0x7f29c4107f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42974/0 (socket says 172.21.15.82:42974) 2024-03-04T09:05:19.094 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:16.992+0000 7f29c9913700 1 -- 172.21.15.82:0/978844494 learned_addr learned my addr 172.21.15.82:0/978844494 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:05:19.094 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:16.992+0000 7f29c9913700 1 -- 172.21.15.82:0/978844494 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c4108ce0 con 0x7f29c4107b30 2024-03-04T09:05:19.094 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:16.992+0000 7f29c9913700 1 --2- 172.21.15.82:0/978844494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29c4107b30 0x7f29c4107f50 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f29bc009e80 tx=0x7f29bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9f17ba8d2190c5e server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:05:19.094 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:16.992+0000 7f29c8911700 1 -- 172.21.15.82:0/978844494 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29bc017070 con 0x7f29c4107b30 2024-03-04T09:05:19.094 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:16.992+0000 7f29c8911700 1 -- 172.21.15.82:0/978844494 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29bc003a20 con 0x7f29c4107b30 2024-03-04T09:05:19.095 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:16.992+0000 7f29c8911700 1 -- 172.21.15.82:0/978844494 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29bc003d20 con 0x7f29c4107b30 2024-03-04T09:05:19.095 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:16.993+0000 7f29cbb77700 1 -- 172.21.15.82:0/978844494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29c4107b30 msgr2=0x7f29c4107f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:05:19.095 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:16.993+0000 7f29cbb77700 1 --2- 172.21.15.82:0/978844494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29c4107b30 0x7f29c4107f50 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f29bc009e80 tx=0x7f29bc00b330 comp rx=0 tx=0).stop 2024-03-04T09:05:19.095 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:16.993+0000 7f29cbb77700 1 -- 172.21.15.82:0/978844494 shutdown_connections 2024-03-04T09:05:19.095 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:16.993+0000 7f29cbb77700 1 --2- 172.21.15.82:0/978844494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29c4107b30 0x7f29c4107f50 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:05:19.095 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:16.993+0000 7f29cbb77700 1 -- 172.21.15.82:0/978844494 >> 172.21.15.82:0/978844494 conn(0x7f29c41030f0 msgr2=0x7f29c4105510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:05:19.095 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:16.993+0000 7f29cbb77700 1 -- 172.21.15.82:0/978844494 shutdown_connections 2024-03-04T09:05:19.095 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:16.993+0000 7f29cbb77700 1 -- 172.21.15.82:0/978844494 wait complete. 2024-03-04T09:05:19.095 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:16.993+0000 7f29cbb77700 1 Processor -- start 2024-03-04T09:05:19.095 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:16.994+0000 7f29cbb77700 1 -- start start 2024-03-04T09:05:19.095 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:16.994+0000 7f29cbb77700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29c4107b30 0x7f29c407db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:05:19.095 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:16.994+0000 7f29cbb77700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c4109210 con 0x7f29c4107b30 2024-03-04T09:05:19.095 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:16.994+0000 7f29c9913700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29c4107b30 0x7f29c407db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:05:19.096 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:16.994+0000 7f29c9913700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29c4107b30 0x7f29c407db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42984/0 (socket says 172.21.15.82:42984) 2024-03-04T09:05:19.096 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:16.994+0000 7f29c9913700 1 -- 172.21.15.82:0/1907620 learned_addr learned my addr 172.21.15.82:0/1907620 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:05:19.096 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:16.994+0000 7f29c9913700 1 -- 172.21.15.82:0/1907620 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c407e050 con 0x7f29c4107b30 2024-03-04T09:05:19.096 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:16.994+0000 7f29c9913700 1 --2- 172.21.15.82:0/1907620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29c4107b30 0x7f29c407db10 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f29bc004000 tx=0x7f29bc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:05:19.096 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:16.994+0000 7f29baffd700 1 -- 172.21.15.82:0/1907620 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29bc022020 con 0x7f29c4107b30 2024-03-04T09:05:19.096 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:16.994+0000 7f29baffd700 1 -- 172.21.15.82:0/1907620 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29bc018040 con 0x7f29c4107b30 2024-03-04T09:05:19.096 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:16.994+0000 7f29cbb77700 1 -- 172.21.15.82:0/1907620 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29c407c240 con 0x7f29c4107b30 2024-03-04T09:05:19.096 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:16.994+0000 7f29baffd700 1 -- 172.21.15.82:0/1907620 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29bc017070 con 0x7f29c4107b30 2024-03-04T09:05:19.096 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:16.994+0000 7f29cbb77700 1 -- 172.21.15.82:0/1907620 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29c407c780 con 0x7f29c4107b30 2024-03-04T09:05:19.096 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:16.995+0000 7f29baffd700 1 -- 172.21.15.82:0/1907620 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f29bc025020 con 0x7f29c4107b30 2024-03-04T09:05:19.096 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:16.995+0000 7f29baffd700 1 -- 172.21.15.82:0/1907620 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f29bc00f050 con 0x7f29c4107b30 2024-03-04T09:05:19.096 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:16.995+0000 7f29cbb77700 1 -- 172.21.15.82:0/1907620 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29c40636f0 con 0x7f29c4107b30 2024-03-04T09:05:19.096 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:16.998+0000 7f29baffd700 1 -- 172.21.15.82:0/1907620 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f29bc02c030 con 0x7f29c4107b30 2024-03-04T09:05:19.097 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:17.066+0000 7f29cbb77700 1 -- 172.21.15.82:0/1907620 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f29c4194920 con 0x7f29c4107b30 2024-03-04T09:05:19.097 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:17.066+0000 7f29baffd700 1 -- 172.21.15.82:0/1907620 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+317 (secure 0 0 0) 0x7f29bc012700 con 0x7f29c4107b30 2024-03-04T09:05:19.097 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:17.067+0000 7f29cbb77700 1 -- 172.21.15.82:0/1907620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29c4107b30 msgr2=0x7f29c407db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:05:19.097 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:17.067+0000 7f29cbb77700 1 --2- 172.21.15.82:0/1907620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29c4107b30 0x7f29c407db10 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f29bc004000 tx=0x7f29bc004ad0 comp rx=0 tx=0).stop 2024-03-04T09:05:19.097 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:17.067+0000 7f29cbb77700 1 -- 172.21.15.82:0/1907620 shutdown_connections 2024-03-04T09:05:19.097 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:17.067+0000 7f29cbb77700 1 --2- 172.21.15.82:0/1907620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29c4107b30 0x7f29c407db10 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:05:19.097 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:17.067+0000 7f29cbb77700 1 -- 172.21.15.82:0/1907620 >> 172.21.15.82:0/1907620 conn(0x7f29c41030f0 msgr2=0x7f29c4191d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:05:19.097 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:17.067+0000 7f29cbb77700 1 -- 172.21.15.82:0/1907620 shutdown_connections 2024-03-04T09:05:19.097 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:17.067+0000 7f29cbb77700 1 -- 172.21.15.82:0/1907620 wait complete. 2024-03-04T09:05:19.097 INFO:teuthology.orchestra.run.smithi082.stdout:mon is available 2024-03-04T09:05:19.097 INFO:teuthology.orchestra.run.smithi082.stdout:Assimilating anything we can from ceph.conf... 2024-03-04T09:05:19.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:19 smithi082 ceph-mon[32501]: from='client.? 172.21.15.82:0/3199912357' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-03-04T09:05:19.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:19 smithi082 ceph-mon[32501]: from='client.? 172.21.15.82:0/3199912357' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-03-04T09:05:20.164 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-03-04T09:05:20.164 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout [global] 2024-03-04T09:05:20.164 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout fsid = 2e533fc8-da06-11ee-95c6-87774f69a715 2024-03-04T09:05:20.164 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.82:3300,v1:172.21.15.82:6789] 2024-03-04T09:05:20.164 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-03-04T09:05:20.164 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-03-04T09:05:20.164 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-03-04T09:05:20.164 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-03-04T09:05:20.164 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-03-04T09:05:20.164 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout [mgr] 2024-03-04T09:05:20.164 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-03-04T09:05:20.164 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-03-04T09:05:20.164 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout [osd] 2024-03-04T09:05:20.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-03-04T09:05:20.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-03-04T09:05:20.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-03-04T09:05:20.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-03-04T09:05:20.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-03-04T09:05:20.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:19.541+0000 7f8cd1872700 1 Processor -- start 2024-03-04T09:05:20.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:19.541+0000 7f8cd1872700 1 -- start start 2024-03-04T09:05:20.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:19.541+0000 7f8cd1872700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ccc107b30 0x7f8ccc107f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:05:20.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:19.541+0000 7f8cd1872700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc108520 con 0x7f8ccc107b30 2024-03-04T09:05:20.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:19.541+0000 7f8ccaffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ccc107b30 0x7f8ccc107f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:05:20.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:19.541+0000 7f8ccaffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ccc107b30 0x7f8ccc107f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42988/0 (socket says 172.21.15.82:42988) 2024-03-04T09:05:20.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:19.541+0000 7f8ccaffd700 1 -- 172.21.15.82:0/4145141393 learned_addr learned my addr 172.21.15.82:0/4145141393 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:05:20.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:19.541+0000 7f8ccaffd700 1 -- 172.21.15.82:0/4145141393 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ccc108ce0 con 0x7f8ccc107b30 2024-03-04T09:05:20.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:19.542+0000 7f8ccaffd700 1 --2- 172.21.15.82:0/4145141393 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ccc107b30 0x7f8ccc107f50 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc0098a0 tx=0x7f8cbc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcfd9afb67a154d7 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:05:20.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:19.542+0000 7f8cc9ffb700 1 -- 172.21.15.82:0/4145141393 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8cbc004160 con 0x7f8ccc107b30 2024-03-04T09:05:20.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:19.542+0000 7f8cc9ffb700 1 -- 172.21.15.82:0/4145141393 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cbc004300 con 0x7f8ccc107b30 2024-03-04T09:05:20.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:19.542+0000 7f8cc9ffb700 1 -- 172.21.15.82:0/4145141393 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8cbc0036a0 con 0x7f8ccc107b30 2024-03-04T09:05:20.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:19.542+0000 7f8cd1872700 1 -- 172.21.15.82:0/4145141393 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ccc107b30 msgr2=0x7f8ccc107f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:05:20.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:19.542+0000 7f8cd1872700 1 --2- 172.21.15.82:0/4145141393 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ccc107b30 0x7f8ccc107f50 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc0098a0 tx=0x7f8cbc009bb0 comp rx=0 tx=0).stop 2024-03-04T09:05:20.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:19.542+0000 7f8cd1872700 1 -- 172.21.15.82:0/4145141393 shutdown_connections 2024-03-04T09:05:20.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:19.542+0000 7f8cd1872700 1 --2- 172.21.15.82:0/4145141393 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ccc107b30 0x7f8ccc107f50 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:05:20.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:19.542+0000 7f8cd1872700 1 -- 172.21.15.82:0/4145141393 >> 172.21.15.82:0/4145141393 conn(0x7f8ccc1030f0 msgr2=0x7f8ccc105510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:05:20.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:19.543+0000 7f8cd1872700 1 -- 172.21.15.82:0/4145141393 shutdown_connections 2024-03-04T09:05:20.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:19.543+0000 7f8cd1872700 1 -- 172.21.15.82:0/4145141393 wait complete. 2024-03-04T09:05:20.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:19.543+0000 7f8cd1872700 1 Processor -- start 2024-03-04T09:05:20.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:19.543+0000 7f8cd1872700 1 -- start start 2024-03-04T09:05:20.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:19.543+0000 7f8cd1872700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ccc107b30 0x7f8ccc19b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:05:20.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:19.543+0000 7f8cd1872700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc109210 con 0x7f8ccc107b30 2024-03-04T09:05:20.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:19.544+0000 7f8ccaffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ccc107b30 0x7f8ccc19b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:05:20.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:19.544+0000 7f8ccaffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ccc107b30 0x7f8ccc19b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42998/0 (socket says 172.21.15.82:42998) 2024-03-04T09:05:20.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:19.544+0000 7f8ccaffd700 1 -- 172.21.15.82:0/3199912357 learned_addr learned my addr 172.21.15.82:0/3199912357 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:05:20.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:19.544+0000 7f8ccaffd700 1 -- 172.21.15.82:0/3199912357 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ccc19b6f0 con 0x7f8ccc107b30 2024-03-04T09:05:20.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:19.544+0000 7f8ccaffd700 1 --2- 172.21.15.82:0/3199912357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ccc107b30 0x7f8ccc19b1b0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc000c00 tx=0x7f8cbc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:05:20.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:19.544+0000 7f8cd0870700 1 -- 172.21.15.82:0/3199912357 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8cbc003db0 con 0x7f8ccc107b30 2024-03-04T09:05:20.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:19.544+0000 7f8cd0870700 1 -- 172.21.15.82:0/3199912357 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cbc011630 con 0x7f8ccc107b30 2024-03-04T09:05:20.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:19.544+0000 7f8cd1872700 1 -- 172.21.15.82:0/3199912357 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ccc19b980 con 0x7f8ccc107b30 2024-03-04T09:05:20.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:19.544+0000 7f8cd0870700 1 -- 172.21.15.82:0/3199912357 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8cbc011950 con 0x7f8ccc107b30 2024-03-04T09:05:20.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:19.544+0000 7f8cd1872700 1 -- 172.21.15.82:0/3199912357 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ccc19e670 con 0x7f8ccc107b30 2024-03-04T09:05:20.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:19.544+0000 7f8cd0870700 1 -- 172.21.15.82:0/3199912357 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f8cbc01a460 con 0x7f8ccc107b30 2024-03-04T09:05:20.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:19.544+0000 7f8cd0870700 1 -- 172.21.15.82:0/3199912357 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f8cbc01baf0 con 0x7f8ccc107b30 2024-03-04T09:05:20.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:19.545+0000 7f8cd1872700 1 -- 172.21.15.82:0/3199912357 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ccc0636f0 con 0x7f8ccc107b30 2024-03-04T09:05:20.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:19.547+0000 7f8cd0870700 1 -- 172.21.15.82:0/3199912357 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f8cbc031020 con 0x7f8ccc107b30 2024-03-04T09:05:20.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:19.614+0000 7f8cd1872700 1 -- 172.21.15.82:0/3199912357 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f8ccc19be60 con 0x7f8ccc107b30 2024-03-04T09:05:20.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:19.617+0000 7f8cd0870700 1 -- 172.21.15.82:0/3199912357 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7f8ccc19be60 con 0x7f8ccc107b30 2024-03-04T09:05:20.168 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:19.617+0000 7f8cd0870700 1 -- 172.21.15.82:0/3199912357 <== mon.0 v2:172.21.15.82:3300/0 8 ==== config(27 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8cbc004260 con 0x7f8ccc107b30 2024-03-04T09:05:20.168 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:19.618+0000 7f8cd1872700 1 -- 172.21.15.82:0/3199912357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ccc107b30 msgr2=0x7f8ccc19b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:05:20.168 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:19.618+0000 7f8cd1872700 1 --2- 172.21.15.82:0/3199912357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ccc107b30 0x7f8ccc19b1b0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc000c00 tx=0x7f8cbc004750 comp rx=0 tx=0).stop 2024-03-04T09:05:20.168 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:19.618+0000 7f8cd1872700 1 -- 172.21.15.82:0/3199912357 shutdown_connections 2024-03-04T09:05:20.168 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:19.618+0000 7f8cd1872700 1 --2- 172.21.15.82:0/3199912357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ccc107b30 0x7f8ccc19b1b0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:05:20.168 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:19.618+0000 7f8cd1872700 1 -- 172.21.15.82:0/3199912357 >> 172.21.15.82:0/3199912357 conn(0x7f8ccc1030f0 msgr2=0x7f8ccc191d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:05:20.168 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:19.618+0000 7f8cd1872700 1 -- 172.21.15.82:0/3199912357 shutdown_connections 2024-03-04T09:05:20.168 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:19.618+0000 7f8cd1872700 1 -- 172.21.15.82:0/3199912357 wait complete. 2024-03-04T09:05:20.168 INFO:teuthology.orchestra.run.smithi082.stdout:Generating new minimal ceph.conf... 2024-03-04T09:05:21.066 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:20 smithi082 ceph-mon[32501]: from='client.? 172.21.15.82:0/3380458060' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:05:21.318 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:20.695+0000 7f69d76fa700 1 Processor -- start 2024-03-04T09:05:21.319 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:20.695+0000 7f69d76fa700 1 -- start start 2024-03-04T09:05:21.319 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:20.695+0000 7f69d76fa700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69d0108590 0x7f69d010a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:05:21.319 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:20.695+0000 7f69d76fa700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d007be10 con 0x7f69d0108590 2024-03-04T09:05:21.319 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:20.696+0000 7f69d5496700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69d0108590 0x7f69d010a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:05:21.319 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:20.696+0000 7f69d5496700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69d0108590 0x7f69d010a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43014/0 (socket says 172.21.15.82:43014) 2024-03-04T09:05:21.319 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:20.696+0000 7f69d5496700 1 -- 172.21.15.82:0/2200596805 learned_addr learned my addr 172.21.15.82:0/2200596805 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:05:21.319 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:20.696+0000 7f69d5496700 1 -- 172.21.15.82:0/2200596805 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d010aec0 con 0x7f69d0108590 2024-03-04T09:05:21.319 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:20.696+0000 7f69d5496700 1 --2- 172.21.15.82:0/2200596805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69d0108590 0x7f69d010a980 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f69cc0098a0 tx=0x7f69cc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63cdc8e0a748a103 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:05:21.319 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:20.696+0000 7f69c7fff700 1 -- 172.21.15.82:0/2200596805 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f69cc004160 con 0x7f69d0108590 2024-03-04T09:05:21.319 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:20.696+0000 7f69c7fff700 1 -- 172.21.15.82:0/2200596805 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f69cc004300 con 0x7f69d0108590 2024-03-04T09:05:21.319 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:20.696+0000 7f69c7fff700 1 -- 172.21.15.82:0/2200596805 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f69cc011b40 con 0x7f69d0108590 2024-03-04T09:05:21.319 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:20.697+0000 7f69d76fa700 1 -- 172.21.15.82:0/2200596805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69d0108590 msgr2=0x7f69d010a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:05:21.319 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:20.697+0000 7f69d76fa700 1 --2- 172.21.15.82:0/2200596805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69d0108590 0x7f69d010a980 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f69cc0098a0 tx=0x7f69cc009bb0 comp rx=0 tx=0).stop 2024-03-04T09:05:21.320 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:20.697+0000 7f69d76fa700 1 -- 172.21.15.82:0/2200596805 shutdown_connections 2024-03-04T09:05:21.320 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:20.697+0000 7f69d76fa700 1 --2- 172.21.15.82:0/2200596805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69d0108590 0x7f69d010a980 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:05:21.320 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:20.697+0000 7f69d76fa700 1 -- 172.21.15.82:0/2200596805 >> 172.21.15.82:0/2200596805 conn(0x7f69d0102000 msgr2=0x7f69d0104420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:05:21.320 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:20.697+0000 7f69d76fa700 1 -- 172.21.15.82:0/2200596805 shutdown_connections 2024-03-04T09:05:21.320 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:20.697+0000 7f69d76fa700 1 -- 172.21.15.82:0/2200596805 wait complete. 2024-03-04T09:05:21.320 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:20.697+0000 7f69d76fa700 1 Processor -- start 2024-03-04T09:05:21.320 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:20.697+0000 7f69d76fa700 1 -- start start 2024-03-04T09:05:21.320 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:20.697+0000 7f69d76fa700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69d0108590 0x7f69d019b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:05:21.320 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:20.698+0000 7f69d76fa700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d010be70 con 0x7f69d0108590 2024-03-04T09:05:21.320 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:20.698+0000 7f69d5496700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69d0108590 0x7f69d019b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:05:21.320 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:20.698+0000 7f69d5496700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69d0108590 0x7f69d019b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43018/0 (socket says 172.21.15.82:43018) 2024-03-04T09:05:21.320 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:20.698+0000 7f69d5496700 1 -- 172.21.15.82:0/3380458060 learned_addr learned my addr 172.21.15.82:0/3380458060 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:05:21.320 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:20.698+0000 7f69d5496700 1 -- 172.21.15.82:0/3380458060 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d019bef0 con 0x7f69d0108590 2024-03-04T09:05:21.321 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:20.698+0000 7f69d5496700 1 --2- 172.21.15.82:0/3380458060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69d0108590 0x7f69d019b9b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f69cc006af0 tx=0x7f69cc011c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:05:21.321 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:20.698+0000 7f69c67fc700 1 -- 172.21.15.82:0/3380458060 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f69cc003970 con 0x7f69d0108590 2024-03-04T09:05:21.321 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:20.698+0000 7f69c67fc700 1 -- 172.21.15.82:0/3380458060 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f69cc003b10 con 0x7f69d0108590 2024-03-04T09:05:21.321 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:20.698+0000 7f69d76fa700 1 -- 172.21.15.82:0/3380458060 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69d019c180 con 0x7f69d0108590 2024-03-04T09:05:21.321 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:20.698+0000 7f69c67fc700 1 -- 172.21.15.82:0/3380458060 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f69cc0196c0 con 0x7f69d0108590 2024-03-04T09:05:21.321 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:20.698+0000 7f69d76fa700 1 -- 172.21.15.82:0/3380458060 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69d019ee70 con 0x7f69d0108590 2024-03-04T09:05:21.321 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:20.698+0000 7f69c67fc700 1 -- 172.21.15.82:0/3380458060 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f69cc02d430 con 0x7f69d0108590 2024-03-04T09:05:21.321 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:20.698+0000 7f69c67fc700 1 -- 172.21.15.82:0/3380458060 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f69cc0247c0 con 0x7f69d0108590 2024-03-04T09:05:21.321 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:20.699+0000 7f69d76fa700 1 -- 172.21.15.82:0/3380458060 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69d00636f0 con 0x7f69d0108590 2024-03-04T09:05:21.321 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:20.701+0000 7f69c67fc700 1 -- 172.21.15.82:0/3380458060 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f69cc004300 con 0x7f69d0108590 2024-03-04T09:05:21.321 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:20.771+0000 7f69d76fa700 1 -- 172.21.15.82:0/3380458060 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f69d019f420 con 0x7f69d0108590 2024-03-04T09:05:21.321 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:20.771+0000 7f69c67fc700 1 -- 172.21.15.82:0/3380458060 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f69cc003cc0 con 0x7f69d0108590 2024-03-04T09:05:21.321 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:20.772+0000 7f69d76fa700 1 -- 172.21.15.82:0/3380458060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69d0108590 msgr2=0x7f69d019b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:05:21.321 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:20.772+0000 7f69d76fa700 1 --2- 172.21.15.82:0/3380458060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69d0108590 0x7f69d019b9b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f69cc006af0 tx=0x7f69cc011c00 comp rx=0 tx=0).stop 2024-03-04T09:05:21.322 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:20.772+0000 7f69d76fa700 1 -- 172.21.15.82:0/3380458060 shutdown_connections 2024-03-04T09:05:21.322 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:20.772+0000 7f69d76fa700 1 --2- 172.21.15.82:0/3380458060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69d0108590 0x7f69d019b9b0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:05:21.322 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:20.772+0000 7f69d76fa700 1 -- 172.21.15.82:0/3380458060 >> 172.21.15.82:0/3380458060 conn(0x7f69d0102000 msgr2=0x7f69d0102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:05:21.322 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:20.772+0000 7f69d76fa700 1 -- 172.21.15.82:0/3380458060 shutdown_connections 2024-03-04T09:05:21.322 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:20.772+0000 7f69d76fa700 1 -- 172.21.15.82:0/3380458060 wait complete. 2024-03-04T09:05:21.322 INFO:teuthology.orchestra.run.smithi082.stdout:Restarting the monitor... 2024-03-04T09:05:21.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:21 smithi082 systemd[1]: Stopping Ceph mon.a for 2e533fc8-da06-11ee-95c6-87774f69a715... 2024-03-04T09:05:21.956 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:21 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mon-a[32496]: 2024-03-04T09:05:21.594+0000 7f65d0593700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T09:05:21.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:21 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mon-a[32496]: 2024-03-04T09:05:21.594+0000 7f65d0593700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-03-04T09:05:21.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:21 smithi082 podman[32749]: 2024-03-04 09:05:21.68687266 +0000 UTC m=+0.203263330 container died 0241b877894d0586be3664fbbea1784debc1b658d53d920549d9db9e4100f741 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-lusov-qdb-1bc250c) 2024-03-04T09:05:22.307 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 podman[32749]: 2024-03-04 09:05:22.06092232 +0000 UTC m=+0.577312983 container cleanup 0241b877894d0586be3664fbbea1784debc1b658d53d920549d9db9e4100f741 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mon-a, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-qdb-1bc250c) 2024-03-04T09:05:22.307 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 bash[32749]: ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mon-a 2024-03-04T09:05:22.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 podman[32762]: 2024-03-04 09:05:22.311866838 +0000 UTC m=+0.622308516 container remove 0241b877894d0586be3664fbbea1784debc1b658d53d920549d9db9e4100f741 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mon-a, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_CLEAN=True, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.license=GPLv2) 2024-03-04T09:05:22.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 systemd[1]: ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mon.a.service: Deactivated successfully. 2024-03-04T09:05:22.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 systemd[1]: Stopped Ceph mon.a for 2e533fc8-da06-11ee-95c6-87774f69a715. 2024-03-04T09:05:22.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 systemd[1]: Starting Ceph mon.a for 2e533fc8-da06-11ee-95c6-87774f69a715... 2024-03-04T09:05:22.944 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 podman[32860]: 2024-03-04 09:05:22.671164829 +0000 UTC m=+0.107880724 container create 938c8db3694aaa7fc4a1414b02079a2e6b04d42e0b295ad381b2be9e145d3544 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mon-a, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-qdb-1bc250c) 2024-03-04T09:05:22.944 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 podman[32860]: 2024-03-04 09:05:22.582028865 +0000 UTC m=+0.018744725 image pull f88ffb32aa6a7d5dfdc954d9f096f0c9cc47981d05ec8d117ba859a22d8185ba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd 2024-03-04T09:05:22.944 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 podman[32860]: 2024-03-04 09:05:22.865193828 +0000 UTC m=+0.301909687 container init 938c8db3694aaa7fc4a1414b02079a2e6b04d42e0b295ad381b2be9e145d3544 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mon-a, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-03-04T09:05:22.944 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 podman[32860]: 2024-03-04 09:05:22.868032925 +0000 UTC m=+0.304748778 container start 938c8db3694aaa7fc4a1414b02079a2e6b04d42e0b295ad381b2be9e145d3544 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mon-a, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-lusov-qdb-1bc250c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-03-04T09:05:22.944 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: set uid:gid to 167:167 (ceph:ceph) 2024-03-04T09:05:22.944 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: ceph version 19.0.0-1739-g1bc250c7 (1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd) squid (dev), process ceph-mon, pid 2 2024-03-04T09:05:22.944 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: pidfile_write: ignore empty --pid-file 2024-03-04T09:05:22.944 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: load: jerasure load: lrc 2024-03-04T09:05:22.944 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: RocksDB version: 7.9.2 2024-03-04T09:05:22.944 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Git sha 0 2024-03-04T09:05:22.944 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Compile date 2024-03-03 23:16:35 2024-03-04T09:05:22.945 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: DB SUMMARY 2024-03-04T09:05:22.945 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: DB Session ID: BOCKXO8J9VGWL4ULKBOK 2024-03-04T09:05:22.945 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: CURRENT file: CURRENT 2024-03-04T09:05:22.945 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: IDENTITY file: IDENTITY 2024-03-04T09:05:22.945 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-03-04T09:05:22.945 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-03-04T09:05:22.945 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 100262 ; 2024-03-04T09:05:22.945 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.error_if_exists: 0 2024-03-04T09:05:22.946 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.create_if_missing: 0 2024-03-04T09:05:22.947 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.paranoid_checks: 1 2024-03-04T09:05:22.947 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.flush_verify_memtable_count: 1 2024-03-04T09:05:22.947 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-03-04T09:05:22.947 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-03-04T09:05:22.947 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.env: 0x5593373e3b20 2024-03-04T09:05:22.947 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.fs: PosixFileSystem 2024-03-04T09:05:22.947 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.info_log: 0x559338895920 2024-03-04T09:05:22.947 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.max_file_opening_threads: 16 2024-03-04T09:05:22.947 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.statistics: (nil) 2024-03-04T09:05:22.947 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.use_fsync: 0 2024-03-04T09:05:22.947 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.max_log_file_size: 0 2024-03-04T09:05:22.947 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-04T09:05:22.947 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.log_file_time_to_roll: 0 2024-03-04T09:05:22.947 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.keep_log_file_num: 1000 2024-03-04T09:05:22.947 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.recycle_log_file_num: 0 2024-03-04T09:05:22.948 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.allow_fallocate: 1 2024-03-04T09:05:22.948 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.allow_mmap_reads: 0 2024-03-04T09:05:22.948 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.allow_mmap_writes: 0 2024-03-04T09:05:22.948 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.use_direct_reads: 0 2024-03-04T09:05:22.948 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-04T09:05:22.948 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.create_missing_column_families: 0 2024-03-04T09:05:22.948 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.db_log_dir: 2024-03-04T09:05:22.948 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.wal_dir: 2024-03-04T09:05:22.948 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.table_cache_numshardbits: 6 2024-03-04T09:05:22.948 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.WAL_ttl_seconds: 0 2024-03-04T09:05:22.948 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.WAL_size_limit_MB: 0 2024-03-04T09:05:22.948 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-04T09:05:22.948 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-04T09:05:22.948 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.is_fd_close_on_exec: 1 2024-03-04T09:05:22.949 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.advise_random_on_open: 1 2024-03-04T09:05:22.949 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.db_write_buffer_size: 0 2024-03-04T09:05:22.949 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.write_buffer_manager: 0x559338869400 2024-03-04T09:05:22.949 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-04T09:05:22.949 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-04T09:05:22.949 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.use_adaptive_mutex: 0 2024-03-04T09:05:22.949 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.rate_limiter: (nil) 2024-03-04T09:05:22.949 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-04T09:05:22.949 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.wal_recovery_mode: 2 2024-03-04T09:05:22.949 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.enable_thread_tracking: 0 2024-03-04T09:05:22.949 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.enable_pipelined_write: 0 2024-03-04T09:05:22.949 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.unordered_write: 0 2024-03-04T09:05:22.949 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-04T09:05:22.949 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-04T09:05:22.949 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-04T09:05:22.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-04T09:05:22.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.row_cache: None 2024-03-04T09:05:22.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.wal_filter: None 2024-03-04T09:05:22.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-04T09:05:22.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.allow_ingest_behind: 0 2024-03-04T09:05:22.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.two_write_queues: 0 2024-03-04T09:05:22.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.manual_wal_flush: 0 2024-03-04T09:05:22.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.wal_compression: 0 2024-03-04T09:05:22.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.atomic_flush: 0 2024-03-04T09:05:22.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-04T09:05:22.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.persist_stats_to_disk: 0 2024-03-04T09:05:22.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.write_dbid_to_manifest: 0 2024-03-04T09:05:22.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.log_readahead_size: 0 2024-03-04T09:05:22.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-03-04T09:05:22.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.best_efforts_recovery: 0 2024-03-04T09:05:22.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-03-04T09:05:22.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-03-04T09:05:22.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.allow_data_in_errors: 0 2024-03-04T09:05:22.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.db_host_id: __hostname__ 2024-03-04T09:05:22.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.enforce_single_del_contracts: true 2024-03-04T09:05:22.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.max_background_jobs: 2 2024-03-04T09:05:22.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.max_background_compactions: -1 2024-03-04T09:05:22.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.max_subcompactions: 1 2024-03-04T09:05:22.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-04T09:05:22.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-04T09:05:22.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.delayed_write_rate : 16777216 2024-03-04T09:05:22.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.max_total_wal_size: 0 2024-03-04T09:05:22.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-04T09:05:22.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.stats_dump_period_sec: 600 2024-03-04T09:05:22.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.stats_persist_period_sec: 600 2024-03-04T09:05:22.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-04T09:05:22.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.max_open_files: -1 2024-03-04T09:05:22.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.bytes_per_sync: 0 2024-03-04T09:05:22.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.wal_bytes_per_sync: 0 2024-03-04T09:05:22.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.strict_bytes_per_sync: 0 2024-03-04T09:05:22.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.compaction_readahead_size: 0 2024-03-04T09:05:22.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.max_background_flushes: -1 2024-03-04T09:05:22.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Compression algorithms supported: 2024-03-04T09:05:22.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-04T09:05:22.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: kZSTD supported: 0 2024-03-04T09:05:22.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: kXpressCompression supported: 0 2024-03-04T09:05:22.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: kLZ4HCCompression supported: 1 2024-03-04T09:05:22.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: kZlibCompression supported: 1 2024-03-04T09:05:22.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: kSnappyCompression supported: 1 2024-03-04T09:05:22.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: kLZ4Compression supported: 1 2024-03-04T09:05:22.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: kBZip2Compression supported: 0 2024-03-04T09:05:22.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Fast CRC32 supported: Supported on x86 2024-03-04T09:05:22.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: DMutex implementation: pthread_mutex_t 2024-03-04T09:05:22.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-03-04T09:05:22.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-03-04T09:05:22.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-04T09:05:22.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.merge_operator: 2024-03-04T09:05:22.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.compaction_filter: None 2024-03-04T09:05:22.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.compaction_filter_factory: None 2024-03-04T09:05:22.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.sst_partitioner_factory: None 2024-03-04T09:05:22.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.memtable_factory: SkipListFactory 2024-03-04T09:05:22.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.table_factory: BlockBasedTable 2024-03-04T09:05:22.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x559338895a20) 2024-03-04T09:05:22.953 INFO:journalctl@ceph.mon.a.smithi082.stdout: cache_index_and_filter_blocks: 1 2024-03-04T09:05:22.953 INFO:journalctl@ceph.mon.a.smithi082.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-03-04T09:05:22.954 INFO:journalctl@ceph.mon.a.smithi082.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-04T09:05:22.954 INFO:journalctl@ceph.mon.a.smithi082.stdout: pin_top_level_index_and_filter: 1 2024-03-04T09:05:22.954 INFO:journalctl@ceph.mon.a.smithi082.stdout: index_type: 0 2024-03-04T09:05:22.954 INFO:journalctl@ceph.mon.a.smithi082.stdout: data_block_index_type: 0 2024-03-04T09:05:22.954 INFO:journalctl@ceph.mon.a.smithi082.stdout: index_shortening: 1 2024-03-04T09:05:22.954 INFO:journalctl@ceph.mon.a.smithi082.stdout: data_block_hash_table_util_ratio: 0.750000 2024-03-04T09:05:22.954 INFO:journalctl@ceph.mon.a.smithi082.stdout: checksum: 4 2024-03-04T09:05:22.954 INFO:journalctl@ceph.mon.a.smithi082.stdout: no_block_cache: 0 2024-03-04T09:05:22.954 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_cache: 0x559338899090 2024-03-04T09:05:22.954 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_cache_name: BinnedLRUCache 2024-03-04T09:05:22.954 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_cache_options: 2024-03-04T09:05:22.954 INFO:journalctl@ceph.mon.a.smithi082.stdout: capacity : 536870912 2024-03-04T09:05:22.954 INFO:journalctl@ceph.mon.a.smithi082.stdout: num_shard_bits : 4 2024-03-04T09:05:22.954 INFO:journalctl@ceph.mon.a.smithi082.stdout: strict_capacity_limit : 0 2024-03-04T09:05:22.954 INFO:journalctl@ceph.mon.a.smithi082.stdout: high_pri_pool_ratio: 0.000 2024-03-04T09:05:22.954 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_cache_compressed: (nil) 2024-03-04T09:05:22.955 INFO:journalctl@ceph.mon.a.smithi082.stdout: persistent_cache: (nil) 2024-03-04T09:05:22.955 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_size: 4096 2024-03-04T09:05:22.955 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_size_deviation: 10 2024-03-04T09:05:22.955 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_restart_interval: 16 2024-03-04T09:05:22.955 INFO:journalctl@ceph.mon.a.smithi082.stdout: index_block_restart_interval: 1 2024-03-04T09:05:22.955 INFO:journalctl@ceph.mon.a.smithi082.stdout: metadata_block_size: 4096 2024-03-04T09:05:22.955 INFO:journalctl@ceph.mon.a.smithi082.stdout: partition_filters: 0 2024-03-04T09:05:22.955 INFO:journalctl@ceph.mon.a.smithi082.stdout: use_delta_encoding: 1 2024-03-04T09:05:22.955 INFO:journalctl@ceph.mon.a.smithi082.stdout: filter_policy: bloomfilter 2024-03-04T09:05:22.955 INFO:journalctl@ceph.mon.a.smithi082.stdout: whole_key_filtering: 1 2024-03-04T09:05:22.955 INFO:journalctl@ceph.mon.a.smithi082.stdout: verify_compression: 0 2024-03-04T09:05:22.955 INFO:journalctl@ceph.mon.a.smithi082.stdout: read_amp_bytes_per_bit: 0 2024-03-04T09:05:22.955 INFO:journalctl@ceph.mon.a.smithi082.stdout: format_version: 5 2024-03-04T09:05:22.956 INFO:journalctl@ceph.mon.a.smithi082.stdout: enable_index_compression: 1 2024-03-04T09:05:22.956 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_align: 0 2024-03-04T09:05:22.956 INFO:journalctl@ceph.mon.a.smithi082.stdout: max_auto_readahead_size: 262144 2024-03-04T09:05:22.956 INFO:journalctl@ceph.mon.a.smithi082.stdout: prepopulate_block_cache: 0 2024-03-04T09:05:22.956 INFO:journalctl@ceph.mon.a.smithi082.stdout: initial_auto_readahead_size: 8192 2024-03-04T09:05:22.956 INFO:journalctl@ceph.mon.a.smithi082.stdout: num_file_reads_for_auto_readahead: 2 2024-03-04T09:05:22.956 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.write_buffer_size: 33554432 2024-03-04T09:05:22.956 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.max_write_buffer_number: 2 2024-03-04T09:05:22.956 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.compression: NoCompression 2024-03-04T09:05:22.956 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.bottommost_compression: Disabled 2024-03-04T09:05:22.956 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.prefix_extractor: nullptr 2024-03-04T09:05:22.956 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-04T09:05:22.956 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.num_levels: 7 2024-03-04T09:05:22.956 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-04T09:05:22.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-04T09:05:22.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-04T09:05:22.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-04T09:05:22.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-04T09:05:22.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-04T09:05:22.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-04T09:05:22.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-04T09:05:22.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-03-04T09:05:22.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-04T09:05:22.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-03-04T09:05:22.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-03-04T09:05:22.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.compression_opts.window_bits: -14 2024-03-04T09:05:22.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.compression_opts.level: 32767 2024-03-04T09:05:22.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.compression_opts.strategy: 0 2024-03-04T09:05:22.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-04T09:05:22.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-04T09:05:22.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-03-04T09:05:22.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-03-04T09:05:22.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.compression_opts.enabled: false 2024-03-04T09:05:22.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-03-04T09:05:22.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-04T09:05:22.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-04T09:05:22.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-04T09:05:22.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.target_file_size_base: 67108864 2024-03-04T09:05:22.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.target_file_size_multiplier: 1 2024-03-04T09:05:22.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-04T09:05:22.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-04T09:05:22.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-04T09:05:22.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-04T09:05:22.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-04T09:05:22.959 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-04T09:05:22.959 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-04T09:05:22.959 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-04T09:05:22.959 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-04T09:05:22.959 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-04T09:05:22.959 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-04T09:05:22.959 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-04T09:05:22.959 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-03-04T09:05:22.959 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.arena_block_size: 1048576 2024-03-04T09:05:22.959 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-04T09:05:22.959 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-04T09:05:22.959 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.disable_auto_compactions: 0 2024-03-04T09:05:22.959 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-04T09:05:22.960 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-04T09:05:22.960 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-04T09:05:22.960 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-04T09:05:22.960 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-04T09:05:22.960 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-04T09:05:22.960 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-04T09:05:22.960 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-04T09:05:22.960 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-04T09:05:22.960 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-04T09:05:22.960 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.table_properties_collectors: 2024-03-04T09:05:22.960 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.inplace_update_support: 0 2024-03-04T09:05:22.960 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.inplace_update_num_locks: 10000 2024-03-04T09:05:22.960 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-04T09:05:22.960 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-04T09:05:22.961 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.memtable_huge_page_size: 0 2024-03-04T09:05:22.961 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.bloom_locality: 0 2024-03-04T09:05:22.961 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.max_successive_merges: 0 2024-03-04T09:05:22.961 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.optimize_filters_for_hits: 0 2024-03-04T09:05:22.961 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.paranoid_file_checks: 0 2024-03-04T09:05:22.961 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.force_consistency_checks: 1 2024-03-04T09:05:22.961 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.report_bg_io_stats: 0 2024-03-04T09:05:22.961 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.ttl: 2592000 2024-03-04T09:05:22.961 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.periodic_compaction_seconds: 0 2024-03-04T09:05:22.961 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-03-04T09:05:22.961 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-03-04T09:05:22.961 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.enable_blob_files: false 2024-03-04T09:05:22.961 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.min_blob_size: 0 2024-03-04T09:05:22.961 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.blob_file_size: 268435456 2024-03-04T09:05:22.961 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.blob_compression_type: NoCompression 2024-03-04T09:05:22.962 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.enable_blob_garbage_collection: false 2024-03-04T09:05:22.962 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-03-04T09:05:22.962 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-03-04T09:05:22.962 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-03-04T09:05:22.962 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.blob_file_starting_level: 0 2024-03-04T09:05:22.962 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-03-04T09:05:22.962 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-03-04T09:05:22.962 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-03-04T09:05:22.962 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: d3d67123-d00f-4375-863f-06b84d1e503e 2024-03-04T09:05:22.962 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709543122896808, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-03-04T09:05:22.962 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-03-04T09:05:22.962 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709543122897828, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 95408, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 318, "table_properties": {"data_size": 93398, "index_size": 292, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13904, "raw_average_key_size": 50, "raw_value_size": 85829, "raw_average_value_size": 309, "num_data_blocks": 11, "num_entries": 277, "num_filter_entries": 277, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1709543122, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d3d67123-d00f-4375-863f-06b84d1e503e", "db_session_id": "BOCKXO8J9VGWL4ULKBOK", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-03-04T09:05:22.962 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709543122897910, "job": 1, "event": "recovery_finished"} 2024-03-04T09:05:22.963 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-03-04T09:05:22.963 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-03-04T09:05:22.963 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55933898a000 2024-03-04T09:05:22.963 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: DB pointer 0x559338974000 2024-03-04T09:05:22.963 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-03-04T09:05:22.963 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-03-04T09:05:22.963 INFO:journalctl@ceph.mon.a.smithi082.stdout: ** DB Stats ** 2024-03-04T09:05:22.963 INFO:journalctl@ceph.mon.a.smithi082.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-04T09:05:22.963 INFO:journalctl@ceph.mon.a.smithi082.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-04T09:05:22.963 INFO:journalctl@ceph.mon.a.smithi082.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-04T09:05:22.963 INFO:journalctl@ceph.mon.a.smithi082.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-04T09:05:22.963 INFO:journalctl@ceph.mon.a.smithi082.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-04T09:05:22.963 INFO:journalctl@ceph.mon.a.smithi082.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-04T09:05:22.963 INFO:journalctl@ceph.mon.a.smithi082.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-04T09:05:22.963 INFO:journalctl@ceph.mon.a.smithi082.stdout: 2024-03-04T09:05:22.964 INFO:journalctl@ceph.mon.a.smithi082.stdout: ** Compaction Stats [default] ** 2024-03-04T09:05:22.964 INFO:journalctl@ceph.mon.a.smithi082.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-04T09:05:22.964 INFO:journalctl@ceph.mon.a.smithi082.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-03-04T09:05:22.964 INFO:journalctl@ceph.mon.a.smithi082.stdout: L0 2/0 95.01 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 140.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-04T09:05:22.964 INFO:journalctl@ceph.mon.a.smithi082.stdout: Sum 2/0 95.01 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 140.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-04T09:05:22.964 INFO:journalctl@ceph.mon.a.smithi082.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 140.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-04T09:05:22.964 INFO:journalctl@ceph.mon.a.smithi082.stdout: 2024-03-04T09:05:22.964 INFO:journalctl@ceph.mon.a.smithi082.stdout: ** Compaction Stats [default] ** 2024-03-04T09:05:22.964 INFO:journalctl@ceph.mon.a.smithi082.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-04T09:05:22.964 INFO:journalctl@ceph.mon.a.smithi082.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-04T09:05:22.964 INFO:journalctl@ceph.mon.a.smithi082.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 140.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-04T09:05:22.964 INFO:journalctl@ceph.mon.a.smithi082.stdout: 2024-03-04T09:05:22.964 INFO:journalctl@ceph.mon.a.smithi082.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-03-04T09:05:22.964 INFO:journalctl@ceph.mon.a.smithi082.stdout: 2024-03-04T09:05:22.965 INFO:journalctl@ceph.mon.a.smithi082.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-04T09:05:22.965 INFO:journalctl@ceph.mon.a.smithi082.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-03-04T09:05:22.965 INFO:journalctl@ceph.mon.a.smithi082.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-04T09:05:22.965 INFO:journalctl@ceph.mon.a.smithi082.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-03-04T09:05:22.965 INFO:journalctl@ceph.mon.a.smithi082.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-03-04T09:05:22.965 INFO:journalctl@ceph.mon.a.smithi082.stdout: AddFile(Keys): cumulative 0, interval 0 2024-03-04T09:05:22.965 INFO:journalctl@ceph.mon.a.smithi082.stdout: Cumulative compaction: 0.00 GB write, 30.51 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-04T09:05:22.965 INFO:journalctl@ceph.mon.a.smithi082.stdout: Interval compaction: 0.00 GB write, 30.51 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-04T09:05:22.965 INFO:journalctl@ceph.mon.a.smithi082.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-04T09:05:22.965 INFO:journalctl@ceph.mon.a.smithi082.stdout: Block cache BinnedLRUCache@0x559338899090#2 capacity: 512.00 MB usage: 1.39 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-03-04T09:05:22.965 INFO:journalctl@ceph.mon.a.smithi082.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-03-04T09:05:22.965 INFO:journalctl@ceph.mon.a.smithi082.stdout: 2024-03-04T09:05:22.965 INFO:journalctl@ceph.mon.a.smithi082.stdout: ** File Read Latency Histogram By Level [default] ** 2024-03-04T09:05:22.966 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: starting mon.a rank 0 at public addrs [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] at bind addrs [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 2e533fc8-da06-11ee-95c6-87774f69a715 2024-03-04T09:05:22.966 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: mon.a@-1(???) e1 preinit fsid 2e533fc8-da06-11ee-95c6-87774f69a715 2024-03-04T09:05:22.966 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: mon.a@-1(???).mds e1 new map 2024-03-04T09:05:22.966 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: mon.a@-1(???).mds e1 print_map 2024-03-04T09:05:22.966 INFO:journalctl@ceph.mon.a.smithi082.stdout: e1 2024-03-04T09:05:22.966 INFO:journalctl@ceph.mon.a.smithi082.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-03-04T09:05:22.966 INFO:journalctl@ceph.mon.a.smithi082.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-03-04T09:05:22.966 INFO:journalctl@ceph.mon.a.smithi082.stdout: legacy client fscid: -1 2024-03-04T09:05:22.966 INFO:journalctl@ceph.mon.a.smithi082.stdout: 2024-03-04T09:05:22.966 INFO:journalctl@ceph.mon.a.smithi082.stdout: No filesystems configured 2024-03-04T09:05:22.966 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-03-04T09:05:22.967 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-03-04T09:05:22.967 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-03-04T09:05:22.967 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-03-04T09:05:22.967 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-03-04T09:05:22.967 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 bash[32860]: 938c8db3694aaa7fc4a1414b02079a2e6b04d42e0b295ad381b2be9e145d3544 2024-03-04T09:05:22.968 INFO:teuthology.orchestra.run.smithi082.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-03-04T09:05:23.237 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 systemd[1]: Started Ceph mon.a for 2e533fc8-da06-11ee-95c6-87774f69a715. 2024-03-04T09:05:23.238 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: mon.a is new leader, mons a in quorum (ranks 0) 2024-03-04T09:05:23.238 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: monmap e1: 1 mons at {a=[v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-04T09:05:23.238 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: fsmap 2024-03-04T09:05:23.238 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: osdmap e1: 0 total, 0 up, 0 in 2024-03-04T09:05:23.238 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:22 smithi082 ceph-mon[32880]: mgrmap e1: no daemons active 2024-03-04T09:05:24.016 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:23.343+0000 7f0f8fb83700 1 Processor -- start 2024-03-04T09:05:24.016 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:23.343+0000 7f0f8fb83700 1 -- start start 2024-03-04T09:05:24.016 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:23.344+0000 7f0f8fb83700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f8807de60 0x7f0f8807c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:05:24.016 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:23.344+0000 7f0f8fb83700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8807c890 con 0x7f0f8807de60 2024-03-04T09:05:24.016 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:23.344+0000 7f0f8d91f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f8807de60 0x7f0f8807c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:05:24.016 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:23.344+0000 7f0f8d91f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f8807de60 0x7f0f8807c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43026/0 (socket says 172.21.15.82:43026) 2024-03-04T09:05:24.017 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:23.344+0000 7f0f8d91f700 1 -- 172.21.15.82:0/456545961 learned_addr learned my addr 172.21.15.82:0/456545961 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:05:24.017 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:23.344+0000 7f0f8d91f700 1 -- 172.21.15.82:0/456545961 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f8807ca10 con 0x7f0f8807de60 2024-03-04T09:05:24.017 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:23.344+0000 7f0f8d91f700 1 --2- 172.21.15.82:0/456545961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f8807de60 0x7f0f8807c2c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f0f840098a0 tx=0x7f0f84009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e4e5754d9561e4f server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:05:24.017 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:23.345+0000 7f0f8c91d700 1 -- 172.21.15.82:0/456545961 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0f84004160 con 0x7f0f8807de60 2024-03-04T09:05:24.017 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:23.345+0000 7f0f8c91d700 1 -- 172.21.15.82:0/456545961 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0f84004300 con 0x7f0f8807de60 2024-03-04T09:05:24.017 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:23.345+0000 7f0f8c91d700 1 -- 172.21.15.82:0/456545961 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0f84011b40 con 0x7f0f8807de60 2024-03-04T09:05:24.017 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:23.345+0000 7f0f8fb83700 1 -- 172.21.15.82:0/456545961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f8807de60 msgr2=0x7f0f8807c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:05:24.017 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:23.345+0000 7f0f8fb83700 1 --2- 172.21.15.82:0/456545961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f8807de60 0x7f0f8807c2c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f0f840098a0 tx=0x7f0f84009bb0 comp rx=0 tx=0).stop 2024-03-04T09:05:24.017 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:23.345+0000 7f0f8fb83700 1 -- 172.21.15.82:0/456545961 shutdown_connections 2024-03-04T09:05:24.017 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:23.345+0000 7f0f8fb83700 1 --2- 172.21.15.82:0/456545961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f8807de60 0x7f0f8807c2c0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:05:24.017 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:23.345+0000 7f0f8fb83700 1 -- 172.21.15.82:0/456545961 >> 172.21.15.82:0/456545961 conn(0x7f0f88103090 msgr2=0x7f0f881054b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:05:24.017 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:23.345+0000 7f0f8fb83700 1 -- 172.21.15.82:0/456545961 shutdown_connections 2024-03-04T09:05:24.018 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:23.345+0000 7f0f8fb83700 1 -- 172.21.15.82:0/456545961 wait complete. 2024-03-04T09:05:24.018 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:23.346+0000 7f0f8fb83700 1 Processor -- start 2024-03-04T09:05:24.018 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:23.346+0000 7f0f8fb83700 1 -- start start 2024-03-04T09:05:24.018 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:23.346+0000 7f0f8fb83700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f8807de60 0x7f0f8819dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:05:24.018 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:23.346+0000 7f0f8fb83700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8810e020 con 0x7f0f8807de60 2024-03-04T09:05:24.018 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:23.346+0000 7f0f8d91f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f8807de60 0x7f0f8819dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:05:24.018 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:23.346+0000 7f0f8d91f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f8807de60 0x7f0f8819dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43030/0 (socket says 172.21.15.82:43030) 2024-03-04T09:05:24.018 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:23.346+0000 7f0f8d91f700 1 -- 172.21.15.82:0/3996223798 learned_addr learned my addr 172.21.15.82:0/3996223798 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:05:24.018 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:23.346+0000 7f0f8d91f700 1 -- 172.21.15.82:0/3996223798 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f8819e130 con 0x7f0f8807de60 2024-03-04T09:05:24.018 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:23.346+0000 7f0f8d91f700 1 --2- 172.21.15.82:0/3996223798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f8807de60 0x7f0f8819dbf0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f0f84011670 tx=0x7f0f84011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:05:24.019 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:23.347+0000 7f0f7effd700 1 -- 172.21.15.82:0/3996223798 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0f840037d0 con 0x7f0f8807de60 2024-03-04T09:05:24.019 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:23.347+0000 7f0f7effd700 1 -- 172.21.15.82:0/3996223798 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0f8401a430 con 0x7f0f8807de60 2024-03-04T09:05:24.019 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:23.347+0000 7f0f8fb83700 1 -- 172.21.15.82:0/3996223798 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f8819e3c0 con 0x7f0f8807de60 2024-03-04T09:05:24.019 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:23.347+0000 7f0f7effd700 1 -- 172.21.15.82:0/3996223798 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0f84019550 con 0x7f0f8807de60 2024-03-04T09:05:24.019 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:23.347+0000 7f0f8fb83700 1 -- 172.21.15.82:0/3996223798 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f881a10b0 con 0x7f0f8807de60 2024-03-04T09:05:24.019 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:23.347+0000 7f0f7effd700 1 -- 172.21.15.82:0/3996223798 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f0f84022020 con 0x7f0f8807de60 2024-03-04T09:05:24.019 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:23.347+0000 7f0f7effd700 1 -- 172.21.15.82:0/3996223798 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f0f84024d70 con 0x7f0f8807de60 2024-03-04T09:05:24.019 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:23.348+0000 7f0f8fb83700 1 -- 172.21.15.82:0/3996223798 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f880636f0 con 0x7f0f8807de60 2024-03-04T09:05:24.019 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:23.350+0000 7f0f7effd700 1 -- 172.21.15.82:0/3996223798 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f0f84019cd0 con 0x7f0f8807de60 2024-03-04T09:05:24.019 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:23.417+0000 7f0f8fb83700 1 -- 172.21.15.82:0/3996223798 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f0f881a1280 con 0x7f0f8807de60 2024-03-04T09:05:24.020 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:23.422+0000 7f0f7effd700 1 -- 172.21.15.82:0/3996223798 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f0f8401aa50 con 0x7f0f8807de60 2024-03-04T09:05:24.020 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:23.422+0000 7f0f8fb83700 1 -- 172.21.15.82:0/3996223798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f8807de60 msgr2=0x7f0f8819dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:05:24.020 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:23.422+0000 7f0f8fb83700 1 --2- 172.21.15.82:0/3996223798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f8807de60 0x7f0f8819dbf0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f0f84011670 tx=0x7f0f84011920 comp rx=0 tx=0).stop 2024-03-04T09:05:24.020 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:23.422+0000 7f0f8fb83700 1 -- 172.21.15.82:0/3996223798 shutdown_connections 2024-03-04T09:05:24.020 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:23.422+0000 7f0f8fb83700 1 --2- 172.21.15.82:0/3996223798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f8807de60 0x7f0f8819dbf0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:05:24.020 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:23.422+0000 7f0f8fb83700 1 -- 172.21.15.82:0/3996223798 >> 172.21.15.82:0/3996223798 conn(0x7f0f88103090 msgr2=0x7f0f88103b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:05:24.020 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:23.422+0000 7f0f8fb83700 1 -- 172.21.15.82:0/3996223798 shutdown_connections 2024-03-04T09:05:24.020 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:23.422+0000 7f0f8fb83700 1 -- 172.21.15.82:0/3996223798 wait complete. 2024-03-04T09:05:24.020 INFO:teuthology.orchestra.run.smithi082.stdout:Wrote config to /etc/ceph/ceph.conf 2024-03-04T09:05:24.041 INFO:teuthology.orchestra.run.smithi082.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-03-04T09:05:24.041 INFO:teuthology.orchestra.run.smithi082.stdout:Creating mgr... 2024-03-04T09:05:24.042 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying port 0.0.0.0:9283 ... 2024-03-04T09:05:24.042 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying port 0.0.0.0:8765 ... 2024-03-04T09:05:24.292 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mgr.x 2024-03-04T09:05:24.292 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Failed to reset failed state of unit ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mgr.x.service: Unit ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mgr.x.service not loaded. 2024-03-04T09:05:24.447 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-2e533fc8-da06-11ee-95c6-87774f69a715.target.wants/ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mgr.x.service → /etc/systemd/system/ceph-2e533fc8-da06-11ee-95c6-87774f69a715@.service. 2024-03-04T09:05:24.681 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:24 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/3996223798' entity='client.admin' 2024-03-04T09:05:24.682 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:24 smithi082 systemd[1]: Starting Ceph mgr.x for 2e533fc8-da06-11ee-95c6-87774f69a715... 2024-03-04T09:05:24.962 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:24 smithi082 podman[33097]: 2024-03-04 09:05:24.589550457 +0000 UTC m=+0.017922561 image pull f88ffb32aa6a7d5dfdc954d9f096f0c9cc47981d05ec8d117ba859a22d8185ba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd 2024-03-04T09:05:24.962 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:24 smithi082 podman[33097]: 2024-03-04 09:05:24.68997889 +0000 UTC m=+0.118351035 container create c589e7f2c2f708af2718a20fbbd859f4afddae904101842bb45e4f10354b8427 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-03-04T09:05:24.962 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:24 smithi082 podman[33097]: 2024-03-04 09:05:24.892122035 +0000 UTC m=+0.320494134 container init c589e7f2c2f708af2718a20fbbd859f4afddae904101842bb45e4f10354b8427 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, GIT_CLEAN=True, RELEASE=wip-lusov-qdb-1bc250c, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-03-04T09:05:24.963 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:24 smithi082 podman[33097]: 2024-03-04 09:05:24.894743529 +0000 UTC m=+0.323115632 container start c589e7f2c2f708af2718a20fbbd859f4afddae904101842bb45e4f10354b8427 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, RELEASE=wip-lusov-qdb-1bc250c, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-04T09:05:24.963 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:24 smithi082 bash[33097]: c589e7f2c2f708af2718a20fbbd859f4afddae904101842bb45e4f10354b8427 2024-03-04T09:05:24.975 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-03-04T09:05:24.975 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout disabled 2024-03-04T09:05:24.982 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-03-04T09:05:24.983 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout inactive 2024-03-04T09:05:24.983 INFO:teuthology.orchestra.run.smithi082.stdout:firewalld.service is not enabled 2024-03-04T09:05:24.983 INFO:teuthology.orchestra.run.smithi082.stdout:Not possible to enable service . firewalld.service is not available 2024-03-04T09:05:24.991 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-03-04T09:05:24.991 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout disabled 2024-03-04T09:05:24.998 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-03-04T09:05:24.998 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout inactive 2024-03-04T09:05:24.999 INFO:teuthology.orchestra.run.smithi082.stdout:firewalld.service is not enabled 2024-03-04T09:05:24.999 INFO:teuthology.orchestra.run.smithi082.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-03-04T09:05:24.999 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for mgr to start... 2024-03-04T09:05:24.999 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for mgr... 2024-03-04T09:05:25.246 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:24 smithi082 systemd[1]: Started Ceph mgr.x for 2e533fc8-da06-11ee-95c6-87774f69a715. 2024-03-04T09:05:25.520 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:25 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:05:25.443+0000 7fee5db12200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-04T09:05:25.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:25 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/1244365014' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-04T09:05:25.816 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:25 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:05:25.545+0000 7fee5db12200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-04T09:05:26.537 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:26 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:05:26.196+0000 7fee5db12200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-04T09:05:26.537 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:26 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:05:26.292+0000 7fee5db12200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-04T09:05:26.537 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:26 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:05:26.441+0000 7fee5db12200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-04T09:05:26.598 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-03-04T09:05:26.598 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-03-04T09:05:26.598 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsid": "2e533fc8-da06-11ee-95c6-87774f69a715", 2024-03-04T09:05:26.599 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "health": { 2024-03-04T09:05:26.599 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-04T09:05:26.599 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-04T09:05:26.599 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-04T09:05:26.599 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-04T09:05:26.599 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-04T09:05:26.599 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-04T09:05:26.599 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 0 2024-03-04T09:05:26.599 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-03-04T09:05:26.599 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-04T09:05:26.599 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "a" 2024-03-04T09:05:26.599 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-03-04T09:05:26.599 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-03-04T09:05:26.599 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-04T09:05:26.599 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-04T09:05:26.600 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-03-04T09:05:26.600 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-04T09:05:26.600 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-04T09:05:26.600 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-04T09:05:26.600 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-04T09:05:26.600 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-04T09:05:26.600 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-04T09:05:26.600 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-04T09:05:26.600 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-04T09:05:26.600 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-04T09:05:26.600 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-04T09:05:26.600 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-04T09:05:26.600 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-04T09:05:26.600 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-04T09:05:26.601 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-04T09:05:26.601 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-04T09:05:26.601 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-04T09:05:26.601 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-04T09:05:26.601 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-04T09:05:26.601 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-04T09:05:26.601 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-04T09:05:26.601 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-04T09:05:26.601 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-04T09:05:26.601 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-04T09:05:26.601 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-04T09:05:26.601 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-04T09:05:26.601 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-04T09:05:26.601 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-04T09:05:26.602 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "available": false, 2024-03-04T09:05:26.602 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-04T09:05:26.602 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-04T09:05:26.602 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-04T09:05:26.602 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-04T09:05:26.602 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "restful" 2024-03-04T09:05:26.602 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-03-04T09:05:26.602 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-04T09:05:26.602 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-04T09:05:26.602 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-04T09:05:26.602 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-04T09:05:26.602 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modified": "2024-03-04T09:05:16.488678+0000", 2024-03-04T09:05:26.602 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-04T09:05:26.602 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-04T09:05:26.603 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-04T09:05:26.603 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-03-04T09:05:26.603 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:25.445+0000 7f7f2170c700 1 Processor -- start 2024-03-04T09:05:26.603 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:25.445+0000 7f7f2170c700 1 -- start start 2024-03-04T09:05:26.603 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:25.445+0000 7f7f2170c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f1c106ee0 0x7f7f1c107300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:05:26.603 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:25.445+0000 7f7f2170c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1c1078d0 con 0x7f7f1c106ee0 2024-03-04T09:05:26.603 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:25.445+0000 7f7f1affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f1c106ee0 0x7f7f1c107300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:05:26.603 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:25.445+0000 7f7f1affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f1c106ee0 0x7f7f1c107300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43068/0 (socket says 172.21.15.82:43068) 2024-03-04T09:05:26.603 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:25.445+0000 7f7f1affd700 1 -- 172.21.15.82:0/23290514 learned_addr learned my addr 172.21.15.82:0/23290514 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:05:26.603 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:25.446+0000 7f7f1affd700 1 -- 172.21.15.82:0/23290514 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f1c107c00 con 0x7f7f1c106ee0 2024-03-04T09:05:26.603 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:25.446+0000 7f7f1affd700 1 --2- 172.21.15.82:0/23290514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f1c106ee0 0x7f7f1c107300 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c0098a0 tx=0x7f7f0c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a03a9f9250b9406 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:05:26.603 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:25.446+0000 7f7f19ffb700 1 -- 172.21.15.82:0/23290514 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f0c004160 con 0x7f7f1c106ee0 2024-03-04T09:05:26.603 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:25.446+0000 7f7f19ffb700 1 -- 172.21.15.82:0/23290514 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7f0c004300 con 0x7f7f1c106ee0 2024-03-04T09:05:26.603 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:25.446+0000 7f7f19ffb700 1 -- 172.21.15.82:0/23290514 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f0c011b40 con 0x7f7f1c106ee0 2024-03-04T09:05:26.604 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:25.447+0000 7f7f2170c700 1 -- 172.21.15.82:0/23290514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f1c106ee0 msgr2=0x7f7f1c107300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:05:26.604 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:25.447+0000 7f7f2170c700 1 --2- 172.21.15.82:0/23290514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f1c106ee0 0x7f7f1c107300 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c0098a0 tx=0x7f7f0c009bb0 comp rx=0 tx=0).stop 2024-03-04T09:05:26.604 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:25.447+0000 7f7f2170c700 1 -- 172.21.15.82:0/23290514 shutdown_connections 2024-03-04T09:05:26.604 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:25.447+0000 7f7f2170c700 1 --2- 172.21.15.82:0/23290514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f1c106ee0 0x7f7f1c107300 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:05:26.604 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:25.447+0000 7f7f2170c700 1 -- 172.21.15.82:0/23290514 >> 172.21.15.82:0/23290514 conn(0x7f7f1c101760 msgr2=0x7f7f1c103b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:05:26.604 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:25.447+0000 7f7f2170c700 1 -- 172.21.15.82:0/23290514 shutdown_connections 2024-03-04T09:05:26.604 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:25.447+0000 7f7f2170c700 1 -- 172.21.15.82:0/23290514 wait complete. 2024-03-04T09:05:26.604 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:25.447+0000 7f7f2170c700 1 Processor -- start 2024-03-04T09:05:26.604 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:25.448+0000 7f7f2170c700 1 -- start start 2024-03-04T09:05:26.604 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:25.448+0000 7f7f2170c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f1c106ee0 0x7f7f1c19dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:05:26.604 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:25.448+0000 7f7f2170c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1c10afb0 con 0x7f7f1c106ee0 2024-03-04T09:05:26.604 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:25.448+0000 7f7f1affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f1c106ee0 0x7f7f1c19dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:05:26.604 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:25.448+0000 7f7f1affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f1c106ee0 0x7f7f1c19dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43074/0 (socket says 172.21.15.82:43074) 2024-03-04T09:05:26.604 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:25.448+0000 7f7f1affd700 1 -- 172.21.15.82:0/1244365014 learned_addr learned my addr 172.21.15.82:0/1244365014 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:05:26.605 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:25.448+0000 7f7f1affd700 1 -- 172.21.15.82:0/1244365014 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f1c19e1e0 con 0x7f7f1c106ee0 2024-03-04T09:05:26.605 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:25.448+0000 7f7f1affd700 1 --2- 172.21.15.82:0/1244365014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f1c106ee0 0x7f7f1c19dca0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c011670 tx=0x7f7f0c011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:05:26.605 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:25.449+0000 7f7f03fff700 1 -- 172.21.15.82:0/1244365014 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f0c0038b0 con 0x7f7f1c106ee0 2024-03-04T09:05:26.605 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:25.449+0000 7f7f03fff700 1 -- 172.21.15.82:0/1244365014 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7f0c01a430 con 0x7f7f1c106ee0 2024-03-04T09:05:26.605 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:25.449+0000 7f7f03fff700 1 -- 172.21.15.82:0/1244365014 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f0c019550 con 0x7f7f1c106ee0 2024-03-04T09:05:26.605 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:25.449+0000 7f7f2170c700 1 -- 172.21.15.82:0/1244365014 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f1c19e470 con 0x7f7f1c106ee0 2024-03-04T09:05:26.605 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:25.449+0000 7f7f2170c700 1 -- 172.21.15.82:0/1244365014 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f1c1a1160 con 0x7f7f1c106ee0 2024-03-04T09:05:26.605 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:25.449+0000 7f7f03fff700 1 -- 172.21.15.82:0/1244365014 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f7f0c019b90 con 0x7f7f1c106ee0 2024-03-04T09:05:26.605 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:25.449+0000 7f7f03fff700 1 -- 172.21.15.82:0/1244365014 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f7f0c024960 con 0x7f7f1c106ee0 2024-03-04T09:05:26.605 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:25.450+0000 7f7f2170c700 1 -- 172.21.15.82:0/1244365014 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f1c0636f0 con 0x7f7f1c106ee0 2024-03-04T09:05:26.605 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:25.452+0000 7f7f03fff700 1 -- 172.21.15.82:0/1244365014 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f7f0c043dd0 con 0x7f7f1c106ee0 2024-03-04T09:05:26.605 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:25.524+0000 7f7f2170c700 1 -- 172.21.15.82:0/1244365014 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f7f1c02dc00 con 0x7f7f1c106ee0 2024-03-04T09:05:26.605 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:25.525+0000 7f7f03fff700 1 -- 172.21.15.82:0/1244365014 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1239 (secure 0 0 0) 0x7f7f0c032020 con 0x7f7f1c106ee0 2024-03-04T09:05:26.606 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:25.526+0000 7f7f2170c700 1 -- 172.21.15.82:0/1244365014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f1c106ee0 msgr2=0x7f7f1c19dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:05:26.606 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:25.526+0000 7f7f2170c700 1 --2- 172.21.15.82:0/1244365014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f1c106ee0 0x7f7f1c19dca0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c011670 tx=0x7f7f0c011b50 comp rx=0 tx=0).stop 2024-03-04T09:05:26.606 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:25.526+0000 7f7f2170c700 1 -- 172.21.15.82:0/1244365014 shutdown_connections 2024-03-04T09:05:26.606 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:25.526+0000 7f7f2170c700 1 --2- 172.21.15.82:0/1244365014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f1c106ee0 0x7f7f1c19dca0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:05:26.606 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:25.526+0000 7f7f2170c700 1 -- 172.21.15.82:0/1244365014 >> 172.21.15.82:0/1244365014 conn(0x7f7f1c101760 msgr2=0x7f7f1c102610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:05:26.606 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:25.526+0000 7f7f2170c700 1 -- 172.21.15.82:0/1244365014 shutdown_connections 2024-03-04T09:05:26.606 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:25.526+0000 7f7f2170c700 1 -- 172.21.15.82:0/1244365014 wait complete. 2024-03-04T09:05:26.606 INFO:teuthology.orchestra.run.smithi082.stdout:mgr not available, waiting (1/15)... 2024-03-04T09:05:26.816 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:26 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:05:26.540+0000 7fee5db12200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-04T09:05:26.816 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:26 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:05:26.627+0000 7fee5db12200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-04T09:05:27.098 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:26 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:05:26.901+0000 7fee5db12200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-04T09:05:27.098 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:27 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:05:27.013+0000 7fee5db12200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-04T09:05:27.098 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:27 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:05:27.102+0000 7fee5db12200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-04T09:05:27.373 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:27 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:05:27.198+0000 7fee5db12200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-04T09:05:27.373 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:27 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:05:27.377+0000 7fee5db12200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-04T09:05:28.711 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:28 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:05:28.343+0000 7fee5db12200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-04T09:05:28.711 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:28 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:05:28.472+0000 7fee5db12200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-04T09:05:29.004 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:28 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:05:28.809+0000 7fee5db12200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-04T09:05:29.005 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:28 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:05:28.901+0000 7fee5db12200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-04T09:05:29.297 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:29 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/2575104667' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-04T09:05:29.298 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:29 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:05:29.102+0000 7fee5db12200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-04T09:05:29.298 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:29 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:05:29.301+0000 7fee5db12200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-04T09:05:29.694 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-03-04T09:05:29.696 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-03-04T09:05:29.696 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsid": "2e533fc8-da06-11ee-95c6-87774f69a715", 2024-03-04T09:05:29.696 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "health": { 2024-03-04T09:05:29.697 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-04T09:05:29.697 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-04T09:05:29.697 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-04T09:05:29.697 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-04T09:05:29.697 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-04T09:05:29.697 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-04T09:05:29.697 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 0 2024-03-04T09:05:29.697 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-03-04T09:05:29.697 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-04T09:05:29.697 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "a" 2024-03-04T09:05:29.697 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-03-04T09:05:29.697 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-03-04T09:05:29.697 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-04T09:05:29.697 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-04T09:05:29.698 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-03-04T09:05:29.698 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-04T09:05:29.698 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-04T09:05:29.698 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-04T09:05:29.698 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-04T09:05:29.698 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-04T09:05:29.698 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-04T09:05:29.698 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-04T09:05:29.708 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-04T09:05:29.708 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-04T09:05:29.709 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-04T09:05:29.709 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-04T09:05:29.709 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-04T09:05:29.709 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-04T09:05:29.709 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-04T09:05:29.709 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-04T09:05:29.709 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-04T09:05:29.709 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-04T09:05:29.709 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-04T09:05:29.709 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-04T09:05:29.709 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-04T09:05:29.709 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-04T09:05:29.709 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-04T09:05:29.710 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-04T09:05:29.710 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-04T09:05:29.710 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-04T09:05:29.710 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-04T09:05:29.710 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-04T09:05:29.710 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "available": false, 2024-03-04T09:05:29.710 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-04T09:05:29.710 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-04T09:05:29.710 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-04T09:05:29.710 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-04T09:05:29.710 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "restful" 2024-03-04T09:05:29.710 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-03-04T09:05:29.710 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-04T09:05:29.710 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-04T09:05:29.711 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-04T09:05:29.711 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-04T09:05:29.711 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modified": "2024-03-04T09:05:16.488678+0000", 2024-03-04T09:05:29.711 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-04T09:05:29.711 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-04T09:05:29.711 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-04T09:05:29.711 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-03-04T09:05:29.711 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:29.024+0000 7f736fbf3700 1 Processor -- start 2024-03-04T09:05:29.711 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:29.024+0000 7f736fbf3700 1 -- start start 2024-03-04T09:05:29.711 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:29.024+0000 7f736fbf3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7368106980 0x7f7368106da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:05:29.711 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:29.024+0000 7f736fbf3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7368107370 con 0x7f7368106980 2024-03-04T09:05:29.711 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:29.024+0000 7f736d98f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7368106980 0x7f7368106da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:05:29.711 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:29.024+0000 7f736d98f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7368106980 0x7f7368106da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43790/0 (socket says 172.21.15.82:43790) 2024-03-04T09:05:29.712 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:29.024+0000 7f736d98f700 1 -- 172.21.15.82:0/1041754083 learned_addr learned my addr 172.21.15.82:0/1041754083 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:05:29.712 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:29.025+0000 7f736d98f700 1 -- 172.21.15.82:0/1041754083 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7368107b80 con 0x7f7368106980 2024-03-04T09:05:29.712 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:29.025+0000 7f736d98f700 1 --2- 172.21.15.82:0/1041754083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7368106980 0x7f7368106da0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f73640098a0 tx=0x7f7364009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1425ec80bafcb69c server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:05:29.712 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:29.025+0000 7f736c98d700 1 -- 172.21.15.82:0/1041754083 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7364004160 con 0x7f7368106980 2024-03-04T09:05:29.712 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:29.025+0000 7f736c98d700 1 -- 172.21.15.82:0/1041754083 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7364004300 con 0x7f7368106980 2024-03-04T09:05:29.712 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:29.025+0000 7f736c98d700 1 -- 172.21.15.82:0/1041754083 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7364011b40 con 0x7f7368106980 2024-03-04T09:05:29.712 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:29.026+0000 7f736fbf3700 1 -- 172.21.15.82:0/1041754083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7368106980 msgr2=0x7f7368106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:05:29.712 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:29.026+0000 7f736fbf3700 1 --2- 172.21.15.82:0/1041754083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7368106980 0x7f7368106da0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f73640098a0 tx=0x7f7364009bb0 comp rx=0 tx=0).stop 2024-03-04T09:05:29.712 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:29.026+0000 7f736fbf3700 1 -- 172.21.15.82:0/1041754083 shutdown_connections 2024-03-04T09:05:29.712 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:29.026+0000 7f736fbf3700 1 --2- 172.21.15.82:0/1041754083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7368106980 0x7f7368106da0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:05:29.712 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:29.026+0000 7f736fbf3700 1 -- 172.21.15.82:0/1041754083 >> 172.21.15.82:0/1041754083 conn(0x7f7368101f00 msgr2=0x7f7368104360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:05:29.712 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:29.026+0000 7f736fbf3700 1 -- 172.21.15.82:0/1041754083 shutdown_connections 2024-03-04T09:05:29.712 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:29.026+0000 7f736fbf3700 1 -- 172.21.15.82:0/1041754083 wait complete. 2024-03-04T09:05:29.713 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:29.026+0000 7f736fbf3700 1 Processor -- start 2024-03-04T09:05:29.713 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:29.027+0000 7f736fbf3700 1 -- start start 2024-03-04T09:05:29.713 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:29.027+0000 7f736fbf3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7368106980 0x7f7368191aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:05:29.713 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:29.027+0000 7f736fbf3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f736810af30 con 0x7f7368106980 2024-03-04T09:05:29.713 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:29.027+0000 7f736d98f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7368106980 0x7f7368191aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:05:29.713 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:29.027+0000 7f736d98f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7368106980 0x7f7368191aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43792/0 (socket says 172.21.15.82:43792) 2024-03-04T09:05:29.713 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:29.027+0000 7f736d98f700 1 -- 172.21.15.82:0/2575104667 learned_addr learned my addr 172.21.15.82:0/2575104667 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:05:29.713 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:29.027+0000 7f736d98f700 1 -- 172.21.15.82:0/2575104667 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7368191fe0 con 0x7f7368106980 2024-03-04T09:05:29.713 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:29.027+0000 7f736d98f700 1 --2- 172.21.15.82:0/2575104667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7368106980 0x7f7368191aa0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7364011670 tx=0x7f7364011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:05:29.713 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:29.027+0000 7f735effd700 1 -- 172.21.15.82:0/2575104667 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73640037d0 con 0x7f7368106980 2024-03-04T09:05:29.713 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:29.027+0000 7f735effd700 1 -- 172.21.15.82:0/2575104667 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f736401a430 con 0x7f7368106980 2024-03-04T09:05:29.713 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:29.027+0000 7f736fbf3700 1 -- 172.21.15.82:0/2575104667 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73681901d0 con 0x7f7368106980 2024-03-04T09:05:29.713 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:29.028+0000 7f736fbf3700 1 -- 172.21.15.82:0/2575104667 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7368190710 con 0x7f7368106980 2024-03-04T09:05:29.713 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:29.028+0000 7f735effd700 1 -- 172.21.15.82:0/2575104667 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7364019550 con 0x7f7368106980 2024-03-04T09:05:29.713 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:29.028+0000 7f735effd700 1 -- 172.21.15.82:0/2575104667 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f7364022020 con 0x7f7368106980 2024-03-04T09:05:29.714 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:29.028+0000 7f735effd700 1 -- 172.21.15.82:0/2575104667 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f7364024b70 con 0x7f7368106980 2024-03-04T09:05:29.714 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:29.028+0000 7f736fbf3700 1 -- 172.21.15.82:0/2575104667 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73680636f0 con 0x7f7368106980 2024-03-04T09:05:29.714 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:29.031+0000 7f735effd700 1 -- 172.21.15.82:0/2575104667 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f7364019d20 con 0x7f7368106980 2024-03-04T09:05:29.714 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:29.103+0000 7f736fbf3700 1 -- 172.21.15.82:0/2575104667 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f73681953b0 con 0x7f7368106980 2024-03-04T09:05:29.714 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:29.104+0000 7f735effd700 1 -- 172.21.15.82:0/2575104667 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1239 (secure 0 0 0) 0x7f736401aa50 con 0x7f7368106980 2024-03-04T09:05:29.714 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:29.105+0000 7f736fbf3700 1 -- 172.21.15.82:0/2575104667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7368106980 msgr2=0x7f7368191aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:05:29.714 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:29.105+0000 7f736fbf3700 1 --2- 172.21.15.82:0/2575104667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7368106980 0x7f7368191aa0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7364011670 tx=0x7f7364011920 comp rx=0 tx=0).stop 2024-03-04T09:05:29.714 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:29.105+0000 7f736fbf3700 1 -- 172.21.15.82:0/2575104667 shutdown_connections 2024-03-04T09:05:29.714 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:29.105+0000 7f736fbf3700 1 --2- 172.21.15.82:0/2575104667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7368106980 0x7f7368191aa0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:05:29.714 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:29.105+0000 7f736fbf3700 1 -- 172.21.15.82:0/2575104667 >> 172.21.15.82:0/2575104667 conn(0x7f7368101f00 msgr2=0x7f7368102dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:05:29.714 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:29.105+0000 7f736fbf3700 1 -- 172.21.15.82:0/2575104667 shutdown_connections 2024-03-04T09:05:29.714 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:29.105+0000 7f736fbf3700 1 -- 172.21.15.82:0/2575104667 wait complete. 2024-03-04T09:05:29.714 INFO:teuthology.orchestra.run.smithi082.stdout:mgr not available, waiting (2/15)... 2024-03-04T09:05:29.843 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:29 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:05:29.587+0000 7fee5db12200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-04T09:05:29.843 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:29 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:05:29.846+0000 7fee5db12200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-04T09:05:30.316 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:30 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:05:30.077+0000 7fee5db12200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-04T09:05:31.316 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:30 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:05:30.863+0000 7fee5db12200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-04T09:05:31.729 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:31 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:05:31.423+0000 7fee5db12200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-04T09:05:31.729 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:31 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:05:31.518+0000 7fee5db12200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-04T09:05:31.729 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:31 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:05:31.733+0000 7fee5db12200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-04T09:05:32.035 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:31 smithi082 ceph-mon[32880]: Activating manager daemon x 2024-03-04T09:05:32.035 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:31 smithi082 ceph-mon[32880]: mgrmap e2: x(active, starting, since 0.00316778s) 2024-03-04T09:05:32.035 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:31 smithi082 ceph-mon[32880]: from='mgr.14100 172.21.15.82:0/1277093072' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-04T09:05:32.035 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:31 smithi082 ceph-mon[32880]: from='mgr.14100 172.21.15.82:0/1277093072' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-04T09:05:32.036 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:31 smithi082 ceph-mon[32880]: from='mgr.14100 172.21.15.82:0/1277093072' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-04T09:05:32.036 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:31 smithi082 ceph-mon[32880]: from='mgr.14100 172.21.15.82:0/1277093072' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T09:05:32.036 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:31 smithi082 ceph-mon[32880]: from='mgr.14100 172.21.15.82:0/1277093072' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-04T09:05:32.036 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:31 smithi082 ceph-mon[32880]: Manager daemon x is now available 2024-03-04T09:05:32.036 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:31 smithi082 ceph-mon[32880]: from='mgr.14100 172.21.15.82:0/1277093072' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-04T09:05:32.036 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:31 smithi082 ceph-mon[32880]: from='mgr.14100 172.21.15.82:0/1277093072' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-04T09:05:32.036 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:31 smithi082 ceph-mon[32880]: from='mgr.14100 172.21.15.82:0/1277093072' entity='mgr.x' 2024-03-04T09:05:32.036 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:31 smithi082 ceph-mon[32880]: from='mgr.14100 172.21.15.82:0/1277093072' entity='mgr.x' 2024-03-04T09:05:32.036 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:31 smithi082 ceph-mon[32880]: from='mgr.14100 172.21.15.82:0/1277093072' entity='mgr.x' 2024-03-04T09:05:32.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:32 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/3259747712' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-04T09:05:32.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:32 smithi082 ceph-mon[32880]: mgrmap e3: x(active, since 1.00673s) 2024-03-04T09:05:32.843 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-03-04T09:05:32.844 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-03-04T09:05:32.844 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsid": "2e533fc8-da06-11ee-95c6-87774f69a715", 2024-03-04T09:05:32.844 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "health": { 2024-03-04T09:05:32.844 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-04T09:05:32.844 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-04T09:05:32.844 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-04T09:05:32.844 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-04T09:05:32.844 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-04T09:05:32.844 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-04T09:05:32.844 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 0 2024-03-04T09:05:32.844 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-03-04T09:05:32.844 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-04T09:05:32.844 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "a" 2024-03-04T09:05:32.844 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-03-04T09:05:32.845 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-03-04T09:05:32.845 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-04T09:05:32.845 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-04T09:05:32.845 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-03-04T09:05:32.845 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-04T09:05:32.845 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-04T09:05:32.845 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-04T09:05:32.845 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-04T09:05:32.845 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-04T09:05:32.845 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-04T09:05:32.845 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-04T09:05:32.845 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-04T09:05:32.845 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-04T09:05:32.845 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-04T09:05:32.845 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-04T09:05:32.846 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-04T09:05:32.846 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-04T09:05:32.846 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-04T09:05:32.846 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-04T09:05:32.846 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-04T09:05:32.846 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-04T09:05:32.846 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-04T09:05:32.846 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-04T09:05:32.846 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-04T09:05:32.846 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-04T09:05:32.846 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-04T09:05:32.846 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-04T09:05:32.846 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-04T09:05:32.846 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-04T09:05:32.847 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-04T09:05:32.847 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-04T09:05:32.847 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "available": false, 2024-03-04T09:05:32.847 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-04T09:05:32.847 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-04T09:05:32.847 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-04T09:05:32.847 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-04T09:05:32.847 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "restful" 2024-03-04T09:05:32.847 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-03-04T09:05:32.847 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-04T09:05:32.847 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-04T09:05:32.847 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-04T09:05:32.847 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-04T09:05:32.847 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modified": "2024-03-04T09:05:16.488678+0000", 2024-03-04T09:05:32.848 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-04T09:05:32.848 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-04T09:05:32.848 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-04T09:05:32.848 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-03-04T09:05:32.848 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:32.136+0000 7fd981e67700 1 Processor -- start 2024-03-04T09:05:32.848 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:32.136+0000 7fd981e67700 1 -- start start 2024-03-04T09:05:32.848 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:32.137+0000 7fd981e67700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd97c106990 0x7fd97c106db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:05:32.848 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:32.137+0000 7fd981e67700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd97c107380 con 0x7fd97c106990 2024-03-04T09:05:32.848 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:32.137+0000 7fd97b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd97c106990 0x7fd97c106db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:05:32.848 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:32.137+0000 7fd97b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd97c106990 0x7fd97c106db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43852/0 (socket says 172.21.15.82:43852) 2024-03-04T09:05:32.848 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:32.137+0000 7fd97b7fe700 1 -- 172.21.15.82:0/2658756681 learned_addr learned my addr 172.21.15.82:0/2658756681 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:05:32.848 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:32.137+0000 7fd97b7fe700 1 -- 172.21.15.82:0/2658756681 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd97c107b90 con 0x7fd97c106990 2024-03-04T09:05:32.848 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:32.137+0000 7fd97b7fe700 1 --2- 172.21.15.82:0/2658756681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd97c106990 0x7fd97c106db0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd96c0098a0 tx=0x7fd96c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba467600e6c36b8d server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:05:32.849 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:32.137+0000 7fd97a7fc700 1 -- 172.21.15.82:0/2658756681 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd96c004160 con 0x7fd97c106990 2024-03-04T09:05:32.849 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:32.137+0000 7fd97a7fc700 1 -- 172.21.15.82:0/2658756681 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd96c004300 con 0x7fd97c106990 2024-03-04T09:05:32.849 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:32.137+0000 7fd97a7fc700 1 -- 172.21.15.82:0/2658756681 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd96c011b40 con 0x7fd97c106990 2024-03-04T09:05:32.849 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:32.138+0000 7fd981e67700 1 -- 172.21.15.82:0/2658756681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd97c106990 msgr2=0x7fd97c106db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:05:32.849 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:32.138+0000 7fd981e67700 1 --2- 172.21.15.82:0/2658756681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd97c106990 0x7fd97c106db0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd96c0098a0 tx=0x7fd96c009bb0 comp rx=0 tx=0).stop 2024-03-04T09:05:32.849 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:32.138+0000 7fd981e67700 1 -- 172.21.15.82:0/2658756681 shutdown_connections 2024-03-04T09:05:32.849 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:32.138+0000 7fd981e67700 1 --2- 172.21.15.82:0/2658756681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd97c106990 0x7fd97c106db0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:05:32.849 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:32.138+0000 7fd981e67700 1 -- 172.21.15.82:0/2658756681 >> 172.21.15.82:0/2658756681 conn(0x7fd97c101f30 msgr2=0x7fd97c104370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:05:32.849 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:32.138+0000 7fd981e67700 1 -- 172.21.15.82:0/2658756681 shutdown_connections 2024-03-04T09:05:32.849 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:32.138+0000 7fd981e67700 1 -- 172.21.15.82:0/2658756681 wait complete. 2024-03-04T09:05:32.849 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:32.139+0000 7fd981e67700 1 Processor -- start 2024-03-04T09:05:32.849 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:32.139+0000 7fd981e67700 1 -- start start 2024-03-04T09:05:32.849 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:32.139+0000 7fd981e67700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd97c106990 0x7fd97c19b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:05:32.849 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:32.139+0000 7fd981e67700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd97c10af40 con 0x7fd97c106990 2024-03-04T09:05:32.849 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:32.139+0000 7fd97b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd97c106990 0x7fd97c19b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:05:32.850 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:32.139+0000 7fd97b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd97c106990 0x7fd97c19b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43860/0 (socket says 172.21.15.82:43860) 2024-03-04T09:05:32.850 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:32.139+0000 7fd97b7fe700 1 -- 172.21.15.82:0/3259747712 learned_addr learned my addr 172.21.15.82:0/3259747712 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:05:32.850 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:32.139+0000 7fd97b7fe700 1 -- 172.21.15.82:0/3259747712 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd97c19bf00 con 0x7fd97c106990 2024-03-04T09:05:32.850 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:32.139+0000 7fd97b7fe700 1 --2- 172.21.15.82:0/3259747712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd97c106990 0x7fd97c19b9c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd96c006af0 tx=0x7fd96c011c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:05:32.850 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:32.139+0000 7fd978ff9700 1 -- 172.21.15.82:0/3259747712 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd96c003970 con 0x7fd97c106990 2024-03-04T09:05:32.850 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:32.139+0000 7fd978ff9700 1 -- 172.21.15.82:0/3259747712 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd96c003b10 con 0x7fd97c106990 2024-03-04T09:05:32.850 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:32.139+0000 7fd981e67700 1 -- 172.21.15.82:0/3259747712 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd97c19c190 con 0x7fd97c106990 2024-03-04T09:05:32.850 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:32.140+0000 7fd978ff9700 1 -- 172.21.15.82:0/3259747712 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd96c0196b0 con 0x7fd97c106990 2024-03-04T09:05:32.850 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:32.140+0000 7fd981e67700 1 -- 172.21.15.82:0/3259747712 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd97c19ee80 con 0x7fd97c106990 2024-03-04T09:05:32.850 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:32.140+0000 7fd978ff9700 1 -- 172.21.15.82:0/3259747712 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 2) v1 ==== 45684+0+0 (secure 0 0 0) 0x7fd96c0199b0 con 0x7fd97c106990 2024-03-04T09:05:32.850 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:32.140+0000 7fd978ff9700 1 -- 172.21.15.82:0/3259747712 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fd96c04cc40 con 0x7fd97c106990 2024-03-04T09:05:32.850 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:32.141+0000 7fd981e67700 1 -- 172.21.15.82:0/3259747712 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd97c0636f0 con 0x7fd97c106990 2024-03-04T09:05:32.850 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:32.143+0000 7fd978ff9700 1 -- 172.21.15.82:0/3259747712 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fd96c02c990 con 0x7fd97c106990 2024-03-04T09:05:32.850 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:32.211+0000 7fd981e67700 1 -- 172.21.15.82:0/3259747712 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fd97c02db00 con 0x7fd97c106990 2024-03-04T09:05:32.851 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:32.212+0000 7fd978ff9700 1 -- 172.21.15.82:0/3259747712 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1239 (secure 0 0 0) 0x7fd96c02cbf0 con 0x7fd97c106990 2024-03-04T09:05:32.851 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:32.212+0000 7fd981e67700 1 -- 172.21.15.82:0/3259747712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd97c106990 msgr2=0x7fd97c19b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:05:32.851 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:32.212+0000 7fd981e67700 1 --2- 172.21.15.82:0/3259747712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd97c106990 0x7fd97c19b9c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd96c006af0 tx=0x7fd96c011c00 comp rx=0 tx=0).stop 2024-03-04T09:05:32.851 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:32.212+0000 7fd981e67700 1 -- 172.21.15.82:0/3259747712 shutdown_connections 2024-03-04T09:05:32.851 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:32.212+0000 7fd981e67700 1 --2- 172.21.15.82:0/3259747712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd97c106990 0x7fd97c19b9c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:05:32.851 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:32.212+0000 7fd981e67700 1 -- 172.21.15.82:0/3259747712 >> 172.21.15.82:0/3259747712 conn(0x7fd97c101f30 msgr2=0x7fd97c102e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:05:32.851 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:32.212+0000 7fd981e67700 1 -- 172.21.15.82:0/3259747712 shutdown_connections 2024-03-04T09:05:32.851 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:32.212+0000 7fd981e67700 1 -- 172.21.15.82:0/3259747712 wait complete. 2024-03-04T09:05:32.851 INFO:teuthology.orchestra.run.smithi082.stdout:mgr not available, waiting (3/15)... 2024-03-04T09:05:35.066 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:34 smithi082 ceph-mon[32880]: mgrmap e4: x(active, since 2s) 2024-03-04T09:05:35.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:35 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/1522657211' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-04T09:05:36.141 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-03-04T09:05:36.141 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-03-04T09:05:36.141 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsid": "2e533fc8-da06-11ee-95c6-87774f69a715", 2024-03-04T09:05:36.141 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "health": { 2024-03-04T09:05:36.141 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-04T09:05:36.141 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-04T09:05:36.141 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-04T09:05:36.141 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-04T09:05:36.142 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-04T09:05:36.142 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-04T09:05:36.142 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 0 2024-03-04T09:05:36.142 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-03-04T09:05:36.142 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-04T09:05:36.142 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "a" 2024-03-04T09:05:36.142 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-03-04T09:05:36.142 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_age": 12, 2024-03-04T09:05:36.142 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-04T09:05:36.142 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-04T09:05:36.142 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-03-04T09:05:36.142 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-04T09:05:36.142 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-04T09:05:36.142 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-04T09:05:36.143 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-04T09:05:36.143 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-04T09:05:36.143 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-04T09:05:36.143 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-04T09:05:36.152 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-04T09:05:36.152 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-04T09:05:36.152 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-04T09:05:36.152 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-04T09:05:36.153 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-04T09:05:36.153 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-04T09:05:36.153 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-04T09:05:36.153 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-04T09:05:36.153 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-04T09:05:36.153 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-04T09:05:36.153 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-04T09:05:36.153 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-04T09:05:36.153 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-04T09:05:36.153 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-04T09:05:36.153 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-04T09:05:36.153 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-04T09:05:36.154 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-04T09:05:36.154 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-04T09:05:36.154 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-04T09:05:36.154 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-04T09:05:36.154 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "available": true, 2024-03-04T09:05:36.154 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-04T09:05:36.154 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-04T09:05:36.154 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-04T09:05:36.154 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-04T09:05:36.154 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "restful" 2024-03-04T09:05:36.154 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-03-04T09:05:36.154 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-04T09:05:36.154 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-04T09:05:36.155 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-04T09:05:36.155 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-04T09:05:36.155 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modified": "2024-03-04T09:05:16.488678+0000", 2024-03-04T09:05:36.155 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-04T09:05:36.155 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-04T09:05:36.155 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-04T09:05:36.155 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-03-04T09:05:36.155 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:35.284+0000 7fd466119700 1 Processor -- start 2024-03-04T09:05:36.155 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:35.284+0000 7fd466119700 1 -- start start 2024-03-04T09:05:36.155 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:35.284+0000 7fd466119700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd460107b10 0x7fd460107f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:05:36.155 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:35.284+0000 7fd466119700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd460108500 con 0x7fd460107b10 2024-03-04T09:05:36.156 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:35.285+0000 7fd45f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd460107b10 0x7fd460107f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:05:36.156 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:35.285+0000 7fd45f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd460107b10 0x7fd460107f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43864/0 (socket says 172.21.15.82:43864) 2024-03-04T09:05:36.156 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:35.285+0000 7fd45f7fe700 1 -- 172.21.15.82:0/2692586830 learned_addr learned my addr 172.21.15.82:0/2692586830 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:05:36.156 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:35.285+0000 7fd45f7fe700 1 -- 172.21.15.82:0/2692586830 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd460108cc0 con 0x7fd460107b10 2024-03-04T09:05:36.156 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:35.285+0000 7fd45f7fe700 1 --2- 172.21.15.82:0/2692586830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd460107b10 0x7fd460107f30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd4500098a0 tx=0x7fd450009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72e36bd695edad98 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:05:36.156 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:35.285+0000 7fd45effd700 1 -- 172.21.15.82:0/2692586830 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd450004160 con 0x7fd460107b10 2024-03-04T09:05:36.156 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:35.285+0000 7fd45effd700 1 -- 172.21.15.82:0/2692586830 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd450004300 con 0x7fd460107b10 2024-03-04T09:05:36.156 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:35.285+0000 7fd45effd700 1 -- 172.21.15.82:0/2692586830 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd450011b40 con 0x7fd460107b10 2024-03-04T09:05:36.156 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:35.286+0000 7fd466119700 1 -- 172.21.15.82:0/2692586830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd460107b10 msgr2=0x7fd460107f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:05:36.156 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:35.286+0000 7fd466119700 1 --2- 172.21.15.82:0/2692586830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd460107b10 0x7fd460107f30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd4500098a0 tx=0x7fd450009bb0 comp rx=0 tx=0).stop 2024-03-04T09:05:36.156 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:35.286+0000 7fd466119700 1 -- 172.21.15.82:0/2692586830 shutdown_connections 2024-03-04T09:05:36.156 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:35.286+0000 7fd466119700 1 --2- 172.21.15.82:0/2692586830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd460107b10 0x7fd460107f30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:05:36.157 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:35.286+0000 7fd466119700 1 -- 172.21.15.82:0/2692586830 >> 172.21.15.82:0/2692586830 conn(0x7fd4601030f0 msgr2=0x7fd460105510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:05:36.157 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:35.286+0000 7fd466119700 1 -- 172.21.15.82:0/2692586830 shutdown_connections 2024-03-04T09:05:36.157 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:35.286+0000 7fd466119700 1 -- 172.21.15.82:0/2692586830 wait complete. 2024-03-04T09:05:36.157 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:35.287+0000 7fd466119700 1 Processor -- start 2024-03-04T09:05:36.157 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:35.287+0000 7fd466119700 1 -- start start 2024-03-04T09:05:36.157 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:35.287+0000 7fd466119700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd460107b10 0x7fd46019ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:05:36.157 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:35.287+0000 7fd466119700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46010c070 con 0x7fd460107b10 2024-03-04T09:05:36.157 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:35.287+0000 7fd45f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd460107b10 0x7fd46019ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:05:36.157 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:35.287+0000 7fd45f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd460107b10 0x7fd46019ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43876/0 (socket says 172.21.15.82:43876) 2024-03-04T09:05:36.157 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:35.287+0000 7fd45f7fe700 1 -- 172.21.15.82:0/1522657211 learned_addr learned my addr 172.21.15.82:0/1522657211 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:05:36.157 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:35.287+0000 7fd45f7fe700 1 -- 172.21.15.82:0/1522657211 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd46019bf60 con 0x7fd460107b10 2024-03-04T09:05:36.157 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:35.287+0000 7fd45f7fe700 1 --2- 172.21.15.82:0/1522657211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd460107b10 0x7fd46019ba20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd450006af0 tx=0x7fd450011c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:05:36.157 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:35.288+0000 7fd45d7fa700 1 -- 172.21.15.82:0/1522657211 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd450003970 con 0x7fd460107b10 2024-03-04T09:05:36.157 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:35.288+0000 7fd466119700 1 -- 172.21.15.82:0/1522657211 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd46019c1f0 con 0x7fd460107b10 2024-03-04T09:05:36.158 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:35.288+0000 7fd45d7fa700 1 -- 172.21.15.82:0/1522657211 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd450003b10 con 0x7fd460107b10 2024-03-04T09:05:36.158 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:35.288+0000 7fd45d7fa700 1 -- 172.21.15.82:0/1522657211 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd4500196b0 con 0x7fd460107b10 2024-03-04T09:05:36.158 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:35.288+0000 7fd466119700 1 -- 172.21.15.82:0/1522657211 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd46019eee0 con 0x7fd460107b10 2024-03-04T09:05:36.158 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:35.289+0000 7fd45d7fa700 1 -- 172.21.15.82:0/1522657211 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 45917+0+0 (secure 0 0 0) 0x7fd4500199b0 con 0x7fd460107b10 2024-03-04T09:05:36.158 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:35.289+0000 7fd466119700 1 -- 172.21.15.82:0/1522657211 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4600636f0 con 0x7fd460107b10 2024-03-04T09:05:36.158 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:35.289+0000 7fd45d7fa700 1 --2- 172.21.15.82:0/1522657211 >> [v2:172.21.15.82:6800/3291527077,v1:172.21.15.82:6801/3291527077] conn(0x7fd44c038b00 0x7fd44c03afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:05:36.158 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:35.289+0000 7fd45d7fa700 1 -- 172.21.15.82:0/1522657211 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fd45004cf70 con 0x7fd460107b10 2024-03-04T09:05:36.158 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:35.289+0000 7fd456ffd700 1 --2- 172.21.15.82:0/1522657211 >> [v2:172.21.15.82:6800/3291527077,v1:172.21.15.82:6801/3291527077] conn(0x7fd44c038b00 0x7fd44c03afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:05:36.158 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:35.289+0000 7fd456ffd700 1 --2- 172.21.15.82:0/1522657211 >> [v2:172.21.15.82:6800/3291527077,v1:172.21.15.82:6801/3291527077] conn(0x7fd44c038b00 0x7fd44c03afc0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd448006fd0 tx=0x7fd448006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:05:36.158 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:35.294+0000 7fd45d7fa700 1 -- 172.21.15.82:0/1522657211 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fd450003cc0 con 0x7fd460107b10 2024-03-04T09:05:36.158 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:35.563+0000 7fd466119700 1 -- 172.21.15.82:0/1522657211 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fd46019f0b0 con 0x7fd460107b10 2024-03-04T09:05:36.158 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:35.563+0000 7fd45d7fa700 1 -- 172.21.15.82:0/1522657211 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1239 (secure 0 0 0) 0x7fd46019f0b0 con 0x7fd460107b10 2024-03-04T09:05:36.158 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:35.565+0000 7fd466119700 1 -- 172.21.15.82:0/1522657211 >> [v2:172.21.15.82:6800/3291527077,v1:172.21.15.82:6801/3291527077] conn(0x7fd44c038b00 msgr2=0x7fd44c03afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:05:36.159 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:35.565+0000 7fd466119700 1 --2- 172.21.15.82:0/1522657211 >> [v2:172.21.15.82:6800/3291527077,v1:172.21.15.82:6801/3291527077] conn(0x7fd44c038b00 0x7fd44c03afc0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd448006fd0 tx=0x7fd448006e40 comp rx=0 tx=0).stop 2024-03-04T09:05:36.159 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:35.565+0000 7fd466119700 1 -- 172.21.15.82:0/1522657211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd460107b10 msgr2=0x7fd46019ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:05:36.159 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:35.565+0000 7fd466119700 1 --2- 172.21.15.82:0/1522657211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd460107b10 0x7fd46019ba20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd450006af0 tx=0x7fd450011c00 comp rx=0 tx=0).stop 2024-03-04T09:05:36.159 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:35.566+0000 7fd466119700 1 -- 172.21.15.82:0/1522657211 shutdown_connections 2024-03-04T09:05:36.159 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:35.566+0000 7fd466119700 1 --2- 172.21.15.82:0/1522657211 >> [v2:172.21.15.82:6800/3291527077,v1:172.21.15.82:6801/3291527077] conn(0x7fd44c038b00 0x7fd44c03afc0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:05:36.159 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:35.566+0000 7fd466119700 1 --2- 172.21.15.82:0/1522657211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd460107b10 0x7fd46019ba20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:05:36.159 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:35.566+0000 7fd466119700 1 -- 172.21.15.82:0/1522657211 >> 172.21.15.82:0/1522657211 conn(0x7fd4601030f0 msgr2=0x7fd460103c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:05:36.159 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:35.566+0000 7fd466119700 1 -- 172.21.15.82:0/1522657211 shutdown_connections 2024-03-04T09:05:36.159 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:35.566+0000 7fd466119700 1 -- 172.21.15.82:0/1522657211 wait complete. 2024-03-04T09:05:36.159 INFO:teuthology.orchestra.run.smithi082.stdout:mgr is available 2024-03-04T09:05:37.066 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:36 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/1586177825' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-03-04T09:05:37.377 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-03-04T09:05:37.377 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout [global] 2024-03-04T09:05:37.377 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout fsid = 2e533fc8-da06-11ee-95c6-87774f69a715 2024-03-04T09:05:37.377 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-03-04T09:05:37.378 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-03-04T09:05:37.378 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-03-04T09:05:37.378 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-03-04T09:05:37.378 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-03-04T09:05:37.378 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout [mgr] 2024-03-04T09:05:37.378 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-03-04T09:05:37.378 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-03-04T09:05:37.378 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout [osd] 2024-03-04T09:05:37.378 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-03-04T09:05:37.378 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-03-04T09:05:37.378 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-03-04T09:05:37.378 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-03-04T09:05:37.379 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-03-04T09:05:37.379 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:36.564+0000 7f053ed79700 1 Processor -- start 2024-03-04T09:05:37.379 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:36.564+0000 7f053ed79700 1 -- start start 2024-03-04T09:05:37.379 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:36.564+0000 7f053ed79700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05381060f0 0x7f0538106510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:05:37.379 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:36.564+0000 7f053ed79700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0538106ae0 con 0x7f05381060f0 2024-03-04T09:05:37.379 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:36.565+0000 7f053cb15700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05381060f0 0x7f0538106510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:05:37.379 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:36.565+0000 7f053cb15700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05381060f0 0x7f0538106510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38746/0 (socket says 172.21.15.82:38746) 2024-03-04T09:05:37.379 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:36.565+0000 7f053cb15700 1 -- 172.21.15.82:0/1978320089 learned_addr learned my addr 172.21.15.82:0/1978320089 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:05:37.379 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:36.565+0000 7f053cb15700 1 -- 172.21.15.82:0/1978320089 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05381072f0 con 0x7f05381060f0 2024-03-04T09:05:37.379 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:36.565+0000 7f053cb15700 1 --2- 172.21.15.82:0/1978320089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05381060f0 0x7f0538106510 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f052c00ac50 tx=0x7f052c00af60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e7907575dbf9f5b server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:05:37.379 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:36.565+0000 7f05377fe700 1 -- 172.21.15.82:0/1978320089 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f052c00b040 con 0x7f05381060f0 2024-03-04T09:05:37.379 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:36.565+0000 7f05377fe700 1 -- 172.21.15.82:0/1978320089 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f052c0044f0 con 0x7f05381060f0 2024-03-04T09:05:37.380 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:36.565+0000 7f05377fe700 1 -- 172.21.15.82:0/1978320089 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f052c003e40 con 0x7f05381060f0 2024-03-04T09:05:37.380 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:36.566+0000 7f053ed79700 1 -- 172.21.15.82:0/1978320089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05381060f0 msgr2=0x7f0538106510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:05:37.380 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:36.566+0000 7f053ed79700 1 --2- 172.21.15.82:0/1978320089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05381060f0 0x7f0538106510 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f052c00ac50 tx=0x7f052c00af60 comp rx=0 tx=0).stop 2024-03-04T09:05:37.380 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:36.566+0000 7f053ed79700 1 -- 172.21.15.82:0/1978320089 shutdown_connections 2024-03-04T09:05:37.380 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:36.566+0000 7f053ed79700 1 --2- 172.21.15.82:0/1978320089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05381060f0 0x7f0538106510 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:05:37.380 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:36.566+0000 7f053ed79700 1 -- 172.21.15.82:0/1978320089 >> 172.21.15.82:0/1978320089 conn(0x7f0538101710 msgr2=0x7f0538103b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:05:37.380 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:36.566+0000 7f053ed79700 1 -- 172.21.15.82:0/1978320089 shutdown_connections 2024-03-04T09:05:37.380 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:36.566+0000 7f053ed79700 1 -- 172.21.15.82:0/1978320089 wait complete. 2024-03-04T09:05:37.380 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:36.566+0000 7f053ed79700 1 Processor -- start 2024-03-04T09:05:37.380 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:36.566+0000 7f053ed79700 1 -- start start 2024-03-04T09:05:37.381 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:36.567+0000 7f053ed79700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05381060f0 0x7f053819ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:05:37.381 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:36.567+0000 7f053ed79700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0538107a10 con 0x7f05381060f0 2024-03-04T09:05:37.381 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:36.567+0000 7f053cb15700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05381060f0 0x7f053819ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:05:37.381 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:36.567+0000 7f053cb15700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05381060f0 0x7f053819ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38750/0 (socket says 172.21.15.82:38750) 2024-03-04T09:05:37.381 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:36.567+0000 7f053cb15700 1 -- 172.21.15.82:0/1586177825 learned_addr learned my addr 172.21.15.82:0/1586177825 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:05:37.381 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:36.567+0000 7f053cb15700 1 -- 172.21.15.82:0/1586177825 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f053819bf60 con 0x7f05381060f0 2024-03-04T09:05:37.381 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:36.567+0000 7f053cb15700 1 --2- 172.21.15.82:0/1586177825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05381060f0 0x7f053819ba20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f052c0046e0 tx=0x7f052c003f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:05:37.381 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:36.567+0000 7f0535ffb700 1 -- 172.21.15.82:0/1586177825 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f052c010510 con 0x7f05381060f0 2024-03-04T09:05:37.381 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:36.567+0000 7f0535ffb700 1 -- 172.21.15.82:0/1586177825 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f052c010b70 con 0x7f05381060f0 2024-03-04T09:05:37.381 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:36.567+0000 7f053ed79700 1 -- 172.21.15.82:0/1586177825 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f053819c1f0 con 0x7f05381060f0 2024-03-04T09:05:37.381 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:36.567+0000 7f0535ffb700 1 -- 172.21.15.82:0/1586177825 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f052c018c30 con 0x7f05381060f0 2024-03-04T09:05:37.381 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:36.567+0000 7f053ed79700 1 -- 172.21.15.82:0/1586177825 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f053819eee0 con 0x7f05381060f0 2024-03-04T09:05:37.381 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:36.568+0000 7f0535ffb700 1 -- 172.21.15.82:0/1586177825 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 45917+0+0 (secure 0 0 0) 0x7f052c01f070 con 0x7f05381060f0 2024-03-04T09:05:37.382 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:36.568+0000 7f0535ffb700 1 --2- 172.21.15.82:0/1586177825 >> [v2:172.21.15.82:6800/3291527077,v1:172.21.15.82:6801/3291527077] conn(0x7f0528038b00 0x7f052803afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:05:37.382 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:36.568+0000 7f053ed79700 1 -- 172.21.15.82:0/1586177825 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05380636f0 con 0x7f05381060f0 2024-03-04T09:05:37.382 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:36.568+0000 7f0535ffb700 1 -- 172.21.15.82:0/1586177825 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f052c04cf60 con 0x7f05381060f0 2024-03-04T09:05:37.382 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:36.568+0000 7f0537fff700 1 --2- 172.21.15.82:0/1586177825 >> [v2:172.21.15.82:6800/3291527077,v1:172.21.15.82:6801/3291527077] conn(0x7f0528038b00 0x7f052803afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:05:37.382 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:36.569+0000 7f0537fff700 1 --2- 172.21.15.82:0/1586177825 >> [v2:172.21.15.82:6800/3291527077,v1:172.21.15.82:6801/3291527077] conn(0x7f0528038b00 0x7f052803afc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0524006fd0 tx=0x7f0524006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:05:37.382 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:36.573+0000 7f0535ffb700 1 -- 172.21.15.82:0/1586177825 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f052c014070 con 0x7f05381060f0 2024-03-04T09:05:37.382 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:36.764+0000 7f053ed79700 1 -- 172.21.15.82:0/1586177825 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f053802dcb0 con 0x7f05381060f0 2024-03-04T09:05:37.382 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:36.765+0000 7f0535ffb700 1 -- 172.21.15.82:0/1586177825 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f052c01f360 con 0x7f05381060f0 2024-03-04T09:05:37.382 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:36.767+0000 7f053ed79700 1 -- 172.21.15.82:0/1586177825 >> [v2:172.21.15.82:6800/3291527077,v1:172.21.15.82:6801/3291527077] conn(0x7f0528038b00 msgr2=0x7f052803afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:05:37.382 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:36.767+0000 7f053ed79700 1 --2- 172.21.15.82:0/1586177825 >> [v2:172.21.15.82:6800/3291527077,v1:172.21.15.82:6801/3291527077] conn(0x7f0528038b00 0x7f052803afc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0524006fd0 tx=0x7f0524006e40 comp rx=0 tx=0).stop 2024-03-04T09:05:37.382 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:36.767+0000 7f053ed79700 1 -- 172.21.15.82:0/1586177825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05381060f0 msgr2=0x7f053819ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:05:37.383 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:36.767+0000 7f053ed79700 1 --2- 172.21.15.82:0/1586177825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05381060f0 0x7f053819ba20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f052c0046e0 tx=0x7f052c003f40 comp rx=0 tx=0).stop 2024-03-04T09:05:37.383 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:36.768+0000 7f053ed79700 1 -- 172.21.15.82:0/1586177825 shutdown_connections 2024-03-04T09:05:37.383 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:36.768+0000 7f053ed79700 1 --2- 172.21.15.82:0/1586177825 >> [v2:172.21.15.82:6800/3291527077,v1:172.21.15.82:6801/3291527077] conn(0x7f0528038b00 0x7f052803afc0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:05:37.383 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:36.768+0000 7f053ed79700 1 --2- 172.21.15.82:0/1586177825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05381060f0 0x7f053819ba20 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:05:37.383 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:36.768+0000 7f053ed79700 1 -- 172.21.15.82:0/1586177825 >> 172.21.15.82:0/1586177825 conn(0x7f0538101710 msgr2=0x7f0538190450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:05:37.383 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:36.768+0000 7f053ed79700 1 -- 172.21.15.82:0/1586177825 shutdown_connections 2024-03-04T09:05:37.383 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:36.768+0000 7f053ed79700 1 -- 172.21.15.82:0/1586177825 wait complete. 2024-03-04T09:05:37.383 INFO:teuthology.orchestra.run.smithi082.stdout:Enabling cephadm module... 2024-03-04T09:05:38.316 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:38 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/1385734242' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-03-04T09:05:38.316 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:38 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: ignoring --setuser ceph since I am not root 2024-03-04T09:05:38.316 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:38 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: ignoring --setgroup ceph since I am not root 2024-03-04T09:05:38.681 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:37.798+0000 7f3aa15f2700 1 Processor -- start 2024-03-04T09:05:38.681 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:37.798+0000 7f3aa15f2700 1 -- start start 2024-03-04T09:05:38.681 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:37.798+0000 7f3aa15f2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a9c107b30 0x7f3a9c107f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:05:38.681 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:37.798+0000 7f3aa15f2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9c108520 con 0x7f3a9c107b30 2024-03-04T09:05:38.681 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:37.799+0000 7f3a9affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a9c107b30 0x7f3a9c107f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:05:38.681 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:37.799+0000 7f3a9affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a9c107b30 0x7f3a9c107f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38752/0 (socket says 172.21.15.82:38752) 2024-03-04T09:05:38.681 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:37.799+0000 7f3a9affd700 1 -- 172.21.15.82:0/2411435594 learned_addr learned my addr 172.21.15.82:0/2411435594 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:05:38.681 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:37.799+0000 7f3a9affd700 1 -- 172.21.15.82:0/2411435594 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a9c108ce0 con 0x7f3a9c107b30 2024-03-04T09:05:38.681 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:37.799+0000 7f3a9affd700 1 --2- 172.21.15.82:0/2411435594 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a9c107b30 0x7f3a9c107f50 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c0098a0 tx=0x7f3a8c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7e6d63fc85f7854 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:05:38.681 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:37.799+0000 7f3a99ffb700 1 -- 172.21.15.82:0/2411435594 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a8c004160 con 0x7f3a9c107b30 2024-03-04T09:05:38.681 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:37.799+0000 7f3a99ffb700 1 -- 172.21.15.82:0/2411435594 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3a8c004300 con 0x7f3a9c107b30 2024-03-04T09:05:38.682 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:37.799+0000 7f3a99ffb700 1 -- 172.21.15.82:0/2411435594 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a8c011b40 con 0x7f3a9c107b30 2024-03-04T09:05:38.682 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:37.800+0000 7f3aa15f2700 1 -- 172.21.15.82:0/2411435594 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a9c107b30 msgr2=0x7f3a9c107f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:05:38.682 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:37.800+0000 7f3aa15f2700 1 --2- 172.21.15.82:0/2411435594 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a9c107b30 0x7f3a9c107f50 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c0098a0 tx=0x7f3a8c009bb0 comp rx=0 tx=0).stop 2024-03-04T09:05:38.682 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:37.800+0000 7f3aa15f2700 1 -- 172.21.15.82:0/2411435594 shutdown_connections 2024-03-04T09:05:38.682 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:37.800+0000 7f3aa15f2700 1 --2- 172.21.15.82:0/2411435594 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a9c107b30 0x7f3a9c107f50 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:05:38.682 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:37.800+0000 7f3aa15f2700 1 -- 172.21.15.82:0/2411435594 >> 172.21.15.82:0/2411435594 conn(0x7f3a9c1030f0 msgr2=0x7f3a9c105510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:05:38.682 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:37.800+0000 7f3aa15f2700 1 -- 172.21.15.82:0/2411435594 shutdown_connections 2024-03-04T09:05:38.682 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:37.800+0000 7f3aa15f2700 1 -- 172.21.15.82:0/2411435594 wait complete. 2024-03-04T09:05:38.682 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:37.800+0000 7f3aa15f2700 1 Processor -- start 2024-03-04T09:05:38.682 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:37.801+0000 7f3aa15f2700 1 -- start start 2024-03-04T09:05:38.682 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:37.801+0000 7f3aa15f2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a9c107b30 0x7f3a9c19ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:05:38.682 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:37.801+0000 7f3aa15f2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9c10c090 con 0x7f3a9c107b30 2024-03-04T09:05:38.682 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:37.801+0000 7f3a9affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a9c107b30 0x7f3a9c19ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:05:38.682 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:37.801+0000 7f3a9affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a9c107b30 0x7f3a9c19ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38764/0 (socket says 172.21.15.82:38764) 2024-03-04T09:05:38.683 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:37.801+0000 7f3a9affd700 1 -- 172.21.15.82:0/1385734242 learned_addr learned my addr 172.21.15.82:0/1385734242 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:05:38.683 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:37.801+0000 7f3a9affd700 1 -- 172.21.15.82:0/1385734242 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a9c19bfd0 con 0x7f3a9c107b30 2024-03-04T09:05:38.683 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:37.801+0000 7f3a9affd700 1 --2- 172.21.15.82:0/1385734242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a9c107b30 0x7f3a9c19ba90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c011840 tx=0x7f3a8c004230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:05:38.683 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:37.801+0000 7f3a83fff700 1 -- 172.21.15.82:0/1385734242 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a8c0038b0 con 0x7f3a9c107b30 2024-03-04T09:05:38.683 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:37.801+0000 7f3a83fff700 1 -- 172.21.15.82:0/1385734242 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3a8c01a430 con 0x7f3a9c107b30 2024-03-04T09:05:38.683 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:37.801+0000 7f3aa15f2700 1 -- 172.21.15.82:0/1385734242 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a9c19c260 con 0x7f3a9c107b30 2024-03-04T09:05:38.683 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:37.801+0000 7f3a83fff700 1 -- 172.21.15.82:0/1385734242 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a8c024650 con 0x7f3a9c107b30 2024-03-04T09:05:38.683 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:37.802+0000 7f3aa15f2700 1 -- 172.21.15.82:0/1385734242 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a9c19ef50 con 0x7f3a9c107b30 2024-03-04T09:05:38.683 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:37.802+0000 7f3a83fff700 1 -- 172.21.15.82:0/1385734242 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 45917+0+0 (secure 0 0 0) 0x7f3a8c022020 con 0x7f3a9c107b30 2024-03-04T09:05:38.683 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:37.803+0000 7f3a83fff700 1 --2- 172.21.15.82:0/1385734242 >> [v2:172.21.15.82:6800/3291527077,v1:172.21.15.82:6801/3291527077] conn(0x7f3a84038b50 0x7f3a8403b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:05:38.683 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:37.803+0000 7f3aa15f2700 1 -- 172.21.15.82:0/1385734242 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a9c0636f0 con 0x7f3a9c107b30 2024-03-04T09:05:38.683 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:37.803+0000 7f3a83fff700 1 -- 172.21.15.82:0/1385734242 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f3a8c04c490 con 0x7f3a9c107b30 2024-03-04T09:05:38.683 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:37.803+0000 7f3a9a7fc700 1 --2- 172.21.15.82:0/1385734242 >> [v2:172.21.15.82:6800/3291527077,v1:172.21.15.82:6801/3291527077] conn(0x7f3a84038b50 0x7f3a8403b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:05:38.683 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:37.803+0000 7f3a9a7fc700 1 --2- 172.21.15.82:0/1385734242 >> [v2:172.21.15.82:6800/3291527077,v1:172.21.15.82:6801/3291527077] conn(0x7f3a84038b50 0x7f3a8403b010 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3a90006fd0 tx=0x7f3a90006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:05:38.683 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:37.808+0000 7f3a83fff700 1 -- 172.21.15.82:0/1385734242 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f3a8c00e260 con 0x7f3a9c107b30 2024-03-04T09:05:38.684 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:38.056+0000 7f3aa15f2700 1 -- 172.21.15.82:0/1385734242 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f3a9c19f120 con 0x7f3a9c107b30 2024-03-04T09:05:38.684 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:38.108+0000 7f3a83fff700 1 -- 172.21.15.82:0/1385734242 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f3a8c01a5e0 con 0x7f3a9c107b30 2024-03-04T09:05:38.684 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:38.110+0000 7f3a83fff700 1 -- 172.21.15.82:0/1385734242 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mgrmap(e 5) v1 ==== 45928+0+0 (secure 0 0 0) 0x7f3a8c02cca0 con 0x7f3a9c107b30 2024-03-04T09:05:38.684 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:38.111+0000 7f3aa15f2700 1 -- 172.21.15.82:0/1385734242 >> [v2:172.21.15.82:6800/3291527077,v1:172.21.15.82:6801/3291527077] conn(0x7f3a84038b50 msgr2=0x7f3a8403b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:05:38.684 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:38.111+0000 7f3aa15f2700 1 --2- 172.21.15.82:0/1385734242 >> [v2:172.21.15.82:6800/3291527077,v1:172.21.15.82:6801/3291527077] conn(0x7f3a84038b50 0x7f3a8403b010 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3a90006fd0 tx=0x7f3a90006e40 comp rx=0 tx=0).stop 2024-03-04T09:05:38.684 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:38.111+0000 7f3aa15f2700 1 -- 172.21.15.82:0/1385734242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a9c107b30 msgr2=0x7f3a9c19ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:05:38.684 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:38.111+0000 7f3aa15f2700 1 --2- 172.21.15.82:0/1385734242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a9c107b30 0x7f3a9c19ba90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c011840 tx=0x7f3a8c004230 comp rx=0 tx=0).stop 2024-03-04T09:05:38.684 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:38.111+0000 7f3aa15f2700 1 -- 172.21.15.82:0/1385734242 shutdown_connections 2024-03-04T09:05:38.684 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:38.111+0000 7f3aa15f2700 1 --2- 172.21.15.82:0/1385734242 >> [v2:172.21.15.82:6800/3291527077,v1:172.21.15.82:6801/3291527077] conn(0x7f3a84038b50 0x7f3a8403b010 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:05:38.684 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:38.111+0000 7f3aa15f2700 1 --2- 172.21.15.82:0/1385734242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a9c107b30 0x7f3a9c19ba90 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:05:38.684 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:38.111+0000 7f3aa15f2700 1 -- 172.21.15.82:0/1385734242 >> 172.21.15.82:0/1385734242 conn(0x7f3a9c1030f0 msgr2=0x7f3a9c103c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:05:38.684 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:38.111+0000 7f3aa15f2700 1 -- 172.21.15.82:0/1385734242 shutdown_connections 2024-03-04T09:05:38.684 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:38.111+0000 7f3aa15f2700 1 -- 172.21.15.82:0/1385734242 wait complete. 2024-03-04T09:05:38.756 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:38 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:05:38.660+0000 7f91fa9f7200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-04T09:05:38.757 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:38 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:05:38.760+0000 7f91fa9f7200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-04T09:05:39.314 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:39 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/1385734242' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-03-04T09:05:39.314 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:39 smithi082 ceph-mon[32880]: mgrmap e5: x(active, since 6s) 2024-03-04T09:05:39.566 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:39 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:05:39.417+0000 7f91fa9f7200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-04T09:05:39.566 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:39 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:05:39.511+0000 7f91fa9f7200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-04T09:05:40.012 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:39 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:05:39.653+0000 7f91fa9f7200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-04T09:05:40.012 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:39 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:05:39.748+0000 7f91fa9f7200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-04T09:05:40.012 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:39 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:05:39.831+0000 7f91fa9f7200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-04T09:05:40.020 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-03-04T09:05:40.020 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-03-04T09:05:40.020 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "available": true, 2024-03-04T09:05:40.020 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-03-04T09:05:40.020 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-03-04T09:05:40.020 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-03-04T09:05:40.020 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:39.111+0000 7f4033033700 1 Processor -- start 2024-03-04T09:05:40.021 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:39.111+0000 7f4033033700 1 -- start start 2024-03-04T09:05:40.021 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:39.111+0000 7f4033033700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f402c105d80 0x7f402c1061a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:05:40.021 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:39.111+0000 7f4033033700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f402c106770 con 0x7f402c105d80 2024-03-04T09:05:40.021 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:39.111+0000 7f4030dcf700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f402c105d80 0x7f402c1061a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:05:40.021 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:39.111+0000 7f4030dcf700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f402c105d80 0x7f402c1061a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38782/0 (socket says 172.21.15.82:38782) 2024-03-04T09:05:40.021 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:39.111+0000 7f4030dcf700 1 -- 172.21.15.82:0/4069869813 learned_addr learned my addr 172.21.15.82:0/4069869813 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:05:40.021 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:39.112+0000 7f4030dcf700 1 -- 172.21.15.82:0/4069869813 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f402c108d10 con 0x7f402c105d80 2024-03-04T09:05:40.021 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:39.112+0000 7f4030dcf700 1 --2- 172.21.15.82:0/4069869813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f402c105d80 0x7f402c1061a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f40200098a0 tx=0x7f4020009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89d8bbe0c0cc8955 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:05:40.021 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:39.114+0000 7f402b7fe700 1 -- 172.21.15.82:0/4069869813 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4020004160 con 0x7f402c105d80 2024-03-04T09:05:40.021 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:39.114+0000 7f402b7fe700 1 -- 172.21.15.82:0/4069869813 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4020004300 con 0x7f402c105d80 2024-03-04T09:05:40.021 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:39.114+0000 7f402b7fe700 1 -- 172.21.15.82:0/4069869813 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4020011b40 con 0x7f402c105d80 2024-03-04T09:05:40.021 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:39.114+0000 7f4033033700 1 -- 172.21.15.82:0/4069869813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f402c105d80 msgr2=0x7f402c1061a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:05:40.021 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:39.114+0000 7f4033033700 1 --2- 172.21.15.82:0/4069869813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f402c105d80 0x7f402c1061a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f40200098a0 tx=0x7f4020009bb0 comp rx=0 tx=0).stop 2024-03-04T09:05:40.022 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:39.114+0000 7f4033033700 1 -- 172.21.15.82:0/4069869813 shutdown_connections 2024-03-04T09:05:40.022 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:39.114+0000 7f4033033700 1 --2- 172.21.15.82:0/4069869813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f402c105d80 0x7f402c1061a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:05:40.022 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:39.114+0000 7f4033033700 1 -- 172.21.15.82:0/4069869813 >> 172.21.15.82:0/4069869813 conn(0x7f402c1016f0 msgr2=0x7f402c103b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:05:40.022 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:39.114+0000 7f4033033700 1 -- 172.21.15.82:0/4069869813 shutdown_connections 2024-03-04T09:05:40.022 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:39.114+0000 7f4033033700 1 -- 172.21.15.82:0/4069869813 wait complete. 2024-03-04T09:05:40.022 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:39.115+0000 7f4033033700 1 Processor -- start 2024-03-04T09:05:40.022 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:39.115+0000 7f4033033700 1 -- start start 2024-03-04T09:05:40.022 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:39.115+0000 7f4033033700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f402c105d80 0x7f402c19b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:05:40.022 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:39.115+0000 7f4033033700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f402c10c0c0 con 0x7f402c105d80 2024-03-04T09:05:40.022 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:39.115+0000 7f4030dcf700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f402c105d80 0x7f402c19b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:05:40.022 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:39.115+0000 7f4030dcf700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f402c105d80 0x7f402c19b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38792/0 (socket says 172.21.15.82:38792) 2024-03-04T09:05:40.022 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:39.115+0000 7f4030dcf700 1 -- 172.21.15.82:0/3797014802 learned_addr learned my addr 172.21.15.82:0/3797014802 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:05:40.022 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:39.116+0000 7f4030dcf700 1 -- 172.21.15.82:0/3797014802 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f402c19bee0 con 0x7f402c105d80 2024-03-04T09:05:40.022 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:39.116+0000 7f4030dcf700 1 --2- 172.21.15.82:0/3797014802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f402c105d80 0x7f402c19b9a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4020011670 tx=0x7f4020011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:05:40.023 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:39.116+0000 7f4029ffb700 1 -- 172.21.15.82:0/3797014802 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f40200037d0 con 0x7f402c105d80 2024-03-04T09:05:40.023 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:39.116+0000 7f4029ffb700 1 -- 172.21.15.82:0/3797014802 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f402001a430 con 0x7f402c105d80 2024-03-04T09:05:40.023 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:39.116+0000 7f4033033700 1 -- 172.21.15.82:0/3797014802 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f402c19c170 con 0x7f402c105d80 2024-03-04T09:05:40.023 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:39.116+0000 7f4029ffb700 1 -- 172.21.15.82:0/3797014802 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4020019550 con 0x7f402c105d80 2024-03-04T09:05:40.023 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:39.116+0000 7f4033033700 1 -- 172.21.15.82:0/3797014802 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f402c19ee60 con 0x7f402c105d80 2024-03-04T09:05:40.023 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:39.117+0000 7f4029ffb700 1 -- 172.21.15.82:0/3797014802 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 45928+0+0 (secure 0 0 0) 0x7f4020022020 con 0x7f402c105d80 2024-03-04T09:05:40.023 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:39.117+0000 7f4033033700 1 -- 172.21.15.82:0/3797014802 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f402c0636f0 con 0x7f402c105d80 2024-03-04T09:05:40.023 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:39.117+0000 7f4029ffb700 1 --2- 172.21.15.82:0/3797014802 >> [v2:172.21.15.82:6800/3291527077,v1:172.21.15.82:6801/3291527077] conn(0x7f401c038ba0 0x7f401c03b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:05:40.023 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:39.117+0000 7f4029ffb700 1 -- 172.21.15.82:0/3797014802 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f402004c660 con 0x7f402c105d80 2024-03-04T09:05:40.023 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:39.117+0000 7f402bfff700 1 -- 172.21.15.82:0/3797014802 >> [v2:172.21.15.82:6800/3291527077,v1:172.21.15.82:6801/3291527077] conn(0x7f401c038ba0 msgr2=0x7f401c03b060 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3291527077 2024-03-04T09:05:40.023 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:39.117+0000 7f402bfff700 1 --2- 172.21.15.82:0/3797014802 >> [v2:172.21.15.82:6800/3291527077,v1:172.21.15.82:6801/3291527077] conn(0x7f401c038ba0 0x7f401c03b060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-04T09:05:40.023 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:39.122+0000 7f4029ffb700 1 -- 172.21.15.82:0/3797014802 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f402002b510 con 0x7f402c105d80 2024-03-04T09:05:40.023 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:39.318+0000 7f402bfff700 1 -- 172.21.15.82:0/3797014802 >> [v2:172.21.15.82:6800/3291527077,v1:172.21.15.82:6801/3291527077] conn(0x7f401c038ba0 msgr2=0x7f401c03b060 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3291527077 2024-03-04T09:05:40.023 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:39.318+0000 7f402bfff700 1 --2- 172.21.15.82:0/3797014802 >> [v2:172.21.15.82:6800/3291527077,v1:172.21.15.82:6801/3291527077] conn(0x7f401c038ba0 0x7f401c03b060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-04T09:05:40.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:39.377+0000 7f4033033700 1 -- 172.21.15.82:0/3797014802 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f402c19f030 con 0x7f402c105d80 2024-03-04T09:05:40.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:39.377+0000 7f4029ffb700 1 -- 172.21.15.82:0/3797014802 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+88 (secure 0 0 0) 0x7f402c19f030 con 0x7f402c105d80 2024-03-04T09:05:40.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:39.379+0000 7f4033033700 1 -- 172.21.15.82:0/3797014802 >> [v2:172.21.15.82:6800/3291527077,v1:172.21.15.82:6801/3291527077] conn(0x7f401c038ba0 msgr2=0x7f401c03b060 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-04T09:05:40.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:39.379+0000 7f4033033700 1 --2- 172.21.15.82:0/3797014802 >> [v2:172.21.15.82:6800/3291527077,v1:172.21.15.82:6801/3291527077] conn(0x7f401c038ba0 0x7f401c03b060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:05:40.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:39.379+0000 7f4033033700 1 -- 172.21.15.82:0/3797014802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f402c105d80 msgr2=0x7f402c19b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:05:40.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:39.379+0000 7f4033033700 1 --2- 172.21.15.82:0/3797014802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f402c105d80 0x7f402c19b9a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4020011670 tx=0x7f4020011920 comp rx=0 tx=0).stop 2024-03-04T09:05:40.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:39.380+0000 7f4033033700 1 -- 172.21.15.82:0/3797014802 shutdown_connections 2024-03-04T09:05:40.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:39.380+0000 7f4033033700 1 --2- 172.21.15.82:0/3797014802 >> [v2:172.21.15.82:6800/3291527077,v1:172.21.15.82:6801/3291527077] conn(0x7f401c038ba0 0x7f401c03b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:05:40.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:39.380+0000 7f4033033700 1 --2- 172.21.15.82:0/3797014802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f402c105d80 0x7f402c19b9a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:05:40.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:39.380+0000 7f4033033700 1 -- 172.21.15.82:0/3797014802 >> 172.21.15.82:0/3797014802 conn(0x7f402c1016f0 msgr2=0x7f402c1021b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:05:40.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:39.380+0000 7f4033033700 1 -- 172.21.15.82:0/3797014802 shutdown_connections 2024-03-04T09:05:40.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:39.380+0000 7f4033033700 1 -- 172.21.15.82:0/3797014802 wait complete. 2024-03-04T09:05:40.024 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for the mgr to restart... 2024-03-04T09:05:40.024 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for mgr epoch 5... 2024-03-04T09:05:40.299 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:40 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/3797014802' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-03-04T09:05:40.299 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:40 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:05:40.101+0000 7f91fa9f7200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-04T09:05:40.300 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:40 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:05:40.212+0000 7f91fa9f7200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-04T09:05:40.300 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:40 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:05:40.303+0000 7f91fa9f7200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-04T09:05:40.566 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:40 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:05:40.398+0000 7f91fa9f7200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-04T09:05:41.066 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:40 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:05:40.580+0000 7f91fa9f7200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-04T09:05:41.816 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:41 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:05:41.532+0000 7f91fa9f7200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-04T09:05:41.816 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:41 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:05:41.662+0000 7f91fa9f7200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-04T09:05:42.282 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:42 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:05:42.004+0000 7f91fa9f7200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-04T09:05:42.282 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:42 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:05:42.093+0000 7f91fa9f7200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-04T09:05:42.282 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:42 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:05:42.286+0000 7f91fa9f7200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-04T09:05:42.566 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:42 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:05:42.467+0000 7f91fa9f7200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-04T09:05:42.999 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:42 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:05:42.748+0000 7f91fa9f7200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-04T09:05:43.316 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:43 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:05:43.003+0000 7f91fa9f7200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-04T09:05:43.316 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:43 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:05:43.235+0000 7f91fa9f7200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-04T09:05:44.316 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:44 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:05:44.022+0000 7f91fa9f7200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-04T09:05:44.894 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:44 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:05:44.586+0000 7f91fa9f7200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-04T09:05:44.894 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:44 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:05:44.683+0000 7f91fa9f7200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-04T09:05:44.895 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:44 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:05:44.898+0000 7f91fa9f7200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-04T09:05:45.316 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:44 smithi082 ceph-mon[32880]: Active manager daemon x restarted 2024-03-04T09:05:45.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:44 smithi082 ceph-mon[32880]: Activating manager daemon x 2024-03-04T09:05:45.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:44 smithi082 ceph-mon[32880]: osdmap e2: 0 total, 0 up, 0 in 2024-03-04T09:05:45.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:44 smithi082 ceph-mon[32880]: mgrmap e6: x(active, starting, since 0.00341655s) 2024-03-04T09:05:45.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:44 smithi082 ceph-mon[32880]: from='mgr.14120 172.21.15.82:0/998079227' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T09:05:45.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:44 smithi082 ceph-mon[32880]: from='mgr.14120 172.21.15.82:0/998079227' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-04T09:05:45.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:44 smithi082 ceph-mon[32880]: from='mgr.14120 172.21.15.82:0/998079227' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-04T09:05:45.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:44 smithi082 ceph-mon[32880]: from='mgr.14120 172.21.15.82:0/998079227' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-04T09:05:45.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:44 smithi082 ceph-mon[32880]: from='mgr.14120 172.21.15.82:0/998079227' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-04T09:05:45.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:44 smithi082 ceph-mon[32880]: Manager daemon x is now available 2024-03-04T09:05:45.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:44 smithi082 ceph-mon[32880]: from='mgr.14120 172.21.15.82:0/998079227' entity='mgr.x' 2024-03-04T09:05:45.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:44 smithi082 ceph-mon[32880]: from='mgr.14120 172.21.15.82:0/998079227' entity='mgr.x' 2024-03-04T09:05:45.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:44 smithi082 ceph-mon[32880]: from='mgr.14120 172.21.15.82:0/998079227' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:05:45.318 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:44 smithi082 ceph-mon[32880]: from='mgr.14120 172.21.15.82:0/998079227' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:05:45.318 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:44 smithi082 ceph-mon[32880]: from='mgr.14120 172.21.15.82:0/998079227' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:05:46.243 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:45 smithi082 ceph-mon[32880]: Found migration_current of "None". Setting to last migration. 2024-03-04T09:05:46.243 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:45 smithi082 ceph-mon[32880]: from='mgr.14120 172.21.15.82:0/998079227' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-04T09:05:46.243 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:45 smithi082 ceph-mon[32880]: from='mgr.14120 172.21.15.82:0/998079227' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-04T09:05:46.243 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:45 smithi082 ceph-mon[32880]: from='mgr.14120 172.21.15.82:0/998079227' entity='mgr.x' 2024-03-04T09:05:46.243 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:45 smithi082 ceph-mon[32880]: from='mgr.14120 172.21.15.82:0/998079227' entity='mgr.x' 2024-03-04T09:05:46.243 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:45 smithi082 ceph-mon[32880]: mgrmap e7: x(active, since 1.00639s) 2024-03-04T09:05:46.521 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-03-04T09:05:46.521 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-03-04T09:05:46.521 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "initialized": true 2024-03-04T09:05:46.521 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-03-04T09:05:46.521 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:40.506+0000 7fd9ef85f700 1 Processor -- start 2024-03-04T09:05:46.522 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:40.506+0000 7fd9ef85f700 1 -- start start 2024-03-04T09:05:46.522 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:40.506+0000 7fd9ef85f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9e81084f0 0x7fd9e810a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:05:46.522 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:40.506+0000 7fd9ef85f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e807be30 con 0x7fd9e81084f0 2024-03-04T09:05:46.522 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:40.506+0000 7fd9ed5fb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9e81084f0 0x7fd9e810a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:05:46.522 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:40.506+0000 7fd9ed5fb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9e81084f0 0x7fd9e810a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38800/0 (socket says 172.21.15.82:38800) 2024-03-04T09:05:46.522 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:40.506+0000 7fd9ed5fb700 1 -- 172.21.15.82:0/2979342516 learned_addr learned my addr 172.21.15.82:0/2979342516 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:05:46.522 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:40.507+0000 7fd9ed5fb700 1 -- 172.21.15.82:0/2979342516 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e810ae20 con 0x7fd9e81084f0 2024-03-04T09:05:46.522 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:40.507+0000 7fd9ed5fb700 1 --2- 172.21.15.82:0/2979342516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9e81084f0 0x7fd9e810a8e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd9e40098a0 tx=0x7fd9e4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d415047e0f879a9 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:05:46.522 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:40.507+0000 7fd9dffff700 1 -- 172.21.15.82:0/2979342516 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd9e4004160 con 0x7fd9e81084f0 2024-03-04T09:05:46.522 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:40.507+0000 7fd9dffff700 1 -- 172.21.15.82:0/2979342516 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd9e4004300 con 0x7fd9e81084f0 2024-03-04T09:05:46.522 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:40.507+0000 7fd9dffff700 1 -- 172.21.15.82:0/2979342516 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd9e4011b40 con 0x7fd9e81084f0 2024-03-04T09:05:46.522 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:40.508+0000 7fd9ef85f700 1 -- 172.21.15.82:0/2979342516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9e81084f0 msgr2=0x7fd9e810a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:05:46.522 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:40.508+0000 7fd9ef85f700 1 --2- 172.21.15.82:0/2979342516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9e81084f0 0x7fd9e810a8e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd9e40098a0 tx=0x7fd9e4009bb0 comp rx=0 tx=0).stop 2024-03-04T09:05:46.523 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:40.508+0000 7fd9ef85f700 1 -- 172.21.15.82:0/2979342516 shutdown_connections 2024-03-04T09:05:46.523 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:40.508+0000 7fd9ef85f700 1 --2- 172.21.15.82:0/2979342516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9e81084f0 0x7fd9e810a8e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:05:46.523 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:40.508+0000 7fd9ef85f700 1 -- 172.21.15.82:0/2979342516 >> 172.21.15.82:0/2979342516 conn(0x7fd9e8101f00 msgr2=0x7fd9e8104340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:05:46.523 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:40.508+0000 7fd9ef85f700 1 -- 172.21.15.82:0/2979342516 shutdown_connections 2024-03-04T09:05:46.523 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:40.508+0000 7fd9ef85f700 1 -- 172.21.15.82:0/2979342516 wait complete. 2024-03-04T09:05:46.523 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:40.509+0000 7fd9ef85f700 1 Processor -- start 2024-03-04T09:05:46.523 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:40.509+0000 7fd9ef85f700 1 -- start start 2024-03-04T09:05:46.523 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:40.509+0000 7fd9ef85f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9e81084f0 0x7fd9e8107d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:05:46.523 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:40.509+0000 7fd9ef85f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e810bd70 con 0x7fd9e81084f0 2024-03-04T09:05:46.523 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:40.509+0000 7fd9ed5fb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9e81084f0 0x7fd9e8107d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:05:46.523 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:40.509+0000 7fd9ed5fb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9e81084f0 0x7fd9e8107d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38804/0 (socket says 172.21.15.82:38804) 2024-03-04T09:05:46.523 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:40.509+0000 7fd9ed5fb700 1 -- 172.21.15.82:0/1770752562 learned_addr learned my addr 172.21.15.82:0/1770752562 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:05:46.523 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:40.509+0000 7fd9ed5fb700 1 -- 172.21.15.82:0/1770752562 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e81082b0 con 0x7fd9e81084f0 2024-03-04T09:05:46.523 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:40.509+0000 7fd9ed5fb700 1 --2- 172.21.15.82:0/1770752562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9e81084f0 0x7fd9e8107d70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4006af0 tx=0x7fd9e4011c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:05:46.523 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:40.510+0000 7fd9de7fc700 1 -- 172.21.15.82:0/1770752562 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd9e4003970 con 0x7fd9e81084f0 2024-03-04T09:05:46.524 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:40.510+0000 7fd9de7fc700 1 -- 172.21.15.82:0/1770752562 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd9e4003b10 con 0x7fd9e81084f0 2024-03-04T09:05:46.524 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:40.510+0000 7fd9ef85f700 1 -- 172.21.15.82:0/1770752562 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9e81064a0 con 0x7fd9e81084f0 2024-03-04T09:05:46.524 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:40.510+0000 7fd9ef85f700 1 -- 172.21.15.82:0/1770752562 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9e81069e0 con 0x7fd9e81084f0 2024-03-04T09:05:46.524 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:40.510+0000 7fd9de7fc700 1 -- 172.21.15.82:0/1770752562 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd9e40196c0 con 0x7fd9e81084f0 2024-03-04T09:05:46.524 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:40.510+0000 7fd9de7fc700 1 -- 172.21.15.82:0/1770752562 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 45928+0+0 (secure 0 0 0) 0x7fd9e4019970 con 0x7fd9e81084f0 2024-03-04T09:05:46.524 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:40.511+0000 7fd9de7fc700 1 --2- 172.21.15.82:0/1770752562 >> [v2:172.21.15.82:6800/3291527077,v1:172.21.15.82:6801/3291527077] conn(0x7fd9d4038ba0 0x7fd9d403b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:05:46.524 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:40.511+0000 7fd9ef85f700 1 -- 172.21.15.82:0/1770752562 --> [v2:172.21.15.82:6800/3291527077,v1:172.21.15.82:6801/3291527077] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd9cc000d40 con 0x7fd9d4038ba0 2024-03-04T09:05:46.524 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:40.511+0000 7fd9de7fc700 1 -- 172.21.15.82:0/1770752562 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fd9e404ded0 con 0x7fd9e81084f0 2024-03-04T09:05:46.524 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:40.511+0000 7fd9ecdfa700 1 -- 172.21.15.82:0/1770752562 >> [v2:172.21.15.82:6800/3291527077,v1:172.21.15.82:6801/3291527077] conn(0x7fd9d4038ba0 msgr2=0x7fd9d403b060 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3291527077 2024-03-04T09:05:46.524 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:40.511+0000 7fd9ecdfa700 1 --2- 172.21.15.82:0/1770752562 >> [v2:172.21.15.82:6800/3291527077,v1:172.21.15.82:6801/3291527077] conn(0x7fd9d4038ba0 0x7fd9d403b060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-04T09:05:46.524 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:40.712+0000 7fd9ecdfa700 1 -- 172.21.15.82:0/1770752562 >> [v2:172.21.15.82:6800/3291527077,v1:172.21.15.82:6801/3291527077] conn(0x7fd9d4038ba0 msgr2=0x7fd9d403b060 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3291527077 2024-03-04T09:05:46.524 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:40.712+0000 7fd9ecdfa700 1 --2- 172.21.15.82:0/1770752562 >> [v2:172.21.15.82:6800/3291527077,v1:172.21.15.82:6801/3291527077] conn(0x7fd9d4038ba0 0x7fd9d403b060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-04T09:05:46.524 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:41.113+0000 7fd9ecdfa700 1 -- 172.21.15.82:0/1770752562 >> [v2:172.21.15.82:6800/3291527077,v1:172.21.15.82:6801/3291527077] conn(0x7fd9d4038ba0 msgr2=0x7fd9d403b060 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3291527077 2024-03-04T09:05:46.525 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:41.113+0000 7fd9ecdfa700 1 --2- 172.21.15.82:0/1770752562 >> [v2:172.21.15.82:6800/3291527077,v1:172.21.15.82:6801/3291527077] conn(0x7fd9d4038ba0 0x7fd9d403b060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-04T09:05:46.525 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:41.914+0000 7fd9ecdfa700 1 -- 172.21.15.82:0/1770752562 >> [v2:172.21.15.82:6800/3291527077,v1:172.21.15.82:6801/3291527077] conn(0x7fd9d4038ba0 msgr2=0x7fd9d403b060 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3291527077 2024-03-04T09:05:46.525 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:41.914+0000 7fd9ecdfa700 1 --2- 172.21.15.82:0/1770752562 >> [v2:172.21.15.82:6800/3291527077,v1:172.21.15.82:6801/3291527077] conn(0x7fd9d4038ba0 0x7fd9d403b060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-04T09:05:46.525 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:43.515+0000 7fd9ecdfa700 1 -- 172.21.15.82:0/1770752562 >> [v2:172.21.15.82:6800/3291527077,v1:172.21.15.82:6801/3291527077] conn(0x7fd9d4038ba0 msgr2=0x7fd9d403b060 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3291527077 2024-03-04T09:05:46.525 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:43.515+0000 7fd9ecdfa700 1 --2- 172.21.15.82:0/1770752562 >> [v2:172.21.15.82:6800/3291527077,v1:172.21.15.82:6801/3291527077] conn(0x7fd9d4038ba0 0x7fd9d403b060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-03-04T09:05:46.525 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:44.914+0000 7fd9de7fc700 1 -- 172.21.15.82:0/1770752562 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mgrmap(e 6) v1 ==== 45695+0+0 (secure 0 0 0) 0x7fd9e402d950 con 0x7fd9e81084f0 2024-03-04T09:05:46.525 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:44.914+0000 7fd9de7fc700 1 -- 172.21.15.82:0/1770752562 >> [v2:172.21.15.82:6800/3291527077,v1:172.21.15.82:6801/3291527077] conn(0x7fd9d4038ba0 msgr2=0x7fd9d403b060 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-04T09:05:46.525 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:44.914+0000 7fd9de7fc700 1 --2- 172.21.15.82:0/1770752562 >> [v2:172.21.15.82:6800/3291527077,v1:172.21.15.82:6801/3291527077] conn(0x7fd9d4038ba0 0x7fd9d403b060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:05:46.525 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:45.916+0000 7fd9de7fc700 1 -- 172.21.15.82:0/1770752562 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 7) v1 ==== 45822+0+0 (secure 0 0 0) 0x7fd9e4047d00 con 0x7fd9e81084f0 2024-03-04T09:05:46.525 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:45.916+0000 7fd9de7fc700 1 --2- 172.21.15.82:0/1770752562 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7fd9d403c1f0 0x7fd9d403e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:05:46.525 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:45.916+0000 7fd9de7fc700 1 -- 172.21.15.82:0/1770752562 --> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd9e402be50 con 0x7fd9d403c1f0 2024-03-04T09:05:46.525 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:45.917+0000 7fd9ecdfa700 1 --2- 172.21.15.82:0/1770752562 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7fd9d403c1f0 0x7fd9d403e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:05:46.525 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:45.917+0000 7fd9ecdfa700 1 --2- 172.21.15.82:0/1770752562 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7fd9d403c1f0 0x7fd9d403e5e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fd9d8003a10 tx=0x7fd9d80092b0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:05:46.526 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:45.918+0000 7fd9de7fc700 1 -- 172.21.15.82:0/1770752562 <== mgr.14120 v2:172.21.15.82:6800/1901539016 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7fd9e402be50 con 0x7fd9d403c1f0 2024-03-04T09:05:46.526 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:45.924+0000 7fd9ef85f700 1 -- 172.21.15.82:0/1770752562 --> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fd9cc002840 con 0x7fd9d403c1f0 2024-03-04T09:05:46.526 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:45.924+0000 7fd9de7fc700 1 -- 172.21.15.82:0/1770752562 <== mgr.14120 v2:172.21.15.82:6800/1901539016 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fd9cc002840 con 0x7fd9d403c1f0 2024-03-04T09:05:46.526 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:45.925+0000 7fd9ef85f700 1 -- 172.21.15.82:0/1770752562 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7fd9d403c1f0 msgr2=0x7fd9d403e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:05:46.526 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:45.925+0000 7fd9ef85f700 1 --2- 172.21.15.82:0/1770752562 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7fd9d403c1f0 0x7fd9d403e5e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fd9d8003a10 tx=0x7fd9d80092b0 comp rx=0 tx=0).stop 2024-03-04T09:05:46.526 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:45.925+0000 7fd9ef85f700 1 -- 172.21.15.82:0/1770752562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9e81084f0 msgr2=0x7fd9e8107d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:05:46.526 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:45.925+0000 7fd9ef85f700 1 --2- 172.21.15.82:0/1770752562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9e81084f0 0x7fd9e8107d70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4006af0 tx=0x7fd9e4011c00 comp rx=0 tx=0).stop 2024-03-04T09:05:46.526 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:45.925+0000 7fd9ef85f700 1 -- 172.21.15.82:0/1770752562 shutdown_connections 2024-03-04T09:05:46.526 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:45.925+0000 7fd9ef85f700 1 --2- 172.21.15.82:0/1770752562 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7fd9d403c1f0 0x7fd9d403e5e0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:05:46.526 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:45.925+0000 7fd9ef85f700 1 --2- 172.21.15.82:0/1770752562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9e81084f0 0x7fd9e8107d70 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:05:46.526 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:45.925+0000 7fd9ef85f700 1 --2- 172.21.15.82:0/1770752562 >> [v2:172.21.15.82:6800/3291527077,v1:172.21.15.82:6801/3291527077] conn(0x7fd9d4038ba0 0x7fd9d403b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:05:46.526 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:45.925+0000 7fd9ef85f700 1 -- 172.21.15.82:0/1770752562 >> 172.21.15.82:0/1770752562 conn(0x7fd9e8101f00 msgr2=0x7fd9e8102a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:05:46.526 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:45.925+0000 7fd9ef85f700 1 -- 172.21.15.82:0/1770752562 shutdown_connections 2024-03-04T09:05:46.527 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:45.925+0000 7fd9ef85f700 1 -- 172.21.15.82:0/1770752562 wait complete. 2024-03-04T09:05:46.527 INFO:teuthology.orchestra.run.smithi082.stdout:mgr epoch 5 is available 2024-03-04T09:05:46.527 INFO:teuthology.orchestra.run.smithi082.stdout:Setting orchestrator backend to cephadm... 2024-03-04T09:05:47.178 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:46 smithi082 ceph-mon[32880]: [04/Mar/2024:09:05:45] ENGINE Bus STARTING 2024-03-04T09:05:47.178 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:46 smithi082 ceph-mon[32880]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-03-04T09:05:47.178 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:46 smithi082 ceph-mon[32880]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-03-04T09:05:47.178 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:46 smithi082 ceph-mon[32880]: [04/Mar/2024:09:05:45] ENGINE Serving on http://172.21.15.82:8765 2024-03-04T09:05:47.178 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:46 smithi082 ceph-mon[32880]: [04/Mar/2024:09:05:46] ENGINE Serving on https://172.21.15.82:7150 2024-03-04T09:05:47.178 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:46 smithi082 ceph-mon[32880]: [04/Mar/2024:09:05:46] ENGINE Bus STARTED 2024-03-04T09:05:47.178 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:46 smithi082 ceph-mon[32880]: from='mgr.14120 172.21.15.82:0/998079227' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:05:47.733 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:46.960+0000 7fa30f7bd700 1 Processor -- start 2024-03-04T09:05:47.733 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:46.960+0000 7fa30f7bd700 1 -- start start 2024-03-04T09:05:47.733 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:46.960+0000 7fa30f7bd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa30807ddd0 0x7fa30807c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:05:47.733 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:46.960+0000 7fa30f7bd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30807c7c0 con 0x7fa30807ddd0 2024-03-04T09:05:47.733 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:46.960+0000 7fa30d559700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa30807ddd0 0x7fa30807c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:05:47.734 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:46.960+0000 7fa30d559700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa30807ddd0 0x7fa30807c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48182/0 (socket says 172.21.15.82:48182) 2024-03-04T09:05:47.734 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:46.960+0000 7fa30d559700 1 -- 172.21.15.82:0/280999801 learned_addr learned my addr 172.21.15.82:0/280999801 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:05:47.734 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:46.961+0000 7fa30d559700 1 -- 172.21.15.82:0/280999801 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa30807c940 con 0x7fa30807ddd0 2024-03-04T09:05:47.734 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:46.961+0000 7fa30d559700 1 --2- 172.21.15.82:0/280999801 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa30807ddd0 0x7fa30807c280 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa3040098a0 tx=0x7fa304009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9572ed0f02bead7 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:05:47.734 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:46.961+0000 7fa2fffff700 1 -- 172.21.15.82:0/280999801 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa304004160 con 0x7fa30807ddd0 2024-03-04T09:05:47.734 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:46.961+0000 7fa2fffff700 1 -- 172.21.15.82:0/280999801 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa304004300 con 0x7fa30807ddd0 2024-03-04T09:05:47.734 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:46.961+0000 7fa2fffff700 1 -- 172.21.15.82:0/280999801 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa304011b40 con 0x7fa30807ddd0 2024-03-04T09:05:47.734 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:46.961+0000 7fa30f7bd700 1 -- 172.21.15.82:0/280999801 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa30807ddd0 msgr2=0x7fa30807c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:05:47.734 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:46.961+0000 7fa30f7bd700 1 --2- 172.21.15.82:0/280999801 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa30807ddd0 0x7fa30807c280 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa3040098a0 tx=0x7fa304009bb0 comp rx=0 tx=0).stop 2024-03-04T09:05:47.734 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:46.961+0000 7fa30f7bd700 1 -- 172.21.15.82:0/280999801 shutdown_connections 2024-03-04T09:05:47.734 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:46.961+0000 7fa30f7bd700 1 --2- 172.21.15.82:0/280999801 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa30807ddd0 0x7fa30807c280 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:05:47.734 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:46.961+0000 7fa30f7bd700 1 -- 172.21.15.82:0/280999801 >> 172.21.15.82:0/280999801 conn(0x7fa3081030f0 msgr2=0x7fa308105510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:05:47.734 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:46.962+0000 7fa30f7bd700 1 -- 172.21.15.82:0/280999801 shutdown_connections 2024-03-04T09:05:47.735 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:46.962+0000 7fa30f7bd700 1 -- 172.21.15.82:0/280999801 wait complete. 2024-03-04T09:05:47.735 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:46.962+0000 7fa30f7bd700 1 Processor -- start 2024-03-04T09:05:47.735 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:46.962+0000 7fa30f7bd700 1 -- start start 2024-03-04T09:05:47.735 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:46.962+0000 7fa30f7bd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa30807ddd0 0x7fa30819dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:05:47.735 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:46.962+0000 7fa30f7bd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30810e040 con 0x7fa30807ddd0 2024-03-04T09:05:47.735 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:46.962+0000 7fa30d559700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa30807ddd0 0x7fa30819dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:05:47.735 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:46.962+0000 7fa30d559700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa30807ddd0 0x7fa30819dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48184/0 (socket says 172.21.15.82:48184) 2024-03-04T09:05:47.735 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:46.962+0000 7fa30d559700 1 -- 172.21.15.82:0/844645287 learned_addr learned my addr 172.21.15.82:0/844645287 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:05:47.735 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:46.963+0000 7fa30d559700 1 -- 172.21.15.82:0/844645287 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa30819e1b0 con 0x7fa30807ddd0 2024-03-04T09:05:47.735 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:46.963+0000 7fa30d559700 1 --2- 172.21.15.82:0/844645287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa30807ddd0 0x7fa30819dc70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa304011670 tx=0x7fa304011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:05:47.735 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:46.963+0000 7fa2fe7fc700 1 -- 172.21.15.82:0/844645287 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa3040038b0 con 0x7fa30807ddd0 2024-03-04T09:05:47.736 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:46.963+0000 7fa2fe7fc700 1 -- 172.21.15.82:0/844645287 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa30401a430 con 0x7fa30807ddd0 2024-03-04T09:05:47.736 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:46.963+0000 7fa30f7bd700 1 -- 172.21.15.82:0/844645287 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa30819e440 con 0x7fa30807ddd0 2024-03-04T09:05:47.736 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:46.963+0000 7fa2fe7fc700 1 -- 172.21.15.82:0/844645287 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa304019550 con 0x7fa30807ddd0 2024-03-04T09:05:47.736 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:46.963+0000 7fa30f7bd700 1 -- 172.21.15.82:0/844645287 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3081a1130 con 0x7fa30807ddd0 2024-03-04T09:05:47.736 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:46.964+0000 7fa2fe7fc700 1 -- 172.21.15.82:0/844645287 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 7) v1 ==== 45822+0+0 (secure 0 0 0) 0x7fa304019850 con 0x7fa30807ddd0 2024-03-04T09:05:47.736 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:46.964+0000 7fa2fe7fc700 1 --2- 172.21.15.82:0/844645287 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7fa2f4038a40 0x7fa2f403af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:05:47.736 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:46.964+0000 7fa2fe7fc700 1 -- 172.21.15.82:0/844645287 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fa30404cb50 con 0x7fa30807ddd0 2024-03-04T09:05:47.736 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:46.964+0000 7fa30f7bd700 1 -- 172.21.15.82:0/844645287 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3080636f0 con 0x7fa30807ddd0 2024-03-04T09:05:47.736 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:46.964+0000 7fa30cd58700 1 --2- 172.21.15.82:0/844645287 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7fa2f4038a40 0x7fa2f403af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:05:47.736 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:46.965+0000 7fa30cd58700 1 --2- 172.21.15.82:0/844645287 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7fa2f4038a40 0x7fa2f403af00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8006fd0 tx=0x7fa2f8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:05:47.737 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:46.972+0000 7fa2fe7fc700 1 -- 172.21.15.82:0/844645287 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fa30400bc70 con 0x7fa30807ddd0 2024-03-04T09:05:47.737 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:46.973+0000 7fa2fe7fc700 1 -- 172.21.15.82:0/844645287 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 8) v1 ==== 45928+0+0 (secure 0 0 0) 0x7fa30402d960 con 0x7fa30807ddd0 2024-03-04T09:05:47.737 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:47.182+0000 7fa30f7bd700 1 -- 172.21.15.82:0/844645287 --> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7fa308104360 con 0x7fa2f4038a40 2024-03-04T09:05:47.737 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:47.190+0000 7fa2fe7fc700 1 -- 172.21.15.82:0/844645287 <== mgr.14120 v2:172.21.15.82:6800/1901539016 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fa308104360 con 0x7fa2f4038a40 2024-03-04T09:05:47.737 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:47.192+0000 7fa30f7bd700 1 -- 172.21.15.82:0/844645287 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7fa2f4038a40 msgr2=0x7fa2f403af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:05:47.737 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:47.192+0000 7fa30f7bd700 1 --2- 172.21.15.82:0/844645287 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7fa2f4038a40 0x7fa2f403af00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8006fd0 tx=0x7fa2f8006e40 comp rx=0 tx=0).stop 2024-03-04T09:05:47.737 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:47.192+0000 7fa30f7bd700 1 -- 172.21.15.82:0/844645287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa30807ddd0 msgr2=0x7fa30819dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:05:47.737 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:47.192+0000 7fa30f7bd700 1 --2- 172.21.15.82:0/844645287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa30807ddd0 0x7fa30819dc70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa304011670 tx=0x7fa304011b50 comp rx=0 tx=0).stop 2024-03-04T09:05:47.737 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:47.192+0000 7fa30f7bd700 1 -- 172.21.15.82:0/844645287 shutdown_connections 2024-03-04T09:05:47.737 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:47.192+0000 7fa30f7bd700 1 --2- 172.21.15.82:0/844645287 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7fa2f4038a40 0x7fa2f403af00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:05:47.738 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:47.192+0000 7fa30f7bd700 1 --2- 172.21.15.82:0/844645287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa30807ddd0 0x7fa30819dc70 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:05:47.738 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:47.192+0000 7fa30f7bd700 1 -- 172.21.15.82:0/844645287 >> 172.21.15.82:0/844645287 conn(0x7fa3081030f0 msgr2=0x7fa308103c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:05:47.738 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:47.193+0000 7fa30f7bd700 1 -- 172.21.15.82:0/844645287 shutdown_connections 2024-03-04T09:05:47.738 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:47.193+0000 7fa30f7bd700 1 -- 172.21.15.82:0/844645287 wait complete. 2024-03-04T09:05:48.143 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:47 smithi082 ceph-mon[32880]: mgrmap e8: x(active, since 2s) 2024-03-04T09:05:48.143 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:47 smithi082 ceph-mon[32880]: from='mgr.14120 172.21.15.82:0/998079227' entity='mgr.x' 2024-03-04T09:05:48.143 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:47 smithi082 ceph-mon[32880]: from='mgr.14120 172.21.15.82:0/998079227' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:05:48.971 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout value unchanged 2024-03-04T09:05:48.971 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:48.166+0000 7f4fb21e7700 1 Processor -- start 2024-03-04T09:05:48.971 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:48.166+0000 7f4fb21e7700 1 -- start start 2024-03-04T09:05:48.972 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:48.166+0000 7f4fb21e7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fac1069c0 0x7f4fac106de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:05:48.972 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:48.166+0000 7f4fb21e7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fac1073b0 con 0x7f4fac1069c0 2024-03-04T09:05:48.972 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:48.166+0000 7f4fab7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fac1069c0 0x7f4fac106de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:05:48.972 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:48.166+0000 7f4fab7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fac1069c0 0x7f4fac106de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48186/0 (socket says 172.21.15.82:48186) 2024-03-04T09:05:48.972 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:48.166+0000 7f4fab7fe700 1 -- 172.21.15.82:0/1595323140 learned_addr learned my addr 172.21.15.82:0/1595323140 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:05:48.972 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:48.166+0000 7f4fab7fe700 1 -- 172.21.15.82:0/1595323140 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fac107bc0 con 0x7f4fac1069c0 2024-03-04T09:05:48.972 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:48.166+0000 7f4fab7fe700 1 --2- 172.21.15.82:0/1595323140 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fac1069c0 0x7f4fac106de0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c0098a0 tx=0x7f4f9c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7656f4eab478ce90 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:05:48.972 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:48.166+0000 7f4faaffd700 1 -- 172.21.15.82:0/1595323140 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4f9c004160 con 0x7f4fac1069c0 2024-03-04T09:05:48.972 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:48.167+0000 7f4faaffd700 1 -- 172.21.15.82:0/1595323140 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4f9c004300 con 0x7f4fac1069c0 2024-03-04T09:05:48.972 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:48.167+0000 7f4faaffd700 1 -- 172.21.15.82:0/1595323140 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4f9c011b40 con 0x7f4fac1069c0 2024-03-04T09:05:48.972 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:48.167+0000 7f4fb21e7700 1 -- 172.21.15.82:0/1595323140 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fac1069c0 msgr2=0x7f4fac106de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:05:48.972 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:48.167+0000 7f4fb21e7700 1 --2- 172.21.15.82:0/1595323140 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fac1069c0 0x7f4fac106de0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c0098a0 tx=0x7f4f9c009bb0 comp rx=0 tx=0).stop 2024-03-04T09:05:48.973 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:48.167+0000 7f4fb21e7700 1 -- 172.21.15.82:0/1595323140 shutdown_connections 2024-03-04T09:05:48.973 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:48.167+0000 7f4fb21e7700 1 --2- 172.21.15.82:0/1595323140 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fac1069c0 0x7f4fac106de0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:05:48.973 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:48.167+0000 7f4fb21e7700 1 -- 172.21.15.82:0/1595323140 >> 172.21.15.82:0/1595323140 conn(0x7f4fac101fa0 msgr2=0x7f4fac1043c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:05:48.973 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:48.167+0000 7f4fb21e7700 1 -- 172.21.15.82:0/1595323140 shutdown_connections 2024-03-04T09:05:48.973 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:48.167+0000 7f4fb21e7700 1 -- 172.21.15.82:0/1595323140 wait complete. 2024-03-04T09:05:48.973 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:48.168+0000 7f4fb21e7700 1 Processor -- start 2024-03-04T09:05:48.973 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:48.168+0000 7f4fb21e7700 1 -- start start 2024-03-04T09:05:48.973 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:48.168+0000 7f4fb21e7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fac1069c0 0x7f4fac19ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:05:48.973 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:48.168+0000 7f4fb21e7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fac10af70 con 0x7f4fac1069c0 2024-03-04T09:05:48.973 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:48.168+0000 7f4fab7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fac1069c0 0x7f4fac19ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:05:48.973 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:48.168+0000 7f4fab7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fac1069c0 0x7f4fac19ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48196/0 (socket says 172.21.15.82:48196) 2024-03-04T09:05:48.973 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:48.168+0000 7f4fab7fe700 1 -- 172.21.15.82:0/3492705193 learned_addr learned my addr 172.21.15.82:0/3492705193 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:05:48.973 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:48.168+0000 7f4fab7fe700 1 -- 172.21.15.82:0/3492705193 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fac19bf40 con 0x7f4fac1069c0 2024-03-04T09:05:48.973 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:48.168+0000 7f4fab7fe700 1 --2- 172.21.15.82:0/3492705193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fac1069c0 0x7f4fac19ba00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c011670 tx=0x7f4f9c011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:05:48.973 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:48.169+0000 7f4fa97fa700 1 -- 172.21.15.82:0/3492705193 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4f9c0037d0 con 0x7f4fac1069c0 2024-03-04T09:05:48.974 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:48.169+0000 7f4fa97fa700 1 -- 172.21.15.82:0/3492705193 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4f9c01a430 con 0x7f4fac1069c0 2024-03-04T09:05:48.974 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:48.169+0000 7f4fa97fa700 1 -- 172.21.15.82:0/3492705193 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4f9c019550 con 0x7f4fac1069c0 2024-03-04T09:05:48.974 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:48.169+0000 7f4fb21e7700 1 -- 172.21.15.82:0/3492705193 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fac19c1d0 con 0x7f4fac1069c0 2024-03-04T09:05:48.974 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:48.169+0000 7f4fb21e7700 1 -- 172.21.15.82:0/3492705193 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fac19eec0 con 0x7f4fac1069c0 2024-03-04T09:05:48.974 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:48.169+0000 7f4fa97fa700 1 -- 172.21.15.82:0/3492705193 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) v1 ==== 45928+0+0 (secure 0 0 0) 0x7f4f9c022020 con 0x7f4fac1069c0 2024-03-04T09:05:48.974 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:48.170+0000 7f4fb21e7700 1 -- 172.21.15.82:0/3492705193 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fac0636f0 con 0x7f4fac1069c0 2024-03-04T09:05:48.974 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:48.170+0000 7f4fa97fa700 1 --2- 172.21.15.82:0/3492705193 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7f4f98038bf0 0x7f4f9803b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:05:48.974 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:48.170+0000 7f4fa97fa700 1 -- 172.21.15.82:0/3492705193 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f4f9c04c950 con 0x7f4fac1069c0 2024-03-04T09:05:48.974 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:48.170+0000 7f4fa3fff700 1 --2- 172.21.15.82:0/3492705193 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7f4f98038bf0 0x7f4f9803b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:05:48.974 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:48.170+0000 7f4fa3fff700 1 --2- 172.21.15.82:0/3492705193 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7f4f98038bf0 0x7f4f9803b0b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4f94006fd0 tx=0x7f4f94006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:05:48.974 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:48.175+0000 7f4fa97fa700 1 -- 172.21.15.82:0/3492705193 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f4f9c01ab00 con 0x7f4fac1069c0 2024-03-04T09:05:48.974 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:48.367+0000 7f4fb21e7700 1 -- 172.21.15.82:0/3492705193 --> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f4fac103210 con 0x7f4f98038bf0 2024-03-04T09:05:48.974 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:48.368+0000 7f4fa97fa700 1 -- 172.21.15.82:0/3492705193 <== mgr.14120 v2:172.21.15.82:6800/1901539016 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f4fac103210 con 0x7f4f98038bf0 2024-03-04T09:05:48.975 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:48.370+0000 7f4fb21e7700 1 -- 172.21.15.82:0/3492705193 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7f4f98038bf0 msgr2=0x7f4f9803b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:05:48.975 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:48.370+0000 7f4fb21e7700 1 --2- 172.21.15.82:0/3492705193 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7f4f98038bf0 0x7f4f9803b0b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4f94006fd0 tx=0x7f4f94006e40 comp rx=0 tx=0).stop 2024-03-04T09:05:48.975 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:48.370+0000 7f4fb21e7700 1 -- 172.21.15.82:0/3492705193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fac1069c0 msgr2=0x7f4fac19ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:05:48.975 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:48.370+0000 7f4fb21e7700 1 --2- 172.21.15.82:0/3492705193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fac1069c0 0x7f4fac19ba00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c011670 tx=0x7f4f9c011920 comp rx=0 tx=0).stop 2024-03-04T09:05:48.975 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:48.370+0000 7f4fb21e7700 1 -- 172.21.15.82:0/3492705193 shutdown_connections 2024-03-04T09:05:48.975 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:48.370+0000 7f4fb21e7700 1 --2- 172.21.15.82:0/3492705193 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7f4f98038bf0 0x7f4f9803b0b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:05:48.975 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:48.370+0000 7f4fb21e7700 1 --2- 172.21.15.82:0/3492705193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fac1069c0 0x7f4fac19ba00 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:05:48.975 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:48.370+0000 7f4fb21e7700 1 -- 172.21.15.82:0/3492705193 >> 172.21.15.82:0/3492705193 conn(0x7f4fac101fa0 msgr2=0x7f4fac102b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:05:48.975 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:48.370+0000 7f4fb21e7700 1 -- 172.21.15.82:0/3492705193 shutdown_connections 2024-03-04T09:05:48.975 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:48.370+0000 7f4fb21e7700 1 -- 172.21.15.82:0/3492705193 wait complete. 2024-03-04T09:05:48.975 INFO:teuthology.orchestra.run.smithi082.stdout:Generating ssh key... 2024-03-04T09:05:49.249 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:48 smithi082 ceph-mon[32880]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:05:49.817 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:49 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: Generating public/private rsa key pair. 2024-03-04T09:05:49.817 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:49 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: Your identification has been saved in /tmp/tmpyvj6k3ow/key. 2024-03-04T09:05:49.817 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:49 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: Your public key has been saved in /tmp/tmpyvj6k3ow/key.pub. 2024-03-04T09:05:49.817 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:49 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: The key fingerprint is: 2024-03-04T09:05:49.817 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:49 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: SHA256:9XZ59zDo1yzbqEU7026Zc/pWmHUsMsJsgwWDRe/6PqQ ceph-2e533fc8-da06-11ee-95c6-87774f69a715 2024-03-04T09:05:49.817 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:49 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: The key's randomart image is: 2024-03-04T09:05:49.817 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:49 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: +---[RSA 3072]----+ 2024-03-04T09:05:49.817 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:49 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: | +=. | 2024-03-04T09:05:49.818 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:49 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: | . o. | 2024-03-04T09:05:49.818 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:49 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: | =o . | 2024-03-04T09:05:49.818 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:49 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: | .o*.o...+| 2024-03-04T09:05:49.818 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:49 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: | S..o+o*=+| 2024-03-04T09:05:49.818 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:49 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: | ..o ooO+| 2024-03-04T09:05:49.818 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:49 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: | .o . B O| 2024-03-04T09:05:49.818 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:49 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: | E.. o %+| 2024-03-04T09:05:49.818 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:49 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: | .o...+=*| 2024-03-04T09:05:49.818 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:05:49 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: +----[SHA256]-----+ 2024-03-04T09:05:50.316 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:49 smithi082 ceph-mon[32880]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:05:50.316 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:49 smithi082 ceph-mon[32880]: from='mgr.14120 172.21.15.82:0/998079227' entity='mgr.x' 2024-03-04T09:05:50.316 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:49 smithi082 ceph-mon[32880]: from='mgr.14120 172.21.15.82:0/998079227' entity='mgr.x' 2024-03-04T09:05:50.343 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:49.351+0000 7f758ac78700 1 Processor -- start 2024-03-04T09:05:50.344 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:49.351+0000 7f758ac78700 1 -- start start 2024-03-04T09:05:50.344 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:49.351+0000 7f758ac78700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f758407de10 0x7f758407c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:05:50.344 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:49.351+0000 7f758ac78700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f758407c890 con 0x7f758407de10 2024-03-04T09:05:50.344 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:49.351+0000 7f7588a14700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f758407de10 0x7f758407c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:05:50.344 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:49.351+0000 7f7588a14700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f758407de10 0x7f758407c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48208/0 (socket says 172.21.15.82:48208) 2024-03-04T09:05:50.344 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:49.351+0000 7f7588a14700 1 -- 172.21.15.82:0/1764862530 learned_addr learned my addr 172.21.15.82:0/1764862530 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:05:50.344 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:49.351+0000 7f7588a14700 1 -- 172.21.15.82:0/1764862530 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f758407ca10 con 0x7f758407de10 2024-03-04T09:05:50.344 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:49.351+0000 7f7588a14700 1 --2- 172.21.15.82:0/1764862530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f758407de10 0x7f758407c2c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f75780098a0 tx=0x7f7578009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=845d5e720a553e9 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:05:50.344 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:49.352+0000 7f75837fe700 1 -- 172.21.15.82:0/1764862530 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7578004160 con 0x7f758407de10 2024-03-04T09:05:50.344 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:49.352+0000 7f75837fe700 1 -- 172.21.15.82:0/1764862530 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7578004300 con 0x7f758407de10 2024-03-04T09:05:50.345 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:49.352+0000 7f75837fe700 1 -- 172.21.15.82:0/1764862530 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7578011b40 con 0x7f758407de10 2024-03-04T09:05:50.345 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:49.352+0000 7f758ac78700 1 -- 172.21.15.82:0/1764862530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f758407de10 msgr2=0x7f758407c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:05:50.345 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:49.352+0000 7f758ac78700 1 --2- 172.21.15.82:0/1764862530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f758407de10 0x7f758407c2c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f75780098a0 tx=0x7f7578009bb0 comp rx=0 tx=0).stop 2024-03-04T09:05:50.345 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:49.352+0000 7f758ac78700 1 -- 172.21.15.82:0/1764862530 shutdown_connections 2024-03-04T09:05:50.345 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:49.352+0000 7f758ac78700 1 --2- 172.21.15.82:0/1764862530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f758407de10 0x7f758407c2c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:05:50.345 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:49.352+0000 7f758ac78700 1 -- 172.21.15.82:0/1764862530 >> 172.21.15.82:0/1764862530 conn(0x7f75841030f0 msgr2=0x7f7584105510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:05:50.345 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:49.352+0000 7f758ac78700 1 -- 172.21.15.82:0/1764862530 shutdown_connections 2024-03-04T09:05:50.345 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:49.352+0000 7f758ac78700 1 -- 172.21.15.82:0/1764862530 wait complete. 2024-03-04T09:05:50.345 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:49.353+0000 7f758ac78700 1 Processor -- start 2024-03-04T09:05:50.345 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:49.353+0000 7f758ac78700 1 -- start start 2024-03-04T09:05:50.345 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:49.353+0000 7f758ac78700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f758407de10 0x7f758419dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:05:50.345 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:49.353+0000 7f758ac78700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f758410e060 con 0x7f758407de10 2024-03-04T09:05:50.345 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:49.353+0000 7f7588a14700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f758407de10 0x7f758419dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:05:50.345 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:49.353+0000 7f7588a14700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f758407de10 0x7f758419dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48220/0 (socket says 172.21.15.82:48220) 2024-03-04T09:05:50.346 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:49.353+0000 7f7588a14700 1 -- 172.21.15.82:0/68970708 learned_addr learned my addr 172.21.15.82:0/68970708 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:05:50.346 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:49.353+0000 7f7588a14700 1 -- 172.21.15.82:0/68970708 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f758419e170 con 0x7f758407de10 2024-03-04T09:05:50.346 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:49.353+0000 7f7588a14700 1 --2- 172.21.15.82:0/68970708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f758407de10 0x7f758419dc30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7578011670 tx=0x7f7578011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:05:50.346 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:49.353+0000 7f7581ffb700 1 -- 172.21.15.82:0/68970708 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75780038b0 con 0x7f758407de10 2024-03-04T09:05:50.346 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:49.353+0000 7f7581ffb700 1 -- 172.21.15.82:0/68970708 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f757801a430 con 0x7f758407de10 2024-03-04T09:05:50.346 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:49.353+0000 7f758ac78700 1 -- 172.21.15.82:0/68970708 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f758419e400 con 0x7f758407de10 2024-03-04T09:05:50.346 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:49.354+0000 7f7581ffb700 1 -- 172.21.15.82:0/68970708 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7578019550 con 0x7f758407de10 2024-03-04T09:05:50.346 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:49.354+0000 7f758ac78700 1 -- 172.21.15.82:0/68970708 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75841a10f0 con 0x7f758407de10 2024-03-04T09:05:50.346 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:49.354+0000 7f7581ffb700 1 -- 172.21.15.82:0/68970708 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) v1 ==== 45928+0+0 (secure 0 0 0) 0x7f7578003a50 con 0x7f758407de10 2024-03-04T09:05:50.346 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:49.355+0000 7f758ac78700 1 -- 172.21.15.82:0/68970708 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75840636f0 con 0x7f758407de10 2024-03-04T09:05:50.346 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:49.355+0000 7f7581ffb700 1 --2- 172.21.15.82:0/68970708 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7f7574038ba0 0x7f757403b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:05:50.346 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:49.355+0000 7f7581ffb700 1 -- 172.21.15.82:0/68970708 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f757804ccd0 con 0x7f758407de10 2024-03-04T09:05:50.346 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:49.355+0000 7f7583fff700 1 --2- 172.21.15.82:0/68970708 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7f7574038ba0 0x7f757403b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:05:50.346 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:49.355+0000 7f7583fff700 1 --2- 172.21.15.82:0/68970708 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7f7574038ba0 0x7f757403b060 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7570006fd0 tx=0x7f7570006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:05:50.347 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:49.360+0000 7f7581ffb700 1 -- 172.21.15.82:0/68970708 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f7578052020 con 0x7f758407de10 2024-03-04T09:05:50.347 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:49.552+0000 7f758ac78700 1 -- 172.21.15.82:0/68970708 --> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f7584104340 con 0x7f7574038ba0 2024-03-04T09:05:50.347 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:49.693+0000 7f7581ffb700 1 -- 172.21.15.82:0/68970708 <== mgr.14120 v2:172.21.15.82:6800/1901539016 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f7584104340 con 0x7f7574038ba0 2024-03-04T09:05:50.347 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:49.695+0000 7f758ac78700 1 -- 172.21.15.82:0/68970708 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7f7574038ba0 msgr2=0x7f757403b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:05:50.347 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:49.695+0000 7f758ac78700 1 --2- 172.21.15.82:0/68970708 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7f7574038ba0 0x7f757403b060 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7570006fd0 tx=0x7f7570006e40 comp rx=0 tx=0).stop 2024-03-04T09:05:50.347 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:49.695+0000 7f758ac78700 1 -- 172.21.15.82:0/68970708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f758407de10 msgr2=0x7f758419dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:05:50.347 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:49.695+0000 7f758ac78700 1 --2- 172.21.15.82:0/68970708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f758407de10 0x7f758419dc30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7578011670 tx=0x7f7578011b50 comp rx=0 tx=0).stop 2024-03-04T09:05:50.347 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:49.695+0000 7f758ac78700 1 -- 172.21.15.82:0/68970708 shutdown_connections 2024-03-04T09:05:50.347 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:49.695+0000 7f758ac78700 1 --2- 172.21.15.82:0/68970708 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7f7574038ba0 0x7f757403b060 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:05:50.347 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:49.695+0000 7f758ac78700 1 --2- 172.21.15.82:0/68970708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f758407de10 0x7f758419dc30 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:05:50.347 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:49.695+0000 7f758ac78700 1 -- 172.21.15.82:0/68970708 >> 172.21.15.82:0/68970708 conn(0x7f75841030f0 msgr2=0x7f7584103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:05:50.347 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:49.695+0000 7f758ac78700 1 -- 172.21.15.82:0/68970708 shutdown_connections 2024-03-04T09:05:50.347 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:49.695+0000 7f758ac78700 1 -- 172.21.15.82:0/68970708 wait complete. 2024-03-04T09:05:51.267 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:50 smithi082 ceph-mon[32880]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:05:51.267 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:50 smithi082 ceph-mon[32880]: Generating ssh key... 2024-03-04T09:05:51.550 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXSFTTDEvhpcvjNaVQXSX7UOj1Ig/JIo2aKYLa7/3ysE/RLV08QnhXVCeXRGAHdzhatUxhl4L1L5j3btGV2tMGE5Dy1OBohdjOYYf2c3A2CIVWzgpp13BcsL3z4Fv7fqR0kkgTbIFJWkraC7RTeP2yJmLnmO2T+jE3V2sjtGwJABQBy2RvbBgeEfGpMGdKF03ErFsENdUZV23T3vnf8nLTflaHYi6SE9AsGlZG0K7jWkaMSdFT3vC8MlVDlyPXWVjCiS1fsdzHZ+Ndgo5Phhm7vHbZm0aLjWMX7iz+afT/vpGT1HSJUwzwLdrfTNJYOrUn9CMgJ/EnOe8C7aZ+GDkder6WTDshQUTD6Bx/kuQ6hlQgqyeA9Vwcy+awY+oZbOFN2M+CMdHVKGmzRWBNPQ4U3vt7CUUgNxEYCAGTU42c67d9CPddkyg7eRSNpv9jGVMwYSg+M4/KwskgTzIo5RYKSU6x52aAj1TfMXKlMSHHf5VK+xZtEG35DB0244BndDk= ceph-2e533fc8-da06-11ee-95c6-87774f69a715 2024-03-04T09:05:51.550 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:50.767+0000 7ff3ac970700 1 Processor -- start 2024-03-04T09:05:51.550 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:50.767+0000 7ff3ac970700 1 -- start start 2024-03-04T09:05:51.550 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:50.768+0000 7ff3ac970700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3a81085b0 0x7ff3a810a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:05:51.550 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:50.768+0000 7ff3ac970700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a807bdf0 con 0x7ff3a81085b0 2024-03-04T09:05:51.550 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:50.768+0000 7ff3a659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3a81085b0 0x7ff3a810a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:05:51.550 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:50.768+0000 7ff3a659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3a81085b0 0x7ff3a810a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48228/0 (socket says 172.21.15.82:48228) 2024-03-04T09:05:51.550 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:50.768+0000 7ff3a659c700 1 -- 172.21.15.82:0/3868643885 learned_addr learned my addr 172.21.15.82:0/3868643885 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:05:51.550 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:50.768+0000 7ff3a659c700 1 -- 172.21.15.82:0/3868643885 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a810aee0 con 0x7ff3a81085b0 2024-03-04T09:05:51.550 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:50.768+0000 7ff3a659c700 1 --2- 172.21.15.82:0/3868643885 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3a81085b0 0x7ff3a810a9a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff39c0098a0 tx=0x7ff39c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b587fc680f7af575 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:05:51.550 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:50.769+0000 7ff3a559a700 1 -- 172.21.15.82:0/3868643885 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff39c004160 con 0x7ff3a81085b0 2024-03-04T09:05:51.551 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:50.769+0000 7ff3a559a700 1 -- 172.21.15.82:0/3868643885 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff39c004300 con 0x7ff3a81085b0 2024-03-04T09:05:51.551 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:50.769+0000 7ff3a559a700 1 -- 172.21.15.82:0/3868643885 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff39c011b40 con 0x7ff3a81085b0 2024-03-04T09:05:51.551 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:50.769+0000 7ff3ac970700 1 -- 172.21.15.82:0/3868643885 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3a81085b0 msgr2=0x7ff3a810a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:05:51.551 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:50.769+0000 7ff3ac970700 1 --2- 172.21.15.82:0/3868643885 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3a81085b0 0x7ff3a810a9a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff39c0098a0 tx=0x7ff39c009bb0 comp rx=0 tx=0).stop 2024-03-04T09:05:51.551 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:50.769+0000 7ff3ac970700 1 -- 172.21.15.82:0/3868643885 shutdown_connections 2024-03-04T09:05:51.551 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:50.769+0000 7ff3ac970700 1 --2- 172.21.15.82:0/3868643885 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3a81085b0 0x7ff3a810a9a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:05:51.551 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:50.769+0000 7ff3ac970700 1 -- 172.21.15.82:0/3868643885 >> 172.21.15.82:0/3868643885 conn(0x7ff3a8102000 msgr2=0x7ff3a8104420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:05:51.551 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:50.769+0000 7ff3ac970700 1 -- 172.21.15.82:0/3868643885 shutdown_connections 2024-03-04T09:05:51.551 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:50.769+0000 7ff3ac970700 1 -- 172.21.15.82:0/3868643885 wait complete. 2024-03-04T09:05:51.551 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:50.770+0000 7ff3ac970700 1 Processor -- start 2024-03-04T09:05:51.551 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:50.770+0000 7ff3ac970700 1 -- start start 2024-03-04T09:05:51.551 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:50.770+0000 7ff3ac970700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3a81085b0 0x7ff3a8107e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:05:51.551 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:50.770+0000 7ff3ac970700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a810be40 con 0x7ff3a81085b0 2024-03-04T09:05:51.552 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:50.770+0000 7ff3a659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3a81085b0 0x7ff3a8107e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:05:51.552 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:50.770+0000 7ff3a659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3a81085b0 0x7ff3a8107e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48236/0 (socket says 172.21.15.82:48236) 2024-03-04T09:05:51.552 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:50.770+0000 7ff3a659c700 1 -- 172.21.15.82:0/4019255153 learned_addr learned my addr 172.21.15.82:0/4019255153 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:05:51.552 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:50.771+0000 7ff3a659c700 1 -- 172.21.15.82:0/4019255153 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a8108370 con 0x7ff3a81085b0 2024-03-04T09:05:51.552 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:50.771+0000 7ff3a659c700 1 --2- 172.21.15.82:0/4019255153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3a81085b0 0x7ff3a8107e30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff39c006af0 tx=0x7ff39c011c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:05:51.552 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:50.771+0000 7ff3977fe700 1 -- 172.21.15.82:0/4019255153 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff39c003970 con 0x7ff3a81085b0 2024-03-04T09:05:51.552 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:50.771+0000 7ff3ac970700 1 -- 172.21.15.82:0/4019255153 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3a8106560 con 0x7ff3a81085b0 2024-03-04T09:05:51.552 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:50.771+0000 7ff3977fe700 1 -- 172.21.15.82:0/4019255153 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff39c003b10 con 0x7ff3a81085b0 2024-03-04T09:05:51.552 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:50.771+0000 7ff3977fe700 1 -- 172.21.15.82:0/4019255153 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff39c0196c0 con 0x7ff3a81085b0 2024-03-04T09:05:51.552 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:50.771+0000 7ff3ac970700 1 -- 172.21.15.82:0/4019255153 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3a8106aa0 con 0x7ff3a81085b0 2024-03-04T09:05:51.552 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:50.772+0000 7ff3977fe700 1 -- 172.21.15.82:0/4019255153 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) v1 ==== 45928+0+0 (secure 0 0 0) 0x7ff39c0199c0 con 0x7ff3a81085b0 2024-03-04T09:05:51.552 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:50.772+0000 7ff3977fe700 1 --2- 172.21.15.82:0/4019255153 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7ff390038b50 0x7ff39003b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:05:51.552 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:50.772+0000 7ff3977fe700 1 -- 172.21.15.82:0/4019255153 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7ff39c04cec0 con 0x7ff3a81085b0 2024-03-04T09:05:51.553 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:50.772+0000 7ff3ac970700 1 -- 172.21.15.82:0/4019255153 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3a80636f0 con 0x7ff3a81085b0 2024-03-04T09:05:51.553 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:50.772+0000 7ff3a5d9b700 1 --2- 172.21.15.82:0/4019255153 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7ff390038b50 0x7ff39003b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:05:51.553 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:50.772+0000 7ff3a5d9b700 1 --2- 172.21.15.82:0/4019255153 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7ff390038b50 0x7ff39003b010 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff398006fd0 tx=0x7ff398006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:05:51.553 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:50.777+0000 7ff3977fe700 1 -- 172.21.15.82:0/4019255153 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7ff39c003cc0 con 0x7ff3a81085b0 2024-03-04T09:05:51.553 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:50.974+0000 7ff3ac970700 1 -- 172.21.15.82:0/4019255153 --> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7ff3a81071d0 con 0x7ff390038b50 2024-03-04T09:05:51.553 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:50.974+0000 7ff3977fe700 1 -- 172.21.15.82:0/4019255153 <== mgr.14120 v2:172.21.15.82:6800/1901539016 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7ff3a81071d0 con 0x7ff390038b50 2024-03-04T09:05:51.553 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:50.976+0000 7ff3ac970700 1 -- 172.21.15.82:0/4019255153 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7ff390038b50 msgr2=0x7ff39003b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:05:51.553 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:50.976+0000 7ff3ac970700 1 --2- 172.21.15.82:0/4019255153 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7ff390038b50 0x7ff39003b010 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff398006fd0 tx=0x7ff398006e40 comp rx=0 tx=0).stop 2024-03-04T09:05:51.553 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:50.976+0000 7ff3ac970700 1 -- 172.21.15.82:0/4019255153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3a81085b0 msgr2=0x7ff3a8107e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:05:51.553 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:50.976+0000 7ff3ac970700 1 --2- 172.21.15.82:0/4019255153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3a81085b0 0x7ff3a8107e30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff39c006af0 tx=0x7ff39c011c00 comp rx=0 tx=0).stop 2024-03-04T09:05:51.553 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:50.977+0000 7ff3ac970700 1 -- 172.21.15.82:0/4019255153 shutdown_connections 2024-03-04T09:05:51.553 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:50.977+0000 7ff3ac970700 1 --2- 172.21.15.82:0/4019255153 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7ff390038b50 0x7ff39003b010 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:05:51.553 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:50.977+0000 7ff3ac970700 1 --2- 172.21.15.82:0/4019255153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3a81085b0 0x7ff3a8107e30 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:05:51.554 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:50.977+0000 7ff3ac970700 1 -- 172.21.15.82:0/4019255153 >> 172.21.15.82:0/4019255153 conn(0x7ff3a8102000 msgr2=0x7ff3a8102af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:05:51.554 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:50.977+0000 7ff3ac970700 1 -- 172.21.15.82:0/4019255153 shutdown_connections 2024-03-04T09:05:51.554 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:50.977+0000 7ff3ac970700 1 -- 172.21.15.82:0/4019255153 wait complete. 2024-03-04T09:05:51.554 INFO:teuthology.orchestra.run.smithi082.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-03-04T09:05:51.554 INFO:teuthology.orchestra.run.smithi082.stdout:Adding key to root@localhost authorized_keys... 2024-03-04T09:05:51.554 INFO:teuthology.orchestra.run.smithi082.stdout:Adding host smithi082... 2024-03-04T09:05:52.169 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:51 smithi082 ceph-mon[32880]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:05:53.300 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:53 smithi082 ceph-mon[32880]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi082", "addr": "172.21.15.82", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:05:53.300 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:53 smithi082 ceph-mon[32880]: Deploying cephadm binary to smithi082 2024-03-04T09:05:57.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout Added host 'smithi082' with addr '172.21.15.82' 2024-03-04T09:05:57.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:51.966+0000 7f1969310700 1 Processor -- start 2024-03-04T09:05:57.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:51.966+0000 7f1969310700 1 -- start start 2024-03-04T09:05:57.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:51.966+0000 7f1969310700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1964106960 0x7f1964106d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:05:57.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:51.966+0000 7f1969310700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1964107350 con 0x7f1964106960 2024-03-04T09:05:57.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:51.967+0000 7f1962ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1964106960 0x7f1964106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:05:57.025 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:51.967+0000 7f1962ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1964106960 0x7f1964106d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48250/0 (socket says 172.21.15.82:48250) 2024-03-04T09:05:57.025 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:51.967+0000 7f1962ffd700 1 -- 172.21.15.82:0/1745494430 learned_addr learned my addr 172.21.15.82:0/1745494430 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:05:57.025 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:51.967+0000 7f1962ffd700 1 -- 172.21.15.82:0/1745494430 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1964107b60 con 0x7f1964106960 2024-03-04T09:05:57.025 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:51.967+0000 7f1962ffd700 1 --2- 172.21.15.82:0/1745494430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1964106960 0x7f1964106d80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f19540098a0 tx=0x7f1954009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4205473d48fc18f3 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:05:57.025 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:51.967+0000 7f19627fc700 1 -- 172.21.15.82:0/1745494430 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1954004160 con 0x7f1964106960 2024-03-04T09:05:57.025 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:51.967+0000 7f19627fc700 1 -- 172.21.15.82:0/1745494430 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1954004300 con 0x7f1964106960 2024-03-04T09:05:57.025 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:51.967+0000 7f19627fc700 1 -- 172.21.15.82:0/1745494430 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1954011b40 con 0x7f1964106960 2024-03-04T09:05:57.025 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:51.968+0000 7f1969310700 1 -- 172.21.15.82:0/1745494430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1964106960 msgr2=0x7f1964106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:05:57.025 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:51.968+0000 7f1969310700 1 --2- 172.21.15.82:0/1745494430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1964106960 0x7f1964106d80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f19540098a0 tx=0x7f1954009bb0 comp rx=0 tx=0).stop 2024-03-04T09:05:57.025 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:51.968+0000 7f1969310700 1 -- 172.21.15.82:0/1745494430 shutdown_connections 2024-03-04T09:05:57.025 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:51.968+0000 7f1969310700 1 --2- 172.21.15.82:0/1745494430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1964106960 0x7f1964106d80 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:05:57.025 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:51.968+0000 7f1969310700 1 -- 172.21.15.82:0/1745494430 >> 172.21.15.82:0/1745494430 conn(0x7f1964101f00 msgr2=0x7f1964104340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:05:57.025 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:51.968+0000 7f1969310700 1 -- 172.21.15.82:0/1745494430 shutdown_connections 2024-03-04T09:05:57.026 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:51.968+0000 7f1969310700 1 -- 172.21.15.82:0/1745494430 wait complete. 2024-03-04T09:05:57.026 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:51.968+0000 7f1969310700 1 Processor -- start 2024-03-04T09:05:57.026 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:51.969+0000 7f1969310700 1 -- start start 2024-03-04T09:05:57.026 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:51.969+0000 7f1969310700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1964106960 0x7f196407b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:05:57.026 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:51.969+0000 7f1969310700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196410af10 con 0x7f1964106960 2024-03-04T09:05:57.026 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:51.969+0000 7f1962ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1964106960 0x7f196407b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:05:57.026 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:51.969+0000 7f1962ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1964106960 0x7f196407b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48252/0 (socket says 172.21.15.82:48252) 2024-03-04T09:05:57.026 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:51.969+0000 7f1962ffd700 1 -- 172.21.15.82:0/1414279540 learned_addr learned my addr 172.21.15.82:0/1414279540 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:05:57.026 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:51.969+0000 7f1962ffd700 1 -- 172.21.15.82:0/1414279540 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f196419e740 con 0x7f1964106960 2024-03-04T09:05:57.026 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:51.969+0000 7f1962ffd700 1 --2- 172.21.15.82:0/1414279540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1964106960 0x7f196407b9f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1954011670 tx=0x7f1954011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:05:57.026 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:51.969+0000 7f1960ff9700 1 -- 172.21.15.82:0/1414279540 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f19540037d0 con 0x7f1964106960 2024-03-04T09:05:57.026 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:51.969+0000 7f1960ff9700 1 -- 172.21.15.82:0/1414279540 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f195401a430 con 0x7f1964106960 2024-03-04T09:05:57.026 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:51.969+0000 7f1969310700 1 -- 172.21.15.82:0/1414279540 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f196419e910 con 0x7f1964106960 2024-03-04T09:05:57.027 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:51.969+0000 7f1960ff9700 1 -- 172.21.15.82:0/1414279540 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1954019550 con 0x7f1964106960 2024-03-04T09:05:57.027 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:51.969+0000 7f1969310700 1 -- 172.21.15.82:0/1414279540 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f196419ecb0 con 0x7f1964106960 2024-03-04T09:05:57.027 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:51.970+0000 7f1960ff9700 1 -- 172.21.15.82:0/1414279540 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) v1 ==== 45928+0+0 (secure 0 0 0) 0x7f1954022020 con 0x7f1964106960 2024-03-04T09:05:57.027 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:51.970+0000 7f1969310700 1 -- 172.21.15.82:0/1414279540 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19640636f0 con 0x7f1964106960 2024-03-04T09:05:57.027 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:51.970+0000 7f1960ff9700 1 --2- 172.21.15.82:0/1414279540 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7f1950038bf0 0x7f195003b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:05:57.027 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:51.970+0000 7f1960ff9700 1 -- 172.21.15.82:0/1414279540 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f195404cb30 con 0x7f1964106960 2024-03-04T09:05:57.027 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:51.971+0000 7f195a7fc700 1 --2- 172.21.15.82:0/1414279540 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7f1950038bf0 0x7f195003b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:05:57.027 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:51.971+0000 7f195a7fc700 1 --2- 172.21.15.82:0/1414279540 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7f1950038bf0 0x7f195003b0b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f194c006fd0 tx=0x7f194c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:05:57.027 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:51.975+0000 7f1960ff9700 1 -- 172.21.15.82:0/1414279540 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f195402b750 con 0x7f1964106960 2024-03-04T09:05:57.027 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:52.173+0000 7f1969310700 1 -- 172.21.15.82:0/1414279540 --> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi082", "addr": "172.21.15.82", "target": ["mon-mgr", ""]}) v1 -- 0x7f19641031c0 con 0x7f1950038bf0 2024-03-04T09:05:57.027 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:56.406+0000 7f1960ff9700 1 -- 172.21.15.82:0/1414279540 <== mgr.14120 v2:172.21.15.82:6800/1901539016 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f19641031c0 con 0x7f1950038bf0 2024-03-04T09:05:57.027 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:56.409+0000 7f1969310700 1 -- 172.21.15.82:0/1414279540 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7f1950038bf0 msgr2=0x7f195003b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:05:57.027 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:56.409+0000 7f1969310700 1 --2- 172.21.15.82:0/1414279540 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7f1950038bf0 0x7f195003b0b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f194c006fd0 tx=0x7f194c006e40 comp rx=0 tx=0).stop 2024-03-04T09:05:57.028 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:56.409+0000 7f1969310700 1 -- 172.21.15.82:0/1414279540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1964106960 msgr2=0x7f196407b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:05:57.028 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:56.409+0000 7f1969310700 1 --2- 172.21.15.82:0/1414279540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1964106960 0x7f196407b9f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1954011670 tx=0x7f1954011920 comp rx=0 tx=0).stop 2024-03-04T09:05:57.028 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:56.409+0000 7f1969310700 1 -- 172.21.15.82:0/1414279540 shutdown_connections 2024-03-04T09:05:57.028 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:56.409+0000 7f1969310700 1 --2- 172.21.15.82:0/1414279540 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7f1950038bf0 0x7f195003b0b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:05:57.028 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:56.409+0000 7f1969310700 1 --2- 172.21.15.82:0/1414279540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1964106960 0x7f196407b9f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:05:57.028 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:56.409+0000 7f1969310700 1 -- 172.21.15.82:0/1414279540 >> 172.21.15.82:0/1414279540 conn(0x7f1964101f00 msgr2=0x7f1964102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:05:57.028 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:56.409+0000 7f1969310700 1 -- 172.21.15.82:0/1414279540 shutdown_connections 2024-03-04T09:05:57.028 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:56.409+0000 7f1969310700 1 -- 172.21.15.82:0/1414279540 wait complete. 2024-03-04T09:05:57.028 INFO:teuthology.orchestra.run.smithi082.stdout:Deploying unmanaged mon service... 2024-03-04T09:05:57.588 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:57 smithi082 ceph-mon[32880]: from='mgr.14120 172.21.15.82:0/998079227' entity='mgr.x' 2024-03-04T09:05:57.588 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:57 smithi082 ceph-mon[32880]: Added host smithi082 2024-03-04T09:05:57.588 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:57 smithi082 ceph-mon[32880]: from='mgr.14120 172.21.15.82:0/998079227' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:05:59.066 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:58 smithi082 ceph-mon[32880]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:05:59.066 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:58 smithi082 ceph-mon[32880]: Saving service mon spec with placement count:5 2024-03-04T09:05:59.066 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:05:58 smithi082 ceph-mon[32880]: from='mgr.14120 172.21.15.82:0/998079227' entity='mgr.x' 2024-03-04T09:05:59.455 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-03-04T09:05:59.455 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:57.591+0000 7f6ff0256700 1 Processor -- start 2024-03-04T09:05:59.456 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:57.591+0000 7f6ff0256700 1 -- start start 2024-03-04T09:05:59.456 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:57.592+0000 7f6ff0256700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fe8107ad0 0x7f6fe8107ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:05:59.456 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:57.592+0000 7f6ff0256700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe8108430 con 0x7f6fe8107ad0 2024-03-04T09:05:59.456 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:57.592+0000 7f6fedff2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fe8107ad0 0x7f6fe8107ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:05:59.456 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:57.592+0000 7f6fedff2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fe8107ad0 0x7f6fe8107ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55554/0 (socket says 172.21.15.82:55554) 2024-03-04T09:05:59.456 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:57.592+0000 7f6fedff2700 1 -- 172.21.15.82:0/2831981288 learned_addr learned my addr 172.21.15.82:0/2831981288 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:05:59.456 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:57.592+0000 7f6fedff2700 1 -- 172.21.15.82:0/2831981288 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe81085b0 con 0x7f6fe8107ad0 2024-03-04T09:05:59.456 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:57.592+0000 7f6fedff2700 1 --2- 172.21.15.82:0/2831981288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fe8107ad0 0x7f6fe8107ef0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6fd80098a0 tx=0x7f6fd8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d78194d19aa6932 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:05:59.456 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:57.592+0000 7f6fecff0700 1 -- 172.21.15.82:0/2831981288 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fd8004160 con 0x7f6fe8107ad0 2024-03-04T09:05:59.456 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:57.592+0000 7f6fecff0700 1 -- 172.21.15.82:0/2831981288 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6fd8004300 con 0x7f6fe8107ad0 2024-03-04T09:05:59.456 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:57.592+0000 7f6fecff0700 1 -- 172.21.15.82:0/2831981288 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fd8011b40 con 0x7f6fe8107ad0 2024-03-04T09:05:59.456 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:57.593+0000 7f6ff0256700 1 -- 172.21.15.82:0/2831981288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fe8107ad0 msgr2=0x7f6fe8107ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:05:59.456 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:57.593+0000 7f6ff0256700 1 --2- 172.21.15.82:0/2831981288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fe8107ad0 0x7f6fe8107ef0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6fd80098a0 tx=0x7f6fd8009bb0 comp rx=0 tx=0).stop 2024-03-04T09:05:59.456 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:57.593+0000 7f6ff0256700 1 -- 172.21.15.82:0/2831981288 shutdown_connections 2024-03-04T09:05:59.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:57.593+0000 7f6ff0256700 1 --2- 172.21.15.82:0/2831981288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fe8107ad0 0x7f6fe8107ef0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:05:59.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:57.593+0000 7f6ff0256700 1 -- 172.21.15.82:0/2831981288 >> 172.21.15.82:0/2831981288 conn(0x7f6fe8103170 msgr2=0x7f6fe8105590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:05:59.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:57.593+0000 7f6ff0256700 1 -- 172.21.15.82:0/2831981288 shutdown_connections 2024-03-04T09:05:59.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:57.593+0000 7f6ff0256700 1 -- 172.21.15.82:0/2831981288 wait complete. 2024-03-04T09:05:59.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:57.594+0000 7f6ff0256700 1 Processor -- start 2024-03-04T09:05:59.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:57.594+0000 7f6ff0256700 1 -- start start 2024-03-04T09:05:59.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:57.594+0000 7f6ff0256700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fe8107ad0 0x7f6fe807db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:05:59.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:57.594+0000 7f6ff0256700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe8109ac0 con 0x7f6fe8107ad0 2024-03-04T09:05:59.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:57.594+0000 7f6fedff2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fe8107ad0 0x7f6fe807db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:05:59.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:57.594+0000 7f6fedff2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fe8107ad0 0x7f6fe807db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55566/0 (socket says 172.21.15.82:55566) 2024-03-04T09:05:59.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:57.594+0000 7f6fedff2700 1 -- 172.21.15.82:0/2653141654 learned_addr learned my addr 172.21.15.82:0/2653141654 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:05:59.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:57.594+0000 7f6fedff2700 1 -- 172.21.15.82:0/2653141654 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe807e050 con 0x7f6fe8107ad0 2024-03-04T09:05:59.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:57.594+0000 7f6fedff2700 1 --2- 172.21.15.82:0/2653141654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fe8107ad0 0x7f6fe807db10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8011670 tx=0x7f6fd8011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:05:59.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:57.594+0000 7f6fdeffd700 1 -- 172.21.15.82:0/2653141654 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fd80038b0 con 0x7f6fe8107ad0 2024-03-04T09:05:59.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:57.594+0000 7f6fdeffd700 1 -- 172.21.15.82:0/2653141654 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6fd801a430 con 0x7f6fe8107ad0 2024-03-04T09:05:59.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:57.594+0000 7f6ff0256700 1 -- 172.21.15.82:0/2653141654 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fe807c240 con 0x7f6fe8107ad0 2024-03-04T09:05:59.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:57.594+0000 7f6fdeffd700 1 -- 172.21.15.82:0/2653141654 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fd8019550 con 0x7f6fe8107ad0 2024-03-04T09:05:59.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:57.595+0000 7f6ff0256700 1 -- 172.21.15.82:0/2653141654 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fe807c780 con 0x7f6fe8107ad0 2024-03-04T09:05:59.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:57.595+0000 7f6fdeffd700 1 -- 172.21.15.82:0/2653141654 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) v1 ==== 45928+0+0 (secure 0 0 0) 0x7f6fd8003a50 con 0x7f6fe8107ad0 2024-03-04T09:05:59.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:57.595+0000 7f6ff0256700 1 -- 172.21.15.82:0/2653141654 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fe80636f0 con 0x7f6fe8107ad0 2024-03-04T09:05:59.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:57.596+0000 7f6fdeffd700 1 --2- 172.21.15.82:0/2653141654 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7f6fd4038ba0 0x7f6fd403b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:05:59.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:57.596+0000 7f6fdeffd700 1 -- 172.21.15.82:0/2653141654 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f6fd804ccf0 con 0x7f6fe8107ad0 2024-03-04T09:05:59.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:57.596+0000 7f6fed7f1700 1 --2- 172.21.15.82:0/2653141654 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7f6fd4038ba0 0x7f6fd403b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:05:59.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:57.596+0000 7f6fed7f1700 1 --2- 172.21.15.82:0/2653141654 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7f6fd4038ba0 0x7f6fd403b060 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4006fd0 tx=0x7f6fe4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:05:59.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:57.600+0000 7f6fdeffd700 1 -- 172.21.15.82:0/2653141654 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f6fd8003d40 con 0x7f6fe8107ad0 2024-03-04T09:05:59.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:57.816+0000 7f6ff0256700 1 -- 172.21.15.82:0/2653141654 --> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f6fe807cfc0 con 0x7f6fd4038ba0 2024-03-04T09:05:59.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:57.821+0000 7f6fdeffd700 1 -- 172.21.15.82:0/2653141654 <== mgr.14120 v2:172.21.15.82:6800/1901539016 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f6fe807cfc0 con 0x7f6fd4038ba0 2024-03-04T09:05:59.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:57.823+0000 7f6ff0256700 1 -- 172.21.15.82:0/2653141654 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7f6fd4038ba0 msgr2=0x7f6fd403b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:05:59.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:57.823+0000 7f6ff0256700 1 --2- 172.21.15.82:0/2653141654 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7f6fd4038ba0 0x7f6fd403b060 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4006fd0 tx=0x7f6fe4006e40 comp rx=0 tx=0).stop 2024-03-04T09:05:59.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:57.823+0000 7f6ff0256700 1 -- 172.21.15.82:0/2653141654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fe8107ad0 msgr2=0x7f6fe807db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:05:59.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:57.823+0000 7f6ff0256700 1 --2- 172.21.15.82:0/2653141654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fe8107ad0 0x7f6fe807db10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8011670 tx=0x7f6fd8011b50 comp rx=0 tx=0).stop 2024-03-04T09:05:59.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:57.823+0000 7f6ff0256700 1 -- 172.21.15.82:0/2653141654 shutdown_connections 2024-03-04T09:05:59.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:57.823+0000 7f6ff0256700 1 --2- 172.21.15.82:0/2653141654 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7f6fd4038ba0 0x7f6fd403b060 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:05:59.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:57.823+0000 7f6ff0256700 1 --2- 172.21.15.82:0/2653141654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fe8107ad0 0x7f6fe807db10 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:05:59.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:57.823+0000 7f6ff0256700 1 -- 172.21.15.82:0/2653141654 >> 172.21.15.82:0/2653141654 conn(0x7f6fe8103170 msgr2=0x7f6fe8103c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:05:59.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:57.823+0000 7f6ff0256700 1 -- 172.21.15.82:0/2653141654 shutdown_connections 2024-03-04T09:05:59.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:57.823+0000 7f6ff0256700 1 -- 172.21.15.82:0/2653141654 wait complete. 2024-03-04T09:05:59.459 INFO:teuthology.orchestra.run.smithi082.stdout:Deploying unmanaged mgr service... 2024-03-04T09:06:00.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:00 smithi082 ceph-mon[32880]: from='mgr.14120 172.21.15.82:0/998079227' entity='mgr.x' 2024-03-04T09:06:00.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:00 smithi082 ceph-mon[32880]: from='mgr.14120 172.21.15.82:0/998079227' entity='mgr.x' 2024-03-04T09:06:00.711 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-03-04T09:06:00.711 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:59.908+0000 7fe0907d2700 1 Processor -- start 2024-03-04T09:06:00.711 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:59.908+0000 7fe0907d2700 1 -- start start 2024-03-04T09:06:00.711 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:59.908+0000 7fe0907d2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe088108530 0x7fe08810a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:06:00.711 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:59.908+0000 7fe0907d2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe08807bdf0 con 0x7fe088108530 2024-03-04T09:06:00.712 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:59.908+0000 7fe08e56e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe088108530 0x7fe08810a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:06:00.712 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:59.908+0000 7fe08e56e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe088108530 0x7fe08810a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55578/0 (socket says 172.21.15.82:55578) 2024-03-04T09:06:00.712 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:59.908+0000 7fe08e56e700 1 -- 172.21.15.82:0/121012768 learned_addr learned my addr 172.21.15.82:0/121012768 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:06:00.712 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:59.909+0000 7fe08e56e700 1 -- 172.21.15.82:0/121012768 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe08810ae60 con 0x7fe088108530 2024-03-04T09:06:00.712 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:59.909+0000 7fe08e56e700 1 --2- 172.21.15.82:0/121012768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe088108530 0x7fe08810a920 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe0840098a0 tx=0x7fe084009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f33098712a11af40 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:06:00.712 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:59.909+0000 7fe08d56c700 1 -- 172.21.15.82:0/121012768 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe084004160 con 0x7fe088108530 2024-03-04T09:06:00.712 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:59.909+0000 7fe08d56c700 1 -- 172.21.15.82:0/121012768 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fe084004300 con 0x7fe088108530 2024-03-04T09:06:00.712 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:59.909+0000 7fe08d56c700 1 -- 172.21.15.82:0/121012768 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe084011b10 con 0x7fe088108530 2024-03-04T09:06:00.712 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:59.909+0000 7fe0907d2700 1 -- 172.21.15.82:0/121012768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe088108530 msgr2=0x7fe08810a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:00.712 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:59.909+0000 7fe0907d2700 1 --2- 172.21.15.82:0/121012768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe088108530 0x7fe08810a920 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe0840098a0 tx=0x7fe084009bb0 comp rx=0 tx=0).stop 2024-03-04T09:06:00.712 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:59.910+0000 7fe0907d2700 1 -- 172.21.15.82:0/121012768 shutdown_connections 2024-03-04T09:06:00.712 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:59.910+0000 7fe0907d2700 1 --2- 172.21.15.82:0/121012768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe088108530 0x7fe08810a920 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:00.712 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:59.910+0000 7fe0907d2700 1 -- 172.21.15.82:0/121012768 >> 172.21.15.82:0/121012768 conn(0x7fe088101f00 msgr2=0x7fe088104340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:06:00.712 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:59.910+0000 7fe0907d2700 1 -- 172.21.15.82:0/121012768 shutdown_connections 2024-03-04T09:06:00.713 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:59.910+0000 7fe0907d2700 1 -- 172.21.15.82:0/121012768 wait complete. 2024-03-04T09:06:00.713 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:59.910+0000 7fe0907d2700 1 Processor -- start 2024-03-04T09:06:00.713 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:59.910+0000 7fe0907d2700 1 -- start start 2024-03-04T09:06:00.713 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:59.910+0000 7fe0907d2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe088108530 0x7fe08819b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:06:00.713 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:59.910+0000 7fe0907d2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe08810be70 con 0x7fe088108530 2024-03-04T09:06:00.713 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:59.910+0000 7fe08e56e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe088108530 0x7fe08819b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:06:00.713 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:59.911+0000 7fe08e56e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe088108530 0x7fe08819b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55592/0 (socket says 172.21.15.82:55592) 2024-03-04T09:06:00.713 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:59.911+0000 7fe08e56e700 1 -- 172.21.15.82:0/2143832047 learned_addr learned my addr 172.21.15.82:0/2143832047 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:06:00.713 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:59.911+0000 7fe08e56e700 1 -- 172.21.15.82:0/2143832047 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe08819bec0 con 0x7fe088108530 2024-03-04T09:06:00.713 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:59.911+0000 7fe08e56e700 1 --2- 172.21.15.82:0/2143832047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe088108530 0x7fe08819b980 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe084009fb0 tx=0x7fe084011bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:06:00.713 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:59.911+0000 7fe07f7fe700 1 -- 172.21.15.82:0/2143832047 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe084003b20 con 0x7fe088108530 2024-03-04T09:06:00.713 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:59.911+0000 7fe07f7fe700 1 -- 172.21.15.82:0/2143832047 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fe084003cc0 con 0x7fe088108530 2024-03-04T09:06:00.713 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:59.911+0000 7fe0907d2700 1 -- 172.21.15.82:0/2143832047 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe08819c150 con 0x7fe088108530 2024-03-04T09:06:00.713 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:59.911+0000 7fe07f7fe700 1 -- 172.21.15.82:0/2143832047 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe084024830 con 0x7fe088108530 2024-03-04T09:06:00.713 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:59.911+0000 7fe0907d2700 1 -- 172.21.15.82:0/2143832047 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe08819ee40 con 0x7fe088108530 2024-03-04T09:06:00.714 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:59.912+0000 7fe0907d2700 1 -- 172.21.15.82:0/2143832047 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0880636f0 con 0x7fe088108530 2024-03-04T09:06:00.714 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:59.912+0000 7fe07f7fe700 1 -- 172.21.15.82:0/2143832047 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) v1 ==== 45928+0+0 (secure 0 0 0) 0x7fe084022020 con 0x7fe088108530 2024-03-04T09:06:00.714 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:59.913+0000 7fe07f7fe700 1 --2- 172.21.15.82:0/2143832047 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7fe074038bf0 0x7fe07403b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:06:00.714 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:59.913+0000 7fe07f7fe700 1 -- 172.21.15.82:0/2143832047 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fe08404cda0 con 0x7fe088108530 2024-03-04T09:06:00.714 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:59.913+0000 7fe08dd6d700 1 --2- 172.21.15.82:0/2143832047 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7fe074038bf0 0x7fe07403b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:06:00.714 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:59.913+0000 7fe08dd6d700 1 --2- 172.21.15.82:0/2143832047 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7fe074038bf0 0x7fe07403b0b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe078006fd0 tx=0x7fe078006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:06:00.714 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:05:59.921+0000 7fe07f7fe700 1 -- 172.21.15.82:0/2143832047 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fe0840193c0 con 0x7fe088108530 2024-03-04T09:06:00.714 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:00.137+0000 7fe0907d2700 1 -- 172.21.15.82:0/2143832047 --> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fe088103150 con 0x7fe074038bf0 2024-03-04T09:06:00.714 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:00.144+0000 7fe07f7fe700 1 -- 172.21.15.82:0/2143832047 <== mgr.14120 v2:172.21.15.82:6800/1901539016 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fe088103150 con 0x7fe074038bf0 2024-03-04T09:06:00.714 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:00.146+0000 7fe0907d2700 1 -- 172.21.15.82:0/2143832047 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7fe074038bf0 msgr2=0x7fe07403b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:00.714 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:00.146+0000 7fe0907d2700 1 --2- 172.21.15.82:0/2143832047 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7fe074038bf0 0x7fe07403b0b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe078006fd0 tx=0x7fe078006e40 comp rx=0 tx=0).stop 2024-03-04T09:06:00.714 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:00.146+0000 7fe0907d2700 1 -- 172.21.15.82:0/2143832047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe088108530 msgr2=0x7fe08819b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:00.714 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:00.146+0000 7fe0907d2700 1 --2- 172.21.15.82:0/2143832047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe088108530 0x7fe08819b980 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe084009fb0 tx=0x7fe084011bd0 comp rx=0 tx=0).stop 2024-03-04T09:06:00.714 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:00.146+0000 7fe0907d2700 1 -- 172.21.15.82:0/2143832047 shutdown_connections 2024-03-04T09:06:00.715 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:00.146+0000 7fe0907d2700 1 --2- 172.21.15.82:0/2143832047 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7fe074038bf0 0x7fe07403b0b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:00.715 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:00.146+0000 7fe0907d2700 1 --2- 172.21.15.82:0/2143832047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe088108530 0x7fe08819b980 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:00.715 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:00.146+0000 7fe0907d2700 1 -- 172.21.15.82:0/2143832047 >> 172.21.15.82:0/2143832047 conn(0x7fe088101f00 msgr2=0x7fe088102a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:06:00.715 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:00.146+0000 7fe0907d2700 1 -- 172.21.15.82:0/2143832047 shutdown_connections 2024-03-04T09:06:00.715 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:00.146+0000 7fe0907d2700 1 -- 172.21.15.82:0/2143832047 wait complete. 2024-03-04T09:06:01.316 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:01 smithi082 ceph-mon[32880]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:06:01.316 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:01 smithi082 ceph-mon[32880]: Saving service mgr spec with placement count:2 2024-03-04T09:06:01.316 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:01 smithi082 ceph-mon[32880]: from='mgr.14120 172.21.15.82:0/998079227' entity='mgr.x' 2024-03-04T09:06:02.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:02 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/1562791156' entity='client.admin' 2024-03-04T09:06:02.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:02 smithi082 ceph-mon[32880]: from='mgr.14120 172.21.15.82:0/998079227' entity='mgr.x' 2024-03-04T09:06:02.595 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:01.112+0000 7fdc88ba7700 1 Processor -- start 2024-03-04T09:06:02.595 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:01.112+0000 7fdc88ba7700 1 -- start start 2024-03-04T09:06:02.595 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:01.113+0000 7fdc88ba7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc84106e90 0x7fdc841072b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:06:02.595 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:01.113+0000 7fdc88ba7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc84107880 con 0x7fdc84106e90 2024-03-04T09:06:02.596 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:01.113+0000 7fdc8259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc84106e90 0x7fdc841072b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:06:02.596 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:01.113+0000 7fdc8259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc84106e90 0x7fdc841072b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55604/0 (socket says 172.21.15.82:55604) 2024-03-04T09:06:02.596 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:01.113+0000 7fdc8259c700 1 -- 172.21.15.82:0/749151014 learned_addr learned my addr 172.21.15.82:0/749151014 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:06:02.596 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:01.113+0000 7fdc8259c700 1 -- 172.21.15.82:0/749151014 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc84107bb0 con 0x7fdc84106e90 2024-03-04T09:06:02.596 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:01.113+0000 7fdc8259c700 1 --2- 172.21.15.82:0/749151014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc84106e90 0x7fdc841072b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdc7400bb40 tx=0x7fdc7400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9865c46c20f0b4bb server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:06:02.596 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:01.113+0000 7fdc8159a700 1 -- 172.21.15.82:0/749151014 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdc7400dbe0 con 0x7fdc84106e90 2024-03-04T09:06:02.596 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:01.113+0000 7fdc8159a700 1 -- 172.21.15.82:0/749151014 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fdc74004500 con 0x7fdc84106e90 2024-03-04T09:06:02.596 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:01.113+0000 7fdc8159a700 1 -- 172.21.15.82:0/749151014 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdc74010470 con 0x7fdc84106e90 2024-03-04T09:06:02.596 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:01.114+0000 7fdc88ba7700 1 -- 172.21.15.82:0/749151014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc84106e90 msgr2=0x7fdc841072b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:02.596 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:01.114+0000 7fdc88ba7700 1 --2- 172.21.15.82:0/749151014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc84106e90 0x7fdc841072b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdc7400bb40 tx=0x7fdc7400be50 comp rx=0 tx=0).stop 2024-03-04T09:06:02.596 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:01.114+0000 7fdc88ba7700 1 -- 172.21.15.82:0/749151014 shutdown_connections 2024-03-04T09:06:02.596 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:01.114+0000 7fdc88ba7700 1 --2- 172.21.15.82:0/749151014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc84106e90 0x7fdc841072b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:02.596 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:01.114+0000 7fdc88ba7700 1 -- 172.21.15.82:0/749151014 >> 172.21.15.82:0/749151014 conn(0x7fdc84101710 msgr2=0x7fdc84103b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:06:02.596 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:01.114+0000 7fdc88ba7700 1 -- 172.21.15.82:0/749151014 shutdown_connections 2024-03-04T09:06:02.597 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:01.114+0000 7fdc88ba7700 1 -- 172.21.15.82:0/749151014 wait complete. 2024-03-04T09:06:02.597 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:01.115+0000 7fdc88ba7700 1 Processor -- start 2024-03-04T09:06:02.597 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:01.115+0000 7fdc88ba7700 1 -- start start 2024-03-04T09:06:02.597 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:01.115+0000 7fdc88ba7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc84106e90 0x7fdc8419dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:06:02.597 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:01.115+0000 7fdc88ba7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc841059f0 con 0x7fdc84106e90 2024-03-04T09:06:02.597 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:01.115+0000 7fdc8259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc84106e90 0x7fdc8419dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:06:02.597 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:01.115+0000 7fdc8259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc84106e90 0x7fdc8419dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55606/0 (socket says 172.21.15.82:55606) 2024-03-04T09:06:02.597 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:01.115+0000 7fdc8259c700 1 -- 172.21.15.82:0/1562791156 learned_addr learned my addr 172.21.15.82:0/1562791156 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:06:02.597 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:01.115+0000 7fdc8259c700 1 -- 172.21.15.82:0/1562791156 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc8419e0e0 con 0x7fdc84106e90 2024-03-04T09:06:02.597 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:01.116+0000 7fdc8259c700 1 --2- 172.21.15.82:0/1562791156 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc84106e90 0x7fdc8419dba0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdc74003fc0 tx=0x7fdc740040a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:06:02.597 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:01.116+0000 7fdc737fe700 1 -- 172.21.15.82:0/1562791156 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdc74010770 con 0x7fdc84106e90 2024-03-04T09:06:02.597 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:01.116+0000 7fdc737fe700 1 -- 172.21.15.82:0/1562791156 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fdc7401d070 con 0x7fdc84106e90 2024-03-04T09:06:02.597 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:01.116+0000 7fdc88ba7700 1 -- 172.21.15.82:0/1562791156 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc8419e370 con 0x7fdc84106e90 2024-03-04T09:06:02.598 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:01.116+0000 7fdc737fe700 1 -- 172.21.15.82:0/1562791156 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdc74021d40 con 0x7fdc84106e90 2024-03-04T09:06:02.598 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:01.116+0000 7fdc88ba7700 1 -- 172.21.15.82:0/1562791156 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc841a1060 con 0x7fdc84106e90 2024-03-04T09:06:02.598 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:01.117+0000 7fdc737fe700 1 -- 172.21.15.82:0/1562791156 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) v1 ==== 45928+0+0 (secure 0 0 0) 0x7fdc7401f030 con 0x7fdc84106e90 2024-03-04T09:06:02.598 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:01.117+0000 7fdc737fe700 1 --2- 172.21.15.82:0/1562791156 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7fdc6c038b50 0x7fdc6c03b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:06:02.598 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:01.117+0000 7fdc737fe700 1 -- 172.21.15.82:0/1562791156 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fdc7404ce80 con 0x7fdc84106e90 2024-03-04T09:06:02.598 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:01.117+0000 7fdc88ba7700 1 -- 172.21.15.82:0/1562791156 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc840636f0 con 0x7fdc84106e90 2024-03-04T09:06:02.598 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:01.117+0000 7fdc81d9b700 1 --2- 172.21.15.82:0/1562791156 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7fdc6c038b50 0x7fdc6c03b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:06:02.598 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:01.117+0000 7fdc81d9b700 1 --2- 172.21.15.82:0/1562791156 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7fdc6c038b50 0x7fdc6c03b010 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fdc78006fd0 tx=0x7fdc78006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:06:02.598 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:01.122+0000 7fdc737fe700 1 -- 172.21.15.82:0/1562791156 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fdc74015070 con 0x7fdc84106e90 2024-03-04T09:06:02.598 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:01.328+0000 7fdc88ba7700 1 -- 172.21.15.82:0/1562791156 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7fdc84192cf0 con 0x7fdc84106e90 2024-03-04T09:06:02.598 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:01.331+0000 7fdc737fe700 1 -- 172.21.15.82:0/1562791156 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7fdc84192cf0 con 0x7fdc84106e90 2024-03-04T09:06:02.598 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:01.334+0000 7fdc88ba7700 1 -- 172.21.15.82:0/1562791156 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7fdc6c038b50 msgr2=0x7fdc6c03b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:02.598 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:01.334+0000 7fdc88ba7700 1 --2- 172.21.15.82:0/1562791156 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7fdc6c038b50 0x7fdc6c03b010 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fdc78006fd0 tx=0x7fdc78006e40 comp rx=0 tx=0).stop 2024-03-04T09:06:02.598 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:01.334+0000 7fdc88ba7700 1 -- 172.21.15.82:0/1562791156 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc84106e90 msgr2=0x7fdc8419dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:02.599 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:01.334+0000 7fdc88ba7700 1 --2- 172.21.15.82:0/1562791156 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc84106e90 0x7fdc8419dba0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdc74003fc0 tx=0x7fdc740040a0 comp rx=0 tx=0).stop 2024-03-04T09:06:02.599 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:01.334+0000 7fdc88ba7700 1 -- 172.21.15.82:0/1562791156 shutdown_connections 2024-03-04T09:06:02.599 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:01.334+0000 7fdc88ba7700 1 --2- 172.21.15.82:0/1562791156 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7fdc6c038b50 0x7fdc6c03b010 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:02.599 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:01.334+0000 7fdc88ba7700 1 --2- 172.21.15.82:0/1562791156 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc84106e90 0x7fdc8419dba0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:02.599 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:01.334+0000 7fdc88ba7700 1 -- 172.21.15.82:0/1562791156 >> 172.21.15.82:0/1562791156 conn(0x7fdc84101710 msgr2=0x7fdc8418fdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:06:02.599 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:01.334+0000 7fdc88ba7700 1 -- 172.21.15.82:0/1562791156 shutdown_connections 2024-03-04T09:06:02.599 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:01.334+0000 7fdc88ba7700 1 -- 172.21.15.82:0/1562791156 wait complete. 2024-03-04T09:06:03.885 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:03.083+0000 7f7db1569700 1 Processor -- start 2024-03-04T09:06:03.885 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:03.083+0000 7f7db1569700 1 -- start start 2024-03-04T09:06:03.885 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:03.083+0000 7f7db1569700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dac1085a0 0x7f7dac10a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:06:03.885 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:03.083+0000 7f7db1569700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dac07be10 con 0x7f7dac1085a0 2024-03-04T09:06:03.885 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:03.084+0000 7f7daaffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dac1085a0 0x7f7dac10a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:06:03.885 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:03.084+0000 7f7daaffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dac1085a0 0x7f7dac10a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55622/0 (socket says 172.21.15.82:55622) 2024-03-04T09:06:03.885 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:03.084+0000 7f7daaffd700 1 -- 172.21.15.82:0/4242086152 learned_addr learned my addr 172.21.15.82:0/4242086152 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:06:03.885 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:03.084+0000 7f7daaffd700 1 -- 172.21.15.82:0/4242086152 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dac10aed0 con 0x7f7dac1085a0 2024-03-04T09:06:03.885 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:03.084+0000 7f7daaffd700 1 --2- 172.21.15.82:0/4242086152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dac1085a0 0x7f7dac10a990 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c0098a0 tx=0x7f7d9c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15656fe597952070 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:06:03.885 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:03.084+0000 7f7da9ffb700 1 -- 172.21.15.82:0/4242086152 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7d9c004160 con 0x7f7dac1085a0 2024-03-04T09:06:03.886 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:03.084+0000 7f7da9ffb700 1 -- 172.21.15.82:0/4242086152 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f7d9c004300 con 0x7f7dac1085a0 2024-03-04T09:06:03.886 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:03.084+0000 7f7da9ffb700 1 -- 172.21.15.82:0/4242086152 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7d9c011b10 con 0x7f7dac1085a0 2024-03-04T09:06:03.886 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:03.085+0000 7f7db1569700 1 -- 172.21.15.82:0/4242086152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dac1085a0 msgr2=0x7f7dac10a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:03.886 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:03.085+0000 7f7db1569700 1 --2- 172.21.15.82:0/4242086152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dac1085a0 0x7f7dac10a990 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c0098a0 tx=0x7f7d9c009bb0 comp rx=0 tx=0).stop 2024-03-04T09:06:03.886 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:03.085+0000 7f7db1569700 1 -- 172.21.15.82:0/4242086152 shutdown_connections 2024-03-04T09:06:03.886 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:03.085+0000 7f7db1569700 1 --2- 172.21.15.82:0/4242086152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dac1085a0 0x7f7dac10a990 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:03.886 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:03.085+0000 7f7db1569700 1 -- 172.21.15.82:0/4242086152 >> 172.21.15.82:0/4242086152 conn(0x7f7dac101ff0 msgr2=0x7f7dac104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:06:03.886 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:03.085+0000 7f7db1569700 1 -- 172.21.15.82:0/4242086152 shutdown_connections 2024-03-04T09:06:03.886 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:03.085+0000 7f7db1569700 1 -- 172.21.15.82:0/4242086152 wait complete. 2024-03-04T09:06:03.886 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:03.086+0000 7f7db1569700 1 Processor -- start 2024-03-04T09:06:03.886 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:03.086+0000 7f7db1569700 1 -- start start 2024-03-04T09:06:03.886 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:03.086+0000 7f7db1569700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dac1085a0 0x7f7dac107e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:06:03.886 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:03.086+0000 7f7db1569700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dac10bf30 con 0x7f7dac1085a0 2024-03-04T09:06:03.886 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:03.086+0000 7f7daaffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dac1085a0 0x7f7dac107e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:06:03.887 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:03.086+0000 7f7daaffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dac1085a0 0x7f7dac107e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55638/0 (socket says 172.21.15.82:55638) 2024-03-04T09:06:03.887 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:03.086+0000 7f7daaffd700 1 -- 172.21.15.82:0/2869228647 learned_addr learned my addr 172.21.15.82:0/2869228647 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:06:03.887 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:03.087+0000 7f7daaffd700 1 -- 172.21.15.82:0/2869228647 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dac108360 con 0x7f7dac1085a0 2024-03-04T09:06:03.887 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:03.087+0000 7f7daaffd700 1 --2- 172.21.15.82:0/2869228647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dac1085a0 0x7f7dac107e20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c011670 tx=0x7f7d9c011bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:06:03.887 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:03.087+0000 7f7d93fff700 1 -- 172.21.15.82:0/2869228647 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7d9c003930 con 0x7f7dac1085a0 2024-03-04T09:06:03.887 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:03.087+0000 7f7db1569700 1 -- 172.21.15.82:0/2869228647 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dac106550 con 0x7f7dac1085a0 2024-03-04T09:06:03.887 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:03.087+0000 7f7d93fff700 1 -- 172.21.15.82:0/2869228647 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f7d9c003ad0 con 0x7f7dac1085a0 2024-03-04T09:06:03.887 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:03.087+0000 7f7d93fff700 1 -- 172.21.15.82:0/2869228647 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7d9c019550 con 0x7f7dac1085a0 2024-03-04T09:06:03.887 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:03.087+0000 7f7db1569700 1 -- 172.21.15.82:0/2869228647 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dac106a90 con 0x7f7dac1085a0 2024-03-04T09:06:03.887 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:03.088+0000 7f7d93fff700 1 -- 172.21.15.82:0/2869228647 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) v1 ==== 45928+0+0 (secure 0 0 0) 0x7f7d9c019870 con 0x7f7dac1085a0 2024-03-04T09:06:03.887 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:03.088+0000 7f7db1569700 1 -- 172.21.15.82:0/2869228647 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dac0636f0 con 0x7f7dac1085a0 2024-03-04T09:06:03.887 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:03.088+0000 7f7d93fff700 1 --2- 172.21.15.82:0/2869228647 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7f7d94038b50 0x7f7d9403b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:06:03.887 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:03.088+0000 7f7d93fff700 1 -- 172.21.15.82:0/2869228647 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f7d9c04ce70 con 0x7f7dac1085a0 2024-03-04T09:06:03.888 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:03.088+0000 7f7daa7fc700 1 --2- 172.21.15.82:0/2869228647 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7f7d94038b50 0x7f7d9403b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:06:03.888 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:03.089+0000 7f7daa7fc700 1 --2- 172.21.15.82:0/2869228647 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7f7d94038b50 0x7f7d9403b010 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7da0006fd0 tx=0x7f7da0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:06:03.888 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:03.097+0000 7f7d93fff700 1 -- 172.21.15.82:0/2869228647 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f7d9c003c80 con 0x7f7dac1085a0 2024-03-04T09:06:03.888 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:03.299+0000 7f7db1569700 1 -- 172.21.15.82:0/2869228647 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f7dac106dd0 con 0x7f7dac1085a0 2024-03-04T09:06:03.888 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:03.303+0000 7f7d93fff700 1 -- 172.21.15.82:0/2869228647 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f7dac106dd0 con 0x7f7dac1085a0 2024-03-04T09:06:03.888 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:03.305+0000 7f7db1569700 1 -- 172.21.15.82:0/2869228647 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7f7d94038b50 msgr2=0x7f7d9403b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:03.888 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:03.305+0000 7f7db1569700 1 --2- 172.21.15.82:0/2869228647 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7f7d94038b50 0x7f7d9403b010 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7da0006fd0 tx=0x7f7da0006e40 comp rx=0 tx=0).stop 2024-03-04T09:06:03.888 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:03.305+0000 7f7db1569700 1 -- 172.21.15.82:0/2869228647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dac1085a0 msgr2=0x7f7dac107e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:03.888 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:03.305+0000 7f7db1569700 1 --2- 172.21.15.82:0/2869228647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dac1085a0 0x7f7dac107e20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c011670 tx=0x7f7d9c011bd0 comp rx=0 tx=0).stop 2024-03-04T09:06:03.888 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:03.305+0000 7f7db1569700 1 -- 172.21.15.82:0/2869228647 shutdown_connections 2024-03-04T09:06:03.888 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:03.305+0000 7f7db1569700 1 --2- 172.21.15.82:0/2869228647 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7f7d94038b50 0x7f7d9403b010 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:03.888 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:03.305+0000 7f7db1569700 1 --2- 172.21.15.82:0/2869228647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dac1085a0 0x7f7dac107e20 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:03.888 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:03.305+0000 7f7db1569700 1 -- 172.21.15.82:0/2869228647 >> 172.21.15.82:0/2869228647 conn(0x7f7dac101ff0 msgr2=0x7f7dac102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:06:03.889 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:03.306+0000 7f7db1569700 1 -- 172.21.15.82:0/2869228647 shutdown_connections 2024-03-04T09:06:03.889 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:03.306+0000 7f7db1569700 1 -- 172.21.15.82:0/2869228647 wait complete. 2024-03-04T09:06:03.889 INFO:teuthology.orchestra.run.smithi082.stdout:Enabling the dashboard module... 2024-03-04T09:06:04.498 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:04 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/2869228647' entity='client.admin' 2024-03-04T09:06:04.498 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:04 smithi082 ceph-mon[32880]: from='mgr.14120 172.21.15.82:0/998079227' entity='mgr.x' 2024-03-04T09:06:05.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:05 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/111939190' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-03-04T09:06:05.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:05 smithi082 ceph-mon[32880]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:06:05.567 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:06:05 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: ignoring --setuser ceph since I am not root 2024-03-04T09:06:05.567 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:06:05 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: ignoring --setgroup ceph since I am not root 2024-03-04T09:06:06.066 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:06:05 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:06:05.877+0000 7f1238201200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-04T09:06:06.066 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:06:05 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:06:05.972+0000 7f1238201200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-04T09:06:06.121 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:04.300+0000 7ff5e8837700 1 Processor -- start 2024-03-04T09:06:06.122 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:04.300+0000 7ff5e8837700 1 -- start start 2024-03-04T09:06:06.122 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:04.300+0000 7ff5e8837700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5e41060f0 0x7ff5e4106510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:06:06.122 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:04.300+0000 7ff5e8837700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e4106ae0 con 0x7ff5e41060f0 2024-03-04T09:06:06.122 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:04.300+0000 7ff5e259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5e41060f0 0x7ff5e4106510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:06:06.122 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:04.301+0000 7ff5e259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5e41060f0 0x7ff5e4106510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55646/0 (socket says 172.21.15.82:55646) 2024-03-04T09:06:06.122 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:04.301+0000 7ff5e259c700 1 -- 172.21.15.82:0/3781593657 learned_addr learned my addr 172.21.15.82:0/3781593657 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:06:06.122 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:04.301+0000 7ff5e259c700 1 -- 172.21.15.82:0/3781593657 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e41072f0 con 0x7ff5e41060f0 2024-03-04T09:06:06.122 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:04.301+0000 7ff5e259c700 1 --2- 172.21.15.82:0/3781593657 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5e41060f0 0x7ff5e4106510 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff5d4009ab0 tx=0x7ff5d4009dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4517ab9015a39518 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:06:06.122 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:04.303+0000 7ff5e1d9b700 1 -- 172.21.15.82:0/3781593657 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5d4004160 con 0x7ff5e41060f0 2024-03-04T09:06:06.122 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:04.303+0000 7ff5e1d9b700 1 -- 172.21.15.82:0/3781593657 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7ff5d400bcb0 con 0x7ff5e41060f0 2024-03-04T09:06:06.122 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:04.303+0000 7ff5e1d9b700 1 -- 172.21.15.82:0/3781593657 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5d4003c70 con 0x7ff5e41060f0 2024-03-04T09:06:06.122 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:04.304+0000 7ff5e8837700 1 -- 172.21.15.82:0/3781593657 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5e41060f0 msgr2=0x7ff5e4106510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:06.122 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:04.304+0000 7ff5e8837700 1 --2- 172.21.15.82:0/3781593657 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5e41060f0 0x7ff5e4106510 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff5d4009ab0 tx=0x7ff5d4009dc0 comp rx=0 tx=0).stop 2024-03-04T09:06:06.123 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:04.304+0000 7ff5e8837700 1 -- 172.21.15.82:0/3781593657 shutdown_connections 2024-03-04T09:06:06.123 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:04.304+0000 7ff5e8837700 1 --2- 172.21.15.82:0/3781593657 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5e41060f0 0x7ff5e4106510 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:06.123 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:04.304+0000 7ff5e8837700 1 -- 172.21.15.82:0/3781593657 >> 172.21.15.82:0/3781593657 conn(0x7ff5e4101710 msgr2=0x7ff5e4103b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:06:06.123 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:04.304+0000 7ff5e8837700 1 -- 172.21.15.82:0/3781593657 shutdown_connections 2024-03-04T09:06:06.123 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:04.304+0000 7ff5e8837700 1 -- 172.21.15.82:0/3781593657 wait complete. 2024-03-04T09:06:06.123 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:04.305+0000 7ff5e8837700 1 Processor -- start 2024-03-04T09:06:06.123 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:04.305+0000 7ff5e8837700 1 -- start start 2024-03-04T09:06:06.123 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:04.305+0000 7ff5e8837700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5e41060f0 0x7ff5e419ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:06:06.123 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:04.305+0000 7ff5e8837700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e410a6a0 con 0x7ff5e41060f0 2024-03-04T09:06:06.123 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:04.305+0000 7ff5e259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5e41060f0 0x7ff5e419ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:06:06.123 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:04.305+0000 7ff5e259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5e41060f0 0x7ff5e419ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55648/0 (socket says 172.21.15.82:55648) 2024-03-04T09:06:06.123 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:04.305+0000 7ff5e259c700 1 -- 172.21.15.82:0/111939190 learned_addr learned my addr 172.21.15.82:0/111939190 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:06:06.123 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:04.305+0000 7ff5e259c700 1 -- 172.21.15.82:0/111939190 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e419bfc0 con 0x7ff5e41060f0 2024-03-04T09:06:06.123 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:04.306+0000 7ff5e259c700 1 --2- 172.21.15.82:0/111939190 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5e41060f0 0x7ff5e419ba80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff5d400ba10 tx=0x7ff5d400baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:06:06.124 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:04.306+0000 7ff5dbfff700 1 -- 172.21.15.82:0/111939190 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5d4004260 con 0x7ff5e41060f0 2024-03-04T09:06:06.124 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:04.306+0000 7ff5dbfff700 1 -- 172.21.15.82:0/111939190 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7ff5d4004400 con 0x7ff5e41060f0 2024-03-04T09:06:06.124 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:04.306+0000 7ff5e8837700 1 -- 172.21.15.82:0/111939190 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5e419c250 con 0x7ff5e41060f0 2024-03-04T09:06:06.124 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:04.306+0000 7ff5dbfff700 1 -- 172.21.15.82:0/111939190 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5d40115b0 con 0x7ff5e41060f0 2024-03-04T09:06:06.124 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:04.306+0000 7ff5e8837700 1 -- 172.21.15.82:0/111939190 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5e419ef40 con 0x7ff5e41060f0 2024-03-04T09:06:06.124 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:04.307+0000 7ff5dbfff700 1 -- 172.21.15.82:0/111939190 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) v1 ==== 45928+0+0 (secure 0 0 0) 0x7ff5d40117f0 con 0x7ff5e41060f0 2024-03-04T09:06:06.124 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:04.307+0000 7ff5dbfff700 1 --2- 172.21.15.82:0/111939190 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7ff5d0038ba0 0x7ff5d003b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:06:06.124 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:04.307+0000 7ff5e8837700 1 -- 172.21.15.82:0/111939190 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5e40636f0 con 0x7ff5e41060f0 2024-03-04T09:06:06.124 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:04.307+0000 7ff5dbfff700 1 -- 172.21.15.82:0/111939190 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7ff5d404d070 con 0x7ff5e41060f0 2024-03-04T09:06:06.124 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:04.307+0000 7ff5d9d9b700 1 --2- 172.21.15.82:0/111939190 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7ff5d0038ba0 0x7ff5d003b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:06:06.124 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:04.307+0000 7ff5d9d9b700 1 --2- 172.21.15.82:0/111939190 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7ff5d0038ba0 0x7ff5d003b060 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc006fd0 tx=0x7ff5cc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:06:06.124 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:04.312+0000 7ff5dbfff700 1 -- 172.21.15.82:0/111939190 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7ff5d401f030 con 0x7ff5e41060f0 2024-03-04T09:06:06.124 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:04.567+0000 7ff5e8837700 1 -- 172.21.15.82:0/111939190 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7ff5e402dc00 con 0x7ff5e41060f0 2024-03-04T09:06:06.124 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:05.306+0000 7ff5dbfff700 1 -- 172.21.15.82:0/111939190 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7ff5d400d1c0 con 0x7ff5e41060f0 2024-03-04T09:06:06.125 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:05.307+0000 7ff5dbfff700 1 -- 172.21.15.82:0/111939190 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mgrmap(e 9) v1 ==== 45941+0+0 (secure 0 0 0) 0x7ff5d401ba10 con 0x7ff5e41060f0 2024-03-04T09:06:06.125 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:05.309+0000 7ff5e8837700 1 -- 172.21.15.82:0/111939190 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7ff5d0038ba0 msgr2=0x7ff5d003b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:06.125 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:05.309+0000 7ff5e8837700 1 --2- 172.21.15.82:0/111939190 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7ff5d0038ba0 0x7ff5d003b060 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc006fd0 tx=0x7ff5cc006e40 comp rx=0 tx=0).stop 2024-03-04T09:06:06.125 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:05.309+0000 7ff5e8837700 1 -- 172.21.15.82:0/111939190 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5e41060f0 msgr2=0x7ff5e419ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:06.125 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:05.309+0000 7ff5e8837700 1 --2- 172.21.15.82:0/111939190 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5e41060f0 0x7ff5e419ba80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff5d400ba10 tx=0x7ff5d400baf0 comp rx=0 tx=0).stop 2024-03-04T09:06:06.125 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:05.309+0000 7ff5e8837700 1 -- 172.21.15.82:0/111939190 shutdown_connections 2024-03-04T09:06:06.125 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:05.309+0000 7ff5e8837700 1 --2- 172.21.15.82:0/111939190 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7ff5d0038ba0 0x7ff5d003b060 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:06.125 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:05.309+0000 7ff5e8837700 1 --2- 172.21.15.82:0/111939190 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5e41060f0 0x7ff5e419ba80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:06.125 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:05.309+0000 7ff5e8837700 1 -- 172.21.15.82:0/111939190 >> 172.21.15.82:0/111939190 conn(0x7ff5e4101710 msgr2=0x7ff5e4102a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:06:06.125 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:05.309+0000 7ff5e8837700 1 -- 172.21.15.82:0/111939190 shutdown_connections 2024-03-04T09:06:06.125 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:05.309+0000 7ff5e8837700 1 -- 172.21.15.82:0/111939190 wait complete. 2024-03-04T09:06:06.458 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:06 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/111939190' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-03-04T09:06:06.459 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:06 smithi082 ceph-mon[32880]: mgrmap e9: x(active, since 20s) 2024-03-04T09:06:06.718 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:06:06 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:06:06.628+0000 7f1238201200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-04T09:06:07.048 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:06:06 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:06:06.722+0000 7f1238201200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-04T09:06:07.048 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:06:06 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:06:06.870+0000 7f1238201200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-04T09:06:07.049 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:06:06 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:06:06.969+0000 7f1238201200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-04T09:06:07.049 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:06:07 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:06:07.052+0000 7f1238201200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-04T09:06:07.438 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-03-04T09:06:07.439 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-03-04T09:06:07.439 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "available": true, 2024-03-04T09:06:07.439 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-03-04T09:06:07.439 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-03-04T09:06:07.439 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-03-04T09:06:07.439 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:06.562+0000 7fd4594ab700 1 Processor -- start 2024-03-04T09:06:07.439 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:06.562+0000 7fd4594ab700 1 -- start start 2024-03-04T09:06:07.439 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:06.562+0000 7fd4594ab700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd454108510 0x7fd45410a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:06:07.439 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:06.562+0000 7fd4594ab700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45407be10 con 0x7fd454108510 2024-03-04T09:06:07.439 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:06.562+0000 7fd452ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd454108510 0x7fd45410a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:06:07.439 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:06.562+0000 7fd452ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd454108510 0x7fd45410a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37248/0 (socket says 172.21.15.82:37248) 2024-03-04T09:06:07.439 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:06.562+0000 7fd452ffd700 1 -- 172.21.15.82:0/1129630994 learned_addr learned my addr 172.21.15.82:0/1129630994 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:06:07.439 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:06.563+0000 7fd452ffd700 1 -- 172.21.15.82:0/1129630994 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd45410ae40 con 0x7fd454108510 2024-03-04T09:06:07.439 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:06.563+0000 7fd452ffd700 1 --2- 172.21.15.82:0/1129630994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd454108510 0x7fd45410a900 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd4480098a0 tx=0x7fd448009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6812b58ba878910 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:06:07.439 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:06.563+0000 7fd451ffb700 1 -- 172.21.15.82:0/1129630994 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd448004160 con 0x7fd454108510 2024-03-04T09:06:07.440 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:06.563+0000 7fd451ffb700 1 -- 172.21.15.82:0/1129630994 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fd448004300 con 0x7fd454108510 2024-03-04T09:06:07.440 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:06.563+0000 7fd451ffb700 1 -- 172.21.15.82:0/1129630994 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd448011b10 con 0x7fd454108510 2024-03-04T09:06:07.440 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:06.564+0000 7fd4594ab700 1 -- 172.21.15.82:0/1129630994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd454108510 msgr2=0x7fd45410a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:07.440 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:06.564+0000 7fd4594ab700 1 --2- 172.21.15.82:0/1129630994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd454108510 0x7fd45410a900 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd4480098a0 tx=0x7fd448009bb0 comp rx=0 tx=0).stop 2024-03-04T09:06:07.440 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:06.564+0000 7fd4594ab700 1 -- 172.21.15.82:0/1129630994 shutdown_connections 2024-03-04T09:06:07.440 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:06.564+0000 7fd4594ab700 1 --2- 172.21.15.82:0/1129630994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd454108510 0x7fd45410a900 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:07.440 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:06.564+0000 7fd4594ab700 1 -- 172.21.15.82:0/1129630994 >> 172.21.15.82:0/1129630994 conn(0x7fd454101f00 msgr2=0x7fd454104340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:06:07.440 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:06.564+0000 7fd4594ab700 1 -- 172.21.15.82:0/1129630994 shutdown_connections 2024-03-04T09:06:07.440 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:06.564+0000 7fd4594ab700 1 -- 172.21.15.82:0/1129630994 wait complete. 2024-03-04T09:06:07.440 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:06.565+0000 7fd4594ab700 1 Processor -- start 2024-03-04T09:06:07.440 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:06.565+0000 7fd4594ab700 1 -- start start 2024-03-04T09:06:07.440 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:06.565+0000 7fd4594ab700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd454108510 0x7fd45419b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:06:07.440 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:06.565+0000 7fd4594ab700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45410bea0 con 0x7fd454108510 2024-03-04T09:06:07.440 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:06.565+0000 7fd452ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd454108510 0x7fd45419b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:06:07.441 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:06.565+0000 7fd452ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd454108510 0x7fd45419b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37254/0 (socket says 172.21.15.82:37254) 2024-03-04T09:06:07.441 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:06.565+0000 7fd452ffd700 1 -- 172.21.15.82:0/4114685364 learned_addr learned my addr 172.21.15.82:0/4114685364 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:06:07.441 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:06.565+0000 7fd452ffd700 1 -- 172.21.15.82:0/4114685364 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd45419bec0 con 0x7fd454108510 2024-03-04T09:06:07.441 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:06.565+0000 7fd452ffd700 1 --2- 172.21.15.82:0/4114685364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd454108510 0x7fd45419b980 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd448009fb0 tx=0x7fd448011bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:06:07.441 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:06.566+0000 7fd43bfff700 1 -- 172.21.15.82:0/4114685364 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd448003b20 con 0x7fd454108510 2024-03-04T09:06:07.441 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:06.566+0000 7fd43bfff700 1 -- 172.21.15.82:0/4114685364 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fd448003cc0 con 0x7fd454108510 2024-03-04T09:06:07.441 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:06.566+0000 7fd43bfff700 1 -- 172.21.15.82:0/4114685364 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd448024830 con 0x7fd454108510 2024-03-04T09:06:07.441 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:06.566+0000 7fd4594ab700 1 -- 172.21.15.82:0/4114685364 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd45419c150 con 0x7fd454108510 2024-03-04T09:06:07.441 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:06.566+0000 7fd4594ab700 1 -- 172.21.15.82:0/4114685364 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd45419ee40 con 0x7fd454108510 2024-03-04T09:06:07.441 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:06.567+0000 7fd43bfff700 1 -- 172.21.15.82:0/4114685364 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 9) v1 ==== 45941+0+0 (secure 0 0 0) 0x7fd448022020 con 0x7fd454108510 2024-03-04T09:06:07.441 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:06.567+0000 7fd4594ab700 1 -- 172.21.15.82:0/4114685364 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4540636f0 con 0x7fd454108510 2024-03-04T09:06:07.441 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:06.567+0000 7fd43bfff700 1 --2- 172.21.15.82:0/4114685364 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7fd43c038c50 0x7fd43c03b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:06:07.441 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:06.567+0000 7fd43bfff700 1 -- 172.21.15.82:0/4114685364 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fd44804ca80 con 0x7fd454108510 2024-03-04T09:06:07.442 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:06.567+0000 7fd4527fc700 1 -- 172.21.15.82:0/4114685364 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7fd43c038c50 msgr2=0x7fd43c03b110 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/1901539016 2024-03-04T09:06:07.442 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:06.567+0000 7fd4527fc700 1 --2- 172.21.15.82:0/4114685364 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7fd43c038c50 0x7fd43c03b110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-04T09:06:07.442 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:06.571+0000 7fd43bfff700 1 -- 172.21.15.82:0/4114685364 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fd4480172b0 con 0x7fd454108510 2024-03-04T09:06:07.442 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:06.768+0000 7fd4527fc700 1 -- 172.21.15.82:0/4114685364 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7fd43c038c50 msgr2=0x7fd43c03b110 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/1901539016 2024-03-04T09:06:07.442 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:06.768+0000 7fd4527fc700 1 --2- 172.21.15.82:0/4114685364 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7fd43c038c50 0x7fd43c03b110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-04T09:06:07.442 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:06.849+0000 7fd4594ab700 1 -- 172.21.15.82:0/4114685364 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fd45419f3f0 con 0x7fd454108510 2024-03-04T09:06:07.442 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:06.849+0000 7fd43bfff700 1 -- 172.21.15.82:0/4114685364 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (secure 0 0 0) 0x7fd44800b5a0 con 0x7fd454108510 2024-03-04T09:06:07.442 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:06.851+0000 7fd4594ab700 1 -- 172.21.15.82:0/4114685364 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7fd43c038c50 msgr2=0x7fd43c03b110 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-04T09:06:07.442 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:06.851+0000 7fd4594ab700 1 --2- 172.21.15.82:0/4114685364 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7fd43c038c50 0x7fd43c03b110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:07.442 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:06.851+0000 7fd4594ab700 1 -- 172.21.15.82:0/4114685364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd454108510 msgr2=0x7fd45419b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:07.442 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:06.851+0000 7fd4594ab700 1 --2- 172.21.15.82:0/4114685364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd454108510 0x7fd45419b980 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd448009fb0 tx=0x7fd448011bd0 comp rx=0 tx=0).stop 2024-03-04T09:06:07.442 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:06.851+0000 7fd4594ab700 1 -- 172.21.15.82:0/4114685364 shutdown_connections 2024-03-04T09:06:07.442 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:06.851+0000 7fd4594ab700 1 --2- 172.21.15.82:0/4114685364 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7fd43c038c50 0x7fd43c03b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:07.442 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:06.851+0000 7fd4594ab700 1 --2- 172.21.15.82:0/4114685364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd454108510 0x7fd45419b980 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:07.442 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:06.851+0000 7fd4594ab700 1 -- 172.21.15.82:0/4114685364 >> 172.21.15.82:0/4114685364 conn(0x7fd454101f00 msgr2=0x7fd4541029f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:06:07.443 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:06.852+0000 7fd4594ab700 1 -- 172.21.15.82:0/4114685364 shutdown_connections 2024-03-04T09:06:07.443 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:06.852+0000 7fd4594ab700 1 -- 172.21.15.82:0/4114685364 wait complete. 2024-03-04T09:06:07.443 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for the mgr to restart... 2024-03-04T09:06:07.443 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for mgr epoch 9... 2024-03-04T09:06:07.557 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:06:07 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:06:07.320+0000 7f1238201200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-04T09:06:07.557 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:06:07 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:06:07.439+0000 7f1238201200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-04T09:06:07.557 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:06:07 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:06:07.530+0000 7f1238201200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-04T09:06:07.557 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:07 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/4114685364' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-03-04T09:06:07.816 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:06:07 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:06:07.627+0000 7f1238201200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-04T09:06:07.816 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:06:07 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:06:07.809+0000 7f1238201200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-04T09:06:09.066 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:06:08 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:06:08.766+0000 7f1238201200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-04T09:06:09.066 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:06:08 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:06:08.895+0000 7f1238201200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-04T09:06:09.508 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:06:09 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:06:09.226+0000 7f1238201200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-04T09:06:09.508 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:06:09 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:06:09.315+0000 7f1238201200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-04T09:06:09.508 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:06:09 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:06:09.512+0000 7f1238201200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-04T09:06:09.816 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:06:09 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:06:09.699+0000 7f1238201200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-04T09:06:10.235 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:06:09 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:06:09.983+0000 7f1238201200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-04T09:06:10.235 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:06:10 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:06:10.239+0000 7f1238201200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-04T09:06:10.566 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:06:10 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:06:10.474+0000 7f1238201200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-04T09:06:11.566 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:06:11 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:06:11.273+0000 7f1238201200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-04T09:06:12.150 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:06:11 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:06:11.838+0000 7f1238201200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-04T09:06:12.150 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:06:11 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:06:11.937+0000 7f1238201200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-04T09:06:12.151 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:06:12 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:06:12.154+0000 7f1238201200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-04T09:06:12.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:12 smithi082 ceph-mon[32880]: Active manager daemon x restarted 2024-03-04T09:06:12.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:12 smithi082 ceph-mon[32880]: Activating manager daemon x 2024-03-04T09:06:12.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:12 smithi082 ceph-mon[32880]: osdmap e3: 0 total, 0 up, 0 in 2024-03-04T09:06:12.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:12 smithi082 ceph-mon[32880]: mgrmap e10: x(active, starting, since 0.0034148s) 2024-03-04T09:06:12.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:12 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T09:06:12.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:12 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-04T09:06:12.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:12 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-04T09:06:12.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:12 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-04T09:06:12.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:12 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-04T09:06:12.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:12 smithi082 ceph-mon[32880]: Manager daemon x is now available 2024-03-04T09:06:12.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:12 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:06:12.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:12 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:06:13.486 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:13 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-04T09:06:13.486 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:13 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-04T09:06:13.486 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:13 smithi082 ceph-mon[32880]: mgrmap e11: x(active, since 1.00587s) 2024-03-04T09:06:13.774 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-03-04T09:06:13.774 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-03-04T09:06:13.774 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "initialized": true 2024-03-04T09:06:13.774 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-03-04T09:06:13.775 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:07.880+0000 7f9493987700 1 Processor -- start 2024-03-04T09:06:13.775 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:07.880+0000 7f9493987700 1 -- start start 2024-03-04T09:06:13.775 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:07.880+0000 7f9493987700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f948c108610 0x7f948c10aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:06:13.775 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:07.880+0000 7f9493987700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948c07bdd0 con 0x7f948c108610 2024-03-04T09:06:13.775 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:07.880+0000 7f9491723700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f948c108610 0x7f948c10aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:06:13.775 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:07.880+0000 7f9491723700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f948c108610 0x7f948c10aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37266/0 (socket says 172.21.15.82:37266) 2024-03-04T09:06:13.775 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:07.880+0000 7f9491723700 1 -- 172.21.15.82:0/1376336638 learned_addr learned my addr 172.21.15.82:0/1376336638 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:06:13.775 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:07.881+0000 7f9491723700 1 -- 172.21.15.82:0/1376336638 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f948c10af40 con 0x7f948c108610 2024-03-04T09:06:13.775 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:07.881+0000 7f9491723700 1 --2- 172.21.15.82:0/1376336638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f948c108610 0x7f948c10aa00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f94880098a0 tx=0x7f9488009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82c40198197dde8 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:06:13.775 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:07.881+0000 7f9483fff700 1 -- 172.21.15.82:0/1376336638 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9488004160 con 0x7f948c108610 2024-03-04T09:06:13.775 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:07.881+0000 7f9483fff700 1 -- 172.21.15.82:0/1376336638 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f9488004300 con 0x7f948c108610 2024-03-04T09:06:13.775 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:07.881+0000 7f9483fff700 1 -- 172.21.15.82:0/1376336638 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9488011b10 con 0x7f948c108610 2024-03-04T09:06:13.776 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:07.882+0000 7f9493987700 1 -- 172.21.15.82:0/1376336638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f948c108610 msgr2=0x7f948c10aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:13.776 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:07.882+0000 7f9493987700 1 --2- 172.21.15.82:0/1376336638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f948c108610 0x7f948c10aa00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f94880098a0 tx=0x7f9488009bb0 comp rx=0 tx=0).stop 2024-03-04T09:06:13.776 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:07.882+0000 7f9493987700 1 -- 172.21.15.82:0/1376336638 shutdown_connections 2024-03-04T09:06:13.776 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:07.882+0000 7f9493987700 1 --2- 172.21.15.82:0/1376336638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f948c108610 0x7f948c10aa00 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:13.776 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:07.882+0000 7f9493987700 1 -- 172.21.15.82:0/1376336638 >> 172.21.15.82:0/1376336638 conn(0x7f948c101fc0 msgr2=0x7f948c104400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:06:13.776 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:07.882+0000 7f9493987700 1 -- 172.21.15.82:0/1376336638 shutdown_connections 2024-03-04T09:06:13.776 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:07.882+0000 7f9493987700 1 -- 172.21.15.82:0/1376336638 wait complete. 2024-03-04T09:06:13.776 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:07.882+0000 7f9493987700 1 Processor -- start 2024-03-04T09:06:13.776 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:07.882+0000 7f9493987700 1 -- start start 2024-03-04T09:06:13.776 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:07.883+0000 7f9493987700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f948c108610 0x7f948c19ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:06:13.776 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:07.883+0000 7f9493987700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948c10bf40 con 0x7f948c108610 2024-03-04T09:06:13.776 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:07.883+0000 7f9491723700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f948c108610 0x7f948c19ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:06:13.776 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:07.883+0000 7f9491723700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f948c108610 0x7f948c19ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37268/0 (socket says 172.21.15.82:37268) 2024-03-04T09:06:13.776 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:07.883+0000 7f9491723700 1 -- 172.21.15.82:0/2681703690 learned_addr learned my addr 172.21.15.82:0/2681703690 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:06:13.777 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:07.883+0000 7f9491723700 1 -- 172.21.15.82:0/2681703690 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f948c19bf80 con 0x7f948c108610 2024-03-04T09:06:13.777 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:07.883+0000 7f9491723700 1 --2- 172.21.15.82:0/2681703690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f948c108610 0x7f948c19ba40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9488006af0 tx=0x7f9488011bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:06:13.777 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:07.883+0000 7f94827fc700 1 -- 172.21.15.82:0/2681703690 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9488003af0 con 0x7f948c108610 2024-03-04T09:06:13.777 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:07.883+0000 7f94827fc700 1 -- 172.21.15.82:0/2681703690 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f9488003c90 con 0x7f948c108610 2024-03-04T09:06:13.777 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:07.883+0000 7f9493987700 1 -- 172.21.15.82:0/2681703690 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f948c19c210 con 0x7f948c108610 2024-03-04T09:06:13.777 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:07.883+0000 7f94827fc700 1 -- 172.21.15.82:0/2681703690 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9488024830 con 0x7f948c108610 2024-03-04T09:06:13.777 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:07.883+0000 7f9493987700 1 -- 172.21.15.82:0/2681703690 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f948c19ef00 con 0x7f948c108610 2024-03-04T09:06:13.777 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:07.884+0000 7f94827fc700 1 -- 172.21.15.82:0/2681703690 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 9) v1 ==== 45941+0+0 (secure 0 0 0) 0x7f9488022020 con 0x7f948c108610 2024-03-04T09:06:13.777 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:07.884+0000 7f94827fc700 1 --2- 172.21.15.82:0/2681703690 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7f9478038c50 0x7f947803b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:06:13.777 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:07.884+0000 7f94827fc700 1 -- 172.21.15.82:0/2681703690 --> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f947803b820 con 0x7f9478038c50 2024-03-04T09:06:13.777 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:07.884+0000 7f94827fc700 1 -- 172.21.15.82:0/2681703690 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f948801ac90 con 0x7f948c108610 2024-03-04T09:06:13.777 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:07.884+0000 7f9490f22700 1 -- 172.21.15.82:0/2681703690 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7f9478038c50 msgr2=0x7f947803b110 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/1901539016 2024-03-04T09:06:13.777 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:07.884+0000 7f9490f22700 1 --2- 172.21.15.82:0/2681703690 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7f9478038c50 0x7f947803b110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-04T09:06:13.777 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:08.085+0000 7f9490f22700 1 -- 172.21.15.82:0/2681703690 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7f9478038c50 msgr2=0x7f947803b110 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/1901539016 2024-03-04T09:06:13.778 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:08.085+0000 7f9490f22700 1 --2- 172.21.15.82:0/2681703690 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7f9478038c50 0x7f947803b110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-04T09:06:13.778 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:08.486+0000 7f9490f22700 1 -- 172.21.15.82:0/2681703690 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7f9478038c50 msgr2=0x7f947803b110 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/1901539016 2024-03-04T09:06:13.778 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:08.486+0000 7f9490f22700 1 --2- 172.21.15.82:0/2681703690 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7f9478038c50 0x7f947803b110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-04T09:06:13.778 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:09.287+0000 7f9490f22700 1 -- 172.21.15.82:0/2681703690 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7f9478038c50 msgr2=0x7f947803b110 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/1901539016 2024-03-04T09:06:13.778 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:09.287+0000 7f9490f22700 1 --2- 172.21.15.82:0/2681703690 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7f9478038c50 0x7f947803b110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-04T09:06:13.778 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:10.888+0000 7f9490f22700 1 -- 172.21.15.82:0/2681703690 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7f9478038c50 msgr2=0x7f947803b110 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/1901539016 2024-03-04T09:06:13.778 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:10.888+0000 7f9490f22700 1 --2- 172.21.15.82:0/2681703690 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7f9478038c50 0x7f947803b110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-03-04T09:06:13.778 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:12.170+0000 7f94827fc700 1 -- 172.21.15.82:0/2681703690 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mgrmap(e 10) v1 ==== 45708+0+0 (secure 0 0 0) 0x7f948802d3f0 con 0x7f948c108610 2024-03-04T09:06:13.778 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:12.170+0000 7f94827fc700 1 -- 172.21.15.82:0/2681703690 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7f9478038c50 msgr2=0x7f947803b110 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-04T09:06:13.778 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:12.170+0000 7f94827fc700 1 --2- 172.21.15.82:0/2681703690 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7f9478038c50 0x7f947803b110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:13.778 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:13.171+0000 7f94827fc700 1 -- 172.21.15.82:0/2681703690 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 11) v1 ==== 45835+0+0 (secure 0 0 0) 0x7f948802d770 con 0x7f948c108610 2024-03-04T09:06:13.778 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:13.171+0000 7f94827fc700 1 --2- 172.21.15.82:0/2681703690 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f947803c740 0x7f947803eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:06:13.778 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:13.172+0000 7f94827fc700 1 -- 172.21.15.82:0/2681703690 --> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f947803b820 con 0x7f947803c740 2024-03-04T09:06:13.778 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:13.172+0000 7f9490f22700 1 --2- 172.21.15.82:0/2681703690 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f947803c740 0x7f947803eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:06:13.778 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:13.173+0000 7f9490f22700 1 --2- 172.21.15.82:0/2681703690 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f947803c740 0x7f947803eb30 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f947c003a10 tx=0x7f947c009270 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:06:13.779 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:13.173+0000 7f94827fc700 1 -- 172.21.15.82:0/2681703690 <== mgr.14152 v2:172.21.15.82:6800/1278635224 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7f947803b820 con 0x7f947803c740 2024-03-04T09:06:13.779 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:13.180+0000 7f9493987700 1 -- 172.21.15.82:0/2681703690 --> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f948c0636f0 con 0x7f947803c740 2024-03-04T09:06:13.779 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:13.180+0000 7f94827fc700 1 -- 172.21.15.82:0/2681703690 <== mgr.14152 v2:172.21.15.82:6800/1278635224 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f948c0636f0 con 0x7f947803c740 2024-03-04T09:06:13.779 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:13.180+0000 7f9493987700 1 -- 172.21.15.82:0/2681703690 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f947803c740 msgr2=0x7f947803eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:13.779 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:13.180+0000 7f9493987700 1 --2- 172.21.15.82:0/2681703690 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f947803c740 0x7f947803eb30 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f947c003a10 tx=0x7f947c009270 comp rx=0 tx=0).stop 2024-03-04T09:06:13.779 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:13.180+0000 7f9493987700 1 -- 172.21.15.82:0/2681703690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f948c108610 msgr2=0x7f948c19ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:13.779 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:13.180+0000 7f9493987700 1 --2- 172.21.15.82:0/2681703690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f948c108610 0x7f948c19ba40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9488006af0 tx=0x7f9488011bd0 comp rx=0 tx=0).stop 2024-03-04T09:06:13.779 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:13.180+0000 7f9493987700 1 -- 172.21.15.82:0/2681703690 shutdown_connections 2024-03-04T09:06:13.779 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:13.180+0000 7f9493987700 1 --2- 172.21.15.82:0/2681703690 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f947803c740 0x7f947803eb30 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:13.779 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:13.180+0000 7f9493987700 1 --2- 172.21.15.82:0/2681703690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f948c108610 0x7f948c19ba40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:13.779 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:13.180+0000 7f9493987700 1 --2- 172.21.15.82:0/2681703690 >> [v2:172.21.15.82:6800/1901539016,v1:172.21.15.82:6801/1901539016] conn(0x7f9478038c50 0x7f947803b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:13.779 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:13.180+0000 7f9493987700 1 -- 172.21.15.82:0/2681703690 >> 172.21.15.82:0/2681703690 conn(0x7f948c101fc0 msgr2=0x7f948c102a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:06:13.779 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:13.180+0000 7f9493987700 1 -- 172.21.15.82:0/2681703690 shutdown_connections 2024-03-04T09:06:13.779 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:13.180+0000 7f9493987700 1 -- 172.21.15.82:0/2681703690 wait complete. 2024-03-04T09:06:13.779 INFO:teuthology.orchestra.run.smithi082.stdout:mgr epoch 9 is available 2024-03-04T09:06:13.780 INFO:teuthology.orchestra.run.smithi082.stdout:Generating a dashboard self-signed certificate... 2024-03-04T09:06:14.386 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:14 smithi082 ceph-mon[32880]: [04/Mar/2024:09:06:12] ENGINE Bus STARTING 2024-03-04T09:06:14.386 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:14 smithi082 ceph-mon[32880]: [04/Mar/2024:09:06:12] ENGINE Serving on https://172.21.15.82:7150 2024-03-04T09:06:14.386 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:14 smithi082 ceph-mon[32880]: [04/Mar/2024:09:06:12] ENGINE Serving on http://172.21.15.82:8765 2024-03-04T09:06:14.386 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:14 smithi082 ceph-mon[32880]: [04/Mar/2024:09:06:12] ENGINE Bus STARTED 2024-03-04T09:06:14.386 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:14 smithi082 ceph-mon[32880]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-03-04T09:06:14.386 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:14 smithi082 ceph-mon[32880]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-03-04T09:06:15.162 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-03-04T09:06:15.163 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:14.180+0000 7fcaec91a700 1 Processor -- start 2024-03-04T09:06:15.163 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:14.180+0000 7fcaec91a700 1 -- start start 2024-03-04T09:06:15.163 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:14.180+0000 7fcaec91a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcae8106990 0x7fcae8106db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:06:15.163 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:14.180+0000 7fcaec91a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae8107380 con 0x7fcae8106990 2024-03-04T09:06:15.163 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:14.180+0000 7fcae659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcae8106990 0x7fcae8106db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:06:15.163 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:14.180+0000 7fcae659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcae8106990 0x7fcae8106db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37334/0 (socket says 172.21.15.82:37334) 2024-03-04T09:06:15.163 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:14.180+0000 7fcae659c700 1 -- 172.21.15.82:0/2790161331 learned_addr learned my addr 172.21.15.82:0/2790161331 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:06:15.163 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:14.180+0000 7fcae659c700 1 -- 172.21.15.82:0/2790161331 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae8107b90 con 0x7fcae8106990 2024-03-04T09:06:15.163 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:14.181+0000 7fcae659c700 1 --2- 172.21.15.82:0/2790161331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcae8106990 0x7fcae8106db0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcad80098a0 tx=0x7fcad8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d786875a243fa96 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:06:15.163 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:14.181+0000 7fcae559a700 1 -- 172.21.15.82:0/2790161331 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcad8004160 con 0x7fcae8106990 2024-03-04T09:06:15.163 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:14.181+0000 7fcae559a700 1 -- 172.21.15.82:0/2790161331 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fcad8004300 con 0x7fcae8106990 2024-03-04T09:06:15.163 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:14.181+0000 7fcae559a700 1 -- 172.21.15.82:0/2790161331 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcad8011b10 con 0x7fcae8106990 2024-03-04T09:06:15.163 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:14.181+0000 7fcaec91a700 1 -- 172.21.15.82:0/2790161331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcae8106990 msgr2=0x7fcae8106db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:15.163 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:14.181+0000 7fcaec91a700 1 --2- 172.21.15.82:0/2790161331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcae8106990 0x7fcae8106db0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcad80098a0 tx=0x7fcad8009bb0 comp rx=0 tx=0).stop 2024-03-04T09:06:15.164 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:14.182+0000 7fcaec91a700 1 -- 172.21.15.82:0/2790161331 shutdown_connections 2024-03-04T09:06:15.164 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:14.182+0000 7fcaec91a700 1 --2- 172.21.15.82:0/2790161331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcae8106990 0x7fcae8106db0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:15.164 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:14.182+0000 7fcaec91a700 1 -- 172.21.15.82:0/2790161331 >> 172.21.15.82:0/2790161331 conn(0x7fcae8101f30 msgr2=0x7fcae8104370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:06:15.164 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:14.182+0000 7fcaec91a700 1 -- 172.21.15.82:0/2790161331 shutdown_connections 2024-03-04T09:06:15.164 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:14.182+0000 7fcaec91a700 1 -- 172.21.15.82:0/2790161331 wait complete. 2024-03-04T09:06:15.164 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:14.182+0000 7fcaec91a700 1 Processor -- start 2024-03-04T09:06:15.164 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:14.182+0000 7fcaec91a700 1 -- start start 2024-03-04T09:06:15.164 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:14.182+0000 7fcaec91a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcae8106990 0x7fcae819b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:06:15.164 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:14.182+0000 7fcaec91a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae810af40 con 0x7fcae8106990 2024-03-04T09:06:15.164 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:14.183+0000 7fcae659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcae8106990 0x7fcae819b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:06:15.164 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:14.183+0000 7fcae659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcae8106990 0x7fcae819b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37346/0 (socket says 172.21.15.82:37346) 2024-03-04T09:06:15.164 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:14.183+0000 7fcae659c700 1 -- 172.21.15.82:0/3267955593 learned_addr learned my addr 172.21.15.82:0/3267955593 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:06:15.164 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:14.183+0000 7fcae659c700 1 -- 172.21.15.82:0/3267955593 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae819bf30 con 0x7fcae8106990 2024-03-04T09:06:15.164 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:14.183+0000 7fcae659c700 1 --2- 172.21.15.82:0/3267955593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcae8106990 0x7fcae819b9f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcad8003fa0 tx=0x7fcad8011bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:06:15.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:14.183+0000 7fcad77fe700 1 -- 172.21.15.82:0/3267955593 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcad80038b0 con 0x7fcae8106990 2024-03-04T09:06:15.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:14.183+0000 7fcad77fe700 1 -- 172.21.15.82:0/3267955593 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fcad801a430 con 0x7fcae8106990 2024-03-04T09:06:15.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:14.183+0000 7fcaec91a700 1 -- 172.21.15.82:0/3267955593 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcae819c1c0 con 0x7fcae8106990 2024-03-04T09:06:15.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:14.183+0000 7fcad77fe700 1 -- 172.21.15.82:0/3267955593 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcad8019530 con 0x7fcae8106990 2024-03-04T09:06:15.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:14.183+0000 7fcaec91a700 1 -- 172.21.15.82:0/3267955593 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcae819eeb0 con 0x7fcae8106990 2024-03-04T09:06:15.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:14.184+0000 7fcad77fe700 1 -- 172.21.15.82:0/3267955593 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 11) v1 ==== 45835+0+0 (secure 0 0 0) 0x7fcad80197a0 con 0x7fcae8106990 2024-03-04T09:06:15.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:14.184+0000 7fcad77fe700 1 --2- 172.21.15.82:0/3267955593 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fcad0038ae0 0x7fcad003afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:06:15.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:14.184+0000 7fcaec91a700 1 -- 172.21.15.82:0/3267955593 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcae80636f0 con 0x7fcae8106990 2024-03-04T09:06:15.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:14.184+0000 7fcad77fe700 1 -- 172.21.15.82:0/3267955593 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fcad804cd10 con 0x7fcae8106990 2024-03-04T09:06:15.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:14.184+0000 7fcae5d9b700 1 --2- 172.21.15.82:0/3267955593 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fcad0038ae0 0x7fcad003afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:06:15.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:14.185+0000 7fcae5d9b700 1 --2- 172.21.15.82:0/3267955593 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fcad0038ae0 0x7fcad003afa0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcadc006fd0 tx=0x7fcadc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:06:15.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:14.189+0000 7fcad77fe700 1 -- 172.21.15.82:0/3267955593 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fcad802d960 con 0x7fcae8106990 2024-03-04T09:06:15.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:14.223+0000 7fcad77fe700 1 -- 172.21.15.82:0/3267955593 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 12) v1 ==== 45941+0+0 (secure 0 0 0) 0x7fcad802d440 con 0x7fcae8106990 2024-03-04T09:06:15.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:14.389+0000 7fcaec91a700 1 -- 172.21.15.82:0/3267955593 --> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7fcae81030e0 con 0x7fcad0038ae0 2024-03-04T09:06:15.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:14.500+0000 7fcad77fe700 1 -- 172.21.15.82:0/3267955593 <== mgr.14152 v2:172.21.15.82:6800/1278635224 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7fcae81030e0 con 0x7fcad0038ae0 2024-03-04T09:06:15.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:14.502+0000 7fcaec91a700 1 -- 172.21.15.82:0/3267955593 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fcad0038ae0 msgr2=0x7fcad003afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:15.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:14.502+0000 7fcaec91a700 1 --2- 172.21.15.82:0/3267955593 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fcad0038ae0 0x7fcad003afa0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcadc006fd0 tx=0x7fcadc006e40 comp rx=0 tx=0).stop 2024-03-04T09:06:15.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:14.502+0000 7fcaec91a700 1 -- 172.21.15.82:0/3267955593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcae8106990 msgr2=0x7fcae819b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:15.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:14.502+0000 7fcaec91a700 1 --2- 172.21.15.82:0/3267955593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcae8106990 0x7fcae819b9f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcad8003fa0 tx=0x7fcad8011bd0 comp rx=0 tx=0).stop 2024-03-04T09:06:15.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:14.502+0000 7fcaec91a700 1 -- 172.21.15.82:0/3267955593 shutdown_connections 2024-03-04T09:06:15.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:14.502+0000 7fcaec91a700 1 --2- 172.21.15.82:0/3267955593 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fcad0038ae0 0x7fcad003afa0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:15.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:14.502+0000 7fcaec91a700 1 --2- 172.21.15.82:0/3267955593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcae8106990 0x7fcae819b9f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:15.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:14.502+0000 7fcaec91a700 1 -- 172.21.15.82:0/3267955593 >> 172.21.15.82:0/3267955593 conn(0x7fcae8101f30 msgr2=0x7fcae81029d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:06:15.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:14.502+0000 7fcaec91a700 1 -- 172.21.15.82:0/3267955593 shutdown_connections 2024-03-04T09:06:15.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:14.502+0000 7fcaec91a700 1 -- 172.21.15.82:0/3267955593 wait complete. 2024-03-04T09:06:15.166 INFO:teuthology.orchestra.run.smithi082.stdout:Creating initial admin user... 2024-03-04T09:06:15.491 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:15 smithi082 ceph-mon[32880]: mgrmap e12: x(active, since 2s) 2024-03-04T09:06:15.491 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:15 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:15.491 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:15 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:15.491 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:15 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:16.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:16 smithi082 ceph-mon[32880]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:06:16.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:16 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:16.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:16 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:16.701 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$3QGr5sFt3G6ucl.u3oRymusnFnHRxEbZ5kX194RSn.O9EUGoG5cuy", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1709543176, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-03-04T09:06:16.702 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:15.602+0000 7fc1eaec9700 1 Processor -- start 2024-03-04T09:06:16.702 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:15.602+0000 7fc1eaec9700 1 -- start start 2024-03-04T09:06:16.702 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:15.602+0000 7fc1eaec9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1e4107a90 0x7fc1e4107eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:06:16.702 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:15.602+0000 7fc1eaec9700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e4108480 con 0x7fc1e4107a90 2024-03-04T09:06:16.702 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:15.603+0000 7fc1e8c65700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1e4107a90 0x7fc1e4107eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:06:16.702 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:15.603+0000 7fc1e8c65700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1e4107a90 0x7fc1e4107eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37360/0 (socket says 172.21.15.82:37360) 2024-03-04T09:06:16.702 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:15.603+0000 7fc1e8c65700 1 -- 172.21.15.82:0/2357982375 learned_addr learned my addr 172.21.15.82:0/2357982375 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:06:16.702 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:15.603+0000 7fc1e8c65700 1 -- 172.21.15.82:0/2357982375 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e4108c90 con 0x7fc1e4107a90 2024-03-04T09:06:16.702 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:15.603+0000 7fc1e8c65700 1 --2- 172.21.15.82:0/2357982375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1e4107a90 0x7fc1e4107eb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc1d80098a0 tx=0x7fc1d8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c214f670d42e2596 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:06:16.702 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:15.603+0000 7fc1e37fe700 1 -- 172.21.15.82:0/2357982375 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1d8004160 con 0x7fc1e4107a90 2024-03-04T09:06:16.702 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:15.603+0000 7fc1e37fe700 1 -- 172.21.15.82:0/2357982375 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fc1d8004300 con 0x7fc1e4107a90 2024-03-04T09:06:16.702 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:15.603+0000 7fc1e37fe700 1 -- 172.21.15.82:0/2357982375 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1d8011b10 con 0x7fc1e4107a90 2024-03-04T09:06:16.702 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:15.604+0000 7fc1eaec9700 1 -- 172.21.15.82:0/2357982375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1e4107a90 msgr2=0x7fc1e4107eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:16.702 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:15.604+0000 7fc1eaec9700 1 --2- 172.21.15.82:0/2357982375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1e4107a90 0x7fc1e4107eb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc1d80098a0 tx=0x7fc1d8009bb0 comp rx=0 tx=0).stop 2024-03-04T09:06:16.703 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:15.604+0000 7fc1eaec9700 1 -- 172.21.15.82:0/2357982375 shutdown_connections 2024-03-04T09:06:16.703 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:15.604+0000 7fc1eaec9700 1 --2- 172.21.15.82:0/2357982375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1e4107a90 0x7fc1e4107eb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:16.703 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:15.604+0000 7fc1eaec9700 1 -- 172.21.15.82:0/2357982375 >> 172.21.15.82:0/2357982375 conn(0x7fc1e4103090 msgr2=0x7fc1e41054b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:06:16.703 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:15.604+0000 7fc1eaec9700 1 -- 172.21.15.82:0/2357982375 shutdown_connections 2024-03-04T09:06:16.703 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:15.604+0000 7fc1eaec9700 1 -- 172.21.15.82:0/2357982375 wait complete. 2024-03-04T09:06:16.703 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:15.605+0000 7fc1eaec9700 1 Processor -- start 2024-03-04T09:06:16.703 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:15.605+0000 7fc1eaec9700 1 -- start start 2024-03-04T09:06:16.703 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:15.605+0000 7fc1eaec9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1e4107a90 0x7fc1e407db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:06:16.703 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:15.605+0000 7fc1eaec9700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e410c040 con 0x7fc1e4107a90 2024-03-04T09:06:16.703 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:15.605+0000 7fc1e8c65700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1e4107a90 0x7fc1e407db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:06:16.703 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:15.605+0000 7fc1e8c65700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1e4107a90 0x7fc1e407db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37368/0 (socket says 172.21.15.82:37368) 2024-03-04T09:06:16.703 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:15.605+0000 7fc1e8c65700 1 -- 172.21.15.82:0/1842551355 learned_addr learned my addr 172.21.15.82:0/1842551355 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:06:16.703 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:15.605+0000 7fc1e8c65700 1 -- 172.21.15.82:0/1842551355 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e407e050 con 0x7fc1e4107a90 2024-03-04T09:06:16.703 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:15.605+0000 7fc1e8c65700 1 --2- 172.21.15.82:0/1842551355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1e4107a90 0x7fc1e407db10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8009fb0 tx=0x7fc1d8011bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:06:16.704 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:15.606+0000 7fc1e1ffb700 1 -- 172.21.15.82:0/1842551355 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1d8003b20 con 0x7fc1e4107a90 2024-03-04T09:06:16.704 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:15.606+0000 7fc1e1ffb700 1 -- 172.21.15.82:0/1842551355 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fc1d8003cc0 con 0x7fc1e4107a90 2024-03-04T09:06:16.704 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:15.606+0000 7fc1eaec9700 1 -- 172.21.15.82:0/1842551355 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1e407c240 con 0x7fc1e4107a90 2024-03-04T09:06:16.704 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:15.606+0000 7fc1e1ffb700 1 -- 172.21.15.82:0/1842551355 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1d80247a0 con 0x7fc1e4107a90 2024-03-04T09:06:16.704 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:15.606+0000 7fc1eaec9700 1 -- 172.21.15.82:0/1842551355 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e407c780 con 0x7fc1e4107a90 2024-03-04T09:06:16.704 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:15.607+0000 7fc1e1ffb700 1 -- 172.21.15.82:0/1842551355 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 12) v1 ==== 45941+0+0 (secure 0 0 0) 0x7fc1d8022020 con 0x7fc1e4107a90 2024-03-04T09:06:16.704 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:15.607+0000 7fc1e1ffb700 1 --2- 172.21.15.82:0/1842551355 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fc1d4038c50 0x7fc1d403b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:06:16.704 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:15.607+0000 7fc1e1ffb700 1 -- 172.21.15.82:0/1842551355 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fc1d804cb90 con 0x7fc1e4107a90 2024-03-04T09:06:16.704 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:15.607+0000 7fc1e3fff700 1 --2- 172.21.15.82:0/1842551355 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fc1d4038c50 0x7fc1d403b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:06:16.704 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:15.607+0000 7fc1eaec9700 1 -- 172.21.15.82:0/1842551355 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1e40636f0 con 0x7fc1e4107a90 2024-03-04T09:06:16.704 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:15.608+0000 7fc1e3fff700 1 --2- 172.21.15.82:0/1842551355 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fc1d4038c50 0x7fc1d403b110 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0006fd0 tx=0x7fc1d0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:06:16.704 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:15.613+0000 7fc1e1ffb700 1 -- 172.21.15.82:0/1842551355 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fc1d800b3e0 con 0x7fc1e4107a90 2024-03-04T09:06:16.705 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:15.833+0000 7fc1eaec9700 1 -- 172.21.15.82:0/1842551355 --> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fc1e4104600 con 0x7fc1d4038c50 2024-03-04T09:06:16.705 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:16.061+0000 7fc1e1ffb700 1 -- 172.21.15.82:0/1842551355 <== mgr.14152 v2:172.21.15.82:6800/1278635224 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7fc1e4104600 con 0x7fc1d4038c50 2024-03-04T09:06:16.705 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:16.063+0000 7fc1eaec9700 1 -- 172.21.15.82:0/1842551355 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fc1d4038c50 msgr2=0x7fc1d403b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:16.705 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:16.063+0000 7fc1eaec9700 1 --2- 172.21.15.82:0/1842551355 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fc1d4038c50 0x7fc1d403b110 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0006fd0 tx=0x7fc1d0006e40 comp rx=0 tx=0).stop 2024-03-04T09:06:16.705 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:16.063+0000 7fc1eaec9700 1 -- 172.21.15.82:0/1842551355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1e4107a90 msgr2=0x7fc1e407db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:16.705 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:16.063+0000 7fc1eaec9700 1 --2- 172.21.15.82:0/1842551355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1e4107a90 0x7fc1e407db10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8009fb0 tx=0x7fc1d8011bd0 comp rx=0 tx=0).stop 2024-03-04T09:06:16.705 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:16.063+0000 7fc1eaec9700 1 -- 172.21.15.82:0/1842551355 shutdown_connections 2024-03-04T09:06:16.705 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:16.063+0000 7fc1eaec9700 1 --2- 172.21.15.82:0/1842551355 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fc1d4038c50 0x7fc1d403b110 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:16.705 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:16.063+0000 7fc1eaec9700 1 --2- 172.21.15.82:0/1842551355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1e4107a90 0x7fc1e407db10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:16.705 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:16.063+0000 7fc1eaec9700 1 -- 172.21.15.82:0/1842551355 >> 172.21.15.82:0/1842551355 conn(0x7fc1e4103090 msgr2=0x7fc1e4103bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:06:16.705 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:16.063+0000 7fc1eaec9700 1 -- 172.21.15.82:0/1842551355 shutdown_connections 2024-03-04T09:06:16.705 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:16.063+0000 7fc1eaec9700 1 -- 172.21.15.82:0/1842551355 wait complete. 2024-03-04T09:06:16.705 INFO:teuthology.orchestra.run.smithi082.stdout:Fetching dashboard port number... 2024-03-04T09:06:17.489 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:17 smithi082 ceph-mon[32880]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:06:18.035 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 8443 2024-03-04T09:06:18.035 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:17.149+0000 7fb648868700 1 Processor -- start 2024-03-04T09:06:18.035 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:17.149+0000 7fb648868700 1 -- start start 2024-03-04T09:06:18.035 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:17.150+0000 7fb648868700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb644108590 0x7fb64410a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:06:18.035 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:17.150+0000 7fb648868700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64407be10 con 0x7fb644108590 2024-03-04T09:06:18.035 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:17.150+0000 7fb64259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb644108590 0x7fb64410a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:06:18.035 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:17.150+0000 7fb64259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb644108590 0x7fb64410a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55392/0 (socket says 172.21.15.82:55392) 2024-03-04T09:06:18.035 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:17.150+0000 7fb64259c700 1 -- 172.21.15.82:0/615631272 learned_addr learned my addr 172.21.15.82:0/615631272 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:06:18.035 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:17.150+0000 7fb64259c700 1 -- 172.21.15.82:0/615631272 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb64410aec0 con 0x7fb644108590 2024-03-04T09:06:18.035 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:17.150+0000 7fb64259c700 1 --2- 172.21.15.82:0/615631272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb644108590 0x7fb64410a980 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb62c0098a0 tx=0x7fb62c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d63e3630c3ba296a server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:06:18.035 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:17.150+0000 7fb64159a700 1 -- 172.21.15.82:0/615631272 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb62c004160 con 0x7fb644108590 2024-03-04T09:06:18.036 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:17.151+0000 7fb64159a700 1 -- 172.21.15.82:0/615631272 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fb62c004300 con 0x7fb644108590 2024-03-04T09:06:18.036 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:17.151+0000 7fb64159a700 1 -- 172.21.15.82:0/615631272 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb62c011b10 con 0x7fb644108590 2024-03-04T09:06:18.036 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:17.151+0000 7fb648868700 1 -- 172.21.15.82:0/615631272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb644108590 msgr2=0x7fb64410a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:18.036 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:17.151+0000 7fb648868700 1 --2- 172.21.15.82:0/615631272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb644108590 0x7fb64410a980 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb62c0098a0 tx=0x7fb62c009bb0 comp rx=0 tx=0).stop 2024-03-04T09:06:18.036 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:17.151+0000 7fb648868700 1 -- 172.21.15.82:0/615631272 shutdown_connections 2024-03-04T09:06:18.036 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:17.151+0000 7fb648868700 1 --2- 172.21.15.82:0/615631272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb644108590 0x7fb64410a980 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:18.036 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:17.151+0000 7fb648868700 1 -- 172.21.15.82:0/615631272 >> 172.21.15.82:0/615631272 conn(0x7fb644102000 msgr2=0x7fb644104420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:06:18.036 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:17.151+0000 7fb648868700 1 -- 172.21.15.82:0/615631272 shutdown_connections 2024-03-04T09:06:18.036 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:17.151+0000 7fb648868700 1 -- 172.21.15.82:0/615631272 wait complete. 2024-03-04T09:06:18.036 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:17.152+0000 7fb648868700 1 Processor -- start 2024-03-04T09:06:18.036 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:17.152+0000 7fb648868700 1 -- start start 2024-03-04T09:06:18.036 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:17.152+0000 7fb648868700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb644108590 0x7fb644107e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:06:18.037 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:17.152+0000 7fb648868700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64410bf20 con 0x7fb644108590 2024-03-04T09:06:18.037 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:17.152+0000 7fb64259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb644108590 0x7fb644107e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:06:18.037 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:17.152+0000 7fb64259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb644108590 0x7fb644107e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55408/0 (socket says 172.21.15.82:55408) 2024-03-04T09:06:18.037 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:17.152+0000 7fb64259c700 1 -- 172.21.15.82:0/1546848268 learned_addr learned my addr 172.21.15.82:0/1546848268 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:06:18.037 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:17.152+0000 7fb64259c700 1 -- 172.21.15.82:0/1546848268 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb644108350 con 0x7fb644108590 2024-03-04T09:06:18.037 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:17.153+0000 7fb64259c700 1 --2- 172.21.15.82:0/1546848268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb644108590 0x7fb644107e10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb62c011670 tx=0x7fb62c011bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:06:18.037 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:17.153+0000 7fb63b7fe700 1 -- 172.21.15.82:0/1546848268 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb62c003930 con 0x7fb644108590 2024-03-04T09:06:18.037 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:17.153+0000 7fb648868700 1 -- 172.21.15.82:0/1546848268 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb644106540 con 0x7fb644108590 2024-03-04T09:06:18.037 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:17.153+0000 7fb63b7fe700 1 -- 172.21.15.82:0/1546848268 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fb62c003ad0 con 0x7fb644108590 2024-03-04T09:06:18.037 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:17.153+0000 7fb63b7fe700 1 -- 172.21.15.82:0/1546848268 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb62c019550 con 0x7fb644108590 2024-03-04T09:06:18.037 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:17.153+0000 7fb648868700 1 -- 172.21.15.82:0/1546848268 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb644106a80 con 0x7fb644108590 2024-03-04T09:06:18.037 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:17.153+0000 7fb63b7fe700 1 -- 172.21.15.82:0/1546848268 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 12) v1 ==== 45941+0+0 (secure 0 0 0) 0x7fb62c019850 con 0x7fb644108590 2024-03-04T09:06:18.037 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:17.154+0000 7fb648868700 1 -- 172.21.15.82:0/1546848268 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6440636f0 con 0x7fb644108590 2024-03-04T09:06:18.038 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:17.154+0000 7fb63b7fe700 1 --2- 172.21.15.82:0/1546848268 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb630038ba0 0x7fb63003b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:06:18.038 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:17.154+0000 7fb63b7fe700 1 -- 172.21.15.82:0/1546848268 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fb62c04cf80 con 0x7fb644108590 2024-03-04T09:06:18.038 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:17.154+0000 7fb641d9b700 1 --2- 172.21.15.82:0/1546848268 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb630038ba0 0x7fb63003b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:06:18.038 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:17.154+0000 7fb641d9b700 1 --2- 172.21.15.82:0/1546848268 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb630038ba0 0x7fb63003b060 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb634006fd0 tx=0x7fb634006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:06:18.038 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:17.159+0000 7fb63b7fe700 1 -- 172.21.15.82:0/1546848268 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fb62c003c80 con 0x7fb644108590 2024-03-04T09:06:18.038 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:17.375+0000 7fb648868700 1 -- 172.21.15.82:0/1546848268 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7fb644106d00 con 0x7fb644108590 2024-03-04T09:06:18.038 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:17.375+0000 7fb63b7fe700 1 -- 172.21.15.82:0/1546848268 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7fb62c02d960 con 0x7fb644108590 2024-03-04T09:06:18.038 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:17.377+0000 7fb648868700 1 -- 172.21.15.82:0/1546848268 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb630038ba0 msgr2=0x7fb63003b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:18.038 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:17.377+0000 7fb648868700 1 --2- 172.21.15.82:0/1546848268 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb630038ba0 0x7fb63003b060 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb634006fd0 tx=0x7fb634006e40 comp rx=0 tx=0).stop 2024-03-04T09:06:18.038 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:17.377+0000 7fb648868700 1 -- 172.21.15.82:0/1546848268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb644108590 msgr2=0x7fb644107e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:18.038 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:17.377+0000 7fb648868700 1 --2- 172.21.15.82:0/1546848268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb644108590 0x7fb644107e10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb62c011670 tx=0x7fb62c011bd0 comp rx=0 tx=0).stop 2024-03-04T09:06:18.038 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:17.377+0000 7fb648868700 1 -- 172.21.15.82:0/1546848268 shutdown_connections 2024-03-04T09:06:18.038 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:17.377+0000 7fb648868700 1 --2- 172.21.15.82:0/1546848268 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb630038ba0 0x7fb63003b060 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:18.038 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:17.377+0000 7fb648868700 1 --2- 172.21.15.82:0/1546848268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb644108590 0x7fb644107e10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:18.039 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:17.377+0000 7fb648868700 1 -- 172.21.15.82:0/1546848268 >> 172.21.15.82:0/1546848268 conn(0x7fb644102000 msgr2=0x7fb644102ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:06:18.039 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:17.377+0000 7fb648868700 1 -- 172.21.15.82:0/1546848268 shutdown_connections 2024-03-04T09:06:18.039 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:17.377+0000 7fb648868700 1 -- 172.21.15.82:0/1546848268 wait complete. 2024-03-04T09:06:18.040 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-03-04T09:06:18.040 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout disabled 2024-03-04T09:06:18.047 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-03-04T09:06:18.047 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout inactive 2024-03-04T09:06:18.048 INFO:teuthology.orchestra.run.smithi082.stdout:firewalld.service is not enabled 2024-03-04T09:06:18.048 INFO:teuthology.orchestra.run.smithi082.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-03-04T09:06:18.049 INFO:teuthology.orchestra.run.smithi082.stdout:Ceph Dashboard is now available at: 2024-03-04T09:06:18.049 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:06:18.049 INFO:teuthology.orchestra.run.smithi082.stdout: URL: https://smithi082.front.sepia.ceph.com:8443/ 2024-03-04T09:06:18.049 INFO:teuthology.orchestra.run.smithi082.stdout: User: admin 2024-03-04T09:06:18.049 INFO:teuthology.orchestra.run.smithi082.stdout: Password: llsriyyrlk 2024-03-04T09:06:18.049 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:06:18.050 INFO:teuthology.orchestra.run.smithi082.stdout:Saving cluster configuration to /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/config directory 2024-03-04T09:06:18.050 INFO:teuthology.orchestra.run.smithi082.stdout:Enabling autotune for osd_memory_target 2024-03-04T09:06:18.316 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:18 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/1546848268' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-03-04T09:06:19.532 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:19 smithi082 ceph-mon[32880]: mgrmap e13: x(active, since 6s) 2024-03-04T09:06:20.146 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:19.330+0000 7f775885a700 1 Processor -- start 2024-03-04T09:06:20.146 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:19.330+0000 7f775885a700 1 -- start start 2024-03-04T09:06:20.146 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:19.330+0000 7f775885a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7754107b10 0x7f7754107f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:06:20.146 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:19.330+0000 7f775885a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7754108500 con 0x7f7754107b10 2024-03-04T09:06:20.146 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:19.331+0000 7f775259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7754107b10 0x7f7754107f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:06:20.146 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:19.331+0000 7f775259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7754107b10 0x7f7754107f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55410/0 (socket says 172.21.15.82:55410) 2024-03-04T09:06:20.147 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:19.331+0000 7f775259c700 1 -- 172.21.15.82:0/827836384 learned_addr learned my addr 172.21.15.82:0/827836384 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:06:20.147 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:19.331+0000 7f775259c700 1 -- 172.21.15.82:0/827836384 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7754108cc0 con 0x7f7754107b10 2024-03-04T09:06:20.147 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:19.331+0000 7f775259c700 1 --2- 172.21.15.82:0/827836384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7754107b10 0x7f7754107f30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f77440098a0 tx=0x7f7744009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddf6b821e98e13ff server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:06:20.147 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:19.331+0000 7f775159a700 1 -- 172.21.15.82:0/827836384 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7744004160 con 0x7f7754107b10 2024-03-04T09:06:20.147 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:19.331+0000 7f775159a700 1 -- 172.21.15.82:0/827836384 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f7744004300 con 0x7f7754107b10 2024-03-04T09:06:20.147 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:19.331+0000 7f775159a700 1 -- 172.21.15.82:0/827836384 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7744011b10 con 0x7f7754107b10 2024-03-04T09:06:20.147 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:19.332+0000 7f775885a700 1 -- 172.21.15.82:0/827836384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7754107b10 msgr2=0x7f7754107f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:20.147 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:19.332+0000 7f775885a700 1 --2- 172.21.15.82:0/827836384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7754107b10 0x7f7754107f30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f77440098a0 tx=0x7f7744009bb0 comp rx=0 tx=0).stop 2024-03-04T09:06:20.147 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:19.332+0000 7f775885a700 1 -- 172.21.15.82:0/827836384 shutdown_connections 2024-03-04T09:06:20.147 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:19.332+0000 7f775885a700 1 --2- 172.21.15.82:0/827836384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7754107b10 0x7f7754107f30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:20.147 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:19.332+0000 7f775885a700 1 -- 172.21.15.82:0/827836384 >> 172.21.15.82:0/827836384 conn(0x7f77541030b0 msgr2=0x7f77541054f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:06:20.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:19.332+0000 7f775885a700 1 -- 172.21.15.82:0/827836384 shutdown_connections 2024-03-04T09:06:20.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:19.332+0000 7f775885a700 1 -- 172.21.15.82:0/827836384 wait complete. 2024-03-04T09:06:20.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:19.333+0000 7f775885a700 1 Processor -- start 2024-03-04T09:06:20.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:19.333+0000 7f775885a700 1 -- start start 2024-03-04T09:06:20.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:19.333+0000 7f775885a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7754107b10 0x7f775419bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:06:20.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:19.333+0000 7f775885a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f775410c070 con 0x7f7754107b10 2024-03-04T09:06:20.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:19.333+0000 7f775259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7754107b10 0x7f775419bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:06:20.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:19.333+0000 7f775259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7754107b10 0x7f775419bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55422/0 (socket says 172.21.15.82:55422) 2024-03-04T09:06:20.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:19.333+0000 7f775259c700 1 -- 172.21.15.82:0/3021478579 learned_addr learned my addr 172.21.15.82:0/3021478579 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:06:20.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:19.333+0000 7f775259c700 1 -- 172.21.15.82:0/3021478579 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f775419c010 con 0x7f7754107b10 2024-03-04T09:06:20.149 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:19.333+0000 7f775259c700 1 --2- 172.21.15.82:0/3021478579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7754107b10 0x7f775419bad0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7744006af0 tx=0x7f7744011bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:06:20.149 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:19.334+0000 7f774b7fe700 1 -- 172.21.15.82:0/3021478579 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7744003af0 con 0x7f7754107b10 2024-03-04T09:06:20.149 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:19.334+0000 7f774b7fe700 1 -- 172.21.15.82:0/3021478579 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f7744003c90 con 0x7f7754107b10 2024-03-04T09:06:20.149 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:19.334+0000 7f775885a700 1 -- 172.21.15.82:0/3021478579 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f775419c2a0 con 0x7f7754107b10 2024-03-04T09:06:20.149 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:19.334+0000 7f774b7fe700 1 -- 172.21.15.82:0/3021478579 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7744024830 con 0x7f7754107b10 2024-03-04T09:06:20.149 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:19.334+0000 7f775885a700 1 -- 172.21.15.82:0/3021478579 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f775419ef90 con 0x7f7754107b10 2024-03-04T09:06:20.149 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:19.335+0000 7f774b7fe700 1 -- 172.21.15.82:0/3021478579 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 45984+0+0 (secure 0 0 0) 0x7f7744022020 con 0x7f7754107b10 2024-03-04T09:06:20.149 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:19.335+0000 7f774b7fe700 1 --2- 172.21.15.82:0/3021478579 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f7740038cf0 0x7f774003b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:06:20.149 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:19.335+0000 7f775885a700 1 -- 172.21.15.82:0/3021478579 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77540636f0 con 0x7f7754107b10 2024-03-04T09:06:20.149 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:19.335+0000 7f774b7fe700 1 -- 172.21.15.82:0/3021478579 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f774404cb40 con 0x7f7754107b10 2024-03-04T09:06:20.149 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:19.335+0000 7f7751d9b700 1 --2- 172.21.15.82:0/3021478579 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f7740038cf0 0x7f774003b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:06:20.150 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:19.335+0000 7f7751d9b700 1 --2- 172.21.15.82:0/3021478579 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f7740038cf0 0x7f774003b1b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f773c006fd0 tx=0x7f773c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:06:20.150 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:19.340+0000 7f774b7fe700 1 -- 172.21.15.82:0/3021478579 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f774402d3f0 con 0x7f7754107b10 2024-03-04T09:06:20.150 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:19.536+0000 7f775885a700 1 -- 172.21.15.82:0/3021478579 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f775419f160 con 0x7f7754107b10 2024-03-04T09:06:20.150 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:19.536+0000 7f774b7fe700 1 -- 172.21.15.82:0/3021478579 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f7744032020 con 0x7f7754107b10 2024-03-04T09:06:20.150 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:19.538+0000 7f775885a700 1 -- 172.21.15.82:0/3021478579 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f7740038cf0 msgr2=0x7f774003b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:20.150 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:19.538+0000 7f775885a700 1 --2- 172.21.15.82:0/3021478579 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f7740038cf0 0x7f774003b1b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f773c006fd0 tx=0x7f773c006e40 comp rx=0 tx=0).stop 2024-03-04T09:06:20.150 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:19.538+0000 7f775885a700 1 -- 172.21.15.82:0/3021478579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7754107b10 msgr2=0x7f775419bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:20.150 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:19.538+0000 7f775885a700 1 --2- 172.21.15.82:0/3021478579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7754107b10 0x7f775419bad0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7744006af0 tx=0x7f7744011bd0 comp rx=0 tx=0).stop 2024-03-04T09:06:20.151 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:19.538+0000 7f775885a700 1 -- 172.21.15.82:0/3021478579 shutdown_connections 2024-03-04T09:06:20.151 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:19.538+0000 7f775885a700 1 --2- 172.21.15.82:0/3021478579 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f7740038cf0 0x7f774003b1b0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:20.151 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:19.538+0000 7f775885a700 1 --2- 172.21.15.82:0/3021478579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7754107b10 0x7f775419bad0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:20.151 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:19.538+0000 7f775885a700 1 -- 172.21.15.82:0/3021478579 >> 172.21.15.82:0/3021478579 conn(0x7f77541030b0 msgr2=0x7f7754103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:06:20.151 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:19.538+0000 7f775885a700 1 -- 172.21.15.82:0/3021478579 shutdown_connections 2024-03-04T09:06:20.151 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:19.538+0000 7f775885a700 1 -- 172.21.15.82:0/3021478579 wait complete. 2024-03-04T09:06:21.469 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:20.597+0000 7f2844d32700 1 Processor -- start 2024-03-04T09:06:21.470 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:20.597+0000 7f2844d32700 1 -- start start 2024-03-04T09:06:21.470 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:20.598+0000 7f2844d32700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2840105dd0 0x7f28401061f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:06:21.470 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:20.598+0000 7f2844d32700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28401067c0 con 0x7f2840105dd0 2024-03-04T09:06:21.470 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:20.598+0000 7f283e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2840105dd0 0x7f28401061f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:06:21.470 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:20.598+0000 7f283e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2840105dd0 0x7f28401061f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55438/0 (socket says 172.21.15.82:55438) 2024-03-04T09:06:21.470 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:20.598+0000 7f283e59c700 1 -- 172.21.15.82:0/2575127096 learned_addr learned my addr 172.21.15.82:0/2575127096 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:06:21.471 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:20.598+0000 7f283e59c700 1 -- 172.21.15.82:0/2575127096 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2840108d60 con 0x7f2840105dd0 2024-03-04T09:06:21.471 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:20.598+0000 7f283e59c700 1 --2- 172.21.15.82:0/2575127096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2840105dd0 0x7f28401061f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f28280098a0 tx=0x7f2828009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69a8ce5b6c662d93 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:06:21.471 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:20.598+0000 7f283d59a700 1 -- 172.21.15.82:0/2575127096 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2828004160 con 0x7f2840105dd0 2024-03-04T09:06:21.471 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:20.599+0000 7f283d59a700 1 -- 172.21.15.82:0/2575127096 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f2828004300 con 0x7f2840105dd0 2024-03-04T09:06:21.471 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:20.599+0000 7f283d59a700 1 -- 172.21.15.82:0/2575127096 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2828011b10 con 0x7f2840105dd0 2024-03-04T09:06:21.471 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:20.599+0000 7f2844d32700 1 -- 172.21.15.82:0/2575127096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2840105dd0 msgr2=0x7f28401061f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:21.471 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:20.599+0000 7f2844d32700 1 --2- 172.21.15.82:0/2575127096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2840105dd0 0x7f28401061f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f28280098a0 tx=0x7f2828009bb0 comp rx=0 tx=0).stop 2024-03-04T09:06:21.471 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:20.599+0000 7f2844d32700 1 -- 172.21.15.82:0/2575127096 shutdown_connections 2024-03-04T09:06:21.471 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:20.599+0000 7f2844d32700 1 --2- 172.21.15.82:0/2575127096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2840105dd0 0x7f28401061f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:21.471 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:20.599+0000 7f2844d32700 1 -- 172.21.15.82:0/2575127096 >> 172.21.15.82:0/2575127096 conn(0x7f2840101760 msgr2=0x7f2840103b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:06:21.471 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:20.599+0000 7f2844d32700 1 -- 172.21.15.82:0/2575127096 shutdown_connections 2024-03-04T09:06:21.471 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:20.599+0000 7f2844d32700 1 -- 172.21.15.82:0/2575127096 wait complete. 2024-03-04T09:06:21.471 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:20.600+0000 7f2844d32700 1 Processor -- start 2024-03-04T09:06:21.471 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:20.600+0000 7f2844d32700 1 -- start start 2024-03-04T09:06:21.472 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:20.600+0000 7f2844d32700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2840105dd0 0x7f284019bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:06:21.472 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:20.600+0000 7f2844d32700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284010c110 con 0x7f2840105dd0 2024-03-04T09:06:21.472 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:20.600+0000 7f283e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2840105dd0 0x7f284019bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:06:21.472 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:20.600+0000 7f283e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2840105dd0 0x7f284019bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55448/0 (socket says 172.21.15.82:55448) 2024-03-04T09:06:21.472 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:20.600+0000 7f283e59c700 1 -- 172.21.15.82:0/2241584173 learned_addr learned my addr 172.21.15.82:0/2241584173 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:06:21.472 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:20.600+0000 7f283e59c700 1 -- 172.21.15.82:0/2241584173 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f284019c000 con 0x7f2840105dd0 2024-03-04T09:06:21.472 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:20.601+0000 7f283e59c700 1 --2- 172.21.15.82:0/2241584173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2840105dd0 0x7f284019bac0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2828006af0 tx=0x7f2828011bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:06:21.472 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:20.601+0000 7f28377fe700 1 -- 172.21.15.82:0/2241584173 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f28280038b0 con 0x7f2840105dd0 2024-03-04T09:06:21.472 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:20.601+0000 7f28377fe700 1 -- 172.21.15.82:0/2241584173 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f282801a430 con 0x7f2840105dd0 2024-03-04T09:06:21.472 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:20.601+0000 7f2844d32700 1 -- 172.21.15.82:0/2241584173 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f284019c290 con 0x7f2840105dd0 2024-03-04T09:06:21.472 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:20.601+0000 7f2844d32700 1 -- 172.21.15.82:0/2241584173 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f284019ef80 con 0x7f2840105dd0 2024-03-04T09:06:21.472 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:20.601+0000 7f28377fe700 1 -- 172.21.15.82:0/2241584173 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2828019530 con 0x7f2840105dd0 2024-03-04T09:06:21.472 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:20.601+0000 7f28377fe700 1 -- 172.21.15.82:0/2241584173 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 45984+0+0 (secure 0 0 0) 0x7f28280197a0 con 0x7f2840105dd0 2024-03-04T09:06:21.473 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:20.602+0000 7f28377fe700 1 --2- 172.21.15.82:0/2241584173 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f282c038ca0 0x7f282c03b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:06:21.473 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:20.602+0000 7f2844d32700 1 -- 172.21.15.82:0/2241584173 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2820005360 con 0x7f2840105dd0 2024-03-04T09:06:21.473 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:20.602+0000 7f28377fe700 1 -- 172.21.15.82:0/2241584173 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f282804d150 con 0x7f2840105dd0 2024-03-04T09:06:21.473 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:20.602+0000 7f283dd9b700 1 --2- 172.21.15.82:0/2241584173 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f282c038ca0 0x7f282c03b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:06:21.473 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:20.602+0000 7f283dd9b700 1 --2- 172.21.15.82:0/2241584173 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f282c038ca0 0x7f282c03b160 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2830006fd0 tx=0x7f2830006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:06:21.473 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:20.607+0000 7f28377fe700 1 -- 172.21.15.82:0/2241584173 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f282801a650 con 0x7f2840105dd0 2024-03-04T09:06:21.473 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:20.908+0000 7f2844d32700 1 -- 172.21.15.82:0/2241584173 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f2820005650 con 0x7f2840105dd0 2024-03-04T09:06:21.473 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:20.910+0000 7f28377fe700 1 -- 172.21.15.82:0/2241584173 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) v1 ==== 153+0+0 (secure 0 0 0) 0x7f282802d960 con 0x7f2840105dd0 2024-03-04T09:06:21.473 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:20.912+0000 7f2844d32700 1 -- 172.21.15.82:0/2241584173 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f282c038ca0 msgr2=0x7f282c03b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:21.473 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:20.912+0000 7f2844d32700 1 --2- 172.21.15.82:0/2241584173 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f282c038ca0 0x7f282c03b160 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2830006fd0 tx=0x7f2830006e40 comp rx=0 tx=0).stop 2024-03-04T09:06:21.473 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:20.912+0000 7f2844d32700 1 -- 172.21.15.82:0/2241584173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2840105dd0 msgr2=0x7f284019bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:21.473 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:20.912+0000 7f2844d32700 1 --2- 172.21.15.82:0/2241584173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2840105dd0 0x7f284019bac0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2828006af0 tx=0x7f2828011bd0 comp rx=0 tx=0).stop 2024-03-04T09:06:21.473 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:20.912+0000 7f2844d32700 1 -- 172.21.15.82:0/2241584173 shutdown_connections 2024-03-04T09:06:21.473 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:20.912+0000 7f2844d32700 1 --2- 172.21.15.82:0/2241584173 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f282c038ca0 0x7f282c03b160 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:21.474 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:20.912+0000 7f2844d32700 1 --2- 172.21.15.82:0/2241584173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2840105dd0 0x7f284019bac0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:21.474 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:20.912+0000 7f2844d32700 1 -- 172.21.15.82:0/2241584173 >> 172.21.15.82:0/2241584173 conn(0x7f2840101760 msgr2=0x7f2840102310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:06:21.474 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:20.912+0000 7f2844d32700 1 -- 172.21.15.82:0/2241584173 shutdown_connections 2024-03-04T09:06:21.474 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-04T09:06:20.912+0000 7f2844d32700 1 -- 172.21.15.82:0/2241584173 wait complete. 2024-03-04T09:06:21.474 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-03-04T09:06:21.474 INFO:teuthology.orchestra.run.smithi082.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-03-04T09:06:21.474 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:06:21.474 INFO:teuthology.orchestra.run.smithi082.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-03-04T09:06:21.474 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:06:21.474 INFO:teuthology.orchestra.run.smithi082.stdout:Or, if you are only running a single cluster on this host: 2024-03-04T09:06:21.474 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:06:21.474 INFO:teuthology.orchestra.run.smithi082.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-03-04T09:06:21.474 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:06:21.474 INFO:teuthology.orchestra.run.smithi082.stdout:Please consider enabling telemetry to help improve Ceph: 2024-03-04T09:06:21.474 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:06:21.474 INFO:teuthology.orchestra.run.smithi082.stdout: ceph telemetry on 2024-03-04T09:06:21.474 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:06:21.475 INFO:teuthology.orchestra.run.smithi082.stdout:For more information see: 2024-03-04T09:06:21.475 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:06:21.475 INFO:teuthology.orchestra.run.smithi082.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-03-04T09:06:21.475 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:06:21.475 INFO:teuthology.orchestra.run.smithi082.stdout:Bootstrap complete. 2024-03-04T09:06:21.508 INFO:tasks.cephadm:Fetching config... 2024-03-04T09:06:21.508 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-03-04T09:06:21.509 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-03-04T09:06:21.524 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-03-04T09:06:21.524 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-03-04T09:06:21.524 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-03-04T09:06:21.578 INFO:tasks.cephadm:Fetching mon keyring... 2024-03-04T09:06:21.578 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-03-04T09:06:21.578 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/keyring of=/dev/stdout 2024-03-04T09:06:21.645 INFO:tasks.cephadm:Fetching pub ssh key... 2024-03-04T09:06:21.645 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-03-04T09:06:21.646 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-03-04T09:06:21.701 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-03-04T09:06:21.701 DEBUG:teuthology.orchestra.run.smithi082:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXSFTTDEvhpcvjNaVQXSX7UOj1Ig/JIo2aKYLa7/3ysE/RLV08QnhXVCeXRGAHdzhatUxhl4L1L5j3btGV2tMGE5Dy1OBohdjOYYf2c3A2CIVWzgpp13BcsL3z4Fv7fqR0kkgTbIFJWkraC7RTeP2yJmLnmO2T+jE3V2sjtGwJABQBy2RvbBgeEfGpMGdKF03ErFsENdUZV23T3vnf8nLTflaHYi6SE9AsGlZG0K7jWkaMSdFT3vC8MlVDlyPXWVjCiS1fsdzHZ+Ndgo5Phhm7vHbZm0aLjWMX7iz+afT/vpGT1HSJUwzwLdrfTNJYOrUn9CMgJ/EnOe8C7aZ+GDkder6WTDshQUTD6Bx/kuQ6hlQgqyeA9Vwcy+awY+oZbOFN2M+CMdHVKGmzRWBNPQ4U3vt7CUUgNxEYCAGTU42c67d9CPddkyg7eRSNpv9jGVMwYSg+M4/KwskgTzIo5RYKSU6x52aAj1TfMXKlMSHHf5VK+xZtEG35DB0244BndDk= ceph-2e533fc8-da06-11ee-95c6-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-03-04T09:06:21.783 INFO:teuthology.orchestra.run.smithi082.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXSFTTDEvhpcvjNaVQXSX7UOj1Ig/JIo2aKYLa7/3ysE/RLV08QnhXVCeXRGAHdzhatUxhl4L1L5j3btGV2tMGE5Dy1OBohdjOYYf2c3A2CIVWzgpp13BcsL3z4Fv7fqR0kkgTbIFJWkraC7RTeP2yJmLnmO2T+jE3V2sjtGwJABQBy2RvbBgeEfGpMGdKF03ErFsENdUZV23T3vnf8nLTflaHYi6SE9AsGlZG0K7jWkaMSdFT3vC8MlVDlyPXWVjCiS1fsdzHZ+Ndgo5Phhm7vHbZm0aLjWMX7iz+afT/vpGT1HSJUwzwLdrfTNJYOrUn9CMgJ/EnOe8C7aZ+GDkder6WTDshQUTD6Bx/kuQ6hlQgqyeA9Vwcy+awY+oZbOFN2M+CMdHVKGmzRWBNPQ4U3vt7CUUgNxEYCAGTU42c67d9CPddkyg7eRSNpv9jGVMwYSg+M4/KwskgTzIo5RYKSU6x52aAj1TfMXKlMSHHf5VK+xZtEG35DB0244BndDk= ceph-2e533fc8-da06-11ee-95c6-87774f69a715 2024-03-04T09:06:21.798 DEBUG:teuthology.orchestra.run.smithi102:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXSFTTDEvhpcvjNaVQXSX7UOj1Ig/JIo2aKYLa7/3ysE/RLV08QnhXVCeXRGAHdzhatUxhl4L1L5j3btGV2tMGE5Dy1OBohdjOYYf2c3A2CIVWzgpp13BcsL3z4Fv7fqR0kkgTbIFJWkraC7RTeP2yJmLnmO2T+jE3V2sjtGwJABQBy2RvbBgeEfGpMGdKF03ErFsENdUZV23T3vnf8nLTflaHYi6SE9AsGlZG0K7jWkaMSdFT3vC8MlVDlyPXWVjCiS1fsdzHZ+Ndgo5Phhm7vHbZm0aLjWMX7iz+afT/vpGT1HSJUwzwLdrfTNJYOrUn9CMgJ/EnOe8C7aZ+GDkder6WTDshQUTD6Bx/kuQ6hlQgqyeA9Vwcy+awY+oZbOFN2M+CMdHVKGmzRWBNPQ4U3vt7CUUgNxEYCAGTU42c67d9CPddkyg7eRSNpv9jGVMwYSg+M4/KwskgTzIo5RYKSU6x52aAj1TfMXKlMSHHf5VK+xZtEG35DB0244BndDk= ceph-2e533fc8-da06-11ee-95c6-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-03-04T09:06:21.842 INFO:teuthology.orchestra.run.smithi102.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXSFTTDEvhpcvjNaVQXSX7UOj1Ig/JIo2aKYLa7/3ysE/RLV08QnhXVCeXRGAHdzhatUxhl4L1L5j3btGV2tMGE5Dy1OBohdjOYYf2c3A2CIVWzgpp13BcsL3z4Fv7fqR0kkgTbIFJWkraC7RTeP2yJmLnmO2T+jE3V2sjtGwJABQBy2RvbBgeEfGpMGdKF03ErFsENdUZV23T3vnf8nLTflaHYi6SE9AsGlZG0K7jWkaMSdFT3vC8MlVDlyPXWVjCiS1fsdzHZ+Ndgo5Phhm7vHbZm0aLjWMX7iz+afT/vpGT1HSJUwzwLdrfTNJYOrUn9CMgJ/EnOe8C7aZ+GDkder6WTDshQUTD6Bx/kuQ6hlQgqyeA9Vwcy+awY+oZbOFN2M+CMdHVKGmzRWBNPQ4U3vt7CUUgNxEYCAGTU42c67d9CPddkyg7eRSNpv9jGVMwYSg+M4/KwskgTzIo5RYKSU6x52aAj1TfMXKlMSHHf5VK+xZtEG35DB0244BndDk= ceph-2e533fc8-da06-11ee-95c6-87774f69a715 2024-03-04T09:06:21.857 DEBUG:teuthology.orchestra.run.smithi190:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXSFTTDEvhpcvjNaVQXSX7UOj1Ig/JIo2aKYLa7/3ysE/RLV08QnhXVCeXRGAHdzhatUxhl4L1L5j3btGV2tMGE5Dy1OBohdjOYYf2c3A2CIVWzgpp13BcsL3z4Fv7fqR0kkgTbIFJWkraC7RTeP2yJmLnmO2T+jE3V2sjtGwJABQBy2RvbBgeEfGpMGdKF03ErFsENdUZV23T3vnf8nLTflaHYi6SE9AsGlZG0K7jWkaMSdFT3vC8MlVDlyPXWVjCiS1fsdzHZ+Ndgo5Phhm7vHbZm0aLjWMX7iz+afT/vpGT1HSJUwzwLdrfTNJYOrUn9CMgJ/EnOe8C7aZ+GDkder6WTDshQUTD6Bx/kuQ6hlQgqyeA9Vwcy+awY+oZbOFN2M+CMdHVKGmzRWBNPQ4U3vt7CUUgNxEYCAGTU42c67d9CPddkyg7eRSNpv9jGVMwYSg+M4/KwskgTzIo5RYKSU6x52aAj1TfMXKlMSHHf5VK+xZtEG35DB0244BndDk= ceph-2e533fc8-da06-11ee-95c6-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-03-04T09:06:21.903 INFO:teuthology.orchestra.run.smithi190.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXSFTTDEvhpcvjNaVQXSX7UOj1Ig/JIo2aKYLa7/3ysE/RLV08QnhXVCeXRGAHdzhatUxhl4L1L5j3btGV2tMGE5Dy1OBohdjOYYf2c3A2CIVWzgpp13BcsL3z4Fv7fqR0kkgTbIFJWkraC7RTeP2yJmLnmO2T+jE3V2sjtGwJABQBy2RvbBgeEfGpMGdKF03ErFsENdUZV23T3vnf8nLTflaHYi6SE9AsGlZG0K7jWkaMSdFT3vC8MlVDlyPXWVjCiS1fsdzHZ+Ndgo5Phhm7vHbZm0aLjWMX7iz+afT/vpGT1HSJUwzwLdrfTNJYOrUn9CMgJ/EnOe8C7aZ+GDkder6WTDshQUTD6Bx/kuQ6hlQgqyeA9Vwcy+awY+oZbOFN2M+CMdHVKGmzRWBNPQ4U3vt7CUUgNxEYCAGTU42c67d9CPddkyg7eRSNpv9jGVMwYSg+M4/KwskgTzIo5RYKSU6x52aAj1TfMXKlMSHHf5VK+xZtEG35DB0244BndDk= ceph-2e533fc8-da06-11ee-95c6-87774f69a715 2024-03-04T09:06:21.918 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-03-04T09:06:22.155 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:06:22.277 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:21 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/2241584173' entity='client.admin' 2024-03-04T09:06:24.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:24.578+0000 7f6f75137700 1 -- 172.21.15.82:0/3258970996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f700ffdc0 msgr2=0x7f6f701001e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:24.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:24.578+0000 7f6f75137700 1 --2- 172.21.15.82:0/3258970996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f700ffdc0 0x7f6f701001e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6f64009910 tx=0x7f6f64009c20 comp rx=0 tx=0).stop 2024-03-04T09:06:24.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:24.578+0000 7f6f75137700 1 -- 172.21.15.82:0/3258970996 shutdown_connections 2024-03-04T09:06:24.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:24.578+0000 7f6f75137700 1 --2- 172.21.15.82:0/3258970996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f700ffdc0 0x7f6f701001e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:24.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:24.578+0000 7f6f75137700 1 -- 172.21.15.82:0/3258970996 >> 172.21.15.82:0/3258970996 conn(0x7f6f700fb720 msgr2=0x7f6f700fdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:06:24.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:24.578+0000 7f6f75137700 1 -- 172.21.15.82:0/3258970996 shutdown_connections 2024-03-04T09:06:24.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:24.578+0000 7f6f75137700 1 -- 172.21.15.82:0/3258970996 wait complete. 2024-03-04T09:06:24.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:24.579+0000 7f6f75137700 1 Processor -- start 2024-03-04T09:06:24.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:24.579+0000 7f6f75137700 1 -- start start 2024-03-04T09:06:24.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:24.580+0000 7f6f75137700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f700ffdc0 0x7f6f7019fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:06:24.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:24.580+0000 7f6f75137700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f70107b80 con 0x7f6f700ffdc0 2024-03-04T09:06:24.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:24.580+0000 7f6f6ed9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f700ffdc0 0x7f6f7019fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:06:24.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:24.580+0000 7f6f6ed9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f700ffdc0 0x7f6f7019fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55480/0 (socket says 172.21.15.82:55480) 2024-03-04T09:06:24.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:24.580+0000 7f6f6ed9d700 1 -- 172.21.15.82:0/255804187 learned_addr learned my addr 172.21.15.82:0/255804187 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:06:24.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:24.580+0000 7f6f6ed9d700 1 -- 172.21.15.82:0/255804187 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f7019ff60 con 0x7f6f700ffdc0 2024-03-04T09:06:24.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:24.580+0000 7f6f6ed9d700 1 --2- 172.21.15.82:0/255804187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f700ffdc0 0x7f6f7019fa20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6f64004f80 tx=0x7f6f64009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:06:24.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:24.580+0000 7f6f57fff700 1 -- 172.21.15.82:0/255804187 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f64027070 con 0x7f6f700ffdc0 2024-03-04T09:06:24.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:24.580+0000 7f6f57fff700 1 -- 172.21.15.82:0/255804187 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f6f6400be30 con 0x7f6f700ffdc0 2024-03-04T09:06:24.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:24.580+0000 7f6f75137700 1 -- 172.21.15.82:0/255804187 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f701a01f0 con 0x7f6f700ffdc0 2024-03-04T09:06:24.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:24.580+0000 7f6f57fff700 1 -- 172.21.15.82:0/255804187 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f6400f460 con 0x7f6f700ffdc0 2024-03-04T09:06:24.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:24.580+0000 7f6f75137700 1 -- 172.21.15.82:0/255804187 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f701a2ee0 con 0x7f6f700ffdc0 2024-03-04T09:06:24.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:24.581+0000 7f6f57fff700 1 -- 172.21.15.82:0/255804187 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 45984+0+0 (secure 0 0 0) 0x7f6f6402a070 con 0x7f6f700ffdc0 2024-03-04T09:06:24.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:24.581+0000 7f6f57fff700 1 --2- 172.21.15.82:0/255804187 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f6f58038ca0 0x7f6f5803b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:06:24.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:24.581+0000 7f6f57fff700 1 -- 172.21.15.82:0/255804187 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f6f6401e030 con 0x7f6f700ffdc0 2024-03-04T09:06:24.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:24.582+0000 7f6f6e59c700 1 --2- 172.21.15.82:0/255804187 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f6f58038ca0 0x7f6f5803b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:06:24.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:24.582+0000 7f6f75137700 1 -- 172.21.15.82:0/255804187 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f70108300 con 0x7f6f700ffdc0 2024-03-04T09:06:24.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:24.582+0000 7f6f6e59c700 1 --2- 172.21.15.82:0/255804187 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f6f58038ca0 0x7f6f5803b160 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6f60006fd0 tx=0x7f6f60006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:06:24.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:24.586+0000 7f6f57fff700 1 -- 172.21.15.82:0/255804187 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f6f64013070 con 0x7f6f700ffdc0 2024-03-04T09:06:24.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:24.788+0000 7f6f75137700 1 -- 172.21.15.82:0/255804187 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f6f7002d9b0 con 0x7f6f700ffdc0 2024-03-04T09:06:24.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:24.791+0000 7f6f57fff700 1 -- 172.21.15.82:0/255804187 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f6f6402b3b0 con 0x7f6f700ffdc0 2024-03-04T09:06:24.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:24.793+0000 7f6f75137700 1 -- 172.21.15.82:0/255804187 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f6f58038ca0 msgr2=0x7f6f5803b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:24.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:24.793+0000 7f6f75137700 1 --2- 172.21.15.82:0/255804187 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f6f58038ca0 0x7f6f5803b160 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6f60006fd0 tx=0x7f6f60006e40 comp rx=0 tx=0).stop 2024-03-04T09:06:24.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:24.793+0000 7f6f75137700 1 -- 172.21.15.82:0/255804187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f700ffdc0 msgr2=0x7f6f7019fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:24.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:24.793+0000 7f6f75137700 1 --2- 172.21.15.82:0/255804187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f700ffdc0 0x7f6f7019fa20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6f64004f80 tx=0x7f6f64009f90 comp rx=0 tx=0).stop 2024-03-04T09:06:24.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:24.794+0000 7f6f75137700 1 -- 172.21.15.82:0/255804187 shutdown_connections 2024-03-04T09:06:24.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:24.794+0000 7f6f75137700 1 --2- 172.21.15.82:0/255804187 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f6f58038ca0 0x7f6f5803b160 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:24.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:24.794+0000 7f6f75137700 1 --2- 172.21.15.82:0/255804187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f700ffdc0 0x7f6f7019fa20 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:24.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:24.794+0000 7f6f75137700 1 -- 172.21.15.82:0/255804187 >> 172.21.15.82:0/255804187 conn(0x7f6f700fb720 msgr2=0x7f6f700fc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:06:24.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:24.794+0000 7f6f75137700 1 -- 172.21.15.82:0/255804187 shutdown_connections 2024-03-04T09:06:24.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:24.794+0000 7f6f75137700 1 -- 172.21.15.82:0/255804187 wait complete. 2024-03-04T09:06:25.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:25 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/255804187' entity='client.admin' 2024-03-04T09:06:26.021 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-03-04T09:06:26.022 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-03-04T09:06:26.257 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:06:27.316 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:26 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:27.316 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:26 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:27.316 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:26 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi082", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:06:27.316 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:26 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:27.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:26 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:06:27.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:26 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:27.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:27.822+0000 7f962469f700 1 -- 172.21.15.82:0/848000854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f961c101b10 msgr2=0x7f961c101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:27.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:27.822+0000 7f962469f700 1 --2- 172.21.15.82:0/848000854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f961c101b10 0x7f961c101f30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9618009910 tx=0x7f9618009c20 comp rx=0 tx=0).stop 2024-03-04T09:06:27.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:27.823+0000 7f962469f700 1 -- 172.21.15.82:0/848000854 shutdown_connections 2024-03-04T09:06:27.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:27.823+0000 7f962469f700 1 --2- 172.21.15.82:0/848000854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f961c101b10 0x7f961c101f30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:27.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:27.823+0000 7f962469f700 1 -- 172.21.15.82:0/848000854 >> 172.21.15.82:0/848000854 conn(0x7f961c0fd0b0 msgr2=0x7f961c0ff4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:06:27.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:27.823+0000 7f962469f700 1 -- 172.21.15.82:0/848000854 shutdown_connections 2024-03-04T09:06:27.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:27.823+0000 7f962469f700 1 -- 172.21.15.82:0/848000854 wait complete. 2024-03-04T09:06:27.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:27.823+0000 7f962469f700 1 Processor -- start 2024-03-04T09:06:27.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:27.823+0000 7f962469f700 1 -- start start 2024-03-04T09:06:27.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:27.823+0000 7f962469f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f961c101b10 0x7f961c197230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:06:27.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:27.823+0000 7f962469f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f961c107b90 con 0x7f961c101b10 2024-03-04T09:06:27.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:27.823+0000 7f962243b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f961c101b10 0x7f961c197230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:06:27.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:27.823+0000 7f962243b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f961c101b10 0x7f961c197230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33376/0 (socket says 172.21.15.82:33376) 2024-03-04T09:06:27.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:27.824+0000 7f962243b700 1 -- 172.21.15.82:0/422355891 learned_addr learned my addr 172.21.15.82:0/422355891 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:06:27.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:27.824+0000 7f962243b700 1 -- 172.21.15.82:0/422355891 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f961c197770 con 0x7f961c101b10 2024-03-04T09:06:27.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:27.824+0000 7f962243b700 1 --2- 172.21.15.82:0/422355891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f961c101b10 0x7f961c197230 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9618004f80 tx=0x7f9618009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:06:27.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:27.824+0000 7f96137fe700 1 -- 172.21.15.82:0/422355891 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9618027070 con 0x7f961c101b10 2024-03-04T09:06:27.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:27.824+0000 7f96137fe700 1 -- 172.21.15.82:0/422355891 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f961800be30 con 0x7f961c101b10 2024-03-04T09:06:27.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:27.824+0000 7f962469f700 1 -- 172.21.15.82:0/422355891 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f961c197a00 con 0x7f961c101b10 2024-03-04T09:06:27.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:27.824+0000 7f96137fe700 1 -- 172.21.15.82:0/422355891 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f961800f460 con 0x7f961c101b10 2024-03-04T09:06:27.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:27.824+0000 7f962469f700 1 -- 172.21.15.82:0/422355891 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f961c19a6f0 con 0x7f961c101b10 2024-03-04T09:06:27.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:27.825+0000 7f96137fe700 1 -- 172.21.15.82:0/422355891 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 45984+0+0 (secure 0 0 0) 0x7f961802a070 con 0x7f961c101b10 2024-03-04T09:06:27.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:27.825+0000 7f96137fe700 1 --2- 172.21.15.82:0/422355891 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f9608038ca0 0x7f960803b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:06:27.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:27.825+0000 7f962469f700 1 -- 172.21.15.82:0/422355891 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f961c108310 con 0x7f961c101b10 2024-03-04T09:06:27.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:27.825+0000 7f96137fe700 1 -- 172.21.15.82:0/422355891 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f961801e030 con 0x7f961c101b10 2024-03-04T09:06:27.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:27.825+0000 7f9621c3a700 1 --2- 172.21.15.82:0/422355891 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f9608038ca0 0x7f960803b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:06:27.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:27.825+0000 7f9621c3a700 1 --2- 172.21.15.82:0/422355891 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f9608038ca0 0x7f960803b160 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f960c006fd0 tx=0x7f960c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:06:27.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:27.830+0000 7f96137fe700 1 -- 172.21.15.82:0/422355891 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f9618013070 con 0x7f961c101b10 2024-03-04T09:06:28.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:28.029+0000 7f962469f700 1 -- 172.21.15.82:0/422355891 --> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f961c02da50 con 0x7f9608038ca0 2024-03-04T09:06:28.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:28.032+0000 7f96137fe700 1 -- 172.21.15.82:0/422355891 <== mgr.14152 v2:172.21.15.82:6800/1278635224 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f961c02da50 con 0x7f9608038ca0 2024-03-04T09:06:28.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:28.034+0000 7f962469f700 1 -- 172.21.15.82:0/422355891 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f9608038ca0 msgr2=0x7f960803b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:28.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:28.034+0000 7f962469f700 1 --2- 172.21.15.82:0/422355891 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f9608038ca0 0x7f960803b160 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f960c006fd0 tx=0x7f960c006e40 comp rx=0 tx=0).stop 2024-03-04T09:06:28.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:28.034+0000 7f962469f700 1 -- 172.21.15.82:0/422355891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f961c101b10 msgr2=0x7f961c197230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:28.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:28.034+0000 7f962469f700 1 --2- 172.21.15.82:0/422355891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f961c101b10 0x7f961c197230 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9618004f80 tx=0x7f9618009f90 comp rx=0 tx=0).stop 2024-03-04T09:06:28.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:28.034+0000 7f962469f700 1 -- 172.21.15.82:0/422355891 shutdown_connections 2024-03-04T09:06:28.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:28.035+0000 7f962469f700 1 --2- 172.21.15.82:0/422355891 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f9608038ca0 0x7f960803b160 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:28.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:28.035+0000 7f962469f700 1 --2- 172.21.15.82:0/422355891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f961c101b10 0x7f961c197230 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:28.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:28.035+0000 7f962469f700 1 -- 172.21.15.82:0/422355891 >> 172.21.15.82:0/422355891 conn(0x7f961c0fd0b0 msgr2=0x7f961c0fdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:06:28.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:28.035+0000 7f962469f700 1 -- 172.21.15.82:0/422355891 shutdown_connections 2024-03-04T09:06:28.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:28.035+0000 7f962469f700 1 -- 172.21.15.82:0/422355891 wait complete. 2024-03-04T09:06:28.818 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi102 2024-03-04T09:06:28.818 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-03-04T09:06:28.818 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/etc/ceph/ceph.conf 2024-03-04T09:06:28.835 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-03-04T09:06:28.835 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-04T09:06:28.892 INFO:tasks.cephadm:Adding host smithi102 to orchestrator... 2024-03-04T09:06:28.893 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph orch host add smithi102 2024-03-04T09:06:29.066 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:29 smithi082 ceph-mon[32880]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:06:29.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:29 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:29.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:29 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:06:29.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:29 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:06:29.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:29 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:06:29.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:29 smithi082 ceph-mon[32880]: Updating smithi082:/etc/ceph/ceph.conf 2024-03-04T09:06:29.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:29 smithi082 ceph-mon[32880]: Updating smithi082:/var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T09:06:29.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:29 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:29.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:29 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:29.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:29 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:29.128 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:06:30.316 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:30 smithi082 ceph-mon[32880]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2024-03-04T09:06:30.316 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:30 smithi082 ceph-mon[32880]: Updating smithi082:/var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/config/ceph.client.admin.keyring 2024-03-04T09:06:30.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:30.694+0000 7f2af5077700 1 -- 172.21.15.82:0/2996031148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2af0106980 msgr2=0x7f2af0106d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:30.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:30.694+0000 7f2af5077700 1 --2- 172.21.15.82:0/2996031148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2af0106980 0x7f2af0106d60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2ae0009910 tx=0x7f2ae0009c20 comp rx=0 tx=0).stop 2024-03-04T09:06:30.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:30.694+0000 7f2af5077700 1 -- 172.21.15.82:0/2996031148 shutdown_connections 2024-03-04T09:06:30.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:30.694+0000 7f2af5077700 1 --2- 172.21.15.82:0/2996031148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2af0106980 0x7f2af0106d60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:30.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:30.694+0000 7f2af5077700 1 -- 172.21.15.82:0/2996031148 >> 172.21.15.82:0/2996031148 conn(0x7f2af00fc470 msgr2=0x7f2af00fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:06:30.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:30.694+0000 7f2af5077700 1 -- 172.21.15.82:0/2996031148 shutdown_connections 2024-03-04T09:06:30.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:30.694+0000 7f2af5077700 1 -- 172.21.15.82:0/2996031148 wait complete. 2024-03-04T09:06:30.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:30.695+0000 7f2af5077700 1 Processor -- start 2024-03-04T09:06:30.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:30.695+0000 7f2af5077700 1 -- start start 2024-03-04T09:06:30.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:30.695+0000 7f2af5077700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2af0106980 0x7f2af0197620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:06:30.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:30.695+0000 7f2af5077700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af010afb0 con 0x7f2af0106980 2024-03-04T09:06:30.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:30.695+0000 7f2aeed9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2af0106980 0x7f2af0197620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:06:30.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:30.695+0000 7f2aeed9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2af0106980 0x7f2af0197620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33390/0 (socket says 172.21.15.82:33390) 2024-03-04T09:06:30.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:30.695+0000 7f2aeed9d700 1 -- 172.21.15.82:0/3439534426 learned_addr learned my addr 172.21.15.82:0/3439534426 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:06:30.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:30.695+0000 7f2aeed9d700 1 -- 172.21.15.82:0/3439534426 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af0197b60 con 0x7f2af0106980 2024-03-04T09:06:30.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:30.695+0000 7f2aeed9d700 1 --2- 172.21.15.82:0/3439534426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2af0106980 0x7f2af0197620 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2ae0006010 tx=0x7f2ae0005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:06:30.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:30.696+0000 7f2ad7fff700 1 -- 172.21.15.82:0/3439534426 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ae0027070 con 0x7f2af0106980 2024-03-04T09:06:30.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:30.696+0000 7f2ad7fff700 1 -- 172.21.15.82:0/3439534426 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f2ae000be30 con 0x7f2af0106980 2024-03-04T09:06:30.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:30.696+0000 7f2af5077700 1 -- 172.21.15.82:0/3439534426 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2af0197e50 con 0x7f2af0106980 2024-03-04T09:06:30.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:30.696+0000 7f2ad7fff700 1 -- 172.21.15.82:0/3439534426 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ae0022d70 con 0x7f2af0106980 2024-03-04T09:06:30.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:30.696+0000 7f2af5077700 1 -- 172.21.15.82:0/3439534426 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2af019bea0 con 0x7f2af0106980 2024-03-04T09:06:30.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:30.697+0000 7f2ad7fff700 1 -- 172.21.15.82:0/3439534426 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 45984+0+0 (secure 0 0 0) 0x7f2ae002a070 con 0x7f2af0106980 2024-03-04T09:06:30.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:30.697+0000 7f2af5077700 1 -- 172.21.15.82:0/3439534426 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2af01020c0 con 0x7f2af0106980 2024-03-04T09:06:30.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:30.697+0000 7f2ad7fff700 1 --2- 172.21.15.82:0/3439534426 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f2ad8038c40 0x7f2ad803b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:06:30.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:30.697+0000 7f2ad7fff700 1 -- 172.21.15.82:0/3439534426 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f2ae001e030 con 0x7f2af0106980 2024-03-04T09:06:30.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:30.697+0000 7f2aee59c700 1 --2- 172.21.15.82:0/3439534426 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f2ad8038c40 0x7f2ad803b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:06:30.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:30.697+0000 7f2aee59c700 1 --2- 172.21.15.82:0/3439534426 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f2ad8038c40 0x7f2ad803b100 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2ae4006fd0 tx=0x7f2ae4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:06:30.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:30.702+0000 7f2ad7fff700 1 -- 172.21.15.82:0/3439534426 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f2ae0053080 con 0x7f2af0106980 2024-03-04T09:06:30.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:30.898+0000 7f2af5077700 1 -- 172.21.15.82:0/3439534426 --> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi102", "target": ["mon-mgr", ""]}) v1 -- 0x7f2af00636f0 con 0x7f2ad8038c40 2024-03-04T09:06:31.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:31 smithi082 ceph-mon[32880]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi102", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:06:32.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:32 smithi082 ceph-mon[32880]: Deploying cephadm binary to smithi102 2024-03-04T09:06:32.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:32 smithi082 ceph-mon[32880]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:06:35.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:35.139+0000 7f2ad7fff700 1 -- 172.21.15.82:0/3439534426 <== mgr.14152 v2:172.21.15.82:6800/1278635224 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f2af00636f0 con 0x7f2ad8038c40 2024-03-04T09:06:35.136 INFO:teuthology.orchestra.run.smithi082.stdout:Added host 'smithi102' with addr '172.21.15.102' 2024-03-04T09:06:35.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:35.141+0000 7f2af5077700 1 -- 172.21.15.82:0/3439534426 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f2ad8038c40 msgr2=0x7f2ad803b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:35.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:35.141+0000 7f2af5077700 1 --2- 172.21.15.82:0/3439534426 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f2ad8038c40 0x7f2ad803b100 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2ae4006fd0 tx=0x7f2ae4006e40 comp rx=0 tx=0).stop 2024-03-04T09:06:35.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:35.141+0000 7f2af5077700 1 -- 172.21.15.82:0/3439534426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2af0106980 msgr2=0x7f2af0197620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:35.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:35.141+0000 7f2af5077700 1 --2- 172.21.15.82:0/3439534426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2af0106980 0x7f2af0197620 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2ae0006010 tx=0x7f2ae0005810 comp rx=0 tx=0).stop 2024-03-04T09:06:35.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:35.141+0000 7f2af5077700 1 -- 172.21.15.82:0/3439534426 shutdown_connections 2024-03-04T09:06:35.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:35.141+0000 7f2af5077700 1 --2- 172.21.15.82:0/3439534426 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f2ad8038c40 0x7f2ad803b100 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:35.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:35.141+0000 7f2af5077700 1 --2- 172.21.15.82:0/3439534426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2af0106980 0x7f2af0197620 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:35.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:35.141+0000 7f2af5077700 1 -- 172.21.15.82:0/3439534426 >> 172.21.15.82:0/3439534426 conn(0x7f2af00fc470 msgr2=0x7f2af0108550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:06:35.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:35.142+0000 7f2af5077700 1 -- 172.21.15.82:0/3439534426 shutdown_connections 2024-03-04T09:06:35.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:35.142+0000 7f2af5077700 1 -- 172.21.15.82:0/3439534426 wait complete. 2024-03-04T09:06:35.456 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:35 smithi082 ceph-mon[32880]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:06:35.456 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:35 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:35.456 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:35 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:06:35.760 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph orch host ls --format=json 2024-03-04T09:06:35.995 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:06:36.451 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:36 smithi082 ceph-mon[32880]: Added host smithi102 2024-03-04T09:06:36.452 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:36 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:36.452 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:36 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:37.482 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:37 smithi082 ceph-mon[32880]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:06:37.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:37.503+0000 7f832be48700 1 -- 172.21.15.82:0/2250506890 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8324107a90 msgr2=0x7f8324107e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:37.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:37.503+0000 7f832be48700 1 --2- 172.21.15.82:0/2250506890 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8324107a90 0x7f8324107e70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8320009910 tx=0x7f8320009c20 comp rx=0 tx=0).stop 2024-03-04T09:06:37.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:37.503+0000 7f832be48700 1 -- 172.21.15.82:0/2250506890 shutdown_connections 2024-03-04T09:06:37.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:37.503+0000 7f832be48700 1 --2- 172.21.15.82:0/2250506890 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8324107a90 0x7f8324107e70 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:37.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:37.503+0000 7f832be48700 1 -- 172.21.15.82:0/2250506890 >> 172.21.15.82:0/2250506890 conn(0x7f83240fd5a0 msgr2=0x7f83240ff9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:06:37.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:37.503+0000 7f832be48700 1 -- 172.21.15.82:0/2250506890 shutdown_connections 2024-03-04T09:06:37.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:37.503+0000 7f832be48700 1 -- 172.21.15.82:0/2250506890 wait complete. 2024-03-04T09:06:37.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:37.503+0000 7f832be48700 1 Processor -- start 2024-03-04T09:06:37.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:37.504+0000 7f832be48700 1 -- start start 2024-03-04T09:06:37.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:37.504+0000 7f832be48700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8324107a90 0x7f8324197620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:06:37.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:37.504+0000 7f832be48700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832410c0c0 con 0x7f8324107a90 2024-03-04T09:06:37.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:37.504+0000 7f8329be4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8324107a90 0x7f8324197620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:06:37.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:37.504+0000 7f8329be4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8324107a90 0x7f8324197620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41566/0 (socket says 172.21.15.82:41566) 2024-03-04T09:06:37.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:37.504+0000 7f8329be4700 1 -- 172.21.15.82:0/830028994 learned_addr learned my addr 172.21.15.82:0/830028994 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:06:37.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:37.504+0000 7f8329be4700 1 -- 172.21.15.82:0/830028994 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8324197b60 con 0x7f8324107a90 2024-03-04T09:06:37.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:37.504+0000 7f8329be4700 1 --2- 172.21.15.82:0/830028994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8324107a90 0x7f8324197620 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8320006010 tx=0x7f8320005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:06:37.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:37.504+0000 7f831affd700 1 -- 172.21.15.82:0/830028994 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8320027070 con 0x7f8324107a90 2024-03-04T09:06:37.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:37.504+0000 7f831affd700 1 -- 172.21.15.82:0/830028994 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f832000be30 con 0x7f8324107a90 2024-03-04T09:06:37.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:37.504+0000 7f831affd700 1 -- 172.21.15.82:0/830028994 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8320022d70 con 0x7f8324107a90 2024-03-04T09:06:37.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:37.504+0000 7f832be48700 1 -- 172.21.15.82:0/830028994 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8324197e50 con 0x7f8324107a90 2024-03-04T09:06:37.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:37.505+0000 7f832be48700 1 -- 172.21.15.82:0/830028994 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f832419bef0 con 0x7f8324107a90 2024-03-04T09:06:37.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:37.505+0000 7f831affd700 1 -- 172.21.15.82:0/830028994 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 45984+0+0 (secure 0 0 0) 0x7f832002a070 con 0x7f8324107a90 2024-03-04T09:06:37.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:37.505+0000 7f832be48700 1 -- 172.21.15.82:0/830028994 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83241031d0 con 0x7f8324107a90 2024-03-04T09:06:37.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:37.506+0000 7f831affd700 1 --2- 172.21.15.82:0/830028994 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f8310038ca0 0x7f831003b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:06:37.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:37.506+0000 7f831affd700 1 -- 172.21.15.82:0/830028994 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f832001e030 con 0x7f8324107a90 2024-03-04T09:06:37.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:37.506+0000 7f83293e3700 1 --2- 172.21.15.82:0/830028994 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f8310038ca0 0x7f831003b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:06:37.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:37.506+0000 7f83293e3700 1 --2- 172.21.15.82:0/830028994 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f8310038ca0 0x7f831003b160 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8314006fd0 tx=0x7f8314006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:06:37.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:37.510+0000 7f831affd700 1 -- 172.21.15.82:0/830028994 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f8320013070 con 0x7f8324107a90 2024-03-04T09:06:37.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:37.715+0000 7f832be48700 1 -- 172.21.15.82:0/830028994 --> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8324198980 con 0x7f8310038ca0 2024-03-04T09:06:37.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:37.716+0000 7f831affd700 1 -- 172.21.15.82:0/830028994 <== mgr.14152 v2:172.21.15.82:6800/1278635224 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7f8324198980 con 0x7f8310038ca0 2024-03-04T09:06:37.712 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:06:37.712 INFO:teuthology.orchestra.run.smithi082.stdout:[{"addr": "172.21.15.82", "hostname": "smithi082", "labels": [], "status": ""}, {"addr": "172.21.15.102", "hostname": "smithi102", "labels": [], "status": ""}] 2024-03-04T09:06:37.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:37.718+0000 7f832be48700 1 -- 172.21.15.82:0/830028994 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f8310038ca0 msgr2=0x7f831003b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:37.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:37.718+0000 7f832be48700 1 --2- 172.21.15.82:0/830028994 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f8310038ca0 0x7f831003b160 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8314006fd0 tx=0x7f8314006e40 comp rx=0 tx=0).stop 2024-03-04T09:06:37.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:37.718+0000 7f832be48700 1 -- 172.21.15.82:0/830028994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8324107a90 msgr2=0x7f8324197620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:37.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:37.718+0000 7f832be48700 1 --2- 172.21.15.82:0/830028994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8324107a90 0x7f8324197620 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8320006010 tx=0x7f8320005810 comp rx=0 tx=0).stop 2024-03-04T09:06:37.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:37.718+0000 7f832be48700 1 -- 172.21.15.82:0/830028994 shutdown_connections 2024-03-04T09:06:37.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:37.718+0000 7f832be48700 1 --2- 172.21.15.82:0/830028994 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f8310038ca0 0x7f831003b160 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:37.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:37.718+0000 7f832be48700 1 --2- 172.21.15.82:0/830028994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8324107a90 0x7f8324197620 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:37.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:37.718+0000 7f832be48700 1 -- 172.21.15.82:0/830028994 >> 172.21.15.82:0/830028994 conn(0x7f83240fd5a0 msgr2=0x7f83240fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:06:37.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:37.718+0000 7f832be48700 1 -- 172.21.15.82:0/830028994 shutdown_connections 2024-03-04T09:06:37.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:37.718+0000 7f832be48700 1 -- 172.21.15.82:0/830028994 wait complete. 2024-03-04T09:06:38.382 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi190 2024-03-04T09:06:38.382 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-03-04T09:06:38.382 DEBUG:teuthology.orchestra.run.smithi190:> dd of=/etc/ceph/ceph.conf 2024-03-04T09:06:38.400 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-03-04T09:06:38.400 DEBUG:teuthology.orchestra.run.smithi190:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-04T09:06:38.457 INFO:tasks.cephadm:Adding host smithi190 to orchestrator... 2024-03-04T09:06:38.457 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph orch host add smithi190 2024-03-04T09:06:38.693 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:06:38.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:38 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:38.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:38 smithi082 ceph-mon[32880]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T09:06:38.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:38 smithi082 ceph-mon[32880]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:06:40.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:40.200+0000 7fcda5c72700 1 -- 172.21.15.82:0/3533295127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcda0102c50 msgr2=0x7fcda0103030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:40.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:40.200+0000 7fcda5c72700 1 --2- 172.21.15.82:0/3533295127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcda0102c50 0x7fcda0103030 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcd90009910 tx=0x7fcd90009c20 comp rx=0 tx=0).stop 2024-03-04T09:06:40.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:40.200+0000 7fcda5c72700 1 -- 172.21.15.82:0/3533295127 shutdown_connections 2024-03-04T09:06:40.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:40.200+0000 7fcda5c72700 1 --2- 172.21.15.82:0/3533295127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcda0102c50 0x7fcda0103030 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:40.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:40.200+0000 7fcda5c72700 1 -- 172.21.15.82:0/3533295127 >> 172.21.15.82:0/3533295127 conn(0x7fcda0077600 msgr2=0x7fcda00fe8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:06:40.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:40.200+0000 7fcda5c72700 1 -- 172.21.15.82:0/3533295127 shutdown_connections 2024-03-04T09:06:40.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:40.200+0000 7fcda5c72700 1 -- 172.21.15.82:0/3533295127 wait complete. 2024-03-04T09:06:40.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:40.201+0000 7fcda5c72700 1 Processor -- start 2024-03-04T09:06:40.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:40.201+0000 7fcda5c72700 1 -- start start 2024-03-04T09:06:40.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:40.201+0000 7fcda5c72700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcda0102c50 0x7fcda0197630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:06:40.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:40.201+0000 7fcda5c72700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda010c130 con 0x7fcda0102c50 2024-03-04T09:06:40.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:40.201+0000 7fcd9f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcda0102c50 0x7fcda0197630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:06:40.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:40.201+0000 7fcd9f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcda0102c50 0x7fcda0197630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41592/0 (socket says 172.21.15.82:41592) 2024-03-04T09:06:40.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:40.201+0000 7fcd9f7fe700 1 -- 172.21.15.82:0/1197734502 learned_addr learned my addr 172.21.15.82:0/1197734502 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:06:40.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:40.201+0000 7fcd9f7fe700 1 -- 172.21.15.82:0/1197734502 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda0197b70 con 0x7fcda0102c50 2024-03-04T09:06:40.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:40.201+0000 7fcd9f7fe700 1 --2- 172.21.15.82:0/1197734502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcda0102c50 0x7fcda0197630 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcd90006010 tx=0x7fcd90005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:06:40.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:40.201+0000 7fcd9d7fa700 1 -- 172.21.15.82:0/1197734502 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcd90027070 con 0x7fcda0102c50 2024-03-04T09:06:40.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:40.202+0000 7fcd9d7fa700 1 -- 172.21.15.82:0/1197734502 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fcd9000be30 con 0x7fcda0102c50 2024-03-04T09:06:40.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:40.202+0000 7fcda5c72700 1 -- 172.21.15.82:0/1197734502 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcda0197e00 con 0x7fcda0102c50 2024-03-04T09:06:40.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:40.202+0000 7fcd9d7fa700 1 -- 172.21.15.82:0/1197734502 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcd90022e10 con 0x7fcda0102c50 2024-03-04T09:06:40.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:40.202+0000 7fcda5c72700 1 -- 172.21.15.82:0/1197734502 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcda0198260 con 0x7fcda0102c50 2024-03-04T09:06:40.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:40.202+0000 7fcd9d7fa700 1 -- 172.21.15.82:0/1197734502 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 45984+0+0 (secure 0 0 0) 0x7fcd9002a070 con 0x7fcda0102c50 2024-03-04T09:06:40.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:40.203+0000 7fcda5c72700 1 -- 172.21.15.82:0/1197734502 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcda0069d90 con 0x7fcda0102c50 2024-03-04T09:06:40.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:40.203+0000 7fcd9d7fa700 1 --2- 172.21.15.82:0/1197734502 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fcd8c038bf0 0x7fcd8c03b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:06:40.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:40.203+0000 7fcd9d7fa700 1 -- 172.21.15.82:0/1197734502 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fcd9001e030 con 0x7fcda0102c50 2024-03-04T09:06:40.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:40.203+0000 7fcd96ffd700 1 --2- 172.21.15.82:0/1197734502 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fcd8c038bf0 0x7fcd8c03b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:06:40.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:40.203+0000 7fcd96ffd700 1 --2- 172.21.15.82:0/1197734502 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fcd8c038bf0 0x7fcd8c03b0b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcd88006fd0 tx=0x7fcd88006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:06:40.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:40.208+0000 7fcd9d7fa700 1 -- 172.21.15.82:0/1197734502 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fcd90013070 con 0x7fcda0102c50 2024-03-04T09:06:40.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:40.407+0000 7fcda5c72700 1 -- 172.21.15.82:0/1197734502 --> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi190", "target": ["mon-mgr", ""]}) v1 -- 0x7fcda0198a00 con 0x7fcd8c038bf0 2024-03-04T09:06:41.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:41 smithi082 ceph-mon[32880]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:06:41.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:41 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:41.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:41 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:41.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:41 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:41.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:41 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:41.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:41 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi102", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:06:41.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:41 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:06:41.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:41 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:06:42.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:42 smithi082 ceph-mon[32880]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi190", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:06:42.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:42 smithi082 ceph-mon[32880]: Updating smithi102:/etc/ceph/ceph.conf 2024-03-04T09:06:42.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:42 smithi082 ceph-mon[32880]: Updating smithi102:/var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T09:06:42.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:42 smithi082 ceph-mon[32880]: Updating smithi102:/etc/ceph/ceph.client.admin.keyring 2024-03-04T09:06:42.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:42 smithi082 ceph-mon[32880]: Deploying cephadm binary to smithi190 2024-03-04T09:06:42.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:42 smithi082 ceph-mon[32880]: Updating smithi102:/var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/config/ceph.client.admin.keyring 2024-03-04T09:06:42.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:42 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:42.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:42 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:42.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:42 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:43.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:43 smithi082 ceph-mon[32880]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:06:44.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:44.849+0000 7fcd9d7fa700 1 -- 172.21.15.82:0/1197734502 <== mgr.14152 v2:172.21.15.82:6800/1278635224 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fcda0198a00 con 0x7fcd8c038bf0 2024-03-04T09:06:44.845 INFO:teuthology.orchestra.run.smithi082.stdout:Added host 'smithi190' with addr '172.21.15.190' 2024-03-04T09:06:44.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:44.851+0000 7fcda5c72700 1 -- 172.21.15.82:0/1197734502 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fcd8c038bf0 msgr2=0x7fcd8c03b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:44.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:44.851+0000 7fcda5c72700 1 --2- 172.21.15.82:0/1197734502 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fcd8c038bf0 0x7fcd8c03b0b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcd88006fd0 tx=0x7fcd88006e40 comp rx=0 tx=0).stop 2024-03-04T09:06:44.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:44.851+0000 7fcda5c72700 1 -- 172.21.15.82:0/1197734502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcda0102c50 msgr2=0x7fcda0197630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:44.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:44.851+0000 7fcda5c72700 1 --2- 172.21.15.82:0/1197734502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcda0102c50 0x7fcda0197630 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcd90006010 tx=0x7fcd90005810 comp rx=0 tx=0).stop 2024-03-04T09:06:44.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:44.851+0000 7fcda5c72700 1 -- 172.21.15.82:0/1197734502 shutdown_connections 2024-03-04T09:06:44.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:44.851+0000 7fcda5c72700 1 --2- 172.21.15.82:0/1197734502 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fcd8c038bf0 0x7fcd8c03b0b0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:44.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:44.851+0000 7fcda5c72700 1 --2- 172.21.15.82:0/1197734502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcda0102c50 0x7fcda0197630 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:44.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:44.851+0000 7fcda5c72700 1 -- 172.21.15.82:0/1197734502 >> 172.21.15.82:0/1197734502 conn(0x7fcda0077600 msgr2=0x7fcda01039e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:06:44.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:44.851+0000 7fcda5c72700 1 -- 172.21.15.82:0/1197734502 shutdown_connections 2024-03-04T09:06:44.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:44.851+0000 7fcda5c72700 1 -- 172.21.15.82:0/1197734502 wait complete. 2024-03-04T09:06:45.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:45 smithi082 ceph-mon[32880]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:06:45.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:45 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:45.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:45 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:06:45.630 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph orch host ls --format=json 2024-03-04T09:06:45.868 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:06:46.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:46 smithi082 ceph-mon[32880]: Added host smithi190 2024-03-04T09:06:46.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:46 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:46.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:46 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:47.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:47.384+0000 7f020faf2700 1 -- 172.21.15.82:0/3326039353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0208107aa0 msgr2=0x7f0208107e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:47.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:47.384+0000 7f020faf2700 1 --2- 172.21.15.82:0/3326039353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0208107aa0 0x7f0208107e80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0204009910 tx=0x7f0204009c20 comp rx=0 tx=0).stop 2024-03-04T09:06:47.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:47.384+0000 7f020faf2700 1 -- 172.21.15.82:0/3326039353 shutdown_connections 2024-03-04T09:06:47.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:47.384+0000 7f020faf2700 1 --2- 172.21.15.82:0/3326039353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0208107aa0 0x7f0208107e80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:47.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:47.384+0000 7f020faf2700 1 -- 172.21.15.82:0/3326039353 >> 172.21.15.82:0/3326039353 conn(0x7f02080fd5d0 msgr2=0x7f02080ff9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:06:47.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:47.384+0000 7f020faf2700 1 -- 172.21.15.82:0/3326039353 shutdown_connections 2024-03-04T09:06:47.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:47.384+0000 7f020faf2700 1 -- 172.21.15.82:0/3326039353 wait complete. 2024-03-04T09:06:47.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:47.385+0000 7f020faf2700 1 Processor -- start 2024-03-04T09:06:47.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:47.385+0000 7f020faf2700 1 -- start start 2024-03-04T09:06:47.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:47.385+0000 7f020faf2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0208107aa0 0x7f02081975d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:06:47.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:47.385+0000 7f020faf2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020810c0d0 con 0x7f0208107aa0 2024-03-04T09:06:47.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:47.385+0000 7f020d88e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0208107aa0 0x7f02081975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:06:47.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:47.385+0000 7f020d88e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0208107aa0 0x7f02081975d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56682/0 (socket says 172.21.15.82:56682) 2024-03-04T09:06:47.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:47.385+0000 7f020d88e700 1 -- 172.21.15.82:0/1353902871 learned_addr learned my addr 172.21.15.82:0/1353902871 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:06:47.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:47.386+0000 7f020d88e700 1 -- 172.21.15.82:0/1353902871 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0208197b10 con 0x7f0208107aa0 2024-03-04T09:06:47.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:47.386+0000 7f020d88e700 1 --2- 172.21.15.82:0/1353902871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0208107aa0 0x7f02081975d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0204006010 tx=0x7f0204005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:06:47.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:47.386+0000 7f01feffd700 1 -- 172.21.15.82:0/1353902871 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0204026070 con 0x7f0208107aa0 2024-03-04T09:06:47.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:47.386+0000 7f01feffd700 1 -- 172.21.15.82:0/1353902871 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f020400bbc0 con 0x7f0208107aa0 2024-03-04T09:06:47.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:47.386+0000 7f020faf2700 1 -- 172.21.15.82:0/1353902871 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0208197e00 con 0x7f0208107aa0 2024-03-04T09:06:47.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:47.386+0000 7f01feffd700 1 -- 172.21.15.82:0/1353902871 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02040038a0 con 0x7f0208107aa0 2024-03-04T09:06:47.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:47.386+0000 7f020faf2700 1 -- 172.21.15.82:0/1353902871 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f020819bea0 con 0x7f0208107aa0 2024-03-04T09:06:47.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:47.387+0000 7f01feffd700 1 -- 172.21.15.82:0/1353902871 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 45984+0+0 (secure 0 0 0) 0x7f0204029070 con 0x7f0208107aa0 2024-03-04T09:06:47.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:47.387+0000 7f01feffd700 1 --2- 172.21.15.82:0/1353902871 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f01f4038c40 0x7f01f403b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:06:47.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:47.387+0000 7f020faf2700 1 -- 172.21.15.82:0/1353902871 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02081031e0 con 0x7f0208107aa0 2024-03-04T09:06:47.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:47.387+0000 7f01feffd700 1 -- 172.21.15.82:0/1353902871 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f020401e070 con 0x7f0208107aa0 2024-03-04T09:06:47.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:47.387+0000 7f020d08d700 1 --2- 172.21.15.82:0/1353902871 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f01f4038c40 0x7f01f403b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:06:47.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:47.387+0000 7f020d08d700 1 --2- 172.21.15.82:0/1353902871 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f01f4038c40 0x7f01f403b100 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f01f8006fd0 tx=0x7f01f8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:06:47.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:47.392+0000 7f01feffd700 1 -- 172.21.15.82:0/1353902871 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f0204013070 con 0x7f0208107aa0 2024-03-04T09:06:47.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:47.593+0000 7f020faf2700 1 -- 172.21.15.82:0/1353902871 --> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0208198930 con 0x7f01f4038c40 2024-03-04T09:06:47.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:47.595+0000 7f01feffd700 1 -- 172.21.15.82:0/1353902871 <== mgr.14152 v2:172.21.15.82:6800/1278635224 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+240 (secure 0 0 0) 0x7f0208198930 con 0x7f01f4038c40 2024-03-04T09:06:47.591 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:06:47.591 INFO:teuthology.orchestra.run.smithi082.stdout:[{"addr": "172.21.15.82", "hostname": "smithi082", "labels": [], "status": ""}, {"addr": "172.21.15.102", "hostname": "smithi102", "labels": [], "status": ""}, {"addr": "172.21.15.190", "hostname": "smithi190", "labels": [], "status": ""}] 2024-03-04T09:06:47.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:47.597+0000 7f020faf2700 1 -- 172.21.15.82:0/1353902871 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f01f4038c40 msgr2=0x7f01f403b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:47.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:47.597+0000 7f020faf2700 1 --2- 172.21.15.82:0/1353902871 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f01f4038c40 0x7f01f403b100 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f01f8006fd0 tx=0x7f01f8006e40 comp rx=0 tx=0).stop 2024-03-04T09:06:47.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:47.597+0000 7f020faf2700 1 -- 172.21.15.82:0/1353902871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0208107aa0 msgr2=0x7f02081975d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:47.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:47.597+0000 7f020faf2700 1 --2- 172.21.15.82:0/1353902871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0208107aa0 0x7f02081975d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0204006010 tx=0x7f0204005810 comp rx=0 tx=0).stop 2024-03-04T09:06:47.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:47.597+0000 7f020faf2700 1 -- 172.21.15.82:0/1353902871 shutdown_connections 2024-03-04T09:06:47.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:47.597+0000 7f020faf2700 1 --2- 172.21.15.82:0/1353902871 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f01f4038c40 0x7f01f403b100 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:47.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:47.597+0000 7f020faf2700 1 --2- 172.21.15.82:0/1353902871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0208107aa0 0x7f02081975d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:47.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:47.597+0000 7f020faf2700 1 -- 172.21.15.82:0/1353902871 >> 172.21.15.82:0/1353902871 conn(0x7f02080fd5d0 msgr2=0x7f0208109670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:06:47.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:47.597+0000 7f020faf2700 1 -- 172.21.15.82:0/1353902871 shutdown_connections 2024-03-04T09:06:47.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:47.597+0000 7f020faf2700 1 -- 172.21.15.82:0/1353902871 wait complete. 2024-03-04T09:06:47.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:47 smithi082 ceph-mon[32880]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:06:48.212 INFO:tasks.cephadm:Setting crush tunables to default 2024-03-04T09:06:48.213 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph osd crush tunables default 2024-03-04T09:06:48.446 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:06:48.762 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:48 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:48.762 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:48 smithi082 ceph-mon[32880]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T09:06:48.762 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:48 smithi082 ceph-mon[32880]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:06:49.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:49.950+0000 7f1fce209700 1 -- 172.21.15.82:0/2469247119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fc8102c60 msgr2=0x7f1fc8103040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:49.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:49.950+0000 7f1fce209700 1 --2- 172.21.15.82:0/2469247119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fc8102c60 0x7f1fc8103040 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1fb8009910 tx=0x7f1fb8009c20 comp rx=0 tx=0).stop 2024-03-04T09:06:49.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:49.950+0000 7f1fce209700 1 -- 172.21.15.82:0/2469247119 shutdown_connections 2024-03-04T09:06:49.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:49.950+0000 7f1fce209700 1 --2- 172.21.15.82:0/2469247119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fc8102c60 0x7f1fc8103040 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:49.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:49.950+0000 7f1fce209700 1 -- 172.21.15.82:0/2469247119 >> 172.21.15.82:0/2469247119 conn(0x7f1fc80fc4b0 msgr2=0x7f1fc80fe8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:06:49.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:49.950+0000 7f1fce209700 1 -- 172.21.15.82:0/2469247119 shutdown_connections 2024-03-04T09:06:49.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:49.950+0000 7f1fce209700 1 -- 172.21.15.82:0/2469247119 wait complete. 2024-03-04T09:06:49.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:49.950+0000 7f1fce209700 1 Processor -- start 2024-03-04T09:06:49.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:49.951+0000 7f1fce209700 1 -- start start 2024-03-04T09:06:49.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:49.951+0000 7f1fce209700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fc8102c60 0x7f1fc8197650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:06:49.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:49.951+0000 7f1fce209700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc810c140 con 0x7f1fc8102c60 2024-03-04T09:06:49.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:49.951+0000 7f1fc77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fc8102c60 0x7f1fc8197650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:06:49.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:49.951+0000 7f1fc77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fc8102c60 0x7f1fc8197650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56700/0 (socket says 172.21.15.82:56700) 2024-03-04T09:06:49.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:49.951+0000 7f1fc77fe700 1 -- 172.21.15.82:0/3429687559 learned_addr learned my addr 172.21.15.82:0/3429687559 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:06:49.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:49.951+0000 7f1fc77fe700 1 -- 172.21.15.82:0/3429687559 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc8197b90 con 0x7f1fc8102c60 2024-03-04T09:06:49.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:49.951+0000 7f1fc77fe700 1 --2- 172.21.15.82:0/3429687559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fc8102c60 0x7f1fc8197650 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1fb8006010 tx=0x7f1fb8005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:06:49.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:49.951+0000 7f1fc4ff9700 1 -- 172.21.15.82:0/3429687559 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1fb8027070 con 0x7f1fc8102c60 2024-03-04T09:06:49.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:49.951+0000 7f1fc4ff9700 1 -- 172.21.15.82:0/3429687559 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f1fb800be30 con 0x7f1fc8102c60 2024-03-04T09:06:49.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:49.951+0000 7f1fce209700 1 -- 172.21.15.82:0/3429687559 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fc8197e20 con 0x7f1fc8102c60 2024-03-04T09:06:49.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:49.951+0000 7f1fc4ff9700 1 -- 172.21.15.82:0/3429687559 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1fb8022e10 con 0x7f1fc8102c60 2024-03-04T09:06:49.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:49.952+0000 7f1fce209700 1 -- 172.21.15.82:0/3429687559 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fc8198280 con 0x7f1fc8102c60 2024-03-04T09:06:49.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:49.952+0000 7f1fc4ff9700 1 -- 172.21.15.82:0/3429687559 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 45984+0+0 (secure 0 0 0) 0x7f1fb802a070 con 0x7f1fc8102c60 2024-03-04T09:06:49.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:49.952+0000 7f1fce209700 1 -- 172.21.15.82:0/3429687559 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fc806a820 con 0x7f1fc8102c60 2024-03-04T09:06:49.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:49.953+0000 7f1fc4ff9700 1 --2- 172.21.15.82:0/3429687559 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f1fb0038c40 0x7f1fb003b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:06:49.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:49.953+0000 7f1fc4ff9700 1 -- 172.21.15.82:0/3429687559 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f1fb801e030 con 0x7f1fc8102c60 2024-03-04T09:06:49.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:49.953+0000 7f1fc6ffd700 1 --2- 172.21.15.82:0/3429687559 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f1fb0038c40 0x7f1fb003b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:06:49.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:49.953+0000 7f1fc6ffd700 1 --2- 172.21.15.82:0/3429687559 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f1fb0038c40 0x7f1fb003b100 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc006fd0 tx=0x7f1fbc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:06:49.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:49.958+0000 7f1fc4ff9700 1 -- 172.21.15.82:0/3429687559 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f1fb8013070 con 0x7f1fc8102c60 2024-03-04T09:06:50.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:50.158+0000 7f1fce209700 1 -- 172.21.15.82:0/3429687559 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f1fc81989b0 con 0x7f1fc8102c60 2024-03-04T09:06:50.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:50.209+0000 7f1fc4ff9700 1 -- 172.21.15.82:0/3429687559 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f1fb8022470 con 0x7f1fc8102c60 2024-03-04T09:06:50.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:50.211+0000 7f1fce209700 1 -- 172.21.15.82:0/3429687559 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f1fb0038c40 msgr2=0x7f1fb003b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:50.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:50.211+0000 7f1fce209700 1 --2- 172.21.15.82:0/3429687559 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f1fb0038c40 0x7f1fb003b100 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc006fd0 tx=0x7f1fbc006e40 comp rx=0 tx=0).stop 2024-03-04T09:06:50.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:50.211+0000 7f1fce209700 1 -- 172.21.15.82:0/3429687559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fc8102c60 msgr2=0x7f1fc8197650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:50.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:50.211+0000 7f1fce209700 1 --2- 172.21.15.82:0/3429687559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fc8102c60 0x7f1fc8197650 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1fb8006010 tx=0x7f1fb8005810 comp rx=0 tx=0).stop 2024-03-04T09:06:50.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:50.211+0000 7f1fce209700 1 -- 172.21.15.82:0/3429687559 shutdown_connections 2024-03-04T09:06:50.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:50.211+0000 7f1fce209700 1 --2- 172.21.15.82:0/3429687559 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f1fb0038c40 0x7f1fb003b100 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:50.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:50.211+0000 7f1fce209700 1 --2- 172.21.15.82:0/3429687559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fc8102c60 0x7f1fc8197650 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:50.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:50.211+0000 7f1fce209700 1 -- 172.21.15.82:0/3429687559 >> 172.21.15.82:0/3429687559 conn(0x7f1fc80fc4b0 msgr2=0x7f1fc81039f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:06:50.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:50.211+0000 7f1fce209700 1 -- 172.21.15.82:0/3429687559 shutdown_connections 2024-03-04T09:06:50.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:06:50.211+0000 7f1fce209700 1 -- 172.21.15.82:0/3429687559 wait complete. 2024-03-04T09:06:50.208 INFO:teuthology.orchestra.run.smithi082.stderr:adjusted tunables profile to default 2024-03-04T09:06:50.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:50 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/3429687559' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-03-04T09:06:50.872 INFO:tasks.cephadm:Adding mon.a on smithi082 2024-03-04T09:06:50.872 INFO:tasks.cephadm:Adding mon.b on smithi102 2024-03-04T09:06:50.872 INFO:tasks.cephadm:Adding mon.c on smithi190 2024-03-04T09:06:50.873 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph orch apply mon '3;smithi082:172.21.15.82=a;smithi102:172.21.15.102=b;smithi190:172.21.15.190=c' 2024-03-04T09:06:51.112 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T09:06:51.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:51 smithi082 ceph-mon[32880]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:06:51.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:51 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/3429687559' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-03-04T09:06:51.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:51 smithi082 ceph-mon[32880]: osdmap e4: 0 total, 0 up, 0 in 2024-03-04T09:06:51.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:51 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:51.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:51 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:51.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:51 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:51.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:51 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:51.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:51 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi190", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:06:51.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:51 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:06:51.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:51 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:06:52.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:52 smithi082 ceph-mon[32880]: Updating smithi190:/etc/ceph/ceph.conf 2024-03-04T09:06:52.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:52 smithi082 ceph-mon[32880]: Updating smithi190:/var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T09:06:52.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:52 smithi082 ceph-mon[32880]: Updating smithi190:/etc/ceph/ceph.client.admin.keyring 2024-03-04T09:06:52.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:52 smithi082 ceph-mon[32880]: Updating smithi190:/var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/config/ceph.client.admin.keyring 2024-03-04T09:06:52.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:52 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:52.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:52 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:52.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:52 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:52.582 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:52.584+0000 7fbb400ef700 1 -- 172.21.15.190:0/2316600236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb38100a40 msgr2=0x7fbb38100e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:52.582 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:52.584+0000 7fbb400ef700 1 --2- 172.21.15.190:0/2316600236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb38100a40 0x7fbb38100e20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbb34009910 tx=0x7fbb34009c20 comp rx=0 tx=0).stop 2024-03-04T09:06:52.582 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:52.585+0000 7fbb400ef700 1 -- 172.21.15.190:0/2316600236 shutdown_connections 2024-03-04T09:06:52.583 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:52.585+0000 7fbb400ef700 1 --2- 172.21.15.190:0/2316600236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb38100a40 0x7fbb38100e20 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:52.583 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:52.585+0000 7fbb400ef700 1 -- 172.21.15.190:0/2316600236 >> 172.21.15.190:0/2316600236 conn(0x7fbb38077600 msgr2=0x7fbb380fe8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:06:52.583 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:52.585+0000 7fbb400ef700 1 -- 172.21.15.190:0/2316600236 shutdown_connections 2024-03-04T09:06:52.583 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:52.585+0000 7fbb400ef700 1 -- 172.21.15.190:0/2316600236 wait complete. 2024-03-04T09:06:52.583 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:52.585+0000 7fbb400ef700 1 Processor -- start 2024-03-04T09:06:52.583 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:52.585+0000 7fbb400ef700 1 -- start start 2024-03-04T09:06:52.583 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:52.585+0000 7fbb400ef700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb38100a40 0x7fbb381a3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:06:52.583 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:52.585+0000 7fbb400ef700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb38112730 con 0x7fbb38100a40 2024-03-04T09:06:52.583 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:52.586+0000 7fbb3de8b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb38100a40 0x7fbb381a3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:06:52.583 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:52.586+0000 7fbb3de8b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb38100a40 0x7fbb381a3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.190:54182/0 (socket says 172.21.15.190:54182) 2024-03-04T09:06:52.583 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:52.586+0000 7fbb3de8b700 1 -- 172.21.15.190:0/2451128184 learned_addr learned my addr 172.21.15.190:0/2451128184 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-03-04T09:06:52.583 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:52.586+0000 7fbb3de8b700 1 -- 172.21.15.190:0/2451128184 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb381a3dc0 con 0x7fbb38100a40 2024-03-04T09:06:52.584 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:52.586+0000 7fbb3de8b700 1 --2- 172.21.15.190:0/2451128184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb38100a40 0x7fbb381a3880 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbb34006010 tx=0x7fbb34005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:06:52.584 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:52.586+0000 7fbb2effd700 1 -- 172.21.15.190:0/2451128184 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbb34027070 con 0x7fbb38100a40 2024-03-04T09:06:52.584 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:52.586+0000 7fbb400ef700 1 -- 172.21.15.190:0/2451128184 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb381a4050 con 0x7fbb38100a40 2024-03-04T09:06:52.584 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:52.586+0000 7fbb2effd700 1 -- 172.21.15.190:0/2451128184 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fbb3400be30 con 0x7fbb38100a40 2024-03-04T09:06:52.584 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:52.586+0000 7fbb2effd700 1 -- 172.21.15.190:0/2451128184 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbb34022e10 con 0x7fbb38100a40 2024-03-04T09:06:52.584 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:52.586+0000 7fbb400ef700 1 -- 172.21.15.190:0/2451128184 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb3819da40 con 0x7fbb38100a40 2024-03-04T09:06:52.585 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:52.587+0000 7fbb400ef700 1 -- 172.21.15.190:0/2451128184 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb38069d90 con 0x7fbb38100a40 2024-03-04T09:06:52.585 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:52.587+0000 7fbb2effd700 1 -- 172.21.15.190:0/2451128184 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 45984+0+0 (secure 0 0 0) 0x7fbb3402a070 con 0x7fbb38100a40 2024-03-04T09:06:52.585 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:52.587+0000 7fbb2effd700 1 --2- 172.21.15.190:0/2451128184 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fbb24038bf0 0x7fbb2403b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:06:52.585 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:52.587+0000 7fbb2effd700 1 -- 172.21.15.190:0/2451128184 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fbb3401e030 con 0x7fbb38100a40 2024-03-04T09:06:52.585 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:52.588+0000 7fbb3d68a700 1 --2- 172.21.15.190:0/2451128184 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fbb24038bf0 0x7fbb2403b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:06:52.585 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:52.588+0000 7fbb3d68a700 1 --2- 172.21.15.190:0/2451128184 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fbb24038bf0 0x7fbb2403b0b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fbb28006fd0 tx=0x7fbb28006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:06:52.588 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:52.592+0000 7fbb2effd700 1 -- 172.21.15.190:0/2451128184 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fbb34013070 con 0x7fbb38100a40 2024-03-04T09:06:52.797 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:52.801+0000 7fbb400ef700 1 -- 172.21.15.190:0/2451128184 --> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi082:172.21.15.82=a;smithi102:172.21.15.102=b;smithi190:172.21.15.190=c", "target": ["mon-mgr", ""]}) v1 -- 0x7fbb3819ef70 con 0x7fbb24038bf0 2024-03-04T09:06:52.803 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:52.808+0000 7fbb2effd700 1 -- 172.21.15.190:0/2451128184 <== mgr.14152 v2:172.21.15.82:6800/1278635224 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fbb3819ef70 con 0x7fbb24038bf0 2024-03-04T09:06:52.804 INFO:teuthology.orchestra.run.smithi190.stdout:Scheduled mon update... 2024-03-04T09:06:52.806 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:52.810+0000 7fbb400ef700 1 -- 172.21.15.190:0/2451128184 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fbb24038bf0 msgr2=0x7fbb2403b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:52.806 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:52.810+0000 7fbb400ef700 1 --2- 172.21.15.190:0/2451128184 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fbb24038bf0 0x7fbb2403b0b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fbb28006fd0 tx=0x7fbb28006e40 comp rx=0 tx=0).stop 2024-03-04T09:06:52.806 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:52.810+0000 7fbb400ef700 1 -- 172.21.15.190:0/2451128184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb38100a40 msgr2=0x7fbb381a3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:52.806 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:52.810+0000 7fbb400ef700 1 --2- 172.21.15.190:0/2451128184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb38100a40 0x7fbb381a3880 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbb34006010 tx=0x7fbb34005810 comp rx=0 tx=0).stop 2024-03-04T09:06:52.806 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:52.810+0000 7fbb400ef700 1 -- 172.21.15.190:0/2451128184 shutdown_connections 2024-03-04T09:06:52.806 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:52.810+0000 7fbb400ef700 1 --2- 172.21.15.190:0/2451128184 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fbb24038bf0 0x7fbb2403b0b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:52.806 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:52.810+0000 7fbb400ef700 1 --2- 172.21.15.190:0/2451128184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb38100a40 0x7fbb381a3880 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:52.806 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:52.810+0000 7fbb400ef700 1 -- 172.21.15.190:0/2451128184 >> 172.21.15.190:0/2451128184 conn(0x7fbb38077600 msgr2=0x7fbb380fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:06:52.807 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:52.810+0000 7fbb400ef700 1 -- 172.21.15.190:0/2451128184 shutdown_connections 2024-03-04T09:06:52.807 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:52.810+0000 7fbb400ef700 1 -- 172.21.15.190:0/2451128184 wait complete. 2024-03-04T09:06:53.394 DEBUG:teuthology.orchestra.run.smithi102:mon.b> sudo journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mon.b.service 2024-03-04T09:06:53.397 DEBUG:teuthology.orchestra.run.smithi190:mon.c> sudo journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mon.c.service 2024-03-04T09:06:53.399 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-03-04T09:06:53.399 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph mon dump -f json 2024-03-04T09:06:53.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:53 smithi082 ceph-mon[32880]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:06:53.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:53 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:53.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:53 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:06:53.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:53 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:06:53.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:53 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:06:53.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:53 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:53.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:53 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-04T09:06:53.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:53 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:06:54.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:54 smithi082 ceph-mon[32880]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi082:172.21.15.82=a;smithi102:172.21.15.102=b;smithi190:172.21.15.190=c", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:06:54.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:54 smithi082 ceph-mon[32880]: Saving service mon spec with placement smithi082:172.21.15.82=a;smithi102:172.21.15.102=b;smithi190:172.21.15.190=c;count:3 2024-03-04T09:06:54.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:54 smithi082 ceph-mon[32880]: Deploying daemon mon.c on smithi190 2024-03-04T09:06:55.036 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T09:06:55.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:55 smithi082 ceph-mon[32880]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:06:57.210 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:57.211+0000 7f57b9a7d700 1 -- 172.21.15.190:0/1134694635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57b4102cb0 msgr2=0x7f57b4103090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:57.210 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:57.211+0000 7f57b9a7d700 1 --2- 172.21.15.190:0/1134694635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57b4102cb0 0x7f57b4103090 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f57a8009910 tx=0x7f57a8009c20 comp rx=0 tx=0).stop 2024-03-04T09:06:57.210 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:57.211+0000 7f57b9a7d700 1 -- 172.21.15.190:0/1134694635 shutdown_connections 2024-03-04T09:06:57.210 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:57.211+0000 7f57b9a7d700 1 --2- 172.21.15.190:0/1134694635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57b4102cb0 0x7f57b4103090 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:57.210 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:57.211+0000 7f57b9a7d700 1 -- 172.21.15.190:0/1134694635 >> 172.21.15.190:0/1134694635 conn(0x7f57b4077600 msgr2=0x7f57b40fe8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:06:57.210 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:57.211+0000 7f57b9a7d700 1 -- 172.21.15.190:0/1134694635 shutdown_connections 2024-03-04T09:06:57.210 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:57.211+0000 7f57b9a7d700 1 -- 172.21.15.190:0/1134694635 wait complete. 2024-03-04T09:06:57.210 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:57.212+0000 7f57b9a7d700 1 Processor -- start 2024-03-04T09:06:57.211 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:57.212+0000 7f57b9a7d700 1 -- start start 2024-03-04T09:06:57.211 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:57.212+0000 7f57b9a7d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57b4102cb0 0x7f57b4100910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:06:57.211 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:57.212+0000 7f57b9a7d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b410c120 con 0x7f57b4102cb0 2024-03-04T09:06:57.211 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:57.213+0000 7f57b37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57b4102cb0 0x7f57b4100910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:06:57.211 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:57.213+0000 7f57b37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57b4102cb0 0x7f57b4100910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.190:54200/0 (socket says 172.21.15.190:54200) 2024-03-04T09:06:57.211 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:57.213+0000 7f57b37fe700 1 -- 172.21.15.190:0/3685291128 learned_addr learned my addr 172.21.15.190:0/3685291128 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-03-04T09:06:57.211 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:57.213+0000 7f57b37fe700 1 -- 172.21.15.190:0/3685291128 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b4102800 con 0x7f57b4102cb0 2024-03-04T09:06:57.211 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:57.213+0000 7f57b37fe700 1 --2- 172.21.15.190:0/3685291128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57b4102cb0 0x7f57b4100910 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f57a8006010 tx=0x7f57a8005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:06:57.211 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:57.214+0000 7f57b0ff9700 1 -- 172.21.15.190:0/3685291128 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f57a8027070 con 0x7f57b4102cb0 2024-03-04T09:06:57.211 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:57.214+0000 7f57b9a7d700 1 -- 172.21.15.190:0/3685291128 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57b4100e50 con 0x7f57b4102cb0 2024-03-04T09:06:57.211 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:57.214+0000 7f57b0ff9700 1 -- 172.21.15.190:0/3685291128 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f57a800be30 con 0x7f57b4102cb0 2024-03-04T09:06:57.211 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:57.214+0000 7f57b0ff9700 1 -- 172.21.15.190:0/3685291128 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f57a8022e10 con 0x7f57b4102cb0 2024-03-04T09:06:57.211 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:57.214+0000 7f57b9a7d700 1 -- 172.21.15.190:0/3685291128 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57b4101310 con 0x7f57b4102cb0 2024-03-04T09:06:57.212 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:57.215+0000 7f57b0ff9700 1 -- 172.21.15.190:0/3685291128 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 45984+0+0 (secure 0 0 0) 0x7f57a802a070 con 0x7f57b4102cb0 2024-03-04T09:06:57.212 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:57.215+0000 7f57b0ff9700 1 --2- 172.21.15.190:0/3685291128 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f579c038bf0 0x7f579c03b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:06:57.212 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:57.215+0000 7f57b0ff9700 1 -- 172.21.15.190:0/3685291128 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f57a801e030 con 0x7f57b4102cb0 2024-03-04T09:06:57.213 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:57.215+0000 7f57b9a7d700 1 -- 172.21.15.190:0/3685291128 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57b4069d30 con 0x7f57b4102cb0 2024-03-04T09:06:57.213 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:57.215+0000 7f57b2ffd700 1 --2- 172.21.15.190:0/3685291128 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f579c038bf0 0x7f579c03b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:06:57.213 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:57.216+0000 7f57b2ffd700 1 --2- 172.21.15.190:0/3685291128 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f579c038bf0 0x7f579c03b0b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f57a4006fd0 tx=0x7f57a4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:06:57.216 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:57.220+0000 7f57b0ff9700 1 -- 172.21.15.190:0/3685291128 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f57a8013070 con 0x7f57b4102cb0 2024-03-04T09:06:57.518 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:57.521+0000 7f57b9a7d700 1 -- 172.21.15.190:0/3685291128 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f57b4101e40 con 0x7f57b4102cb0 2024-03-04T09:06:57.518 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:57.521+0000 7f57b0ff9700 1 -- 172.21.15.190:0/3685291128 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+745 (secure 0 0 0) 0x7f57a8013250 con 0x7f57b4102cb0 2024-03-04T09:06:57.518 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-03-04T09:06:57.518 INFO:teuthology.orchestra.run.smithi190.stdout:{"epoch":1,"fsid":"2e533fc8-da06-11ee-95c6-87774f69a715","modified":"2024-03-04T09:05:13.118894Z","created":"2024-03-04T09:05:13.118894Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-04T09:06:57.520 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:57.523+0000 7f57b9a7d700 1 -- 172.21.15.190:0/3685291128 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f579c038bf0 msgr2=0x7f579c03b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:57.520 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:57.523+0000 7f57b9a7d700 1 --2- 172.21.15.190:0/3685291128 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f579c038bf0 0x7f579c03b0b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f57a4006fd0 tx=0x7f57a4006e40 comp rx=0 tx=0).stop 2024-03-04T09:06:57.520 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:57.523+0000 7f57b9a7d700 1 -- 172.21.15.190:0/3685291128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57b4102cb0 msgr2=0x7f57b4100910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:06:57.520 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:57.523+0000 7f57b9a7d700 1 --2- 172.21.15.190:0/3685291128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57b4102cb0 0x7f57b4100910 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f57a8006010 tx=0x7f57a8005810 comp rx=0 tx=0).stop 2024-03-04T09:06:57.520 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:57.524+0000 7f57b9a7d700 1 -- 172.21.15.190:0/3685291128 shutdown_connections 2024-03-04T09:06:57.520 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:57.524+0000 7f57b9a7d700 1 --2- 172.21.15.190:0/3685291128 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f579c038bf0 0x7f579c03b0b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:57.520 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:57.524+0000 7f57b9a7d700 1 --2- 172.21.15.190:0/3685291128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57b4102cb0 0x7f57b4100910 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:06:57.520 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:57.524+0000 7f57b9a7d700 1 -- 172.21.15.190:0/3685291128 >> 172.21.15.190:0/3685291128 conn(0x7f57b4077600 msgr2=0x7f57b4103a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:06:57.520 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:57.524+0000 7f57b9a7d700 1 -- 172.21.15.190:0/3685291128 shutdown_connections 2024-03-04T09:06:57.520 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:06:57.524+0000 7f57b9a7d700 1 -- 172.21.15.190:0/3685291128 wait complete. 2024-03-04T09:06:57.521 INFO:teuthology.orchestra.run.smithi190.stderr:dumped monmap epoch 1 2024-03-04T09:06:57.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:06:57 smithi082 ceph-mon[32880]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:06:57.611 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: mon.c@-1(synchronizing).mds e1 print_map 2024-03-04T09:06:57.611 INFO:journalctl@ceph.mon.c.smithi190.stdout: e1 2024-03-04T09:06:57.611 INFO:journalctl@ceph.mon.c.smithi190.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-03-04T09:06:57.611 INFO:journalctl@ceph.mon.c.smithi190.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-03-04T09:06:57.611 INFO:journalctl@ceph.mon.c.smithi190.stdout: legacy client fscid: -1 2024-03-04T09:06:57.611 INFO:journalctl@ceph.mon.c.smithi190.stdout: 2024-03-04T09:06:57.612 INFO:journalctl@ceph.mon.c.smithi190.stdout: No filesystems configured 2024-03-04T09:06:57.612 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-03-04T09:06:57.612 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-03-04T09:06:57.612 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-03-04T09:06:57.612 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-03-04T09:06:57.612 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-03-04T09:06:57.612 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-03-04T09:06:57.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-03-04T09:06:57.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-03-04T09:06:57.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-03-04T09:06:57.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-03-04T09:06:57.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: Added host smithi102 2024-03-04T09:06:57.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:57.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:57.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:06:57.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:57.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T09:06:57.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:06:57.922 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:06:57.922 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:57.922 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:57.922 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:57.922 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:57.922 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi102", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:06:57.922 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:06:57.922 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:06:57.922 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi190", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:06:57.922 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: Updating smithi102:/etc/ceph/ceph.conf 2024-03-04T09:06:57.922 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: Updating smithi102:/var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T09:06:57.923 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: Updating smithi102:/etc/ceph/ceph.client.admin.keyring 2024-03-04T09:06:57.923 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: Deploying cephadm binary to smithi190 2024-03-04T09:06:57.923 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: Updating smithi102:/var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/config/ceph.client.admin.keyring 2024-03-04T09:06:57.923 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:57.923 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:57.923 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:57.923 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:06:57.923 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:06:57.923 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:57.923 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:06:57.923 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: Added host smithi190 2024-03-04T09:06:57.923 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:57.923 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:57.923 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:06:57.924 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:57.924 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T09:06:57.924 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:06:57.924 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/3429687559' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-03-04T09:06:57.924 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:06:57.924 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/3429687559' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-03-04T09:06:57.924 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: osdmap e4: 0 total, 0 up, 0 in 2024-03-04T09:06:57.924 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:57.924 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:57.925 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:57.925 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:57.925 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi190", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:06:57.925 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:06:57.925 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:06:57.925 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: Updating smithi190:/etc/ceph/ceph.conf 2024-03-04T09:06:57.925 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: Updating smithi190:/var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T09:06:57.925 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: Updating smithi190:/etc/ceph/ceph.client.admin.keyring 2024-03-04T09:06:57.925 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: Updating smithi190:/var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/config/ceph.client.admin.keyring 2024-03-04T09:06:57.925 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:57.925 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:57.926 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:57.926 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:06:57.926 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:57.926 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:06:57.926 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:06:57.926 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:06:57.926 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:06:57.926 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-04T09:06:57.926 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:06:57.926 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi082:172.21.15.82=a;smithi102:172.21.15.102=b;smithi190:172.21.15.190=c", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:06:57.926 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: Saving service mon spec with placement smithi082:172.21.15.82=a;smithi102:172.21.15.102=b;smithi190:172.21.15.190=c;count:3 2024-03-04T09:06:57.926 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: Deploying daemon mon.c on smithi190 2024-03-04T09:06:57.926 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:06:57.927 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:06:57.927 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 ceph-mon[36341]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-03-04T09:06:57.927 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 bash[36307]: 2d0032eabe8cf09c7b4b60007aec1ac1b6c04aa723d6b762472e9803b02c2116 2024-03-04T09:06:57.927 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:06:57 smithi190 systemd[1]: Started Ceph mon.c for 2e533fc8-da06-11ee-95c6-87774f69a715. 2024-03-04T09:06:59.222 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-03-04T09:06:59.223 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph mon dump -f json 2024-03-04T09:06:59.469 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.c/config 2024-03-04T09:07:03.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:02 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T09:07:03.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:02 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T09:07:03.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:02 smithi082 ceph-mon[32880]: mon.a calling monitor election 2024-03-04T09:07:03.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:02 smithi082 ceph-mon[32880]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:03.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:02 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T09:07:03.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:02 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T09:07:03.068 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:02 smithi082 ceph-mon[32880]: mon.c calling monitor election 2024-03-04T09:07:03.068 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:02 smithi082 ceph-mon[32880]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:03.068 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:02 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T09:07:03.068 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:02 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T09:07:03.068 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:02 smithi082 ceph-mon[32880]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:03.068 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:02 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T09:07:03.068 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:02 smithi082 ceph-mon[32880]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-03-04T09:07:03.068 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:02 smithi082 ceph-mon[32880]: monmap e2: 2 mons at {a=[v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0],c=[v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-04T09:07:03.068 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:02 smithi082 ceph-mon[32880]: fsmap 2024-03-04T09:07:03.068 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:02 smithi082 ceph-mon[32880]: osdmap e4: 0 total, 0 up, 0 in 2024-03-04T09:07:03.068 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:02 smithi082 ceph-mon[32880]: mgrmap e13: x(active, since 50s) 2024-03-04T09:07:03.068 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:02 smithi082 ceph-mon[32880]: overall HEALTH_OK 2024-03-04T09:07:03.068 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:02 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:03.069 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:02 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:03.069 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:02 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:03.170 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:02 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T09:07:03.170 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:02 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T09:07:03.170 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:02 smithi190 ceph-mon[36341]: mon.a calling monitor election 2024-03-04T09:07:03.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:02 smithi190 ceph-mon[36341]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:03.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:02 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T09:07:03.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:02 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T09:07:03.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:02 smithi190 ceph-mon[36341]: mon.c calling monitor election 2024-03-04T09:07:03.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:02 smithi190 ceph-mon[36341]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:03.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:02 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T09:07:03.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:02 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T09:07:03.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:02 smithi190 ceph-mon[36341]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:03.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:02 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T09:07:03.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:02 smithi190 ceph-mon[36341]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-03-04T09:07:03.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:02 smithi190 ceph-mon[36341]: monmap e2: 2 mons at {a=[v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0],c=[v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-04T09:07:03.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:02 smithi190 ceph-mon[36341]: fsmap 2024-03-04T09:07:03.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:02 smithi190 ceph-mon[36341]: osdmap e4: 0 total, 0 up, 0 in 2024-03-04T09:07:03.172 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:02 smithi190 ceph-mon[36341]: mgrmap e13: x(active, since 50s) 2024-03-04T09:07:03.172 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:02 smithi190 ceph-mon[36341]: overall HEALTH_OK 2024-03-04T09:07:03.172 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:02 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:03.172 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:02 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:03.172 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:02 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:04.063 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:04.066+0000 7f3bfea5a700 1 -- 172.21.15.190:0/710821705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3be00035c0 msgr2=0x7f3be0005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:07:04.063 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:04.066+0000 7f3bfea5a700 1 --2- 172.21.15.190:0/710821705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3be00035c0 0x7f3be0005a50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8074390 tx=0x7f3be800feb0 comp rx=0 tx=0).stop 2024-03-04T09:07:04.063 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:04.066+0000 7f3bfea5a700 1 -- 172.21.15.190:0/710821705 shutdown_connections 2024-03-04T09:07:04.063 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:04.066+0000 7f3bfea5a700 1 --2- 172.21.15.190:0/710821705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3be00035c0 0x7f3be0005a50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:07:04.063 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:04.066+0000 7f3bfea5a700 1 -- 172.21.15.190:0/710821705 >> 172.21.15.190:0/710821705 conn(0x7f3bf80fd650 msgr2=0x7f3bf80ffa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:07:04.063 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:04.066+0000 7f3bfea5a700 1 -- 172.21.15.190:0/710821705 shutdown_connections 2024-03-04T09:07:04.064 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:04.066+0000 7f3bfea5a700 1 -- 172.21.15.190:0/710821705 wait complete. 2024-03-04T09:07:04.064 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:03 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-04T09:07:04.064 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:03 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:07:04.064 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:03 smithi190 ceph-mon[36341]: Deploying daemon mon.b on smithi102 2024-03-04T09:07:04.064 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:03 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T09:07:04.067 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:04.067+0000 7f3bfea5a700 1 Processor -- start 2024-03-04T09:07:04.068 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:04.067+0000 7f3bfea5a700 1 -- start start 2024-03-04T09:07:04.068 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:04.068+0000 7f3bfea5a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3be00035c0 0x7f3bf819ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:07:04.068 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:04.068+0000 7f3bfea5a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bf819e300 0x7f3bf81a2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:07:04.068 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:04.068+0000 7f3bfea5a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf8110240 con 0x7f3bf819e300 2024-03-04T09:07:04.068 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:04.068+0000 7f3bfea5a700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf81100c0 con 0x7f3be00035c0 2024-03-04T09:07:04.068 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:04.068+0000 7f3bf7fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3be00035c0 0x7f3bf819ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:07:04.068 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:04.068+0000 7f3bf7fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3be00035c0 0x7f3bf819ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:42992/0 (socket says 172.21.15.190:42992) 2024-03-04T09:07:04.068 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:04.068+0000 7f3bf7fff700 1 -- 172.21.15.190:0/1924394315 learned_addr learned my addr 172.21.15.190:0/1924394315 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-03-04T09:07:04.068 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:04.068+0000 7f3bf7fff700 1 -- 172.21.15.190:0/1924394315 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3be00035c0 msgr2=0x7f3bf819ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-03-04T09:07:04.069 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:04.068+0000 7f3bf7fff700 1 -- 172.21.15.190:0/1924394315 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3be00035c0 msgr2=0x7f3bf819ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-04T09:07:04.069 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:04.068+0000 7f3bf7fff700 1 --2- 172.21.15.190:0/1924394315 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3be00035c0 0x7f3bf819ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-04T09:07:04.069 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:04.068+0000 7f3bf7fff700 1 --2- 172.21.15.190:0/1924394315 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3be00035c0 0x7f3bf819ddc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-04T09:07:04.069 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:04.068+0000 7f3bf77fe700 1 --2- 172.21.15.190:0/1924394315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bf819e300 0x7f3bf81a2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:07:04.069 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:04.069+0000 7f3bf77fe700 1 -- 172.21.15.190:0/1924394315 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3be00035c0 msgr2=0x7f3bf819ddc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-04T09:07:04.069 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:04.069+0000 7f3bf77fe700 1 --2- 172.21.15.190:0/1924394315 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3be00035c0 0x7f3bf819ddc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:07:04.069 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:04.069+0000 7f3bf77fe700 1 -- 172.21.15.190:0/1924394315 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf819e940 con 0x7f3bf819e300 2024-03-04T09:07:04.069 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:04.069+0000 7f3bf77fe700 1 --2- 172.21.15.190:0/1924394315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bf819e300 0x7f3bf81a2690 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3bec00b4d0 tx=0x7f3bec00b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:07:04.069 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:04.069+0000 7f3bf57fa700 1 -- 172.21.15.190:0/1924394315 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f3bec011630 con 0x7f3bf819e300 2024-03-04T09:07:04.070 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:04.069+0000 7f3bfea5a700 1 -- 172.21.15.190:0/1924394315 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bf81a2bd0 con 0x7f3bf819e300 2024-03-04T09:07:04.070 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:04.069+0000 7f3bf57fa700 1 -- 172.21.15.190:0/1924394315 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f3bec011ca0 con 0x7f3bf819e300 2024-03-04T09:07:04.070 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:04.069+0000 7f3bf57fa700 1 -- 172.21.15.190:0/1924394315 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f3bec010dd0 con 0x7f3bf819e300 2024-03-04T09:07:04.070 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:04.069+0000 7f3bfea5a700 1 -- 172.21.15.190:0/1924394315 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bf81a3130 con 0x7f3bf819e300 2024-03-04T09:07:04.070 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:04.070+0000 7f3bf57fa700 1 -- 172.21.15.190:0/1924394315 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 45984+0+0 (secure 0 0 0) 0x7f3bec018020 con 0x7f3bf819e300 2024-03-04T09:07:04.070 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:04.070+0000 7f3bfea5a700 1 -- 172.21.15.190:0/1924394315 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bf8075ba0 con 0x7f3bf819e300 2024-03-04T09:07:04.070 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:04.071+0000 7f3bf57fa700 1 --2- 172.21.15.190:0/1924394315 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f3be4038990 0x7f3be403ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:07:04.070 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:04.071+0000 7f3bf57fa700 1 -- 172.21.15.190:0/1924394315 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f3bec04b580 con 0x7f3bf819e300 2024-03-04T09:07:04.071 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:04.071+0000 7f3bf7fff700 1 --2- 172.21.15.190:0/1924394315 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f3be4038990 0x7f3be403ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:07:04.071 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:04.071+0000 7f3bf7fff700 1 --2- 172.21.15.190:0/1924394315 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f3be4038990 0x7f3be403ae50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3be800fa60 tx=0x7f3be8005a90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:07:04.071 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:03 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-04T09:07:04.072 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:03 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:07:04.072 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:03 smithi082 ceph-mon[32880]: Deploying daemon mon.b on smithi102 2024-03-04T09:07:04.072 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:03 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T09:07:04.072 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:04.076+0000 7f3bf57fa700 1 -- 172.21.15.190:0/1924394315 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f3bec01f020 con 0x7f3bf819e300 2024-03-04T09:07:04.358 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:04.362+0000 7f3bfea5a700 1 -- 172.21.15.190:0/1924394315 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f3bf81a3440 con 0x7f3bf819e300 2024-03-04T09:07:04.358 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:04.362+0000 7f3bf57fa700 1 -- 172.21.15.190:0/1924394315 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1015 (secure 0 0 0) 0x7f3bec018310 con 0x7f3bf819e300 2024-03-04T09:07:04.358 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-03-04T09:07:04.359 INFO:teuthology.orchestra.run.smithi190.stdout:{"epoch":2,"fsid":"2e533fc8-da06-11ee-95c6-87774f69a715","modified":"2024-03-04T09:06:57.620973Z","created":"2024-03-04T09:05:13.118894Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:3300","nonce":0},{"type":"v1","addr":"172.21.15.190:6789","nonce":0}]},"addr":"172.21.15.190:6789/0","public_addr":"172.21.15.190:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-03-04T09:07:04.361 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:04.365+0000 7f3bfea5a700 1 -- 172.21.15.190:0/1924394315 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f3be4038990 msgr2=0x7f3be403ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:07:04.361 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:04.365+0000 7f3bfea5a700 1 --2- 172.21.15.190:0/1924394315 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f3be4038990 0x7f3be403ae50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3be800fa60 tx=0x7f3be8005a90 comp rx=0 tx=0).stop 2024-03-04T09:07:04.361 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:04.365+0000 7f3bfea5a700 1 -- 172.21.15.190:0/1924394315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bf819e300 msgr2=0x7f3bf81a2690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:07:04.361 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:04.365+0000 7f3bfea5a700 1 --2- 172.21.15.190:0/1924394315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bf819e300 0x7f3bf81a2690 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3bec00b4d0 tx=0x7f3bec00b890 comp rx=0 tx=0).stop 2024-03-04T09:07:04.361 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:04.365+0000 7f3bfea5a700 1 -- 172.21.15.190:0/1924394315 shutdown_connections 2024-03-04T09:07:04.361 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:04.365+0000 7f3bfea5a700 1 --2- 172.21.15.190:0/1924394315 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f3be4038990 0x7f3be403ae50 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:07:04.361 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:04.365+0000 7f3bfea5a700 1 --2- 172.21.15.190:0/1924394315 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3be00035c0 0x7f3bf819ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:07:04.362 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:04.365+0000 7f3bfea5a700 1 --2- 172.21.15.190:0/1924394315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bf819e300 0x7f3bf81a2690 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:07:04.362 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:04.365+0000 7f3bfea5a700 1 -- 172.21.15.190:0/1924394315 >> 172.21.15.190:0/1924394315 conn(0x7f3bf80fd650 msgr2=0x7f3bf80ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:07:04.362 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:04.365+0000 7f3bfea5a700 1 -- 172.21.15.190:0/1924394315 shutdown_connections 2024-03-04T09:07:04.362 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:04.365+0000 7f3bfea5a700 1 -- 172.21.15.190:0/1924394315 wait complete. 2024-03-04T09:07:04.362 INFO:teuthology.orchestra.run.smithi190.stderr:dumped monmap epoch 2 2024-03-04T09:07:04.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:04 smithi190 ceph-mon[36341]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:04.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:04 smithi190 ceph-mon[36341]: from='client.? 172.21.15.190:0/1924394315' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-04T09:07:05.066 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:04 smithi082 ceph-mon[32880]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:05.066 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:04 smithi082 ceph-mon[32880]: from='client.? 172.21.15.190:0/1924394315' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-04T09:07:05.975 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-03-04T09:07:05.976 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph mon dump -f json 2024-03-04T09:07:06.219 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.c/config 2024-03-04T09:07:06.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:06 smithi102 systemd[1]: Started Ceph mon.b for 2e533fc8-da06-11ee-95c6-87774f69a715. 2024-03-04T09:07:11.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:11 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T09:07:11.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:11 smithi190 ceph-mon[36341]: mon.a calling monitor election 2024-03-04T09:07:11.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:11 smithi190 ceph-mon[36341]: mon.c calling monitor election 2024-03-04T09:07:11.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:11 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T09:07:11.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:11 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T09:07:11.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:11 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T09:07:11.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:11 smithi190 ceph-mon[36341]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:11.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:11 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T09:07:11.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:11 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T09:07:11.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:11 smithi190 ceph-mon[36341]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:11.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:11 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T09:07:11.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:11 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T09:07:11.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:11 smithi190 ceph-mon[36341]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-03-04T09:07:11.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:11 smithi190 ceph-mon[36341]: monmap e3: 3 mons at {a=[v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0],b=[v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0],c=[v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-04T09:07:11.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:11 smithi190 ceph-mon[36341]: fsmap 2024-03-04T09:07:11.922 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:11 smithi190 ceph-mon[36341]: osdmap e4: 0 total, 0 up, 0 in 2024-03-04T09:07:11.922 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:11 smithi190 ceph-mon[36341]: mgrmap e13: x(active, since 59s) 2024-03-04T09:07:11.922 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:11 smithi190 ceph-mon[36341]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-03-04T09:07:11.922 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:11 smithi190 ceph-mon[36341]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-03-04T09:07:11.922 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:11 smithi190 ceph-mon[36341]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-03-04T09:07:11.922 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:11 smithi190 ceph-mon[36341]: mon.b (rank 2) addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] is down (out of quorum) 2024-03-04T09:07:11.922 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:11 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:11.922 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:11 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:12.043 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.047+0000 7f3bcc70c700 1 -- 172.21.15.190:0/4015899506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bb00035c0 msgr2=0x7f3bb0005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:07:12.043 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.047+0000 7f3bcc70c700 1 --2- 172.21.15.190:0/4015899506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bb00035c0 0x7f3bb0005a50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3bc41011e0 tx=0x7f3bc000fe60 comp rx=0 tx=0).stop 2024-03-04T09:07:12.043 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.047+0000 7f3bcc70c700 1 -- 172.21.15.190:0/4015899506 shutdown_connections 2024-03-04T09:07:12.043 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.047+0000 7f3bcc70c700 1 --2- 172.21.15.190:0/4015899506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bb00035c0 0x7f3bb0005a50 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:07:12.043 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.047+0000 7f3bcc70c700 1 -- 172.21.15.190:0/4015899506 >> 172.21.15.190:0/4015899506 conn(0x7f3bc40771b0 msgr2=0x7f3bc40775c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:07:12.043 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.047+0000 7f3bcc70c700 1 -- 172.21.15.190:0/4015899506 shutdown_connections 2024-03-04T09:07:12.044 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.047+0000 7f3bcc70c700 1 -- 172.21.15.190:0/4015899506 wait complete. 2024-03-04T09:07:12.047 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.048+0000 7f3bcc70c700 1 Processor -- start 2024-03-04T09:07:12.047 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.048+0000 7f3bcc70c700 1 -- start start 2024-03-04T09:07:12.047 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.048+0000 7f3bcc70c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bb00035c0 0x7f3bc419d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:07:12.047 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.048+0000 7f3bcc70c700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3bc419dbb0 0x7f3bc4197740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:07:12.047 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.048+0000 7f3bcc70c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3bc4197c80 0x7f3bc4198130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:07:12.047 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.048+0000 7f3bcc70c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc4109ce0 con 0x7f3bb00035c0 2024-03-04T09:07:12.047 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.048+0000 7f3bcc70c700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc4109b60 con 0x7f3bc419dbb0 2024-03-04T09:07:12.047 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.048+0000 7f3bcc70c700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc4109e60 con 0x7f3bc4197c80 2024-03-04T09:07:12.047 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.048+0000 7f3bca4a8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bb00035c0 0x7f3bc419d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:07:12.047 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.048+0000 7f3bcaca9700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3bc4197c80 0x7f3bc4198130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:07:12.048 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.048+0000 7f3bca4a8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bb00035c0 0x7f3bc419d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.190:53736/0 (socket says 172.21.15.190:53736) 2024-03-04T09:07:12.048 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.048+0000 7f3bca4a8700 1 -- 172.21.15.190:0/95175663 learned_addr learned my addr 172.21.15.190:0/95175663 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-03-04T09:07:12.048 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.048+0000 7f3bcaca9700 1 -- 172.21.15.190:0/95175663 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3bc4197c80 msgr2=0x7f3bc4198130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-03-04T09:07:12.048 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.048+0000 7f3bcaca9700 1 -- 172.21.15.190:0/95175663 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3bc4197c80 msgr2=0x7f3bc4198130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-04T09:07:12.048 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.048+0000 7f3bcaca9700 1 --2- 172.21.15.190:0/95175663 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3bc4197c80 0x7f3bc4198130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-04T09:07:12.048 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.048+0000 7f3bc9ca7700 1 --2- 172.21.15.190:0/95175663 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3bc419dbb0 0x7f3bc4197740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:07:12.048 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.048+0000 7f3bcaca9700 1 --2- 172.21.15.190:0/95175663 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3bc4197c80 0x7f3bc4198130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-04T09:07:12.048 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.048+0000 7f3bca4a8700 1 -- 172.21.15.190:0/95175663 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3bc4197c80 msgr2=0x7f3bc4198130 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-04T09:07:12.048 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.048+0000 7f3bca4a8700 1 --2- 172.21.15.190:0/95175663 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3bc4197c80 0x7f3bc4198130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:07:12.048 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.048+0000 7f3bc9ca7700 1 -- 172.21.15.190:0/95175663 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3bc419dbb0 msgr2=0x7f3bc4197740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-03-04T09:07:12.048 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.048+0000 7f3bc9ca7700 1 -- 172.21.15.190:0/95175663 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3bc419dbb0 msgr2=0x7f3bc4197740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-04T09:07:12.049 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.048+0000 7f3bca4a8700 1 -- 172.21.15.190:0/95175663 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3bc419dbb0 msgr2=0x7f3bc4197740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:07:12.049 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.048+0000 7f3bc9ca7700 1 --2- 172.21.15.190:0/95175663 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3bc419dbb0 0x7f3bc4197740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-04T09:07:12.049 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.048+0000 7f3bc9ca7700 1 --2- 172.21.15.190:0/95175663 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3bc419dbb0 0x7f3bc4197740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-04T09:07:12.049 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.048+0000 7f3bca4a8700 1 --2- 172.21.15.190:0/95175663 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3bc419dbb0 0x7f3bc4197740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:07:12.049 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.049+0000 7f3bca4a8700 1 -- 172.21.15.190:0/95175663 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc41a4420 con 0x7f3bb00035c0 2024-03-04T09:07:12.049 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.049+0000 7f3bca4a8700 1 --2- 172.21.15.190:0/95175663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bb00035c0 0x7f3bc419d670 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0012c50 tx=0x7f3bc0012d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:07:12.049 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.049+0000 7f3bbb7fe700 1 -- 172.21.15.190:0/95175663 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc002b070 con 0x7f3bb00035c0 2024-03-04T09:07:12.049 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.049+0000 7f3bbb7fe700 1 -- 172.21.15.190:0/95175663 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f3bc001dd80 con 0x7f3bb00035c0 2024-03-04T09:07:12.049 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.049+0000 7f3bcc70c700 1 -- 172.21.15.190:0/95175663 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bc41a4650 con 0x7f3bb00035c0 2024-03-04T09:07:12.049 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.049+0000 7f3bbb7fe700 1 -- 172.21.15.190:0/95175663 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc0022040 con 0x7f3bb00035c0 2024-03-04T09:07:12.049 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.049+0000 7f3bcc70c700 1 -- 172.21.15.190:0/95175663 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bc41a4b90 con 0x7f3bb00035c0 2024-03-04T09:07:12.049 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.050+0000 7f3bbb7fe700 1 -- 172.21.15.190:0/95175663 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 45984+0+0 (secure 0 0 0) 0x7f3bc002e070 con 0x7f3bb00035c0 2024-03-04T09:07:12.050 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.050+0000 7f3bbb7fe700 1 --2- 172.21.15.190:0/95175663 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f3ba80390d0 0x7f3ba803b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:07:12.050 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.050+0000 7f3bbb7fe700 1 -- 172.21.15.190:0/95175663 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f3bc004e240 con 0x7f3bb00035c0 2024-03-04T09:07:12.050 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.050+0000 7f3bc9ca7700 1 --2- 172.21.15.190:0/95175663 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f3ba80390d0 0x7f3ba803b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:07:12.050 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.050+0000 7f3bcc70c700 1 -- 172.21.15.190:0/95175663 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bc4103460 con 0x7f3bb00035c0 2024-03-04T09:07:12.050 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.051+0000 7f3bc9ca7700 1 --2- 172.21.15.190:0/95175663 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f3ba80390d0 0x7f3ba803b590 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4009850 tx=0x7f3bb4008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:07:12.051 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.056+0000 7f3bbb7fe700 1 -- 172.21.15.190:0/95175663 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f3bc0003d80 con 0x7f3bb00035c0 2024-03-04T09:07:12.066 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:11 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T09:07:12.066 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:11 smithi082 ceph-mon[32880]: mon.a calling monitor election 2024-03-04T09:07:12.066 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:11 smithi082 ceph-mon[32880]: mon.c calling monitor election 2024-03-04T09:07:12.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:11 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T09:07:12.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:11 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T09:07:12.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:11 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T09:07:12.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:11 smithi082 ceph-mon[32880]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:12.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:11 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T09:07:12.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:11 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T09:07:12.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:11 smithi082 ceph-mon[32880]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:12.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:11 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T09:07:12.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:11 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T09:07:12.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:11 smithi082 ceph-mon[32880]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-03-04T09:07:12.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:11 smithi082 ceph-mon[32880]: monmap e3: 3 mons at {a=[v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0],b=[v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0],c=[v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-04T09:07:12.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:11 smithi082 ceph-mon[32880]: fsmap 2024-03-04T09:07:12.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:11 smithi082 ceph-mon[32880]: osdmap e4: 0 total, 0 up, 0 in 2024-03-04T09:07:12.068 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:11 smithi082 ceph-mon[32880]: mgrmap e13: x(active, since 59s) 2024-03-04T09:07:12.068 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:11 smithi082 ceph-mon[32880]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-03-04T09:07:12.068 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:11 smithi082 ceph-mon[32880]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-03-04T09:07:12.068 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:11 smithi082 ceph-mon[32880]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-03-04T09:07:12.068 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:11 smithi082 ceph-mon[32880]: mon.b (rank 2) addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] is down (out of quorum) 2024-03-04T09:07:12.068 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:11 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:12.068 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:11 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:12.407 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.410+0000 7f3bcc70c700 1 -- 172.21.15.190:0/95175663 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f3bc41a4df0 con 0x7f3bb00035c0 2024-03-04T09:07:12.408 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.411+0000 7f3bbb7fe700 1 -- 172.21.15.190:0/95175663 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1283 (secure 0 0 0) 0x7f3bc0003a80 con 0x7f3bb00035c0 2024-03-04T09:07:12.409 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-03-04T09:07:12.409 INFO:teuthology.orchestra.run.smithi190.stdout:{"epoch":3,"fsid":"2e533fc8-da06-11ee-95c6-87774f69a715","modified":"2024-03-04T09:07:06.578405Z","created":"2024-03-04T09:05:13.118894Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:3300","nonce":0},{"type":"v1","addr":"172.21.15.190:6789","nonce":0}]},"addr":"172.21.15.190:6789/0","public_addr":"172.21.15.190:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:3300","nonce":0},{"type":"v1","addr":"172.21.15.102:6789","nonce":0}]},"addr":"172.21.15.102:6789/0","public_addr":"172.21.15.102:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-03-04T09:07:12.410 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.414+0000 7f3bcc70c700 1 -- 172.21.15.190:0/95175663 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f3ba80390d0 msgr2=0x7f3ba803b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:07:12.410 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.414+0000 7f3bcc70c700 1 --2- 172.21.15.190:0/95175663 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f3ba80390d0 0x7f3ba803b590 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4009850 tx=0x7f3bb4008040 comp rx=0 tx=0).stop 2024-03-04T09:07:12.410 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.414+0000 7f3bcc70c700 1 -- 172.21.15.190:0/95175663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bb00035c0 msgr2=0x7f3bc419d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:07:12.410 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.414+0000 7f3bcc70c700 1 --2- 172.21.15.190:0/95175663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bb00035c0 0x7f3bc419d670 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0012c50 tx=0x7f3bc0012d30 comp rx=0 tx=0).stop 2024-03-04T09:07:12.410 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.414+0000 7f3bcc70c700 1 -- 172.21.15.190:0/95175663 shutdown_connections 2024-03-04T09:07:12.411 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.414+0000 7f3bcc70c700 1 --2- 172.21.15.190:0/95175663 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f3ba80390d0 0x7f3ba803b590 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:07:12.411 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.414+0000 7f3bcc70c700 1 --2- 172.21.15.190:0/95175663 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3bc4197c80 0x7f3bc4198130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:07:12.411 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.414+0000 7f3bcc70c700 1 --2- 172.21.15.190:0/95175663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bb00035c0 0x7f3bc419d670 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:07:12.411 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.414+0000 7f3bcc70c700 1 --2- 172.21.15.190:0/95175663 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3bc419dbb0 0x7f3bc4197740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:07:12.411 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.414+0000 7f3bcc70c700 1 -- 172.21.15.190:0/95175663 >> 172.21.15.190:0/95175663 conn(0x7f3bc40771b0 msgr2=0x7f3bc41038f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:07:12.411 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.414+0000 7f3bcc70c700 1 -- 172.21.15.190:0/95175663 shutdown_connections 2024-03-04T09:07:12.411 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:12.414+0000 7f3bcc70c700 1 -- 172.21.15.190:0/95175663 wait complete. 2024-03-04T09:07:12.413 INFO:teuthology.orchestra.run.smithi190.stderr:dumped monmap epoch 3 2024-03-04T09:07:12.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:12 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:12.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:12 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:12.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:12 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:07:12.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:12 smithi190 ceph-mon[36341]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:12.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:12 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:12.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:12 smithi190 ceph-mon[36341]: from='client.? 172.21.15.190:0/95175663' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-04T09:07:12.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:12 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T09:07:12.935 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-03-04T09:07:12.935 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph config generate-minimal-conf 2024-03-04T09:07:12.965 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:12 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:12.965 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:12 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:12.965 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:12 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:07:12.965 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:12 smithi082 ceph-mon[32880]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:12.965 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:12 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:12.966 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:12 smithi082 ceph-mon[32880]: from='client.? 172.21.15.190:0/95175663' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-04T09:07:12.966 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:12 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T09:07:13.183 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:07:13.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:13 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T09:07:13.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:13 smithi102 ceph-mon[36220]: mon.a calling monitor election 2024-03-04T09:07:13.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:13 smithi102 ceph-mon[36220]: mon.c calling monitor election 2024-03-04T09:07:13.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:13 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T09:07:13.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:13 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T09:07:13.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:13 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T09:07:13.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:13 smithi102 ceph-mon[36220]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:13.930 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:13 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T09:07:13.930 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:13 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T09:07:13.930 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:13 smithi102 ceph-mon[36220]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:13.930 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:13 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T09:07:13.930 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:13 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T09:07:13.930 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:13 smithi102 ceph-mon[36220]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-03-04T09:07:13.930 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:13 smithi102 ceph-mon[36220]: monmap e3: 3 mons at {a=[v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0],b=[v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0],c=[v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-04T09:07:13.930 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:13 smithi102 ceph-mon[36220]: fsmap 2024-03-04T09:07:13.930 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:13 smithi102 ceph-mon[36220]: osdmap e4: 0 total, 0 up, 0 in 2024-03-04T09:07:13.930 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:13 smithi102 ceph-mon[36220]: mgrmap e13: x(active, since 59s) 2024-03-04T09:07:13.930 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:13 smithi102 ceph-mon[36220]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-03-04T09:07:13.930 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:13 smithi102 ceph-mon[36220]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-03-04T09:07:13.930 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:13 smithi102 ceph-mon[36220]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-03-04T09:07:13.930 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:13 smithi102 ceph-mon[36220]: mon.b (rank 2) addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] is down (out of quorum) 2024-03-04T09:07:13.931 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:13 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:13.931 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:13 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:13.931 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:13 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:13.931 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:13 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:13.931 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:13 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:07:13.931 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:13 smithi102 ceph-mon[36220]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:13.931 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:13 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:13.931 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:13 smithi102 ceph-mon[36220]: from='client.? 172.21.15.190:0/95175663' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-04T09:07:13.931 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:13 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T09:07:14.294 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:13 smithi082 ceph-mon[32880]: mon.b calling monitor election 2024-03-04T09:07:14.294 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:13 smithi082 ceph-mon[32880]: mon.b calling monitor election 2024-03-04T09:07:14.294 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:13 smithi082 ceph-mon[32880]: mon.c calling monitor election 2024-03-04T09:07:14.294 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:13 smithi082 ceph-mon[32880]: mon.a calling monitor election 2024-03-04T09:07:14.294 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:13 smithi082 ceph-mon[32880]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-03-04T09:07:14.294 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:13 smithi082 ceph-mon[32880]: monmap e3: 3 mons at {a=[v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0],b=[v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0],c=[v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-04T09:07:14.294 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:13 smithi082 ceph-mon[32880]: fsmap 2024-03-04T09:07:14.294 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:13 smithi082 ceph-mon[32880]: osdmap e4: 0 total, 0 up, 0 in 2024-03-04T09:07:14.294 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:13 smithi082 ceph-mon[32880]: mgrmap e13: x(active, since 61s) 2024-03-04T09:07:14.294 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:13 smithi082 ceph-mon[32880]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-03-04T09:07:14.294 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:13 smithi082 ceph-mon[32880]: Cluster is now healthy 2024-03-04T09:07:14.295 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:13 smithi082 ceph-mon[32880]: overall HEALTH_OK 2024-03-04T09:07:14.295 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:13 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:14.295 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:13 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:14.295 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:13 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:07:14.295 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:13 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:07:14.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:13 smithi190 ceph-mon[36341]: mon.b calling monitor election 2024-03-04T09:07:14.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:13 smithi190 ceph-mon[36341]: mon.b calling monitor election 2024-03-04T09:07:14.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:13 smithi190 ceph-mon[36341]: mon.c calling monitor election 2024-03-04T09:07:14.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:13 smithi190 ceph-mon[36341]: mon.a calling monitor election 2024-03-04T09:07:14.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:13 smithi190 ceph-mon[36341]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-03-04T09:07:14.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:13 smithi190 ceph-mon[36341]: monmap e3: 3 mons at {a=[v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0],b=[v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0],c=[v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-04T09:07:14.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:13 smithi190 ceph-mon[36341]: fsmap 2024-03-04T09:07:14.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:13 smithi190 ceph-mon[36341]: osdmap e4: 0 total, 0 up, 0 in 2024-03-04T09:07:14.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:13 smithi190 ceph-mon[36341]: mgrmap e13: x(active, since 61s) 2024-03-04T09:07:14.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:13 smithi190 ceph-mon[36341]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-03-04T09:07:14.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:13 smithi190 ceph-mon[36341]: Cluster is now healthy 2024-03-04T09:07:14.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:13 smithi190 ceph-mon[36341]: overall HEALTH_OK 2024-03-04T09:07:14.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:13 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:14.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:13 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:14.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:13 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:07:14.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:13 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:07:14.428 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:13 smithi102 ceph-mon[36220]: mon.b calling monitor election 2024-03-04T09:07:14.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:13 smithi102 ceph-mon[36220]: mon.b calling monitor election 2024-03-04T09:07:14.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:13 smithi102 ceph-mon[36220]: mon.c calling monitor election 2024-03-04T09:07:14.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:13 smithi102 ceph-mon[36220]: mon.a calling monitor election 2024-03-04T09:07:14.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:13 smithi102 ceph-mon[36220]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-03-04T09:07:14.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:13 smithi102 ceph-mon[36220]: monmap e3: 3 mons at {a=[v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0],b=[v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0],c=[v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-04T09:07:14.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:13 smithi102 ceph-mon[36220]: fsmap 2024-03-04T09:07:14.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:13 smithi102 ceph-mon[36220]: osdmap e4: 0 total, 0 up, 0 in 2024-03-04T09:07:14.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:13 smithi102 ceph-mon[36220]: mgrmap e13: x(active, since 61s) 2024-03-04T09:07:14.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:13 smithi102 ceph-mon[36220]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-03-04T09:07:14.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:13 smithi102 ceph-mon[36220]: Cluster is now healthy 2024-03-04T09:07:14.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:13 smithi102 ceph-mon[36220]: overall HEALTH_OK 2024-03-04T09:07:14.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:13 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:14.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:13 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:14.430 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:13 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:07:14.430 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:13 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:07:14.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:14.837+0000 7f6aa0693700 1 -- 172.21.15.82:0/2530268043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a981069c0 msgr2=0x7f6a98106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:07:14.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:14.837+0000 7f6aa0693700 1 --2- 172.21.15.82:0/2530268043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a981069c0 0x7f6a98106da0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6a88009910 tx=0x7f6a88009c20 comp rx=0 tx=0).stop 2024-03-04T09:07:14.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:14.837+0000 7f6aa0693700 1 -- 172.21.15.82:0/2530268043 shutdown_connections 2024-03-04T09:07:14.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:14.837+0000 7f6aa0693700 1 --2- 172.21.15.82:0/2530268043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a981069c0 0x7f6a98106da0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:07:14.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:14.837+0000 7f6aa0693700 1 -- 172.21.15.82:0/2530268043 >> 172.21.15.82:0/2530268043 conn(0x7f6a980fc510 msgr2=0x7f6a980fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:07:14.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:14.837+0000 7f6aa0693700 1 -- 172.21.15.82:0/2530268043 shutdown_connections 2024-03-04T09:07:14.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:14.837+0000 7f6aa0693700 1 -- 172.21.15.82:0/2530268043 wait complete. 2024-03-04T09:07:14.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:14.837+0000 7f6aa0693700 1 Processor -- start 2024-03-04T09:07:14.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:14.837+0000 7f6aa0693700 1 -- start start 2024-03-04T09:07:14.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:14.837+0000 7f6aa0693700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a981069c0 0x7f6a98196710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:07:14.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:14.837+0000 7f6aa0693700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a98196c50 0x7f6a9819afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:07:14.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:14.837+0000 7f6aa0693700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a9819b520 0x7f6a9819b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:07:14.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:14.837+0000 7f6aa0693700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9810aff0 con 0x7f6a9819b520 2024-03-04T09:07:14.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:14.838+0000 7f6aa0693700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9810ae70 con 0x7f6a981069c0 2024-03-04T09:07:14.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:14.838+0000 7f6aa0693700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9810b170 con 0x7f6a98196c50 2024-03-04T09:07:14.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:14.838+0000 7f6a9ec30700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a9819b520 0x7f6a9819b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:07:14.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:14.838+0000 7f6a9ec30700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a9819b520 0x7f6a9819b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48938/0 (socket says 172.21.15.82:48938) 2024-03-04T09:07:14.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:14.838+0000 7f6a9ec30700 1 -- 172.21.15.82:0/1297069868 learned_addr learned my addr 172.21.15.82:0/1297069868 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:07:14.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:14.838+0000 7f6a9e42f700 1 --2- 172.21.15.82:0/1297069868 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a981069c0 0x7f6a98196710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:07:14.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:14.838+0000 7f6a9dc2e700 1 --2- 172.21.15.82:0/1297069868 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a98196c50 0x7f6a9819afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:07:14.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:14.838+0000 7f6a9ec30700 1 -- 172.21.15.82:0/1297069868 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a98196c50 msgr2=0x7f6a9819afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:07:14.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:14.838+0000 7f6a9ec30700 1 --2- 172.21.15.82:0/1297069868 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a98196c50 0x7f6a9819afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:07:14.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:14.838+0000 7f6a9ec30700 1 -- 172.21.15.82:0/1297069868 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a981069c0 msgr2=0x7f6a98196710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:07:14.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:14.838+0000 7f6a9ec30700 1 --2- 172.21.15.82:0/1297069868 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a981069c0 0x7f6a98196710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:07:14.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:14.838+0000 7f6a9ec30700 1 -- 172.21.15.82:0/1297069868 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a981a3290 con 0x7f6a9819b520 2024-03-04T09:07:14.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:14.838+0000 7f6a9dc2e700 1 --2- 172.21.15.82:0/1297069868 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a98196c50 0x7f6a9819afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T09:07:14.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:14.838+0000 7f6a9ec30700 1 --2- 172.21.15.82:0/1297069868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a9819b520 0x7f6a9819b9d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6a9000ba50 tx=0x7f6a9000bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:07:14.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:14.838+0000 7f6a8f7fe700 1 -- 172.21.15.82:0/1297069868 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a90019070 con 0x7f6a9819b520 2024-03-04T09:07:14.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:14.838+0000 7f6a8f7fe700 1 -- 172.21.15.82:0/1297069868 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f6a90014440 con 0x7f6a9819b520 2024-03-04T09:07:14.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:14.838+0000 7f6aa0693700 1 -- 172.21.15.82:0/1297069868 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a981a34c0 con 0x7f6a9819b520 2024-03-04T09:07:14.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:14.838+0000 7f6a8f7fe700 1 -- 172.21.15.82:0/1297069868 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a900075b0 con 0x7f6a9819b520 2024-03-04T09:07:14.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:14.838+0000 7f6aa0693700 1 -- 172.21.15.82:0/1297069868 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a981a3a00 con 0x7f6a9819b520 2024-03-04T09:07:14.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:14.839+0000 7f6a8f7fe700 1 -- 172.21.15.82:0/1297069868 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 45984+0+0 (secure 0 0 0) 0x7f6a9001c070 con 0x7f6a9819b520 2024-03-04T09:07:14.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:14.839+0000 7f6aa0693700 1 -- 172.21.15.82:0/1297069868 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a980636f0 con 0x7f6a9819b520 2024-03-04T09:07:14.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:14.839+0000 7f6a8f7fe700 1 --2- 172.21.15.82:0/1297069868 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f6a840390d0 0x7f6a8403b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:07:14.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:14.839+0000 7f6a8f7fe700 1 -- 172.21.15.82:0/1297069868 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f6a9004b130 con 0x7f6a9819b520 2024-03-04T09:07:14.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:14.839+0000 7f6a9e42f700 1 --2- 172.21.15.82:0/1297069868 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f6a840390d0 0x7f6a8403b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:07:14.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:14.840+0000 7f6a9e42f700 1 --2- 172.21.15.82:0/1297069868 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f6a840390d0 0x7f6a8403b590 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6a88009750 tx=0x7f6a88009f40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:07:14.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:14.844+0000 7f6a8f7fe700 1 -- 172.21.15.82:0/1297069868 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f6a9001b2c0 con 0x7f6a9819b520 2024-03-04T09:07:15.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:15.040+0000 7f6aa0693700 1 -- 172.21.15.82:0/1297069868 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f6a981a3cf0 con 0x7f6a9819b520 2024-03-04T09:07:15.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:15.040+0000 7f6a8f7fe700 1 -- 172.21.15.82:0/1297069868 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) v1 ==== 76+0+275 (secure 0 0 0) 0x7f6a90014a10 con 0x7f6a9819b520 2024-03-04T09:07:15.036 INFO:teuthology.orchestra.run.smithi082.stdout:# minimal ceph.conf for 2e533fc8-da06-11ee-95c6-87774f69a715 2024-03-04T09:07:15.037 INFO:teuthology.orchestra.run.smithi082.stdout:[global] 2024-03-04T09:07:15.037 INFO:teuthology.orchestra.run.smithi082.stdout: fsid = 2e533fc8-da06-11ee-95c6-87774f69a715 2024-03-04T09:07:15.037 INFO:teuthology.orchestra.run.smithi082.stdout: mon_host = [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2024-03-04T09:07:15.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:15.042+0000 7f6aa0693700 1 -- 172.21.15.82:0/1297069868 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f6a840390d0 msgr2=0x7f6a8403b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:07:15.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:15.042+0000 7f6aa0693700 1 --2- 172.21.15.82:0/1297069868 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f6a840390d0 0x7f6a8403b590 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6a88009750 tx=0x7f6a88009f40 comp rx=0 tx=0).stop 2024-03-04T09:07:15.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:15.042+0000 7f6aa0693700 1 -- 172.21.15.82:0/1297069868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a9819b520 msgr2=0x7f6a9819b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:07:15.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:15.042+0000 7f6aa0693700 1 --2- 172.21.15.82:0/1297069868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a9819b520 0x7f6a9819b9d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6a9000ba50 tx=0x7f6a9000bd60 comp rx=0 tx=0).stop 2024-03-04T09:07:15.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:15.042+0000 7f6aa0693700 1 -- 172.21.15.82:0/1297069868 shutdown_connections 2024-03-04T09:07:15.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:15.042+0000 7f6aa0693700 1 --2- 172.21.15.82:0/1297069868 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f6a840390d0 0x7f6a8403b590 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:07:15.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:15.042+0000 7f6aa0693700 1 --2- 172.21.15.82:0/1297069868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a9819b520 0x7f6a9819b9d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:07:15.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:15.042+0000 7f6aa0693700 1 --2- 172.21.15.82:0/1297069868 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a981069c0 0x7f6a98196710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:07:15.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:15.042+0000 7f6aa0693700 1 --2- 172.21.15.82:0/1297069868 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a98196c50 0x7f6a9819afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:07:15.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:15.042+0000 7f6aa0693700 1 -- 172.21.15.82:0/1297069868 >> 172.21.15.82:0/1297069868 conn(0x7f6a980fc510 msgr2=0x7f6a981024c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:07:15.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:15.042+0000 7f6aa0693700 1 -- 172.21.15.82:0/1297069868 shutdown_connections 2024-03-04T09:07:15.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:15.042+0000 7f6aa0693700 1 -- 172.21.15.82:0/1297069868 wait complete. 2024-03-04T09:07:15.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:15 smithi082 ceph-mon[32880]: Updating smithi082:/etc/ceph/ceph.conf 2024-03-04T09:07:15.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:15 smithi082 ceph-mon[32880]: Updating smithi102:/etc/ceph/ceph.conf 2024-03-04T09:07:15.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:15 smithi082 ceph-mon[32880]: Updating smithi190:/etc/ceph/ceph.conf 2024-03-04T09:07:15.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:15 smithi082 ceph-mon[32880]: Updating smithi082:/var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T09:07:15.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:15 smithi082 ceph-mon[32880]: Updating smithi102:/var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T09:07:15.318 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:15 smithi082 ceph-mon[32880]: Updating smithi190:/var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T09:07:15.318 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:15 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:15.318 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:15 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:15.318 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:15 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:15.318 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:15 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:15.318 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:15 smithi082 ceph-mon[32880]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:15.318 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:15 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:15.318 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:15 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:15.318 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:15 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:15.318 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:15 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:15.318 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:15 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:15.318 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:15 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:15.318 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:15 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:15.318 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:15 smithi082 ceph-mon[32880]: Reconfiguring mon.a (unknown last config time)... 2024-03-04T09:07:15.319 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:15 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-04T09:07:15.319 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:15 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-04T09:07:15.319 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:15 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:07:15.319 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:15 smithi082 ceph-mon[32880]: Reconfiguring daemon mon.a on smithi082 2024-03-04T09:07:15.319 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:15 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T09:07:15.319 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:15 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/1297069868' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:07:15.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:15 smithi190 ceph-mon[36341]: Updating smithi082:/etc/ceph/ceph.conf 2024-03-04T09:07:15.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:15 smithi190 ceph-mon[36341]: Updating smithi102:/etc/ceph/ceph.conf 2024-03-04T09:07:15.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:15 smithi190 ceph-mon[36341]: Updating smithi190:/etc/ceph/ceph.conf 2024-03-04T09:07:15.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:15 smithi190 ceph-mon[36341]: Updating smithi082:/var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T09:07:15.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:15 smithi190 ceph-mon[36341]: Updating smithi102:/var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T09:07:15.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:15 smithi190 ceph-mon[36341]: Updating smithi190:/var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T09:07:15.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:15 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:15.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:15 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:15.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:15 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:15.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:15 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:15.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:15 smithi190 ceph-mon[36341]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:15.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:15 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:15.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:15 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:15.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:15 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:15.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:15 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:15.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:15 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:15.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:15 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:15.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:15 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:15.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:15 smithi190 ceph-mon[36341]: Reconfiguring mon.a (unknown last config time)... 2024-03-04T09:07:15.422 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:15 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-04T09:07:15.422 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:15 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-04T09:07:15.422 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:15 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:07:15.422 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:15 smithi190 ceph-mon[36341]: Reconfiguring daemon mon.a on smithi082 2024-03-04T09:07:15.422 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:15 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T09:07:15.422 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:15 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/1297069868' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:07:15.428 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:15 smithi102 ceph-mon[36220]: Updating smithi082:/etc/ceph/ceph.conf 2024-03-04T09:07:15.428 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:15 smithi102 ceph-mon[36220]: Updating smithi102:/etc/ceph/ceph.conf 2024-03-04T09:07:15.428 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:15 smithi102 ceph-mon[36220]: Updating smithi190:/etc/ceph/ceph.conf 2024-03-04T09:07:15.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:15 smithi102 ceph-mon[36220]: Updating smithi082:/var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T09:07:15.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:15 smithi102 ceph-mon[36220]: Updating smithi102:/var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T09:07:15.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:15 smithi102 ceph-mon[36220]: Updating smithi190:/var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T09:07:15.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:15 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:15.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:15 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:15.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:15 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:15.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:15 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:15.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:15 smithi102 ceph-mon[36220]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:15.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:15 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:15.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:15 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:15.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:15 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:15.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:15 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:15.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:15 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:15.430 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:15 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:15.430 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:15 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:15.430 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:15 smithi102 ceph-mon[36220]: Reconfiguring mon.a (unknown last config time)... 2024-03-04T09:07:15.430 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:15 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-04T09:07:15.430 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:15 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-04T09:07:15.430 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:15 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:07:15.430 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:15 smithi102 ceph-mon[36220]: Reconfiguring daemon mon.a on smithi082 2024-03-04T09:07:15.430 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:15 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T09:07:15.430 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:15 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/1297069868' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:07:15.729 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-03-04T09:07:15.729 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-03-04T09:07:15.729 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/ceph/ceph.conf 2024-03-04T09:07:15.799 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-03-04T09:07:15.799 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-04T09:07:15.869 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-03-04T09:07:15.869 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/ceph/ceph.conf 2024-03-04T09:07:15.903 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-03-04T09:07:15.903 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-04T09:07:15.973 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-03-04T09:07:15.973 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/ceph/ceph.conf 2024-03-04T09:07:16.007 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-03-04T09:07:16.007 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-04T09:07:16.078 INFO:tasks.cephadm:Adding mgr.x on smithi082 2024-03-04T09:07:16.079 INFO:tasks.cephadm:Adding mgr.y on smithi102 2024-03-04T09:07:16.079 INFO:tasks.cephadm:Adding mgr.z on smithi190 2024-03-04T09:07:16.079 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph orch apply mgr '3;smithi082=x;smithi102=y;smithi190=z' 2024-03-04T09:07:16.354 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.c/config 2024-03-04T09:07:17.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:17 smithi190 ceph-mon[36341]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:17.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:17 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:17.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:17 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:17.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:17 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-04T09:07:17.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:17 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-04T09:07:17.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:17 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:07:17.427 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:17 smithi102 ceph-mon[36220]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:17.427 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:17 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:17.427 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:17 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:17.427 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:17 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-04T09:07:17.428 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:17 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-04T09:07:17.428 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:17 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:07:17.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:17 smithi082 ceph-mon[32880]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:17.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:17 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:17.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:17 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:17.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:17 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-04T09:07:17.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:17 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-04T09:07:17.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:17 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:07:17.791 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:17.793+0000 7f6d4fc14700 1 -- 172.21.15.190:0/1320380056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d48100ae0 msgr2=0x7f6d48100f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:07:17.791 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:17.793+0000 7f6d4fc14700 1 --2- 172.21.15.190:0/1320380056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d48100ae0 0x7f6d48100f00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6d44009910 tx=0x7f6d44009c20 comp rx=0 tx=0).stop 2024-03-04T09:07:17.791 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:17.793+0000 7f6d4fc14700 1 -- 172.21.15.190:0/1320380056 shutdown_connections 2024-03-04T09:07:17.791 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:17.793+0000 7f6d4fc14700 1 --2- 172.21.15.190:0/1320380056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d48100ae0 0x7f6d48100f00 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:07:17.792 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:17.793+0000 7f6d4fc14700 1 -- 172.21.15.190:0/1320380056 >> 172.21.15.190:0/1320380056 conn(0x7f6d480fc0a0 msgr2=0x7f6d480fe4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:07:17.792 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:17.793+0000 7f6d4fc14700 1 -- 172.21.15.190:0/1320380056 shutdown_connections 2024-03-04T09:07:17.792 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:17.793+0000 7f6d4fc14700 1 -- 172.21.15.190:0/1320380056 wait complete. 2024-03-04T09:07:17.792 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:17.794+0000 7f6d4fc14700 1 Processor -- start 2024-03-04T09:07:17.792 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:17.794+0000 7f6d4fc14700 1 -- start start 2024-03-04T09:07:17.792 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:17.794+0000 7f6d4fc14700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6d48100ae0 0x7f6d48197430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:07:17.792 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:17.794+0000 7f6d4fc14700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6d48197970 0x7f6d4819c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:07:17.792 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:17.794+0000 7f6d4fc14700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d48197df0 0x7f6d4819ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:07:17.792 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:17.794+0000 7f6d4fc14700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d48106b10 con 0x7f6d48197df0 2024-03-04T09:07:17.792 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:17.794+0000 7f6d4fc14700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d48106990 con 0x7f6d48100ae0 2024-03-04T09:07:17.792 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:17.794+0000 7f6d4fc14700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d48106c90 con 0x7f6d48197970 2024-03-04T09:07:17.792 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:17.794+0000 7f6d4d1af700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6d48197970 0x7f6d4819c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:07:17.792 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:17.794+0000 7f6d4d1af700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6d48197970 0x7f6d4819c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:45384/0 (socket says 172.21.15.190:45384) 2024-03-04T09:07:17.793 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:17.794+0000 7f6d4d1af700 1 -- 172.21.15.190:0/4099128993 learned_addr learned my addr 172.21.15.190:0/4099128993 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-03-04T09:07:17.793 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:17.794+0000 7f6d4e1b1700 1 --2- 172.21.15.190:0/4099128993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d48197df0 0x7f6d4819ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:07:17.793 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:17.795+0000 7f6d4d9b0700 1 --2- 172.21.15.190:0/4099128993 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6d48100ae0 0x7f6d48197430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:07:17.793 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:17.795+0000 7f6d4d1af700 1 -- 172.21.15.190:0/4099128993 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6d48100ae0 msgr2=0x7f6d48197430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:07:17.793 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:17.795+0000 7f6d4d1af700 1 --2- 172.21.15.190:0/4099128993 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6d48100ae0 0x7f6d48197430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:07:17.793 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:17.795+0000 7f6d4d1af700 1 -- 172.21.15.190:0/4099128993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d48197df0 msgr2=0x7f6d4819ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:07:17.793 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:17.795+0000 7f6d4d1af700 1 --2- 172.21.15.190:0/4099128993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d48197df0 0x7f6d4819ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:07:17.793 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:17.795+0000 7f6d4d1af700 1 -- 172.21.15.190:0/4099128993 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d4819f840 con 0x7f6d48197970 2024-03-04T09:07:17.793 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:17.795+0000 7f6d4d9b0700 1 --2- 172.21.15.190:0/4099128993 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6d48100ae0 0x7f6d48197430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T09:07:17.793 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:17.795+0000 7f6d4d1af700 1 --2- 172.21.15.190:0/4099128993 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6d48197970 0x7f6d4819c9e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6d3800b780 tx=0x7f6d3800ba90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:07:17.793 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:17.795+0000 7f6d3effd700 1 -- 172.21.15.190:0/4099128993 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d38004230 con 0x7f6d48197970 2024-03-04T09:07:17.793 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:17.795+0000 7f6d3effd700 1 -- 172.21.15.190:0/4099128993 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f6d380043d0 con 0x7f6d48197970 2024-03-04T09:07:17.793 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:17.795+0000 7f6d4fc14700 1 -- 172.21.15.190:0/4099128993 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d4819fb30 con 0x7f6d48197970 2024-03-04T09:07:17.793 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:17.795+0000 7f6d3effd700 1 -- 172.21.15.190:0/4099128993 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d38011bf0 con 0x7f6d48197970 2024-03-04T09:07:17.793 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:17.795+0000 7f6d4fc14700 1 -- 172.21.15.190:0/4099128993 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d481a0140 con 0x7f6d48197970 2024-03-04T09:07:17.794 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:17.796+0000 7f6d3effd700 1 -- 172.21.15.190:0/4099128993 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 13) v1 ==== 45984+0+0 (secure 0 0 0) 0x7f6d380036a0 con 0x7f6d48197970 2024-03-04T09:07:17.794 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:17.796+0000 7f6d4fc14700 1 -- 172.21.15.190:0/4099128993 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d480636f0 con 0x7f6d48197970 2024-03-04T09:07:17.795 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:17.796+0000 7f6d3effd700 1 --2- 172.21.15.190:0/4099128993 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f6d340390d0 0x7f6d3403b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:07:17.795 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:17.796+0000 7f6d3effd700 1 -- 172.21.15.190:0/4099128993 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f6d3804b640 con 0x7f6d48197970 2024-03-04T09:07:17.795 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:17.797+0000 7f6d4d9b0700 1 --2- 172.21.15.190:0/4099128993 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f6d340390d0 0x7f6d3403b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:07:17.795 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:17.797+0000 7f6d4d9b0700 1 --2- 172.21.15.190:0/4099128993 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f6d340390d0 0x7f6d3403b590 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6d44005cd0 tx=0x7f6d44005c00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:07:17.797 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:17.801+0000 7f6d3effd700 1 -- 172.21.15.190:0/4099128993 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f6d38021e00 con 0x7f6d48197970 2024-03-04T09:07:18.000 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:18.004+0000 7f6d4fc14700 1 -- 172.21.15.190:0/4099128993 --> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi082=x;smithi102=y;smithi190=z", "target": ["mon-mgr", ""]}) v1 -- 0x7f6d48062500 con 0x7f6d340390d0 2024-03-04T09:07:18.006 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:18.010+0000 7f6d3effd700 1 -- 172.21.15.190:0/4099128993 <== mgr.14152 v2:172.21.15.82:6800/1278635224 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f6d48062500 con 0x7f6d340390d0 2024-03-04T09:07:18.006 INFO:teuthology.orchestra.run.smithi190.stdout:Scheduled mgr update... 2024-03-04T09:07:18.009 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:18.012+0000 7f6d4fc14700 1 -- 172.21.15.190:0/4099128993 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f6d340390d0 msgr2=0x7f6d3403b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:07:18.009 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:18.012+0000 7f6d4fc14700 1 --2- 172.21.15.190:0/4099128993 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f6d340390d0 0x7f6d3403b590 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6d44005cd0 tx=0x7f6d44005c00 comp rx=0 tx=0).stop 2024-03-04T09:07:18.009 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:18.012+0000 7f6d4fc14700 1 -- 172.21.15.190:0/4099128993 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6d48197970 msgr2=0x7f6d4819c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:07:18.009 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:18.012+0000 7f6d4fc14700 1 --2- 172.21.15.190:0/4099128993 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6d48197970 0x7f6d4819c9e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6d3800b780 tx=0x7f6d3800ba90 comp rx=0 tx=0).stop 2024-03-04T09:07:18.009 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:18.012+0000 7f6d4fc14700 1 -- 172.21.15.190:0/4099128993 shutdown_connections 2024-03-04T09:07:18.009 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:18.012+0000 7f6d4fc14700 1 --2- 172.21.15.190:0/4099128993 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f6d340390d0 0x7f6d3403b590 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:07:18.009 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:18.012+0000 7f6d4fc14700 1 --2- 172.21.15.190:0/4099128993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d48197df0 0x7f6d4819ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:07:18.009 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:18.012+0000 7f6d4fc14700 1 --2- 172.21.15.190:0/4099128993 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6d48100ae0 0x7f6d48197430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:07:18.009 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:18.012+0000 7f6d4fc14700 1 --2- 172.21.15.190:0/4099128993 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6d48197970 0x7f6d4819c9e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:07:18.009 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:18.012+0000 7f6d4fc14700 1 -- 172.21.15.190:0/4099128993 >> 172.21.15.190:0/4099128993 conn(0x7f6d480fc0a0 msgr2=0x7f6d48069f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:07:18.009 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:18.013+0000 7f6d4fc14700 1 -- 172.21.15.190:0/4099128993 shutdown_connections 2024-03-04T09:07:18.009 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:07:18.013+0000 7f6d4fc14700 1 -- 172.21.15.190:0/4099128993 wait complete. 2024-03-04T09:07:18.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:18 smithi190 ceph-mon[36341]: Reconfiguring mon.b (monmap changed)... 2024-03-04T09:07:18.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:18 smithi190 ceph-mon[36341]: Reconfiguring daemon mon.b on smithi102 2024-03-04T09:07:18.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:18 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:18.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:18 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:18.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:18 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:18.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:18 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-04T09:07:18.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:18 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-04T09:07:18.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:18 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:07:18.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:18 smithi082 ceph-mon[32880]: Reconfiguring mon.b (monmap changed)... 2024-03-04T09:07:18.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:18 smithi082 ceph-mon[32880]: Reconfiguring daemon mon.b on smithi102 2024-03-04T09:07:18.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:18 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:18.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:18 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:18.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:18 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:18.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:18 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-04T09:07:18.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:18 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-04T09:07:18.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:18 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:07:18.640 DEBUG:teuthology.orchestra.run.smithi102:mgr.y> sudo journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mgr.y.service 2024-03-04T09:07:18.643 DEBUG:teuthology.orchestra.run.smithi190:mgr.z> sudo journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mgr.z.service 2024-03-04T09:07:18.646 INFO:tasks.cephadm:Deploying OSDs... 2024-03-04T09:07:18.646 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-03-04T09:07:18.646 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/scratch_devs of=/dev/stdout 2024-03-04T09:07:18.665 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-04T09:07:18.665 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_1 2024-03-04T09:07:18.669 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:18 smithi102 ceph-mon[36220]: Reconfiguring mon.b (monmap changed)... 2024-03-04T09:07:18.669 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:18 smithi102 ceph-mon[36220]: Reconfiguring daemon mon.b on smithi102 2024-03-04T09:07:18.669 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:18 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:18.669 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:18 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:18.669 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:18 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:18.669 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:18 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-04T09:07:18.669 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:18 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-04T09:07:18.669 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:18 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:07:18.722 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-04T09:07:18.722 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-04T09:07:18.722 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-03-04T09:07:18.722 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-04T09:07:18.722 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-03-04T09:07:18.722 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-03-04 09:06:25.053387085 +0000 2024-03-04T09:07:18.722 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-03-04 09:00:47.746719440 +0000 2024-03-04T09:07:18.722 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-03-04 09:00:47.746719440 +0000 2024-03-04T09:07:18.722 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-03-04 09:00:47.746719440 +0000 2024-03-04T09:07:18.723 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-04T09:07:18.790 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-03-04T09:07:18.790 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-03-04T09:07:18.790 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000226103 s, 2.3 MB/s 2024-03-04T09:07:18.791 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-04T09:07:18.850 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_2 2024-03-04T09:07:18.908 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-04T09:07:18.908 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-04T09:07:18.908 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-03-04T09:07:18.908 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-04T09:07:18.908 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-03-04T09:07:18.908 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-03-04 09:06:25.080386565 +0000 2024-03-04T09:07:18.908 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-03-04 09:00:48.078713029 +0000 2024-03-04T09:07:18.908 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-03-04 09:00:48.078713029 +0000 2024-03-04T09:07:18.908 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-03-04 09:00:48.078713029 +0000 2024-03-04T09:07:18.909 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-04T09:07:18.977 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-03-04T09:07:18.977 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-03-04T09:07:18.977 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.00021546 s, 2.4 MB/s 2024-03-04T09:07:18.978 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-04T09:07:19.036 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_3 2024-03-04T09:07:19.093 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-04T09:07:19.093 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-04T09:07:19.093 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-03-04T09:07:19.093 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-04T09:07:19.093 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-03-04T09:07:19.093 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-03-04 09:06:25.106386064 +0000 2024-03-04T09:07:19.093 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-03-04 09:00:48.430706233 +0000 2024-03-04T09:07:19.093 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-03-04 09:00:48.430706233 +0000 2024-03-04T09:07:19.093 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-03-04 09:00:48.430706233 +0000 2024-03-04T09:07:19.094 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-04T09:07:19.160 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-03-04T09:07:19.160 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-03-04T09:07:19.160 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000215209 s, 2.4 MB/s 2024-03-04T09:07:19.161 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-04T09:07:19.218 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_4 2024-03-04T09:07:19.274 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-04T09:07:19.275 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-04T09:07:19.275 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-03-04T09:07:19.275 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-04T09:07:19.275 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-03-04T09:07:19.275 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-03-04 09:06:25.132385563 +0000 2024-03-04T09:07:19.275 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-03-04 09:00:48.780699474 +0000 2024-03-04T09:07:19.275 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-03-04 09:00:48.780699474 +0000 2024-03-04T09:07:19.275 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-03-04 09:00:48.780699474 +0000 2024-03-04T09:07:19.275 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-04T09:07:19.342 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-03-04T09:07:19.343 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-03-04T09:07:19.343 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000192598 s, 2.7 MB/s 2024-03-04T09:07:19.344 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-04T09:07:19.400 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-03-04T09:07:19.401 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/scratch_devs of=/dev/stdout 2024-03-04T09:07:19.419 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-04T09:07:19.419 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_1 2024-03-04T09:07:19.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:19 smithi190 ceph-mon[36341]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi082=x;smithi102=y;smithi190=z", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:07:19.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:19 smithi190 ceph-mon[36341]: Saving service mgr spec with placement smithi082=x;smithi102=y;smithi190=z;count:3 2024-03-04T09:07:19.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:19 smithi190 ceph-mon[36341]: Reconfiguring mon.c (monmap changed)... 2024-03-04T09:07:19.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:19 smithi190 ceph-mon[36341]: Reconfiguring daemon mon.c on smithi190 2024-03-04T09:07:19.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:19 smithi190 ceph-mon[36341]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:19.477 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-04T09:07:19.478 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-04T09:07:19.478 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-03-04T09:07:19.478 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-04T09:07:19.478 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2024-03-04T09:07:19.478 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-03-04 09:07:06.028683796 +0000 2024-03-04T09:07:19.478 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-03-04 09:00:48.692484839 +0000 2024-03-04T09:07:19.478 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-03-04 09:00:48.692484839 +0000 2024-03-04T09:07:19.478 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-03-04 09:00:48.692484839 +0000 2024-03-04T09:07:19.478 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-04T09:07:19.545 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:19 smithi102 ceph-mon[36220]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi082=x;smithi102=y;smithi190=z", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:07:19.545 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:19 smithi102 ceph-mon[36220]: Saving service mgr spec with placement smithi082=x;smithi102=y;smithi190=z;count:3 2024-03-04T09:07:19.545 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:19 smithi102 ceph-mon[36220]: Reconfiguring mon.c (monmap changed)... 2024-03-04T09:07:19.545 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:19 smithi102 ceph-mon[36220]: Reconfiguring daemon mon.c on smithi190 2024-03-04T09:07:19.545 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:19 smithi102 ceph-mon[36220]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:19.548 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-03-04T09:07:19.548 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-03-04T09:07:19.548 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000266668 s, 1.9 MB/s 2024-03-04T09:07:19.549 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-04T09:07:19.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:19 smithi082 ceph-mon[32880]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi082=x;smithi102=y;smithi190=z", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:07:19.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:19 smithi082 ceph-mon[32880]: Saving service mgr spec with placement smithi082=x;smithi102=y;smithi190=z;count:3 2024-03-04T09:07:19.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:19 smithi082 ceph-mon[32880]: Reconfiguring mon.c (monmap changed)... 2024-03-04T09:07:19.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:19 smithi082 ceph-mon[32880]: Reconfiguring daemon mon.c on smithi190 2024-03-04T09:07:19.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:19 smithi082 ceph-mon[32880]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:19.608 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_2 2024-03-04T09:07:19.666 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-04T09:07:19.666 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-04T09:07:19.666 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-03-04T09:07:19.666 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-04T09:07:19.666 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2024-03-04T09:07:19.666 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-03-04 09:07:06.029683774 +0000 2024-03-04T09:07:19.667 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-03-04 09:00:49.033477488 +0000 2024-03-04T09:07:19.667 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-03-04 09:00:49.033477488 +0000 2024-03-04T09:07:19.667 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-03-04 09:00:49.033477488 +0000 2024-03-04T09:07:19.667 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-04T09:07:19.736 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-03-04T09:07:19.737 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-03-04T09:07:19.737 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000272293 s, 1.9 MB/s 2024-03-04T09:07:19.738 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-04T09:07:19.797 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_3 2024-03-04T09:07:19.855 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-04T09:07:19.855 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-04T09:07:19.855 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-03-04T09:07:19.855 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-04T09:07:19.855 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2024-03-04T09:07:19.855 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-03-04 09:07:06.029683774 +0000 2024-03-04T09:07:19.855 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-03-04 09:00:49.369470242 +0000 2024-03-04T09:07:19.855 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-03-04 09:00:49.369470242 +0000 2024-03-04T09:07:19.855 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-03-04 09:00:49.369470242 +0000 2024-03-04T09:07:19.856 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-04T09:07:19.924 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-03-04T09:07:19.924 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-03-04T09:07:19.924 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000227315 s, 2.3 MB/s 2024-03-04T09:07:19.925 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-04T09:07:19.983 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_4 2024-03-04T09:07:20.040 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-04T09:07:20.040 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-04T09:07:20.041 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-03-04T09:07:20.041 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-04T09:07:20.041 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2024-03-04T09:07:20.041 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-03-04 09:07:06.029683774 +0000 2024-03-04T09:07:20.041 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-03-04 09:00:49.712462845 +0000 2024-03-04T09:07:20.041 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-03-04 09:00:49.712462845 +0000 2024-03-04T09:07:20.041 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-03-04 09:00:49.712462845 +0000 2024-03-04T09:07:20.041 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-04T09:07:20.109 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-03-04T09:07:20.109 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-03-04T09:07:20.109 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000186296 s, 2.7 MB/s 2024-03-04T09:07:20.110 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-04T09:07:20.166 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-03-04T09:07:20.167 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/scratch_devs of=/dev/stdout 2024-03-04T09:07:20.186 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-04T09:07:20.186 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_1 2024-03-04T09:07:20.243 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-04T09:07:20.243 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-04T09:07:20.243 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-03-04T09:07:20.243 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-04T09:07:20.244 INFO:teuthology.orchestra.run.smithi190.stdout:Context: system_u:object_r:device_t:s0 2024-03-04T09:07:20.244 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2024-03-04 09:06:56.941891929 +0000 2024-03-04T09:07:20.244 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2024-03-04 09:00:48.889453728 +0000 2024-03-04T09:07:20.244 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2024-03-04 09:00:48.889453728 +0000 2024-03-04T09:07:20.244 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: 2024-03-04 09:00:48.889453728 +0000 2024-03-04T09:07:20.244 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-04T09:07:20.311 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2024-03-04T09:07:20.311 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2024-03-04T09:07:20.311 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000252189 s, 2.0 MB/s 2024-03-04T09:07:20.313 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-04T09:07:20.368 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_2 2024-03-04T09:07:20.423 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-04T09:07:20.423 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-04T09:07:20.424 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-03-04T09:07:20.424 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-04T09:07:20.424 INFO:teuthology.orchestra.run.smithi190.stdout:Context: system_u:object_r:device_t:s0 2024-03-04T09:07:20.424 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2024-03-04 09:06:56.942891901 +0000 2024-03-04T09:07:20.424 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2024-03-04 09:00:49.238443868 +0000 2024-03-04T09:07:20.424 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2024-03-04 09:00:49.238443868 +0000 2024-03-04T09:07:20.424 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: 2024-03-04 09:00:49.238443868 +0000 2024-03-04T09:07:20.424 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-04T09:07:20.490 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2024-03-04T09:07:20.490 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2024-03-04T09:07:20.490 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000200369 s, 2.6 MB/s 2024-03-04T09:07:20.491 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-04T09:07:20.547 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_3 2024-03-04T09:07:20.602 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-04T09:07:20.602 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-04T09:07:20.602 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-03-04T09:07:20.603 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-04T09:07:20.603 INFO:teuthology.orchestra.run.smithi190.stdout:Context: system_u:object_r:device_t:s0 2024-03-04T09:07:20.603 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2024-03-04 09:06:56.942891901 +0000 2024-03-04T09:07:20.603 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2024-03-04 09:00:49.595433783 +0000 2024-03-04T09:07:20.603 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2024-03-04 09:00:49.595433783 +0000 2024-03-04T09:07:20.603 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: 2024-03-04 09:00:49.595433783 +0000 2024-03-04T09:07:20.603 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-04T09:07:20.671 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2024-03-04T09:07:20.672 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2024-03-04T09:07:20.672 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000236727 s, 2.2 MB/s 2024-03-04T09:07:20.672 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-04T09:07:20.727 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_4 2024-03-04T09:07:20.781 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-04T09:07:20.781 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-04T09:07:20.781 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-03-04T09:07:20.781 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-04T09:07:20.782 INFO:teuthology.orchestra.run.smithi190.stdout:Context: system_u:object_r:device_t:s0 2024-03-04T09:07:20.782 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2024-03-04 09:06:56.942891901 +0000 2024-03-04T09:07:20.782 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2024-03-04 09:00:49.931424290 +0000 2024-03-04T09:07:20.782 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2024-03-04 09:00:49.931424290 +0000 2024-03-04T09:07:20.782 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: 2024-03-04 09:00:49.931424290 +0000 2024-03-04T09:07:20.782 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-04T09:07:20.845 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:20 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:20.845 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:20 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:20.845 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:20 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:07:20.845 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:20 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:07:20.845 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:20 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:07:20.845 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:20 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:20.845 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:20 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-04T09:07:20.846 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:20 smithi190 ceph-mon[36341]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:20.846 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:20 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-04T09:07:20.846 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:20 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-04T09:07:20.846 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:20 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:07:20.846 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:20 smithi190 ceph-mon[36341]: Deploying daemon mgr.z on smithi190 2024-03-04T09:07:20.847 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2024-03-04T09:07:20.847 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2024-03-04T09:07:20.847 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000168251 s, 3.0 MB/s 2024-03-04T09:07:20.848 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-04T09:07:20.904 INFO:tasks.cephadm:Deploying osd.0 on smithi082 with /dev/vg_nvme/lv_4... 2024-03-04T09:07:20.904 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-03-04T09:07:20.928 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:20 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:20.928 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:20 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:20.928 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:20 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:07:20.928 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:20 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:07:20.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:20 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:07:20.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:20 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:20.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:20 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-04T09:07:20.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:20 smithi102 ceph-mon[36220]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:20.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:20 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-04T09:07:20.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:20 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-04T09:07:20.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:20 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:07:20.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:20 smithi102 ceph-mon[36220]: Deploying daemon mgr.z on smithi190 2024-03-04T09:07:20.931 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:20 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:20.931 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:20 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:20.931 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:20 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:07:20.931 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:20 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:07:20.932 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:20 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:07:20.932 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:20 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:20.932 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:20 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-04T09:07:20.932 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:20 smithi082 ceph-mon[32880]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:20.932 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:20 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-04T09:07:20.932 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:20 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-04T09:07:20.932 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:20 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:07:20.932 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:20 smithi082 ceph-mon[32880]: Deploying daemon mgr.z on smithi190 2024-03-04T09:07:21.141 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:07:22.670 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:07:22 smithi190 systemd[1]: Started Ceph mgr.z for 2e533fc8-da06-11ee-95c6-87774f69a715. 2024-03-04T09:07:23.144 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-03-04T09:07:23.144 INFO:teuthology.orchestra.run.smithi082.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-03-04T09:07:23.144 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10+0 records in 2024-03-04T09:07:23.144 INFO:teuthology.orchestra.run.smithi082.stderr:10+0 records out 2024-03-04T09:07:23.144 INFO:teuthology.orchestra.run.smithi082.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0115299 s, 909 MB/s 2024-03-04T09:07:23.144 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping successful for: 2024-03-04T09:07:23.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:23 smithi190 ceph-mon[36341]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:23.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:23 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:23.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:23 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:23.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:23 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:23.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:23 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-04T09:07:23.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:23 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-04T09:07:23.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:23 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-04T09:07:23.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:23 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:07:23.421 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:07:23 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z[38195]: 2024-03-04T09:07:23.061+0000 7f14dfcb7200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-04T09:07:23.421 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:07:23 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z[38195]: 2024-03-04T09:07:23.151+0000 7f14dfcb7200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-04T09:07:23.436 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:23 smithi102 ceph-mon[36220]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:23.436 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:23 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:23.436 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:23 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:23.436 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:23 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:23.436 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:23 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-04T09:07:23.436 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:23 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-04T09:07:23.437 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:23 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-04T09:07:23.437 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:23 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:07:23.467 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:23 smithi082 ceph-mon[32880]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:23.468 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:23 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:23.468 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:23 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:23.468 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:23 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:23.468 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:23 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-04T09:07:23.468 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:23 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-04T09:07:23.468 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:23 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-04T09:07:23.468 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:23 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:07:23.779 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph orch daemon add osd smithi082:vg_nvme/lv_4 2024-03-04T09:07:24.057 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:07:24.099 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:07:23 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z[38195]: 2024-03-04T09:07:23.780+0000 7f14dfcb7200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-04T09:07:24.099 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:07:23 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z[38195]: 2024-03-04T09:07:23.870+0000 7f14dfcb7200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-04T09:07:24.099 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:07:24 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z[38195]: 2024-03-04T09:07:24.009+0000 7f14dfcb7200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-04T09:07:24.415 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:24 smithi102 ceph-mon[36220]: Deploying daemon mgr.y on smithi102 2024-03-04T09:07:24.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:24 smithi190 ceph-mon[36341]: Deploying daemon mgr.y on smithi102 2024-03-04T09:07:24.420 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:07:24 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z[38195]: 2024-03-04T09:07:24.102+0000 7f14dfcb7200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-04T09:07:24.420 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:07:24 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z[38195]: 2024-03-04T09:07:24.184+0000 7f14dfcb7200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-04T09:07:24.496 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:24 smithi082 ceph-mon[32880]: Deploying daemon mgr.y on smithi102 2024-03-04T09:07:24.727 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:07:24 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z[38195]: 2024-03-04T09:07:24.443+0000 7f14dfcb7200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-04T09:07:24.727 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:07:24 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z[38195]: 2024-03-04T09:07:24.549+0000 7f14dfcb7200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-04T09:07:24.728 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:07:24 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z[38195]: 2024-03-04T09:07:24.633+0000 7f14dfcb7200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-04T09:07:24.728 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:07:24 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z[38195]: 2024-03-04T09:07:24.731+0000 7f14dfcb7200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-04T09:07:25.075 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:07:24 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z[38195]: 2024-03-04T09:07:24.911+0000 7f14dfcb7200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-04T09:07:25.388 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:25 smithi082 ceph-mon[32880]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:25.388 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:25 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:25.388 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:25 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:25.388 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:25 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:25.388 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:25 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:25.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:25 smithi190 ceph-mon[36341]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:25.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:25 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:25.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:25 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:25.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:25 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:25.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:25 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:25.428 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:25 smithi102 ceph-mon[36220]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:25.428 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:25 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:25.428 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:25 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:25.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:25 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:25.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:25 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:25.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:25.627+0000 7f2906f5e700 1 -- 172.21.15.82:0/1641523915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2900102b90 msgr2=0x7f2900109440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:07:25.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:25.627+0000 7f2906f5e700 1 --2- 172.21.15.82:0/1641523915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2900102b90 0x7f2900109440 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f28f800b0d0 tx=0x7f28f800b3e0 comp rx=0 tx=0).stop 2024-03-04T09:07:25.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:25.627+0000 7f2906f5e700 1 -- 172.21.15.82:0/1641523915 shutdown_connections 2024-03-04T09:07:25.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:25.627+0000 7f2906f5e700 1 --2- 172.21.15.82:0/1641523915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2900102b90 0x7f2900109440 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:07:25.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:25.627+0000 7f2906f5e700 1 --2- 172.21.15.82:0/1641523915 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2900100ff0 0x7f2900101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:07:25.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:25.627+0000 7f2906f5e700 1 --2- 172.21.15.82:0/1641523915 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29001021f0 0x7f2900102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:07:25.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:25.627+0000 7f2906f5e700 1 -- 172.21.15.82:0/1641523915 >> 172.21.15.82:0/1641523915 conn(0x7f29000fc5b0 msgr2=0x7f29000fe9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:07:25.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:25.627+0000 7f2906f5e700 1 -- 172.21.15.82:0/1641523915 shutdown_connections 2024-03-04T09:07:25.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:25.627+0000 7f2906f5e700 1 -- 172.21.15.82:0/1641523915 wait complete. 2024-03-04T09:07:25.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:25.628+0000 7f2906f5e700 1 Processor -- start 2024-03-04T09:07:25.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:25.628+0000 7f2906f5e700 1 -- start start 2024-03-04T09:07:25.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:25.628+0000 7f2906f5e700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2900100ff0 0x7f290019a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:07:25.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:25.628+0000 7f2906f5e700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29001021f0 0x7f290019a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:07:25.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:25.628+0000 7f2906f5e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2900102b90 0x7f29001a19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:07:25.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:25.628+0000 7f2906f5e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f290010cc20 con 0x7f2900102b90 2024-03-04T09:07:25.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:25.628+0000 7f2906f5e700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f290010caa0 con 0x7f2900100ff0 2024-03-04T09:07:25.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:25.628+0000 7f2906f5e700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f290010cda0 con 0x7f29001021f0 2024-03-04T09:07:25.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:25.628+0000 7f29054fb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2900102b90 0x7f29001a19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:07:25.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:25.628+0000 7f29054fb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2900102b90 0x7f29001a19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51486/0 (socket says 172.21.15.82:51486) 2024-03-04T09:07:25.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:25.628+0000 7f29054fb700 1 -- 172.21.15.82:0/2471314317 learned_addr learned my addr 172.21.15.82:0/2471314317 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:07:25.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:25.628+0000 7f2904cfa700 1 --2- 172.21.15.82:0/2471314317 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2900100ff0 0x7f290019a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:07:25.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:25.628+0000 7f28fffff700 1 --2- 172.21.15.82:0/2471314317 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29001021f0 0x7f290019a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:07:25.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:25.628+0000 7f29054fb700 1 -- 172.21.15.82:0/2471314317 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29001021f0 msgr2=0x7f290019a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:07:25.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:25.628+0000 7f29054fb700 1 --2- 172.21.15.82:0/2471314317 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29001021f0 0x7f290019a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:07:25.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:25.628+0000 7f29054fb700 1 -- 172.21.15.82:0/2471314317 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2900100ff0 msgr2=0x7f290019a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:07:25.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:25.628+0000 7f29054fb700 1 --2- 172.21.15.82:0/2471314317 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2900100ff0 0x7f290019a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:07:25.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:25.628+0000 7f29054fb700 1 -- 172.21.15.82:0/2471314317 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29001a2080 con 0x7f2900102b90 2024-03-04T09:07:25.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:25.628+0000 7f29054fb700 1 --2- 172.21.15.82:0/2471314317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2900102b90 0x7f29001a19e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f28f8004fd0 tx=0x7f28f8008f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:07:25.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:25.629+0000 7f28fdffb700 1 -- 172.21.15.82:0/2471314317 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f8021020 con 0x7f2900102b90 2024-03-04T09:07:25.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:25.629+0000 7f28fdffb700 1 -- 172.21.15.82:0/2471314317 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f28f8007c40 con 0x7f2900102b90 2024-03-04T09:07:25.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:25.629+0000 7f28fdffb700 1 -- 172.21.15.82:0/2471314317 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f801b720 con 0x7f2900102b90 2024-03-04T09:07:25.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:25.629+0000 7f2906f5e700 1 -- 172.21.15.82:0/2471314317 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29001a2310 con 0x7f2900102b90 2024-03-04T09:07:25.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:25.629+0000 7f2906f5e700 1 -- 172.21.15.82:0/2471314317 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29001a2760 con 0x7f2900102b90 2024-03-04T09:07:25.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:25.630+0000 7f28fdffb700 1 -- 172.21.15.82:0/2471314317 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 45984+0+0 (secure 0 0 0) 0x7f28f8024020 con 0x7f2900102b90 2024-03-04T09:07:25.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:25.630+0000 7f2906f5e700 1 -- 172.21.15.82:0/2471314317 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2900068d80 con 0x7f2900102b90 2024-03-04T09:07:25.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:25.630+0000 7f28fdffb700 1 --2- 172.21.15.82:0/2471314317 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f28f0038e80 0x7f28f003b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:07:25.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:25.630+0000 7f28fdffb700 1 -- 172.21.15.82:0/2471314317 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f28f804ce10 con 0x7f2900102b90 2024-03-04T09:07:25.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:25.630+0000 7f2904cfa700 1 --2- 172.21.15.82:0/2471314317 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f28f0038e80 0x7f28f003b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:07:25.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:25.630+0000 7f2904cfa700 1 --2- 172.21.15.82:0/2471314317 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f28f0038e80 0x7f28f003b340 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2900102050 tx=0x7f28f4007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:07:25.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:25.635+0000 7f28fdffb700 1 -- 172.21.15.82:0/2471314317 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f28f802b020 con 0x7f2900102b90 2024-03-04T09:07:25.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:25.841+0000 7f2906f5e700 1 -- 172.21.15.82:0/2471314317 --> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f29000fe6a0 con 0x7f28f0038e80 2024-03-04T09:07:25.928 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:07:25 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-y[37603]: 2024-03-04T09:07:25.676+0000 7f21238d6200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-04T09:07:26.170 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:07:25 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z[38195]: 2024-03-04T09:07:25.961+0000 7f14dfcb7200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-04T09:07:26.170 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:07:26 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z[38195]: 2024-03-04T09:07:26.091+0000 7f14dfcb7200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-04T09:07:26.429 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:07:26 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-y[37603]: 2024-03-04T09:07:26.357+0000 7f21238d6200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-04T09:07:26.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:26 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:07:26.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:26 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T09:07:26.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:26 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T09:07:26.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:26 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:07:26.461 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:26 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:07:26.461 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:26 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T09:07:26.461 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:26 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T09:07:26.462 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:26 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:07:26.528 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:26 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:07:26.528 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:26 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T09:07:26.528 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:26 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T09:07:26.528 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:26 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:07:26.529 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:07:26 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z[38195]: 2024-03-04T09:07:26.431+0000 7f14dfcb7200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-04T09:07:26.774 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:07:26 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-y[37603]: 2024-03-04T09:07:26.448+0000 7f21238d6200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-04T09:07:26.774 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:07:26 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-y[37603]: 2024-03-04T09:07:26.598+0000 7f21238d6200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-04T09:07:26.774 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:07:26 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-y[37603]: 2024-03-04T09:07:26.695+0000 7f21238d6200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-04T09:07:26.774 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:07:26 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-y[37603]: 2024-03-04T09:07:26.778+0000 7f21238d6200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-04T09:07:26.915 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:07:26 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z[38195]: 2024-03-04T09:07:26.532+0000 7f14dfcb7200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-04T09:07:26.915 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:07:26 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z[38195]: 2024-03-04T09:07:26.732+0000 7f14dfcb7200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-04T09:07:26.915 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:07:26 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z[38195]: 2024-03-04T09:07:26.919+0000 7f14dfcb7200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-04T09:07:27.322 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:07:27 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-y[37603]: 2024-03-04T09:07:27.039+0000 7f21238d6200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-04T09:07:27.322 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:07:27 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-y[37603]: 2024-03-04T09:07:27.146+0000 7f21238d6200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-04T09:07:27.322 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:07:27 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-y[37603]: 2024-03-04T09:07:27.233+0000 7f21238d6200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-04T09:07:27.322 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:07:27 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-y[37603]: 2024-03-04T09:07:27.325+0000 7f21238d6200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-04T09:07:27.322 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:27 smithi102 ceph-mon[36220]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:07:27.322 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:27 smithi102 ceph-mon[36220]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:27.322 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:27 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:27.322 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:27 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:27.322 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:27 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:27.322 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:27 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:27.323 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:27 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:07:27.323 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:27 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:07:27.323 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:27 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:27.323 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:27 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-04T09:07:27.323 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:27 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-04T09:07:27.323 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:27 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:07:27.464 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:27 smithi082 ceph-mon[32880]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:07:27.464 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:27 smithi082 ceph-mon[32880]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:27.464 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:27 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:27.465 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:27 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:27.465 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:27 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:27.465 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:27 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:27.465 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:27 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:07:27.465 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:27 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:07:27.465 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:27 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:27.465 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:27 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-04T09:07:27.465 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:27 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-04T09:07:27.465 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:27 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:07:27.484 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:07:27 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z[38195]: 2024-03-04T09:07:27.204+0000 7f14dfcb7200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-04T09:07:27.484 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:07:27 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z[38195]: 2024-03-04T09:07:27.488+0000 7f14dfcb7200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-04T09:07:27.484 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:27 smithi190 ceph-mon[36341]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:07:27.485 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:27 smithi190 ceph-mon[36341]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:27.485 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:27 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:27.485 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:27 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:27.485 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:27 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:27.485 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:27 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:27.485 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:27 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:07:27.485 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:27 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:07:27.485 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:27 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:27.485 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:27 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-04T09:07:27.485 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:27 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-04T09:07:27.485 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:27 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:07:27.678 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:07:27 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-y[37603]: 2024-03-04T09:07:27.498+0000 7f21238d6200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-04T09:07:27.920 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:07:27 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z[38195]: 2024-03-04T09:07:27.727+0000 7f14dfcb7200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-04T09:07:28.527 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:28 smithi190 ceph-mon[36341]: Reconfiguring mgr.x (unknown last config time)... 2024-03-04T09:07:28.527 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:28 smithi190 ceph-mon[36341]: Reconfiguring daemon mgr.x on smithi082 2024-03-04T09:07:28.527 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:28 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:28.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:28 smithi082 ceph-mon[32880]: Reconfiguring mgr.x (unknown last config time)... 2024-03-04T09:07:28.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:28 smithi082 ceph-mon[32880]: Reconfiguring daemon mgr.x on smithi082 2024-03-04T09:07:28.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:28 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:28.585 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:07:28 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-y[37603]: 2024-03-04T09:07:28.461+0000 7f21238d6200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-04T09:07:28.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:28 smithi102 ceph-mon[36220]: Reconfiguring mgr.x (unknown last config time)... 2024-03-04T09:07:28.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:28 smithi102 ceph-mon[36220]: Reconfiguring daemon mgr.x on smithi082 2024-03-04T09:07:28.586 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:28 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:28.914 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:07:28 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-y[37603]: 2024-03-04T09:07:28.589+0000 7f21238d6200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-04T09:07:28.914 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:07:28 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-y[37603]: 2024-03-04T09:07:28.918+0000 7f21238d6200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-04T09:07:28.920 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:07:28 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z[38195]: 2024-03-04T09:07:28.531+0000 7f14dfcb7200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-04T09:07:29.178 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:07:29 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-y[37603]: 2024-03-04T09:07:29.005+0000 7f21238d6200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-04T09:07:29.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:29 smithi190 ceph-mon[36341]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:29.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:29 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/757931544' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "085b5c4b-ede9-4d0d-b994-50c89d991012"}]: dispatch 2024-03-04T09:07:29.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:29 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/757931544' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "085b5c4b-ede9-4d0d-b994-50c89d991012"}]': finished 2024-03-04T09:07:29.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:29 smithi190 ceph-mon[36341]: osdmap e5: 1 total, 0 up, 1 in 2024-03-04T09:07:29.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:29 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-04T09:07:29.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:29 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/1132032453' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T09:07:29.421 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:07:29 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z[38195]: 2024-03-04T09:07:29.107+0000 7f14dfcb7200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-04T09:07:29.421 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:07:29 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z[38195]: 2024-03-04T09:07:29.206+0000 7f14dfcb7200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-04T09:07:29.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:29 smithi082 ceph-mon[32880]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:29.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:29 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/757931544' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "085b5c4b-ede9-4d0d-b994-50c89d991012"}]: dispatch 2024-03-04T09:07:29.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:29 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/757931544' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "085b5c4b-ede9-4d0d-b994-50c89d991012"}]': finished 2024-03-04T09:07:29.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:29 smithi082 ceph-mon[32880]: osdmap e5: 1 total, 0 up, 1 in 2024-03-04T09:07:29.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:29 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-04T09:07:29.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:29 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/1132032453' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T09:07:29.653 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:07:29 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-y[37603]: 2024-03-04T09:07:29.197+0000 7f21238d6200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-04T09:07:29.653 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:07:29 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-y[37603]: 2024-03-04T09:07:29.378+0000 7f21238d6200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-04T09:07:29.653 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:29 smithi102 ceph-mon[36220]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:29.653 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:29 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/757931544' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "085b5c4b-ede9-4d0d-b994-50c89d991012"}]: dispatch 2024-03-04T09:07:29.653 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:29 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/757931544' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "085b5c4b-ede9-4d0d-b994-50c89d991012"}]': finished 2024-03-04T09:07:29.653 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:29 smithi102 ceph-mon[36220]: osdmap e5: 1 total, 0 up, 1 in 2024-03-04T09:07:29.654 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:29 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-04T09:07:29.654 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:29 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/1132032453' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T09:07:29.909 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:07:29 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-y[37603]: 2024-03-04T09:07:29.656+0000 7f21238d6200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-04T09:07:29.909 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:07:29 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-y[37603]: 2024-03-04T09:07:29.912+0000 7f21238d6200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-04T09:07:29.920 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:07:29 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z[38195]: 2024-03-04T09:07:29.425+0000 7f14dfcb7200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-04T09:07:30.178 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:07:30 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-y[37603]: 2024-03-04T09:07:30.145+0000 7f21238d6200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-04T09:07:30.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:30.258+0000 7f28fdffb700 1 -- 172.21.15.82:0/2471314317 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 14) v1 ==== 91342+0+0 (secure 0 0 0) 0x7f28f8026450 con 0x7f2900102b90 2024-03-04T09:07:30.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:30 smithi082 ceph-mon[32880]: Standby manager daemon z started 2024-03-04T09:07:30.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:30 smithi082 ceph-mon[32880]: from='mgr.? 172.21.15.190:0/521267737' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-03-04T09:07:30.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:30 smithi082 ceph-mon[32880]: from='mgr.? 172.21.15.190:0/521267737' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-04T09:07:30.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:30 smithi082 ceph-mon[32880]: from='mgr.? 172.21.15.190:0/521267737' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-03-04T09:07:30.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:30 smithi082 ceph-mon[32880]: from='mgr.? 172.21.15.190:0/521267737' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-04T09:07:30.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:30 smithi190 ceph-mon[36341]: Standby manager daemon z started 2024-03-04T09:07:30.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:30 smithi190 ceph-mon[36341]: from='mgr.? 172.21.15.190:0/521267737' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-03-04T09:07:30.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:30 smithi190 ceph-mon[36341]: from='mgr.? 172.21.15.190:0/521267737' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-04T09:07:30.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:30 smithi190 ceph-mon[36341]: from='mgr.? 172.21.15.190:0/521267737' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-03-04T09:07:30.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:30 smithi190 ceph-mon[36341]: from='mgr.? 172.21.15.190:0/521267737' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-04T09:07:30.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:30 smithi102 ceph-mon[36220]: Standby manager daemon z started 2024-03-04T09:07:30.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:30 smithi102 ceph-mon[36220]: from='mgr.? 172.21.15.190:0/521267737' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-03-04T09:07:30.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:30 smithi102 ceph-mon[36220]: from='mgr.? 172.21.15.190:0/521267737' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-04T09:07:30.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:30 smithi102 ceph-mon[36220]: from='mgr.? 172.21.15.190:0/521267737' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-03-04T09:07:30.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:30 smithi102 ceph-mon[36220]: from='mgr.? 172.21.15.190:0/521267737' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-04T09:07:31.253 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:07:30 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-y[37603]: 2024-03-04T09:07:30.935+0000 7f21238d6200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-04T09:07:31.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:31 smithi082 ceph-mon[32880]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:31.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:31 smithi082 ceph-mon[32880]: mgrmap e14: x(active, since 78s), standbys: z 2024-03-04T09:07:31.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:31 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-03-04T09:07:31.588 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:07:31 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-y[37603]: 2024-03-04T09:07:31.497+0000 7f21238d6200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-04T09:07:31.588 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:31 smithi102 ceph-mon[36220]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:31.589 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:31 smithi102 ceph-mon[36220]: mgrmap e14: x(active, since 78s), standbys: z 2024-03-04T09:07:31.589 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:31 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-03-04T09:07:31.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:31 smithi190 ceph-mon[36341]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:31.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:31 smithi190 ceph-mon[36341]: mgrmap e14: x(active, since 78s), standbys: z 2024-03-04T09:07:31.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:31 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-03-04T09:07:31.928 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:07:31 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-y[37603]: 2024-03-04T09:07:31.592+0000 7f21238d6200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-04T09:07:31.929 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:07:31 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-y[37603]: 2024-03-04T09:07:31.806+0000 7f21238d6200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-04T09:07:32.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:32.268+0000 7f28fdffb700 1 -- 172.21.15.82:0/2471314317 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mgrmap(e 15) v1 ==== 136700+0+0 (secure 0 0 0) 0x7f28f8011c90 con 0x7f2900102b90 2024-03-04T09:07:32.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:32 smithi082 ceph-mon[32880]: Standby manager daemon y started 2024-03-04T09:07:32.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:32 smithi082 ceph-mon[32880]: from='mgr.? 172.21.15.102:0/1420928536' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-03-04T09:07:32.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:32 smithi082 ceph-mon[32880]: from='mgr.? 172.21.15.102:0/1420928536' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-04T09:07:32.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:32 smithi082 ceph-mon[32880]: from='mgr.? 172.21.15.102:0/1420928536' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-03-04T09:07:32.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:32 smithi082 ceph-mon[32880]: from='mgr.? 172.21.15.102:0/1420928536' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-04T09:07:32.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:32 smithi190 ceph-mon[36341]: Standby manager daemon y started 2024-03-04T09:07:32.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:32 smithi190 ceph-mon[36341]: from='mgr.? 172.21.15.102:0/1420928536' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-03-04T09:07:32.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:32 smithi190 ceph-mon[36341]: from='mgr.? 172.21.15.102:0/1420928536' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-04T09:07:32.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:32 smithi190 ceph-mon[36341]: from='mgr.? 172.21.15.102:0/1420928536' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-03-04T09:07:32.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:32 smithi190 ceph-mon[36341]: from='mgr.? 172.21.15.102:0/1420928536' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-04T09:07:32.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:32 smithi102 ceph-mon[36220]: Standby manager daemon y started 2024-03-04T09:07:32.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:32 smithi102 ceph-mon[36220]: from='mgr.? 172.21.15.102:0/1420928536' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-03-04T09:07:32.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:32 smithi102 ceph-mon[36220]: from='mgr.? 172.21.15.102:0/1420928536' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-04T09:07:32.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:32 smithi102 ceph-mon[36220]: from='mgr.? 172.21.15.102:0/1420928536' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-03-04T09:07:32.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:32 smithi102 ceph-mon[36220]: from='mgr.? 172.21.15.102:0/1420928536' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-04T09:07:33.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:33 smithi082 ceph-mon[32880]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:33.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:33 smithi082 ceph-mon[32880]: mgrmap e15: x(active, since 80s), standbys: z, y 2024-03-04T09:07:33.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:33 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-04T09:07:33.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:33 smithi190 ceph-mon[36341]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:33.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:33 smithi190 ceph-mon[36341]: mgrmap e15: x(active, since 80s), standbys: z, y 2024-03-04T09:07:33.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:33 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-04T09:07:33.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:33 smithi102 ceph-mon[36220]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:33.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:33 smithi102 ceph-mon[36220]: mgrmap e15: x(active, since 80s), standbys: z, y 2024-03-04T09:07:33.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:33 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-04T09:07:35.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:35 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:35.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:35 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:35.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:35 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:07:35.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:35 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:07:35.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:35 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:07:35.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:35 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:35.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:35 smithi082 ceph-mon[32880]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:35.378 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:35 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:35.378 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:35 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:35.378 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:35 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:07:35.378 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:35 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:07:35.378 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:35 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:07:35.378 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:35 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:35.378 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:35 smithi190 ceph-mon[36341]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:35.428 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:35 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:35.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:35 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:35.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:35 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:07:35.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:35 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:07:35.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:35 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:07:35.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:35 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:35.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:35 smithi102 ceph-mon[36220]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:37.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:37 smithi082 ceph-mon[32880]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:37.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:37 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-04T09:07:37.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:37 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:07:37.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:37 smithi190 ceph-mon[36341]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:37.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:37 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-04T09:07:37.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:37 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:07:37.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:37 smithi102 ceph-mon[36220]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:37.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:37 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-04T09:07:37.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:37 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:07:38.316 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:38 smithi082 ceph-mon[32880]: Deploying daemon osd.0 on smithi082 2024-03-04T09:07:38.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:38 smithi190 ceph-mon[36341]: Deploying daemon osd.0 on smithi082 2024-03-04T09:07:38.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:38 smithi102 ceph-mon[36220]: Deploying daemon osd.0 on smithi082 2024-03-04T09:07:39.433 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:39 smithi082 ceph-mon[32880]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:39.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:39 smithi190 ceph-mon[36341]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:39.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:39 smithi102 ceph-mon[36220]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:41.496 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:41 smithi082 ceph-mon[32880]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:41.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:41 smithi190 ceph-mon[36341]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:41.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:41 smithi102 ceph-mon[36220]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:43.316 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:43 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:43.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:43 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:43.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:43 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:07:43.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:43 smithi082 ceph-mon[32880]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:43.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:43 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:43.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:43 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:43.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:43 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:07:43.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:43 smithi190 ceph-mon[36341]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:43.428 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:43 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:43.428 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:43 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:43.428 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:43 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:07:43.428 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:43 smithi102 ceph-mon[36220]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:45.525 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:45 smithi082 ceph-mon[32880]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:45.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:45.596+0000 7f28fdffb700 1 -- 172.21.15.82:0/2471314317 <== mgr.14152 v2:172.21.15.82:6800/1278635224 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f29000fe6a0 con 0x7f28f0038e80 2024-03-04T09:07:45.593 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 0 on host 'smithi082' 2024-03-04T09:07:45.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:45.600+0000 7f2906f5e700 1 -- 172.21.15.82:0/2471314317 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f28f0038e80 msgr2=0x7f28f003b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:07:45.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:45.600+0000 7f2906f5e700 1 --2- 172.21.15.82:0/2471314317 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f28f0038e80 0x7f28f003b340 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2900102050 tx=0x7f28f4007400 comp rx=0 tx=0).stop 2024-03-04T09:07:45.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:45.600+0000 7f2906f5e700 1 -- 172.21.15.82:0/2471314317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2900102b90 msgr2=0x7f29001a19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:07:45.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:45.600+0000 7f2906f5e700 1 --2- 172.21.15.82:0/2471314317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2900102b90 0x7f29001a19e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f28f8004fd0 tx=0x7f28f8008f60 comp rx=0 tx=0).stop 2024-03-04T09:07:45.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:45.600+0000 7f2906f5e700 1 -- 172.21.15.82:0/2471314317 shutdown_connections 2024-03-04T09:07:45.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:45.600+0000 7f2906f5e700 1 --2- 172.21.15.82:0/2471314317 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f28f0038e80 0x7f28f003b340 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:07:45.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:45.600+0000 7f2906f5e700 1 --2- 172.21.15.82:0/2471314317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2900102b90 0x7f29001a19e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:07:45.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:45.600+0000 7f2906f5e700 1 --2- 172.21.15.82:0/2471314317 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2900100ff0 0x7f290019a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:07:45.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:45.600+0000 7f2906f5e700 1 --2- 172.21.15.82:0/2471314317 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29001021f0 0x7f290019a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:07:45.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:45.600+0000 7f2906f5e700 1 -- 172.21.15.82:0/2471314317 >> 172.21.15.82:0/2471314317 conn(0x7f29000fc5b0 msgr2=0x7f29000fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:07:45.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:45.601+0000 7f2906f5e700 1 -- 172.21.15.82:0/2471314317 shutdown_connections 2024-03-04T09:07:45.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:07:45.601+0000 7f2906f5e700 1 -- 172.21.15.82:0/2471314317 wait complete. 2024-03-04T09:07:45.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:45 smithi190 ceph-mon[36341]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:45.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:45 smithi102 ceph-mon[36220]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:46.224 DEBUG:teuthology.orchestra.run.smithi082:osd.0> sudo journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@osd.0.service 2024-03-04T09:07:46.227 INFO:tasks.cephadm:Deploying osd.1 on smithi102 with /dev/vg_nvme/lv_4... 2024-03-04T09:07:46.227 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-03-04T09:07:46.476 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.b/config 2024-03-04T09:07:46.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:46 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:46.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:46 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:46.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:46 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:46.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:46 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:46.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:46 smithi082 ceph-mon[32880]: from='osd.0 [v2:172.21.15.82:6802/709655235,v1:172.21.15.82:6803/709655235]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-04T09:07:46.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:46 smithi082 ceph-mon[32880]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:46.855 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:46 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:46.856 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:46 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:46.856 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:46 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:46.856 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:46 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:46.856 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:46 smithi102 ceph-mon[36220]: from='osd.0 [v2:172.21.15.82:6802/709655235,v1:172.21.15.82:6803/709655235]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-04T09:07:46.856 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:46 smithi102 ceph-mon[36220]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:46.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:46 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:46.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:46 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:46.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:46 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:46.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:46 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:46.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:46 smithi190 ceph-mon[36341]: from='osd.0 [v2:172.21.15.82:6802/709655235,v1:172.21.15.82:6803/709655235]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-04T09:07:46.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:46 smithi190 ceph-mon[36341]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:47.845 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:47 smithi102 ceph-mon[36220]: from='osd.0 [v2:172.21.15.82:6802/709655235,v1:172.21.15.82:6803/709655235]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-04T09:07:47.845 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:47 smithi102 ceph-mon[36220]: osdmap e6: 1 total, 0 up, 1 in 2024-03-04T09:07:47.845 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:47 smithi102 ceph-mon[36220]: from='osd.0 [v2:172.21.15.82:6802/709655235,v1:172.21.15.82:6803/709655235]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-03-04T09:07:47.845 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:47 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-04T09:07:48.066 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:47 smithi082 ceph-mon[32880]: from='osd.0 [v2:172.21.15.82:6802/709655235,v1:172.21.15.82:6803/709655235]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-04T09:07:48.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:47 smithi082 ceph-mon[32880]: osdmap e6: 1 total, 0 up, 1 in 2024-03-04T09:07:48.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:47 smithi082 ceph-mon[32880]: from='osd.0 [v2:172.21.15.82:6802/709655235,v1:172.21.15.82:6803/709655235]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-03-04T09:07:48.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:47 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-04T09:07:48.067 INFO:journalctl@ceph.osd.0.smithi082.stdout:Mar 04 09:07:47 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-0[47395]: 2024-03-04T09:07:47.682+0000 7fcadb9dc700 -1 osd.0 0 waiting for initial osdmap 2024-03-04T09:07:48.067 INFO:journalctl@ceph.osd.0.smithi082.stdout:Mar 04 09:07:47 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-0[47395]: 2024-03-04T09:07:47.688+0000 7fcad77cf700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T09:07:48.170 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:47 smithi190 ceph-mon[36341]: from='osd.0 [v2:172.21.15.82:6802/709655235,v1:172.21.15.82:6803/709655235]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-04T09:07:48.170 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:47 smithi190 ceph-mon[36341]: osdmap e6: 1 total, 0 up, 1 in 2024-03-04T09:07:48.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:47 smithi190 ceph-mon[36341]: from='osd.0 [v2:172.21.15.82:6802/709655235,v1:172.21.15.82:6803/709655235]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-03-04T09:07:48.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:47 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-04T09:07:48.216 INFO:teuthology.orchestra.run.smithi102.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-03-04T09:07:48.216 INFO:teuthology.orchestra.run.smithi102.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-03-04T09:07:48.216 INFO:teuthology.orchestra.run.smithi102.stderr: stderr: 10+0 records in 2024-03-04T09:07:48.216 INFO:teuthology.orchestra.run.smithi102.stderr:10+0 records out 2024-03-04T09:07:48.216 INFO:teuthology.orchestra.run.smithi102.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0126821 s, 827 MB/s 2024-03-04T09:07:48.216 INFO:teuthology.orchestra.run.smithi102.stderr:--> Zapping successful for: 2024-03-04T09:07:48.774 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:48 smithi102 ceph-mon[36220]: from='osd.0 [v2:172.21.15.82:6802/709655235,v1:172.21.15.82:6803/709655235]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-03-04T09:07:48.774 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:48 smithi102 ceph-mon[36220]: osdmap e7: 1 total, 0 up, 1 in 2024-03-04T09:07:48.774 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:48 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-04T09:07:48.775 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:48 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-04T09:07:48.775 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:48 smithi102 ceph-mon[36220]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:48.807 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph orch daemon add osd smithi102:vg_nvme/lv_4 2024-03-04T09:07:48.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:48 smithi082 ceph-mon[32880]: from='osd.0 [v2:172.21.15.82:6802/709655235,v1:172.21.15.82:6803/709655235]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-03-04T09:07:48.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:48 smithi082 ceph-mon[32880]: osdmap e7: 1 total, 0 up, 1 in 2024-03-04T09:07:48.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:48 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-04T09:07:48.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:48 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-04T09:07:48.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:48 smithi082 ceph-mon[32880]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:49.050 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.b/config 2024-03-04T09:07:49.170 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:48 smithi190 ceph-mon[36341]: from='osd.0 [v2:172.21.15.82:6802/709655235,v1:172.21.15.82:6803/709655235]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-03-04T09:07:49.170 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:48 smithi190 ceph-mon[36341]: osdmap e7: 1 total, 0 up, 1 in 2024-03-04T09:07:49.170 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:48 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-04T09:07:49.170 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:48 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-04T09:07:49.170 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:48 smithi190 ceph-mon[36341]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-04T09:07:49.838 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:49 smithi102 ceph-mon[36220]: purged_snaps scrub starts 2024-03-04T09:07:49.839 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:49 smithi102 ceph-mon[36220]: purged_snaps scrub ok 2024-03-04T09:07:49.839 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:49 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-04T09:07:49.839 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:49 smithi102 ceph-mon[36220]: osd.0 [v2:172.21.15.82:6802/709655235,v1:172.21.15.82:6803/709655235] boot 2024-03-04T09:07:49.839 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:49 smithi102 ceph-mon[36220]: osdmap e8: 1 total, 1 up, 1 in 2024-03-04T09:07:49.839 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:49 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-04T09:07:49.839 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:49 smithi102 ceph-mon[36220]: Detected new or changed devices on smithi082 2024-03-04T09:07:49.839 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:49 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:49.839 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:49 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:49.839 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:49 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:07:49.839 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:49 smithi102 ceph-mon[36220]: Adjusting osd_memory_target on smithi082 to 17088M 2024-03-04T09:07:49.839 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:49 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:49.839 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:49 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:07:49.839 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:49 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:07:49.839 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:49 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:49.840 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:49 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:07:50.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:49 smithi082 ceph-mon[32880]: purged_snaps scrub starts 2024-03-04T09:07:50.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:49 smithi082 ceph-mon[32880]: purged_snaps scrub ok 2024-03-04T09:07:50.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:49 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-04T09:07:50.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:49 smithi082 ceph-mon[32880]: osd.0 [v2:172.21.15.82:6802/709655235,v1:172.21.15.82:6803/709655235] boot 2024-03-04T09:07:50.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:49 smithi082 ceph-mon[32880]: osdmap e8: 1 total, 1 up, 1 in 2024-03-04T09:07:50.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:49 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-04T09:07:50.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:49 smithi082 ceph-mon[32880]: Detected new or changed devices on smithi082 2024-03-04T09:07:50.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:49 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:50.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:49 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:50.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:49 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:07:50.068 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:49 smithi082 ceph-mon[32880]: Adjusting osd_memory_target on smithi082 to 17088M 2024-03-04T09:07:50.068 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:49 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:50.068 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:49 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:07:50.068 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:49 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:07:50.068 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:49 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:50.068 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:49 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:07:50.170 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:49 smithi190 ceph-mon[36341]: purged_snaps scrub starts 2024-03-04T09:07:50.170 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:49 smithi190 ceph-mon[36341]: purged_snaps scrub ok 2024-03-04T09:07:50.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:49 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-04T09:07:50.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:49 smithi190 ceph-mon[36341]: osd.0 [v2:172.21.15.82:6802/709655235,v1:172.21.15.82:6803/709655235] boot 2024-03-04T09:07:50.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:49 smithi190 ceph-mon[36341]: osdmap e8: 1 total, 1 up, 1 in 2024-03-04T09:07:50.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:49 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-04T09:07:50.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:49 smithi190 ceph-mon[36341]: Detected new or changed devices on smithi082 2024-03-04T09:07:50.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:49 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:50.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:49 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:50.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:49 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:07:50.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:49 smithi190 ceph-mon[36341]: Adjusting osd_memory_target on smithi082 to 17088M 2024-03-04T09:07:50.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:49 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:50.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:49 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:07:50.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:49 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:07:50.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:49 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:50.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:49 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:07:50.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:07:50.339+0000 7f0945919700 1 -- 172.21.15.102:0/1062420258 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0940100fe0 msgr2=0x7f0940101400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:07:50.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:07:50.339+0000 7f0945919700 1 --2- 172.21.15.102:0/1062420258 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0940100fe0 0x7f0940101400 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f09340099c0 tx=0x7f0934009cd0 comp rx=0 tx=0).stop 2024-03-04T09:07:50.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:07:50.339+0000 7f0945919700 1 -- 172.21.15.102:0/1062420258 shutdown_connections 2024-03-04T09:07:50.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:07:50.339+0000 7f0945919700 1 --2- 172.21.15.102:0/1062420258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0940102b80 0x7f0940109430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:07:50.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:07:50.339+0000 7f0945919700 1 --2- 172.21.15.102:0/1062420258 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0940100fe0 0x7f0940101400 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:07:50.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:07:50.339+0000 7f0945919700 1 --2- 172.21.15.102:0/1062420258 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f09401021e0 0x7f0940102640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:07:50.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:07:50.339+0000 7f0945919700 1 -- 172.21.15.102:0/1062420258 >> 172.21.15.102:0/1062420258 conn(0x7f09400fc580 msgr2=0x7f09400fe9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:07:50.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:07:50.339+0000 7f0945919700 1 -- 172.21.15.102:0/1062420258 shutdown_connections 2024-03-04T09:07:50.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:07:50.339+0000 7f0945919700 1 -- 172.21.15.102:0/1062420258 wait complete. 2024-03-04T09:07:50.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:07:50.340+0000 7f0945919700 1 Processor -- start 2024-03-04T09:07:50.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:07:50.340+0000 7f0945919700 1 -- start start 2024-03-04T09:07:50.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:07:50.340+0000 7f0945919700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0940100fe0 0x7f0940198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:07:50.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:07:50.340+0000 7f0945919700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09401021e0 0x7f0940198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:07:50.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:07:50.340+0000 7f0945919700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0940102b80 0x7f094019f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:07:50.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:07:50.340+0000 7f0945919700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094010cbd0 con 0x7f09401021e0 2024-03-04T09:07:50.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:07:50.340+0000 7f0945919700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094010ca50 con 0x7f0940100fe0 2024-03-04T09:07:50.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:07:50.340+0000 7f0945919700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094010cd50 con 0x7f0940102b80 2024-03-04T09:07:50.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:07:50.340+0000 7f093effd700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0940100fe0 0x7f0940198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:07:50.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:07:50.340+0000 7f093effd700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0940100fe0 0x7f0940198330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47928/0 (socket says 172.21.15.102:47928) 2024-03-04T09:07:50.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:07:50.340+0000 7f093effd700 1 -- 172.21.15.102:0/787359315 learned_addr learned my addr 172.21.15.102:0/787359315 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-04T09:07:50.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:07:50.341+0000 7f093e7fc700 1 --2- 172.21.15.102:0/787359315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09401021e0 0x7f0940198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:07:50.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:07:50.341+0000 7f093f7fe700 1 --2- 172.21.15.102:0/787359315 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0940102b80 0x7f094019f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:07:50.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:07:50.341+0000 7f093effd700 1 -- 172.21.15.102:0/787359315 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0940102b80 msgr2=0x7f094019f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:07:50.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:07:50.341+0000 7f093effd700 1 --2- 172.21.15.102:0/787359315 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0940102b80 0x7f094019f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:07:50.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:07:50.341+0000 7f093effd700 1 -- 172.21.15.102:0/787359315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09401021e0 msgr2=0x7f0940198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:07:50.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:07:50.341+0000 7f093effd700 1 --2- 172.21.15.102:0/787359315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09401021e0 0x7f0940198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:07:50.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:07:50.341+0000 7f093effd700 1 -- 172.21.15.102:0/787359315 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f094019ff90 con 0x7f0940100fe0 2024-03-04T09:07:50.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:07:50.341+0000 7f093effd700 1 --2- 172.21.15.102:0/787359315 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0940100fe0 0x7f0940198330 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f093400bf60 tx=0x7f093400bf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:07:50.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:07:50.341+0000 7f0944917700 1 -- 172.21.15.102:0/787359315 <== mon.2 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0934009e60 con 0x7f0940100fe0 2024-03-04T09:07:50.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:07:50.341+0000 7f0944917700 1 -- 172.21.15.102:0/787359315 <== mon.2 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f0934005940 con 0x7f0940100fe0 2024-03-04T09:07:50.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:07:50.341+0000 7f0945919700 1 -- 172.21.15.102:0/787359315 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09401a0220 con 0x7f0940100fe0 2024-03-04T09:07:50.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:07:50.341+0000 7f0944917700 1 -- 172.21.15.102:0/787359315 <== mon.2 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09340173f0 con 0x7f0940100fe0 2024-03-04T09:07:50.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:07:50.341+0000 7f0945919700 1 -- 172.21.15.102:0/787359315 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09401a0750 con 0x7f0940100fe0 2024-03-04T09:07:50.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:07:50.342+0000 7f0945919700 1 -- 172.21.15.102:0/787359315 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0940068d80 con 0x7f0940100fe0 2024-03-04T09:07:50.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:07:50.343+0000 7f0944917700 1 -- 172.21.15.102:0/787359315 <== mon.2 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 15) v1 ==== 136700+0+0 (secure 0 0 0) 0x7f093400f680 con 0x7f0940100fe0 2024-03-04T09:07:50.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:07:50.343+0000 7f0944917700 1 --2- 172.21.15.102:0/787359315 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f09280a1e00 0x7f09280a42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:07:50.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:07:50.344+0000 7f0944917700 1 -- 172.21.15.102:0/787359315 <== mon.2 v2:172.21.15.102:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1767+0+0 (secure 0 0 0) 0x7f09340cd150 con 0x7f0940100fe0 2024-03-04T09:07:50.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:07:50.344+0000 7f093e7fc700 1 --2- 172.21.15.102:0/787359315 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f09280a1e00 0x7f09280a42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:07:50.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:07:50.344+0000 7f093e7fc700 1 --2- 172.21.15.102:0/787359315 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f09280a1e00 0x7f09280a42c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0930009c60 tx=0x7f0930009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:07:50.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:07:50.348+0000 7f0944917700 1 -- 172.21.15.102:0/787359315 <== mon.2 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f0934013070 con 0x7f0940100fe0 2024-03-04T09:07:50.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:07:50.550+0000 7f0945919700 1 -- 172.21.15.102:0/787359315 --> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f09400fe780 con 0x7f09280a1e00 2024-03-04T09:07:50.928 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:50 smithi102 ceph-mon[36220]: osdmap e9: 1 total, 1 up, 1 in 2024-03-04T09:07:50.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:50 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:07:50.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:50 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:07:50.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:50 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:50.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:50 smithi102 ceph-mon[36220]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T09:07:50.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:50 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T09:07:50.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:50 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T09:07:50.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:50 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:07:51.066 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:50 smithi082 ceph-mon[32880]: osdmap e9: 1 total, 1 up, 1 in 2024-03-04T09:07:51.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:50 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:07:51.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:50 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:07:51.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:50 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:51.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:50 smithi082 ceph-mon[32880]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T09:07:51.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:50 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T09:07:51.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:50 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T09:07:51.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:50 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:07:51.170 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:50 smithi190 ceph-mon[36341]: osdmap e9: 1 total, 1 up, 1 in 2024-03-04T09:07:51.170 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:50 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:07:51.170 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:50 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:07:51.170 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:50 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:07:51.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:50 smithi190 ceph-mon[36341]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T09:07:51.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:50 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T09:07:51.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:50 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T09:07:51.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:50 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:07:52.258 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:51 smithi102 ceph-mon[36220]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:07:52.316 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:51 smithi082 ceph-mon[32880]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:07:52.342 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:51 smithi190 ceph-mon[36341]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:07:53.260 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:53 smithi190 ceph-mon[36341]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T09:07:53.316 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:53 smithi082 ceph-mon[32880]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T09:07:53.428 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:53 smithi102 ceph-mon[36220]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T09:07:54.316 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:54 smithi082 ceph-mon[32880]: from='client.? 172.21.15.102:0/228352220' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e4dd7079-333e-4bcf-b3af-11fb082a5af9"}]: dispatch 2024-03-04T09:07:54.316 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:54 smithi082 ceph-mon[32880]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e4dd7079-333e-4bcf-b3af-11fb082a5af9"}]: dispatch 2024-03-04T09:07:54.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:54 smithi082 ceph-mon[32880]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e4dd7079-333e-4bcf-b3af-11fb082a5af9"}]': finished 2024-03-04T09:07:54.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:54 smithi082 ceph-mon[32880]: osdmap e10: 2 total, 1 up, 2 in 2024-03-04T09:07:54.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:54 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-04T09:07:54.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:54 smithi082 ceph-mon[32880]: from='client.? 172.21.15.102:0/545130894' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T09:07:54.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:54 smithi190 ceph-mon[36341]: from='client.? 172.21.15.102:0/228352220' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e4dd7079-333e-4bcf-b3af-11fb082a5af9"}]: dispatch 2024-03-04T09:07:54.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:54 smithi190 ceph-mon[36341]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e4dd7079-333e-4bcf-b3af-11fb082a5af9"}]: dispatch 2024-03-04T09:07:54.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:54 smithi190 ceph-mon[36341]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e4dd7079-333e-4bcf-b3af-11fb082a5af9"}]': finished 2024-03-04T09:07:54.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:54 smithi190 ceph-mon[36341]: osdmap e10: 2 total, 1 up, 2 in 2024-03-04T09:07:54.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:54 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-04T09:07:54.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:54 smithi190 ceph-mon[36341]: from='client.? 172.21.15.102:0/545130894' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T09:07:54.428 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:54 smithi102 ceph-mon[36220]: from='client.? 172.21.15.102:0/228352220' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e4dd7079-333e-4bcf-b3af-11fb082a5af9"}]: dispatch 2024-03-04T09:07:54.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:54 smithi102 ceph-mon[36220]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e4dd7079-333e-4bcf-b3af-11fb082a5af9"}]: dispatch 2024-03-04T09:07:54.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:54 smithi102 ceph-mon[36220]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e4dd7079-333e-4bcf-b3af-11fb082a5af9"}]': finished 2024-03-04T09:07:54.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:54 smithi102 ceph-mon[36220]: osdmap e10: 2 total, 1 up, 2 in 2024-03-04T09:07:54.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:54 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-04T09:07:54.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:54 smithi102 ceph-mon[36220]: from='client.? 172.21.15.102:0/545130894' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T09:07:55.316 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:55 smithi082 ceph-mon[32880]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T09:07:55.423 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:55 smithi190 ceph-mon[36341]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T09:07:55.428 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:55 smithi102 ceph-mon[36220]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T09:07:57.428 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:57 smithi102 ceph-mon[36220]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T09:07:57.527 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:57 smithi082 ceph-mon[32880]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T09:07:57.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:57 smithi190 ceph-mon[36341]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T09:07:59.394 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:07:59 smithi102 ceph-mon[36220]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T09:07:59.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:07:59 smithi082 ceph-mon[32880]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T09:07:59.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:07:59 smithi190 ceph-mon[36341]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T09:08:00.562 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:00 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-04T09:08:00.562 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:00 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:08:00.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:00 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-04T09:08:00.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:00 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:08:00.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:00 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-04T09:08:00.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:00 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:08:01.508 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:01 smithi102 ceph-mon[36220]: Deploying daemon osd.1 on smithi102 2024-03-04T09:08:01.508 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:01 smithi102 ceph-mon[36220]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T09:08:01.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:01 smithi082 ceph-mon[32880]: Deploying daemon osd.1 on smithi102 2024-03-04T09:08:01.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:01 smithi082 ceph-mon[32880]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T09:08:01.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:01 smithi190 ceph-mon[36341]: Deploying daemon osd.1 on smithi102 2024-03-04T09:08:01.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:01 smithi190 ceph-mon[36341]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T09:08:03.507 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:03 smithi102 ceph-mon[36220]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T09:08:03.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:03 smithi082 ceph-mon[32880]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T09:08:03.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:03 smithi190 ceph-mon[36341]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T09:08:05.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:05 smithi082 ceph-mon[32880]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T09:08:05.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:05 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:05.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:05 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:05.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:05 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:08:05.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:05 smithi190 ceph-mon[36341]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T09:08:05.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:05 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:05.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:05 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:05.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:05 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:08:05.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:05 smithi102 ceph-mon[36220]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T09:08:05.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:05 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:05.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:05 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:05.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:05 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:08:07.548 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:07 smithi102 ceph-mon[36220]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T09:08:07.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:07 smithi082 ceph-mon[32880]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T09:08:07.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:07 smithi190 ceph-mon[36341]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T09:08:08.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:08:08.513+0000 7f0944917700 1 -- 172.21.15.102:0/787359315 <== mgr.14152 v2:172.21.15.82:6800/1278635224 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f09400fe780 con 0x7f09280a1e00 2024-03-04T09:08:08.510 INFO:teuthology.orchestra.run.smithi102.stdout:Created osd(s) 1 on host 'smithi102' 2024-03-04T09:08:08.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:08:08.515+0000 7f0945919700 1 -- 172.21.15.102:0/787359315 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f09280a1e00 msgr2=0x7f09280a42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:08:08.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:08:08.515+0000 7f0945919700 1 --2- 172.21.15.102:0/787359315 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f09280a1e00 0x7f09280a42c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0930009c60 tx=0x7f0930009260 comp rx=0 tx=0).stop 2024-03-04T09:08:08.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:08:08.515+0000 7f0945919700 1 -- 172.21.15.102:0/787359315 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0940100fe0 msgr2=0x7f0940198330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:08:08.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:08:08.515+0000 7f0945919700 1 --2- 172.21.15.102:0/787359315 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0940100fe0 0x7f0940198330 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f093400bf60 tx=0x7f093400bf90 comp rx=0 tx=0).stop 2024-03-04T09:08:08.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:08:08.516+0000 7f0945919700 1 -- 172.21.15.102:0/787359315 shutdown_connections 2024-03-04T09:08:08.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:08:08.516+0000 7f0945919700 1 --2- 172.21.15.102:0/787359315 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f09280a1e00 0x7f09280a42c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:08:08.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:08:08.516+0000 7f0945919700 1 --2- 172.21.15.102:0/787359315 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0940102b80 0x7f094019f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:08:08.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:08:08.516+0000 7f0945919700 1 --2- 172.21.15.102:0/787359315 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0940100fe0 0x7f0940198330 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:08:08.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:08:08.516+0000 7f0945919700 1 --2- 172.21.15.102:0/787359315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09401021e0 0x7f0940198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:08:08.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:08:08.516+0000 7f0945919700 1 -- 172.21.15.102:0/787359315 >> 172.21.15.102:0/787359315 conn(0x7f09400fc580 msgr2=0x7f09400fe070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:08:08.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:08:08.516+0000 7f0945919700 1 -- 172.21.15.102:0/787359315 shutdown_connections 2024-03-04T09:08:08.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:08:08.516+0000 7f0945919700 1 -- 172.21.15.102:0/787359315 wait complete. 2024-03-04T09:08:08.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:08 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:08.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:08 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:08.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:08 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:08:08.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:08 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:08:08.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:08 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:08.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:08 smithi082 ceph-mon[32880]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T09:08:08.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:08 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:08.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:08 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:08:08.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:08 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:08.988 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:08 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:08.988 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:08 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:08.988 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:08 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:08:08.988 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:08 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:08:08.988 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:08 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:08.988 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:08 smithi102 ceph-mon[36220]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T09:08:08.988 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:08 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:08.988 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:08 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:08:08.988 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:08 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:09.129 DEBUG:teuthology.orchestra.run.smithi102:osd.1> sudo journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@osd.1.service 2024-03-04T09:08:09.132 INFO:tasks.cephadm:Deploying osd.2 on smithi190 with /dev/vg_nvme/lv_4... 2024-03-04T09:08:09.132 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-03-04T09:08:09.161 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:08 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:09.162 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:08 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:09.162 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:08 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:08:09.162 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:08 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:08:09.162 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:08 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:09.162 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:08 smithi190 ceph-mon[36341]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T09:08:09.162 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:08 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:09.162 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:08 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:08:09.162 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:08 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:09.377 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.c/config 2024-03-04T09:08:09.800 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:09 smithi190 ceph-mon[36341]: from='osd.1 [v2:172.21.15.102:6800/270721212,v1:172.21.15.102:6801/270721212]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-04T09:08:09.800 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:09 smithi190 ceph-mon[36341]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-04T09:08:09.928 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:09 smithi102 ceph-mon[36220]: from='osd.1 [v2:172.21.15.102:6800/270721212,v1:172.21.15.102:6801/270721212]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-04T09:08:09.928 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:09 smithi102 ceph-mon[36220]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-04T09:08:10.066 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:09 smithi082 ceph-mon[32880]: from='osd.1 [v2:172.21.15.102:6800/270721212,v1:172.21.15.102:6801/270721212]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-04T09:08:10.066 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:09 smithi082 ceph-mon[32880]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-04T09:08:10.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:10 smithi190 ceph-mon[36341]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-04T09:08:10.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:10 smithi190 ceph-mon[36341]: from='osd.1 [v2:172.21.15.102:6800/270721212,v1:172.21.15.102:6801/270721212]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-03-04T09:08:10.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:10 smithi190 ceph-mon[36341]: osdmap e11: 2 total, 1 up, 2 in 2024-03-04T09:08:10.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:10 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-04T09:08:10.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:10 smithi190 ceph-mon[36341]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-03-04T09:08:10.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:10 smithi190 ceph-mon[36341]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T09:08:10.928 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:10 smithi102 ceph-mon[36220]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-04T09:08:10.928 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:10 smithi102 ceph-mon[36220]: from='osd.1 [v2:172.21.15.102:6800/270721212,v1:172.21.15.102:6801/270721212]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-03-04T09:08:10.928 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:10 smithi102 ceph-mon[36220]: osdmap e11: 2 total, 1 up, 2 in 2024-03-04T09:08:10.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:10 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-04T09:08:10.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:10 smithi102 ceph-mon[36220]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-03-04T09:08:10.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:10 smithi102 ceph-mon[36220]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T09:08:11.066 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:10 smithi082 ceph-mon[32880]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-04T09:08:11.066 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:10 smithi082 ceph-mon[32880]: from='osd.1 [v2:172.21.15.102:6800/270721212,v1:172.21.15.102:6801/270721212]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-03-04T09:08:11.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:10 smithi082 ceph-mon[32880]: osdmap e11: 2 total, 1 up, 2 in 2024-03-04T09:08:11.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:10 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-04T09:08:11.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:10 smithi082 ceph-mon[32880]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-03-04T09:08:11.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:10 smithi082 ceph-mon[32880]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T09:08:11.209 INFO:teuthology.orchestra.run.smithi190.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-03-04T09:08:11.209 INFO:teuthology.orchestra.run.smithi190.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-03-04T09:08:11.209 INFO:teuthology.orchestra.run.smithi190.stderr: stderr: 10+0 records in 2024-03-04T09:08:11.209 INFO:teuthology.orchestra.run.smithi190.stderr:10+0 records out 2024-03-04T09:08:11.209 INFO:teuthology.orchestra.run.smithi190.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0123665 s, 848 MB/s 2024-03-04T09:08:11.209 INFO:teuthology.orchestra.run.smithi190.stderr:--> Zapping successful for: 2024-03-04T09:08:11.678 INFO:journalctl@ceph.osd.1.smithi102.stdout:Mar 04 09:08:11 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-1[40784]: 2024-03-04T09:08:11.191+0000 7f8cab63a700 -1 osd.1 0 waiting for initial osdmap 2024-03-04T09:08:11.678 INFO:journalctl@ceph.osd.1.smithi102.stdout:Mar 04 09:08:11 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-1[40784]: 2024-03-04T09:08:11.195+0000 7f8ca3425700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T09:08:11.721 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph orch daemon add osd smithi190:vg_nvme/lv_4 2024-03-04T09:08:11.788 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:11 smithi190 ceph-mon[36341]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-03-04T09:08:11.788 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:11 smithi190 ceph-mon[36341]: osdmap e12: 2 total, 1 up, 2 in 2024-03-04T09:08:11.788 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:11 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-04T09:08:11.788 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:11 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-04T09:08:11.788 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:11 smithi190 ceph-mon[36341]: from='osd.1 ' entity='osd.1' 2024-03-04T09:08:11.788 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:11 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-04T09:08:11.928 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:11 smithi102 ceph-mon[36220]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-03-04T09:08:11.928 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:11 smithi102 ceph-mon[36220]: osdmap e12: 2 total, 1 up, 2 in 2024-03-04T09:08:11.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:11 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-04T09:08:11.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:11 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-04T09:08:11.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:11 smithi102 ceph-mon[36220]: from='osd.1 ' entity='osd.1' 2024-03-04T09:08:11.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:11 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-04T09:08:12.004 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.c/config 2024-03-04T09:08:12.066 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:11 smithi082 ceph-mon[32880]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-03-04T09:08:12.066 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:11 smithi082 ceph-mon[32880]: osdmap e12: 2 total, 1 up, 2 in 2024-03-04T09:08:12.066 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:11 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-04T09:08:12.066 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:11 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-04T09:08:12.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:11 smithi082 ceph-mon[32880]: from='osd.1 ' entity='osd.1' 2024-03-04T09:08:12.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:11 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-04T09:08:12.956 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:12 smithi190 ceph-mon[36341]: purged_snaps scrub starts 2024-03-04T09:08:12.957 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:12 smithi190 ceph-mon[36341]: purged_snaps scrub ok 2024-03-04T09:08:12.957 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:12 smithi190 ceph-mon[36341]: Detected new or changed devices on smithi102 2024-03-04T09:08:12.957 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:12 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:12.957 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:12 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:12.957 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:12 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:08:12.957 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:12 smithi190 ceph-mon[36341]: Adjusting osd_memory_target on smithi102 to 17088M 2024-03-04T09:08:12.957 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:12 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:12.957 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:12 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:08:12.957 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:12 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:08:12.957 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:12 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:12.957 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:12 smithi190 ceph-mon[36341]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T09:08:12.958 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:12 smithi190 ceph-mon[36341]: osd.1 [v2:172.21.15.102:6800/270721212,v1:172.21.15.102:6801/270721212] boot 2024-03-04T09:08:12.958 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:12 smithi190 ceph-mon[36341]: osdmap e13: 2 total, 2 up, 2 in 2024-03-04T09:08:12.958 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:12 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-04T09:08:13.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:12 smithi082 ceph-mon[32880]: purged_snaps scrub starts 2024-03-04T09:08:13.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:12 smithi082 ceph-mon[32880]: purged_snaps scrub ok 2024-03-04T09:08:13.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:12 smithi082 ceph-mon[32880]: Detected new or changed devices on smithi102 2024-03-04T09:08:13.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:12 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:13.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:12 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:13.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:12 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:08:13.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:12 smithi082 ceph-mon[32880]: Adjusting osd_memory_target on smithi102 to 17088M 2024-03-04T09:08:13.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:12 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:13.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:12 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:08:13.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:12 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:08:13.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:12 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:13.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:12 smithi082 ceph-mon[32880]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T09:08:13.068 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:12 smithi082 ceph-mon[32880]: osd.1 [v2:172.21.15.102:6800/270721212,v1:172.21.15.102:6801/270721212] boot 2024-03-04T09:08:13.068 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:12 smithi082 ceph-mon[32880]: osdmap e13: 2 total, 2 up, 2 in 2024-03-04T09:08:13.068 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:12 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-04T09:08:13.178 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:12 smithi102 ceph-mon[36220]: purged_snaps scrub starts 2024-03-04T09:08:13.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:12 smithi102 ceph-mon[36220]: purged_snaps scrub ok 2024-03-04T09:08:13.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:12 smithi102 ceph-mon[36220]: Detected new or changed devices on smithi102 2024-03-04T09:08:13.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:12 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:13.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:12 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:13.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:12 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:08:13.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:12 smithi102 ceph-mon[36220]: Adjusting osd_memory_target on smithi102 to 17088M 2024-03-04T09:08:13.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:12 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:13.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:12 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:08:13.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:12 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:08:13.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:12 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:13.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:12 smithi102 ceph-mon[36220]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-04T09:08:13.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:12 smithi102 ceph-mon[36220]: osd.1 [v2:172.21.15.102:6800/270721212,v1:172.21.15.102:6801/270721212] boot 2024-03-04T09:08:13.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:12 smithi102 ceph-mon[36220]: osdmap e13: 2 total, 2 up, 2 in 2024-03-04T09:08:13.180 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:12 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-04T09:08:13.448 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:08:13.450+0000 7f1360caa700 1 -- 172.21.15.190:0/2041427907 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f135c101990 msgr2=0x7f135c101df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:08:13.448 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:08:13.450+0000 7f1360caa700 1 --2- 172.21.15.190:0/2041427907 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f135c101990 0x7f135c101df0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f134c009990 tx=0x7f134c009ca0 comp rx=0 tx=0).stop 2024-03-04T09:08:13.448 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:08:13.450+0000 7f1360caa700 1 -- 172.21.15.190:0/2041427907 shutdown_connections 2024-03-04T09:08:13.448 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:08:13.450+0000 7f1360caa700 1 --2- 172.21.15.190:0/2041427907 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f135c102330 0x7f135c108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:08:13.448 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:08:13.450+0000 7f1360caa700 1 --2- 172.21.15.190:0/2041427907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f135c100790 0x7f135c100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:08:13.448 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:08:13.450+0000 7f1360caa700 1 --2- 172.21.15.190:0/2041427907 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f135c101990 0x7f135c101df0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:08:13.448 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:08:13.450+0000 7f1360caa700 1 -- 172.21.15.190:0/2041427907 >> 172.21.15.190:0/2041427907 conn(0x7f135c0fbd10 msgr2=0x7f135c0fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:08:13.449 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:08:13.450+0000 7f1360caa700 1 -- 172.21.15.190:0/2041427907 shutdown_connections 2024-03-04T09:08:13.449 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:08:13.450+0000 7f1360caa700 1 -- 172.21.15.190:0/2041427907 wait complete. 2024-03-04T09:08:13.449 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:08:13.451+0000 7f1360caa700 1 Processor -- start 2024-03-04T09:08:13.449 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:08:13.451+0000 7f1360caa700 1 -- start start 2024-03-04T09:08:13.449 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:08:13.451+0000 7f1360caa700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f135c100790 0x7f135c104720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:08:13.449 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:08:13.451+0000 7f1360caa700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f135c101990 0x7f135c102d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:08:13.449 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:08:13.451+0000 7f1360caa700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f135c102330 0x7f135c1032b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:08:13.449 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:08:13.451+0000 7f1360caa700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135c10cc30 con 0x7f135c102330 2024-03-04T09:08:13.449 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:08:13.451+0000 7f1360caa700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135c10cab0 con 0x7f135c101990 2024-03-04T09:08:13.449 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:08:13.451+0000 7f1360caa700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135c10cdb0 con 0x7f135c100790 2024-03-04T09:08:13.449 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:08:13.451+0000 7f135a59c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f135c100790 0x7f135c104720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:08:13.449 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:08:13.451+0000 7f135a59c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f135c100790 0x7f135c104720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:53176/0 (socket says 172.21.15.190:53176) 2024-03-04T09:08:13.449 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:08:13.451+0000 7f135a59c700 1 -- 172.21.15.190:0/3926014187 learned_addr learned my addr 172.21.15.190:0/3926014187 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-03-04T09:08:13.449 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:08:13.451+0000 7f135a59c700 1 -- 172.21.15.190:0/3926014187 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f135c101990 msgr2=0x7f135c102d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:08:13.450 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:08:13.451+0000 7f135a59c700 1 --2- 172.21.15.190:0/3926014187 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f135c101990 0x7f135c102d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:08:13.450 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:08:13.451+0000 7f135a59c700 1 -- 172.21.15.190:0/3926014187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f135c102330 msgr2=0x7f135c1032b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:08:13.450 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:08:13.451+0000 7f135a59c700 1 --2- 172.21.15.190:0/3926014187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f135c102330 0x7f135c1032b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:08:13.450 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:08:13.451+0000 7f135a59c700 1 -- 172.21.15.190:0/3926014187 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f135c103b60 con 0x7f135c100790 2024-03-04T09:08:13.450 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:08:13.452+0000 7f135a59c700 1 --2- 172.21.15.190:0/3926014187 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f135c100790 0x7f135c104720 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f135000c990 tx=0x7f135000cd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:08:13.450 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:08:13.452+0000 7f134b7fe700 1 -- 172.21.15.190:0/3926014187 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1350007b00 con 0x7f135c100790 2024-03-04T09:08:13.450 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:08:13.452+0000 7f134b7fe700 1 -- 172.21.15.190:0/3926014187 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f1350007ca0 con 0x7f135c100790 2024-03-04T09:08:13.450 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:08:13.452+0000 7f1360caa700 1 -- 172.21.15.190:0/3926014187 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f135c1a2420 con 0x7f135c100790 2024-03-04T09:08:13.450 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:08:13.452+0000 7f134b7fe700 1 -- 172.21.15.190:0/3926014187 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13500186f0 con 0x7f135c100790 2024-03-04T09:08:13.450 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:08:13.452+0000 7f1360caa700 1 -- 172.21.15.190:0/3926014187 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f135c1a2930 con 0x7f135c100790 2024-03-04T09:08:13.451 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:08:13.453+0000 7f1360caa700 1 -- 172.21.15.190:0/3926014187 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f135c068d80 con 0x7f135c100790 2024-03-04T09:08:13.451 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:08:13.454+0000 7f134b7fe700 1 -- 172.21.15.190:0/3926014187 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 15) v1 ==== 136700+0+0 (secure 0 0 0) 0x7f135000f450 con 0x7f135c100790 2024-03-04T09:08:13.451 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:08:13.454+0000 7f134b7fe700 1 --2- 172.21.15.190:0/3926014187 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f13440a1d80 0x7f13440a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:08:13.451 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:08:13.454+0000 7f134b7fe700 1 -- 172.21.15.190:0/3926014187 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2309+0+0 (secure 0 0 0) 0x7f13500cc500 con 0x7f135c100790 2024-03-04T09:08:13.451 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:08:13.454+0000 7f1359d9b700 1 --2- 172.21.15.190:0/3926014187 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f13440a1d80 0x7f13440a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:08:13.451 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:08:13.455+0000 7f1359d9b700 1 --2- 172.21.15.190:0/3926014187 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f13440a1d80 0x7f13440a4240 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f134c0098e0 tx=0x7f134c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:08:13.455 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:08:13.459+0000 7f134b7fe700 1 -- 172.21.15.190:0/3926014187 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f1350014030 con 0x7f135c100790 2024-03-04T09:08:13.657 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:08:13.661+0000 7f1360caa700 1 -- 172.21.15.190:0/3926014187 --> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f135c0fde20 con 0x7f13440a1d80 2024-03-04T09:08:14.380 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:14 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T09:08:14.380 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:14 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T09:08:14.380 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:14 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:08:14.380 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:14 smithi190 ceph-mon[36341]: osdmap e14: 2 total, 2 up, 2 in 2024-03-04T09:08:14.428 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:14 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T09:08:14.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:14 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T09:08:14.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:14 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:08:14.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:14 smithi102 ceph-mon[36220]: osdmap e14: 2 total, 2 up, 2 in 2024-03-04T09:08:14.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:14 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T09:08:14.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:14 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T09:08:14.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:14 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:08:14.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:14 smithi082 ceph-mon[32880]: osdmap e14: 2 total, 2 up, 2 in 2024-03-04T09:08:15.349 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:15 smithi190 ceph-mon[36341]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:08:15.349 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:15 smithi190 ceph-mon[36341]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-04T09:08:15.428 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:15 smithi102 ceph-mon[36220]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:08:15.428 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:15 smithi102 ceph-mon[36220]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-04T09:08:15.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:15 smithi082 ceph-mon[32880]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:08:15.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:15 smithi082 ceph-mon[32880]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-04T09:08:16.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:16 smithi082 ceph-mon[32880]: from='client.? 172.21.15.190:0/1160101492' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6fed5fd6-dc82-497f-9d69-c10a5e5802da"}]: dispatch 2024-03-04T09:08:16.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:16 smithi082 ceph-mon[32880]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6fed5fd6-dc82-497f-9d69-c10a5e5802da"}]: dispatch 2024-03-04T09:08:16.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:16 smithi082 ceph-mon[32880]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6fed5fd6-dc82-497f-9d69-c10a5e5802da"}]': finished 2024-03-04T09:08:16.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:16 smithi082 ceph-mon[32880]: osdmap e15: 3 total, 2 up, 3 in 2024-03-04T09:08:16.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:16 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-04T09:08:16.573 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:16 smithi190 ceph-mon[36341]: from='client.? 172.21.15.190:0/1160101492' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6fed5fd6-dc82-497f-9d69-c10a5e5802da"}]: dispatch 2024-03-04T09:08:16.573 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:16 smithi190 ceph-mon[36341]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6fed5fd6-dc82-497f-9d69-c10a5e5802da"}]: dispatch 2024-03-04T09:08:16.574 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:16 smithi190 ceph-mon[36341]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6fed5fd6-dc82-497f-9d69-c10a5e5802da"}]': finished 2024-03-04T09:08:16.574 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:16 smithi190 ceph-mon[36341]: osdmap e15: 3 total, 2 up, 3 in 2024-03-04T09:08:16.574 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:16 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-04T09:08:16.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:16 smithi102 ceph-mon[36220]: from='client.? 172.21.15.190:0/1160101492' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6fed5fd6-dc82-497f-9d69-c10a5e5802da"}]: dispatch 2024-03-04T09:08:16.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:16 smithi102 ceph-mon[36220]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6fed5fd6-dc82-497f-9d69-c10a5e5802da"}]: dispatch 2024-03-04T09:08:16.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:16 smithi102 ceph-mon[36220]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6fed5fd6-dc82-497f-9d69-c10a5e5802da"}]': finished 2024-03-04T09:08:16.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:16 smithi102 ceph-mon[36220]: osdmap e15: 3 total, 2 up, 3 in 2024-03-04T09:08:16.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:16 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-04T09:08:17.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:17 smithi082 ceph-mon[32880]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-04T09:08:17.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:17 smithi082 ceph-mon[32880]: from='client.? 172.21.15.190:0/2305559381' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T09:08:17.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:17 smithi190 ceph-mon[36341]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-04T09:08:17.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:17 smithi190 ceph-mon[36341]: from='client.? 172.21.15.190:0/2305559381' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T09:08:17.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:17 smithi102 ceph-mon[36220]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-04T09:08:17.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:17 smithi102 ceph-mon[36220]: from='client.? 172.21.15.190:0/2305559381' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T09:08:19.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:19 smithi082 ceph-mon[32880]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-04T09:08:19.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:19 smithi190 ceph-mon[36341]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-04T09:08:19.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:19 smithi102 ceph-mon[36220]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-04T09:08:21.410 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:21 smithi190 ceph-mon[36341]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-04T09:08:21.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:21 smithi082 ceph-mon[32880]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-04T09:08:21.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:21 smithi102 ceph-mon[36220]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-04T09:08:23.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:23 smithi190 ceph-mon[36341]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-04T09:08:23.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:23 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-04T09:08:23.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:23 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:08:23.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:23 smithi082 ceph-mon[32880]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-04T09:08:23.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:23 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-04T09:08:23.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:23 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:08:23.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:23 smithi102 ceph-mon[36220]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-04T09:08:23.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:23 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-04T09:08:23.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:23 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:08:24.407 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:24 smithi190 ceph-mon[36341]: Deploying daemon osd.2 on smithi190 2024-03-04T09:08:24.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:24 smithi082 ceph-mon[32880]: Deploying daemon osd.2 on smithi190 2024-03-04T09:08:24.655 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:24 smithi102 ceph-mon[36220]: Deploying daemon osd.2 on smithi190 2024-03-04T09:08:25.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:25 smithi190 ceph-mon[36341]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-04T09:08:25.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:25 smithi082 ceph-mon[32880]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-04T09:08:25.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:25 smithi102 ceph-mon[36220]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-04T09:08:27.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:27 smithi190 ceph-mon[36341]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-04T09:08:27.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:27 smithi082 ceph-mon[32880]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-04T09:08:27.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:27 smithi102 ceph-mon[36220]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-04T09:08:29.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:29 smithi082 ceph-mon[32880]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-04T09:08:29.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:29 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:29.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:29 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:08:29.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:29 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:29.589 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:29 smithi190 ceph-mon[36341]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-04T09:08:29.589 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:29 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:29.590 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:29 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:08:29.590 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:29 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:29.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:29 smithi102 ceph-mon[36220]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-04T09:08:29.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:29 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:29.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:29 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:08:29.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:29 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:31.549 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:31 smithi190 ceph-mon[36341]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-04T09:08:31.549 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:31 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:31.549 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:31 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:31.549 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:31 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:08:31.549 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:31 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:08:31.549 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:31 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:31.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:31 smithi082 ceph-mon[32880]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-04T09:08:31.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:31 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:31.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:31 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:31.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:31 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:08:31.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:31 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:08:31.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:31 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:31.618 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:08:31.622+0000 7f134b7fe700 1 -- 172.21.15.190:0/3926014187 <== mgr.14152 v2:172.21.15.82:6800/1278635224 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f135c0fde20 con 0x7f13440a1d80 2024-03-04T09:08:31.618 INFO:teuthology.orchestra.run.smithi190.stdout:Created osd(s) 2 on host 'smithi190' 2024-03-04T09:08:31.621 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:08:31.624+0000 7f1360caa700 1 -- 172.21.15.190:0/3926014187 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f13440a1d80 msgr2=0x7f13440a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:08:31.621 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:08:31.624+0000 7f1360caa700 1 --2- 172.21.15.190:0/3926014187 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f13440a1d80 0x7f13440a4240 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f134c0098e0 tx=0x7f134c005fb0 comp rx=0 tx=0).stop 2024-03-04T09:08:31.621 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:08:31.624+0000 7f1360caa700 1 -- 172.21.15.190:0/3926014187 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f135c100790 msgr2=0x7f135c104720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:08:31.621 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:08:31.624+0000 7f1360caa700 1 --2- 172.21.15.190:0/3926014187 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f135c100790 0x7f135c104720 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f135000c990 tx=0x7f135000cd50 comp rx=0 tx=0).stop 2024-03-04T09:08:31.621 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:08:31.624+0000 7f1360caa700 1 -- 172.21.15.190:0/3926014187 shutdown_connections 2024-03-04T09:08:31.621 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:08:31.624+0000 7f1360caa700 1 --2- 172.21.15.190:0/3926014187 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f13440a1d80 0x7f13440a4240 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:08:31.621 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:08:31.624+0000 7f1360caa700 1 --2- 172.21.15.190:0/3926014187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f135c102330 0x7f135c1032b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:08:31.621 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:08:31.624+0000 7f1360caa700 1 --2- 172.21.15.190:0/3926014187 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f135c100790 0x7f135c104720 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:08:31.621 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:08:31.624+0000 7f1360caa700 1 --2- 172.21.15.190:0/3926014187 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f135c101990 0x7f135c102d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:08:31.621 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:08:31.624+0000 7f1360caa700 1 -- 172.21.15.190:0/3926014187 >> 172.21.15.190:0/3926014187 conn(0x7f135c0fbd10 msgr2=0x7f135c0fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:08:31.621 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:08:31.625+0000 7f1360caa700 1 -- 172.21.15.190:0/3926014187 shutdown_connections 2024-03-04T09:08:31.621 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:08:31.625+0000 7f1360caa700 1 -- 172.21.15.190:0/3926014187 wait complete. 2024-03-04T09:08:31.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:31 smithi102 ceph-mon[36220]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-04T09:08:31.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:31 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:31.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:31 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:31.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:31 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:08:31.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:31 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:08:31.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:31 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:32.211 DEBUG:teuthology.orchestra.run.smithi190:osd.2> sudo journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@osd.2.service 2024-03-04T09:08:32.253 INFO:tasks.cephadm:Deploying osd.3 on smithi082 with /dev/vg_nvme/lv_3... 2024-03-04T09:08:32.254 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-03-04T09:08:32.498 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:08:32.913 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:32 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:32.913 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:32 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:32.913 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:32 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:08:32.914 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:32 smithi082 ceph-mon[32880]: from='osd.2 [v2:172.21.15.190:6800/946410459,v1:172.21.15.190:6801/946410459]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-04T09:08:32.914 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:32 smithi082 ceph-mon[32880]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-04T09:08:32.914 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:32 smithi082 ceph-mon[32880]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-04T09:08:32.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:32 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:32.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:32 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:32.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:32 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:08:32.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:32 smithi190 ceph-mon[36341]: from='osd.2 [v2:172.21.15.190:6800/946410459,v1:172.21.15.190:6801/946410459]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-04T09:08:32.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:32 smithi190 ceph-mon[36341]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-04T09:08:32.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:32 smithi190 ceph-mon[36341]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-04T09:08:32.928 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:32 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:32.928 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:32 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:32.928 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:32 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:08:32.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:32 smithi102 ceph-mon[36220]: from='osd.2 [v2:172.21.15.190:6800/946410459,v1:172.21.15.190:6801/946410459]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-04T09:08:32.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:32 smithi102 ceph-mon[36220]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-04T09:08:32.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:32 smithi102 ceph-mon[36220]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-04T09:08:33.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:33 smithi190 ceph-mon[36341]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-04T09:08:33.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:33 smithi190 ceph-mon[36341]: osdmap e16: 3 total, 2 up, 3 in 2024-03-04T09:08:33.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:33 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-04T09:08:33.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:33 smithi190 ceph-mon[36341]: from='osd.2 [v2:172.21.15.190:6800/946410459,v1:172.21.15.190:6801/946410459]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2024-03-04T09:08:33.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:33 smithi190 ceph-mon[36341]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2024-03-04T09:08:33.671 INFO:journalctl@ceph.osd.2.smithi190.stdout:Mar 04 09:08:33 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-2[41494]: 2024-03-04T09:08:33.609+0000 7f223e25e700 -1 osd.2 0 waiting for initial osdmap 2024-03-04T09:08:33.671 INFO:journalctl@ceph.osd.2.smithi190.stdout:Mar 04 09:08:33 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-2[41494]: 2024-03-04T09:08:33.612+0000 7f223a051700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T09:08:33.875 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:33 smithi082 ceph-mon[32880]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-04T09:08:33.875 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:33 smithi082 ceph-mon[32880]: osdmap e16: 3 total, 2 up, 3 in 2024-03-04T09:08:33.875 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:33 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-04T09:08:33.875 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:33 smithi082 ceph-mon[32880]: from='osd.2 [v2:172.21.15.190:6800/946410459,v1:172.21.15.190:6801/946410459]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2024-03-04T09:08:33.875 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:33 smithi082 ceph-mon[32880]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2024-03-04T09:08:33.928 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:33 smithi102 ceph-mon[36220]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-04T09:08:33.928 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:33 smithi102 ceph-mon[36220]: osdmap e16: 3 total, 2 up, 3 in 2024-03-04T09:08:33.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:33 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-04T09:08:33.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:33 smithi102 ceph-mon[36220]: from='osd.2 [v2:172.21.15.190:6800/946410459,v1:172.21.15.190:6801/946410459]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2024-03-04T09:08:33.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:33 smithi102 ceph-mon[36220]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2024-03-04T09:08:34.754 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-03-04T09:08:34.754 INFO:teuthology.orchestra.run.smithi082.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-03-04T09:08:34.754 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10+0 records in 2024-03-04T09:08:34.754 INFO:teuthology.orchestra.run.smithi082.stderr:10+0 records out 2024-03-04T09:08:34.754 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114302 s, 917 MB/s 2024-03-04T09:08:34.754 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping successful for: 2024-03-04T09:08:34.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:34 smithi190 ceph-mon[36341]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2024-03-04T09:08:34.873 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:34 smithi190 ceph-mon[36341]: osdmap e17: 3 total, 2 up, 3 in 2024-03-04T09:08:34.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:34 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-04T09:08:34.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:34 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-04T09:08:34.874 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:34 smithi190 ceph-mon[36341]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-04T09:08:34.928 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:34 smithi102 ceph-mon[36220]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2024-03-04T09:08:34.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:34 smithi102 ceph-mon[36220]: osdmap e17: 3 total, 2 up, 3 in 2024-03-04T09:08:34.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:34 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-04T09:08:34.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:34 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-04T09:08:34.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:34 smithi102 ceph-mon[36220]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-04T09:08:35.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:34 smithi082 ceph-mon[32880]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2024-03-04T09:08:35.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:34 smithi082 ceph-mon[32880]: osdmap e17: 3 total, 2 up, 3 in 2024-03-04T09:08:35.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:34 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-04T09:08:35.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:34 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-04T09:08:35.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:34 smithi082 ceph-mon[32880]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-04T09:08:35.390 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph orch daemon add osd smithi082:vg_nvme/lv_3 2024-03-04T09:08:35.627 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:08:35.750 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:35 smithi082 ceph-mon[32880]: purged_snaps scrub starts 2024-03-04T09:08:35.750 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:35 smithi082 ceph-mon[32880]: purged_snaps scrub ok 2024-03-04T09:08:35.750 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:35 smithi082 ceph-mon[32880]: osd.2 [v2:172.21.15.190:6800/946410459,v1:172.21.15.190:6801/946410459] boot 2024-03-04T09:08:35.750 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:35 smithi082 ceph-mon[32880]: osdmap e18: 3 total, 3 up, 3 in 2024-03-04T09:08:35.751 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:35 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-04T09:08:35.751 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:35 smithi082 ceph-mon[32880]: Detected new or changed devices on smithi190 2024-03-04T09:08:35.751 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:35 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:35.751 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:35 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:35.751 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:35 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:08:35.751 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:35 smithi082 ceph-mon[32880]: Adjusting osd_memory_target on smithi190 to 17088M 2024-03-04T09:08:35.751 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:35 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:35.751 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:35 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:08:35.751 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:35 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:08:35.751 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:35 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:35.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:35 smithi190 ceph-mon[36341]: purged_snaps scrub starts 2024-03-04T09:08:35.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:35 smithi190 ceph-mon[36341]: purged_snaps scrub ok 2024-03-04T09:08:35.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:35 smithi190 ceph-mon[36341]: osd.2 [v2:172.21.15.190:6800/946410459,v1:172.21.15.190:6801/946410459] boot 2024-03-04T09:08:35.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:35 smithi190 ceph-mon[36341]: osdmap e18: 3 total, 3 up, 3 in 2024-03-04T09:08:35.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:35 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-04T09:08:35.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:35 smithi190 ceph-mon[36341]: Detected new or changed devices on smithi190 2024-03-04T09:08:35.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:35 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:35.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:35 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:35.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:35 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:08:35.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:35 smithi190 ceph-mon[36341]: Adjusting osd_memory_target on smithi190 to 17088M 2024-03-04T09:08:35.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:35 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:35.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:35 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:08:35.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:35 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:08:35.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:35 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:35.928 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:35 smithi102 ceph-mon[36220]: purged_snaps scrub starts 2024-03-04T09:08:35.928 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:35 smithi102 ceph-mon[36220]: purged_snaps scrub ok 2024-03-04T09:08:35.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:35 smithi102 ceph-mon[36220]: osd.2 [v2:172.21.15.190:6800/946410459,v1:172.21.15.190:6801/946410459] boot 2024-03-04T09:08:35.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:35 smithi102 ceph-mon[36220]: osdmap e18: 3 total, 3 up, 3 in 2024-03-04T09:08:35.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:35 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-04T09:08:35.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:35 smithi102 ceph-mon[36220]: Detected new or changed devices on smithi190 2024-03-04T09:08:35.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:35 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:35.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:35 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:35.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:35 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:08:35.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:35 smithi102 ceph-mon[36220]: Adjusting osd_memory_target on smithi190 to 17088M 2024-03-04T09:08:35.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:35 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:35.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:35 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:08:35.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:35 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:08:35.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:35 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:36.738 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:36 smithi082 ceph-mon[32880]: osdmap e19: 3 total, 3 up, 3 in 2024-03-04T09:08:36.738 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:36 smithi082 ceph-mon[32880]: pgmap v81: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-03-04T09:08:36.739 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:36 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-03-04T09:08:36.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:36 smithi190 ceph-mon[36341]: osdmap e19: 3 total, 3 up, 3 in 2024-03-04T09:08:36.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:36 smithi190 ceph-mon[36341]: pgmap v81: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-03-04T09:08:36.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:36 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-03-04T09:08:36.928 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:36 smithi102 ceph-mon[36220]: osdmap e19: 3 total, 3 up, 3 in 2024-03-04T09:08:36.928 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:36 smithi102 ceph-mon[36220]: pgmap v81: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-03-04T09:08:36.928 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:36 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-03-04T09:08:37.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:37.274+0000 7f5a37eb5700 1 -- 172.21.15.82:0/3332913595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a301021f0 msgr2=0x7f5a30102650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:08:37.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:37.274+0000 7f5a37eb5700 1 --2- 172.21.15.82:0/3332913595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a301021f0 0x7f5a30102650 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5a200099c0 tx=0x7f5a20009cd0 comp rx=0 tx=0).stop 2024-03-04T09:08:37.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:37.274+0000 7f5a37eb5700 1 -- 172.21.15.82:0/3332913595 shutdown_connections 2024-03-04T09:08:37.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:37.274+0000 7f5a37eb5700 1 --2- 172.21.15.82:0/3332913595 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5a30102b90 0x7f5a30109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:08:37.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:37.274+0000 7f5a37eb5700 1 --2- 172.21.15.82:0/3332913595 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a30100ff0 0x7f5a30101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:08:37.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:37.274+0000 7f5a37eb5700 1 --2- 172.21.15.82:0/3332913595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a301021f0 0x7f5a30102650 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:08:37.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:37.274+0000 7f5a37eb5700 1 -- 172.21.15.82:0/3332913595 >> 172.21.15.82:0/3332913595 conn(0x7f5a300fc590 msgr2=0x7f5a300fe9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:08:37.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:37.274+0000 7f5a37eb5700 1 -- 172.21.15.82:0/3332913595 shutdown_connections 2024-03-04T09:08:37.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:37.274+0000 7f5a37eb5700 1 -- 172.21.15.82:0/3332913595 wait complete. 2024-03-04T09:08:37.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:37.274+0000 7f5a37eb5700 1 Processor -- start 2024-03-04T09:08:37.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:37.274+0000 7f5a37eb5700 1 -- start start 2024-03-04T09:08:37.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:37.274+0000 7f5a37eb5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a30100ff0 0x7f5a30198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:08:37.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:37.274+0000 7f5a37eb5700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a301021f0 0x7f5a301988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:08:37.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:37.275+0000 7f5a37eb5700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5a30102b90 0x7f5a3019f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:08:37.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:37.275+0000 7f5a37eb5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3010cb90 con 0x7f5a30100ff0 2024-03-04T09:08:37.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:37.275+0000 7f5a37eb5700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3010ca10 con 0x7f5a301021f0 2024-03-04T09:08:37.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:37.275+0000 7f5a37eb5700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3010cd10 con 0x7f5a30102b90 2024-03-04T09:08:37.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:37.275+0000 7f5a35c51700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a30100ff0 0x7f5a30198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:08:37.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:37.275+0000 7f5a35c51700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a30100ff0 0x7f5a30198390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42120/0 (socket says 172.21.15.82:42120) 2024-03-04T09:08:37.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:37.275+0000 7f5a35c51700 1 -- 172.21.15.82:0/2619300783 learned_addr learned my addr 172.21.15.82:0/2619300783 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:08:37.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:37.275+0000 7f5a35450700 1 --2- 172.21.15.82:0/2619300783 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a301021f0 0x7f5a301988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:08:37.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:37.275+0000 7f5a36452700 1 --2- 172.21.15.82:0/2619300783 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5a30102b90 0x7f5a3019f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:08:37.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:37.275+0000 7f5a35c51700 1 -- 172.21.15.82:0/2619300783 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5a30102b90 msgr2=0x7f5a3019f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:08:37.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:37.275+0000 7f5a35c51700 1 --2- 172.21.15.82:0/2619300783 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5a30102b90 0x7f5a3019f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:08:37.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:37.275+0000 7f5a35c51700 1 -- 172.21.15.82:0/2619300783 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a301021f0 msgr2=0x7f5a301988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:08:37.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:37.275+0000 7f5a35c51700 1 --2- 172.21.15.82:0/2619300783 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a301021f0 0x7f5a301988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:08:37.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:37.275+0000 7f5a35c51700 1 -- 172.21.15.82:0/2619300783 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a3019ffa0 con 0x7f5a30100ff0 2024-03-04T09:08:37.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:37.275+0000 7f5a35c51700 1 --2- 172.21.15.82:0/2619300783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a30100ff0 0x7f5a30198390 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c00d9b0 tx=0x7f5a2c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:08:37.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:37.275+0000 7f5a26ffd700 1 -- 172.21.15.82:0/2619300783 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c017030 con 0x7f5a30100ff0 2024-03-04T09:08:37.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:37.275+0000 7f5a26ffd700 1 -- 172.21.15.82:0/2619300783 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f5a2c0044f0 con 0x7f5a30100ff0 2024-03-04T09:08:37.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:37.275+0000 7f5a37eb5700 1 -- 172.21.15.82:0/2619300783 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a301a0290 con 0x7f5a30100ff0 2024-03-04T09:08:37.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:37.275+0000 7f5a26ffd700 1 -- 172.21.15.82:0/2619300783 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c003970 con 0x7f5a30100ff0 2024-03-04T09:08:37.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:37.275+0000 7f5a37eb5700 1 -- 172.21.15.82:0/2619300783 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a301a07d0 con 0x7f5a30100ff0 2024-03-04T09:08:37.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:37.276+0000 7f5a37eb5700 1 -- 172.21.15.82:0/2619300783 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a30068d80 con 0x7f5a30100ff0 2024-03-04T09:08:37.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:37.277+0000 7f5a26ffd700 1 -- 172.21.15.82:0/2619300783 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 15) v1 ==== 136700+0+0 (secure 0 0 0) 0x7f5a2c01a070 con 0x7f5a30100ff0 2024-03-04T09:08:37.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:37.278+0000 7f5a26ffd700 1 --2- 172.21.15.82:0/2619300783 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f5a1c0a1d80 0x7f5a1c0a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:08:37.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:37.278+0000 7f5a35450700 1 --2- 172.21.15.82:0/2619300783 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f5a1c0a1d80 0x7f5a1c0a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:08:37.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:37.278+0000 7f5a26ffd700 1 -- 172.21.15.82:0/2619300783 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3226+0+0 (secure 0 0 0) 0x7f5a2c0cc500 con 0x7f5a30100ff0 2024-03-04T09:08:37.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:37.278+0000 7f5a35450700 1 --2- 172.21.15.82:0/2619300783 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f5a1c0a1d80 0x7f5a1c0a4240 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5a20000c00 tx=0x7f5a20005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:08:37.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:37.282+0000 7f5a26ffd700 1 -- 172.21.15.82:0/2619300783 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f5a2c00e350 con 0x7f5a30100ff0 2024-03-04T09:08:37.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:37.486+0000 7f5a37eb5700 1 -- 172.21.15.82:0/2619300783 --> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f5a3006a4b0 con 0x7f5a1c0a1d80 2024-03-04T09:08:37.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:37 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-03-04T09:08:37.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:37 smithi082 ceph-mon[32880]: osdmap e20: 3 total, 3 up, 3 in 2024-03-04T09:08:37.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:37 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-03-04T09:08:37.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:37 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T09:08:37.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:37 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T09:08:37.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:37 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:08:37.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:37 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-03-04T09:08:37.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:37 smithi190 ceph-mon[36341]: osdmap e20: 3 total, 3 up, 3 in 2024-03-04T09:08:37.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:37 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-03-04T09:08:37.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:37 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T09:08:37.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:37 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T09:08:37.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:37 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:08:37.928 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:37 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-03-04T09:08:37.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:37 smithi102 ceph-mon[36220]: osdmap e20: 3 total, 3 up, 3 in 2024-03-04T09:08:37.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:37 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-03-04T09:08:37.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:37 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T09:08:37.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:37 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T09:08:37.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:37 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:08:38.248 INFO:journalctl@ceph.osd.0.smithi082.stdout:Mar 04 09:08:37 smithi082 sudo[52202]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-04T09:08:38.248 INFO:journalctl@ceph.osd.0.smithi082.stdout:Mar 04 09:08:37 smithi082 sudo[52202]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-04T09:08:38.248 INFO:journalctl@ceph.osd.0.smithi082.stdout:Mar 04 09:08:37 smithi082 sudo[52202]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-04T09:08:38.248 INFO:journalctl@ceph.osd.0.smithi082.stdout:Mar 04 09:08:38 smithi082 sudo[52202]: pam_unix(sudo:session): session closed for user root 2024-03-04T09:08:38.566 INFO:journalctl@ceph.osd.0.smithi082.stdout:Mar 04 09:08:38 smithi082 sudo[52221]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-04T09:08:38.567 INFO:journalctl@ceph.osd.0.smithi082.stdout:Mar 04 09:08:38 smithi082 sudo[52221]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-04T09:08:38.567 INFO:journalctl@ceph.osd.0.smithi082.stdout:Mar 04 09:08:38 smithi082 sudo[52221]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-04T09:08:38.567 INFO:journalctl@ceph.osd.0.smithi082.stdout:Mar 04 09:08:38 smithi082 sudo[52221]: pam_unix(sudo:session): session closed for user root 2024-03-04T09:08:38.769 INFO:journalctl@ceph.osd.1.smithi102.stdout:Mar 04 09:08:38 smithi102 sudo[44770]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-04T09:08:38.770 INFO:journalctl@ceph.osd.1.smithi102.stdout:Mar 04 09:08:38 smithi102 sudo[44770]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-04T09:08:38.770 INFO:journalctl@ceph.osd.1.smithi102.stdout:Mar 04 09:08:38 smithi102 sudo[44770]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-04T09:08:38.770 INFO:journalctl@ceph.osd.1.smithi102.stdout:Mar 04 09:08:38 smithi102 sudo[44770]: pam_unix(sudo:session): session closed for user root 2024-03-04T09:08:38.770 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:38 smithi102 ceph-mon[36220]: from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:08:38.770 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:38 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-03-04T09:08:38.770 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:38 smithi102 ceph-mon[36220]: osdmap e21: 3 total, 3 up, 3 in 2024-03-04T09:08:38.770 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:38 smithi102 ceph-mon[36220]: pgmap v84: 1 pgs: 1 active+clean; 449 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-03-04T09:08:38.770 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:38 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:38.770 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:38 smithi102 ceph-mon[36220]: osdmap e22: 3 total, 3 up, 3 in 2024-03-04T09:08:38.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:38 smithi190 ceph-mon[36341]: from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:08:38.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:38 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-03-04T09:08:38.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:38 smithi190 ceph-mon[36341]: osdmap e21: 3 total, 3 up, 3 in 2024-03-04T09:08:38.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:38 smithi190 ceph-mon[36341]: pgmap v84: 1 pgs: 1 active+clean; 449 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-03-04T09:08:38.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:38 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:38.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:38 smithi190 ceph-mon[36341]: osdmap e22: 3 total, 3 up, 3 in 2024-03-04T09:08:39.066 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:38 smithi082 ceph-mon[32880]: from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:08:39.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:38 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-03-04T09:08:39.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:38 smithi082 ceph-mon[32880]: osdmap e21: 3 total, 3 up, 3 in 2024-03-04T09:08:39.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:38 smithi082 ceph-mon[32880]: pgmap v84: 1 pgs: 1 active+clean; 449 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-03-04T09:08:39.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:38 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:39.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:38 smithi082 ceph-mon[32880]: osdmap e22: 3 total, 3 up, 3 in 2024-03-04T09:08:39.178 INFO:journalctl@ceph.osd.1.smithi102.stdout:Mar 04 09:08:38 smithi102 sudo[44773]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-04T09:08:39.179 INFO:journalctl@ceph.osd.1.smithi102.stdout:Mar 04 09:08:38 smithi102 sudo[44773]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-04T09:08:39.179 INFO:journalctl@ceph.osd.1.smithi102.stdout:Mar 04 09:08:38 smithi102 sudo[44773]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-04T09:08:39.179 INFO:journalctl@ceph.osd.1.smithi102.stdout:Mar 04 09:08:38 smithi102 sudo[44773]: pam_unix(sudo:session): session closed for user root 2024-03-04T09:08:39.291 INFO:journalctl@ceph.osd.2.smithi190.stdout:Mar 04 09:08:39 smithi190 sudo[45550]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-04T09:08:39.291 INFO:journalctl@ceph.osd.2.smithi190.stdout:Mar 04 09:08:39 smithi190 sudo[45550]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-04T09:08:39.291 INFO:journalctl@ceph.osd.2.smithi190.stdout:Mar 04 09:08:39 smithi190 sudo[45550]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-04T09:08:39.291 INFO:journalctl@ceph.osd.2.smithi190.stdout:Mar 04 09:08:39 smithi190 sudo[45550]: pam_unix(sudo:session): session closed for user root 2024-03-04T09:08:39.670 INFO:journalctl@ceph.osd.2.smithi190.stdout:Mar 04 09:08:39 smithi190 sudo[45553]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-04T09:08:39.670 INFO:journalctl@ceph.osd.2.smithi190.stdout:Mar 04 09:08:39 smithi190 sudo[45553]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-04T09:08:39.670 INFO:journalctl@ceph.osd.2.smithi190.stdout:Mar 04 09:08:39 smithi190 sudo[45553]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-04T09:08:39.670 INFO:journalctl@ceph.osd.2.smithi190.stdout:Mar 04 09:08:39 smithi190 sudo[45553]: pam_unix(sudo:session): session closed for user root 2024-03-04T09:08:39.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:39 smithi082 sudo[52273]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-04T09:08:39.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:39 smithi082 sudo[52273]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-04T09:08:39.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:39 smithi082 sudo[52273]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-04T09:08:39.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:39 smithi082 sudo[52273]: pam_unix(sudo:session): session closed for user root 2024-03-04T09:08:39.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:39.853+0000 7f5a26ffd700 1 -- 172.21.15.82:0/2619300783 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f5a2c0096d0 con 0x7f5a30100ff0 2024-03-04T09:08:40.098 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:39 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:40.098 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:39 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:40.099 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:39 smithi190 ceph-mon[36341]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-04T09:08:40.099 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:40 smithi190 sudo[45556]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-04T09:08:40.099 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:40 smithi190 sudo[45556]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-04T09:08:40.099 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:40 smithi190 sudo[45556]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-04T09:08:40.099 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:40 smithi190 sudo[45556]: pam_unix(sudo:session): session closed for user root 2024-03-04T09:08:40.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:39 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:40.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:39 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:40.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:39 smithi102 ceph-mon[36220]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-04T09:08:40.316 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:39 smithi082 sudo[52288]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-04T09:08:40.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:39 smithi082 sudo[52288]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-04T09:08:40.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:39 smithi082 sudo[52288]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-04T09:08:40.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:39 smithi082 sudo[52288]: pam_unix(sudo:session): session closed for user root 2024-03-04T09:08:40.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:39 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:40.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:39 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:40.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:39 smithi082 ceph-mon[32880]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-04T09:08:40.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:40 smithi190 sudo[45559]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-04T09:08:40.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:40 smithi190 sudo[45559]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-04T09:08:40.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:40 smithi190 sudo[45559]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-04T09:08:40.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:40 smithi190 sudo[45559]: pam_unix(sudo:session): session closed for user root 2024-03-04T09:08:40.830 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:40 smithi102 sudo[44776]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-04T09:08:40.830 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:40 smithi102 sudo[44776]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-04T09:08:40.830 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:40 smithi102 sudo[44776]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-04T09:08:40.831 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:40 smithi102 sudo[44776]: pam_unix(sudo:session): session closed for user root 2024-03-04T09:08:41.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:40 smithi082 ceph-mon[32880]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-04T09:08:41.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:40 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T09:08:41.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:40 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T09:08:41.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:40 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T09:08:41.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:40 smithi082 ceph-mon[32880]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-04T09:08:41.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:40 smithi082 ceph-mon[32880]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-03-04T09:08:41.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:40 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T09:08:41.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:40 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T09:08:41.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:40 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T09:08:41.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:40 smithi082 ceph-mon[32880]: pgmap v86: 1 pgs: 1 active+clean; 449 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-03-04T09:08:41.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:40 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/118401845' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "91ccbdc3-3da6-4d39-8a89-3a7b7bb4adc3"}]: dispatch 2024-03-04T09:08:41.068 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:40 smithi082 ceph-mon[32880]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-04T09:08:41.068 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:40 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/118401845' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "91ccbdc3-3da6-4d39-8a89-3a7b7bb4adc3"}]': finished 2024-03-04T09:08:41.068 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:40 smithi082 ceph-mon[32880]: osdmap e23: 4 total, 3 up, 4 in 2024-03-04T09:08:41.068 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:40 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-04T09:08:41.068 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:40 smithi082 ceph-mon[32880]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-04T09:08:41.068 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:40 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T09:08:41.068 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:40 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T09:08:41.068 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:40 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T09:08:41.068 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:40 smithi082 ceph-mon[32880]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-04T09:08:41.170 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:40 smithi190 ceph-mon[36341]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-04T09:08:41.170 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:40 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T09:08:41.170 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:40 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T09:08:41.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:40 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T09:08:41.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:40 smithi190 ceph-mon[36341]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-04T09:08:41.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:40 smithi190 ceph-mon[36341]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-03-04T09:08:41.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:40 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T09:08:41.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:40 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T09:08:41.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:40 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T09:08:41.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:40 smithi190 ceph-mon[36341]: pgmap v86: 1 pgs: 1 active+clean; 449 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-03-04T09:08:41.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:40 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/118401845' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "91ccbdc3-3da6-4d39-8a89-3a7b7bb4adc3"}]: dispatch 2024-03-04T09:08:41.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:40 smithi190 ceph-mon[36341]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-04T09:08:41.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:40 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/118401845' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "91ccbdc3-3da6-4d39-8a89-3a7b7bb4adc3"}]': finished 2024-03-04T09:08:41.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:40 smithi190 ceph-mon[36341]: osdmap e23: 4 total, 3 up, 4 in 2024-03-04T09:08:41.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:40 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-04T09:08:41.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:40 smithi190 ceph-mon[36341]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-04T09:08:41.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:40 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T09:08:41.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:40 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T09:08:41.172 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:40 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T09:08:41.172 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:40 smithi190 ceph-mon[36341]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-04T09:08:41.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:40 smithi102 sudo[44779]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-04T09:08:41.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:40 smithi102 sudo[44779]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-04T09:08:41.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:40 smithi102 sudo[44779]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-04T09:08:41.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:40 smithi102 sudo[44779]: pam_unix(sudo:session): session closed for user root 2024-03-04T09:08:41.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:40 smithi102 ceph-mon[36220]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-04T09:08:41.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:40 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T09:08:41.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:40 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T09:08:41.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:40 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T09:08:41.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:40 smithi102 ceph-mon[36220]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-04T09:08:41.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:40 smithi102 ceph-mon[36220]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-03-04T09:08:41.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:40 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T09:08:41.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:40 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T09:08:41.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:40 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T09:08:41.180 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:40 smithi102 ceph-mon[36220]: pgmap v86: 1 pgs: 1 active+clean; 449 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-03-04T09:08:41.180 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:40 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/118401845' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "91ccbdc3-3da6-4d39-8a89-3a7b7bb4adc3"}]: dispatch 2024-03-04T09:08:41.180 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:40 smithi102 ceph-mon[36220]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-04T09:08:41.180 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:40 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/118401845' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "91ccbdc3-3da6-4d39-8a89-3a7b7bb4adc3"}]': finished 2024-03-04T09:08:41.180 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:40 smithi102 ceph-mon[36220]: osdmap e23: 4 total, 3 up, 4 in 2024-03-04T09:08:41.180 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:40 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-04T09:08:41.180 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:40 smithi102 ceph-mon[36220]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-04T09:08:41.180 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:40 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T09:08:41.180 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:40 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T09:08:41.180 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:40 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T09:08:41.180 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:40 smithi102 ceph-mon[36220]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-04T09:08:42.170 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:41 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/3503429602' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T09:08:42.178 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:41 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/3503429602' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T09:08:42.316 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:41 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/3503429602' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T09:08:43.170 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:42 smithi190 ceph-mon[36341]: pgmap v88: 1 pgs: 1 active+clean; 449 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-03-04T09:08:43.178 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:42 smithi102 ceph-mon[36220]: pgmap v88: 1 pgs: 1 active+clean; 449 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-03-04T09:08:43.316 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:42 smithi082 ceph-mon[32880]: pgmap v88: 1 pgs: 1 active+clean; 449 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-03-04T09:08:45.542 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:45 smithi082 ceph-mon[32880]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 305 KiB/s wr, 20 op/s 2024-03-04T09:08:45.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:45 smithi190 ceph-mon[36341]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 305 KiB/s wr, 20 op/s 2024-03-04T09:08:45.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:45 smithi102 ceph-mon[36220]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 305 KiB/s wr, 20 op/s 2024-03-04T09:08:47.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:47 smithi082 ceph-mon[32880]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 228 KiB/s wr, 15 op/s 2024-03-04T09:08:47.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:47 smithi190 ceph-mon[36341]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 228 KiB/s wr, 15 op/s 2024-03-04T09:08:47.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:47 smithi102 ceph-mon[36220]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 228 KiB/s wr, 15 op/s 2024-03-04T09:08:48.538 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:48 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-04T09:08:48.539 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:48 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:08:48.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:48 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-04T09:08:48.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:48 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:08:48.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:48 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-04T09:08:48.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:48 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:08:49.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:49 smithi082 ceph-mon[32880]: Deploying daemon osd.3 on smithi082 2024-03-04T09:08:49.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:49 smithi082 ceph-mon[32880]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 191 KiB/s wr, 13 op/s 2024-03-04T09:08:49.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:49 smithi190 ceph-mon[36341]: Deploying daemon osd.3 on smithi082 2024-03-04T09:08:49.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:49 smithi190 ceph-mon[36341]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 191 KiB/s wr, 13 op/s 2024-03-04T09:08:49.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:49 smithi102 ceph-mon[36220]: Deploying daemon osd.3 on smithi082 2024-03-04T09:08:49.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:49 smithi102 ceph-mon[36220]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 191 KiB/s wr, 13 op/s 2024-03-04T09:08:51.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:51 smithi082 ceph-mon[32880]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 183 KiB/s wr, 12 op/s 2024-03-04T09:08:51.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:51 smithi190 ceph-mon[36341]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 183 KiB/s wr, 12 op/s 2024-03-04T09:08:51.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:51 smithi102 ceph-mon[36220]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 183 KiB/s wr, 12 op/s 2024-03-04T09:08:53.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:53 smithi082 ceph-mon[32880]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 154 KiB/s wr, 10 op/s 2024-03-04T09:08:53.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:53 smithi190 ceph-mon[36341]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 154 KiB/s wr, 10 op/s 2024-03-04T09:08:53.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:53 smithi102 ceph-mon[36220]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 154 KiB/s wr, 10 op/s 2024-03-04T09:08:54.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:54 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:54.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:54 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:08:54.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:54 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:54.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:54 smithi082 ceph-mon[32880]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 152 KiB/s wr, 10 op/s 2024-03-04T09:08:54.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:54 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:54.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:54 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:08:54.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:54 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:54.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:54 smithi190 ceph-mon[36341]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 152 KiB/s wr, 10 op/s 2024-03-04T09:08:54.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:54 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:54.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:54 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:08:54.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:54 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:54.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:54 smithi102 ceph-mon[36220]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 152 KiB/s wr, 10 op/s 2024-03-04T09:08:57.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:57.296+0000 7f5a26ffd700 1 -- 172.21.15.82:0/2619300783 <== mgr.14152 v2:172.21.15.82:6800/1278635224 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f5a3006a4b0 con 0x7f5a1c0a1d80 2024-03-04T09:08:57.293 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 3 on host 'smithi082' 2024-03-04T09:08:57.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:57.298+0000 7f5a37eb5700 1 -- 172.21.15.82:0/2619300783 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f5a1c0a1d80 msgr2=0x7f5a1c0a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:08:57.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:57.298+0000 7f5a37eb5700 1 --2- 172.21.15.82:0/2619300783 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f5a1c0a1d80 0x7f5a1c0a4240 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5a20000c00 tx=0x7f5a20005fb0 comp rx=0 tx=0).stop 2024-03-04T09:08:57.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:57.298+0000 7f5a37eb5700 1 -- 172.21.15.82:0/2619300783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a30100ff0 msgr2=0x7f5a30198390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:08:57.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:57.298+0000 7f5a37eb5700 1 --2- 172.21.15.82:0/2619300783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a30100ff0 0x7f5a30198390 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c00d9b0 tx=0x7f5a2c00dcc0 comp rx=0 tx=0).stop 2024-03-04T09:08:57.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:57.298+0000 7f5a37eb5700 1 -- 172.21.15.82:0/2619300783 shutdown_connections 2024-03-04T09:08:57.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:57.298+0000 7f5a37eb5700 1 --2- 172.21.15.82:0/2619300783 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f5a1c0a1d80 0x7f5a1c0a4240 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:08:57.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:57.298+0000 7f5a37eb5700 1 --2- 172.21.15.82:0/2619300783 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5a30102b90 0x7f5a3019f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:08:57.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:57.298+0000 7f5a37eb5700 1 --2- 172.21.15.82:0/2619300783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a30100ff0 0x7f5a30198390 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:08:57.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:57.298+0000 7f5a37eb5700 1 --2- 172.21.15.82:0/2619300783 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a301021f0 0x7f5a301988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:08:57.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:57.298+0000 7f5a37eb5700 1 -- 172.21.15.82:0/2619300783 >> 172.21.15.82:0/2619300783 conn(0x7f5a300fc590 msgr2=0x7f5a30069da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:08:57.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:57.298+0000 7f5a37eb5700 1 -- 172.21.15.82:0/2619300783 shutdown_connections 2024-03-04T09:08:57.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:08:57.298+0000 7f5a37eb5700 1 -- 172.21.15.82:0/2619300783 wait complete. 2024-03-04T09:08:57.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:57 smithi082 ceph-mon[32880]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-03-04T09:08:57.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:57 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:57.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:57 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:57.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:57 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:08:57.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:57 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:08:57.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:57 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:57.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:57 smithi190 ceph-mon[36341]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-03-04T09:08:57.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:57 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:57.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:57 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:57.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:57 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:08:57.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:57 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:08:57.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:57 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:57.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:57 smithi102 ceph-mon[36220]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-03-04T09:08:57.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:57 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:57.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:57 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:57.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:57 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:08:57.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:57 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:08:57.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:57 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:58.006 DEBUG:teuthology.orchestra.run.smithi082:osd.3> sudo journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@osd.3.service 2024-03-04T09:08:58.009 INFO:tasks.cephadm:Deploying osd.4 on smithi102 with /dev/vg_nvme/lv_3... 2024-03-04T09:08:58.009 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-03-04T09:08:58.265 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.b/config 2024-03-04T09:08:58.387 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:58 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:58.387 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:58 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:08:58.387 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:58 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:58.387 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:58 smithi102 ceph-mon[36220]: from='osd.3 [v2:172.21.15.82:6810/980870924,v1:172.21.15.82:6811/980870924]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-04T09:08:58.542 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:58 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:58.542 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:58 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:08:58.542 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:58 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:58.542 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:58 smithi082 ceph-mon[32880]: from='osd.3 [v2:172.21.15.82:6810/980870924,v1:172.21.15.82:6811/980870924]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-04T09:08:58.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:58 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:58.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:58 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:08:58.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:58 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:08:58.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:58 smithi190 ceph-mon[36341]: from='osd.3 [v2:172.21.15.82:6810/980870924,v1:172.21.15.82:6811/980870924]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-04T09:08:59.555 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:59 smithi102 ceph-mon[36220]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-03-04T09:08:59.555 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:59 smithi102 ceph-mon[36220]: from='osd.3 [v2:172.21.15.82:6810/980870924,v1:172.21.15.82:6811/980870924]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-04T09:08:59.555 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:59 smithi102 ceph-mon[36220]: osdmap e24: 4 total, 3 up, 4 in 2024-03-04T09:08:59.556 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:59 smithi102 ceph-mon[36220]: from='osd.3 [v2:172.21.15.82:6810/980870924,v1:172.21.15.82:6811/980870924]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-03-04T09:08:59.556 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:08:59 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-04T09:08:59.562 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:59 smithi082 ceph-mon[32880]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-03-04T09:08:59.562 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:59 smithi082 ceph-mon[32880]: from='osd.3 [v2:172.21.15.82:6810/980870924,v1:172.21.15.82:6811/980870924]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-04T09:08:59.563 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:59 smithi082 ceph-mon[32880]: osdmap e24: 4 total, 3 up, 4 in 2024-03-04T09:08:59.563 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:59 smithi082 ceph-mon[32880]: from='osd.3 [v2:172.21.15.82:6810/980870924,v1:172.21.15.82:6811/980870924]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-03-04T09:08:59.563 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:08:59 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-04T09:08:59.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:59 smithi190 ceph-mon[36341]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-03-04T09:08:59.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:59 smithi190 ceph-mon[36341]: from='osd.3 [v2:172.21.15.82:6810/980870924,v1:172.21.15.82:6811/980870924]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-04T09:08:59.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:59 smithi190 ceph-mon[36341]: osdmap e24: 4 total, 3 up, 4 in 2024-03-04T09:08:59.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:59 smithi190 ceph-mon[36341]: from='osd.3 [v2:172.21.15.82:6810/980870924,v1:172.21.15.82:6811/980870924]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-03-04T09:08:59.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:08:59 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-04T09:08:59.817 INFO:journalctl@ceph.osd.3.smithi082.stdout:Mar 04 09:08:59 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-3[54369]: 2024-03-04T09:08:59.710+0000 7f6542638700 -1 osd.3 0 waiting for initial osdmap 2024-03-04T09:08:59.817 INFO:journalctl@ceph.osd.3.smithi082.stdout:Mar 04 09:08:59 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-3[54369]: 2024-03-04T09:08:59.717+0000 7f653a423700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T09:09:00.102 INFO:teuthology.orchestra.run.smithi102.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-03-04T09:09:00.102 INFO:teuthology.orchestra.run.smithi102.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-03-04T09:09:00.102 INFO:teuthology.orchestra.run.smithi102.stderr: stderr: 10+0 records in 2024-03-04T09:09:00.102 INFO:teuthology.orchestra.run.smithi102.stderr:10+0 records out 2024-03-04T09:09:00.103 INFO:teuthology.orchestra.run.smithi102.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0112905 s, 929 MB/s 2024-03-04T09:09:00.103 INFO:teuthology.orchestra.run.smithi102.stderr:--> Zapping successful for: 2024-03-04T09:09:00.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:00 smithi082 ceph-mon[32880]: from='osd.3 [v2:172.21.15.82:6810/980870924,v1:172.21.15.82:6811/980870924]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-03-04T09:09:00.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:00 smithi082 ceph-mon[32880]: osdmap e25: 4 total, 3 up, 4 in 2024-03-04T09:09:00.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:00 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-04T09:09:00.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:00 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-04T09:09:00.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:00 smithi082 ceph-mon[32880]: from='osd.3 [v2:172.21.15.82:6810/980870924,v1:172.21.15.82:6811/980870924]' entity='osd.3' 2024-03-04T09:09:00.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:00 smithi190 ceph-mon[36341]: from='osd.3 [v2:172.21.15.82:6810/980870924,v1:172.21.15.82:6811/980870924]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-03-04T09:09:00.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:00 smithi190 ceph-mon[36341]: osdmap e25: 4 total, 3 up, 4 in 2024-03-04T09:09:00.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:00 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-04T09:09:00.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:00 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-04T09:09:00.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:00 smithi190 ceph-mon[36341]: from='osd.3 [v2:172.21.15.82:6810/980870924,v1:172.21.15.82:6811/980870924]' entity='osd.3' 2024-03-04T09:09:00.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:00 smithi102 ceph-mon[36220]: from='osd.3 [v2:172.21.15.82:6810/980870924,v1:172.21.15.82:6811/980870924]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-03-04T09:09:00.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:00 smithi102 ceph-mon[36220]: osdmap e25: 4 total, 3 up, 4 in 2024-03-04T09:09:00.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:00 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-04T09:09:00.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:00 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-04T09:09:00.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:00 smithi102 ceph-mon[36220]: from='osd.3 [v2:172.21.15.82:6810/980870924,v1:172.21.15.82:6811/980870924]' entity='osd.3' 2024-03-04T09:09:00.751 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph orch daemon add osd smithi102:vg_nvme/lv_3 2024-03-04T09:09:00.985 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.b/config 2024-03-04T09:09:01.419 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:01 smithi102 ceph-mon[36220]: purged_snaps scrub starts 2024-03-04T09:09:01.419 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:01 smithi102 ceph-mon[36220]: purged_snaps scrub ok 2024-03-04T09:09:01.419 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:01 smithi102 ceph-mon[36220]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-03-04T09:09:01.419 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:01 smithi102 ceph-mon[36220]: osd.3 [v2:172.21.15.82:6810/980870924,v1:172.21.15.82:6811/980870924] boot 2024-03-04T09:09:01.419 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:01 smithi102 ceph-mon[36220]: osdmap e26: 4 total, 4 up, 4 in 2024-03-04T09:09:01.419 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:01 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-04T09:09:01.419 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:01 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:01.419 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:01 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:01.419 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:01 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:09:01.420 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:01 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:09:01.420 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:01 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:01.420 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:01 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:09:01.420 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:01 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:09:01.420 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:01 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:01.420 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:01 smithi102 ceph-mon[36220]: osdmap e27: 4 total, 4 up, 4 in 2024-03-04T09:09:01.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:01 smithi082 ceph-mon[32880]: purged_snaps scrub starts 2024-03-04T09:09:01.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:01 smithi082 ceph-mon[32880]: purged_snaps scrub ok 2024-03-04T09:09:01.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:01 smithi082 ceph-mon[32880]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-03-04T09:09:01.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:01 smithi082 ceph-mon[32880]: osd.3 [v2:172.21.15.82:6810/980870924,v1:172.21.15.82:6811/980870924] boot 2024-03-04T09:09:01.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:01 smithi082 ceph-mon[32880]: osdmap e26: 4 total, 4 up, 4 in 2024-03-04T09:09:01.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:01 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-04T09:09:01.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:01 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:01.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:01 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:01.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:01 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:09:01.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:01 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:09:01.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:01 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:01.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:01 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:09:01.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:01 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:09:01.568 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:01 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:01.568 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:01 smithi082 ceph-mon[32880]: osdmap e27: 4 total, 4 up, 4 in 2024-03-04T09:09:01.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:01 smithi190 ceph-mon[36341]: purged_snaps scrub starts 2024-03-04T09:09:01.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:01 smithi190 ceph-mon[36341]: purged_snaps scrub ok 2024-03-04T09:09:01.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:01 smithi190 ceph-mon[36341]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-03-04T09:09:01.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:01 smithi190 ceph-mon[36341]: osd.3 [v2:172.21.15.82:6810/980870924,v1:172.21.15.82:6811/980870924] boot 2024-03-04T09:09:01.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:01 smithi190 ceph-mon[36341]: osdmap e26: 4 total, 4 up, 4 in 2024-03-04T09:09:01.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:01 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-04T09:09:01.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:01 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:01.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:01 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:01.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:01 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:09:01.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:01 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:09:01.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:01 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:01.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:01 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:09:01.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:01 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:09:01.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:01 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:01.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:01 smithi190 ceph-mon[36341]: osdmap e27: 4 total, 4 up, 4 in 2024-03-04T09:09:02.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:09:02.565+0000 7f0fd9410700 1 -- 172.21.15.102:0/778636585 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0fd41020f0 msgr2=0x7f0fd4102510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:09:02.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:09:02.565+0000 7f0fd9410700 1 --2- 172.21.15.102:0/778636585 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0fd41020f0 0x7f0fd4102510 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0fc40099c0 tx=0x7f0fc4009cd0 comp rx=0 tx=0).stop 2024-03-04T09:09:02.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:09:02.565+0000 7f0fd9410700 1 -- 172.21.15.102:0/778636585 shutdown_connections 2024-03-04T09:09:02.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:09:02.565+0000 7f0fd9410700 1 --2- 172.21.15.102:0/778636585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fd4103c90 0x7f0fd410a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:09:02.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:09:02.565+0000 7f0fd9410700 1 --2- 172.21.15.102:0/778636585 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0fd41020f0 0x7f0fd4102510 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:09:02.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:09:02.565+0000 7f0fd9410700 1 --2- 172.21.15.102:0/778636585 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0fd41032f0 0x7f0fd4103750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:09:02.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:09:02.565+0000 7f0fd9410700 1 -- 172.21.15.102:0/778636585 >> 172.21.15.102:0/778636585 conn(0x7f0fd40fd6d0 msgr2=0x7f0fd40ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:09:02.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:09:02.565+0000 7f0fd9410700 1 -- 172.21.15.102:0/778636585 shutdown_connections 2024-03-04T09:09:02.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:09:02.565+0000 7f0fd9410700 1 -- 172.21.15.102:0/778636585 wait complete. 2024-03-04T09:09:02.563 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:02 smithi102 ceph-mon[36220]: Detected new or changed devices on smithi082 2024-03-04T09:09:02.563 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:02 smithi102 ceph-mon[36220]: Adjusting osd_memory_target on smithi082 to 8544M 2024-03-04T09:09:02.563 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:02 smithi102 ceph-mon[36220]: osdmap e28: 4 total, 4 up, 4 in 2024-03-04T09:09:02.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:09:02.566+0000 7f0fd9410700 1 Processor -- start 2024-03-04T09:09:02.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:09:02.566+0000 7f0fd9410700 1 -- start start 2024-03-04T09:09:02.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:09:02.566+0000 7f0fd9410700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fd41020f0 0x7f0fd4198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:09:02.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:09:02.566+0000 7f0fd9410700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0fd41032f0 0x7f0fd41988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:09:02.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:09:02.566+0000 7f0fd9410700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0fd4103c90 0x7f0fd419f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:09:02.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:09:02.566+0000 7f0fd9410700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd410dca0 con 0x7f0fd41020f0 2024-03-04T09:09:02.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:09:02.566+0000 7f0fd9410700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd410db20 con 0x7f0fd4103c90 2024-03-04T09:09:02.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:09:02.566+0000 7f0fd9410700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd410de20 con 0x7f0fd41032f0 2024-03-04T09:09:02.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:09:02.566+0000 7f0fd37fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0fd4103c90 0x7f0fd419f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:09:02.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:09:02.566+0000 7f0fd37fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0fd4103c90 0x7f0fd419f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:57952/0 (socket says 172.21.15.102:57952) 2024-03-04T09:09:02.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:09:02.566+0000 7f0fd37fe700 1 -- 172.21.15.102:0/221815454 learned_addr learned my addr 172.21.15.102:0/221815454 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-04T09:09:02.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:09:02.566+0000 7f0fd2ffd700 1 --2- 172.21.15.102:0/221815454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fd41020f0 0x7f0fd4198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:09:02.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:09:02.566+0000 7f0fca7fc700 1 --2- 172.21.15.102:0/221815454 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0fd41032f0 0x7f0fd41988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:09:02.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:09:02.567+0000 7f0fd37fe700 1 -- 172.21.15.102:0/221815454 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0fd41032f0 msgr2=0x7f0fd41988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:09:02.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:09:02.567+0000 7f0fd37fe700 1 --2- 172.21.15.102:0/221815454 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0fd41032f0 0x7f0fd41988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:09:02.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:09:02.567+0000 7f0fd37fe700 1 -- 172.21.15.102:0/221815454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fd41020f0 msgr2=0x7f0fd4198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:09:02.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:09:02.567+0000 7f0fd37fe700 1 --2- 172.21.15.102:0/221815454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fd41020f0 0x7f0fd4198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:09:02.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:09:02.567+0000 7f0fd37fe700 1 -- 172.21.15.102:0/221815454 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd419ff90 con 0x7f0fd4103c90 2024-03-04T09:09:02.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:09:02.567+0000 7f0fd37fe700 1 --2- 172.21.15.102:0/221815454 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0fd4103c90 0x7f0fd419f8f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc007ee0 tx=0x7f0fcc00d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:09:02.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:09:02.567+0000 7f0fd0ff9700 1 -- 172.21.15.102:0/221815454 <== mon.2 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fcc00dd20 con 0x7f0fd4103c90 2024-03-04T09:09:02.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:09:02.567+0000 7f0fd0ff9700 1 -- 172.21.15.102:0/221815454 <== mon.2 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f0fcc004020 con 0x7f0fd4103c90 2024-03-04T09:09:02.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:09:02.567+0000 7f0fd9410700 1 -- 172.21.15.102:0/221815454 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fd41a0280 con 0x7f0fd4103c90 2024-03-04T09:09:02.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:09:02.567+0000 7f0fd0ff9700 1 -- 172.21.15.102:0/221815454 <== mon.2 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fcc015660 con 0x7f0fd4103c90 2024-03-04T09:09:02.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:09:02.567+0000 7f0fd9410700 1 -- 172.21.15.102:0/221815454 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fd41a07c0 con 0x7f0fd4103c90 2024-03-04T09:09:02.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:09:02.568+0000 7f0fd9410700 1 -- 172.21.15.102:0/221815454 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fd4068d80 con 0x7f0fd4103c90 2024-03-04T09:09:02.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:09:02.569+0000 7f0fd0ff9700 1 -- 172.21.15.102:0/221815454 <== mon.2 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f0fcc0041d0 con 0x7f0fd4103c90 2024-03-04T09:09:02.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:09:02.570+0000 7f0fd0ff9700 1 --2- 172.21.15.102:0/221815454 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f0fc00a1e10 0x7f0fc00a42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:09:02.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:09:02.570+0000 7f0fd0ff9700 1 -- 172.21.15.102:0/221815454 <== mon.2 v2:172.21.15.102:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 3698+0+0 (secure 0 0 0) 0x7f0fcc0cc540 con 0x7f0fd4103c90 2024-03-04T09:09:02.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:09:02.570+0000 7f0fd2ffd700 1 --2- 172.21.15.102:0/221815454 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f0fc00a1e10 0x7f0fc00a42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:09:02.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:09:02.571+0000 7f0fd2ffd700 1 --2- 172.21.15.102:0/221815454 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f0fc00a1e10 0x7f0fc00a42d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4003900 tx=0x7f0fc4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:09:02.570 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:02 smithi082 ceph-mon[32880]: Detected new or changed devices on smithi082 2024-03-04T09:09:02.570 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:02 smithi082 ceph-mon[32880]: Adjusting osd_memory_target on smithi082 to 8544M 2024-03-04T09:09:02.570 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:02 smithi082 ceph-mon[32880]: osdmap e28: 4 total, 4 up, 4 in 2024-03-04T09:09:02.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:09:02.575+0000 7f0fd0ff9700 1 -- 172.21.15.102:0/221815454 <== mon.2 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f0fcc010070 con 0x7f0fd4103c90 2024-03-04T09:09:02.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:02 smithi190 ceph-mon[36341]: Detected new or changed devices on smithi082 2024-03-04T09:09:02.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:02 smithi190 ceph-mon[36341]: Adjusting osd_memory_target on smithi082 to 8544M 2024-03-04T09:09:02.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:02 smithi190 ceph-mon[36341]: osdmap e28: 4 total, 4 up, 4 in 2024-03-04T09:09:02.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:09:02.777+0000 7f0fd9410700 1 -- 172.21.15.102:0/221815454 --> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f0fd4062500 con 0x7f0fc00a1e10 2024-03-04T09:09:03.562 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:03 smithi102 ceph-mon[36220]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 358 GiB / 358 GiB avail 2024-03-04T09:09:03.562 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:03 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T09:09:03.563 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:03 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T09:09:03.563 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:03 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:09:03.563 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:03 smithi102 ceph-mon[36220]: osdmap e29: 4 total, 4 up, 4 in 2024-03-04T09:09:03.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:03 smithi082 ceph-mon[32880]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 358 GiB / 358 GiB avail 2024-03-04T09:09:03.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:03 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T09:09:03.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:03 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T09:09:03.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:03 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:09:03.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:03 smithi082 ceph-mon[32880]: osdmap e29: 4 total, 4 up, 4 in 2024-03-04T09:09:03.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:03 smithi190 ceph-mon[36341]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 358 GiB / 358 GiB avail 2024-03-04T09:09:03.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:03 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T09:09:03.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:03 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T09:09:03.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:03 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:09:03.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:03 smithi190 ceph-mon[36341]: osdmap e29: 4 total, 4 up, 4 in 2024-03-04T09:09:04.553 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:04 smithi102 ceph-mon[36220]: from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:09:04.553 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:04 smithi102 ceph-mon[36220]: osdmap e30: 4 total, 4 up, 4 in 2024-03-04T09:09:04.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:04 smithi082 ceph-mon[32880]: from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:09:04.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:04 smithi082 ceph-mon[32880]: osdmap e30: 4 total, 4 up, 4 in 2024-03-04T09:09:04.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:04 smithi190 ceph-mon[36341]: from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:09:04.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:04 smithi190 ceph-mon[36341]: osdmap e30: 4 total, 4 up, 4 in 2024-03-04T09:09:05.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:05 smithi082 ceph-mon[32880]: pgmap v106: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 112 MiB used, 358 GiB / 358 GiB avail; 148 KiB/s, 0 objects/s recovering 2024-03-04T09:09:05.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:05 smithi190 ceph-mon[36341]: pgmap v106: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 112 MiB used, 358 GiB / 358 GiB avail; 148 KiB/s, 0 objects/s recovering 2024-03-04T09:09:05.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:05 smithi102 ceph-mon[36220]: pgmap v106: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 112 MiB used, 358 GiB / 358 GiB avail; 148 KiB/s, 0 objects/s recovering 2024-03-04T09:09:06.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:06 smithi082 ceph-mon[32880]: from='client.? 172.21.15.102:0/1004901382' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dbb9d486-5daa-4819-bbed-04fc76ca473e"}]: dispatch 2024-03-04T09:09:06.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:06 smithi082 ceph-mon[32880]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dbb9d486-5daa-4819-bbed-04fc76ca473e"}]: dispatch 2024-03-04T09:09:06.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:06 smithi082 ceph-mon[32880]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dbb9d486-5daa-4819-bbed-04fc76ca473e"}]': finished 2024-03-04T09:09:06.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:06 smithi082 ceph-mon[32880]: osdmap e31: 5 total, 4 up, 5 in 2024-03-04T09:09:06.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:06 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-04T09:09:06.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:06 smithi082 ceph-mon[32880]: from='client.? 172.21.15.102:0/3017269167' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T09:09:06.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:06 smithi190 ceph-mon[36341]: from='client.? 172.21.15.102:0/1004901382' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dbb9d486-5daa-4819-bbed-04fc76ca473e"}]: dispatch 2024-03-04T09:09:06.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:06 smithi190 ceph-mon[36341]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dbb9d486-5daa-4819-bbed-04fc76ca473e"}]: dispatch 2024-03-04T09:09:06.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:06 smithi190 ceph-mon[36341]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dbb9d486-5daa-4819-bbed-04fc76ca473e"}]': finished 2024-03-04T09:09:06.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:06 smithi190 ceph-mon[36341]: osdmap e31: 5 total, 4 up, 5 in 2024-03-04T09:09:06.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:06 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-04T09:09:06.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:06 smithi190 ceph-mon[36341]: from='client.? 172.21.15.102:0/3017269167' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T09:09:06.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:06 smithi102 ceph-mon[36220]: from='client.? 172.21.15.102:0/1004901382' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dbb9d486-5daa-4819-bbed-04fc76ca473e"}]: dispatch 2024-03-04T09:09:06.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:06 smithi102 ceph-mon[36220]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dbb9d486-5daa-4819-bbed-04fc76ca473e"}]: dispatch 2024-03-04T09:09:06.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:06 smithi102 ceph-mon[36220]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dbb9d486-5daa-4819-bbed-04fc76ca473e"}]': finished 2024-03-04T09:09:06.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:06 smithi102 ceph-mon[36220]: osdmap e31: 5 total, 4 up, 5 in 2024-03-04T09:09:06.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:06 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-04T09:09:06.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:06 smithi102 ceph-mon[36220]: from='client.? 172.21.15.102:0/3017269167' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T09:09:07.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:07 smithi190 ceph-mon[36341]: pgmap v108: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-03-04T09:09:07.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:07 smithi102 ceph-mon[36220]: pgmap v108: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-03-04T09:09:07.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:07 smithi082 ceph-mon[32880]: pgmap v108: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-03-04T09:09:09.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:09 smithi082 ceph-mon[32880]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-03-04T09:09:09.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:09 smithi190 ceph-mon[36341]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-03-04T09:09:09.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:09 smithi102 ceph-mon[36220]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-03-04T09:09:11.585 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:11 smithi102 ceph-mon[36220]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-04T09:09:11.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:11 smithi190 ceph-mon[36341]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-04T09:09:11.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:11 smithi082 ceph-mon[32880]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-04T09:09:13.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:13 smithi102 ceph-mon[36220]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-04T09:09:13.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:13 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-04T09:09:13.584 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:13 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:09:13.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:13 smithi190 ceph-mon[36341]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-04T09:09:13.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:13 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-04T09:09:13.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:13 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:09:13.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:13 smithi082 ceph-mon[32880]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-04T09:09:13.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:13 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-04T09:09:13.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:13 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:09:14.514 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:14 smithi102 ceph-mon[36220]: Deploying daemon osd.4 on smithi102 2024-03-04T09:09:14.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:14 smithi190 ceph-mon[36341]: Deploying daemon osd.4 on smithi102 2024-03-04T09:09:14.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:14 smithi082 ceph-mon[32880]: Deploying daemon osd.4 on smithi102 2024-03-04T09:09:15.652 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:15 smithi102 ceph-mon[36220]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-04T09:09:15.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:15 smithi190 ceph-mon[36341]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-04T09:09:15.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:15 smithi082 ceph-mon[32880]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-04T09:09:17.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:17 smithi102 ceph-mon[36220]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-04T09:09:17.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:17 smithi190 ceph-mon[36341]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-04T09:09:17.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:17 smithi082 ceph-mon[32880]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-04T09:09:19.178 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:19 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:19.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:19 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:19.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:19 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:09:19.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:19 smithi102 ceph-mon[36220]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-04T09:09:19.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:19 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:19.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:19 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:19.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:19 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:09:19.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:19 smithi082 ceph-mon[32880]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-04T09:09:19.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:19 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:19.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:19 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:19.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:19 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:09:19.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:19 smithi190 ceph-mon[36341]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-04T09:09:21.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:21 smithi082 ceph-mon[32880]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-04T09:09:21.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:21 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:21.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:21 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:21.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:21 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:09:21.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:21 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:09:21.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:21 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:21.608 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:21 smithi102 ceph-mon[36220]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-04T09:09:21.608 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:21 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:21.608 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:21 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:21.608 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:21 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:09:21.608 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:21 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:09:21.608 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:21 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:21.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:21 smithi190 ceph-mon[36341]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-04T09:09:21.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:21 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:21.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:21 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:21.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:21 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:09:21.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:21 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:09:21.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:21 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:21.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:09:21.994+0000 7f0fd0ff9700 1 -- 172.21.15.102:0/221815454 <== mgr.14152 v2:172.21.15.82:6800/1278635224 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f0fd4062500 con 0x7f0fc00a1e10 2024-03-04T09:09:21.992 INFO:teuthology.orchestra.run.smithi102.stdout:Created osd(s) 4 on host 'smithi102' 2024-03-04T09:09:21.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:09:21.998+0000 7f0fd9410700 1 -- 172.21.15.102:0/221815454 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f0fc00a1e10 msgr2=0x7f0fc00a42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:09:21.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:09:21.998+0000 7f0fd9410700 1 --2- 172.21.15.102:0/221815454 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f0fc00a1e10 0x7f0fc00a42d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4003900 tx=0x7f0fc4005fb0 comp rx=0 tx=0).stop 2024-03-04T09:09:21.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:09:21.998+0000 7f0fd9410700 1 -- 172.21.15.102:0/221815454 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0fd4103c90 msgr2=0x7f0fd419f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:09:21.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:09:21.998+0000 7f0fd9410700 1 --2- 172.21.15.102:0/221815454 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0fd4103c90 0x7f0fd419f8f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc007ee0 tx=0x7f0fcc00d3b0 comp rx=0 tx=0).stop 2024-03-04T09:09:21.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:09:21.998+0000 7f0fd9410700 1 -- 172.21.15.102:0/221815454 shutdown_connections 2024-03-04T09:09:21.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:09:21.998+0000 7f0fd9410700 1 --2- 172.21.15.102:0/221815454 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f0fc00a1e10 0x7f0fc00a42d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:09:21.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:09:21.998+0000 7f0fd9410700 1 --2- 172.21.15.102:0/221815454 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0fd4103c90 0x7f0fd419f8f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:09:21.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:09:21.998+0000 7f0fd9410700 1 --2- 172.21.15.102:0/221815454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fd41020f0 0x7f0fd4198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:09:21.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:09:21.998+0000 7f0fd9410700 1 --2- 172.21.15.102:0/221815454 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0fd41032f0 0x7f0fd41988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:09:21.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:09:21.998+0000 7f0fd9410700 1 -- 172.21.15.102:0/221815454 >> 172.21.15.102:0/221815454 conn(0x7f0fd40fd6d0 msgr2=0x7f0fd4106780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:09:21.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:09:21.998+0000 7f0fd9410700 1 -- 172.21.15.102:0/221815454 shutdown_connections 2024-03-04T09:09:21.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:09:21.998+0000 7f0fd9410700 1 -- 172.21.15.102:0/221815454 wait complete. 2024-03-04T09:09:22.638 DEBUG:teuthology.orchestra.run.smithi102:osd.4> sudo journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@osd.4.service 2024-03-04T09:09:22.641 INFO:tasks.cephadm:Deploying osd.5 on smithi190 with /dev/vg_nvme/lv_3... 2024-03-04T09:09:22.641 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-03-04T09:09:22.886 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.c/config 2024-03-04T09:09:23.231 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:22 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:23.232 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:22 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:23.232 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:22 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:09:23.232 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:22 smithi190 ceph-mon[36341]: from='osd.4 [v2:172.21.15.102:6808/1229627753,v1:172.21.15.102:6809/1229627753]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-04T09:09:23.232 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:22 smithi190 ceph-mon[36341]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-04T09:09:23.232 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:22 smithi190 ceph-mon[36341]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-04T09:09:23.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:22 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:23.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:22 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:23.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:22 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:09:23.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:22 smithi082 ceph-mon[32880]: from='osd.4 [v2:172.21.15.102:6808/1229627753,v1:172.21.15.102:6809/1229627753]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-04T09:09:23.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:22 smithi082 ceph-mon[32880]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-04T09:09:23.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:22 smithi082 ceph-mon[32880]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-04T09:09:23.403 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:22 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:23.403 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:22 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:23.403 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:22 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:09:23.403 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:22 smithi102 ceph-mon[36220]: from='osd.4 [v2:172.21.15.102:6808/1229627753,v1:172.21.15.102:6809/1229627753]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-04T09:09:23.403 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:22 smithi102 ceph-mon[36220]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-04T09:09:23.403 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:22 smithi102 ceph-mon[36220]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-04T09:09:24.011 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:23 smithi102 ceph-mon[36220]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-04T09:09:24.012 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:23 smithi102 ceph-mon[36220]: osdmap e32: 5 total, 4 up, 5 in 2024-03-04T09:09:24.012 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:23 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-04T09:09:24.012 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:23 smithi102 ceph-mon[36220]: from='osd.4 [v2:172.21.15.102:6808/1229627753,v1:172.21.15.102:6809/1229627753]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-03-04T09:09:24.012 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:23 smithi102 ceph-mon[36220]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-03-04T09:09:24.013 INFO:journalctl@ceph.osd.4.smithi102.stdout:Mar 04 09:09:23 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-4[47584]: 2024-03-04T09:09:23.956+0000 7f61ce3bd700 -1 osd.4 0 waiting for initial osdmap 2024-03-04T09:09:24.013 INFO:journalctl@ceph.osd.4.smithi102.stdout:Mar 04 09:09:23 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-4[47584]: 2024-03-04T09:09:23.961+0000 7f61ca1b0700 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T09:09:24.259 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:23 smithi190 ceph-mon[36341]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-04T09:09:24.259 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:23 smithi190 ceph-mon[36341]: osdmap e32: 5 total, 4 up, 5 in 2024-03-04T09:09:24.259 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:23 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-04T09:09:24.260 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:23 smithi190 ceph-mon[36341]: from='osd.4 [v2:172.21.15.102:6808/1229627753,v1:172.21.15.102:6809/1229627753]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-03-04T09:09:24.260 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:23 smithi190 ceph-mon[36341]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-03-04T09:09:24.316 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:23 smithi082 ceph-mon[32880]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-04T09:09:24.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:23 smithi082 ceph-mon[32880]: osdmap e32: 5 total, 4 up, 5 in 2024-03-04T09:09:24.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:23 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-04T09:09:24.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:23 smithi082 ceph-mon[32880]: from='osd.4 [v2:172.21.15.102:6808/1229627753,v1:172.21.15.102:6809/1229627753]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-03-04T09:09:24.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:23 smithi082 ceph-mon[32880]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-03-04T09:09:24.838 INFO:teuthology.orchestra.run.smithi190.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-03-04T09:09:24.838 INFO:teuthology.orchestra.run.smithi190.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-03-04T09:09:24.838 INFO:teuthology.orchestra.run.smithi190.stderr: stderr: 10+0 records in 2024-03-04T09:09:24.838 INFO:teuthology.orchestra.run.smithi190.stderr:10+0 records out 2024-03-04T09:09:24.839 INFO:teuthology.orchestra.run.smithi190.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0123372 s, 850 MB/s 2024-03-04T09:09:24.839 INFO:teuthology.orchestra.run.smithi190.stderr:--> Zapping successful for: 2024-03-04T09:09:25.110 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:24 smithi102 ceph-mon[36220]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-03-04T09:09:25.111 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:24 smithi102 ceph-mon[36220]: osdmap e33: 5 total, 4 up, 5 in 2024-03-04T09:09:25.111 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:24 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-04T09:09:25.111 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:24 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-04T09:09:25.111 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:24 smithi102 ceph-mon[36220]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-04T09:09:25.316 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:24 smithi082 ceph-mon[32880]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-03-04T09:09:25.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:24 smithi082 ceph-mon[32880]: osdmap e33: 5 total, 4 up, 5 in 2024-03-04T09:09:25.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:24 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-04T09:09:25.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:24 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-04T09:09:25.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:24 smithi082 ceph-mon[32880]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-04T09:09:25.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:24 smithi190 ceph-mon[36341]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-03-04T09:09:25.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:24 smithi190 ceph-mon[36341]: osdmap e33: 5 total, 4 up, 5 in 2024-03-04T09:09:25.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:24 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-04T09:09:25.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:24 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-04T09:09:25.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:24 smithi190 ceph-mon[36341]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-04T09:09:25.480 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph orch daemon add osd smithi190:vg_nvme/lv_3 2024-03-04T09:09:25.716 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.c/config 2024-03-04T09:09:26.137 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:25 smithi190 ceph-mon[36341]: purged_snaps scrub starts 2024-03-04T09:09:26.137 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:25 smithi190 ceph-mon[36341]: purged_snaps scrub ok 2024-03-04T09:09:26.137 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:25 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-04T09:09:26.137 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:25 smithi190 ceph-mon[36341]: osd.4 [v2:172.21.15.102:6808/1229627753,v1:172.21.15.102:6809/1229627753] boot 2024-03-04T09:09:26.137 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:25 smithi190 ceph-mon[36341]: osdmap e34: 5 total, 5 up, 5 in 2024-03-04T09:09:26.137 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:25 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-04T09:09:26.137 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:25 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:26.137 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:25 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:26.137 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:25 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:09:26.138 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:25 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:09:26.138 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:25 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:26.138 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:25 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:09:26.138 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:25 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:09:26.138 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:25 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:26.316 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:25 smithi082 ceph-mon[32880]: purged_snaps scrub starts 2024-03-04T09:09:26.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:25 smithi082 ceph-mon[32880]: purged_snaps scrub ok 2024-03-04T09:09:26.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:25 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-04T09:09:26.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:25 smithi082 ceph-mon[32880]: osd.4 [v2:172.21.15.102:6808/1229627753,v1:172.21.15.102:6809/1229627753] boot 2024-03-04T09:09:26.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:25 smithi082 ceph-mon[32880]: osdmap e34: 5 total, 5 up, 5 in 2024-03-04T09:09:26.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:25 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-04T09:09:26.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:25 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:26.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:25 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:26.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:25 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:09:26.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:25 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:09:26.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:25 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:26.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:25 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:09:26.318 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:25 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:09:26.319 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:25 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:26.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:25 smithi102 ceph-mon[36220]: purged_snaps scrub starts 2024-03-04T09:09:26.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:25 smithi102 ceph-mon[36220]: purged_snaps scrub ok 2024-03-04T09:09:26.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:25 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-04T09:09:26.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:25 smithi102 ceph-mon[36220]: osd.4 [v2:172.21.15.102:6808/1229627753,v1:172.21.15.102:6809/1229627753] boot 2024-03-04T09:09:26.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:25 smithi102 ceph-mon[36220]: osdmap e34: 5 total, 5 up, 5 in 2024-03-04T09:09:26.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:25 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-04T09:09:26.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:25 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:26.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:25 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:26.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:25 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:09:26.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:25 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:09:26.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:25 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:26.430 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:25 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:09:26.430 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:25 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:09:26.430 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:25 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:27.085 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:26 smithi190 ceph-mon[36341]: Detected new or changed devices on smithi102 2024-03-04T09:09:27.085 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:26 smithi190 ceph-mon[36341]: Adjusting osd_memory_target on smithi102 to 8544M 2024-03-04T09:09:27.085 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:26 smithi190 ceph-mon[36341]: osdmap e35: 5 total, 5 up, 5 in 2024-03-04T09:09:27.086 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:26 smithi190 ceph-mon[36341]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-04T09:09:27.190 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:09:27.192+0000 7f4d4f265700 1 -- 172.21.15.190:0/20160446 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4d48102110 msgr2=0x7f4d48102530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:09:27.190 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:09:27.192+0000 7f4d4f265700 1 --2- 172.21.15.190:0/20160446 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4d48102110 0x7f4d48102530 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4d44009990 tx=0x7f4d44009ca0 comp rx=0 tx=0).stop 2024-03-04T09:09:27.190 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:09:27.192+0000 7f4d4f265700 1 -- 172.21.15.190:0/20160446 shutdown_connections 2024-03-04T09:09:27.190 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:09:27.192+0000 7f4d4f265700 1 --2- 172.21.15.190:0/20160446 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d48103cb0 0x7f4d4810a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:09:27.190 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:09:27.192+0000 7f4d4f265700 1 --2- 172.21.15.190:0/20160446 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4d48102110 0x7f4d48102530 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:09:27.191 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:09:27.192+0000 7f4d4f265700 1 --2- 172.21.15.190:0/20160446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d48103310 0x7f4d48103770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:09:27.191 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:09:27.192+0000 7f4d4f265700 1 -- 172.21.15.190:0/20160446 >> 172.21.15.190:0/20160446 conn(0x7f4d480fd6d0 msgr2=0x7f4d480ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:09:27.191 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:09:27.192+0000 7f4d4f265700 1 -- 172.21.15.190:0/20160446 shutdown_connections 2024-03-04T09:09:27.191 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:09:27.192+0000 7f4d4f265700 1 -- 172.21.15.190:0/20160446 wait complete. 2024-03-04T09:09:27.191 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:09:27.193+0000 7f4d4f265700 1 Processor -- start 2024-03-04T09:09:27.191 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:09:27.193+0000 7f4d4f265700 1 -- start start 2024-03-04T09:09:27.191 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:09:27.193+0000 7f4d4f265700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d48102110 0x7f4d48198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:09:27.191 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:09:27.193+0000 7f4d4f265700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4d48103310 0x7f4d48198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:09:27.191 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:09:27.193+0000 7f4d4f265700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d48103cb0 0x7f4d4819f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:09:27.191 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:09:27.193+0000 7f4d4f265700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4810dd40 con 0x7f4d48102110 2024-03-04T09:09:27.191 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:09:27.193+0000 7f4d4f265700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4810dbc0 con 0x7f4d48103cb0 2024-03-04T09:09:27.191 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:09:27.193+0000 7f4d4f265700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4810dec0 con 0x7f4d48103310 2024-03-04T09:09:27.191 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:09:27.193+0000 7f4d4c800700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4d48103310 0x7f4d48198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:09:27.191 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:09:27.193+0000 7f4d4c800700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4d48103310 0x7f4d48198860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:55598/0 (socket says 172.21.15.190:55598) 2024-03-04T09:09:27.192 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:09:27.193+0000 7f4d4c800700 1 -- 172.21.15.190:0/3210440105 learned_addr learned my addr 172.21.15.190:0/3210440105 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-03-04T09:09:27.192 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:09:27.193+0000 7f4d4d001700 1 --2- 172.21.15.190:0/3210440105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d48102110 0x7f4d48198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:09:27.192 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:09:27.193+0000 7f4d4c800700 1 -- 172.21.15.190:0/3210440105 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d48103cb0 msgr2=0x7f4d4819f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:09:27.192 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:09:27.193+0000 7f4d4c800700 1 --2- 172.21.15.190:0/3210440105 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d48103cb0 0x7f4d4819f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:09:27.192 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:09:27.193+0000 7f4d4c800700 1 -- 172.21.15.190:0/3210440105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d48102110 msgr2=0x7f4d48198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:09:27.192 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:09:27.193+0000 7f4d4c800700 1 --2- 172.21.15.190:0/3210440105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d48102110 0x7f4d48198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:09:27.192 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:09:27.193+0000 7f4d4c800700 1 -- 172.21.15.190:0/3210440105 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d4819ff80 con 0x7f4d48103310 2024-03-04T09:09:27.192 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:09:27.193+0000 7f4d4c800700 1 --2- 172.21.15.190:0/3210440105 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4d48103310 0x7f4d48198860 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4d3800e9d0 tx=0x7f4d3800ed90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:09:27.192 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:09:27.194+0000 7f4d3e7fc700 1 -- 172.21.15.190:0/3210440105 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3800cbd0 con 0x7f4d48103310 2024-03-04T09:09:27.192 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:09:27.194+0000 7f4d3e7fc700 1 -- 172.21.15.190:0/3210440105 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f4d3800cd70 con 0x7f4d48103310 2024-03-04T09:09:27.192 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:09:27.194+0000 7f4d4f265700 1 -- 172.21.15.190:0/3210440105 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d481a0270 con 0x7f4d48103310 2024-03-04T09:09:27.192 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:09:27.194+0000 7f4d3e7fc700 1 -- 172.21.15.190:0/3210440105 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d380187a0 con 0x7f4d48103310 2024-03-04T09:09:27.192 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:09:27.194+0000 7f4d4f265700 1 -- 172.21.15.190:0/3210440105 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d481a07b0 con 0x7f4d48103310 2024-03-04T09:09:27.193 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:09:27.195+0000 7f4d4f265700 1 -- 172.21.15.190:0/3210440105 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d48068d80 con 0x7f4d48103310 2024-03-04T09:09:27.193 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:09:27.196+0000 7f4d3e7fc700 1 -- 172.21.15.190:0/3210440105 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f4d38010430 con 0x7f4d48103310 2024-03-04T09:09:27.194 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:09:27.196+0000 7f4d3e7fc700 1 --2- 172.21.15.190:0/3210440105 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f4d340a1e10 0x7f4d340a42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:09:27.194 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:09:27.197+0000 7f4d3e7fc700 1 -- 172.21.15.190:0/3210440105 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4101+0+0 (secure 0 0 0) 0x7f4d380cd060 con 0x7f4d48103310 2024-03-04T09:09:27.194 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:09:27.197+0000 7f4d4d001700 1 --2- 172.21.15.190:0/3210440105 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f4d340a1e10 0x7f4d340a42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:09:27.194 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:09:27.197+0000 7f4d4d001700 1 --2- 172.21.15.190:0/3210440105 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f4d340a1e10 0x7f4d340a42d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4d4400b950 tx=0x7f4d4401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:09:27.197 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:09:27.201+0000 7f4d3e7fc700 1 -- 172.21.15.190:0/3210440105 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f4d3809b500 con 0x7f4d48103310 2024-03-04T09:09:27.218 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:26 smithi082 ceph-mon[32880]: Detected new or changed devices on smithi102 2024-03-04T09:09:27.218 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:26 smithi082 ceph-mon[32880]: Adjusting osd_memory_target on smithi102 to 8544M 2024-03-04T09:09:27.218 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:26 smithi082 ceph-mon[32880]: osdmap e35: 5 total, 5 up, 5 in 2024-03-04T09:09:27.218 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:26 smithi082 ceph-mon[32880]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-04T09:09:27.398 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:09:27.402+0000 7f4d4f265700 1 -- 172.21.15.190:0/3210440105 --> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f4d48062500 con 0x7f4d340a1e10 2024-03-04T09:09:27.428 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:26 smithi102 ceph-mon[36220]: Detected new or changed devices on smithi102 2024-03-04T09:09:27.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:26 smithi102 ceph-mon[36220]: Adjusting osd_memory_target on smithi102 to 8544M 2024-03-04T09:09:27.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:26 smithi102 ceph-mon[36220]: osdmap e35: 5 total, 5 up, 5 in 2024-03-04T09:09:27.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:26 smithi102 ceph-mon[36220]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-04T09:09:28.234 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:27 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T09:09:28.234 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:27 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T09:09:28.234 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:27 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:09:28.316 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:27 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T09:09:28.316 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:27 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T09:09:28.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:27 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:09:28.428 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:27 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T09:09:28.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:27 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T09:09:28.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:27 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:09:29.057 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:28 smithi190 ceph-mon[36341]: from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:09:29.057 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:28 smithi190 ceph-mon[36341]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-04T09:09:29.316 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:28 smithi082 ceph-mon[32880]: from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:09:29.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:28 smithi082 ceph-mon[32880]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-04T09:09:29.428 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:28 smithi102 ceph-mon[36220]: from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:09:29.428 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:28 smithi102 ceph-mon[36220]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-04T09:09:30.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:30 smithi082 ceph-mon[32880]: from='client.? 172.21.15.190:0/531903226' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b50127b-df2b-4c95-8e53-9d42b40273fa"}]: dispatch 2024-03-04T09:09:30.589 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:30 smithi082 ceph-mon[32880]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b50127b-df2b-4c95-8e53-9d42b40273fa"}]: dispatch 2024-03-04T09:09:30.589 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:30 smithi082 ceph-mon[32880]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6b50127b-df2b-4c95-8e53-9d42b40273fa"}]': finished 2024-03-04T09:09:30.589 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:30 smithi082 ceph-mon[32880]: osdmap e36: 6 total, 5 up, 6 in 2024-03-04T09:09:30.589 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:30 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-04T09:09:30.590 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:30 smithi190 ceph-mon[36341]: from='client.? 172.21.15.190:0/531903226' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b50127b-df2b-4c95-8e53-9d42b40273fa"}]: dispatch 2024-03-04T09:09:30.590 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:30 smithi190 ceph-mon[36341]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b50127b-df2b-4c95-8e53-9d42b40273fa"}]: dispatch 2024-03-04T09:09:30.590 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:30 smithi190 ceph-mon[36341]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6b50127b-df2b-4c95-8e53-9d42b40273fa"}]': finished 2024-03-04T09:09:30.590 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:30 smithi190 ceph-mon[36341]: osdmap e36: 6 total, 5 up, 6 in 2024-03-04T09:09:30.590 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:30 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-04T09:09:30.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:30 smithi102 ceph-mon[36220]: from='client.? 172.21.15.190:0/531903226' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b50127b-df2b-4c95-8e53-9d42b40273fa"}]: dispatch 2024-03-04T09:09:30.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:30 smithi102 ceph-mon[36220]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b50127b-df2b-4c95-8e53-9d42b40273fa"}]: dispatch 2024-03-04T09:09:30.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:30 smithi102 ceph-mon[36220]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6b50127b-df2b-4c95-8e53-9d42b40273fa"}]': finished 2024-03-04T09:09:30.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:30 smithi102 ceph-mon[36220]: osdmap e36: 6 total, 5 up, 6 in 2024-03-04T09:09:30.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:30 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-04T09:09:31.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:31 smithi082 ceph-mon[32880]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-04T09:09:31.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:31 smithi082 ceph-mon[32880]: from='client.? 172.21.15.190:0/645555085' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T09:09:31.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:31 smithi190 ceph-mon[36341]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-04T09:09:31.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:31 smithi190 ceph-mon[36341]: from='client.? 172.21.15.190:0/645555085' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T09:09:31.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:31 smithi102 ceph-mon[36220]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-04T09:09:31.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:31 smithi102 ceph-mon[36220]: from='client.? 172.21.15.190:0/645555085' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T09:09:33.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:33 smithi082 ceph-mon[32880]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-04T09:09:33.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:33 smithi190 ceph-mon[36341]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-04T09:09:33.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:33 smithi102 ceph-mon[36220]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-04T09:09:35.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:35 smithi190 ceph-mon[36341]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-04T09:09:35.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:35 smithi082 ceph-mon[32880]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-04T09:09:35.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:35 smithi102 ceph-mon[36220]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-04T09:09:37.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:37 smithi190 ceph-mon[36341]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-04T09:09:37.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:37 smithi082 ceph-mon[32880]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-04T09:09:37.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:37 smithi102 ceph-mon[36220]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-04T09:09:38.334 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:38 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-04T09:09:38.335 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:38 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:09:38.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:38 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-04T09:09:38.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:38 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:09:38.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:38 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-04T09:09:38.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:38 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:09:39.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:39 smithi082 ceph-mon[32880]: Deploying daemon osd.5 on smithi190 2024-03-04T09:09:39.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:39 smithi082 ceph-mon[32880]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-04T09:09:39.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:39 smithi190 ceph-mon[36341]: Deploying daemon osd.5 on smithi190 2024-03-04T09:09:39.624 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:39 smithi190 ceph-mon[36341]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-04T09:09:39.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:39 smithi102 ceph-mon[36220]: Deploying daemon osd.5 on smithi190 2024-03-04T09:09:39.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:39 smithi102 ceph-mon[36220]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-04T09:09:41.562 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:41 smithi190 ceph-mon[36341]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-04T09:09:41.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:41 smithi082 ceph-mon[32880]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-04T09:09:41.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:41 smithi102 ceph-mon[36220]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-04T09:09:43.423 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:43 smithi190 ceph-mon[36341]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-04T09:09:43.423 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:43 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:43.423 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:43 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:43.423 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:43 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:09:43.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:43 smithi082 ceph-mon[32880]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-04T09:09:43.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:43 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:43.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:43 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:43.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:43 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:09:43.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:43 smithi102 ceph-mon[36220]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-04T09:09:43.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:43 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:43.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:43 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:43.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:43 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:09:45.303 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:45 smithi190 ceph-mon[36341]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-04T09:09:45.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:45 smithi082 ceph-mon[32880]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-04T09:09:45.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:45 smithi102 ceph-mon[36220]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-04T09:09:46.315 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:09:46.318+0000 7f4d3e7fc700 1 -- 172.21.15.190:0/3210440105 <== mgr.14152 v2:172.21.15.82:6800/1278635224 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f4d48062500 con 0x7f4d340a1e10 2024-03-04T09:09:46.315 INFO:teuthology.orchestra.run.smithi190.stdout:Created osd(s) 5 on host 'smithi190' 2024-03-04T09:09:46.317 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:09:46.320+0000 7f4d4f265700 1 -- 172.21.15.190:0/3210440105 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f4d340a1e10 msgr2=0x7f4d340a42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:09:46.317 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:09:46.320+0000 7f4d4f265700 1 --2- 172.21.15.190:0/3210440105 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f4d340a1e10 0x7f4d340a42d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4d4400b950 tx=0x7f4d4401a040 comp rx=0 tx=0).stop 2024-03-04T09:09:46.318 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:09:46.320+0000 7f4d4f265700 1 -- 172.21.15.190:0/3210440105 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4d48103310 msgr2=0x7f4d48198860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:09:46.318 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:09:46.320+0000 7f4d4f265700 1 --2- 172.21.15.190:0/3210440105 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4d48103310 0x7f4d48198860 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4d3800e9d0 tx=0x7f4d3800ed90 comp rx=0 tx=0).stop 2024-03-04T09:09:46.318 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:09:46.320+0000 7f4d4f265700 1 -- 172.21.15.190:0/3210440105 shutdown_connections 2024-03-04T09:09:46.318 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:09:46.320+0000 7f4d4f265700 1 --2- 172.21.15.190:0/3210440105 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f4d340a1e10 0x7f4d340a42d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:09:46.318 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:09:46.320+0000 7f4d4f265700 1 --2- 172.21.15.190:0/3210440105 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d48103cb0 0x7f4d4819f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:09:46.318 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:09:46.320+0000 7f4d4f265700 1 --2- 172.21.15.190:0/3210440105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d48102110 0x7f4d48198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:09:46.318 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:09:46.320+0000 7f4d4f265700 1 --2- 172.21.15.190:0/3210440105 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4d48103310 0x7f4d48198860 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:09:46.318 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:09:46.321+0000 7f4d4f265700 1 -- 172.21.15.190:0/3210440105 >> 172.21.15.190:0/3210440105 conn(0x7f4d480fd6d0 msgr2=0x7f4d48106610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:09:46.319 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:09:46.321+0000 7f4d4f265700 1 -- 172.21.15.190:0/3210440105 shutdown_connections 2024-03-04T09:09:46.319 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:09:46.321+0000 7f4d4f265700 1 -- 172.21.15.190:0/3210440105 wait complete. 2024-03-04T09:09:46.627 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:46 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:46.627 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:46 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:46.627 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:46 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:09:46.627 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:46 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:09:46.627 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:46 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:46.627 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:46 smithi190 ceph-mon[36341]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-04T09:09:46.627 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:46 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:46.627 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:46 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:46.627 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:46 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:09:46.820 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:46 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:46.820 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:46 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:46.820 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:46 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:09:46.820 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:46 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:09:46.820 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:46 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:46.820 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:46 smithi082 ceph-mon[32880]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-04T09:09:46.820 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:46 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:46.820 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:46 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:46.821 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:46 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:09:46.920 DEBUG:teuthology.orchestra.run.smithi190:osd.5> sudo journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@osd.5.service 2024-03-04T09:09:46.923 INFO:tasks.cephadm:Deploying osd.6 on smithi082 with /dev/vg_nvme/lv_2... 2024-03-04T09:09:46.923 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-03-04T09:09:46.928 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:46 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:46.928 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:46 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:46.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:46 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:09:46.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:46 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:09:46.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:46 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:46.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:46 smithi102 ceph-mon[36220]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-04T09:09:46.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:46 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:46.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:46 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:46.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:46 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:09:47.171 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:09:47.557 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:47 smithi082 ceph-mon[32880]: from='osd.5 [v2:172.21.15.190:6808/2171194148,v1:172.21.15.190:6809/2171194148]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-04T09:09:47.558 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:47 smithi082 ceph-mon[32880]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-04T09:09:47.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:47 smithi190 ceph-mon[36341]: from='osd.5 [v2:172.21.15.190:6808/2171194148,v1:172.21.15.190:6809/2171194148]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-04T09:09:47.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:47 smithi190 ceph-mon[36341]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-04T09:09:47.928 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:47 smithi102 ceph-mon[36220]: from='osd.5 [v2:172.21.15.190:6808/2171194148,v1:172.21.15.190:6809/2171194148]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-04T09:09:47.928 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:47 smithi102 ceph-mon[36220]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-04T09:09:48.626 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:48 smithi082 ceph-mon[32880]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-04T09:09:48.626 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:48 smithi082 ceph-mon[32880]: osdmap e37: 6 total, 5 up, 6 in 2024-03-04T09:09:48.627 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:48 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-04T09:09:48.627 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:48 smithi082 ceph-mon[32880]: from='osd.5 [v2:172.21.15.190:6808/2171194148,v1:172.21.15.190:6809/2171194148]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2024-03-04T09:09:48.627 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:48 smithi082 ceph-mon[32880]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2024-03-04T09:09:48.627 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:48 smithi082 ceph-mon[32880]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-04T09:09:48.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:48 smithi190 ceph-mon[36341]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-04T09:09:48.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:48 smithi190 ceph-mon[36341]: osdmap e37: 6 total, 5 up, 6 in 2024-03-04T09:09:48.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:48 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-04T09:09:48.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:48 smithi190 ceph-mon[36341]: from='osd.5 [v2:172.21.15.190:6808/2171194148,v1:172.21.15.190:6809/2171194148]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2024-03-04T09:09:48.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:48 smithi190 ceph-mon[36341]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2024-03-04T09:09:48.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:48 smithi190 ceph-mon[36341]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-04T09:09:48.921 INFO:journalctl@ceph.osd.5.smithi190.stdout:Mar 04 09:09:48 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-5[48439]: 2024-03-04T09:09:48.563+0000 7f264ae19700 -1 osd.5 0 waiting for initial osdmap 2024-03-04T09:09:48.921 INFO:journalctl@ceph.osd.5.smithi190.stdout:Mar 04 09:09:48 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-5[48439]: 2024-03-04T09:09:48.569+0000 7f2646c0c700 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T09:09:48.928 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:48 smithi102 ceph-mon[36220]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-04T09:09:48.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:48 smithi102 ceph-mon[36220]: osdmap e37: 6 total, 5 up, 6 in 2024-03-04T09:09:48.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:48 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-04T09:09:48.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:48 smithi102 ceph-mon[36220]: from='osd.5 [v2:172.21.15.190:6808/2171194148,v1:172.21.15.190:6809/2171194148]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2024-03-04T09:09:48.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:48 smithi102 ceph-mon[36220]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2024-03-04T09:09:48.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:48 smithi102 ceph-mon[36220]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-04T09:09:49.196 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-03-04T09:09:49.196 INFO:teuthology.orchestra.run.smithi082.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-03-04T09:09:49.196 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10+0 records in 2024-03-04T09:09:49.196 INFO:teuthology.orchestra.run.smithi082.stderr:10+0 records out 2024-03-04T09:09:49.197 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0120429 s, 871 MB/s 2024-03-04T09:09:49.197 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping successful for: 2024-03-04T09:09:49.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:49 smithi082 ceph-mon[32880]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2024-03-04T09:09:49.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:49 smithi082 ceph-mon[32880]: osdmap e38: 6 total, 5 up, 6 in 2024-03-04T09:09:49.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:49 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-04T09:09:49.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:49 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-04T09:09:49.817 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:49 smithi190 ceph-mon[36341]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2024-03-04T09:09:49.817 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:49 smithi190 ceph-mon[36341]: osdmap e38: 6 total, 5 up, 6 in 2024-03-04T09:09:49.817 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:49 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-04T09:09:49.818 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:49 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-04T09:09:49.928 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:49 smithi102 ceph-mon[36220]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2024-03-04T09:09:49.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:49 smithi102 ceph-mon[36220]: osdmap e38: 6 total, 5 up, 6 in 2024-03-04T09:09:49.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:49 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-04T09:09:49.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:49 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-04T09:09:49.947 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph orch daemon add osd smithi082:vg_nvme/lv_2 2024-03-04T09:09:50.193 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:09:50.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:50 smithi082 ceph-mon[32880]: purged_snaps scrub starts 2024-03-04T09:09:50.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:50 smithi082 ceph-mon[32880]: purged_snaps scrub ok 2024-03-04T09:09:50.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:50 smithi082 ceph-mon[32880]: osd.5 [v2:172.21.15.190:6808/2171194148,v1:172.21.15.190:6809/2171194148] boot 2024-03-04T09:09:50.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:50 smithi082 ceph-mon[32880]: osdmap e39: 6 total, 6 up, 6 in 2024-03-04T09:09:50.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:50 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-04T09:09:50.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:50 smithi082 ceph-mon[32880]: Detected new or changed devices on smithi190 2024-03-04T09:09:50.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:50 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:50.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:50 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:50.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:50 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:09:50.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:50 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:09:50.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:50 smithi082 ceph-mon[32880]: Adjusting osd_memory_target on smithi190 to 8544M 2024-03-04T09:09:50.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:50 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:50.568 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:50 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:09:50.568 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:50 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:09:50.568 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:50 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:50.568 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:50 smithi082 ceph-mon[32880]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-03-04T09:09:50.568 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:50 smithi082 ceph-mon[32880]: osdmap e40: 6 total, 6 up, 6 in 2024-03-04T09:09:50.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:50 smithi190 ceph-mon[36341]: purged_snaps scrub starts 2024-03-04T09:09:50.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:50 smithi190 ceph-mon[36341]: purged_snaps scrub ok 2024-03-04T09:09:50.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:50 smithi190 ceph-mon[36341]: osd.5 [v2:172.21.15.190:6808/2171194148,v1:172.21.15.190:6809/2171194148] boot 2024-03-04T09:09:50.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:50 smithi190 ceph-mon[36341]: osdmap e39: 6 total, 6 up, 6 in 2024-03-04T09:09:50.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:50 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-04T09:09:50.923 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:50 smithi190 ceph-mon[36341]: Detected new or changed devices on smithi190 2024-03-04T09:09:50.923 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:50 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:50.923 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:50 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:50.923 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:50 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:09:50.923 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:50 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:09:50.923 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:50 smithi190 ceph-mon[36341]: Adjusting osd_memory_target on smithi190 to 8544M 2024-03-04T09:09:50.923 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:50 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:50.923 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:50 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:09:50.924 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:50 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:09:50.924 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:50 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:50.924 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:50 smithi190 ceph-mon[36341]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-03-04T09:09:50.924 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:50 smithi190 ceph-mon[36341]: osdmap e40: 6 total, 6 up, 6 in 2024-03-04T09:09:50.928 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:50 smithi102 ceph-mon[36220]: purged_snaps scrub starts 2024-03-04T09:09:50.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:50 smithi102 ceph-mon[36220]: purged_snaps scrub ok 2024-03-04T09:09:50.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:50 smithi102 ceph-mon[36220]: osd.5 [v2:172.21.15.190:6808/2171194148,v1:172.21.15.190:6809/2171194148] boot 2024-03-04T09:09:50.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:50 smithi102 ceph-mon[36220]: osdmap e39: 6 total, 6 up, 6 in 2024-03-04T09:09:50.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:50 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-04T09:09:50.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:50 smithi102 ceph-mon[36220]: Detected new or changed devices on smithi190 2024-03-04T09:09:50.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:50 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:50.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:50 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:50.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:50 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:09:50.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:50 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:09:50.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:50 smithi102 ceph-mon[36220]: Adjusting osd_memory_target on smithi190 to 8544M 2024-03-04T09:09:50.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:50 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:50.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:50 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:09:50.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:50 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:09:50.930 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:50 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:09:50.930 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:50 smithi102 ceph-mon[36220]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-03-04T09:09:50.930 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:50 smithi102 ceph-mon[36220]: osdmap e40: 6 total, 6 up, 6 in 2024-03-04T09:09:51.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:09:51.910+0000 7fb857988700 1 -- 172.21.15.82:0/3788993475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb850100ff0 msgr2=0x7fb850101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:09:51.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:09:51.910+0000 7fb857988700 1 --2- 172.21.15.82:0/3788993475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb850100ff0 0x7fb850101410 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb84c0099c0 tx=0x7fb84c009cd0 comp rx=0 tx=0).stop 2024-03-04T09:09:51.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:09:51.910+0000 7fb857988700 1 -- 172.21.15.82:0/3788993475 shutdown_connections 2024-03-04T09:09:51.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:09:51.910+0000 7fb857988700 1 --2- 172.21.15.82:0/3788993475 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb850102b90 0x7fb850109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:09:51.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:09:51.910+0000 7fb857988700 1 --2- 172.21.15.82:0/3788993475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb850100ff0 0x7fb850101410 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:09:51.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:09:51.910+0000 7fb857988700 1 --2- 172.21.15.82:0/3788993475 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8501021f0 0x7fb850102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:09:51.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:09:51.910+0000 7fb857988700 1 -- 172.21.15.82:0/3788993475 >> 172.21.15.82:0/3788993475 conn(0x7fb8500fc5b0 msgr2=0x7fb8500fe9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:09:51.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:09:51.910+0000 7fb857988700 1 -- 172.21.15.82:0/3788993475 shutdown_connections 2024-03-04T09:09:51.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:09:51.910+0000 7fb857988700 1 -- 172.21.15.82:0/3788993475 wait complete. 2024-03-04T09:09:51.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:09:51.911+0000 7fb857988700 1 Processor -- start 2024-03-04T09:09:51.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:09:51.911+0000 7fb857988700 1 -- start start 2024-03-04T09:09:51.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:09:51.911+0000 7fb857988700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb850100ff0 0x7fb85006b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:09:51.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:09:51.911+0000 7fb857988700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8501021f0 0x7fb85019d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:09:51.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:09:51.911+0000 7fb857988700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb850102b90 0x7fb85019f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:09:51.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:09:51.911+0000 7fb857988700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85010cb90 con 0x7fb850100ff0 2024-03-04T09:09:51.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:09:51.911+0000 7fb857988700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85010ca10 con 0x7fb8501021f0 2024-03-04T09:09:51.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:09:51.911+0000 7fb857988700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85010cd10 con 0x7fb850102b90 2024-03-04T09:09:51.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:09:51.911+0000 7fb855724700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb850100ff0 0x7fb85006b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:09:51.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:09:51.911+0000 7fb855724700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb850100ff0 0x7fb85006b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52260/0 (socket says 172.21.15.82:52260) 2024-03-04T09:09:51.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:09:51.911+0000 7fb855724700 1 -- 172.21.15.82:0/441173920 learned_addr learned my addr 172.21.15.82:0/441173920 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:09:51.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:09:51.911+0000 7fb854f23700 1 --2- 172.21.15.82:0/441173920 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8501021f0 0x7fb85019d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:09:51.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:09:51.911+0000 7fb855f25700 1 --2- 172.21.15.82:0/441173920 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb850102b90 0x7fb85019f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:09:51.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:09:51.911+0000 7fb855724700 1 -- 172.21.15.82:0/441173920 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb850102b90 msgr2=0x7fb85019f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:09:51.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:09:51.911+0000 7fb855724700 1 --2- 172.21.15.82:0/441173920 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb850102b90 0x7fb85019f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:09:51.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:09:51.911+0000 7fb855724700 1 -- 172.21.15.82:0/441173920 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8501021f0 msgr2=0x7fb85019d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:09:51.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:09:51.911+0000 7fb855724700 1 --2- 172.21.15.82:0/441173920 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8501021f0 0x7fb85019d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:09:51.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:09:51.911+0000 7fb855724700 1 -- 172.21.15.82:0/441173920 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb85019ff40 con 0x7fb850100ff0 2024-03-04T09:09:51.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:09:51.911+0000 7fb855f25700 1 --2- 172.21.15.82:0/441173920 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb850102b90 0x7fb85019f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T09:09:51.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:09:51.911+0000 7fb855724700 1 --2- 172.21.15.82:0/441173920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb850100ff0 0x7fb85006b380 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb84c005840 tx=0x7fb84c009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:09:51.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:09:51.912+0000 7fb8467fc700 1 -- 172.21.15.82:0/441173920 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84c027070 con 0x7fb850100ff0 2024-03-04T09:09:51.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:09:51.912+0000 7fb857988700 1 -- 172.21.15.82:0/441173920 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8501a01d0 con 0x7fb850100ff0 2024-03-04T09:09:51.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:09:51.912+0000 7fb8467fc700 1 -- 172.21.15.82:0/441173920 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fb84c0041b0 con 0x7fb850100ff0 2024-03-04T09:09:51.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:09:51.912+0000 7fb8467fc700 1 -- 172.21.15.82:0/441173920 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84c022d60 con 0x7fb850100ff0 2024-03-04T09:09:51.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:09:51.912+0000 7fb857988700 1 -- 172.21.15.82:0/441173920 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8501a06b0 con 0x7fb850100ff0 2024-03-04T09:09:51.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:09:51.913+0000 7fb857988700 1 -- 172.21.15.82:0/441173920 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb850068d80 con 0x7fb850100ff0 2024-03-04T09:09:51.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:09:51.914+0000 7fb8467fc700 1 -- 172.21.15.82:0/441173920 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7fb84c02a070 con 0x7fb850100ff0 2024-03-04T09:09:51.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:09:51.914+0000 7fb8467fc700 1 --2- 172.21.15.82:0/441173920 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb83c0a1e10 0x7fb83c0a42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:09:51.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:09:51.914+0000 7fb854f23700 1 --2- 172.21.15.82:0/441173920 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb83c0a1e10 0x7fb83c0a42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:09:51.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:09:51.914+0000 7fb8467fc700 1 -- 172.21.15.82:0/441173920 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4562+0+0 (secure 0 0 0) 0x7fb84c0cdc20 con 0x7fb850100ff0 2024-03-04T09:09:51.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:09:51.915+0000 7fb854f23700 1 --2- 172.21.15.82:0/441173920 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb83c0a1e10 0x7fb83c0a42d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb85006b8e0 tx=0x7fb8400073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:09:51.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:09:51.919+0000 7fb8467fc700 1 -- 172.21.15.82:0/441173920 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fb84c013070 con 0x7fb850100ff0 2024-03-04T09:09:52.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:09:52.126+0000 7fb857988700 1 -- 172.21.15.82:0/441173920 --> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fb850062500 con 0x7fb83c0a1e10 2024-03-04T09:09:52.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:52 smithi082 ceph-mon[32880]: osdmap e41: 6 total, 6 up, 6 in 2024-03-04T09:09:52.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:52 smithi082 ceph-mon[32880]: from='client.14361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:09:52.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:52 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T09:09:52.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:52 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T09:09:52.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:52 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:09:52.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:52 smithi082 ceph-mon[32880]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-03-04T09:09:52.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:52 smithi190 ceph-mon[36341]: osdmap e41: 6 total, 6 up, 6 in 2024-03-04T09:09:52.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:52 smithi190 ceph-mon[36341]: from='client.14361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:09:52.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:52 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T09:09:52.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:52 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T09:09:52.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:52 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:09:52.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:52 smithi190 ceph-mon[36341]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-03-04T09:09:52.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:52 smithi102 ceph-mon[36220]: osdmap e41: 6 total, 6 up, 6 in 2024-03-04T09:09:52.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:52 smithi102 ceph-mon[36220]: from='client.14361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:09:52.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:52 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T09:09:52.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:52 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T09:09:52.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:52 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:09:52.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:52 smithi102 ceph-mon[36220]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-03-04T09:09:53.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:53 smithi082 ceph-mon[32880]: osdmap e42: 6 total, 6 up, 6 in 2024-03-04T09:09:53.821 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:53 smithi190 ceph-mon[36341]: osdmap e42: 6 total, 6 up, 6 in 2024-03-04T09:09:53.830 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:53 smithi102 ceph-mon[36220]: osdmap e42: 6 total, 6 up, 6 in 2024-03-04T09:09:54.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:54 smithi190 ceph-mon[36341]: osdmap e43: 6 total, 6 up, 6 in 2024-03-04T09:09:54.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:54 smithi190 ceph-mon[36341]: pgmap v144: 1 pgs: 1 peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-03-04T09:09:54.928 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:54 smithi102 ceph-mon[36220]: osdmap e43: 6 total, 6 up, 6 in 2024-03-04T09:09:54.928 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:54 smithi102 ceph-mon[36220]: pgmap v144: 1 pgs: 1 peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-03-04T09:09:55.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:54 smithi082 ceph-mon[32880]: osdmap e43: 6 total, 6 up, 6 in 2024-03-04T09:09:55.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:54 smithi082 ceph-mon[32880]: pgmap v144: 1 pgs: 1 peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-03-04T09:09:55.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:55 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/3242694397' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e72bebb0-5939-4210-950a-41c25c23c62f"}]: dispatch 2024-03-04T09:09:55.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:55 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/3242694397' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e72bebb0-5939-4210-950a-41c25c23c62f"}]': finished 2024-03-04T09:09:55.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:55 smithi190 ceph-mon[36341]: osdmap e44: 7 total, 6 up, 7 in 2024-03-04T09:09:55.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:55 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-04T09:09:55.928 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:55 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/3242694397' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e72bebb0-5939-4210-950a-41c25c23c62f"}]: dispatch 2024-03-04T09:09:55.928 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:55 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/3242694397' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e72bebb0-5939-4210-950a-41c25c23c62f"}]': finished 2024-03-04T09:09:55.928 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:55 smithi102 ceph-mon[36220]: osdmap e44: 7 total, 6 up, 7 in 2024-03-04T09:09:55.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:55 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-04T09:09:56.066 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:55 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/3242694397' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e72bebb0-5939-4210-950a-41c25c23c62f"}]: dispatch 2024-03-04T09:09:56.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:55 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/3242694397' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e72bebb0-5939-4210-950a-41c25c23c62f"}]': finished 2024-03-04T09:09:56.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:55 smithi082 ceph-mon[32880]: osdmap e44: 7 total, 6 up, 7 in 2024-03-04T09:09:56.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:55 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-04T09:09:56.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:56 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/92956633' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T09:09:56.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:56 smithi190 ceph-mon[36341]: pgmap v146: 1 pgs: 1 peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 124 KiB/s, 0 objects/s recovering 2024-03-04T09:09:56.928 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:56 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/92956633' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T09:09:56.928 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:56 smithi102 ceph-mon[36220]: pgmap v146: 1 pgs: 1 peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 124 KiB/s, 0 objects/s recovering 2024-03-04T09:09:57.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:56 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/92956633' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T09:09:57.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:56 smithi082 ceph-mon[32880]: pgmap v146: 1 pgs: 1 peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 124 KiB/s, 0 objects/s recovering 2024-03-04T09:09:59.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:09:59 smithi082 ceph-mon[32880]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-04T09:09:59.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:09:59 smithi190 ceph-mon[36341]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-04T09:09:59.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:09:59 smithi102 ceph-mon[36220]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-04T09:10:00.288 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:00 smithi082 ceph-mon[32880]: overall HEALTH_OK 2024-03-04T09:10:00.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:00 smithi190 ceph-mon[36341]: overall HEALTH_OK 2024-03-04T09:10:00.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:00 smithi102 ceph-mon[36220]: overall HEALTH_OK 2024-03-04T09:10:01.487 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:01 smithi082 ceph-mon[32880]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-03-04T09:10:01.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:01 smithi190 ceph-mon[36341]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-03-04T09:10:01.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:01 smithi102 ceph-mon[36220]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-03-04T09:10:03.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:03 smithi082 ceph-mon[32880]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-03-04T09:10:03.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:03 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-04T09:10:03.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:03 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:10:03.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:03 smithi190 ceph-mon[36341]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-03-04T09:10:03.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:03 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-04T09:10:03.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:03 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:10:03.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:03 smithi102 ceph-mon[36220]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-03-04T09:10:03.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:03 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-04T09:10:03.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:03 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:10:04.493 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:04 smithi082 ceph-mon[32880]: Deploying daemon osd.6 on smithi082 2024-03-04T09:10:04.529 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:04 smithi102 ceph-mon[36220]: Deploying daemon osd.6 on smithi082 2024-03-04T09:10:04.529 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:04 smithi190 ceph-mon[36341]: Deploying daemon osd.6 on smithi082 2024-03-04T09:10:05.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:05 smithi190 ceph-mon[36341]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-03-04T09:10:05.428 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:05 smithi102 ceph-mon[36220]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-03-04T09:10:05.495 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:05 smithi082 ceph-mon[32880]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-03-04T09:10:07.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:07 smithi082 ceph-mon[32880]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-03-04T09:10:07.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:07 smithi190 ceph-mon[36341]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-03-04T09:10:07.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:07 smithi102 ceph-mon[36220]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-03-04T09:10:09.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:09 smithi082 ceph-mon[32880]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-03-04T09:10:09.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:09 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:09.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:09 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:09.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:09 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:10:09.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:09 smithi190 ceph-mon[36341]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-03-04T09:10:09.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:09 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:09.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:09 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:09.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:09 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:10:09.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:09 smithi102 ceph-mon[36220]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-03-04T09:10:09.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:09 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:09.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:09 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:09.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:09 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:10:11.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:11 smithi082 ceph-mon[32880]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-03-04T09:10:11.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:11 smithi190 ceph-mon[36341]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-03-04T09:10:11.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:11 smithi102 ceph-mon[36220]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-03-04T09:10:12.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:10:12.038+0000 7fb8467fc700 1 -- 172.21.15.82:0/441173920 <== mgr.14152 v2:172.21.15.82:6800/1278635224 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb850062500 con 0x7fb83c0a1e10 2024-03-04T09:10:12.034 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 6 on host 'smithi082' 2024-03-04T09:10:12.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:10:12.040+0000 7fb857988700 1 -- 172.21.15.82:0/441173920 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb83c0a1e10 msgr2=0x7fb83c0a42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:10:12.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:10:12.040+0000 7fb857988700 1 --2- 172.21.15.82:0/441173920 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb83c0a1e10 0x7fb83c0a42d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb85006b8e0 tx=0x7fb8400073d0 comp rx=0 tx=0).stop 2024-03-04T09:10:12.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:10:12.040+0000 7fb857988700 1 -- 172.21.15.82:0/441173920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb850100ff0 msgr2=0x7fb85006b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:10:12.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:10:12.040+0000 7fb857988700 1 --2- 172.21.15.82:0/441173920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb850100ff0 0x7fb85006b380 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb84c005840 tx=0x7fb84c009510 comp rx=0 tx=0).stop 2024-03-04T09:10:12.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:10:12.040+0000 7fb857988700 1 -- 172.21.15.82:0/441173920 shutdown_connections 2024-03-04T09:10:12.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:10:12.040+0000 7fb857988700 1 --2- 172.21.15.82:0/441173920 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb83c0a1e10 0x7fb83c0a42d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:10:12.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:10:12.040+0000 7fb857988700 1 --2- 172.21.15.82:0/441173920 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb850102b90 0x7fb85019f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:10:12.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:10:12.040+0000 7fb857988700 1 --2- 172.21.15.82:0/441173920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb850100ff0 0x7fb85006b380 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:10:12.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:10:12.040+0000 7fb857988700 1 --2- 172.21.15.82:0/441173920 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8501021f0 0x7fb85019d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:10:12.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:10:12.040+0000 7fb857988700 1 -- 172.21.15.82:0/441173920 >> 172.21.15.82:0/441173920 conn(0x7fb8500fc5b0 msgr2=0x7fb850105570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:10:12.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:10:12.040+0000 7fb857988700 1 -- 172.21.15.82:0/441173920 shutdown_connections 2024-03-04T09:10:12.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:10:12.040+0000 7fb857988700 1 -- 172.21.15.82:0/441173920 wait complete. 2024-03-04T09:10:12.760 DEBUG:teuthology.orchestra.run.smithi082:osd.6> sudo journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@osd.6.service 2024-03-04T09:10:12.762 INFO:tasks.cephadm:Deploying osd.7 on smithi102 with /dev/vg_nvme/lv_2... 2024-03-04T09:10:12.763 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-03-04T09:10:13.006 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.b/config 2024-03-04T09:10:13.128 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:13 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:13.128 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:13 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:13.128 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:13 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:13.128 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:13 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:13.128 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:13 smithi102 ceph-mon[36220]: from='osd.6 [v2:172.21.15.82:6818/454436959,v1:172.21.15.82:6819/454436959]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-04T09:10:13.128 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:13 smithi102 ceph-mon[36220]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-03-04T09:10:13.266 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:13 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:13.266 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:13 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:13.266 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:13 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:13.266 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:13 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:13.266 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:13 smithi082 ceph-mon[32880]: from='osd.6 [v2:172.21.15.82:6818/454436959,v1:172.21.15.82:6819/454436959]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-04T09:10:13.266 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:13 smithi082 ceph-mon[32880]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-03-04T09:10:13.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:13 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:13.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:13 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:13.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:13 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:13.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:13 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:13.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:13 smithi190 ceph-mon[36341]: from='osd.6 [v2:172.21.15.82:6818/454436959,v1:172.21.15.82:6819/454436959]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-04T09:10:13.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:13 smithi190 ceph-mon[36341]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-03-04T09:10:14.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:14 smithi082 ceph-mon[32880]: from='osd.6 [v2:172.21.15.82:6818/454436959,v1:172.21.15.82:6819/454436959]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-03-04T09:10:14.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:14 smithi082 ceph-mon[32880]: osdmap e45: 7 total, 6 up, 7 in 2024-03-04T09:10:14.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:14 smithi082 ceph-mon[32880]: from='osd.6 [v2:172.21.15.82:6818/454436959,v1:172.21.15.82:6819/454436959]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-03-04T09:10:14.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:14 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-04T09:10:14.317 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 04 09:10:14 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-6[61078]: 2024-03-04T09:10:14.105+0000 7f3b0acbf700 -1 osd.6 0 waiting for initial osdmap 2024-03-04T09:10:14.317 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 04 09:10:14 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-6[61078]: 2024-03-04T09:10:14.117+0000 7f3b06ab2700 -1 osd.6 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T09:10:14.403 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:14 smithi102 ceph-mon[36220]: from='osd.6 [v2:172.21.15.82:6818/454436959,v1:172.21.15.82:6819/454436959]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-03-04T09:10:14.403 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:14 smithi102 ceph-mon[36220]: osdmap e45: 7 total, 6 up, 7 in 2024-03-04T09:10:14.404 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:14 smithi102 ceph-mon[36220]: from='osd.6 [v2:172.21.15.82:6818/454436959,v1:172.21.15.82:6819/454436959]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-03-04T09:10:14.404 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:14 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-04T09:10:14.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:14 smithi190 ceph-mon[36341]: from='osd.6 [v2:172.21.15.82:6818/454436959,v1:172.21.15.82:6819/454436959]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-03-04T09:10:14.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:14 smithi190 ceph-mon[36341]: osdmap e45: 7 total, 6 up, 7 in 2024-03-04T09:10:14.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:14 smithi190 ceph-mon[36341]: from='osd.6 [v2:172.21.15.82:6818/454436959,v1:172.21.15.82:6819/454436959]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-03-04T09:10:14.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:14 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-04T09:10:15.314 INFO:teuthology.orchestra.run.smithi102.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-03-04T09:10:15.314 INFO:teuthology.orchestra.run.smithi102.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-03-04T09:10:15.314 INFO:teuthology.orchestra.run.smithi102.stderr: stderr: 10+0 records in 2024-03-04T09:10:15.314 INFO:teuthology.orchestra.run.smithi102.stderr:10+0 records out 2024-03-04T09:10:15.315 INFO:teuthology.orchestra.run.smithi102.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.013259 s, 791 MB/s 2024-03-04T09:10:15.315 INFO:teuthology.orchestra.run.smithi102.stderr:--> Zapping successful for: 2024-03-04T09:10:15.385 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:15 smithi102 ceph-mon[36220]: from='osd.6 [v2:172.21.15.82:6818/454436959,v1:172.21.15.82:6819/454436959]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-03-04T09:10:15.385 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:15 smithi102 ceph-mon[36220]: osdmap e46: 7 total, 6 up, 7 in 2024-03-04T09:10:15.385 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:15 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-04T09:10:15.385 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:15 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-04T09:10:15.385 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:15 smithi102 ceph-mon[36220]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-03-04T09:10:15.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:15 smithi190 ceph-mon[36341]: from='osd.6 [v2:172.21.15.82:6818/454436959,v1:172.21.15.82:6819/454436959]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-03-04T09:10:15.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:15 smithi190 ceph-mon[36341]: osdmap e46: 7 total, 6 up, 7 in 2024-03-04T09:10:15.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:15 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-04T09:10:15.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:15 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-04T09:10:15.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:15 smithi190 ceph-mon[36341]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-03-04T09:10:15.534 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:15 smithi082 ceph-mon[32880]: from='osd.6 [v2:172.21.15.82:6818/454436959,v1:172.21.15.82:6819/454436959]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-03-04T09:10:15.535 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:15 smithi082 ceph-mon[32880]: osdmap e46: 7 total, 6 up, 7 in 2024-03-04T09:10:15.535 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:15 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-04T09:10:15.535 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:15 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-04T09:10:15.535 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:15 smithi082 ceph-mon[32880]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-03-04T09:10:15.979 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph orch daemon add osd smithi102:vg_nvme/lv_2 2024-03-04T09:10:16.224 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.b/config 2024-03-04T09:10:16.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:16 smithi082 ceph-mon[32880]: purged_snaps scrub starts 2024-03-04T09:10:16.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:16 smithi082 ceph-mon[32880]: purged_snaps scrub ok 2024-03-04T09:10:16.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:16 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-04T09:10:16.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:16 smithi082 ceph-mon[32880]: osd.6 [v2:172.21.15.82:6818/454436959,v1:172.21.15.82:6819/454436959] boot 2024-03-04T09:10:16.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:16 smithi082 ceph-mon[32880]: osdmap e47: 7 total, 7 up, 7 in 2024-03-04T09:10:16.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:16 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-04T09:10:16.318 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:16 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:16.318 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:16 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:16.318 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:16 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:10:16.318 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:16 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:10:16.318 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:16 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:10:16.318 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:16 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:16.318 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:16 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:10:16.318 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:16 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:10:16.318 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:16 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:16.344 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:16 smithi102 ceph-mon[36220]: purged_snaps scrub starts 2024-03-04T09:10:16.344 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:16 smithi102 ceph-mon[36220]: purged_snaps scrub ok 2024-03-04T09:10:16.345 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:16 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-04T09:10:16.345 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:16 smithi102 ceph-mon[36220]: osd.6 [v2:172.21.15.82:6818/454436959,v1:172.21.15.82:6819/454436959] boot 2024-03-04T09:10:16.345 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:16 smithi102 ceph-mon[36220]: osdmap e47: 7 total, 7 up, 7 in 2024-03-04T09:10:16.345 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:16 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-04T09:10:16.345 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:16 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:16.345 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:16 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:16.345 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:16 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:10:16.345 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:16 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:10:16.345 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:16 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:10:16.345 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:16 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:16.345 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:16 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:10:16.345 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:16 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:10:16.345 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:16 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:16.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:16 smithi190 ceph-mon[36341]: purged_snaps scrub starts 2024-03-04T09:10:16.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:16 smithi190 ceph-mon[36341]: purged_snaps scrub ok 2024-03-04T09:10:16.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:16 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-04T09:10:16.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:16 smithi190 ceph-mon[36341]: osd.6 [v2:172.21.15.82:6818/454436959,v1:172.21.15.82:6819/454436959] boot 2024-03-04T09:10:16.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:16 smithi190 ceph-mon[36341]: osdmap e47: 7 total, 7 up, 7 in 2024-03-04T09:10:16.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:16 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-04T09:10:16.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:16 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:16.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:16 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:16.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:16 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:10:16.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:16 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:10:16.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:16 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:10:16.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:16 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:16.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:16 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:10:16.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:16 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:10:16.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:16 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:17.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:17 smithi190 ceph-mon[36341]: Detected new or changed devices on smithi082 2024-03-04T09:10:17.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:17 smithi190 ceph-mon[36341]: Adjusting osd_memory_target on smithi082 to 5696M 2024-03-04T09:10:17.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:17 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:10:17.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:17 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:10:17.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:17 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:10:17.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:17 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:17.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:17 smithi190 ceph-mon[36341]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-03-04T09:10:17.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:17 smithi102 ceph-mon[36220]: Detected new or changed devices on smithi082 2024-03-04T09:10:17.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:17 smithi102 ceph-mon[36220]: Adjusting osd_memory_target on smithi082 to 5696M 2024-03-04T09:10:17.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:17 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:10:17.430 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:17 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:10:17.430 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:17 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:10:17.430 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:17 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:17.430 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:17 smithi102 ceph-mon[36220]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-03-04T09:10:17.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:17 smithi082 ceph-mon[32880]: Detected new or changed devices on smithi082 2024-03-04T09:10:17.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:17 smithi082 ceph-mon[32880]: Adjusting osd_memory_target on smithi082 to 5696M 2024-03-04T09:10:17.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:17 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:10:17.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:17 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:10:17.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:17 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:10:17.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:17 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:17.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:17 smithi082 ceph-mon[32880]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-03-04T09:10:17.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:10:17.871+0000 7fcaed1f5700 1 -- 172.21.15.102:0/1936272541 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcae8100170 msgr2=0x7fcae81005d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:10:17.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:10:17.871+0000 7fcaed1f5700 1 --2- 172.21.15.102:0/1936272541 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcae8100170 0x7fcae81005d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcadc009990 tx=0x7fcadc009ca0 comp rx=0 tx=0).stop 2024-03-04T09:10:17.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:10:17.871+0000 7fcaed1f5700 1 -- 172.21.15.102:0/1936272541 shutdown_connections 2024-03-04T09:10:17.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:10:17.871+0000 7fcaed1f5700 1 --2- 172.21.15.102:0/1936272541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcae8100b10 0x7fcae810a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:10:17.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:10:17.871+0000 7fcaed1f5700 1 --2- 172.21.15.102:0/1936272541 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcae81036f0 0x7fcae8103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:10:17.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:10:17.871+0000 7fcaed1f5700 1 --2- 172.21.15.102:0/1936272541 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcae8100170 0x7fcae81005d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:10:17.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:10:17.871+0000 7fcaed1f5700 1 -- 172.21.15.102:0/1936272541 >> 172.21.15.102:0/1936272541 conn(0x7fcae80fbd10 msgr2=0x7fcae80fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:10:17.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:10:17.871+0000 7fcaed1f5700 1 -- 172.21.15.102:0/1936272541 shutdown_connections 2024-03-04T09:10:17.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:10:17.871+0000 7fcaed1f5700 1 -- 172.21.15.102:0/1936272541 wait complete. 2024-03-04T09:10:17.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:10:17.872+0000 7fcaed1f5700 1 Processor -- start 2024-03-04T09:10:17.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:10:17.872+0000 7fcaed1f5700 1 -- start start 2024-03-04T09:10:17.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:10:17.873+0000 7fcaed1f5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcae8100170 0x7fcae81983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:10:17.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:10:17.873+0000 7fcaed1f5700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcae8100b10 0x7fcae8198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:10:17.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:10:17.873+0000 7fcaed1f5700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcae81036f0 0x7fcae819f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:10:17.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:10:17.873+0000 7fcaed1f5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae810ddb0 con 0x7fcae8100170 2024-03-04T09:10:17.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:10:17.873+0000 7fcaed1f5700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae810dc30 con 0x7fcae81036f0 2024-03-04T09:10:17.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:10:17.873+0000 7fcaed1f5700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae810df30 con 0x7fcae8100b10 2024-03-04T09:10:17.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:10:17.873+0000 7fcae759e700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcae81036f0 0x7fcae819f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:10:17.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:10:17.873+0000 7fcae759e700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcae81036f0 0x7fcae819f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36632/0 (socket says 172.21.15.102:36632) 2024-03-04T09:10:17.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:10:17.873+0000 7fcae759e700 1 -- 172.21.15.102:0/3178440483 learned_addr learned my addr 172.21.15.102:0/3178440483 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-04T09:10:17.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:10:17.873+0000 7fcae659c700 1 --2- 172.21.15.102:0/3178440483 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcae8100b10 0x7fcae8198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:10:17.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:10:17.873+0000 7fcae6d9d700 1 --2- 172.21.15.102:0/3178440483 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcae8100170 0x7fcae81983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:10:17.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:10:17.873+0000 7fcae759e700 1 -- 172.21.15.102:0/3178440483 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcae8100b10 msgr2=0x7fcae8198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:10:17.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:10:17.873+0000 7fcae759e700 1 --2- 172.21.15.102:0/3178440483 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcae8100b10 0x7fcae8198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:10:17.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:10:17.873+0000 7fcae759e700 1 -- 172.21.15.102:0/3178440483 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcae8100170 msgr2=0x7fcae81983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:10:17.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:10:17.873+0000 7fcae759e700 1 --2- 172.21.15.102:0/3178440483 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcae8100170 0x7fcae81983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:10:17.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:10:17.873+0000 7fcae759e700 1 -- 172.21.15.102:0/3178440483 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae81a0050 con 0x7fcae81036f0 2024-03-04T09:10:17.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:10:17.873+0000 7fcae759e700 1 --2- 172.21.15.102:0/3178440483 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcae81036f0 0x7fcae819f9b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fcae0007ee0 tx=0x7fcae000d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:10:17.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:10:17.873+0000 7fcacffff700 1 -- 172.21.15.102:0/3178440483 <== mon.2 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae0004bb0 con 0x7fcae81036f0 2024-03-04T09:10:17.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:10:17.874+0000 7fcaed1f5700 1 -- 172.21.15.102:0/3178440483 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcae81a0340 con 0x7fcae81036f0 2024-03-04T09:10:17.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:10:17.874+0000 7fcacffff700 1 -- 172.21.15.102:0/3178440483 <== mon.2 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fcae0004d50 con 0x7fcae81036f0 2024-03-04T09:10:17.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:10:17.874+0000 7fcacffff700 1 -- 172.21.15.102:0/3178440483 <== mon.2 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae00059a0 con 0x7fcae81036f0 2024-03-04T09:10:17.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:10:17.874+0000 7fcaed1f5700 1 -- 172.21.15.102:0/3178440483 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcae81a0900 con 0x7fcae81036f0 2024-03-04T09:10:17.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:10:17.874+0000 7fcaed1f5700 1 -- 172.21.15.102:0/3178440483 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcae8068d80 con 0x7fcae81036f0 2024-03-04T09:10:17.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:10:17.876+0000 7fcacffff700 1 -- 172.21.15.102:0/3178440483 <== mon.2 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7fcae001a020 con 0x7fcae81036f0 2024-03-04T09:10:17.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:10:17.877+0000 7fcacffff700 1 --2- 172.21.15.102:0/3178440483 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fcad00a1e10 0x7fcad00a42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:10:17.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:10:17.877+0000 7fcacffff700 1 -- 172.21.15.102:0/3178440483 <== mon.2 v2:172.21.15.102:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4965+0+0 (secure 0 0 0) 0x7fcae00ccdd0 con 0x7fcae81036f0 2024-03-04T09:10:17.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:10:17.877+0000 7fcae6d9d700 1 --2- 172.21.15.102:0/3178440483 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fcad00a1e10 0x7fcad00a42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:10:17.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:10:17.877+0000 7fcae6d9d700 1 --2- 172.21.15.102:0/3178440483 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fcad00a1e10 0x7fcad00a42d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcae806a560 tx=0x7fcad8009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:10:17.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:10:17.881+0000 7fcacffff700 1 -- 172.21.15.102:0/3178440483 <== mon.2 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fcae0010070 con 0x7fcae81036f0 2024-03-04T09:10:18.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:10:18.082+0000 7fcaed1f5700 1 -- 172.21.15.102:0/3178440483 --> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fcae8062500 con 0x7fcad00a1e10 2024-03-04T09:10:18.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:18 smithi190 ceph-mon[36341]: osdmap e48: 7 total, 7 up, 7 in 2024-03-04T09:10:18.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:18 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T09:10:18.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:18 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T09:10:18.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:18 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:10:18.428 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:18 smithi102 ceph-mon[36220]: osdmap e48: 7 total, 7 up, 7 in 2024-03-04T09:10:18.428 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:18 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T09:10:18.428 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:18 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T09:10:18.428 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:18 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:10:18.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:18 smithi082 ceph-mon[32880]: osdmap e48: 7 total, 7 up, 7 in 2024-03-04T09:10:18.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:18 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T09:10:18.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:18 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T09:10:18.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:18 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:10:19.338 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:19 smithi102 ceph-mon[36220]: from='client.24272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:10:19.339 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:19 smithi102 ceph-mon[36220]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-03-04T09:10:19.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:19 smithi190 ceph-mon[36341]: from='client.24272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:10:19.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:19 smithi190 ceph-mon[36341]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-03-04T09:10:19.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:19 smithi082 ceph-mon[32880]: from='client.24272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:10:19.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:19 smithi082 ceph-mon[32880]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-03-04T09:10:21.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:21 smithi102 ceph-mon[36220]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-03-04T09:10:21.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:21 smithi102 ceph-mon[36220]: from='client.? 172.21.15.102:0/1197659403' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72f83f97-f496-4503-8284-6a7b8f99a6f3"}]: dispatch 2024-03-04T09:10:21.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:21 smithi102 ceph-mon[36220]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72f83f97-f496-4503-8284-6a7b8f99a6f3"}]: dispatch 2024-03-04T09:10:21.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:21 smithi102 ceph-mon[36220]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "72f83f97-f496-4503-8284-6a7b8f99a6f3"}]': finished 2024-03-04T09:10:21.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:21 smithi102 ceph-mon[36220]: osdmap e49: 8 total, 7 up, 8 in 2024-03-04T09:10:21.430 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:21 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-04T09:10:21.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:21 smithi082 ceph-mon[32880]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-03-04T09:10:21.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:21 smithi082 ceph-mon[32880]: from='client.? 172.21.15.102:0/1197659403' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72f83f97-f496-4503-8284-6a7b8f99a6f3"}]: dispatch 2024-03-04T09:10:21.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:21 smithi082 ceph-mon[32880]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72f83f97-f496-4503-8284-6a7b8f99a6f3"}]: dispatch 2024-03-04T09:10:21.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:21 smithi082 ceph-mon[32880]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "72f83f97-f496-4503-8284-6a7b8f99a6f3"}]': finished 2024-03-04T09:10:21.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:21 smithi082 ceph-mon[32880]: osdmap e49: 8 total, 7 up, 8 in 2024-03-04T09:10:21.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:21 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-04T09:10:21.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:21 smithi190 ceph-mon[36341]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-03-04T09:10:21.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:21 smithi190 ceph-mon[36341]: from='client.? 172.21.15.102:0/1197659403' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72f83f97-f496-4503-8284-6a7b8f99a6f3"}]: dispatch 2024-03-04T09:10:21.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:21 smithi190 ceph-mon[36341]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72f83f97-f496-4503-8284-6a7b8f99a6f3"}]: dispatch 2024-03-04T09:10:21.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:21 smithi190 ceph-mon[36341]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "72f83f97-f496-4503-8284-6a7b8f99a6f3"}]': finished 2024-03-04T09:10:21.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:21 smithi190 ceph-mon[36341]: osdmap e49: 8 total, 7 up, 8 in 2024-03-04T09:10:21.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:21 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-04T09:10:22.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:22 smithi082 ceph-mon[32880]: from='client.? 172.21.15.102:0/3183978736' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T09:10:22.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:22 smithi190 ceph-mon[36341]: from='client.? 172.21.15.102:0/3183978736' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T09:10:22.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:22 smithi102 ceph-mon[36220]: from='client.? 172.21.15.102:0/3183978736' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T09:10:23.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:23 smithi082 ceph-mon[32880]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-03-04T09:10:23.571 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:23 smithi190 ceph-mon[36341]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-03-04T09:10:23.580 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:23 smithi102 ceph-mon[36220]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-03-04T09:10:25.428 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:25 smithi102 ceph-mon[36220]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-03-04T09:10:25.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:25 smithi082 ceph-mon[32880]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-03-04T09:10:25.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:25 smithi190 ceph-mon[36341]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-03-04T09:10:27.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:27 smithi082 ceph-mon[32880]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-03-04T09:10:27.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:27 smithi190 ceph-mon[36341]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-03-04T09:10:27.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:27 smithi102 ceph-mon[36220]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-03-04T09:10:28.428 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:28 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-04T09:10:28.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:28 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:10:28.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:28 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-04T09:10:28.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:28 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:10:28.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:28 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-04T09:10:28.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:28 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:10:29.428 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:29 smithi102 ceph-mon[36220]: Deploying daemon osd.7 on smithi102 2024-03-04T09:10:29.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:29 smithi102 ceph-mon[36220]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-03-04T09:10:29.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:29 smithi082 ceph-mon[32880]: Deploying daemon osd.7 on smithi102 2024-03-04T09:10:29.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:29 smithi082 ceph-mon[32880]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-03-04T09:10:29.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:29 smithi190 ceph-mon[36341]: Deploying daemon osd.7 on smithi102 2024-03-04T09:10:29.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:29 smithi190 ceph-mon[36341]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-03-04T09:10:31.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:31 smithi102 ceph-mon[36220]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-03-04T09:10:31.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:31 smithi082 ceph-mon[32880]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-03-04T09:10:31.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:31 smithi190 ceph-mon[36341]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-03-04T09:10:33.539 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:33 smithi102 ceph-mon[36220]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-03-04T09:10:33.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:33 smithi082 ceph-mon[32880]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-03-04T09:10:33.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:33 smithi190 ceph-mon[36341]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-03-04T09:10:34.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:34 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:34.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:34 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:34.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:34 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:10:34.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:34 smithi102 ceph-mon[36220]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-03-04T09:10:35.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:34 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:35.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:34 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:35.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:34 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:10:35.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:34 smithi082 ceph-mon[32880]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-03-04T09:10:35.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:34 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:35.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:34 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:35.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:34 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:10:35.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:34 smithi190 ceph-mon[36341]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-03-04T09:10:37.480 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:37 smithi102 ceph-mon[36220]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-03-04T09:10:37.480 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:37 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:37.480 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:37 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:37.480 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:37 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:10:37.480 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:37 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:10:37.480 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:37 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:37.544 INFO:teuthology.orchestra.run.smithi102.stdout:Created osd(s) 7 on host 'smithi102' 2024-03-04T09:10:37.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:10:37.547+0000 7fcacffff700 1 -- 172.21.15.102:0/3178440483 <== mgr.14152 v2:172.21.15.82:6800/1278635224 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fcae8062500 con 0x7fcad00a1e10 2024-03-04T09:10:37.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:10:37.549+0000 7fcaed1f5700 1 -- 172.21.15.102:0/3178440483 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fcad00a1e10 msgr2=0x7fcad00a42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:10:37.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:10:37.549+0000 7fcaed1f5700 1 --2- 172.21.15.102:0/3178440483 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fcad00a1e10 0x7fcad00a42d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcae806a560 tx=0x7fcad8009190 comp rx=0 tx=0).stop 2024-03-04T09:10:37.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:10:37.549+0000 7fcaed1f5700 1 -- 172.21.15.102:0/3178440483 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcae81036f0 msgr2=0x7fcae819f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:10:37.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:10:37.549+0000 7fcaed1f5700 1 --2- 172.21.15.102:0/3178440483 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcae81036f0 0x7fcae819f9b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fcae0007ee0 tx=0x7fcae000d3b0 comp rx=0 tx=0).stop 2024-03-04T09:10:37.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:10:37.549+0000 7fcaed1f5700 1 -- 172.21.15.102:0/3178440483 shutdown_connections 2024-03-04T09:10:37.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:10:37.549+0000 7fcaed1f5700 1 --2- 172.21.15.102:0/3178440483 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fcad00a1e10 0x7fcad00a42d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:10:37.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:10:37.549+0000 7fcaed1f5700 1 --2- 172.21.15.102:0/3178440483 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcae81036f0 0x7fcae819f9b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:10:37.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:10:37.549+0000 7fcaed1f5700 1 --2- 172.21.15.102:0/3178440483 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcae8100170 0x7fcae81983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:10:37.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:10:37.549+0000 7fcaed1f5700 1 --2- 172.21.15.102:0/3178440483 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcae8100b10 0x7fcae8198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:10:37.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:10:37.549+0000 7fcaed1f5700 1 -- 172.21.15.102:0/3178440483 >> 172.21.15.102:0/3178440483 conn(0x7fcae80fbd10 msgr2=0x7fcae8106790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:10:37.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:10:37.550+0000 7fcaed1f5700 1 -- 172.21.15.102:0/3178440483 shutdown_connections 2024-03-04T09:10:37.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:10:37.550+0000 7fcaed1f5700 1 -- 172.21.15.102:0/3178440483 wait complete. 2024-03-04T09:10:37.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:37 smithi082 ceph-mon[32880]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-03-04T09:10:37.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:37 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:37.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:37 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:37.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:37 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:10:37.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:37 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:10:37.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:37 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:37.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:37 smithi190 ceph-mon[36341]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-03-04T09:10:37.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:37 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:37.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:37 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:37.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:37 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:10:37.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:37 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:10:37.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:37 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:38.193 DEBUG:teuthology.orchestra.run.smithi102:osd.7> sudo journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@osd.7.service 2024-03-04T09:10:38.195 INFO:tasks.cephadm:Deploying osd.8 on smithi190 with /dev/vg_nvme/lv_2... 2024-03-04T09:10:38.196 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-03-04T09:10:38.443 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.c/config 2024-03-04T09:10:38.763 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:38 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:38.763 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:38 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:38.763 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:38 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:10:38.763 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:38 smithi190 ceph-mon[36341]: from='osd.7 [v2:172.21.15.102:6816/2745057274,v1:172.21.15.102:6817/2745057274]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-04T09:10:38.763 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:38 smithi190 ceph-mon[36341]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-04T09:10:38.763 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:38 smithi190 ceph-mon[36341]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-03-04T09:10:38.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:38 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:38.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:38 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:38.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:38 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:10:38.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:38 smithi082 ceph-mon[32880]: from='osd.7 [v2:172.21.15.102:6816/2745057274,v1:172.21.15.102:6817/2745057274]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-04T09:10:38.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:38 smithi082 ceph-mon[32880]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-04T09:10:38.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:38 smithi082 ceph-mon[32880]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-03-04T09:10:38.928 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:38 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:38.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:38 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:38.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:38 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:10:38.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:38 smithi102 ceph-mon[36220]: from='osd.7 [v2:172.21.15.102:6816/2745057274,v1:172.21.15.102:6817/2745057274]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-04T09:10:38.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:38 smithi102 ceph-mon[36220]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-04T09:10:38.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:38 smithi102 ceph-mon[36220]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-03-04T09:10:39.646 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:39 smithi102 ceph-mon[36220]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-03-04T09:10:39.646 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:39 smithi102 ceph-mon[36220]: osdmap e50: 8 total, 7 up, 8 in 2024-03-04T09:10:39.646 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:39 smithi102 ceph-mon[36220]: from='osd.7 [v2:172.21.15.102:6816/2745057274,v1:172.21.15.102:6817/2745057274]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-03-04T09:10:39.646 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:39 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-04T09:10:39.646 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:39 smithi102 ceph-mon[36220]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-03-04T09:10:39.646 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:10:39 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:10:39.532+0000 7f8d13a51700 -1 osd.7 0 waiting for initial osdmap 2024-03-04T09:10:39.647 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:10:39 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:10:39.543+0000 7f8d0f844700 -1 osd.7 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T09:10:39.782 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:39 smithi190 ceph-mon[36341]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-03-04T09:10:39.782 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:39 smithi190 ceph-mon[36341]: osdmap e50: 8 total, 7 up, 8 in 2024-03-04T09:10:39.782 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:39 smithi190 ceph-mon[36341]: from='osd.7 [v2:172.21.15.102:6816/2745057274,v1:172.21.15.102:6817/2745057274]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-03-04T09:10:39.782 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:39 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-04T09:10:39.782 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:39 smithi190 ceph-mon[36341]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-03-04T09:10:39.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:39 smithi082 ceph-mon[32880]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-03-04T09:10:39.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:39 smithi082 ceph-mon[32880]: osdmap e50: 8 total, 7 up, 8 in 2024-03-04T09:10:39.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:39 smithi082 ceph-mon[32880]: from='osd.7 [v2:172.21.15.102:6816/2745057274,v1:172.21.15.102:6817/2745057274]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-03-04T09:10:39.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:39 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-04T09:10:39.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:39 smithi082 ceph-mon[32880]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-03-04T09:10:40.349 INFO:teuthology.orchestra.run.smithi190.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-03-04T09:10:40.349 INFO:teuthology.orchestra.run.smithi190.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-03-04T09:10:40.349 INFO:teuthology.orchestra.run.smithi190.stderr: stderr: 10+0 records in 2024-03-04T09:10:40.349 INFO:teuthology.orchestra.run.smithi190.stderr:10+0 records out 2024-03-04T09:10:40.349 INFO:teuthology.orchestra.run.smithi190.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0129518 s, 810 MB/s 2024-03-04T09:10:40.349 INFO:teuthology.orchestra.run.smithi190.stderr:--> Zapping successful for: 2024-03-04T09:10:40.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:40 smithi102 ceph-mon[36220]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-03-04T09:10:40.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:40 smithi102 ceph-mon[36220]: osdmap e51: 8 total, 7 up, 8 in 2024-03-04T09:10:40.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:40 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-04T09:10:40.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:40 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-04T09:10:40.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:40 smithi102 ceph-mon[36220]: pgmap v175: 1 pgs: 1 unknown; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-03-04T09:10:40.723 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:40 smithi190 ceph-mon[36341]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-03-04T09:10:40.723 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:40 smithi190 ceph-mon[36341]: osdmap e51: 8 total, 7 up, 8 in 2024-03-04T09:10:40.723 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:40 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-04T09:10:40.724 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:40 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-04T09:10:40.724 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:40 smithi190 ceph-mon[36341]: pgmap v175: 1 pgs: 1 unknown; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-03-04T09:10:40.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:40 smithi082 ceph-mon[32880]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-03-04T09:10:40.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:40 smithi082 ceph-mon[32880]: osdmap e51: 8 total, 7 up, 8 in 2024-03-04T09:10:40.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:40 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-04T09:10:40.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:40 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-04T09:10:40.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:40 smithi082 ceph-mon[32880]: pgmap v175: 1 pgs: 1 unknown; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-03-04T09:10:41.064 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph orch daemon add osd smithi190:vg_nvme/lv_2 2024-03-04T09:10:41.319 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.c/config 2024-03-04T09:10:41.733 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:41 smithi190 ceph-mon[36341]: purged_snaps scrub starts 2024-03-04T09:10:41.733 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:41 smithi190 ceph-mon[36341]: purged_snaps scrub ok 2024-03-04T09:10:41.733 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:41 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-04T09:10:41.733 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:41 smithi190 ceph-mon[36341]: osd.7 [v2:172.21.15.102:6816/2745057274,v1:172.21.15.102:6817/2745057274] boot 2024-03-04T09:10:41.733 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:41 smithi190 ceph-mon[36341]: osdmap e52: 8 total, 8 up, 8 in 2024-03-04T09:10:41.733 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:41 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-04T09:10:41.733 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:41 smithi190 ceph-mon[36341]: Detected new or changed devices on smithi102 2024-03-04T09:10:41.733 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:41 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:41.733 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:41 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:41.734 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:41 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:10:41.734 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:41 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:10:41.734 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:41 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:10:41.734 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:41 smithi190 ceph-mon[36341]: Adjusting osd_memory_target on smithi102 to 5696M 2024-03-04T09:10:41.734 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:41 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:41.734 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:41 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:10:41.734 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:41 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:10:41.734 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:41 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:41.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:41 smithi082 ceph-mon[32880]: purged_snaps scrub starts 2024-03-04T09:10:41.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:41 smithi082 ceph-mon[32880]: purged_snaps scrub ok 2024-03-04T09:10:41.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:41 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-04T09:10:41.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:41 smithi082 ceph-mon[32880]: osd.7 [v2:172.21.15.102:6816/2745057274,v1:172.21.15.102:6817/2745057274] boot 2024-03-04T09:10:41.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:41 smithi082 ceph-mon[32880]: osdmap e52: 8 total, 8 up, 8 in 2024-03-04T09:10:41.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:41 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-04T09:10:41.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:41 smithi082 ceph-mon[32880]: Detected new or changed devices on smithi102 2024-03-04T09:10:41.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:41 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:41.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:41 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:41.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:41 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:10:41.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:41 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:10:41.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:41 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:10:41.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:41 smithi082 ceph-mon[32880]: Adjusting osd_memory_target on smithi102 to 5696M 2024-03-04T09:10:41.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:41 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:41.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:41 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:10:41.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:41 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:10:41.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:41 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:41.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:41 smithi102 ceph-mon[36220]: purged_snaps scrub starts 2024-03-04T09:10:41.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:41 smithi102 ceph-mon[36220]: purged_snaps scrub ok 2024-03-04T09:10:41.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:41 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-04T09:10:41.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:41 smithi102 ceph-mon[36220]: osd.7 [v2:172.21.15.102:6816/2745057274,v1:172.21.15.102:6817/2745057274] boot 2024-03-04T09:10:41.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:41 smithi102 ceph-mon[36220]: osdmap e52: 8 total, 8 up, 8 in 2024-03-04T09:10:41.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:41 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-04T09:10:41.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:41 smithi102 ceph-mon[36220]: Detected new or changed devices on smithi102 2024-03-04T09:10:41.930 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:41 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:41.930 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:41 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:41.930 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:41 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:10:41.930 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:41 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:10:41.930 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:41 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:10:41.930 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:41 smithi102 ceph-mon[36220]: Adjusting osd_memory_target on smithi102 to 5696M 2024-03-04T09:10:41.930 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:41 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:41.930 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:41 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:10:41.930 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:41 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:10:41.930 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:41 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:42.664 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:42 smithi190 ceph-mon[36341]: osdmap e53: 8 total, 8 up, 8 in 2024-03-04T09:10:42.664 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:42 smithi190 ceph-mon[36341]: pgmap v178: 1 pgs: 1 unknown; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-03-04T09:10:42.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:42 smithi082 ceph-mon[32880]: osdmap e53: 8 total, 8 up, 8 in 2024-03-04T09:10:42.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:42 smithi082 ceph-mon[32880]: pgmap v178: 1 pgs: 1 unknown; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-03-04T09:10:42.870 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:10:42.872+0000 7faf4987b700 1 -- 172.21.15.190:0/3385287169 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faf44107e70 msgr2=0x7faf4410a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:10:42.871 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:10:42.872+0000 7faf4987b700 1 --2- 172.21.15.190:0/3385287169 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faf44107e70 0x7faf4410a280 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7faf34009990 tx=0x7faf34009ca0 comp rx=0 tx=0).stop 2024-03-04T09:10:42.871 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:10:42.872+0000 7faf4987b700 1 -- 172.21.15.190:0/3385287169 shutdown_connections 2024-03-04T09:10:42.871 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:10:42.872+0000 7faf4987b700 1 --2- 172.21.15.190:0/3385287169 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faf44107e70 0x7faf4410a280 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:10:42.871 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:10:42.872+0000 7faf4987b700 1 --2- 172.21.15.190:0/3385287169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf44102c10 0x7faf44105000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:10:42.871 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:10:42.872+0000 7faf4987b700 1 --2- 172.21.15.190:0/3385287169 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf44105540 0x7faf44107930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:10:42.871 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:10:42.872+0000 7faf4987b700 1 -- 172.21.15.190:0/3385287169 >> 172.21.15.190:0/3385287169 conn(0x7faf440fc5e0 msgr2=0x7faf440fea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:10:42.871 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:10:42.872+0000 7faf4987b700 1 -- 172.21.15.190:0/3385287169 shutdown_connections 2024-03-04T09:10:42.871 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:10:42.872+0000 7faf4987b700 1 -- 172.21.15.190:0/3385287169 wait complete. 2024-03-04T09:10:42.871 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:10:42.873+0000 7faf4987b700 1 Processor -- start 2024-03-04T09:10:42.871 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:10:42.873+0000 7faf4987b700 1 -- start start 2024-03-04T09:10:42.871 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:10:42.873+0000 7faf4987b700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf44102c10 0x7faf44198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:10:42.872 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:10:42.873+0000 7faf4987b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faf44105540 0x7faf441987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:10:42.872 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:10:42.873+0000 7faf4987b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf44107e70 0x7faf4419f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:10:42.872 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:10:42.873+0000 7faf4987b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf4410dd40 con 0x7faf44107e70 2024-03-04T09:10:42.872 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:10:42.873+0000 7faf4987b700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf4410dbc0 con 0x7faf44102c10 2024-03-04T09:10:42.872 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:10:42.873+0000 7faf4987b700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf4410dec0 con 0x7faf44105540 2024-03-04T09:10:42.872 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:10:42.873+0000 7faf427fc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faf44105540 0x7faf441987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:10:42.872 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:10:42.873+0000 7faf427fc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faf44105540 0x7faf441987d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:52308/0 (socket says 172.21.15.190:52308) 2024-03-04T09:10:42.872 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:10:42.873+0000 7faf427fc700 1 -- 172.21.15.190:0/3791854077 learned_addr learned my addr 172.21.15.190:0/3791854077 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-03-04T09:10:42.872 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:10:42.873+0000 7faf437fe700 1 --2- 172.21.15.190:0/3791854077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf44107e70 0x7faf4419f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:10:42.872 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:10:42.873+0000 7faf42ffd700 1 --2- 172.21.15.190:0/3791854077 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf44102c10 0x7faf44198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:10:42.872 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:10:42.873+0000 7faf427fc700 1 -- 172.21.15.190:0/3791854077 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf44102c10 msgr2=0x7faf44198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:10:42.872 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:10:42.873+0000 7faf427fc700 1 --2- 172.21.15.190:0/3791854077 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf44102c10 0x7faf44198290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:10:42.873 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:10:42.874+0000 7faf427fc700 1 -- 172.21.15.190:0/3791854077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf44107e70 msgr2=0x7faf4419f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:10:42.873 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:10:42.874+0000 7faf427fc700 1 --2- 172.21.15.190:0/3791854077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf44107e70 0x7faf4419f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:10:42.873 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:10:42.874+0000 7faf427fc700 1 -- 172.21.15.190:0/3791854077 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf4419fef0 con 0x7faf44105540 2024-03-04T09:10:42.873 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:10:42.874+0000 7faf437fe700 1 --2- 172.21.15.190:0/3791854077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf44107e70 0x7faf4419f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T09:10:42.873 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:10:42.874+0000 7faf427fc700 1 --2- 172.21.15.190:0/3791854077 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faf44105540 0x7faf441987d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7faf2c00b560 tx=0x7faf2c00b920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:10:42.873 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:10:42.874+0000 7faf48879700 1 -- 172.21.15.190:0/3791854077 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c015020 con 0x7faf44105540 2024-03-04T09:10:42.873 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:10:42.874+0000 7faf4987b700 1 -- 172.21.15.190:0/3791854077 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf441a01e0 con 0x7faf44105540 2024-03-04T09:10:42.873 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:10:42.874+0000 7faf48879700 1 -- 172.21.15.190:0/3791854077 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7faf2c011d00 con 0x7faf44105540 2024-03-04T09:10:42.873 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:10:42.874+0000 7faf48879700 1 -- 172.21.15.190:0/3791854077 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c010e30 con 0x7faf44105540 2024-03-04T09:10:42.873 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:10:42.874+0000 7faf4987b700 1 -- 172.21.15.190:0/3791854077 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf441a07a0 con 0x7faf44105540 2024-03-04T09:10:42.874 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:10:42.875+0000 7faf4987b700 1 -- 172.21.15.190:0/3791854077 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf44068d80 con 0x7faf44105540 2024-03-04T09:10:42.874 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:10:42.876+0000 7faf48879700 1 -- 172.21.15.190:0/3791854077 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7faf2c018020 con 0x7faf44105540 2024-03-04T09:10:42.874 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:10:42.877+0000 7faf48879700 1 --2- 172.21.15.190:0/3791854077 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7faf300a1e10 0x7faf300a42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:10:42.874 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:10:42.877+0000 7faf48879700 1 -- 172.21.15.190:0/3791854077 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5426+0+0 (secure 0 0 0) 0x7faf2c0cd070 con 0x7faf44105540 2024-03-04T09:10:42.874 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:10:42.877+0000 7faf42ffd700 1 --2- 172.21.15.190:0/3791854077 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7faf300a1e10 0x7faf300a42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:10:42.874 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:10:42.877+0000 7faf42ffd700 1 --2- 172.21.15.190:0/3791854077 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7faf300a1e10 0x7faf300a42d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7faf3c00e270 tx=0x7faf3c009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:10:42.876 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:10:42.880+0000 7faf48879700 1 -- 172.21.15.190:0/3791854077 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7faf2c01f020 con 0x7faf44105540 2024-03-04T09:10:42.928 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:42 smithi102 ceph-mon[36220]: osdmap e53: 8 total, 8 up, 8 in 2024-03-04T09:10:42.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:42 smithi102 ceph-mon[36220]: pgmap v178: 1 pgs: 1 unknown; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-03-04T09:10:43.084 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:10:43.088+0000 7faf4987b700 1 -- 172.21.15.190:0/3791854077 --> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7faf44062500 con 0x7faf300a1e10 2024-03-04T09:10:43.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:43 smithi082 ceph-mon[32880]: osdmap e54: 8 total, 8 up, 8 in 2024-03-04T09:10:43.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:43 smithi082 ceph-mon[32880]: osdmap e55: 8 total, 8 up, 8 in 2024-03-04T09:10:43.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:43 smithi082 ceph-mon[32880]: from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:10:43.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:43 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T09:10:43.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:43 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T09:10:43.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:43 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:10:43.831 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:43 smithi190 ceph-mon[36341]: osdmap e54: 8 total, 8 up, 8 in 2024-03-04T09:10:43.831 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:43 smithi190 ceph-mon[36341]: osdmap e55: 8 total, 8 up, 8 in 2024-03-04T09:10:43.831 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:43 smithi190 ceph-mon[36341]: from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:10:43.831 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:43 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T09:10:43.831 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:43 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T09:10:43.831 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:43 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:10:43.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:43 smithi102 ceph-mon[36220]: osdmap e54: 8 total, 8 up, 8 in 2024-03-04T09:10:43.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:43 smithi102 ceph-mon[36220]: osdmap e55: 8 total, 8 up, 8 in 2024-03-04T09:10:43.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:43 smithi102 ceph-mon[36220]: from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:10:43.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:43 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T09:10:43.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:43 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T09:10:43.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:43 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:10:45.170 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:44 smithi190 ceph-mon[36341]: osdmap e56: 8 total, 8 up, 8 in 2024-03-04T09:10:45.170 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:44 smithi190 ceph-mon[36341]: pgmap v182: 1 pgs: 1 unknown; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-03-04T09:10:45.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:44 smithi082 ceph-mon[32880]: osdmap e56: 8 total, 8 up, 8 in 2024-03-04T09:10:45.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:44 smithi082 ceph-mon[32880]: pgmap v182: 1 pgs: 1 unknown; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-03-04T09:10:45.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:44 smithi102 ceph-mon[36220]: osdmap e56: 8 total, 8 up, 8 in 2024-03-04T09:10:45.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:44 smithi102 ceph-mon[36220]: pgmap v182: 1 pgs: 1 unknown; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-03-04T09:10:46.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:45 smithi082 ceph-mon[32880]: from='client.? 172.21.15.190:0/2632973633' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "92c9109d-6ebb-4c50-9944-28cd7b2f9c0a"}]: dispatch 2024-03-04T09:10:46.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:45 smithi082 ceph-mon[32880]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "92c9109d-6ebb-4c50-9944-28cd7b2f9c0a"}]: dispatch 2024-03-04T09:10:46.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:45 smithi082 ceph-mon[32880]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "92c9109d-6ebb-4c50-9944-28cd7b2f9c0a"}]': finished 2024-03-04T09:10:46.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:45 smithi082 ceph-mon[32880]: osdmap e57: 9 total, 8 up, 9 in 2024-03-04T09:10:46.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:45 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-04T09:10:46.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:45 smithi190 ceph-mon[36341]: from='client.? 172.21.15.190:0/2632973633' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "92c9109d-6ebb-4c50-9944-28cd7b2f9c0a"}]: dispatch 2024-03-04T09:10:46.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:45 smithi190 ceph-mon[36341]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "92c9109d-6ebb-4c50-9944-28cd7b2f9c0a"}]: dispatch 2024-03-04T09:10:46.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:45 smithi190 ceph-mon[36341]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "92c9109d-6ebb-4c50-9944-28cd7b2f9c0a"}]': finished 2024-03-04T09:10:46.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:45 smithi190 ceph-mon[36341]: osdmap e57: 9 total, 8 up, 9 in 2024-03-04T09:10:46.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:45 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-04T09:10:46.428 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:45 smithi102 ceph-mon[36220]: from='client.? 172.21.15.190:0/2632973633' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "92c9109d-6ebb-4c50-9944-28cd7b2f9c0a"}]: dispatch 2024-03-04T09:10:46.428 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:45 smithi102 ceph-mon[36220]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "92c9109d-6ebb-4c50-9944-28cd7b2f9c0a"}]: dispatch 2024-03-04T09:10:46.428 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:45 smithi102 ceph-mon[36220]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "92c9109d-6ebb-4c50-9944-28cd7b2f9c0a"}]': finished 2024-03-04T09:10:46.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:45 smithi102 ceph-mon[36220]: osdmap e57: 9 total, 8 up, 9 in 2024-03-04T09:10:46.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:45 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-04T09:10:47.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:46 smithi082 ceph-mon[32880]: pgmap v184: 1 pgs: 1 unknown; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-04T09:10:47.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:46 smithi082 ceph-mon[32880]: from='client.? 172.21.15.190:0/1955836224' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T09:10:47.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:46 smithi190 ceph-mon[36341]: pgmap v184: 1 pgs: 1 unknown; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-04T09:10:47.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:46 smithi190 ceph-mon[36341]: from='client.? 172.21.15.190:0/1955836224' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T09:10:47.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:46 smithi102 ceph-mon[36220]: pgmap v184: 1 pgs: 1 unknown; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-04T09:10:47.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:46 smithi102 ceph-mon[36220]: from='client.? 172.21.15.190:0/1955836224' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T09:10:49.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:49 smithi082 ceph-mon[32880]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-04T09:10:49.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:49 smithi190 ceph-mon[36341]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-04T09:10:49.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:49 smithi102 ceph-mon[36220]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-04T09:10:51.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:51 smithi082 ceph-mon[32880]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-04T09:10:51.605 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:51 smithi190 ceph-mon[36341]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-04T09:10:51.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:51 smithi102 ceph-mon[36220]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-04T09:10:53.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:53 smithi082 ceph-mon[32880]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-04T09:10:53.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:53 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-03-04T09:10:53.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:53 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:10:53.615 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:53 smithi190 ceph-mon[36341]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-04T09:10:53.615 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:53 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-03-04T09:10:53.615 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:53 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:10:53.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:53 smithi102 ceph-mon[36220]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-04T09:10:53.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:53 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-03-04T09:10:53.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:53 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:10:54.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:54 smithi082 ceph-mon[32880]: Deploying daemon osd.8 on smithi190 2024-03-04T09:10:54.629 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:54 smithi190 ceph-mon[36341]: Deploying daemon osd.8 on smithi190 2024-03-04T09:10:54.669 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:54 smithi102 ceph-mon[36220]: Deploying daemon osd.8 on smithi190 2024-03-04T09:10:55.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:55 smithi190 ceph-mon[36341]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-04T09:10:55.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:55 smithi082 ceph-mon[32880]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-04T09:10:55.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:55 smithi102 ceph-mon[36220]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-04T09:10:57.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:57 smithi082 ceph-mon[32880]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-04T09:10:57.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:57 smithi190 ceph-mon[36341]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-04T09:10:57.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:57 smithi102 ceph-mon[36220]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-04T09:10:59.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:59 smithi082 ceph-mon[32880]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-04T09:10:59.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:59 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:59.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:59 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:59.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:10:59 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:10:59.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:59 smithi190 ceph-mon[36341]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-04T09:10:59.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:59 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:59.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:59 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:59.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:10:59 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:10:59.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:59 smithi102 ceph-mon[36220]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-04T09:10:59.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:59 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:59.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:59 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:10:59.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:10:59 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:11:01.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:01 smithi190 ceph-mon[36341]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-04T09:11:01.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:01 smithi082 ceph-mon[32880]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-04T09:11:01.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:01 smithi102 ceph-mon[36220]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-04T09:11:02.002 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:11:02.005+0000 7faf48879700 1 -- 172.21.15.190:0/3791854077 <== mgr.14152 v2:172.21.15.82:6800/1278635224 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7faf44062500 con 0x7faf300a1e10 2024-03-04T09:11:02.002 INFO:teuthology.orchestra.run.smithi190.stdout:Created osd(s) 8 on host 'smithi190' 2024-03-04T09:11:02.004 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:11:02.008+0000 7faf4987b700 1 -- 172.21.15.190:0/3791854077 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7faf300a1e10 msgr2=0x7faf300a42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:11:02.004 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:11:02.008+0000 7faf4987b700 1 --2- 172.21.15.190:0/3791854077 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7faf300a1e10 0x7faf300a42d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7faf3c00e270 tx=0x7faf3c009040 comp rx=0 tx=0).stop 2024-03-04T09:11:02.004 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:11:02.008+0000 7faf4987b700 1 -- 172.21.15.190:0/3791854077 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faf44105540 msgr2=0x7faf441987d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:11:02.004 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:11:02.008+0000 7faf4987b700 1 --2- 172.21.15.190:0/3791854077 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faf44105540 0x7faf441987d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7faf2c00b560 tx=0x7faf2c00b920 comp rx=0 tx=0).stop 2024-03-04T09:11:02.004 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:11:02.008+0000 7faf4987b700 1 -- 172.21.15.190:0/3791854077 shutdown_connections 2024-03-04T09:11:02.005 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:11:02.008+0000 7faf4987b700 1 --2- 172.21.15.190:0/3791854077 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7faf300a1e10 0x7faf300a42d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:11:02.005 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:11:02.008+0000 7faf4987b700 1 --2- 172.21.15.190:0/3791854077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf44107e70 0x7faf4419f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:11:02.005 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:11:02.008+0000 7faf4987b700 1 --2- 172.21.15.190:0/3791854077 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf44102c10 0x7faf44198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:11:02.005 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:11:02.008+0000 7faf4987b700 1 --2- 172.21.15.190:0/3791854077 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faf44105540 0x7faf441987d0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:11:02.005 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:11:02.008+0000 7faf4987b700 1 -- 172.21.15.190:0/3791854077 >> 172.21.15.190:0/3791854077 conn(0x7faf440fc5e0 msgr2=0x7faf44103550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:11:02.005 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:11:02.008+0000 7faf4987b700 1 -- 172.21.15.190:0/3791854077 shutdown_connections 2024-03-04T09:11:02.005 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:11:02.008+0000 7faf4987b700 1 -- 172.21.15.190:0/3791854077 wait complete. 2024-03-04T09:11:02.817 DEBUG:teuthology.orchestra.run.smithi190:osd.8> sudo journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@osd.8.service 2024-03-04T09:11:02.820 INFO:tasks.cephadm:Deploying osd.9 on smithi082 with /dev/vg_nvme/lv_1... 2024-03-04T09:11:02.820 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-03-04T09:11:03.069 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:11:03.152 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:02 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:03.152 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:02 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:03.152 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:02 smithi190 ceph-mon[36341]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-04T09:11:03.152 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:02 smithi190 ceph-mon[36341]: from='osd.8 [v2:172.21.15.190:6816/1679683516,v1:172.21.15.190:6817/1679683516]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-03-04T09:11:03.152 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:02 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:03.152 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:02 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:03.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:02 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:03.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:02 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:03.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:02 smithi082 ceph-mon[32880]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-04T09:11:03.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:02 smithi082 ceph-mon[32880]: from='osd.8 [v2:172.21.15.190:6816/1679683516,v1:172.21.15.190:6817/1679683516]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-03-04T09:11:03.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:02 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:03.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:02 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:03.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:02 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:03.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:02 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:03.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:02 smithi102 ceph-mon[36220]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-04T09:11:03.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:02 smithi102 ceph-mon[36220]: from='osd.8 [v2:172.21.15.190:6816/1679683516,v1:172.21.15.190:6817/1679683516]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-03-04T09:11:03.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:02 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:03.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:02 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:04.267 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:03 smithi190 ceph-mon[36341]: from='osd.8 [v2:172.21.15.190:6816/1679683516,v1:172.21.15.190:6817/1679683516]' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-03-04T09:11:04.267 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:03 smithi190 ceph-mon[36341]: osdmap e58: 9 total, 8 up, 9 in 2024-03-04T09:11:04.268 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:03 smithi190 ceph-mon[36341]: from='osd.8 [v2:172.21.15.190:6816/1679683516,v1:172.21.15.190:6817/1679683516]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2024-03-04T09:11:04.268 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:03 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-04T09:11:04.274 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:03 smithi082 ceph-mon[32880]: from='osd.8 [v2:172.21.15.190:6816/1679683516,v1:172.21.15.190:6817/1679683516]' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-03-04T09:11:04.274 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:03 smithi082 ceph-mon[32880]: osdmap e58: 9 total, 8 up, 9 in 2024-03-04T09:11:04.274 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:03 smithi082 ceph-mon[32880]: from='osd.8 [v2:172.21.15.190:6816/1679683516,v1:172.21.15.190:6817/1679683516]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2024-03-04T09:11:04.274 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:03 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-04T09:11:04.428 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:03 smithi102 ceph-mon[36220]: from='osd.8 [v2:172.21.15.190:6816/1679683516,v1:172.21.15.190:6817/1679683516]' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-03-04T09:11:04.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:03 smithi102 ceph-mon[36220]: osdmap e58: 9 total, 8 up, 9 in 2024-03-04T09:11:04.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:03 smithi102 ceph-mon[36220]: from='osd.8 [v2:172.21.15.190:6816/1679683516,v1:172.21.15.190:6817/1679683516]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2024-03-04T09:11:04.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:03 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-04T09:11:04.671 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:11:04 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:11:04.424+0000 7f30d7006700 -1 osd.8 0 waiting for initial osdmap 2024-03-04T09:11:04.671 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:11:04 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:11:04.437+0000 7f30ce5f0700 -1 osd.8 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T09:11:05.263 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:05 smithi082 ceph-mon[32880]: from='osd.8 [v2:172.21.15.190:6816/1679683516,v1:172.21.15.190:6817/1679683516]' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2024-03-04T09:11:05.263 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:05 smithi082 ceph-mon[32880]: osdmap e59: 9 total, 8 up, 9 in 2024-03-04T09:11:05.263 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:05 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-04T09:11:05.263 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:05 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-04T09:11:05.263 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:05 smithi082 ceph-mon[32880]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-04T09:11:05.263 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:05 smithi082 ceph-mon[32880]: from='osd.8 [v2:172.21.15.190:6816/1679683516,v1:172.21.15.190:6817/1679683516]' entity='osd.8' 2024-03-04T09:11:05.263 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-03-04T09:11:05.263 INFO:teuthology.orchestra.run.smithi082.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-03-04T09:11:05.263 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10+0 records in 2024-03-04T09:11:05.264 INFO:teuthology.orchestra.run.smithi082.stderr:10+0 records out 2024-03-04T09:11:05.264 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114151 s, 919 MB/s 2024-03-04T09:11:05.264 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping successful for: 2024-03-04T09:11:05.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:05 smithi190 ceph-mon[36341]: from='osd.8 [v2:172.21.15.190:6816/1679683516,v1:172.21.15.190:6817/1679683516]' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2024-03-04T09:11:05.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:05 smithi190 ceph-mon[36341]: osdmap e59: 9 total, 8 up, 9 in 2024-03-04T09:11:05.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:05 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-04T09:11:05.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:05 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-04T09:11:05.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:05 smithi190 ceph-mon[36341]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-04T09:11:05.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:05 smithi190 ceph-mon[36341]: from='osd.8 [v2:172.21.15.190:6816/1679683516,v1:172.21.15.190:6817/1679683516]' entity='osd.8' 2024-03-04T09:11:05.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:05 smithi102 ceph-mon[36220]: from='osd.8 [v2:172.21.15.190:6816/1679683516,v1:172.21.15.190:6817/1679683516]' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2024-03-04T09:11:05.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:05 smithi102 ceph-mon[36220]: osdmap e59: 9 total, 8 up, 9 in 2024-03-04T09:11:05.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:05 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-04T09:11:05.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:05 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-04T09:11:05.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:05 smithi102 ceph-mon[36220]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-04T09:11:05.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:05 smithi102 ceph-mon[36220]: from='osd.8 [v2:172.21.15.190:6816/1679683516,v1:172.21.15.190:6817/1679683516]' entity='osd.8' 2024-03-04T09:11:06.054 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph orch daemon add osd smithi082:vg_nvme/lv_1 2024-03-04T09:11:06.292 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:11:06.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:06 smithi082 ceph-mon[32880]: purged_snaps scrub starts 2024-03-04T09:11:06.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:06 smithi082 ceph-mon[32880]: purged_snaps scrub ok 2024-03-04T09:11:06.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:06 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-04T09:11:06.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:06 smithi082 ceph-mon[32880]: osd.8 [v2:172.21.15.190:6816/1679683516,v1:172.21.15.190:6817/1679683516] boot 2024-03-04T09:11:06.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:06 smithi082 ceph-mon[32880]: osdmap e60: 9 total, 9 up, 9 in 2024-03-04T09:11:06.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:06 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-04T09:11:06.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:06 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:06.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:06 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:06.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:06 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:11:06.318 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:06 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:11:06.318 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:06 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:11:06.318 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:06 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:06.318 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:06 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:11:06.318 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:06 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:11:06.318 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:06 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:06.318 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:06 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:11:06.318 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:06 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:11:06.318 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:06 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:11:06.318 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:06 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:06.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:06 smithi190 ceph-mon[36341]: purged_snaps scrub starts 2024-03-04T09:11:06.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:06 smithi190 ceph-mon[36341]: purged_snaps scrub ok 2024-03-04T09:11:06.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:06 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-04T09:11:06.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:06 smithi190 ceph-mon[36341]: osd.8 [v2:172.21.15.190:6816/1679683516,v1:172.21.15.190:6817/1679683516] boot 2024-03-04T09:11:06.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:06 smithi190 ceph-mon[36341]: osdmap e60: 9 total, 9 up, 9 in 2024-03-04T09:11:06.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:06 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-04T09:11:06.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:06 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:06.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:06 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:06.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:06 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:11:06.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:06 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:11:06.422 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:06 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:11:06.422 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:06 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:06.422 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:06 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:11:06.422 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:06 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:11:06.422 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:06 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:06.422 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:06 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:11:06.423 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:06 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:11:06.423 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:06 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:11:06.423 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:06 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:06.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:06 smithi102 ceph-mon[36220]: purged_snaps scrub starts 2024-03-04T09:11:06.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:06 smithi102 ceph-mon[36220]: purged_snaps scrub ok 2024-03-04T09:11:06.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:06 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-04T09:11:06.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:06 smithi102 ceph-mon[36220]: osd.8 [v2:172.21.15.190:6816/1679683516,v1:172.21.15.190:6817/1679683516] boot 2024-03-04T09:11:06.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:06 smithi102 ceph-mon[36220]: osdmap e60: 9 total, 9 up, 9 in 2024-03-04T09:11:06.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:06 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-04T09:11:06.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:06 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:06.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:06 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:06.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:06 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:11:06.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:06 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:11:06.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:06 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:11:06.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:06 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:06.430 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:06 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:11:06.430 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:06 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:11:06.430 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:06 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:06.430 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:06 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:11:06.430 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:06 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:11:06.430 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:06 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:11:06.430 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:06 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:07.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:07 smithi082 ceph-mon[32880]: Detected new or changed devices on smithi190 2024-03-04T09:11:07.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:07 smithi082 ceph-mon[32880]: Adjusting osd_memory_target on smithi190 to 5696M 2024-03-04T09:11:07.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:07 smithi082 ceph-mon[32880]: osdmap e61: 9 total, 9 up, 9 in 2024-03-04T09:11:07.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:07 smithi082 ceph-mon[32880]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-03-04T09:11:07.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:07 smithi190 ceph-mon[36341]: Detected new or changed devices on smithi190 2024-03-04T09:11:07.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:07 smithi190 ceph-mon[36341]: Adjusting osd_memory_target on smithi190 to 5696M 2024-03-04T09:11:07.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:07 smithi190 ceph-mon[36341]: osdmap e61: 9 total, 9 up, 9 in 2024-03-04T09:11:07.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:07 smithi190 ceph-mon[36341]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-03-04T09:11:07.428 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:07 smithi102 ceph-mon[36220]: Detected new or changed devices on smithi190 2024-03-04T09:11:07.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:07 smithi102 ceph-mon[36220]: Adjusting osd_memory_target on smithi190 to 5696M 2024-03-04T09:11:07.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:07 smithi102 ceph-mon[36220]: osdmap e61: 9 total, 9 up, 9 in 2024-03-04T09:11:07.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:07 smithi102 ceph-mon[36220]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-03-04T09:11:08.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:11:08.022+0000 7f5c3b28d700 1 -- 172.21.15.82:0/1775112689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c34100790 msgr2=0x7f5c34100bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:11:08.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:11:08.022+0000 7f5c3b28d700 1 --2- 172.21.15.82:0/1775112689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c34100790 0x7f5c34100bb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5c300099c0 tx=0x7f5c30009cd0 comp rx=0 tx=0).stop 2024-03-04T09:11:08.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:11:08.022+0000 7f5c3b28d700 1 -- 172.21.15.82:0/1775112689 shutdown_connections 2024-03-04T09:11:08.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:11:08.022+0000 7f5c3b28d700 1 --2- 172.21.15.82:0/1775112689 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c34102330 0x7f5c34108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:11:08.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:11:08.022+0000 7f5c3b28d700 1 --2- 172.21.15.82:0/1775112689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c34100790 0x7f5c34100bb0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:11:08.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:11:08.022+0000 7f5c3b28d700 1 --2- 172.21.15.82:0/1775112689 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5c34101990 0x7f5c34101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:11:08.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:11:08.022+0000 7f5c3b28d700 1 -- 172.21.15.82:0/1775112689 >> 172.21.15.82:0/1775112689 conn(0x7f5c340fbd50 msgr2=0x7f5c340fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:11:08.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:11:08.022+0000 7f5c3b28d700 1 -- 172.21.15.82:0/1775112689 shutdown_connections 2024-03-04T09:11:08.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:11:08.022+0000 7f5c3b28d700 1 -- 172.21.15.82:0/1775112689 wait complete. 2024-03-04T09:11:08.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:11:08.022+0000 7f5c3b28d700 1 Processor -- start 2024-03-04T09:11:08.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:11:08.022+0000 7f5c3b28d700 1 -- start start 2024-03-04T09:11:08.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:11:08.023+0000 7f5c3b28d700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5c34100790 0x7f5c34198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:11:08.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:11:08.023+0000 7f5c3b28d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c34101990 0x7f5c34198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:11:08.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:11:08.023+0000 7f5c3b28d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c34102330 0x7f5c3419f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:11:08.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:11:08.023+0000 7f5c3b28d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3410cbd0 con 0x7f5c34101990 2024-03-04T09:11:08.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:11:08.023+0000 7f5c3b28d700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3410ca50 con 0x7f5c34100790 2024-03-04T09:11:08.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:11:08.023+0000 7f5c3b28d700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3410cd50 con 0x7f5c34102330 2024-03-04T09:11:08.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:11:08.023+0000 7f5c38828700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c34101990 0x7f5c34198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:11:08.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:11:08.023+0000 7f5c38828700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c34101990 0x7f5c34198840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51998/0 (socket says 172.21.15.82:51998) 2024-03-04T09:11:08.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:11:08.023+0000 7f5c38828700 1 -- 172.21.15.82:0/3706261082 learned_addr learned my addr 172.21.15.82:0/3706261082 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:11:08.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:11:08.023+0000 7f5c39029700 1 --2- 172.21.15.82:0/3706261082 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5c34100790 0x7f5c34198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:11:08.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:11:08.023+0000 7f5c3982a700 1 --2- 172.21.15.82:0/3706261082 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c34102330 0x7f5c3419f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:11:08.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:11:08.023+0000 7f5c38828700 1 -- 172.21.15.82:0/3706261082 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c34102330 msgr2=0x7f5c3419f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:11:08.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:11:08.023+0000 7f5c38828700 1 --2- 172.21.15.82:0/3706261082 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c34102330 0x7f5c3419f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:11:08.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:11:08.023+0000 7f5c38828700 1 -- 172.21.15.82:0/3706261082 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5c34100790 msgr2=0x7f5c34198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:11:08.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:11:08.023+0000 7f5c38828700 1 --2- 172.21.15.82:0/3706261082 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5c34100790 0x7f5c34198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:11:08.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:11:08.023+0000 7f5c38828700 1 -- 172.21.15.82:0/3706261082 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c3419ff60 con 0x7f5c34101990 2024-03-04T09:11:08.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:11:08.023+0000 7f5c38828700 1 --2- 172.21.15.82:0/3706261082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c34101990 0x7f5c34198840 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5c2400d980 tx=0x7f5c2400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:11:08.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:11:08.023+0000 7f5c2a7fc700 1 -- 172.21.15.82:0/3706261082 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c24016070 con 0x7f5c34101990 2024-03-04T09:11:08.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:11:08.023+0000 7f5c3b28d700 1 -- 172.21.15.82:0/3706261082 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c341a0250 con 0x7f5c34101990 2024-03-04T09:11:08.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:11:08.023+0000 7f5c2a7fc700 1 -- 172.21.15.82:0/3706261082 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f5c2400de70 con 0x7f5c34101990 2024-03-04T09:11:08.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:11:08.023+0000 7f5c2a7fc700 1 -- 172.21.15.82:0/3706261082 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2400f3c0 con 0x7f5c34101990 2024-03-04T09:11:08.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:11:08.023+0000 7f5c3b28d700 1 -- 172.21.15.82:0/3706261082 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c341a0790 con 0x7f5c34101990 2024-03-04T09:11:08.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:11:08.024+0000 7f5c3b28d700 1 -- 172.21.15.82:0/3706261082 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c34068d80 con 0x7f5c34101990 2024-03-04T09:11:08.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:11:08.025+0000 7f5c2a7fc700 1 -- 172.21.15.82:0/3706261082 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f5c24019070 con 0x7f5c34101990 2024-03-04T09:11:08.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:11:08.026+0000 7f5c2a7fc700 1 --2- 172.21.15.82:0/3706261082 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f5c200a1e10 0x7f5c200a42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:11:08.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:11:08.026+0000 7f5c39029700 1 --2- 172.21.15.82:0/3706261082 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f5c200a1e10 0x7f5c200a42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:11:08.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:11:08.026+0000 7f5c2a7fc700 1 -- 172.21.15.82:0/3706261082 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5829+0+0 (secure 0 0 0) 0x7f5c240ccf20 con 0x7f5c34101990 2024-03-04T09:11:08.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:11:08.026+0000 7f5c39029700 1 --2- 172.21.15.82:0/3706261082 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f5c200a1e10 0x7f5c200a42d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5c30003900 tx=0x7f5c30005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:11:08.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:11:08.030+0000 7f5c2a7fc700 1 -- 172.21.15.82:0/3706261082 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f5c2409ad00 con 0x7f5c34101990 2024-03-04T09:11:08.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:11:08.232+0000 7f5c3b28d700 1 -- 172.21.15.82:0/3706261082 --> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f5c34109d00 con 0x7f5c200a1e10 2024-03-04T09:11:08.229 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:08 smithi082 ceph-mon[32880]: osdmap e62: 9 total, 9 up, 9 in 2024-03-04T09:11:08.229 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:08 smithi082 ceph-mon[32880]: osdmap e63: 9 total, 9 up, 9 in 2024-03-04T09:11:08.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:08 smithi190 ceph-mon[36341]: osdmap e62: 9 total, 9 up, 9 in 2024-03-04T09:11:08.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:08 smithi190 ceph-mon[36341]: osdmap e63: 9 total, 9 up, 9 in 2024-03-04T09:11:08.428 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:08 smithi102 ceph-mon[36220]: osdmap e62: 9 total, 9 up, 9 in 2024-03-04T09:11:08.428 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:08 smithi102 ceph-mon[36220]: osdmap e63: 9 total, 9 up, 9 in 2024-03-04T09:11:09.182 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:09 smithi082 ceph-mon[32880]: pgmap v201: 1 pgs: 1 remapped+peering; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-03-04T09:11:09.182 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:09 smithi082 ceph-mon[32880]: from='client.14415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:11:09.182 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:09 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T09:11:09.182 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:09 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T09:11:09.182 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:09 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:11:09.182 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:09 smithi082 ceph-mon[32880]: osdmap e64: 9 total, 9 up, 9 in 2024-03-04T09:11:09.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:09 smithi190 ceph-mon[36341]: pgmap v201: 1 pgs: 1 remapped+peering; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-03-04T09:11:09.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:09 smithi190 ceph-mon[36341]: from='client.14415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:11:09.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:09 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T09:11:09.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:09 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T09:11:09.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:09 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:11:09.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:09 smithi190 ceph-mon[36341]: osdmap e64: 9 total, 9 up, 9 in 2024-03-04T09:11:09.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:09 smithi102 ceph-mon[36220]: pgmap v201: 1 pgs: 1 remapped+peering; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-03-04T09:11:09.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:09 smithi102 ceph-mon[36220]: from='client.14415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:11:09.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:09 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T09:11:09.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:09 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T09:11:09.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:09 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:11:09.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:09 smithi102 ceph-mon[36220]: osdmap e64: 9 total, 9 up, 9 in 2024-03-04T09:11:11.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:11 smithi082 ceph-mon[32880]: pgmap v203: 1 pgs: 1 remapped+peering; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-03-04T09:11:11.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:11 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/1902189706' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a3cfce03-0148-475d-bf55-b8284ae1cad2"}]: dispatch 2024-03-04T09:11:11.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:11 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/1902189706' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a3cfce03-0148-475d-bf55-b8284ae1cad2"}]': finished 2024-03-04T09:11:11.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:11 smithi082 ceph-mon[32880]: osdmap e65: 10 total, 9 up, 10 in 2024-03-04T09:11:11.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:11 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-04T09:11:11.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:11 smithi190 ceph-mon[36341]: pgmap v203: 1 pgs: 1 remapped+peering; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-03-04T09:11:11.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:11 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/1902189706' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a3cfce03-0148-475d-bf55-b8284ae1cad2"}]: dispatch 2024-03-04T09:11:11.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:11 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/1902189706' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a3cfce03-0148-475d-bf55-b8284ae1cad2"}]': finished 2024-03-04T09:11:11.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:11 smithi190 ceph-mon[36341]: osdmap e65: 10 total, 9 up, 10 in 2024-03-04T09:11:11.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:11 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-04T09:11:11.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:11 smithi102 ceph-mon[36220]: pgmap v203: 1 pgs: 1 remapped+peering; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-03-04T09:11:11.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:11 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/1902189706' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a3cfce03-0148-475d-bf55-b8284ae1cad2"}]: dispatch 2024-03-04T09:11:11.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:11 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/1902189706' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a3cfce03-0148-475d-bf55-b8284ae1cad2"}]': finished 2024-03-04T09:11:11.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:11 smithi102 ceph-mon[36220]: osdmap e65: 10 total, 9 up, 10 in 2024-03-04T09:11:11.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:11 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-04T09:11:12.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:12 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/3257838423' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T09:11:12.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:12 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/3257838423' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T09:11:12.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:12 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/3257838423' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T09:11:13.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:13 smithi082 ceph-mon[32880]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 111 KiB/s, 0 objects/s recovering 2024-03-04T09:11:13.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:13 smithi190 ceph-mon[36341]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 111 KiB/s, 0 objects/s recovering 2024-03-04T09:11:13.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:13 smithi102 ceph-mon[36220]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 111 KiB/s, 0 objects/s recovering 2024-03-04T09:11:15.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:15 smithi082 ceph-mon[32880]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-03-04T09:11:15.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:15 smithi190 ceph-mon[36341]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-03-04T09:11:15.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:15 smithi102 ceph-mon[36220]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-03-04T09:11:17.379 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:17 smithi082 ceph-mon[32880]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-04T09:11:17.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:17 smithi190 ceph-mon[36341]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-04T09:11:17.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:17 smithi102 ceph-mon[36220]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-04T09:11:19.538 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:19 smithi082 ceph-mon[32880]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-03-04T09:11:19.538 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:19 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-03-04T09:11:19.538 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:19 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:11:19.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:19 smithi190 ceph-mon[36341]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-03-04T09:11:19.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:19 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-03-04T09:11:19.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:19 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:11:19.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:19 smithi102 ceph-mon[36220]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-03-04T09:11:19.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:19 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-03-04T09:11:19.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:19 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:11:20.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:20 smithi082 ceph-mon[32880]: Deploying daemon osd.9 on smithi082 2024-03-04T09:11:20.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:20 smithi190 ceph-mon[36341]: Deploying daemon osd.9 on smithi082 2024-03-04T09:11:20.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:20 smithi102 ceph-mon[36220]: Deploying daemon osd.9 on smithi082 2024-03-04T09:11:21.311 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:21 smithi082 ceph-mon[32880]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-04T09:11:21.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:21 smithi190 ceph-mon[36341]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-04T09:11:21.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:21 smithi102 ceph-mon[36220]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-04T09:11:23.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:23 smithi082 ceph-mon[32880]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-03-04T09:11:23.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:23 smithi190 ceph-mon[36341]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-03-04T09:11:23.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:23 smithi102 ceph-mon[36220]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-03-04T09:11:25.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:25 smithi082 ceph-mon[32880]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-03-04T09:11:25.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:25 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:25.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:25 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:25.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:25 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:11:25.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:25 smithi190 ceph-mon[36341]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-03-04T09:11:25.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:25 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:25.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:25 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:25.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:25 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:11:25.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:25 smithi102 ceph-mon[36220]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-03-04T09:11:25.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:25 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:25.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:25 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:25.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:25 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:11:27.562 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:27 smithi082 ceph-mon[32880]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-03-04T09:11:27.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:27 smithi190 ceph-mon[36341]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-03-04T09:11:27.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:27 smithi102 ceph-mon[36220]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-03-04T09:11:28.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:11:28.944+0000 7f5c2a7fc700 1 -- 172.21.15.82:0/3706261082 <== mgr.14152 v2:172.21.15.82:6800/1278635224 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f5c34109d00 con 0x7f5c200a1e10 2024-03-04T09:11:28.942 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 9 on host 'smithi082' 2024-03-04T09:11:28.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:11:28.947+0000 7f5c3b28d700 1 -- 172.21.15.82:0/3706261082 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f5c200a1e10 msgr2=0x7f5c200a42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:11:28.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:11:28.947+0000 7f5c3b28d700 1 --2- 172.21.15.82:0/3706261082 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f5c200a1e10 0x7f5c200a42d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5c30003900 tx=0x7f5c30005fb0 comp rx=0 tx=0).stop 2024-03-04T09:11:28.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:11:28.947+0000 7f5c3b28d700 1 -- 172.21.15.82:0/3706261082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c34101990 msgr2=0x7f5c34198840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:11:28.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:11:28.947+0000 7f5c3b28d700 1 --2- 172.21.15.82:0/3706261082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c34101990 0x7f5c34198840 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5c2400d980 tx=0x7f5c2400dc90 comp rx=0 tx=0).stop 2024-03-04T09:11:28.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:11:28.947+0000 7f5c3b28d700 1 -- 172.21.15.82:0/3706261082 shutdown_connections 2024-03-04T09:11:28.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:11:28.947+0000 7f5c3b28d700 1 --2- 172.21.15.82:0/3706261082 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f5c200a1e10 0x7f5c200a42d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:11:28.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:11:28.947+0000 7f5c3b28d700 1 --2- 172.21.15.82:0/3706261082 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c34102330 0x7f5c3419f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:11:28.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:11:28.947+0000 7f5c3b28d700 1 --2- 172.21.15.82:0/3706261082 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5c34100790 0x7f5c34198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:11:28.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:11:28.947+0000 7f5c3b28d700 1 --2- 172.21.15.82:0/3706261082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c34101990 0x7f5c34198840 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:11:28.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:11:28.947+0000 7f5c3b28d700 1 -- 172.21.15.82:0/3706261082 >> 172.21.15.82:0/3706261082 conn(0x7f5c340fbd50 msgr2=0x7f5c341095f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:11:28.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:11:28.947+0000 7f5c3b28d700 1 -- 172.21.15.82:0/3706261082 shutdown_connections 2024-03-04T09:11:28.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:11:28.947+0000 7f5c3b28d700 1 -- 172.21.15.82:0/3706261082 wait complete. 2024-03-04T09:11:29.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:29 smithi082 ceph-mon[32880]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-03-04T09:11:29.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:29 smithi082 ceph-mon[32880]: from='osd.9 [v2:172.21.15.82:6826/1777272933,v1:172.21.15.82:6827/1777272933]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-03-04T09:11:29.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:29 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:29.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:29 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:29.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:29 smithi190 ceph-mon[36341]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-03-04T09:11:29.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:29 smithi190 ceph-mon[36341]: from='osd.9 [v2:172.21.15.82:6826/1777272933,v1:172.21.15.82:6827/1777272933]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-03-04T09:11:29.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:29 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:29.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:29 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:29.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:29 smithi102 ceph-mon[36220]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-03-04T09:11:29.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:29 smithi102 ceph-mon[36220]: from='osd.9 [v2:172.21.15.82:6826/1777272933,v1:172.21.15.82:6827/1777272933]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-03-04T09:11:29.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:29 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:29.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:29 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:29.718 DEBUG:teuthology.orchestra.run.smithi082:osd.9> sudo journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@osd.9.service 2024-03-04T09:11:29.720 INFO:tasks.cephadm:Deploying osd.10 on smithi102 with /dev/vg_nvme/lv_1... 2024-03-04T09:11:29.720 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-03-04T09:11:29.965 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.b/config 2024-03-04T09:11:30.351 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:30 smithi102 ceph-mon[36220]: from='osd.9 [v2:172.21.15.82:6826/1777272933,v1:172.21.15.82:6827/1777272933]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-03-04T09:11:30.351 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:30 smithi102 ceph-mon[36220]: osdmap e66: 10 total, 9 up, 10 in 2024-03-04T09:11:30.352 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:30 smithi102 ceph-mon[36220]: from='osd.9 [v2:172.21.15.82:6826/1777272933,v1:172.21.15.82:6827/1777272933]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-03-04T09:11:30.352 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:30 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-04T09:11:30.352 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:30 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:30.352 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:30 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:30.352 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:30 smithi102 ceph-mon[36220]: from='osd.9 [v2:172.21.15.82:6826/1777272933,v1:172.21.15.82:6827/1777272933]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-03-04T09:11:30.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:30 smithi082 ceph-mon[32880]: from='osd.9 [v2:172.21.15.82:6826/1777272933,v1:172.21.15.82:6827/1777272933]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-03-04T09:11:30.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:30 smithi082 ceph-mon[32880]: osdmap e66: 10 total, 9 up, 10 in 2024-03-04T09:11:30.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:30 smithi082 ceph-mon[32880]: from='osd.9 [v2:172.21.15.82:6826/1777272933,v1:172.21.15.82:6827/1777272933]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-03-04T09:11:30.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:30 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-04T09:11:30.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:30 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:30.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:30 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:30.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:30 smithi082 ceph-mon[32880]: from='osd.9 [v2:172.21.15.82:6826/1777272933,v1:172.21.15.82:6827/1777272933]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-03-04T09:11:30.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:30 smithi190 ceph-mon[36341]: from='osd.9 [v2:172.21.15.82:6826/1777272933,v1:172.21.15.82:6827/1777272933]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-03-04T09:11:30.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:30 smithi190 ceph-mon[36341]: osdmap e66: 10 total, 9 up, 10 in 2024-03-04T09:11:30.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:30 smithi190 ceph-mon[36341]: from='osd.9 [v2:172.21.15.82:6826/1777272933,v1:172.21.15.82:6827/1777272933]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-03-04T09:11:30.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:30 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-04T09:11:30.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:30 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:30.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:30 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:30.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:30 smithi190 ceph-mon[36341]: from='osd.9 [v2:172.21.15.82:6826/1777272933,v1:172.21.15.82:6827/1777272933]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-03-04T09:11:30.919 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:11:30 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:11:30.826+0000 7fc0e6f7a700 -1 osd.9 0 waiting for initial osdmap 2024-03-04T09:11:30.919 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:11:30 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:11:30.839+0000 7fc0de564700 -1 osd.9 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T09:11:31.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:31 smithi102 ceph-mon[36220]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-03-04T09:11:31.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:31 smithi102 ceph-mon[36220]: osdmap e67: 10 total, 9 up, 10 in 2024-03-04T09:11:31.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:31 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-04T09:11:31.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:31 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-04T09:11:31.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:31 smithi102 ceph-mon[36220]: from='osd.9 [v2:172.21.15.82:6826/1777272933,v1:172.21.15.82:6827/1777272933]' entity='osd.9' 2024-03-04T09:11:31.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:31 smithi082 ceph-mon[32880]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-03-04T09:11:31.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:31 smithi082 ceph-mon[32880]: osdmap e67: 10 total, 9 up, 10 in 2024-03-04T09:11:31.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:31 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-04T09:11:31.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:31 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-04T09:11:31.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:31 smithi082 ceph-mon[32880]: from='osd.9 [v2:172.21.15.82:6826/1777272933,v1:172.21.15.82:6827/1777272933]' entity='osd.9' 2024-03-04T09:11:31.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:31 smithi190 ceph-mon[36341]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-03-04T09:11:31.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:31 smithi190 ceph-mon[36341]: osdmap e67: 10 total, 9 up, 10 in 2024-03-04T09:11:31.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:31 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-04T09:11:31.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:31 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-04T09:11:31.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:31 smithi190 ceph-mon[36341]: from='osd.9 [v2:172.21.15.82:6826/1777272933,v1:172.21.15.82:6827/1777272933]' entity='osd.9' 2024-03-04T09:11:32.021 INFO:teuthology.orchestra.run.smithi102.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-03-04T09:11:32.021 INFO:teuthology.orchestra.run.smithi102.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-03-04T09:11:32.021 INFO:teuthology.orchestra.run.smithi102.stderr: stderr: 10+0 records in 2024-03-04T09:11:32.021 INFO:teuthology.orchestra.run.smithi102.stderr:10+0 records out 2024-03-04T09:11:32.021 INFO:teuthology.orchestra.run.smithi102.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113819 s, 921 MB/s 2024-03-04T09:11:32.021 INFO:teuthology.orchestra.run.smithi102.stderr:--> Zapping successful for: 2024-03-04T09:11:32.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:32 smithi082 ceph-mon[32880]: purged_snaps scrub starts 2024-03-04T09:11:32.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:32 smithi082 ceph-mon[32880]: purged_snaps scrub ok 2024-03-04T09:11:32.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:32 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-04T09:11:32.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:32 smithi082 ceph-mon[32880]: osd.9 [v2:172.21.15.82:6826/1777272933,v1:172.21.15.82:6827/1777272933] boot 2024-03-04T09:11:32.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:32 smithi082 ceph-mon[32880]: osdmap e68: 10 total, 10 up, 10 in 2024-03-04T09:11:32.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:32 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-04T09:11:32.632 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:32 smithi102 ceph-mon[36220]: purged_snaps scrub starts 2024-03-04T09:11:32.632 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:32 smithi102 ceph-mon[36220]: purged_snaps scrub ok 2024-03-04T09:11:32.632 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:32 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-04T09:11:32.633 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:32 smithi102 ceph-mon[36220]: osd.9 [v2:172.21.15.82:6826/1777272933,v1:172.21.15.82:6827/1777272933] boot 2024-03-04T09:11:32.633 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:32 smithi102 ceph-mon[36220]: osdmap e68: 10 total, 10 up, 10 in 2024-03-04T09:11:32.633 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:32 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-04T09:11:32.659 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph orch daemon add osd smithi102:vg_nvme/lv_1 2024-03-04T09:11:32.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:32 smithi190 ceph-mon[36341]: purged_snaps scrub starts 2024-03-04T09:11:32.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:32 smithi190 ceph-mon[36341]: purged_snaps scrub ok 2024-03-04T09:11:32.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:32 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-04T09:11:32.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:32 smithi190 ceph-mon[36341]: osd.9 [v2:172.21.15.82:6826/1777272933,v1:172.21.15.82:6827/1777272933] boot 2024-03-04T09:11:32.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:32 smithi190 ceph-mon[36341]: osdmap e68: 10 total, 10 up, 10 in 2024-03-04T09:11:32.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:32 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-04T09:11:32.909 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.b/config 2024-03-04T09:11:33.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:33 smithi190 ceph-mon[36341]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-03-04T09:11:33.672 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:33 smithi102 ceph-mon[36220]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-03-04T09:11:33.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:33 smithi082 ceph-mon[32880]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-03-04T09:11:34.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:34.476+0000 7f60b5cd4700 1 -- 172.21.15.102:0/378127071 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60b0105520 msgr2=0x7f60b0107910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:11:34.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:34.476+0000 7f60b5cd4700 1 --2- 172.21.15.102:0/378127071 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60b0105520 0x7f60b0107910 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f60a4009990 tx=0x7f60a4009ca0 comp rx=0 tx=0).stop 2024-03-04T09:11:34.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:34.476+0000 7f60b5cd4700 1 -- 172.21.15.102:0/378127071 shutdown_connections 2024-03-04T09:11:34.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:34.476+0000 7f60b5cd4700 1 --2- 172.21.15.102:0/378127071 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f60b0107e50 0x7f60b010a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:11:34.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:34.476+0000 7f60b5cd4700 1 --2- 172.21.15.102:0/378127071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60b0102bf0 0x7f60b0104fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:11:34.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:34.476+0000 7f60b5cd4700 1 --2- 172.21.15.102:0/378127071 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60b0105520 0x7f60b0107910 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:11:34.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:34.476+0000 7f60b5cd4700 1 -- 172.21.15.102:0/378127071 >> 172.21.15.102:0/378127071 conn(0x7f60b00fc620 msgr2=0x7f60b00fea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:11:34.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:34.476+0000 7f60b5cd4700 1 -- 172.21.15.102:0/378127071 shutdown_connections 2024-03-04T09:11:34.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:34.476+0000 7f60b5cd4700 1 -- 172.21.15.102:0/378127071 wait complete. 2024-03-04T09:11:34.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:34.476+0000 7f60b5cd4700 1 Processor -- start 2024-03-04T09:11:34.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:34.477+0000 7f60b5cd4700 1 -- start start 2024-03-04T09:11:34.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:34.477+0000 7f60b5cd4700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60b0102bf0 0x7f60b0198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:11:34.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:34.477+0000 7f60b5cd4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60b0105520 0x7f60b01989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:11:34.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:34.477+0000 7f60b5cd4700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f60b0107e50 0x7f60b019fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:11:34.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:34.477+0000 7f60b5cd4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b010ddb0 con 0x7f60b0105520 2024-03-04T09:11:34.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:34.477+0000 7f60b5cd4700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b010dc30 con 0x7f60b0102bf0 2024-03-04T09:11:34.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:34.477+0000 7f60b5cd4700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b010df30 con 0x7f60b0107e50 2024-03-04T09:11:34.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:34.477+0000 7f60af7fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60b0102bf0 0x7f60b0198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:11:34.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:34.477+0000 7f60af7fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60b0102bf0 0x7f60b0198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33880/0 (socket says 172.21.15.102:33880) 2024-03-04T09:11:34.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:34.477+0000 7f60af7fe700 1 -- 172.21.15.102:0/1723159272 learned_addr learned my addr 172.21.15.102:0/1723159272 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-03-04T09:11:34.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:34.477+0000 7f60aeffd700 1 --2- 172.21.15.102:0/1723159272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60b0105520 0x7f60b01989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:11:34.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:34.477+0000 7f60affff700 1 --2- 172.21.15.102:0/1723159272 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f60b0107e50 0x7f60b019fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:11:34.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:34.477+0000 7f60af7fe700 1 -- 172.21.15.102:0/1723159272 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f60b0107e50 msgr2=0x7f60b019fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:11:34.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:34.477+0000 7f60af7fe700 1 --2- 172.21.15.102:0/1723159272 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f60b0107e50 0x7f60b019fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:11:34.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:34.477+0000 7f60af7fe700 1 -- 172.21.15.102:0/1723159272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60b0105520 msgr2=0x7f60b01989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:11:34.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:34.477+0000 7f60af7fe700 1 --2- 172.21.15.102:0/1723159272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60b0105520 0x7f60b01989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:11:34.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:34.477+0000 7f60af7fe700 1 -- 172.21.15.102:0/1723159272 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b01a00c0 con 0x7f60b0102bf0 2024-03-04T09:11:34.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:34.477+0000 7f60affff700 1 --2- 172.21.15.102:0/1723159272 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f60b0107e50 0x7f60b019fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T09:11:34.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:34.477+0000 7f60aeffd700 1 --2- 172.21.15.102:0/1723159272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60b0105520 0x7f60b01989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T09:11:34.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:34.477+0000 7f60af7fe700 1 --2- 172.21.15.102:0/1723159272 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60b0102bf0 0x7f60b0198460 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f60a000b530 tx=0x7f60a000b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:11:34.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:34.477+0000 7f60acff9700 1 -- 172.21.15.102:0/1723159272 <== mon.2 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a0015020 con 0x7f60b0102bf0 2024-03-04T09:11:34.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:34.477+0000 7f60acff9700 1 -- 172.21.15.102:0/1723159272 <== mon.2 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f60a0011d00 con 0x7f60b0102bf0 2024-03-04T09:11:34.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:34.477+0000 7f60b5cd4700 1 -- 172.21.15.102:0/1723159272 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60b01a03b0 con 0x7f60b0102bf0 2024-03-04T09:11:34.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:34.477+0000 7f60acff9700 1 -- 172.21.15.102:0/1723159272 <== mon.2 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a000f2e0 con 0x7f60b0102bf0 2024-03-04T09:11:34.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:34.477+0000 7f60b5cd4700 1 -- 172.21.15.102:0/1723159272 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60b01a0970 con 0x7f60b0102bf0 2024-03-04T09:11:34.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:34.479+0000 7f60b5cd4700 1 -- 172.21.15.102:0/1723159272 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60b0068d80 con 0x7f60b0102bf0 2024-03-04T09:11:34.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:34.480+0000 7f60acff9700 1 -- 172.21.15.102:0/1723159272 <== mon.2 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f60a0018020 con 0x7f60b0102bf0 2024-03-04T09:11:34.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:34.480+0000 7f60acff9700 1 --2- 172.21.15.102:0/1723159272 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f60980a1e10 0x7f60980a42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:11:34.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:34.480+0000 7f60acff9700 1 -- 172.21.15.102:0/1723159272 <== mon.2 v2:172.21.15.102:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6261+0+0 (secure 0 0 0) 0x7f60a00cd330 con 0x7f60b0102bf0 2024-03-04T09:11:34.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:34.481+0000 7f60aeffd700 1 --2- 172.21.15.102:0/1723159272 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f60980a1e10 0x7f60980a42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:11:34.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:34.481+0000 7f60aeffd700 1 --2- 172.21.15.102:0/1723159272 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f60980a1e10 0x7f60980a42d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f60a400b5c0 tx=0x7f60a4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:11:34.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:34.484+0000 7f60acff9700 1 -- 172.21.15.102:0/1723159272 <== mon.2 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f60a001f020 con 0x7f60b0102bf0 2024-03-04T09:11:34.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:34 smithi190 ceph-mon[36341]: osdmap e69: 10 total, 10 up, 10 in 2024-03-04T09:11:34.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:34 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:34.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:34 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:34.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:34 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:11:34.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:34 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:11:34.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:34 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:11:34.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:34 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:11:34.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:34 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:34.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:34 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:11:34.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:34 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:11:34.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:34 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:34.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:34 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:11:34.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:34 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:11:34.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:34 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:11:34.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:34 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:34.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:34 smithi102 ceph-mon[36220]: osdmap e69: 10 total, 10 up, 10 in 2024-03-04T09:11:34.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:34 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:34.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:34 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:34.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:34 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:11:34.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:34 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:11:34.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:34 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:11:34.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:34 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:11:34.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:34 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:34.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:34 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:11:34.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:34 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:11:34.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:34 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:34.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:34 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:11:34.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:34 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:11:34.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:34 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:11:34.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:34 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:34.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:34.690+0000 7f60b5cd4700 1 -- 172.21.15.102:0/1723159272 --> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f60b0062500 con 0x7f60980a1e10 2024-03-04T09:11:34.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:34 smithi082 ceph-mon[32880]: osdmap e69: 10 total, 10 up, 10 in 2024-03-04T09:11:34.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:34 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:34.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:34 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:34.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:34 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:11:34.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:34 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:11:34.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:34 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:11:34.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:34 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:11:34.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:34 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:34.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:34 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:11:34.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:34 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:11:34.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:34 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:34.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:34 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:11:34.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:34 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:11:34.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:34 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:11:34.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:34 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:35.581 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:35 smithi102 ceph-mon[36220]: Detected new or changed devices on smithi082 2024-03-04T09:11:35.581 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:35 smithi102 ceph-mon[36220]: Adjusting osd_memory_target on smithi082 to 4272M 2024-03-04T09:11:35.581 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:35 smithi102 ceph-mon[36220]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-03-04T09:11:35.581 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:35 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T09:11:35.581 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:35 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T09:11:35.581 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:35 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:11:35.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:35 smithi190 ceph-mon[36341]: Detected new or changed devices on smithi082 2024-03-04T09:11:35.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:35 smithi190 ceph-mon[36341]: Adjusting osd_memory_target on smithi082 to 4272M 2024-03-04T09:11:35.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:35 smithi190 ceph-mon[36341]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-03-04T09:11:35.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:35 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T09:11:35.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:35 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T09:11:35.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:35 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:11:35.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:35 smithi082 ceph-mon[32880]: Detected new or changed devices on smithi082 2024-03-04T09:11:35.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:35 smithi082 ceph-mon[32880]: Adjusting osd_memory_target on smithi082 to 4272M 2024-03-04T09:11:35.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:35 smithi082 ceph-mon[32880]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-03-04T09:11:35.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:35 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T09:11:35.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:35 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T09:11:35.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:35 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:11:36.562 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:36 smithi102 ceph-mon[36220]: from='client.24329 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:11:36.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:36 smithi190 ceph-mon[36341]: from='client.24329 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:11:36.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:36 smithi082 ceph-mon[32880]: from='client.24329 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:11:37.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:37 smithi190 ceph-mon[36341]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-03-04T09:11:37.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:37 smithi102 ceph-mon[36220]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-03-04T09:11:37.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:37 smithi082 ceph-mon[32880]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-03-04T09:11:38.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:38 smithi190 ceph-mon[36341]: from='client.? 172.21.15.102:0/345240366' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "db156ccf-4396-43cb-b69a-bb9095b94b40"}]: dispatch 2024-03-04T09:11:38.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:38 smithi190 ceph-mon[36341]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "db156ccf-4396-43cb-b69a-bb9095b94b40"}]: dispatch 2024-03-04T09:11:38.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:38 smithi190 ceph-mon[36341]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "db156ccf-4396-43cb-b69a-bb9095b94b40"}]': finished 2024-03-04T09:11:38.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:38 smithi190 ceph-mon[36341]: osdmap e70: 11 total, 10 up, 11 in 2024-03-04T09:11:38.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:38 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-04T09:11:38.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:38 smithi190 ceph-mon[36341]: from='client.? 172.21.15.102:0/1947866495' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T09:11:38.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:38 smithi102 ceph-mon[36220]: from='client.? 172.21.15.102:0/345240366' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "db156ccf-4396-43cb-b69a-bb9095b94b40"}]: dispatch 2024-03-04T09:11:38.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:38 smithi102 ceph-mon[36220]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "db156ccf-4396-43cb-b69a-bb9095b94b40"}]: dispatch 2024-03-04T09:11:38.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:38 smithi102 ceph-mon[36220]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "db156ccf-4396-43cb-b69a-bb9095b94b40"}]': finished 2024-03-04T09:11:38.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:38 smithi102 ceph-mon[36220]: osdmap e70: 11 total, 10 up, 11 in 2024-03-04T09:11:38.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:38 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-04T09:11:38.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:38 smithi102 ceph-mon[36220]: from='client.? 172.21.15.102:0/1947866495' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T09:11:38.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:38 smithi082 ceph-mon[32880]: from='client.? 172.21.15.102:0/345240366' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "db156ccf-4396-43cb-b69a-bb9095b94b40"}]: dispatch 2024-03-04T09:11:38.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:38 smithi082 ceph-mon[32880]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "db156ccf-4396-43cb-b69a-bb9095b94b40"}]: dispatch 2024-03-04T09:11:38.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:38 smithi082 ceph-mon[32880]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "db156ccf-4396-43cb-b69a-bb9095b94b40"}]': finished 2024-03-04T09:11:38.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:38 smithi082 ceph-mon[32880]: osdmap e70: 11 total, 10 up, 11 in 2024-03-04T09:11:38.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:38 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-04T09:11:38.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:38 smithi082 ceph-mon[32880]: from='client.? 172.21.15.102:0/1947866495' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T09:11:39.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:39 smithi190 ceph-mon[36341]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-03-04T09:11:39.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:39 smithi102 ceph-mon[36220]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-03-04T09:11:39.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:39 smithi082 ceph-mon[32880]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-03-04T09:11:41.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:41 smithi190 ceph-mon[36341]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-03-04T09:11:41.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:41 smithi102 ceph-mon[36220]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-03-04T09:11:41.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:41 smithi082 ceph-mon[32880]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-03-04T09:11:43.629 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:43 smithi102 ceph-mon[36220]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-03-04T09:11:43.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:43 smithi190 ceph-mon[36341]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-03-04T09:11:43.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:43 smithi082 ceph-mon[32880]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-03-04T09:11:45.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:45 smithi190 ceph-mon[36341]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-03-04T09:11:45.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:45 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-03-04T09:11:45.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:45 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:11:45.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:45 smithi102 ceph-mon[36220]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-03-04T09:11:45.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:45 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-03-04T09:11:45.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:45 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:11:45.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:45 smithi082 ceph-mon[32880]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-03-04T09:11:45.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:45 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-03-04T09:11:45.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:45 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:11:46.530 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:46 smithi102 ceph-mon[36220]: Deploying daemon osd.10 on smithi102 2024-03-04T09:11:46.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:46 smithi190 ceph-mon[36341]: Deploying daemon osd.10 on smithi102 2024-03-04T09:11:46.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:46 smithi082 ceph-mon[32880]: Deploying daemon osd.10 on smithi102 2024-03-04T09:11:47.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:47 smithi190 ceph-mon[36341]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-03-04T09:11:47.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:47 smithi102 ceph-mon[36220]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-03-04T09:11:47.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:47 smithi082 ceph-mon[32880]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-03-04T09:11:48.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:48 smithi102 ceph-mon[36220]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-03-04T09:11:48.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:48 smithi082 ceph-mon[32880]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-03-04T09:11:48.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:48 smithi190 ceph-mon[36341]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-03-04T09:11:51.428 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:51 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:51.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:51 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:51.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:51 smithi102 ceph-mon[36220]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-03-04T09:11:51.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:51 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:11:51.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:51 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:51.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:51 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:51.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:51 smithi082 ceph-mon[32880]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-03-04T09:11:51.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:51 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:11:51.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:51 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:51.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:51 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:51.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:51 smithi190 ceph-mon[36341]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-03-04T09:11:51.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:51 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:11:53.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:53 smithi082 ceph-mon[32880]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-03-04T09:11:53.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:53 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:53.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:53 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:53.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:53 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:11:53.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:53 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:11:53.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:53 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:53.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:53 smithi190 ceph-mon[36341]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-03-04T09:11:53.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:53 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:53.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:53 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:53.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:53 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:11:53.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:53 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:11:53.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:53 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:53.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:53 smithi102 ceph-mon[36220]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-03-04T09:11:53.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:53 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:53.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:53 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:53.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:53 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:11:53.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:53 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:11:53.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:53 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:54.105 INFO:teuthology.orchestra.run.smithi102.stdout:Created osd(s) 10 on host 'smithi102' 2024-03-04T09:11:54.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:54.108+0000 7f60acff9700 1 -- 172.21.15.102:0/1723159272 <== mgr.14152 v2:172.21.15.82:6800/1278635224 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f60b0062500 con 0x7f60980a1e10 2024-03-04T09:11:54.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:54.111+0000 7f60b5cd4700 1 -- 172.21.15.102:0/1723159272 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f60980a1e10 msgr2=0x7f60980a42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:11:54.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:54.111+0000 7f60b5cd4700 1 --2- 172.21.15.102:0/1723159272 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f60980a1e10 0x7f60980a42d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f60a400b5c0 tx=0x7f60a4005fb0 comp rx=0 tx=0).stop 2024-03-04T09:11:54.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:54.111+0000 7f60b5cd4700 1 -- 172.21.15.102:0/1723159272 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60b0102bf0 msgr2=0x7f60b0198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:11:54.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:54.111+0000 7f60b5cd4700 1 --2- 172.21.15.102:0/1723159272 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60b0102bf0 0x7f60b0198460 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f60a000b530 tx=0x7f60a000b8f0 comp rx=0 tx=0).stop 2024-03-04T09:11:54.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:54.111+0000 7f60b5cd4700 1 -- 172.21.15.102:0/1723159272 shutdown_connections 2024-03-04T09:11:54.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:54.111+0000 7f60b5cd4700 1 --2- 172.21.15.102:0/1723159272 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f60980a1e10 0x7f60980a42d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:11:54.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:54.111+0000 7f60b5cd4700 1 --2- 172.21.15.102:0/1723159272 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f60b0107e50 0x7f60b019fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:11:54.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:54.111+0000 7f60b5cd4700 1 --2- 172.21.15.102:0/1723159272 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60b0102bf0 0x7f60b0198460 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:11:54.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:54.111+0000 7f60b5cd4700 1 --2- 172.21.15.102:0/1723159272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60b0105520 0x7f60b01989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:11:54.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:54.111+0000 7f60b5cd4700 1 -- 172.21.15.102:0/1723159272 >> 172.21.15.102:0/1723159272 conn(0x7f60b00fc620 msgr2=0x7f60b01035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:11:54.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:54.111+0000 7f60b5cd4700 1 -- 172.21.15.102:0/1723159272 shutdown_connections 2024-03-04T09:11:54.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-03-04T09:11:54.111+0000 7f60b5cd4700 1 -- 172.21.15.102:0/1723159272 wait complete. 2024-03-04T09:11:54.693 DEBUG:teuthology.orchestra.run.smithi102:osd.10> sudo journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@osd.10.service 2024-03-04T09:11:54.695 INFO:tasks.cephadm:Deploying osd.11 on smithi190 with /dev/vg_nvme/lv_1... 2024-03-04T09:11:54.696 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-03-04T09:11:54.944 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.c/config 2024-03-04T09:11:55.380 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:55 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:55.380 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:55 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:55.380 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:55 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:11:55.380 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:55 smithi190 ceph-mon[36341]: from='osd.10 [v2:172.21.15.102:6824/1012784035,v1:172.21.15.102:6825/1012784035]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-03-04T09:11:55.380 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:55 smithi190 ceph-mon[36341]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-03-04T09:11:55.380 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:55 smithi190 ceph-mon[36341]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-03-04T09:11:55.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:55 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:55.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:55 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:55.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:55 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:11:55.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:55 smithi102 ceph-mon[36220]: from='osd.10 [v2:172.21.15.102:6824/1012784035,v1:172.21.15.102:6825/1012784035]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-03-04T09:11:55.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:55 smithi102 ceph-mon[36220]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-03-04T09:11:55.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:55 smithi102 ceph-mon[36220]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-03-04T09:11:55.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:55 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:55.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:55 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:55.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:55 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:11:55.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:55 smithi082 ceph-mon[32880]: from='osd.10 [v2:172.21.15.102:6824/1012784035,v1:172.21.15.102:6825/1012784035]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-03-04T09:11:55.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:55 smithi082 ceph-mon[32880]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-03-04T09:11:55.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:55 smithi082 ceph-mon[32880]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-03-04T09:11:56.109 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:56 smithi102 ceph-mon[36220]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-03-04T09:11:56.109 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:56 smithi102 ceph-mon[36220]: osdmap e71: 11 total, 10 up, 11 in 2024-03-04T09:11:56.109 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:56 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-04T09:11:56.109 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:56 smithi102 ceph-mon[36220]: from='osd.10 [v2:172.21.15.102:6824/1012784035,v1:172.21.15.102:6825/1012784035]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-03-04T09:11:56.109 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:56 smithi102 ceph-mon[36220]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-03-04T09:11:56.110 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:11:56 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:11:56.098+0000 7f6d3c79c700 -1 osd.10 0 waiting for initial osdmap 2024-03-04T09:11:56.110 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:11:56 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:11:56.112+0000 7f6d3858f700 -1 osd.10 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T09:11:56.358 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:56 smithi190 ceph-mon[36341]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-03-04T09:11:56.358 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:56 smithi190 ceph-mon[36341]: osdmap e71: 11 total, 10 up, 11 in 2024-03-04T09:11:56.358 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:56 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-04T09:11:56.359 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:56 smithi190 ceph-mon[36341]: from='osd.10 [v2:172.21.15.102:6824/1012784035,v1:172.21.15.102:6825/1012784035]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-03-04T09:11:56.359 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:56 smithi190 ceph-mon[36341]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-03-04T09:11:56.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:56 smithi082 ceph-mon[32880]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-03-04T09:11:56.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:56 smithi082 ceph-mon[32880]: osdmap e71: 11 total, 10 up, 11 in 2024-03-04T09:11:56.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:56 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-04T09:11:56.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:56 smithi082 ceph-mon[32880]: from='osd.10 [v2:172.21.15.102:6824/1012784035,v1:172.21.15.102:6825/1012784035]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-03-04T09:11:56.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:56 smithi082 ceph-mon[32880]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-03-04T09:11:56.922 INFO:teuthology.orchestra.run.smithi190.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-03-04T09:11:56.922 INFO:teuthology.orchestra.run.smithi190.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-03-04T09:11:56.922 INFO:teuthology.orchestra.run.smithi190.stderr: stderr: 10+0 records in 2024-03-04T09:11:56.922 INFO:teuthology.orchestra.run.smithi190.stderr:10+0 records out 2024-03-04T09:11:56.922 INFO:teuthology.orchestra.run.smithi190.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0112525 s, 932 MB/s 2024-03-04T09:11:56.922 INFO:teuthology.orchestra.run.smithi190.stderr:--> Zapping successful for: 2024-03-04T09:11:57.273 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:57 smithi102 ceph-mon[36220]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-03-04T09:11:57.273 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:57 smithi102 ceph-mon[36220]: osdmap e72: 11 total, 10 up, 11 in 2024-03-04T09:11:57.273 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:57 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-04T09:11:57.273 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:57 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-04T09:11:57.273 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:57 smithi102 ceph-mon[36220]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-03-04T09:11:57.300 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:57 smithi190 ceph-mon[36341]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-03-04T09:11:57.300 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:57 smithi190 ceph-mon[36341]: osdmap e72: 11 total, 10 up, 11 in 2024-03-04T09:11:57.300 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:57 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-04T09:11:57.300 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:57 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-04T09:11:57.300 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:57 smithi190 ceph-mon[36341]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-03-04T09:11:57.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:57 smithi082 ceph-mon[32880]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-03-04T09:11:57.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:57 smithi082 ceph-mon[32880]: osdmap e72: 11 total, 10 up, 11 in 2024-03-04T09:11:57.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:57 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-04T09:11:57.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:57 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-04T09:11:57.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:57 smithi082 ceph-mon[32880]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-03-04T09:11:57.715 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph orch daemon add osd smithi190:vg_nvme/lv_1 2024-03-04T09:11:57.963 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.c/config 2024-03-04T09:11:58.322 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:58 smithi190 ceph-mon[36341]: purged_snaps scrub starts 2024-03-04T09:11:58.322 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:58 smithi190 ceph-mon[36341]: purged_snaps scrub ok 2024-03-04T09:11:58.322 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:58 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-04T09:11:58.322 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:58 smithi190 ceph-mon[36341]: osd.10 [v2:172.21.15.102:6824/1012784035,v1:172.21.15.102:6825/1012784035] boot 2024-03-04T09:11:58.322 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:58 smithi190 ceph-mon[36341]: osdmap e73: 11 total, 11 up, 11 in 2024-03-04T09:11:58.322 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:58 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-04T09:11:58.322 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:58 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:58.322 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:58 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:58.322 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:58 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:11:58.322 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:58 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:11:58.322 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:58 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:11:58.323 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:58 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:11:58.323 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:58 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:58.323 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:58 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:11:58.323 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:58 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:11:58.323 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:58 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:58.323 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:58 smithi190 ceph-mon[36341]: osdmap e74: 11 total, 11 up, 11 in 2024-03-04T09:11:58.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:58 smithi102 ceph-mon[36220]: purged_snaps scrub starts 2024-03-04T09:11:58.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:58 smithi102 ceph-mon[36220]: purged_snaps scrub ok 2024-03-04T09:11:58.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:58 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-04T09:11:58.430 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:58 smithi102 ceph-mon[36220]: osd.10 [v2:172.21.15.102:6824/1012784035,v1:172.21.15.102:6825/1012784035] boot 2024-03-04T09:11:58.430 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:58 smithi102 ceph-mon[36220]: osdmap e73: 11 total, 11 up, 11 in 2024-03-04T09:11:58.430 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:58 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-04T09:11:58.430 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:58 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:58.430 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:58 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:58.430 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:58 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:11:58.430 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:58 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:11:58.430 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:58 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:11:58.430 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:58 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:11:58.430 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:58 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:58.430 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:58 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:11:58.430 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:58 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:11:58.430 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:58 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:58.430 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:58 smithi102 ceph-mon[36220]: osdmap e74: 11 total, 11 up, 11 in 2024-03-04T09:11:58.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:58 smithi082 ceph-mon[32880]: purged_snaps scrub starts 2024-03-04T09:11:58.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:58 smithi082 ceph-mon[32880]: purged_snaps scrub ok 2024-03-04T09:11:58.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:58 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-04T09:11:58.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:58 smithi082 ceph-mon[32880]: osd.10 [v2:172.21.15.102:6824/1012784035,v1:172.21.15.102:6825/1012784035] boot 2024-03-04T09:11:58.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:58 smithi082 ceph-mon[32880]: osdmap e73: 11 total, 11 up, 11 in 2024-03-04T09:11:58.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:58 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-04T09:11:58.568 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:58 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:58.568 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:58 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:58.568 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:58 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:11:58.568 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:58 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:11:58.568 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:58 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:11:58.568 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:58 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:11:58.568 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:58 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:58.568 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:58 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:11:58.568 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:58 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:11:58.568 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:58 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:11:58.568 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:58 smithi082 ceph-mon[32880]: osdmap e74: 11 total, 11 up, 11 in 2024-03-04T09:11:59.220 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:59 smithi190 ceph-mon[36341]: Detected new or changed devices on smithi102 2024-03-04T09:11:59.220 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:59 smithi190 ceph-mon[36341]: Adjusting osd_memory_target on smithi102 to 4272M 2024-03-04T09:11:59.220 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:59 smithi190 ceph-mon[36341]: pgmap v237: 1 pgs: 1 peering; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-03-04T09:11:59.220 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:11:59 smithi190 ceph-mon[36341]: osdmap e75: 11 total, 11 up, 11 in 2024-03-04T09:11:59.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:59 smithi102 ceph-mon[36220]: Detected new or changed devices on smithi102 2024-03-04T09:11:59.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:59 smithi102 ceph-mon[36220]: Adjusting osd_memory_target on smithi102 to 4272M 2024-03-04T09:11:59.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:59 smithi102 ceph-mon[36220]: pgmap v237: 1 pgs: 1 peering; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-03-04T09:11:59.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:11:59 smithi102 ceph-mon[36220]: osdmap e75: 11 total, 11 up, 11 in 2024-03-04T09:11:59.468 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:59 smithi082 ceph-mon[32880]: Detected new or changed devices on smithi102 2024-03-04T09:11:59.468 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:59 smithi082 ceph-mon[32880]: Adjusting osd_memory_target on smithi102 to 4272M 2024-03-04T09:11:59.468 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:59 smithi082 ceph-mon[32880]: pgmap v237: 1 pgs: 1 peering; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-03-04T09:11:59.468 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:11:59 smithi082 ceph-mon[32880]: osdmap e75: 11 total, 11 up, 11 in 2024-03-04T09:11:59.585 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:11:59.586+0000 7f0f16ec4700 1 -- 172.21.15.190:0/1737415727 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0f101021f0 msgr2=0x7f0f10102650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:11:59.585 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:11:59.586+0000 7f0f16ec4700 1 --2- 172.21.15.190:0/1737415727 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0f101021f0 0x7f0f10102650 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0efc009990 tx=0x7f0efc009ca0 comp rx=0 tx=0).stop 2024-03-04T09:11:59.585 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:11:59.587+0000 7f0f16ec4700 1 -- 172.21.15.190:0/1737415727 shutdown_connections 2024-03-04T09:11:59.585 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:11:59.587+0000 7f0f16ec4700 1 --2- 172.21.15.190:0/1737415727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f10102b90 0x7f0f10109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:11:59.585 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:11:59.587+0000 7f0f16ec4700 1 --2- 172.21.15.190:0/1737415727 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f10100ff0 0x7f0f10101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:11:59.585 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:11:59.587+0000 7f0f16ec4700 1 --2- 172.21.15.190:0/1737415727 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0f101021f0 0x7f0f10102650 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:11:59.585 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:11:59.587+0000 7f0f16ec4700 1 -- 172.21.15.190:0/1737415727 >> 172.21.15.190:0/1737415727 conn(0x7f0f100fc5b0 msgr2=0x7f0f100fe9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:11:59.585 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:11:59.587+0000 7f0f16ec4700 1 -- 172.21.15.190:0/1737415727 shutdown_connections 2024-03-04T09:11:59.586 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:11:59.587+0000 7f0f16ec4700 1 -- 172.21.15.190:0/1737415727 wait complete. 2024-03-04T09:11:59.586 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:11:59.587+0000 7f0f16ec4700 1 Processor -- start 2024-03-04T09:11:59.586 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:11:59.587+0000 7f0f16ec4700 1 -- start start 2024-03-04T09:11:59.586 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:11:59.587+0000 7f0f16ec4700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f10100ff0 0x7f0f10105120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:11:59.586 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:11:59.587+0000 7f0f16ec4700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0f101021f0 0x7f0f10103770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:11:59.586 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:11:59.587+0000 7f0f16ec4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f10102b90 0x7f0f10103cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:11:59.586 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:11:59.587+0000 7f0f16ec4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1010cc40 con 0x7f0f10102b90 2024-03-04T09:11:59.586 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:11:59.587+0000 7f0f16ec4700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1010cac0 con 0x7f0f10100ff0 2024-03-04T09:11:59.586 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:11:59.587+0000 7f0f16ec4700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1010cdc0 con 0x7f0f101021f0 2024-03-04T09:11:59.586 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:11:59.587+0000 7f0f0ffff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0f101021f0 0x7f0f10103770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:11:59.586 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:11:59.587+0000 7f0f0ffff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0f101021f0 0x7f0f10103770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:34516/0 (socket says 172.21.15.190:34516) 2024-03-04T09:11:59.586 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:11:59.587+0000 7f0f0ffff700 1 -- 172.21.15.190:0/693302473 learned_addr learned my addr 172.21.15.190:0/693302473 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-03-04T09:11:59.586 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:11:59.588+0000 7f0f15461700 1 --2- 172.21.15.190:0/693302473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f10102b90 0x7f0f10103cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:11:59.587 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:11:59.588+0000 7f0f14c60700 1 --2- 172.21.15.190:0/693302473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f10100ff0 0x7f0f10105120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:11:59.587 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:11:59.588+0000 7f0f0ffff700 1 -- 172.21.15.190:0/693302473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f10100ff0 msgr2=0x7f0f10105120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:11:59.587 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:11:59.588+0000 7f0f0ffff700 1 --2- 172.21.15.190:0/693302473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f10100ff0 0x7f0f10105120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:11:59.587 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:11:59.588+0000 7f0f0ffff700 1 -- 172.21.15.190:0/693302473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f10102b90 msgr2=0x7f0f10103cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:11:59.587 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:11:59.588+0000 7f0f0ffff700 1 --2- 172.21.15.190:0/693302473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f10102b90 0x7f0f10103cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:11:59.587 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:11:59.588+0000 7f0f0ffff700 1 -- 172.21.15.190:0/693302473 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f10104560 con 0x7f0f101021f0 2024-03-04T09:11:59.587 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:11:59.588+0000 7f0f0ffff700 1 --2- 172.21.15.190:0/693302473 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0f101021f0 0x7f0f10103770 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0efc0098e0 tx=0x7f0efc009510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:11:59.587 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:11:59.588+0000 7f0f0dffb700 1 -- 172.21.15.190:0/693302473 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc027070 con 0x7f0f101021f0 2024-03-04T09:11:59.587 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:11:59.588+0000 7f0f16ec4700 1 -- 172.21.15.190:0/693302473 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f101a24b0 con 0x7f0f101021f0 2024-03-04T09:11:59.587 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:11:59.588+0000 7f0f0dffb700 1 -- 172.21.15.190:0/693302473 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f0efc0041b0 con 0x7f0f101021f0 2024-03-04T09:11:59.587 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:11:59.588+0000 7f0f0dffb700 1 -- 172.21.15.190:0/693302473 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc00f460 con 0x7f0f101021f0 2024-03-04T09:11:59.587 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:11:59.588+0000 7f0f16ec4700 1 -- 172.21.15.190:0/693302473 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f101a28b0 con 0x7f0f101021f0 2024-03-04T09:11:59.588 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:11:59.589+0000 7f0f16ec4700 1 -- 172.21.15.190:0/693302473 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f10068d80 con 0x7f0f101021f0 2024-03-04T09:11:59.588 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:11:59.590+0000 7f0f0dffb700 1 -- 172.21.15.190:0/693302473 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f0efc02a070 con 0x7f0f101021f0 2024-03-04T09:11:59.588 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:11:59.591+0000 7f0f0dffb700 1 --2- 172.21.15.190:0/693302473 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f0f000a1e10 0x7f0f000a42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:11:59.588 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:11:59.591+0000 7f0f0dffb700 1 -- 172.21.15.190:0/693302473 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6723+0+0 (secure 0 0 0) 0x7f0efc0cea10 con 0x7f0f101021f0 2024-03-04T09:11:59.588 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:11:59.591+0000 7f0f14c60700 1 --2- 172.21.15.190:0/693302473 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f0f000a1e10 0x7f0f000a42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:11:59.588 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:11:59.591+0000 7f0f14c60700 1 --2- 172.21.15.190:0/693302473 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f0f000a1e10 0x7f0f000a42d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0f04006fd0 tx=0x7f0f04008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:11:59.590 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:11:59.594+0000 7f0f0dffb700 1 -- 172.21.15.190:0/693302473 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f0efc013070 con 0x7f0f101021f0 2024-03-04T09:11:59.792 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:11:59.796+0000 7f0f16ec4700 1 -- 172.21.15.190:0/693302473 --> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f0f1006af10 con 0x7f0f000a1e10 2024-03-04T09:12:00.392 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:00 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T09:12:00.392 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:00 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T09:12:00.393 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:00 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:12:00.393 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:00 smithi190 ceph-mon[36341]: osdmap e76: 11 total, 11 up, 11 in 2024-03-04T09:12:00.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:00 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T09:12:00.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:00 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T09:12:00.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:00 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:12:00.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:00 smithi102 ceph-mon[36220]: osdmap e76: 11 total, 11 up, 11 in 2024-03-04T09:12:00.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:00 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-04T09:12:00.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:00 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-04T09:12:00.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:00 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:12:00.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:00 smithi082 ceph-mon[32880]: osdmap e76: 11 total, 11 up, 11 in 2024-03-04T09:12:01.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:01 smithi190 ceph-mon[36341]: from='client.24346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:12:01.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:01 smithi190 ceph-mon[36341]: pgmap v240: 1 pgs: 1 peering; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-03-04T09:12:01.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:01 smithi190 ceph-mon[36341]: osdmap e77: 11 total, 11 up, 11 in 2024-03-04T09:12:01.428 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:01 smithi102 ceph-mon[36220]: from='client.24346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:12:01.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:01 smithi102 ceph-mon[36220]: pgmap v240: 1 pgs: 1 peering; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-03-04T09:12:01.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:01 smithi102 ceph-mon[36220]: osdmap e77: 11 total, 11 up, 11 in 2024-03-04T09:12:01.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:01 smithi082 ceph-mon[32880]: from='client.24346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:12:01.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:01 smithi082 ceph-mon[32880]: pgmap v240: 1 pgs: 1 peering; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-03-04T09:12:01.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:01 smithi082 ceph-mon[32880]: osdmap e77: 11 total, 11 up, 11 in 2024-03-04T09:12:03.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:03 smithi082 ceph-mon[32880]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 135 KiB/s, 0 objects/s recovering 2024-03-04T09:12:03.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:03 smithi082 ceph-mon[32880]: from='client.? 172.21.15.190:0/2023195962' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b4d52576-f5b4-479f-8ff6-8fdba4635ca5"}]: dispatch 2024-03-04T09:12:03.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:03 smithi082 ceph-mon[32880]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b4d52576-f5b4-479f-8ff6-8fdba4635ca5"}]: dispatch 2024-03-04T09:12:03.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:03 smithi082 ceph-mon[32880]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b4d52576-f5b4-479f-8ff6-8fdba4635ca5"}]': finished 2024-03-04T09:12:03.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:03 smithi082 ceph-mon[32880]: osdmap e78: 12 total, 11 up, 12 in 2024-03-04T09:12:03.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:03 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-04T09:12:03.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:03 smithi082 ceph-mon[32880]: from='client.? 172.21.15.190:0/371036259' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T09:12:03.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:03 smithi190 ceph-mon[36341]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 135 KiB/s, 0 objects/s recovering 2024-03-04T09:12:03.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:03 smithi190 ceph-mon[36341]: from='client.? 172.21.15.190:0/2023195962' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b4d52576-f5b4-479f-8ff6-8fdba4635ca5"}]: dispatch 2024-03-04T09:12:03.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:03 smithi190 ceph-mon[36341]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b4d52576-f5b4-479f-8ff6-8fdba4635ca5"}]: dispatch 2024-03-04T09:12:03.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:03 smithi190 ceph-mon[36341]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b4d52576-f5b4-479f-8ff6-8fdba4635ca5"}]': finished 2024-03-04T09:12:03.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:03 smithi190 ceph-mon[36341]: osdmap e78: 12 total, 11 up, 12 in 2024-03-04T09:12:03.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:03 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-04T09:12:03.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:03 smithi190 ceph-mon[36341]: from='client.? 172.21.15.190:0/371036259' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T09:12:03.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:03 smithi102 ceph-mon[36220]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 135 KiB/s, 0 objects/s recovering 2024-03-04T09:12:03.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:03 smithi102 ceph-mon[36220]: from='client.? 172.21.15.190:0/2023195962' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b4d52576-f5b4-479f-8ff6-8fdba4635ca5"}]: dispatch 2024-03-04T09:12:03.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:03 smithi102 ceph-mon[36220]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b4d52576-f5b4-479f-8ff6-8fdba4635ca5"}]: dispatch 2024-03-04T09:12:03.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:03 smithi102 ceph-mon[36220]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b4d52576-f5b4-479f-8ff6-8fdba4635ca5"}]': finished 2024-03-04T09:12:03.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:03 smithi102 ceph-mon[36220]: osdmap e78: 12 total, 11 up, 12 in 2024-03-04T09:12:03.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:03 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-04T09:12:03.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:03 smithi102 ceph-mon[36220]: from='client.? 172.21.15.190:0/371036259' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-04T09:12:05.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:05 smithi082 ceph-mon[32880]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-03-04T09:12:05.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:05 smithi190 ceph-mon[36341]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-03-04T09:12:05.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:05 smithi102 ceph-mon[36220]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-03-04T09:12:07.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:07 smithi082 ceph-mon[32880]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-03-04T09:12:07.589 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:07 smithi190 ceph-mon[36341]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-03-04T09:12:07.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:07 smithi102 ceph-mon[36220]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-03-04T09:12:09.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:09 smithi082 ceph-mon[32880]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-04T09:12:09.630 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:09 smithi190 ceph-mon[36341]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-04T09:12:09.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:09 smithi102 ceph-mon[36220]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-04T09:12:10.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:10 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-03-04T09:12:10.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:10 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:12:10.599 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:10 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-03-04T09:12:10.599 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:10 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:12:10.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:10 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-03-04T09:12:10.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:10 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:12:11.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:11 smithi082 ceph-mon[32880]: Deploying daemon osd.11 on smithi190 2024-03-04T09:12:11.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:11 smithi082 ceph-mon[32880]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-03-04T09:12:11.598 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:11 smithi190 ceph-mon[36341]: Deploying daemon osd.11 on smithi190 2024-03-04T09:12:11.598 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:11 smithi190 ceph-mon[36341]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-03-04T09:12:11.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:11 smithi102 ceph-mon[36220]: Deploying daemon osd.11 on smithi190 2024-03-04T09:12:11.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:11 smithi102 ceph-mon[36220]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-03-04T09:12:13.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:13 smithi190 ceph-mon[36341]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-03-04T09:12:13.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:13 smithi082 ceph-mon[32880]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-03-04T09:12:13.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:13 smithi102 ceph-mon[36220]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-03-04T09:12:15.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:15 smithi082 ceph-mon[32880]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-03-04T09:12:15.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:15 smithi190 ceph-mon[36341]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-03-04T09:12:15.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:15 smithi102 ceph-mon[36220]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-03-04T09:12:16.639 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:16 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:16.640 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:16 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:16.640 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:16 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:12:16.640 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:16 smithi190 ceph-mon[36341]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-03-04T09:12:16.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:16 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:16.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:16 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:16.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:16 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:12:16.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:16 smithi082 ceph-mon[32880]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-03-04T09:12:16.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:16 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:16.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:16 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:16.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:16 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:12:16.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:16 smithi102 ceph-mon[36220]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-03-04T09:12:19.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:19 smithi190 ceph-mon[36341]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-03-04T09:12:19.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:19 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:19.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:19 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:19.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:19 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:12:19.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:19 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:12:19.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:19 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:19.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:19 smithi082 ceph-mon[32880]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-03-04T09:12:19.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:19 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:19.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:19 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:19.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:19 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:12:19.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:19 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:12:19.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:19 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:19.607 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:19.610+0000 7f0f0dffb700 1 -- 172.21.15.190:0/693302473 <== mgr.14152 v2:172.21.15.82:6800/1278635224 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f0f1006af10 con 0x7f0f000a1e10 2024-03-04T09:12:19.607 INFO:teuthology.orchestra.run.smithi190.stdout:Created osd(s) 11 on host 'smithi190' 2024-03-04T09:12:19.609 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:19.612+0000 7f0f16ec4700 1 -- 172.21.15.190:0/693302473 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f0f000a1e10 msgr2=0x7f0f000a42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:19.609 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:19.612+0000 7f0f16ec4700 1 --2- 172.21.15.190:0/693302473 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f0f000a1e10 0x7f0f000a42d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0f04006fd0 tx=0x7f0f04008040 comp rx=0 tx=0).stop 2024-03-04T09:12:19.609 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:19.612+0000 7f0f16ec4700 1 -- 172.21.15.190:0/693302473 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0f101021f0 msgr2=0x7f0f10103770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:19.609 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:19.612+0000 7f0f16ec4700 1 --2- 172.21.15.190:0/693302473 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0f101021f0 0x7f0f10103770 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0efc0098e0 tx=0x7f0efc009510 comp rx=0 tx=0).stop 2024-03-04T09:12:19.609 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:19.612+0000 7f0f16ec4700 1 -- 172.21.15.190:0/693302473 shutdown_connections 2024-03-04T09:12:19.609 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:19.612+0000 7f0f16ec4700 1 --2- 172.21.15.190:0/693302473 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f0f000a1e10 0x7f0f000a42d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:19.609 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:19.612+0000 7f0f16ec4700 1 --2- 172.21.15.190:0/693302473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f10102b90 0x7f0f10103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:19.609 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:19.612+0000 7f0f16ec4700 1 --2- 172.21.15.190:0/693302473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f10100ff0 0x7f0f10105120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:19.609 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:19.612+0000 7f0f16ec4700 1 --2- 172.21.15.190:0/693302473 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0f101021f0 0x7f0f10103770 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:19.609 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:19.612+0000 7f0f16ec4700 1 -- 172.21.15.190:0/693302473 >> 172.21.15.190:0/693302473 conn(0x7f0f100fc5b0 msgr2=0x7f0f1006a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:12:19.609 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:19.612+0000 7f0f16ec4700 1 -- 172.21.15.190:0/693302473 shutdown_connections 2024-03-04T09:12:19.610 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:19.612+0000 7f0f16ec4700 1 -- 172.21.15.190:0/693302473 wait complete. 2024-03-04T09:12:19.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:19 smithi102 ceph-mon[36220]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-03-04T09:12:19.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:19 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:19.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:19 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:19.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:19 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:12:19.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:19 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:12:19.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:19 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:20.238 DEBUG:teuthology.orchestra.run.smithi190:osd.11> sudo journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@osd.11.service 2024-03-04T09:12:20.240 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-03-04T09:12:20.240 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph osd stat -f json 2024-03-04T09:12:20.492 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:12:20.552 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:20 smithi190 ceph-mon[36341]: from='osd.11 [v2:172.21.15.190:6824/144700355,v1:172.21.15.190:6825/144700355]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-03-04T09:12:20.552 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:20 smithi190 ceph-mon[36341]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-03-04T09:12:20.552 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:20 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:20.552 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:20 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:12:20.553 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:20 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:20.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:20 smithi082 ceph-mon[32880]: from='osd.11 [v2:172.21.15.190:6824/144700355,v1:172.21.15.190:6825/144700355]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-03-04T09:12:20.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:20 smithi082 ceph-mon[32880]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-03-04T09:12:20.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:20 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:20.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:20 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:12:20.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:20 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:20.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:20 smithi102 ceph-mon[36220]: from='osd.11 [v2:172.21.15.190:6824/144700355,v1:172.21.15.190:6825/144700355]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-03-04T09:12:20.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:20 smithi102 ceph-mon[36220]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-03-04T09:12:20.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:20 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:20.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:20 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:12:20.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:20 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:21.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:21 smithi190 ceph-mon[36341]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-03-04T09:12:21.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:21 smithi190 ceph-mon[36341]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-03-04T09:12:21.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:21 smithi190 ceph-mon[36341]: from='osd.11 [v2:172.21.15.190:6824/144700355,v1:172.21.15.190:6825/144700355]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2024-03-04T09:12:21.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:21 smithi190 ceph-mon[36341]: osdmap e79: 12 total, 11 up, 12 in 2024-03-04T09:12:21.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:21 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-04T09:12:21.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:21 smithi190 ceph-mon[36341]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2024-03-04T09:12:21.421 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:12:21 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:12:21.311+0000 7f24d15b8700 -1 osd.11 0 waiting for initial osdmap 2024-03-04T09:12:21.421 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:12:21 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:12:21.327+0000 7f24cd3ab700 -1 osd.11 80 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T09:12:21.568 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:21 smithi082 ceph-mon[32880]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-03-04T09:12:21.568 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:21 smithi082 ceph-mon[32880]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-03-04T09:12:21.569 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:21 smithi082 ceph-mon[32880]: from='osd.11 [v2:172.21.15.190:6824/144700355,v1:172.21.15.190:6825/144700355]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2024-03-04T09:12:21.569 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:21 smithi082 ceph-mon[32880]: osdmap e79: 12 total, 11 up, 12 in 2024-03-04T09:12:21.569 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:21 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-04T09:12:21.569 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:21 smithi082 ceph-mon[32880]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2024-03-04T09:12:21.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:21 smithi102 ceph-mon[36220]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-03-04T09:12:21.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:21 smithi102 ceph-mon[36220]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-03-04T09:12:21.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:21 smithi102 ceph-mon[36220]: from='osd.11 [v2:172.21.15.190:6824/144700355,v1:172.21.15.190:6825/144700355]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2024-03-04T09:12:21.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:21 smithi102 ceph-mon[36220]: osdmap e79: 12 total, 11 up, 12 in 2024-03-04T09:12:21.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:21 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-04T09:12:21.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:21 smithi102 ceph-mon[36220]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2024-03-04T09:12:22.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:22.181+0000 7fd31a72b700 1 -- 172.21.15.82:0/1547210476 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd314102c00 msgr2=0x7fd3141094b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:22.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:22.181+0000 7fd31a72b700 1 --2- 172.21.15.82:0/1547210476 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd314102c00 0x7fd3141094b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd30c00b0d0 tx=0x7fd30c00b3e0 comp rx=0 tx=0).stop 2024-03-04T09:12:22.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:22.181+0000 7fd31a72b700 1 -- 172.21.15.82:0/1547210476 shutdown_connections 2024-03-04T09:12:22.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:22.181+0000 7fd31a72b700 1 --2- 172.21.15.82:0/1547210476 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd314102c00 0x7fd3141094b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:22.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:22.181+0000 7fd31a72b700 1 --2- 172.21.15.82:0/1547210476 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd314101060 0x7fd314101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:22.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:22.181+0000 7fd31a72b700 1 --2- 172.21.15.82:0/1547210476 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd314102260 0x7fd3141026c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:22.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:22.181+0000 7fd31a72b700 1 -- 172.21.15.82:0/1547210476 >> 172.21.15.82:0/1547210476 conn(0x7fd3140fc620 msgr2=0x7fd3140fea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:12:22.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:22.181+0000 7fd31a72b700 1 -- 172.21.15.82:0/1547210476 shutdown_connections 2024-03-04T09:12:22.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:22.181+0000 7fd31a72b700 1 -- 172.21.15.82:0/1547210476 wait complete. 2024-03-04T09:12:22.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:22.181+0000 7fd31a72b700 1 Processor -- start 2024-03-04T09:12:22.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:22.182+0000 7fd31a72b700 1 -- start start 2024-03-04T09:12:22.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:22.182+0000 7fd31a72b700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd314101060 0x7fd31406b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:22.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:22.182+0000 7fd31a72b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd314102260 0x7fd31419d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:22.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:22.182+0000 7fd31a72b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd314102c00 0x7fd31419f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:22.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:22.182+0000 7fd31a72b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd31410ccc0 con 0x7fd314102c00 2024-03-04T09:12:22.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:22.182+0000 7fd31a72b700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd31410cb40 con 0x7fd314101060 2024-03-04T09:12:22.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:22.182+0000 7fd31a72b700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd31410ce40 con 0x7fd314102260 2024-03-04T09:12:22.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:22.182+0000 7fd318cc8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd314102c00 0x7fd31419f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:22.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:22.182+0000 7fd318cc8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd314102c00 0x7fd31419f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33520/0 (socket says 172.21.15.82:33520) 2024-03-04T09:12:22.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:22.182+0000 7fd318cc8700 1 -- 172.21.15.82:0/3148007893 learned_addr learned my addr 172.21.15.82:0/3148007893 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:12:22.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:22.182+0000 7fd313fff700 1 --2- 172.21.15.82:0/3148007893 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd314101060 0x7fd31406b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:22.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:22.182+0000 7fd3137fe700 1 --2- 172.21.15.82:0/3148007893 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd314102260 0x7fd31419d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:22.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:22.182+0000 7fd318cc8700 1 -- 172.21.15.82:0/3148007893 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd314102260 msgr2=0x7fd31419d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:22.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:22.182+0000 7fd318cc8700 1 --2- 172.21.15.82:0/3148007893 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd314102260 0x7fd31419d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:22.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:22.182+0000 7fd318cc8700 1 -- 172.21.15.82:0/3148007893 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd314101060 msgr2=0x7fd31406b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:22.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:22.182+0000 7fd318cc8700 1 --2- 172.21.15.82:0/3148007893 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd314101060 0x7fd31406b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:22.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:22.182+0000 7fd318cc8700 1 -- 172.21.15.82:0/3148007893 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd31419ff80 con 0x7fd314102c00 2024-03-04T09:12:22.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:22.183+0000 7fd318cc8700 1 --2- 172.21.15.82:0/3148007893 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd314102c00 0x7fd31419f6b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd30c009030 tx=0x7fd30c00bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:12:22.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:22.183+0000 7fd3117fa700 1 -- 172.21.15.82:0/3148007893 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30c021020 con 0x7fd314102c00 2024-03-04T09:12:22.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:22.183+0000 7fd3117fa700 1 -- 172.21.15.82:0/3148007893 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fd30c005510 con 0x7fd314102c00 2024-03-04T09:12:22.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:22.183+0000 7fd31a72b700 1 -- 172.21.15.82:0/3148007893 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3141a0210 con 0x7fd314102c00 2024-03-04T09:12:22.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:22.183+0000 7fd3117fa700 1 -- 172.21.15.82:0/3148007893 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30c01b9f0 con 0x7fd314102c00 2024-03-04T09:12:22.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:22.183+0000 7fd31a72b700 1 -- 172.21.15.82:0/3148007893 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3141a0690 con 0x7fd314102c00 2024-03-04T09:12:22.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:22.184+0000 7fd31a72b700 1 -- 172.21.15.82:0/3148007893 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd31402d9b0 con 0x7fd314102c00 2024-03-04T09:12:22.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:22.185+0000 7fd3117fa700 1 -- 172.21.15.82:0/3148007893 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7fd30c024020 con 0x7fd314102c00 2024-03-04T09:12:22.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:22.186+0000 7fd3117fa700 1 --2- 172.21.15.82:0/3148007893 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fd2fc0a1e10 0x7fd2fc0a42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:22.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:22.186+0000 7fd313fff700 1 --2- 172.21.15.82:0/3148007893 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fd2fc0a1e10 0x7fd2fc0a42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:22.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:22.186+0000 7fd3117fa700 1 -- 172.21.15.82:0/3148007893 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6847+0+0 (secure 0 0 0) 0x7fd30c0cef60 con 0x7fd314102c00 2024-03-04T09:12:22.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:22.186+0000 7fd313fff700 1 --2- 172.21.15.82:0/3148007893 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fd2fc0a1e10 0x7fd2fc0a42d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd3141020c0 tx=0x7fd304009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:12:22.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:22.190+0000 7fd3117fa700 1 -- 172.21.15.82:0/3148007893 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fd30c02b020 con 0x7fd314102c00 2024-03-04T09:12:22.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:22.392+0000 7fd31a72b700 1 -- 172.21.15.82:0/3148007893 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fd31402ddd0 con 0x7fd314102c00 2024-03-04T09:12:22.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:22.392+0000 7fd3117fa700 1 -- 172.21.15.82:0/3148007893 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v81) v1 ==== 74+0+133 (secure 0 0 0) 0x7fd30c011e50 con 0x7fd314102c00 2024-03-04T09:12:22.389 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:12:22.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:22.395+0000 7fd31a72b700 1 -- 172.21.15.82:0/3148007893 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fd2fc0a1e10 msgr2=0x7fd2fc0a42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:22.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:22.395+0000 7fd31a72b700 1 --2- 172.21.15.82:0/3148007893 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fd2fc0a1e10 0x7fd2fc0a42d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd3141020c0 tx=0x7fd304009190 comp rx=0 tx=0).stop 2024-03-04T09:12:22.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:22.395+0000 7fd31a72b700 1 -- 172.21.15.82:0/3148007893 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd314102c00 msgr2=0x7fd31419f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:22.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:22.395+0000 7fd31a72b700 1 --2- 172.21.15.82:0/3148007893 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd314102c00 0x7fd31419f6b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd30c009030 tx=0x7fd30c00bd60 comp rx=0 tx=0).stop 2024-03-04T09:12:22.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:22.395+0000 7fd31a72b700 1 -- 172.21.15.82:0/3148007893 shutdown_connections 2024-03-04T09:12:22.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:22.395+0000 7fd31a72b700 1 --2- 172.21.15.82:0/3148007893 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fd2fc0a1e10 0x7fd2fc0a42d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:22.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:22.395+0000 7fd31a72b700 1 --2- 172.21.15.82:0/3148007893 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd314102c00 0x7fd31419f6b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:22.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:22.395+0000 7fd31a72b700 1 --2- 172.21.15.82:0/3148007893 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd314101060 0x7fd31406b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:22.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:22.395+0000 7fd31a72b700 1 --2- 172.21.15.82:0/3148007893 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd314102260 0x7fd31419d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:22.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:22.395+0000 7fd31a72b700 1 -- 172.21.15.82:0/3148007893 >> 172.21.15.82:0/3148007893 conn(0x7fd3140fc620 msgr2=0x7fd314105560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:12:22.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:22.395+0000 7fd31a72b700 1 -- 172.21.15.82:0/3148007893 shutdown_connections 2024-03-04T09:12:22.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:22.395+0000 7fd31a72b700 1 -- 172.21.15.82:0/3148007893 wait complete. 2024-03-04T09:12:22.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:22 smithi082 ceph-mon[32880]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2024-03-04T09:12:22.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:22 smithi082 ceph-mon[32880]: osdmap e80: 12 total, 11 up, 12 in 2024-03-04T09:12:22.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:22 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-04T09:12:22.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:22 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-04T09:12:22.620 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:22 smithi190 ceph-mon[36341]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2024-03-04T09:12:22.620 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:22 smithi190 ceph-mon[36341]: osdmap e80: 12 total, 11 up, 12 in 2024-03-04T09:12:22.620 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:22 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-04T09:12:22.620 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:22 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-04T09:12:22.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:22 smithi102 ceph-mon[36220]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2024-03-04T09:12:22.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:22 smithi102 ceph-mon[36220]: osdmap e80: 12 total, 11 up, 12 in 2024-03-04T09:12:22.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:22 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-04T09:12:22.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:22 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-04T09:12:23.125 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":81,"num_osds":12,"num_up_osds":12,"osd_up_since":1709543542,"num_in_osds":12,"osd_in_since":1709543522,"num_remapped_pgs":0} 2024-03-04T09:12:23.126 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph osd dump --format=json 2024-03-04T09:12:23.380 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:12:23.503 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:23 smithi082 ceph-mon[32880]: purged_snaps scrub starts 2024-03-04T09:12:23.503 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:23 smithi082 ceph-mon[32880]: purged_snaps scrub ok 2024-03-04T09:12:23.503 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:23 smithi082 ceph-mon[32880]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-03-04T09:12:23.503 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:23 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-04T09:12:23.503 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:23 smithi082 ceph-mon[32880]: osd.11 [v2:172.21.15.190:6824/144700355,v1:172.21.15.190:6825/144700355] boot 2024-03-04T09:12:23.503 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:23 smithi082 ceph-mon[32880]: osdmap e81: 12 total, 12 up, 12 in 2024-03-04T09:12:23.503 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:23 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-04T09:12:23.503 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:23 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/3148007893' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-04T09:12:23.503 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:23 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:23.503 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:23 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:23.504 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:23 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:12:23.504 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:23 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:12:23.504 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:23 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:12:23.504 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:23 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:12:23.580 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:23 smithi102 ceph-mon[36220]: purged_snaps scrub starts 2024-03-04T09:12:23.581 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:23 smithi102 ceph-mon[36220]: purged_snaps scrub ok 2024-03-04T09:12:23.581 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:23 smithi102 ceph-mon[36220]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-03-04T09:12:23.581 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:23 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-04T09:12:23.581 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:23 smithi102 ceph-mon[36220]: osd.11 [v2:172.21.15.190:6824/144700355,v1:172.21.15.190:6825/144700355] boot 2024-03-04T09:12:23.581 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:23 smithi102 ceph-mon[36220]: osdmap e81: 12 total, 12 up, 12 in 2024-03-04T09:12:23.581 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:23 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-04T09:12:23.581 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:23 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/3148007893' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-04T09:12:23.581 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:23 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:23.581 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:23 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:23.581 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:23 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:12:23.581 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:23 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:12:23.581 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:23 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:12:23.582 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:23 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:12:23.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:23 smithi190 ceph-mon[36341]: purged_snaps scrub starts 2024-03-04T09:12:23.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:23 smithi190 ceph-mon[36341]: purged_snaps scrub ok 2024-03-04T09:12:23.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:23 smithi190 ceph-mon[36341]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-03-04T09:12:23.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:23 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-04T09:12:23.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:23 smithi190 ceph-mon[36341]: osd.11 [v2:172.21.15.190:6824/144700355,v1:172.21.15.190:6825/144700355] boot 2024-03-04T09:12:23.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:23 smithi190 ceph-mon[36341]: osdmap e81: 12 total, 12 up, 12 in 2024-03-04T09:12:23.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:23 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-04T09:12:23.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:23 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/3148007893' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-04T09:12:23.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:23 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:23.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:23 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:23.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:23 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:12:23.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:23 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:12:23.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:23 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:12:23.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:23 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:12:24.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:24 smithi082 ceph-mon[32880]: Detected new or changed devices on smithi190 2024-03-04T09:12:24.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:24 smithi082 ceph-mon[32880]: Adjusting osd_memory_target on smithi190 to 4272M 2024-03-04T09:12:24.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:24 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:24.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:24 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:12:24.568 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:24 smithi082 ceph-mon[32880]: osdmap e82: 12 total, 12 up, 12 in 2024-03-04T09:12:24.568 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:24 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:12:24.568 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:24 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:24.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:24 smithi190 ceph-mon[36341]: Detected new or changed devices on smithi190 2024-03-04T09:12:24.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:24 smithi190 ceph-mon[36341]: Adjusting osd_memory_target on smithi190 to 4272M 2024-03-04T09:12:24.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:24 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:24.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:24 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:12:24.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:24 smithi190 ceph-mon[36341]: osdmap e82: 12 total, 12 up, 12 in 2024-03-04T09:12:24.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:24 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:12:24.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:24 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:24.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:24 smithi102 ceph-mon[36220]: Detected new or changed devices on smithi190 2024-03-04T09:12:24.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:24 smithi102 ceph-mon[36220]: Adjusting osd_memory_target on smithi190 to 4272M 2024-03-04T09:12:24.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:24 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:24.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:24 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:12:24.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:24 smithi102 ceph-mon[36220]: osdmap e82: 12 total, 12 up, 12 in 2024-03-04T09:12:24.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:24 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:12:24.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:24 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:25.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:25.156+0000 7f9149bc8700 1 -- 172.21.15.82:0/1441782175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9144102ad0 msgr2=0x7f914410ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:25.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:25.156+0000 7f9149bc8700 1 --2- 172.21.15.82:0/1441782175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9144102ad0 0x7f914410ef10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f913c00b0d0 tx=0x7f913c00b3e0 comp rx=0 tx=0).stop 2024-03-04T09:12:25.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:25.156+0000 7f9149bc8700 1 -- 172.21.15.82:0/1441782175 shutdown_connections 2024-03-04T09:12:25.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:25.156+0000 7f9149bc8700 1 --2- 172.21.15.82:0/1441782175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9144102ad0 0x7f914410ef10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:25.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:25.156+0000 7f9149bc8700 1 --2- 172.21.15.82:0/1441782175 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91441080f0 0x7f91441084d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:25.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:25.156+0000 7f9149bc8700 1 --2- 172.21.15.82:0/1441782175 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9144102110 0x7f9144102590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:25.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:25.156+0000 7f9149bc8700 1 -- 172.21.15.82:0/1441782175 >> 172.21.15.82:0/1441782175 conn(0x7f91440791f0 msgr2=0x7f9144079600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:12:25.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:25.156+0000 7f9149bc8700 1 -- 172.21.15.82:0/1441782175 shutdown_connections 2024-03-04T09:12:25.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:25.156+0000 7f9149bc8700 1 -- 172.21.15.82:0/1441782175 wait complete. 2024-03-04T09:12:25.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:25.157+0000 7f9149bc8700 1 Processor -- start 2024-03-04T09:12:25.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:25.157+0000 7f9149bc8700 1 -- start start 2024-03-04T09:12:25.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:25.157+0000 7f9149bc8700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9144102110 0x7f914419e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:25.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:25.157+0000 7f9149bc8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9144102ad0 0x7f914419e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:25.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:25.157+0000 7f9149bc8700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91441080f0 0x7f9144198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:25.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:25.157+0000 7f9149bc8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9144112380 con 0x7f9144102ad0 2024-03-04T09:12:25.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:25.157+0000 7f9149bc8700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9144112200 con 0x7f91441080f0 2024-03-04T09:12:25.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:25.157+0000 7f9149bc8700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9144112500 con 0x7f9144102110 2024-03-04T09:12:25.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:25.158+0000 7f9142ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9144102ad0 0x7f914419e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:25.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:25.158+0000 7f9142ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9144102ad0 0x7f914419e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33542/0 (socket says 172.21.15.82:33542) 2024-03-04T09:12:25.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:25.158+0000 7f9142ffd700 1 -- 172.21.15.82:0/715864000 learned_addr learned my addr 172.21.15.82:0/715864000 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:12:25.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:25.158+0000 7f91437fe700 1 --2- 172.21.15.82:0/715864000 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9144102110 0x7f914419e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:25.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:25.158+0000 7f9143fff700 1 --2- 172.21.15.82:0/715864000 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91441080f0 0x7f9144198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:25.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:25.158+0000 7f9142ffd700 1 -- 172.21.15.82:0/715864000 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9144102110 msgr2=0x7f914419e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:25.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:25.158+0000 7f9142ffd700 1 --2- 172.21.15.82:0/715864000 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9144102110 0x7f914419e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:25.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:25.158+0000 7f9142ffd700 1 -- 172.21.15.82:0/715864000 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91441080f0 msgr2=0x7f9144198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:25.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:25.158+0000 7f9142ffd700 1 --2- 172.21.15.82:0/715864000 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91441080f0 0x7f9144198600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:25.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:25.158+0000 7f9142ffd700 1 -- 172.21.15.82:0/715864000 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9144198d60 con 0x7f9144102ad0 2024-03-04T09:12:25.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:25.158+0000 7f9142ffd700 1 --2- 172.21.15.82:0/715864000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9144102ad0 0x7f914419e930 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f913400d950 tx=0x7f913400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:12:25.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:25.158+0000 7f9140ff9700 1 -- 172.21.15.82:0/715864000 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9134016070 con 0x7f9144102ad0 2024-03-04T09:12:25.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:25.158+0000 7f9149bc8700 1 -- 172.21.15.82:0/715864000 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9144199050 con 0x7f9144102ad0 2024-03-04T09:12:25.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:25.158+0000 7f9140ff9700 1 -- 172.21.15.82:0/715864000 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f9134009e10 con 0x7f9144102ad0 2024-03-04T09:12:25.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:25.158+0000 7f9140ff9700 1 -- 172.21.15.82:0/715864000 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913400f620 con 0x7f9144102ad0 2024-03-04T09:12:25.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:25.158+0000 7f9149bc8700 1 -- 172.21.15.82:0/715864000 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91441a52c0 con 0x7f9144102ad0 2024-03-04T09:12:25.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:25.159+0000 7f9149bc8700 1 -- 172.21.15.82:0/715864000 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9144068d80 con 0x7f9144102ad0 2024-03-04T09:12:25.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:25.161+0000 7f9140ff9700 1 -- 172.21.15.82:0/715864000 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f9134019070 con 0x7f9144102ad0 2024-03-04T09:12:25.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:25.161+0000 7f9140ff9700 1 --2- 172.21.15.82:0/715864000 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f912c0a1e10 0x7f912c0a42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:25.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:25.161+0000 7f91437fe700 1 --2- 172.21.15.82:0/715864000 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f912c0a1e10 0x7f912c0a42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:25.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:25.161+0000 7f9140ff9700 1 -- 172.21.15.82:0/715864000 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f91340cd520 con 0x7f9144102ad0 2024-03-04T09:12:25.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:25.162+0000 7f91437fe700 1 --2- 172.21.15.82:0/715864000 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f912c0a1e10 0x7f912c0a42d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9138004630 tx=0x7f913800b3c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:12:25.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:25.165+0000 7f9140ff9700 1 -- 172.21.15.82:0/715864000 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f913409adf0 con 0x7f9144102ad0 2024-03-04T09:12:25.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:25.362+0000 7f9149bc8700 1 -- 172.21.15.82:0/715864000 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f914402d9b0 con 0x7f9144102ad0 2024-03-04T09:12:25.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:25.363+0000 7f9140ff9700 1 -- 172.21.15.82:0/715864000 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+18420 (secure 0 0 0) 0x7f913409a6f0 con 0x7f9144102ad0 2024-03-04T09:12:25.360 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:12:25.360 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":82,"fsid":"2e533fc8-da06-11ee-95c6-87774f69a715","created":"2024-03-04T09:05:16.488249+0000","modified":"2024-03-04T09:12:23.316714+0000","last_up_change":"2024-03-04T09:12:22.308711+0000","last_in_change":"2024-03-04T09:12:02.548212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T09:08:36.508257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"085b5c4b-ede9-4d0d-b994-50c89d991012","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6803","nonce":709655235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6805","nonce":709655235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6809","nonce":709655235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6807","nonce":709655235}]},"public_addr":"172.21.15.82:6803/709655235","cluster_addr":"172.21.15.82:6805/709655235","heartbeat_back_addr":"172.21.15.82:6809/709655235","heartbeat_front_addr":"172.21.15.82:6807/709655235","state":["exists","up"]},{"osd":1,"uuid":"e4dd7079-333e-4bcf-b3af-11fb082a5af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6801","nonce":270721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6803","nonce":270721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6807","nonce":270721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6805","nonce":270721212}]},"public_addr":"172.21.15.102:6801/270721212","cluster_addr":"172.21.15.102:6803/270721212","heartbeat_back_addr":"172.21.15.102:6807/270721212","heartbeat_front_addr":"172.21.15.102:6805/270721212","state":["exists","up"]},{"osd":2,"uuid":"6fed5fd6-dc82-497f-9d69-c10a5e5802da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6801","nonce":946410459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6803","nonce":946410459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6807","nonce":946410459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6805","nonce":946410459}]},"public_addr":"172.21.15.190:6801/946410459","cluster_addr":"172.21.15.190:6803/946410459","heartbeat_back_addr":"172.21.15.190:6807/946410459","heartbeat_front_addr":"172.21.15.190:6805/946410459","state":["exists","up"]},{"osd":3,"uuid":"91ccbdc3-3da6-4d39-8a89-3a7b7bb4adc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6811","nonce":980870924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6813","nonce":980870924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6817","nonce":980870924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6815","nonce":980870924}]},"public_addr":"172.21.15.82:6811/980870924","cluster_addr":"172.21.15.82:6813/980870924","heartbeat_back_addr":"172.21.15.82:6817/980870924","heartbeat_front_addr":"172.21.15.82:6815/980870924","state":["exists","up"]},{"osd":4,"uuid":"dbb9d486-5daa-4819-bbed-04fc76ca473e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6809","nonce":1229627753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6811","nonce":1229627753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6815","nonce":1229627753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6813","nonce":1229627753}]},"public_addr":"172.21.15.102:6809/1229627753","cluster_addr":"172.21.15.102:6811/1229627753","heartbeat_back_addr":"172.21.15.102:6815/1229627753","heartbeat_front_addr":"172.21.15.102:6813/1229627753","state":["exists","up"]},{"osd":5,"uuid":"6b50127b-df2b-4c95-8e53-9d42b40273fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6809","nonce":2171194148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6811","nonce":2171194148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6815","nonce":2171194148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6813","nonce":2171194148}]},"public_addr":"172.21.15.190:6809/2171194148","cluster_addr":"172.21.15.190:6811/2171194148","heartbeat_back_addr":"172.21.15.190:6815/2171194148","heartbeat_front_addr":"172.21.15.190:6813/2171194148","state":["exists","up"]},{"osd":6,"uuid":"e72bebb0-5939-4210-950a-41c25c23c62f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6819","nonce":454436959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6821","nonce":454436959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6825","nonce":454436959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6823","nonce":454436959}]},"public_addr":"172.21.15.82:6819/454436959","cluster_addr":"172.21.15.82:6821/454436959","heartbeat_back_addr":"172.21.15.82:6825/454436959","heartbeat_front_addr":"172.21.15.82:6823/454436959","state":["exists","up"]},{"osd":7,"uuid":"72f83f97-f496-4503-8284-6a7b8f99a6f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6817","nonce":2745057274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6819","nonce":2745057274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6823","nonce":2745057274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6821","nonce":2745057274}]},"public_addr":"172.21.15.102:6817/2745057274","cluster_addr":"172.21.15.102:6819/2745057274","heartbeat_back_addr":"172.21.15.102:6823/2745057274","heartbeat_front_addr":"172.21.15.102:6821/2745057274","state":["exists","up"]},{"osd":8,"uuid":"92c9109d-6ebb-4c50-9944-28cd7b2f9c0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6817","nonce":1679683516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6819","nonce":1679683516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6823","nonce":1679683516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6821","nonce":1679683516}]},"public_addr":"172.21.15.190:6817/1679683516","cluster_addr":"172.21.15.190:6819/1679683516","heartbeat_back_addr":"172.21.15.190:6823/1679683516","heartbeat_front_addr":"172.21.15.190:6821/1679683516","state":["exists","up"]},{"osd":9,"uuid":"a3cfce03-0148-475d-bf55-b8284ae1cad2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6827","nonce":1777272933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6829","nonce":1777272933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6833","nonce":1777272933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6831","nonce":1777272933}]},"public_addr":"172.21.15.82:6827/1777272933","cluster_addr":"172.21.15.82:6829/1777272933","heartbeat_back_addr":"172.21.15.82:6833/1777272933","heartbeat_front_addr":"172.21.15.82:6831/1777272933","state":["exists","up"]},{"osd":10,"uuid":"db156ccf-4396-43cb-b69a-bb9095b94b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6825","nonce":1012784035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6827","nonce":1012784035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6831","nonce":1012784035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6829","nonce":1012784035}]},"public_addr":"172.21.15.102:6825/1012784035","cluster_addr":"172.21.15.102:6827/1012784035","heartbeat_back_addr":"172.21.15.102:6831/1012784035","heartbeat_front_addr":"172.21.15.102:6829/1012784035","state":["exists","up"]},{"osd":11,"uuid":"b4d52576-f5b4-479f-8ff6-8fdba4635ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6825","nonce":144700355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6827","nonce":144700355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6831","nonce":144700355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6829","nonce":144700355}]},"public_addr":"172.21.15.190:6825/144700355","cluster_addr":"172.21.15.190:6827/144700355","heartbeat_back_addr":"172.21.15.190:6831/144700355","heartbeat_front_addr":"172.21.15.190:6829/144700355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:07:47.007772+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:09.944738+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:33.183567+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:58.302023+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:09:23.042488+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:09:47.616009+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:10:13.122887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:10:38.584530+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:03.473453+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:29.847105+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:55.152195+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:12:20.401765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6800/1901539016":"2024-03-05T09:06:12.169231+0000","172.21.15.82:0/1124105204":"2024-03-05T09:06:12.169231+0000","172.21.15.82:6801/1901539016":"2024-03-05T09:06:12.169231+0000","172.21.15.82:0/735262841":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/2402774828":"2024-03-05T09:05:44.913099+0000","172.21.15.82:6801/3291527077":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/1846720385":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/3757201752":"2024-03-05T09:06:12.169231+0000","172.21.15.82:6800/3291527077":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/984630078":"2024-03-05T09:06:12.169231+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T09:12:25.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:25.365+0000 7f9149bc8700 1 -- 172.21.15.82:0/715864000 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f912c0a1e10 msgr2=0x7f912c0a42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:25.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:25.365+0000 7f9149bc8700 1 --2- 172.21.15.82:0/715864000 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f912c0a1e10 0x7f912c0a42d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9138004630 tx=0x7f913800b3c0 comp rx=0 tx=0).stop 2024-03-04T09:12:25.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:25.365+0000 7f9149bc8700 1 -- 172.21.15.82:0/715864000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9144102ad0 msgr2=0x7f914419e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:25.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:25.365+0000 7f9149bc8700 1 --2- 172.21.15.82:0/715864000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9144102ad0 0x7f914419e930 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f913400d950 tx=0x7f913400dc60 comp rx=0 tx=0).stop 2024-03-04T09:12:25.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:25.365+0000 7f9149bc8700 1 -- 172.21.15.82:0/715864000 shutdown_connections 2024-03-04T09:12:25.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:25.365+0000 7f9149bc8700 1 --2- 172.21.15.82:0/715864000 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f912c0a1e10 0x7f912c0a42d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:25.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:25.365+0000 7f9149bc8700 1 --2- 172.21.15.82:0/715864000 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91441080f0 0x7f9144198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:25.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:25.365+0000 7f9149bc8700 1 --2- 172.21.15.82:0/715864000 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9144102110 0x7f914419e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:25.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:25.365+0000 7f9149bc8700 1 --2- 172.21.15.82:0/715864000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9144102ad0 0x7f914419e930 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:25.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:25.365+0000 7f9149bc8700 1 -- 172.21.15.82:0/715864000 >> 172.21.15.82:0/715864000 conn(0x7f91440791f0 msgr2=0x7f9144100d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:12:25.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:25.365+0000 7f9149bc8700 1 -- 172.21.15.82:0/715864000 shutdown_connections 2024-03-04T09:12:25.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:25.365+0000 7f9149bc8700 1 -- 172.21.15.82:0/715864000 wait complete. 2024-03-04T09:12:25.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:25 smithi082 ceph-mon[32880]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:12:25.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:25 smithi190 ceph-mon[36341]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:12:25.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:25 smithi102 ceph-mon[36220]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:12:26.110 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T09:08:36.508257+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-04T09:12:26.111 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph osd pool get .mgr pg_num 2024-03-04T09:12:26.348 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:12:26.469 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:26 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/715864000' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:12:26.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:26 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/715864000' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:12:26.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:26 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/715864000' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:12:27.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:27 smithi190 ceph-mon[36341]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:12:27.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:27 smithi102 ceph-mon[36220]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:12:27.756 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:27 smithi082 ceph-mon[32880]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:12:28.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:28.125+0000 7f5b70e54700 1 -- 172.21.15.82:0/3469070175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b6c101250 msgr2=0x7f5b6c101630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:28.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:28.125+0000 7f5b70e54700 1 --2- 172.21.15.82:0/3469070175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b6c101250 0x7f5b6c101630 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c0099c0 tx=0x7f5b5c009cd0 comp rx=0 tx=0).stop 2024-03-04T09:12:28.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:28.125+0000 7f5b70e54700 1 -- 172.21.15.82:0/3469070175 shutdown_connections 2024-03-04T09:12:28.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:28.125+0000 7f5b70e54700 1 --2- 172.21.15.82:0/3469070175 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b6c1062a0 0x7f5b6c10de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:28.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:28.125+0000 7f5b70e54700 1 --2- 172.21.15.82:0/3469070175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b6c101250 0x7f5b6c101630 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:28.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:28.125+0000 7f5b70e54700 1 --2- 172.21.15.82:0/3469070175 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5b6c101c00 0x7f5b6c105bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:28.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:28.125+0000 7f5b70e54700 1 -- 172.21.15.82:0/3469070175 >> 172.21.15.82:0/3469070175 conn(0x7f5b6c077010 msgr2=0x7f5b6c077420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:12:28.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:28.125+0000 7f5b70e54700 1 -- 172.21.15.82:0/3469070175 shutdown_connections 2024-03-04T09:12:28.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:28.125+0000 7f5b70e54700 1 -- 172.21.15.82:0/3469070175 wait complete. 2024-03-04T09:12:28.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:28.126+0000 7f5b70e54700 1 Processor -- start 2024-03-04T09:12:28.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:28.126+0000 7f5b70e54700 1 -- start start 2024-03-04T09:12:28.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:28.126+0000 7f5b70e54700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b6c101250 0x7f5b6c197750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:28.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:28.126+0000 7f5b70e54700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b6c101c00 0x7f5b6c197c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:28.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:28.126+0000 7f5b70e54700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5b6c1062a0 0x7f5b6c19c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:28.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:28.126+0000 7f5b70e54700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6c111220 con 0x7f5b6c101c00 2024-03-04T09:12:28.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:28.126+0000 7f5b70e54700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6c1110a0 con 0x7f5b6c101250 2024-03-04T09:12:28.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:28.126+0000 7f5b70e54700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6c1113a0 con 0x7f5b6c1062a0 2024-03-04T09:12:28.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:28.126+0000 7f5b61d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b6c101c00 0x7f5b6c197c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:28.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:28.126+0000 7f5b61d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b6c101c00 0x7f5b6c197c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58356/0 (socket says 172.21.15.82:58356) 2024-03-04T09:12:28.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:28.126+0000 7f5b61d9b700 1 -- 172.21.15.82:0/1044760343 learned_addr learned my addr 172.21.15.82:0/1044760343 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:12:28.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:28.127+0000 7f5b6a59c700 1 --2- 172.21.15.82:0/1044760343 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b6c101250 0x7f5b6c197750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:28.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:28.127+0000 7f5b61d9b700 1 -- 172.21.15.82:0/1044760343 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5b6c1062a0 msgr2=0x7f5b6c19c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:28.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:28.127+0000 7f5b61d9b700 1 --2- 172.21.15.82:0/1044760343 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5b6c1062a0 0x7f5b6c19c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:28.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:28.127+0000 7f5b61d9b700 1 -- 172.21.15.82:0/1044760343 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b6c101250 msgr2=0x7f5b6c197750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:28.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:28.127+0000 7f5b61d9b700 1 --2- 172.21.15.82:0/1044760343 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b6c101250 0x7f5b6c197750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:28.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:28.127+0000 7f5b61d9b700 1 -- 172.21.15.82:0/1044760343 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b6c19c760 con 0x7f5b6c101c00 2024-03-04T09:12:28.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:28.127+0000 7f5b61d9b700 1 --2- 172.21.15.82:0/1044760343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b6c101c00 0x7f5b6c197c90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5b54007b50 tx=0x7f5b54007e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:12:28.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:28.127+0000 7f5b63fff700 1 -- 172.21.15.82:0/1044760343 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5400e500 con 0x7f5b6c101c00 2024-03-04T09:12:28.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:28.127+0000 7f5b63fff700 1 -- 172.21.15.82:0/1044760343 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f5b5400eb70 con 0x7f5b6c101c00 2024-03-04T09:12:28.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:28.127+0000 7f5b70e54700 1 -- 172.21.15.82:0/1044760343 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b6c19ca50 con 0x7f5b6c101c00 2024-03-04T09:12:28.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:28.127+0000 7f5b63fff700 1 -- 172.21.15.82:0/1044760343 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5400ab20 con 0x7f5b6c101c00 2024-03-04T09:12:28.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:28.127+0000 7f5b70e54700 1 -- 172.21.15.82:0/1044760343 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b6c06a600 con 0x7f5b6c101c00 2024-03-04T09:12:28.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:28.128+0000 7f5b70e54700 1 -- 172.21.15.82:0/1044760343 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b6c068d80 con 0x7f5b6c101c00 2024-03-04T09:12:28.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:28.129+0000 7f5b63fff700 1 -- 172.21.15.82:0/1044760343 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f5b5400e6a0 con 0x7f5b6c101c00 2024-03-04T09:12:28.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:28.129+0000 7f5b63fff700 1 --2- 172.21.15.82:0/1044760343 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f5b580a1e10 0x7f5b580a42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:28.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:28.130+0000 7f5b6a59c700 1 --2- 172.21.15.82:0/1044760343 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f5b580a1e10 0x7f5b580a42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:28.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:28.130+0000 7f5b63fff700 1 -- 172.21.15.82:0/1044760343 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f5b540ceff0 con 0x7f5b6c101c00 2024-03-04T09:12:28.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:28.130+0000 7f5b6a59c700 1 --2- 172.21.15.82:0/1044760343 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f5b580a1e10 0x7f5b580a42d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c009fd0 tx=0x7f5b5c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:12:28.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:28.134+0000 7f5b63fff700 1 -- 172.21.15.82:0/1044760343 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f5b5400e990 con 0x7f5b6c101c00 2024-03-04T09:12:28.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:28.329+0000 7f5b70e54700 1 -- 172.21.15.82:0/1044760343 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5b6c06b0f0 con 0x7f5b6c101c00 2024-03-04T09:12:28.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:28.329+0000 7f5b63fff700 1 -- 172.21.15.82:0/1044760343 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5b5409c8c0 con 0x7f5b6c101c00 2024-03-04T09:12:28.326 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-03-04T09:12:28.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:28.332+0000 7f5b70e54700 1 -- 172.21.15.82:0/1044760343 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f5b580a1e10 msgr2=0x7f5b580a42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:28.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:28.332+0000 7f5b70e54700 1 --2- 172.21.15.82:0/1044760343 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f5b580a1e10 0x7f5b580a42d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c009fd0 tx=0x7f5b5c005fb0 comp rx=0 tx=0).stop 2024-03-04T09:12:28.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:28.332+0000 7f5b70e54700 1 -- 172.21.15.82:0/1044760343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b6c101c00 msgr2=0x7f5b6c197c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:28.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:28.332+0000 7f5b70e54700 1 --2- 172.21.15.82:0/1044760343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b6c101c00 0x7f5b6c197c90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5b54007b50 tx=0x7f5b54007e60 comp rx=0 tx=0).stop 2024-03-04T09:12:28.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:28.332+0000 7f5b70e54700 1 -- 172.21.15.82:0/1044760343 shutdown_connections 2024-03-04T09:12:28.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:28.332+0000 7f5b70e54700 1 --2- 172.21.15.82:0/1044760343 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f5b580a1e10 0x7f5b580a42d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:28.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:28.332+0000 7f5b70e54700 1 --2- 172.21.15.82:0/1044760343 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5b6c1062a0 0x7f5b6c19c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:28.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:28.332+0000 7f5b70e54700 1 --2- 172.21.15.82:0/1044760343 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b6c101250 0x7f5b6c197750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:28.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:28.332+0000 7f5b70e54700 1 --2- 172.21.15.82:0/1044760343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b6c101c00 0x7f5b6c197c90 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:28.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:28.332+0000 7f5b70e54700 1 -- 172.21.15.82:0/1044760343 >> 172.21.15.82:0/1044760343 conn(0x7f5b6c077010 msgr2=0x7f5b6c104f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:12:28.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:28.332+0000 7f5b70e54700 1 -- 172.21.15.82:0/1044760343 shutdown_connections 2024-03-04T09:12:28.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:28.332+0000 7f5b70e54700 1 -- 172.21.15.82:0/1044760343 wait complete. 2024-03-04T09:12:28.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:28 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/1044760343' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-04T09:12:28.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:28 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/1044760343' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-04T09:12:28.680 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:28 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/1044760343' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-04T09:12:29.010 INFO:tasks.cephadm:Adding mds.a on smithi082 2024-03-04T09:12:29.010 INFO:tasks.cephadm:Adding mds.d on smithi082 2024-03-04T09:12:29.010 INFO:tasks.cephadm:Adding mds.g on smithi082 2024-03-04T09:12:29.010 INFO:tasks.cephadm:Adding mds.j on smithi082 2024-03-04T09:12:29.010 INFO:tasks.cephadm:Adding mds.b on smithi102 2024-03-04T09:12:29.010 INFO:tasks.cephadm:Adding mds.e on smithi102 2024-03-04T09:12:29.010 INFO:tasks.cephadm:Adding mds.h on smithi102 2024-03-04T09:12:29.010 INFO:tasks.cephadm:Adding mds.k on smithi102 2024-03-04T09:12:29.010 INFO:tasks.cephadm:Adding mds.c on smithi190 2024-03-04T09:12:29.010 INFO:tasks.cephadm:Adding mds.f on smithi190 2024-03-04T09:12:29.010 INFO:tasks.cephadm:Adding mds.i on smithi190 2024-03-04T09:12:29.010 INFO:tasks.cephadm:Adding mds.l on smithi190 2024-03-04T09:12:29.011 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph orch apply mds all '12;smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi102=b;smithi102=e;smithi102=h;smithi102=k;smithi190=c;smithi190=f;smithi190=i;smithi190=l' 2024-03-04T09:12:29.259 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.c/config 2024-03-04T09:12:29.632 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:29 smithi190 ceph-mon[36341]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:12:29.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:29 smithi102 ceph-mon[36220]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:12:29.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:29 smithi082 ceph-mon[32880]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:12:30.928 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:30.931+0000 7f473ba6a700 1 -- 172.21.15.190:0/3153549531 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47341007c0 msgr2=0x7f4734100be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:30.928 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:30.931+0000 7f473ba6a700 1 --2- 172.21.15.190:0/3153549531 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47341007c0 0x7f4734100be0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4730009990 tx=0x7f4730009ca0 comp rx=0 tx=0).stop 2024-03-04T09:12:30.928 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:30.932+0000 7f473ba6a700 1 -- 172.21.15.190:0/3153549531 shutdown_connections 2024-03-04T09:12:30.928 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:30.932+0000 7f473ba6a700 1 --2- 172.21.15.190:0/3153549531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4734102360 0x7f4734108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:30.928 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:30.932+0000 7f473ba6a700 1 --2- 172.21.15.190:0/3153549531 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47341007c0 0x7f4734100be0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:30.929 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:30.932+0000 7f473ba6a700 1 --2- 172.21.15.190:0/3153549531 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f47341019c0 0x7f4734101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:30.929 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:30.932+0000 7f473ba6a700 1 -- 172.21.15.190:0/3153549531 >> 172.21.15.190:0/3153549531 conn(0x7f47340fbd60 msgr2=0x7f47340fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:12:30.929 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:30.932+0000 7f473ba6a700 1 -- 172.21.15.190:0/3153549531 shutdown_connections 2024-03-04T09:12:30.929 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:30.932+0000 7f473ba6a700 1 -- 172.21.15.190:0/3153549531 wait complete. 2024-03-04T09:12:30.931 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:30.932+0000 7f473ba6a700 1 Processor -- start 2024-03-04T09:12:30.931 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:30.932+0000 7f473ba6a700 1 -- start start 2024-03-04T09:12:30.931 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:30.932+0000 7f473ba6a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47341007c0 0x7f4734198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:30.931 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:30.932+0000 7f473ba6a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47341019c0 0x7f47341988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:30.931 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:30.933+0000 7f473ba6a700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4734102360 0x7f473419f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:30.931 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:30.933+0000 7f473ba6a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f473410c3f0 con 0x7f47341019c0 2024-03-04T09:12:30.931 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:30.933+0000 7f473ba6a700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f473410c270 con 0x7f4734102360 2024-03-04T09:12:30.931 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:30.933+0000 7f473ba6a700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f473410c570 con 0x7f47341007c0 2024-03-04T09:12:30.931 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:30.933+0000 7f4739806700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47341007c0 0x7f4734198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:30.931 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:30.933+0000 7f4739806700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47341007c0 0x7f4734198390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:45510/0 (socket says 172.21.15.190:45510) 2024-03-04T09:12:30.931 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:30.933+0000 7f4739806700 1 -- 172.21.15.190:0/1971476502 learned_addr learned my addr 172.21.15.190:0/1971476502 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-03-04T09:12:30.931 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:30.933+0000 7f4739005700 1 --2- 172.21.15.190:0/1971476502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47341019c0 0x7f47341988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:30.932 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:30.933+0000 7f473a007700 1 --2- 172.21.15.190:0/1971476502 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4734102360 0x7f473419f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:30.932 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:30.933+0000 7f4739806700 1 -- 172.21.15.190:0/1971476502 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4734102360 msgr2=0x7f473419f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:30.932 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:30.933+0000 7f4739806700 1 --2- 172.21.15.190:0/1971476502 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4734102360 0x7f473419f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:30.932 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:30.933+0000 7f4739806700 1 -- 172.21.15.190:0/1971476502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47341019c0 msgr2=0x7f47341988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:30.932 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:30.933+0000 7f4739806700 1 --2- 172.21.15.190:0/1971476502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47341019c0 0x7f47341988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:30.932 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:30.933+0000 7f4739806700 1 -- 172.21.15.190:0/1971476502 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f473419fff0 con 0x7f47341007c0 2024-03-04T09:12:30.932 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:30.933+0000 7f4739005700 1 --2- 172.21.15.190:0/1971476502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47341019c0 0x7f47341988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T09:12:30.932 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:30.933+0000 7f4739806700 1 --2- 172.21.15.190:0/1971476502 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47341007c0 0x7f4734198390 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4730000c00 tx=0x7f4730009510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:12:30.932 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:30.933+0000 7f472affd700 1 -- 172.21.15.190:0/1971476502 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4730027070 con 0x7f47341007c0 2024-03-04T09:12:30.932 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:30.933+0000 7f472affd700 1 -- 172.21.15.190:0/1971476502 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f47300041b0 con 0x7f47341007c0 2024-03-04T09:12:30.932 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:30.933+0000 7f473ba6a700 1 -- 172.21.15.190:0/1971476502 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47341a0280 con 0x7f47341007c0 2024-03-04T09:12:30.932 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:30.933+0000 7f472affd700 1 -- 172.21.15.190:0/1971476502 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473000f460 con 0x7f47341007c0 2024-03-04T09:12:30.932 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:30.933+0000 7f473ba6a700 1 -- 172.21.15.190:0/1971476502 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47341a0750 con 0x7f47341007c0 2024-03-04T09:12:30.932 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:30.934+0000 7f473ba6a700 1 -- 172.21.15.190:0/1971476502 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4734068db0 con 0x7f47341007c0 2024-03-04T09:12:30.933 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:30.935+0000 7f472affd700 1 -- 172.21.15.190:0/1971476502 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f473002a070 con 0x7f47341007c0 2024-03-04T09:12:30.933 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:30.936+0000 7f472affd700 1 --2- 172.21.15.190:0/1971476502 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f47200a1e10 0x7f47200a42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:30.933 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:30.936+0000 7f472affd700 1 -- 172.21.15.190:0/1971476502 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f47300ceba0 con 0x7f47341007c0 2024-03-04T09:12:30.933 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:30.936+0000 7f4739005700 1 --2- 172.21.15.190:0/1971476502 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f47200a1e10 0x7f47200a42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:30.933 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:30.937+0000 7f4739005700 1 --2- 172.21.15.190:0/1971476502 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f47200a1e10 0x7f47200a42d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f47240099d0 tx=0x7f4724008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:12:30.936 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:30.940+0000 7f472affd700 1 -- 172.21.15.190:0/1971476502 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f4734068db0 con 0x7f47341007c0 2024-03-04T09:12:31.142 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:31.145+0000 7f473ba6a700 1 -- 172.21.15.190:0/1971476502 --> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi102=b;smithi102=e;smithi102=h;smithi102=k;smithi190=c;smithi190=f;smithi190=i;smithi190=l", "target": ["mon-mgr", ""]}) v1 -- 0x7f4734107f10 con 0x7f47200a1e10 2024-03-04T09:12:31.150 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:31.153+0000 7f472affd700 1 -- 172.21.15.190:0/1971476502 <== mgr.14152 v2:172.21.15.82:6800/1278635224 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f4734107f10 con 0x7f47200a1e10 2024-03-04T09:12:31.150 INFO:teuthology.orchestra.run.smithi190.stdout:Scheduled mds.all update... 2024-03-04T09:12:31.152 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:31.155+0000 7f473ba6a700 1 -- 172.21.15.190:0/1971476502 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f47200a1e10 msgr2=0x7f47200a42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:31.152 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:31.155+0000 7f473ba6a700 1 --2- 172.21.15.190:0/1971476502 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f47200a1e10 0x7f47200a42d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f47240099d0 tx=0x7f4724008040 comp rx=0 tx=0).stop 2024-03-04T09:12:31.152 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:31.155+0000 7f473ba6a700 1 -- 172.21.15.190:0/1971476502 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47341007c0 msgr2=0x7f4734198390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:31.152 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:31.155+0000 7f473ba6a700 1 --2- 172.21.15.190:0/1971476502 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47341007c0 0x7f4734198390 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4730000c00 tx=0x7f4730009510 comp rx=0 tx=0).stop 2024-03-04T09:12:31.152 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:31.155+0000 7f473ba6a700 1 -- 172.21.15.190:0/1971476502 shutdown_connections 2024-03-04T09:12:31.152 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:31.155+0000 7f473ba6a700 1 --2- 172.21.15.190:0/1971476502 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f47200a1e10 0x7f47200a42d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:31.152 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:31.155+0000 7f473ba6a700 1 --2- 172.21.15.190:0/1971476502 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4734102360 0x7f473419f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:31.152 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:31.155+0000 7f473ba6a700 1 --2- 172.21.15.190:0/1971476502 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47341007c0 0x7f4734198390 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:31.152 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:31.155+0000 7f473ba6a700 1 --2- 172.21.15.190:0/1971476502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47341019c0 0x7f47341988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:31.152 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:31.155+0000 7f473ba6a700 1 -- 172.21.15.190:0/1971476502 >> 172.21.15.190:0/1971476502 conn(0x7f47340fbd60 msgr2=0x7f47340fd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:12:31.153 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:31.156+0000 7f473ba6a700 1 -- 172.21.15.190:0/1971476502 shutdown_connections 2024-03-04T09:12:31.153 INFO:teuthology.orchestra.run.smithi190.stderr:2024-03-04T09:12:31.156+0000 7f473ba6a700 1 -- 172.21.15.190:0/1971476502 wait complete. 2024-03-04T09:12:31.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:31 smithi190 ceph-mon[36341]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:12:31.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:31 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:31.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:31 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:12:31.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:31 smithi102 ceph-mon[36220]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:12:31.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:31 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:31.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:31 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:12:31.796 DEBUG:teuthology.orchestra.run.smithi082:mds.a> sudo journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mds.a.service 2024-03-04T09:12:31.799 DEBUG:teuthology.orchestra.run.smithi082:mds.d> sudo journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mds.d.service 2024-03-04T09:12:31.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:31 smithi082 ceph-mon[32880]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:12:31.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:31 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:31.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:31 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:12:31.817 DEBUG:teuthology.orchestra.run.smithi082:mds.g> sudo journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mds.g.service 2024-03-04T09:12:31.860 DEBUG:teuthology.orchestra.run.smithi082:mds.j> sudo journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mds.j.service 2024-03-04T09:12:31.903 DEBUG:teuthology.orchestra.run.smithi102:mds.b> sudo journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mds.b.service 2024-03-04T09:12:31.905 DEBUG:teuthology.orchestra.run.smithi102:mds.e> sudo journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mds.e.service 2024-03-04T09:12:31.948 DEBUG:teuthology.orchestra.run.smithi102:mds.h> sudo journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mds.h.service 2024-03-04T09:12:31.991 DEBUG:teuthology.orchestra.run.smithi102:mds.k> sudo journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mds.k.service 2024-03-04T09:12:32.034 DEBUG:teuthology.orchestra.run.smithi190:mds.c> sudo journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mds.c.service 2024-03-04T09:12:32.036 DEBUG:teuthology.orchestra.run.smithi190:mds.f> sudo journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mds.f.service 2024-03-04T09:12:32.079 DEBUG:teuthology.orchestra.run.smithi190:mds.i> sudo journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mds.i.service 2024-03-04T09:12:32.122 DEBUG:teuthology.orchestra.run.smithi190:mds.l> sudo journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mds.l.service 2024-03-04T09:12:32.166 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-03-04T09:12:32.166 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T09:12:32.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.289+0000 7fd012977640 1 -- 172.21.15.82:0/2801259709 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd00c1007c0 msgr2=0x7fd00c100c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:32.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.289+0000 7fd012977640 1 --2- 172.21.15.82:0/2801259709 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd00c1007c0 0x7fd00c100c20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd000009900 tx=0x7fd00002bc30 comp rx=0 tx=0).stop 2024-03-04T09:12:32.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.289+0000 7fd012977640 1 -- 172.21.15.82:0/2801259709 shutdown_connections 2024-03-04T09:12:32.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.289+0000 7fd012977640 1 --2- 172.21.15.82:0/2801259709 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd00c101160 0x7fd00c1015e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:32.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.289+0000 7fd012977640 1 --2- 172.21.15.82:0/2801259709 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd00c1007c0 0x7fd00c100c20 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:32.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.289+0000 7fd012977640 1 --2- 172.21.15.82:0/2801259709 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd00c0ffe60 0x7fd00c100280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:32.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.289+0000 7fd012977640 1 -- 172.21.15.82:0/2801259709 >> 172.21.15.82:0/2801259709 conn(0x7fd00c0fba60 msgr2=0x7fd00c0fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:12:32.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.289+0000 7fd012977640 1 -- 172.21.15.82:0/2801259709 shutdown_connections 2024-03-04T09:12:32.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.289+0000 7fd012977640 1 -- 172.21.15.82:0/2801259709 wait complete. 2024-03-04T09:12:32.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.289+0000 7fd012977640 1 Processor -- start 2024-03-04T09:12:32.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.289+0000 7fd012977640 1 -- start start 2024-03-04T09:12:32.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.290+0000 7fd012977640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd00c0ffe60 0x7fd00c199af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:32.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.290+0000 7fd012977640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd00c1007c0 0x7fd00c19a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:32.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.290+0000 7fd012977640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd00c101160 0x7fd00c1a10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:32.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.290+0000 7fd012977640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c10f420 con 0x7fd00c101160 2024-03-04T09:12:32.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.290+0000 7fd012977640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c10f2a0 con 0x7fd00c0ffe60 2024-03-04T09:12:32.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.290+0000 7fd012977640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c10f5a0 con 0x7fd00c1007c0 2024-03-04T09:12:32.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.290+0000 7fd010f14640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd00c101160 0x7fd00c1a10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:32.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.290+0000 7fd010f14640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd00c101160 0x7fd00c1a10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58386/0 (socket says 172.21.15.82:58386) 2024-03-04T09:12:32.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.290+0000 7fd010f14640 1 -- 172.21.15.82:0/3106203042 learned_addr learned my addr 172.21.15.82:0/3106203042 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:12:32.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.290+0000 7fd00b7fe640 1 --2- 172.21.15.82:0/3106203042 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd00c1007c0 0x7fd00c19a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:32.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.290+0000 7fd00bfff640 1 --2- 172.21.15.82:0/3106203042 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd00c0ffe60 0x7fd00c199af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:32.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.290+0000 7fd010f14640 1 -- 172.21.15.82:0/3106203042 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd00c1007c0 msgr2=0x7fd00c19a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:32.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.290+0000 7fd010f14640 1 --2- 172.21.15.82:0/3106203042 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd00c1007c0 0x7fd00c19a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:32.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.290+0000 7fd010f14640 1 -- 172.21.15.82:0/3106203042 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd00c0ffe60 msgr2=0x7fd00c199af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:32.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.290+0000 7fd010f14640 1 --2- 172.21.15.82:0/3106203042 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd00c0ffe60 0x7fd00c199af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:32.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.290+0000 7fd010f14640 1 -- 172.21.15.82:0/3106203042 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd00c1a1710 con 0x7fd00c101160 2024-03-04T09:12:32.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.290+0000 7fd00bfff640 1 --2- 172.21.15.82:0/3106203042 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd00c0ffe60 0x7fd00c199af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T09:12:32.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.290+0000 7fd010f14640 1 --2- 172.21.15.82:0/3106203042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd00c101160 0x7fd00c1a10a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd00400cad0 tx=0x7fd00400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:12:32.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.290+0000 7fd0097fa640 1 -- 172.21.15.82:0/3106203042 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00400ae20 con 0x7fd00c101160 2024-03-04T09:12:32.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.290+0000 7fd012977640 1 -- 172.21.15.82:0/3106203042 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd00c1a1a00 con 0x7fd00c101160 2024-03-04T09:12:32.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.290+0000 7fd0097fa640 1 -- 172.21.15.82:0/3106203042 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fd004005020 con 0x7fd00c101160 2024-03-04T09:12:32.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.290+0000 7fd0097fa640 1 -- 172.21.15.82:0/3106203042 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00400f690 con 0x7fd00c101160 2024-03-04T09:12:32.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.290+0000 7fd012977640 1 -- 172.21.15.82:0/3106203042 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd00c1a1ed0 con 0x7fd00c101160 2024-03-04T09:12:32.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.291+0000 7fd012977640 1 -- 172.21.15.82:0/3106203042 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd00c10adb0 con 0x7fd00c101160 2024-03-04T09:12:32.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.292+0000 7fd0097fa640 1 -- 172.21.15.82:0/3106203042 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7fd0040051d0 con 0x7fd00c101160 2024-03-04T09:12:32.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.293+0000 7fd0097fa640 1 --2- 172.21.15.82:0/3106203042 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fcff40a1d80 0x7fcff40a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:32.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.293+0000 7fd00bfff640 1 --2- 172.21.15.82:0/3106203042 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fcff40a1d80 0x7fcff40a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:32.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.293+0000 7fd0097fa640 1 -- 172.21.15.82:0/3106203042 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fd0040cdc90 con 0x7fd00c101160 2024-03-04T09:12:32.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.293+0000 7fd00bfff640 1 --2- 172.21.15.82:0/3106203042 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fcff40a1d80 0x7fcff40a4240 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcffc005d00 tx=0x7fcffc005ed0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:12:32.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.296+0000 7fd0097fa640 1 -- 172.21.15.82:0/3106203042 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fd004014030 con 0x7fd00c101160 2024-03-04T09:12:32.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.472+0000 7fd012977640 1 -- 172.21.15.82:0/3106203042 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd00c02d240 con 0x7fd00c101160 2024-03-04T09:12:32.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.473+0000 7fd0097fa640 1 -- 172.21.15.82:0/3106203042 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+18420 (secure 0 0 0) 0x7fd00409b560 con 0x7fd00c101160 2024-03-04T09:12:32.470 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:12:32.470 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":82,"fsid":"2e533fc8-da06-11ee-95c6-87774f69a715","created":"2024-03-04T09:05:16.488249+0000","modified":"2024-03-04T09:12:23.316714+0000","last_up_change":"2024-03-04T09:12:22.308711+0000","last_in_change":"2024-03-04T09:12:02.548212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T09:08:36.508257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"085b5c4b-ede9-4d0d-b994-50c89d991012","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6803","nonce":709655235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6805","nonce":709655235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6809","nonce":709655235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6807","nonce":709655235}]},"public_addr":"172.21.15.82:6803/709655235","cluster_addr":"172.21.15.82:6805/709655235","heartbeat_back_addr":"172.21.15.82:6809/709655235","heartbeat_front_addr":"172.21.15.82:6807/709655235","state":["exists","up"]},{"osd":1,"uuid":"e4dd7079-333e-4bcf-b3af-11fb082a5af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6801","nonce":270721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6803","nonce":270721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6807","nonce":270721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6805","nonce":270721212}]},"public_addr":"172.21.15.102:6801/270721212","cluster_addr":"172.21.15.102:6803/270721212","heartbeat_back_addr":"172.21.15.102:6807/270721212","heartbeat_front_addr":"172.21.15.102:6805/270721212","state":["exists","up"]},{"osd":2,"uuid":"6fed5fd6-dc82-497f-9d69-c10a5e5802da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6801","nonce":946410459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6803","nonce":946410459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6807","nonce":946410459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6805","nonce":946410459}]},"public_addr":"172.21.15.190:6801/946410459","cluster_addr":"172.21.15.190:6803/946410459","heartbeat_back_addr":"172.21.15.190:6807/946410459","heartbeat_front_addr":"172.21.15.190:6805/946410459","state":["exists","up"]},{"osd":3,"uuid":"91ccbdc3-3da6-4d39-8a89-3a7b7bb4adc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6811","nonce":980870924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6813","nonce":980870924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6817","nonce":980870924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6815","nonce":980870924}]},"public_addr":"172.21.15.82:6811/980870924","cluster_addr":"172.21.15.82:6813/980870924","heartbeat_back_addr":"172.21.15.82:6817/980870924","heartbeat_front_addr":"172.21.15.82:6815/980870924","state":["exists","up"]},{"osd":4,"uuid":"dbb9d486-5daa-4819-bbed-04fc76ca473e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6809","nonce":1229627753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6811","nonce":1229627753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6815","nonce":1229627753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6813","nonce":1229627753}]},"public_addr":"172.21.15.102:6809/1229627753","cluster_addr":"172.21.15.102:6811/1229627753","heartbeat_back_addr":"172.21.15.102:6815/1229627753","heartbeat_front_addr":"172.21.15.102:6813/1229627753","state":["exists","up"]},{"osd":5,"uuid":"6b50127b-df2b-4c95-8e53-9d42b40273fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6809","nonce":2171194148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6811","nonce":2171194148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6815","nonce":2171194148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6813","nonce":2171194148}]},"public_addr":"172.21.15.190:6809/2171194148","cluster_addr":"172.21.15.190:6811/2171194148","heartbeat_back_addr":"172.21.15.190:6815/2171194148","heartbeat_front_addr":"172.21.15.190:6813/2171194148","state":["exists","up"]},{"osd":6,"uuid":"e72bebb0-5939-4210-950a-41c25c23c62f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6819","nonce":454436959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6821","nonce":454436959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6825","nonce":454436959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6823","nonce":454436959}]},"public_addr":"172.21.15.82:6819/454436959","cluster_addr":"172.21.15.82:6821/454436959","heartbeat_back_addr":"172.21.15.82:6825/454436959","heartbeat_front_addr":"172.21.15.82:6823/454436959","state":["exists","up"]},{"osd":7,"uuid":"72f83f97-f496-4503-8284-6a7b8f99a6f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6817","nonce":2745057274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6819","nonce":2745057274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6823","nonce":2745057274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6821","nonce":2745057274}]},"public_addr":"172.21.15.102:6817/2745057274","cluster_addr":"172.21.15.102:6819/2745057274","heartbeat_back_addr":"172.21.15.102:6823/2745057274","heartbeat_front_addr":"172.21.15.102:6821/2745057274","state":["exists","up"]},{"osd":8,"uuid":"92c9109d-6ebb-4c50-9944-28cd7b2f9c0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6817","nonce":1679683516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6819","nonce":1679683516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6823","nonce":1679683516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6821","nonce":1679683516}]},"public_addr":"172.21.15.190:6817/1679683516","cluster_addr":"172.21.15.190:6819/1679683516","heartbeat_back_addr":"172.21.15.190:6823/1679683516","heartbeat_front_addr":"172.21.15.190:6821/1679683516","state":["exists","up"]},{"osd":9,"uuid":"a3cfce03-0148-475d-bf55-b8284ae1cad2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6827","nonce":1777272933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6829","nonce":1777272933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6833","nonce":1777272933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6831","nonce":1777272933}]},"public_addr":"172.21.15.82:6827/1777272933","cluster_addr":"172.21.15.82:6829/1777272933","heartbeat_back_addr":"172.21.15.82:6833/1777272933","heartbeat_front_addr":"172.21.15.82:6831/1777272933","state":["exists","up"]},{"osd":10,"uuid":"db156ccf-4396-43cb-b69a-bb9095b94b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6825","nonce":1012784035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6827","nonce":1012784035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6831","nonce":1012784035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6829","nonce":1012784035}]},"public_addr":"172.21.15.102:6825/1012784035","cluster_addr":"172.21.15.102:6827/1012784035","heartbeat_back_addr":"172.21.15.102:6831/1012784035","heartbeat_front_addr":"172.21.15.102:6829/1012784035","state":["exists","up"]},{"osd":11,"uuid":"b4d52576-f5b4-479f-8ff6-8fdba4635ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6825","nonce":144700355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6827","nonce":144700355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6831","nonce":144700355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6829","nonce":144700355}]},"public_addr":"172.21.15.190:6825/144700355","cluster_addr":"172.21.15.190:6827/144700355","heartbeat_back_addr":"172.21.15.190:6831/144700355","heartbeat_front_addr":"172.21.15.190:6829/144700355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:07:47.007772+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:09.944738+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:33.183567+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:58.302023+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:09:23.042488+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:09:47.616009+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:10:13.122887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:10:38.584530+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:03.473453+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:29.847105+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:55.152195+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:12:20.401765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6800/1901539016":"2024-03-05T09:06:12.169231+0000","172.21.15.82:0/1124105204":"2024-03-05T09:06:12.169231+0000","172.21.15.82:6801/1901539016":"2024-03-05T09:06:12.169231+0000","172.21.15.82:0/735262841":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/2402774828":"2024-03-05T09:05:44.913099+0000","172.21.15.82:6801/3291527077":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/1846720385":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/3757201752":"2024-03-05T09:06:12.169231+0000","172.21.15.82:6800/3291527077":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/984630078":"2024-03-05T09:06:12.169231+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T09:12:32.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.475+0000 7fd012977640 1 -- 172.21.15.82:0/3106203042 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fcff40a1d80 msgr2=0x7fcff40a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:32.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.475+0000 7fd012977640 1 --2- 172.21.15.82:0/3106203042 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fcff40a1d80 0x7fcff40a4240 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcffc005d00 tx=0x7fcffc005ed0 comp rx=0 tx=0).stop 2024-03-04T09:12:32.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.475+0000 7fd012977640 1 -- 172.21.15.82:0/3106203042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd00c101160 msgr2=0x7fd00c1a10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:32.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.475+0000 7fd012977640 1 --2- 172.21.15.82:0/3106203042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd00c101160 0x7fd00c1a10a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd00400cad0 tx=0x7fd00400cf90 comp rx=0 tx=0).stop 2024-03-04T09:12:32.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.475+0000 7fd012977640 1 -- 172.21.15.82:0/3106203042 shutdown_connections 2024-03-04T09:12:32.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.475+0000 7fd012977640 1 --2- 172.21.15.82:0/3106203042 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fcff40a1d80 0x7fcff40a4240 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:32.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.475+0000 7fd012977640 1 --2- 172.21.15.82:0/3106203042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd00c101160 0x7fd00c1a10a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:32.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.475+0000 7fd012977640 1 --2- 172.21.15.82:0/3106203042 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd00c1007c0 0x7fd00c19a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:32.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.475+0000 7fd012977640 1 --2- 172.21.15.82:0/3106203042 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd00c0ffe60 0x7fd00c199af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:32.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.475+0000 7fd012977640 1 -- 172.21.15.82:0/3106203042 >> 172.21.15.82:0/3106203042 conn(0x7fd00c0fba60 msgr2=0x7fd00c0fd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:12:32.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.475+0000 7fd012977640 1 -- 172.21.15.82:0/3106203042 shutdown_connections 2024-03-04T09:12:32.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.475+0000 7fd012977640 1 -- 172.21.15.82:0/3106203042 wait complete. 2024-03-04T09:12:32.481 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:32 smithi082 ceph-mon[32880]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi102=b;smithi102=e;smithi102=h;smithi102=k;smithi190=c;smithi190=f;smithi190=i;smithi190=l", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:12:32.481 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:32 smithi082 ceph-mon[32880]: Saving service mds.all spec with placement smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi102=b;smithi102=e;smithi102=h;smithi102=k;smithi190=c;smithi190=f;smithi190=i;smithi190=l;count:12 2024-03-04T09:12:32.482 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:32 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:12:32.482 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:32 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:12:32.482 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:32 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:32.482 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:32 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-04T09:12:32.482 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:32 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-04T09:12:32.482 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:32 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:12:32.484 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T09:08:36.508257+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-04T09:12:32.485 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-04T09:12:32.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.593+0000 7ff052bbc640 1 -- 172.21.15.82:0/3086919819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff04c102880 msgr2=0x7ff04c102d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:32.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.593+0000 7ff052bbc640 1 --2- 172.21.15.82:0/3086919819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff04c102880 0x7ff04c102d00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff040009930 tx=0x7ff04002bc30 comp rx=0 tx=0).stop 2024-03-04T09:12:32.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.593+0000 7ff052bbc640 1 -- 172.21.15.82:0/3086919819 shutdown_connections 2024-03-04T09:12:32.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.593+0000 7ff052bbc640 1 --2- 172.21.15.82:0/3086919819 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff04c103240 0x7ff04c109ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:32.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.593+0000 7ff052bbc640 1 --2- 172.21.15.82:0/3086919819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff04c102880 0x7ff04c102d00 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:32.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.593+0000 7ff052bbc640 1 --2- 172.21.15.82:0/3086919819 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff04c0ff8b0 0x7ff04c0ffcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:32.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.593+0000 7ff052bbc640 1 -- 172.21.15.82:0/3086919819 >> 172.21.15.82:0/3086919819 conn(0x7ff04c0fb1c0 msgr2=0x7ff04c0fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:12:32.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.593+0000 7ff052bbc640 1 -- 172.21.15.82:0/3086919819 shutdown_connections 2024-03-04T09:12:32.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.593+0000 7ff052bbc640 1 -- 172.21.15.82:0/3086919819 wait complete. 2024-03-04T09:12:32.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.593+0000 7ff052bbc640 1 Processor -- start 2024-03-04T09:12:32.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.593+0000 7ff052bbc640 1 -- start start 2024-03-04T09:12:32.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.593+0000 7ff052bbc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff04c0ff8b0 0x7ff04c1978e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:32.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.593+0000 7ff052bbc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff04c102880 0x7ff04c197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:32.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.593+0000 7ff052bbc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff04c103240 0x7ff04c19ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:32.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.593+0000 7ff052bbc640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04c10d270 con 0x7ff04c0ff8b0 2024-03-04T09:12:32.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.593+0000 7ff052bbc640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04c10d0f0 con 0x7ff04c103240 2024-03-04T09:12:32.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.593+0000 7ff052bbc640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04c10d3f0 con 0x7ff04c102880 2024-03-04T09:12:32.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.594+0000 7ff050958640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff04c0ff8b0 0x7ff04c1978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:32.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.594+0000 7ff050958640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff04c0ff8b0 0x7ff04c1978e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58410/0 (socket says 172.21.15.82:58410) 2024-03-04T09:12:32.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.594+0000 7ff050958640 1 -- 172.21.15.82:0/1867613776 learned_addr learned my addr 172.21.15.82:0/1867613776 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:12:32.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.594+0000 7ff04bfff640 1 --2- 172.21.15.82:0/1867613776 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff04c102880 0x7ff04c197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:32.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.594+0000 7ff051159640 1 --2- 172.21.15.82:0/1867613776 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff04c103240 0x7ff04c19ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:32.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.594+0000 7ff050958640 1 -- 172.21.15.82:0/1867613776 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff04c102880 msgr2=0x7ff04c197e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:32.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.594+0000 7ff050958640 1 --2- 172.21.15.82:0/1867613776 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff04c102880 0x7ff04c197e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:32.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.594+0000 7ff050958640 1 -- 172.21.15.82:0/1867613776 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff04c103240 msgr2=0x7ff04c19ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:32.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.594+0000 7ff050958640 1 --2- 172.21.15.82:0/1867613776 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff04c103240 0x7ff04c19ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:32.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.594+0000 7ff050958640 1 -- 172.21.15.82:0/1867613776 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff04c19f500 con 0x7ff04c0ff8b0 2024-03-04T09:12:32.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.594+0000 7ff050958640 1 --2- 172.21.15.82:0/1867613776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff04c0ff8b0 0x7ff04c1978e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff04400ebc0 tx=0x7ff04400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:12:32.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.594+0000 7ff049ffb640 1 -- 172.21.15.82:0/1867613776 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff044003b70 con 0x7ff04c0ff8b0 2024-03-04T09:12:32.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.594+0000 7ff052bbc640 1 -- 172.21.15.82:0/1867613776 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff04c19f7f0 con 0x7ff04c0ff8b0 2024-03-04T09:12:32.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.594+0000 7ff049ffb640 1 -- 172.21.15.82:0/1867613776 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7ff044003d10 con 0x7ff04c0ff8b0 2024-03-04T09:12:32.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.594+0000 7ff049ffb640 1 -- 172.21.15.82:0/1867613776 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff044019860 con 0x7ff04c0ff8b0 2024-03-04T09:12:32.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.594+0000 7ff052bbc640 1 -- 172.21.15.82:0/1867613776 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff04c19fd10 con 0x7ff04c0ff8b0 2024-03-04T09:12:32.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.595+0000 7ff052bbc640 1 -- 172.21.15.82:0/1867613776 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff04c108a00 con 0x7ff04c0ff8b0 2024-03-04T09:12:32.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.596+0000 7ff049ffb640 1 -- 172.21.15.82:0/1867613776 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7ff044019a00 con 0x7ff04c0ff8b0 2024-03-04T09:12:32.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.597+0000 7ff049ffb640 1 --2- 172.21.15.82:0/1867613776 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff0340a1d80 0x7ff0340a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:32.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.597+0000 7ff04bfff640 1 --2- 172.21.15.82:0/1867613776 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff0340a1d80 0x7ff0340a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:32.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.597+0000 7ff049ffb640 1 -- 172.21.15.82:0/1867613776 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ff0440ce210 con 0x7ff04c0ff8b0 2024-03-04T09:12:32.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.597+0000 7ff04bfff640 1 --2- 172.21.15.82:0/1867613776 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff0340a1d80 0x7ff0340a4240 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff040000c00 tx=0x7ff040005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:12:32.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.601+0000 7ff049ffb640 1 -- 172.21.15.82:0/1867613776 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7ff04409bae0 con 0x7ff04c0ff8b0 2024-03-04T09:12:32.605 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:32 smithi190 ceph-mon[36341]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi102=b;smithi102=e;smithi102=h;smithi102=k;smithi190=c;smithi190=f;smithi190=i;smithi190=l", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:12:32.605 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:32 smithi190 ceph-mon[36341]: Saving service mds.all spec with placement smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi102=b;smithi102=e;smithi102=h;smithi102=k;smithi190=c;smithi190=f;smithi190=i;smithi190=l;count:12 2024-03-04T09:12:32.605 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:32 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:12:32.605 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:32 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:12:32.605 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:32 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:32.605 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:32 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-04T09:12:32.605 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:32 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-04T09:12:32.606 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:32 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:12:32.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:32 smithi102 ceph-mon[36220]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi102=b;smithi102=e;smithi102=h;smithi102=k;smithi190=c;smithi190=f;smithi190=i;smithi190=l", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:12:32.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:32 smithi102 ceph-mon[36220]: Saving service mds.all spec with placement smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi102=b;smithi102=e;smithi102=h;smithi102=k;smithi190=c;smithi190=f;smithi190=i;smithi190=l;count:12 2024-03-04T09:12:32.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:32 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:12:32.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:32 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:12:32.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:32 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:32.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:32 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-04T09:12:32.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:32 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-04T09:12:32.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:32 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:12:32.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.772+0000 7ff052bbc640 1 -- 172.21.15.82:0/1867613776 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff04c0621d0 con 0x7ff04c0ff8b0 2024-03-04T09:12:32.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.773+0000 7ff049ffb640 1 -- 172.21.15.82:0/1867613776 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff04409b3e0 con 0x7ff04c0ff8b0 2024-03-04T09:12:32.770 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-03-04T09:12:32.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.775+0000 7ff052bbc640 1 -- 172.21.15.82:0/1867613776 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff0340a1d80 msgr2=0x7ff0340a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:32.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.775+0000 7ff052bbc640 1 --2- 172.21.15.82:0/1867613776 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff0340a1d80 0x7ff0340a4240 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff040000c00 tx=0x7ff040005fd0 comp rx=0 tx=0).stop 2024-03-04T09:12:32.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.775+0000 7ff052bbc640 1 -- 172.21.15.82:0/1867613776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff04c0ff8b0 msgr2=0x7ff04c1978e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:32.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.775+0000 7ff052bbc640 1 --2- 172.21.15.82:0/1867613776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff04c0ff8b0 0x7ff04c1978e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff04400ebc0 tx=0x7ff04400c6a0 comp rx=0 tx=0).stop 2024-03-04T09:12:32.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.775+0000 7ff052bbc640 1 -- 172.21.15.82:0/1867613776 shutdown_connections 2024-03-04T09:12:32.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.775+0000 7ff052bbc640 1 --2- 172.21.15.82:0/1867613776 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff0340a1d80 0x7ff0340a4240 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:32.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.775+0000 7ff052bbc640 1 --2- 172.21.15.82:0/1867613776 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff04c103240 0x7ff04c19ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:32.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.775+0000 7ff052bbc640 1 --2- 172.21.15.82:0/1867613776 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff04c102880 0x7ff04c197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:32.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.775+0000 7ff052bbc640 1 --2- 172.21.15.82:0/1867613776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff04c0ff8b0 0x7ff04c1978e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:32.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.775+0000 7ff052bbc640 1 -- 172.21.15.82:0/1867613776 >> 172.21.15.82:0/1867613776 conn(0x7ff04c0fb1c0 msgr2=0x7ff04c105bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:12:32.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.775+0000 7ff052bbc640 1 -- 172.21.15.82:0/1867613776 shutdown_connections 2024-03-04T09:12:32.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.775+0000 7ff052bbc640 1 -- 172.21.15.82:0/1867613776 wait complete. 2024-03-04T09:12:32.782 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T09:12:32.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.888+0000 7f850193a640 1 -- 172.21.15.82:0/2975924539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84fc101700 msgr2=0x7f84fc101b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:32.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.888+0000 7f850193a640 1 --2- 172.21.15.82:0/2975924539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84fc101700 0x7f84fc101b80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f84e4009900 tx=0x7f84e402bc30 comp rx=0 tx=0).stop 2024-03-04T09:12:32.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.888+0000 7f850193a640 1 -- 172.21.15.82:0/2975924539 shutdown_connections 2024-03-04T09:12:32.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.888+0000 7f850193a640 1 --2- 172.21.15.82:0/2975924539 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84fc1020c0 0x7f84fc108950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:32.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.888+0000 7f850193a640 1 --2- 172.21.15.82:0/2975924539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84fc101700 0x7f84fc101b80 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:32.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.888+0000 7f850193a640 1 --2- 172.21.15.82:0/2975924539 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f84fc100510 0x7f84fc100930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:32.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.888+0000 7f850193a640 1 -- 172.21.15.82:0/2975924539 >> 172.21.15.82:0/2975924539 conn(0x7f84fc0fba80 msgr2=0x7f84fc0fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:12:32.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.888+0000 7f850193a640 1 -- 172.21.15.82:0/2975924539 shutdown_connections 2024-03-04T09:12:32.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.888+0000 7f850193a640 1 -- 172.21.15.82:0/2975924539 wait complete. 2024-03-04T09:12:32.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.889+0000 7f850193a640 1 Processor -- start 2024-03-04T09:12:32.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.889+0000 7f850193a640 1 -- start start 2024-03-04T09:12:32.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.889+0000 7f850193a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f84fc100510 0x7f84fc197990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:32.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.889+0000 7f850193a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84fc101700 0x7f84fc197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:32.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.889+0000 7f850193a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84fc1020c0 0x7f84fc19ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:32.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.889+0000 7f850193a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84fc10c1f0 con 0x7f84fc1020c0 2024-03-04T09:12:32.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.889+0000 7f850193a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84fc10c070 con 0x7f84fc101700 2024-03-04T09:12:32.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.889+0000 7f850193a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84fc10c370 con 0x7f84fc100510 2024-03-04T09:12:32.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.889+0000 7f84fb7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84fc1020c0 0x7f84fc19ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:32.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.889+0000 7f84fb7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84fc1020c0 0x7f84fc19ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58434/0 (socket says 172.21.15.82:58434) 2024-03-04T09:12:32.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.889+0000 7f84fb7fe640 1 -- 172.21.15.82:0/2798248013 learned_addr learned my addr 172.21.15.82:0/2798248013 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:12:32.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.890+0000 7f84fa7fc640 1 --2- 172.21.15.82:0/2798248013 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84fc101700 0x7f84fc197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:32.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.890+0000 7f84faffd640 1 --2- 172.21.15.82:0/2798248013 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f84fc100510 0x7f84fc197990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:32.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.890+0000 7f84fb7fe640 1 -- 172.21.15.82:0/2798248013 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f84fc100510 msgr2=0x7f84fc197990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:32.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.890+0000 7f84fb7fe640 1 --2- 172.21.15.82:0/2798248013 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f84fc100510 0x7f84fc197990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:32.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.890+0000 7f84fb7fe640 1 -- 172.21.15.82:0/2798248013 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84fc101700 msgr2=0x7f84fc197ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:32.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.890+0000 7f84fb7fe640 1 --2- 172.21.15.82:0/2798248013 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84fc101700 0x7f84fc197ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:32.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.890+0000 7f84fb7fe640 1 -- 172.21.15.82:0/2798248013 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84fc19f5b0 con 0x7f84fc1020c0 2024-03-04T09:12:32.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.890+0000 7f84faffd640 1 --2- 172.21.15.82:0/2798248013 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f84fc100510 0x7f84fc197990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T09:12:32.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.890+0000 7f84fb7fe640 1 --2- 172.21.15.82:0/2798248013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84fc1020c0 0x7f84fc19ef40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f84f4009fd0 tx=0x7f84f400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:12:32.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.890+0000 7f8500938640 1 -- 172.21.15.82:0/2798248013 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f4011830 con 0x7f84fc1020c0 2024-03-04T09:12:32.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.890+0000 7f8500938640 1 -- 172.21.15.82:0/2798248013 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f84f4016070 con 0x7f84fc1020c0 2024-03-04T09:12:32.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.890+0000 7f8500938640 1 -- 172.21.15.82:0/2798248013 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f400f2e0 con 0x7f84fc1020c0 2024-03-04T09:12:32.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.890+0000 7f850193a640 1 -- 172.21.15.82:0/2798248013 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84fc19f8a0 con 0x7f84fc1020c0 2024-03-04T09:12:32.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.890+0000 7f850193a640 1 -- 172.21.15.82:0/2798248013 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84fc19fe20 con 0x7f84fc1020c0 2024-03-04T09:12:32.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.891+0000 7f850193a640 1 -- 172.21.15.82:0/2798248013 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84fc1a00b0 con 0x7f84fc1020c0 2024-03-04T09:12:32.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.892+0000 7f8500938640 1 -- 172.21.15.82:0/2798248013 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f84f40119d0 con 0x7f84fc1020c0 2024-03-04T09:12:32.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.892+0000 7f8500938640 1 --2- 172.21.15.82:0/2798248013 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f84e80a1d80 0x7f84e80a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:32.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.893+0000 7f84faffd640 1 --2- 172.21.15.82:0/2798248013 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f84e80a1d80 0x7f84e80a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:32.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.893+0000 7f8500938640 1 -- 172.21.15.82:0/2798248013 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f84f40cd0f0 con 0x7f84fc1020c0 2024-03-04T09:12:32.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.893+0000 7f84faffd640 1 --2- 172.21.15.82:0/2798248013 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f84e80a1d80 0x7f84e80a4240 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f84fc101560 tx=0x7f84ec009400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:12:32.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:32.897+0000 7f8500938640 1 -- 172.21.15.82:0/2798248013 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f84f409a9c0 con 0x7f84fc1020c0 2024-03-04T09:12:33.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:33.110+0000 7f850193a640 1 -- 172.21.15.82:0/2798248013 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f84fc1a0280 con 0x7f84fc1020c0 2024-03-04T09:12:33.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:33.111+0000 7f8500938640 1 -- 172.21.15.82:0/2798248013 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7f84f409a2c0 con 0x7f84fc1020c0 2024-03-04T09:12:33.107 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:12:33.108 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-03-04T09:12:33.108 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 1 2024-03-04T09:12:33.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:33.113+0000 7f850193a640 1 -- 172.21.15.82:0/2798248013 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f84e80a1d80 msgr2=0x7f84e80a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:33.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:33.113+0000 7f850193a640 1 --2- 172.21.15.82:0/2798248013 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f84e80a1d80 0x7f84e80a4240 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f84fc101560 tx=0x7f84ec009400 comp rx=0 tx=0).stop 2024-03-04T09:12:33.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:33.113+0000 7f850193a640 1 -- 172.21.15.82:0/2798248013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84fc1020c0 msgr2=0x7f84fc19ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:33.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:33.113+0000 7f850193a640 1 --2- 172.21.15.82:0/2798248013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84fc1020c0 0x7f84fc19ef40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f84f4009fd0 tx=0x7f84f400b8e0 comp rx=0 tx=0).stop 2024-03-04T09:12:33.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:33.113+0000 7f850193a640 1 -- 172.21.15.82:0/2798248013 shutdown_connections 2024-03-04T09:12:33.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:33.113+0000 7f850193a640 1 --2- 172.21.15.82:0/2798248013 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f84e80a1d80 0x7f84e80a4240 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:33.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:33.113+0000 7f850193a640 1 --2- 172.21.15.82:0/2798248013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84fc1020c0 0x7f84fc19ef40 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:33.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:33.113+0000 7f850193a640 1 --2- 172.21.15.82:0/2798248013 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84fc101700 0x7f84fc197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:33.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:33.113+0000 7f850193a640 1 --2- 172.21.15.82:0/2798248013 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f84fc100510 0x7f84fc197990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:33.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:33.113+0000 7f850193a640 1 -- 172.21.15.82:0/2798248013 >> 172.21.15.82:0/2798248013 conn(0x7f84fc0fba80 msgr2=0x7f84fc0fd520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:12:33.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:33.113+0000 7f850193a640 1 -- 172.21.15.82:0/2798248013 shutdown_connections 2024-03-04T09:12:33.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:33.113+0000 7f850193a640 1 -- 172.21.15.82:0/2798248013 wait complete. 2024-03-04T09:12:33.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:33 smithi082 ceph-mon[32880]: Deploying daemon mds.l on smithi190 2024-03-04T09:12:33.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:33 smithi082 ceph-mon[32880]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:12:33.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:33 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/3106203042' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:12:33.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:33 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/1867613776' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-04T09:12:33.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:33 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/2798248013' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:12:33.608 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:33 smithi190 ceph-mon[36341]: Deploying daemon mds.l on smithi190 2024-03-04T09:12:33.608 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:33 smithi190 ceph-mon[36341]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:12:33.608 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:33 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/3106203042' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:12:33.608 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:33 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/1867613776' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-04T09:12:33.608 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:33 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/2798248013' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:12:33.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:33 smithi102 ceph-mon[36220]: Deploying daemon mds.l on smithi190 2024-03-04T09:12:33.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:33 smithi102 ceph-mon[36220]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:12:33.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:33 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/3106203042' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:12:33.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:33 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/1867613776' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-04T09:12:33.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:33 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/2798248013' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:12:34.170 INFO:journalctl@ceph.mds.l.smithi190.stdout:Mar 04 09:12:34 smithi190 systemd[1]: Starting Ceph mds.l for 2e533fc8-da06-11ee-95c6-87774f69a715... 2024-03-04T09:12:34.551 INFO:journalctl@ceph.mds.l.smithi190.stdout:Mar 04 09:12:34 smithi190 podman[66646]: 2024-03-04 09:12:34.187115961 +0000 UTC m=+0.018499458 image pull f88ffb32aa6a7d5dfdc954d9f096f0c9cc47981d05ec8d117ba859a22d8185ba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5 2024-03-04T09:12:34.551 INFO:journalctl@ceph.mds.l.smithi190.stdout:Mar 04 09:12:34 smithi190 podman[66646]: 2024-03-04 09:12:34.302670104 +0000 UTC m=+0.134053595 container create a8098d38027e9e7748d6d16cd38df20a9b14994c2443409ac3f33c5ca010912b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-l, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-03-04T09:12:34.921 INFO:journalctl@ceph.mds.l.smithi190.stdout:Mar 04 09:12:34 smithi190 podman[66646]: 2024-03-04 09:12:34.555414765 +0000 UTC m=+0.386798260 container init a8098d38027e9e7748d6d16cd38df20a9b14994c2443409ac3f33c5ca010912b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-l, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240222, RELEASE=wip-lusov-qdb-1bc250c, CEPH_POINT_RELEASE=) 2024-03-04T09:12:34.921 INFO:journalctl@ceph.mds.l.smithi190.stdout:Mar 04 09:12:34 smithi190 podman[66646]: 2024-03-04 09:12:34.558359924 +0000 UTC m=+0.389743422 container start a8098d38027e9e7748d6d16cd38df20a9b14994c2443409ac3f33c5ca010912b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-l, RELEASE=wip-lusov-qdb-1bc250c, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True) 2024-03-04T09:12:34.921 INFO:journalctl@ceph.mds.l.smithi190.stdout:Mar 04 09:12:34 smithi190 ceph-mds[66665]: -- 172.21.15.190:0/2837498508 <== mon.1 v2:172.21.15.190:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x559d797f7a40 con 0x559d797ca800 2024-03-04T09:12:34.921 INFO:journalctl@ceph.mds.l.smithi190.stdout:Mar 04 09:12:34 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-l[66661]: starting mds.l at 2024-03-04T09:12:34.921 INFO:journalctl@ceph.mds.l.smithi190.stdout:Mar 04 09:12:34 smithi190 bash[66646]: a8098d38027e9e7748d6d16cd38df20a9b14994c2443409ac3f33c5ca010912b 2024-03-04T09:12:34.921 INFO:journalctl@ceph.mds.l.smithi190.stdout:Mar 04 09:12:34 smithi190 systemd[1]: Started Ceph mds.l for 2e533fc8-da06-11ee-95c6-87774f69a715. 2024-03-04T09:12:35.121 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T09:12:35.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:35.238+0000 7f5f6a666640 1 -- 172.21.15.82:0/180613862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f641004f0 msgr2=0x7f5f64100910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:35.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:35.238+0000 7f5f6a666640 1 --2- 172.21.15.82:0/180613862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f641004f0 0x7f5f64100910 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5f54009900 tx=0x7f5f5402bc30 comp rx=0 tx=0).stop 2024-03-04T09:12:35.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:35.238+0000 7f5f6a666640 1 -- 172.21.15.82:0/180613862 shutdown_connections 2024-03-04T09:12:35.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:35.238+0000 7f5f6a666640 1 --2- 172.21.15.82:0/180613862 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f641020a0 0x7f5f64108930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:35.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:35.238+0000 7f5f6a666640 1 --2- 172.21.15.82:0/180613862 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5f641016e0 0x7f5f64101b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:35.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:35.238+0000 7f5f6a666640 1 --2- 172.21.15.82:0/180613862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f641004f0 0x7f5f64100910 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:35.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:35.238+0000 7f5f6a666640 1 -- 172.21.15.82:0/180613862 >> 172.21.15.82:0/180613862 conn(0x7f5f640fba60 msgr2=0x7f5f640fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:12:35.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:35.238+0000 7f5f6a666640 1 -- 172.21.15.82:0/180613862 shutdown_connections 2024-03-04T09:12:35.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:35.239+0000 7f5f6a666640 1 -- 172.21.15.82:0/180613862 wait complete. 2024-03-04T09:12:35.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:35.239+0000 7f5f6a666640 1 Processor -- start 2024-03-04T09:12:35.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:35.239+0000 7f5f6a666640 1 -- start start 2024-03-04T09:12:35.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:35.239+0000 7f5f6a666640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f641004f0 0x7f5f64199aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:35.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:35.239+0000 7f5f6a666640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f641016e0 0x7f5f64199fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:35.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:35.239+0000 7f5f6a666640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5f641020a0 0x7f5f641a1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:35.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:35.239+0000 7f5f6a666640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6410c140 con 0x7f5f641004f0 2024-03-04T09:12:35.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:35.239+0000 7f5f6a666640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6410bfc0 con 0x7f5f641016e0 2024-03-04T09:12:35.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:35.239+0000 7f5f6a666640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6410c2c0 con 0x7f5f641020a0 2024-03-04T09:12:35.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:35.240+0000 7f5f63fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f641004f0 0x7f5f64199aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:35.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:35.240+0000 7f5f63fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f641004f0 0x7f5f64199aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58454/0 (socket says 172.21.15.82:58454) 2024-03-04T09:12:35.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:35.240+0000 7f5f63fff640 1 -- 172.21.15.82:0/3937080661 learned_addr learned my addr 172.21.15.82:0/3937080661 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:12:35.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:35.240+0000 7f5f637fe640 1 --2- 172.21.15.82:0/3937080661 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f641016e0 0x7f5f64199fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:35.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:35.240+0000 7f5f68c03640 1 --2- 172.21.15.82:0/3937080661 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5f641020a0 0x7f5f641a1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:35.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:35.240+0000 7f5f63fff640 1 -- 172.21.15.82:0/3937080661 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5f641020a0 msgr2=0x7f5f641a1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:35.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:35.240+0000 7f5f63fff640 1 --2- 172.21.15.82:0/3937080661 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5f641020a0 0x7f5f641a1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:35.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:35.240+0000 7f5f63fff640 1 -- 172.21.15.82:0/3937080661 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f641016e0 msgr2=0x7f5f64199fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:35.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:35.240+0000 7f5f63fff640 1 --2- 172.21.15.82:0/3937080661 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f641016e0 0x7f5f64199fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:35.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:35.240+0000 7f5f63fff640 1 -- 172.21.15.82:0/3937080661 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f641a16c0 con 0x7f5f641004f0 2024-03-04T09:12:35.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:35.240+0000 7f5f63fff640 1 --2- 172.21.15.82:0/3937080661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f641004f0 0x7f5f64199aa0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5f54005ab0 tx=0x7f5f54004e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:12:35.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:35.240+0000 7f5f617fa640 1 -- 172.21.15.82:0/3937080661 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f54043020 con 0x7f5f641004f0 2024-03-04T09:12:35.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:35.240+0000 7f5f6a666640 1 -- 172.21.15.82:0/3937080661 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f641a1950 con 0x7f5f641004f0 2024-03-04T09:12:35.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:35.240+0000 7f5f617fa640 1 -- 172.21.15.82:0/3937080661 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f5f540054f0 con 0x7f5f641004f0 2024-03-04T09:12:35.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:35.240+0000 7f5f617fa640 1 -- 172.21.15.82:0/3937080661 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f54003d10 con 0x7f5f641004f0 2024-03-04T09:12:35.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:35.240+0000 7f5f6a666640 1 -- 172.21.15.82:0/3937080661 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f641a1ea0 con 0x7f5f641004f0 2024-03-04T09:12:35.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:35.241+0000 7f5f6a666640 1 -- 172.21.15.82:0/3937080661 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f641a2070 con 0x7f5f641004f0 2024-03-04T09:12:35.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:35.242+0000 7f5f617fa640 1 -- 172.21.15.82:0/3937080661 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f5f54046020 con 0x7f5f641004f0 2024-03-04T09:12:35.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:35.243+0000 7f5f617fa640 1 --2- 172.21.15.82:0/3937080661 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f5f4c0a1d80 0x7f5f4c0a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:35.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:35.243+0000 7f5f637fe640 1 --2- 172.21.15.82:0/3937080661 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f5f4c0a1d80 0x7f5f4c0a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:35.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:35.243+0000 7f5f617fa640 1 -- 172.21.15.82:0/3937080661 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f5f540ef590 con 0x7f5f641004f0 2024-03-04T09:12:35.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:35.244+0000 7f5f637fe640 1 --2- 172.21.15.82:0/3937080661 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f5f4c0a1d80 0x7f5f4c0a4240 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5f6419afb0 tx=0x7f5f5800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:12:35.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:35.248+0000 7f5f617fa640 1 -- 172.21.15.82:0/3937080661 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f5f5404d070 con 0x7f5f641004f0 2024-03-04T09:12:35.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:35.460+0000 7f5f6a666640 1 -- 172.21.15.82:0/3937080661 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5f641a2400 con 0x7f5f641004f0 2024-03-04T09:12:35.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:35.461+0000 7f5f617fa640 1 -- 172.21.15.82:0/3937080661 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1328 (secure 0 0 0) 0x7f5f540bce60 con 0x7f5f641004f0 2024-03-04T09:12:35.457 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:12:35.457 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/3023382814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":3023382814},{"type":"v1","addr":"172.21.15.190:6833","nonce":3023382814}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-03-04T09:12:35.458 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 2 2024-03-04T09:12:35.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:35.463+0000 7f5f6a666640 1 -- 172.21.15.82:0/3937080661 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f5f4c0a1d80 msgr2=0x7f5f4c0a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:35.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:35.463+0000 7f5f6a666640 1 --2- 172.21.15.82:0/3937080661 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f5f4c0a1d80 0x7f5f4c0a4240 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5f6419afb0 tx=0x7f5f5800b390 comp rx=0 tx=0).stop 2024-03-04T09:12:35.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:35.463+0000 7f5f6a666640 1 -- 172.21.15.82:0/3937080661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f641004f0 msgr2=0x7f5f64199aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:35.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:35.463+0000 7f5f6a666640 1 --2- 172.21.15.82:0/3937080661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f641004f0 0x7f5f64199aa0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5f54005ab0 tx=0x7f5f54004e90 comp rx=0 tx=0).stop 2024-03-04T09:12:35.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:35.463+0000 7f5f6a666640 1 -- 172.21.15.82:0/3937080661 shutdown_connections 2024-03-04T09:12:35.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:35.463+0000 7f5f6a666640 1 --2- 172.21.15.82:0/3937080661 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f5f4c0a1d80 0x7f5f4c0a4240 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:35.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:35.463+0000 7f5f6a666640 1 --2- 172.21.15.82:0/3937080661 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5f641020a0 0x7f5f641a1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:35.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:35.463+0000 7f5f6a666640 1 --2- 172.21.15.82:0/3937080661 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f641016e0 0x7f5f64199fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:35.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:35.463+0000 7f5f6a666640 1 --2- 172.21.15.82:0/3937080661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f641004f0 0x7f5f64199aa0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:35.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:35.463+0000 7f5f6a666640 1 -- 172.21.15.82:0/3937080661 >> 172.21.15.82:0/3937080661 conn(0x7f5f640fba60 msgr2=0x7f5f64068730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:12:35.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:35.463+0000 7f5f6a666640 1 -- 172.21.15.82:0/3937080661 shutdown_connections 2024-03-04T09:12:35.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:35.463+0000 7f5f6a666640 1 -- 172.21.15.82:0/3937080661 wait complete. 2024-03-04T09:12:35.469 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:35 smithi082 ceph-mon[32880]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:12:35.469 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:35 smithi082 ceph-mon[32880]: mds.? [v2:172.21.15.190:6832/3023382814,v1:172.21.15.190:6833/3023382814] up:boot 2024-03-04T09:12:35.469 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:35 smithi082 ceph-mon[32880]: fsmap 1 up:standby 2024-03-04T09:12:35.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:35 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-04T09:12:35.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:35 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:35.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:35 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:35.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:35 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:35.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:35 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-04T09:12:35.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:35 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-04T09:12:35.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:35 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:12:35.660 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:35 smithi102 ceph-mon[36220]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:12:35.660 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:35 smithi102 ceph-mon[36220]: mds.? [v2:172.21.15.190:6832/3023382814,v1:172.21.15.190:6833/3023382814] up:boot 2024-03-04T09:12:35.660 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:35 smithi102 ceph-mon[36220]: fsmap 1 up:standby 2024-03-04T09:12:35.660 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:35 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-04T09:12:35.660 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:35 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:35.660 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:35 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:35.661 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:35 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:35.661 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:35 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-04T09:12:35.661 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:35 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-04T09:12:35.661 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:35 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:12:35.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:35 smithi190 ceph-mon[36341]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:12:35.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:35 smithi190 ceph-mon[36341]: mds.? [v2:172.21.15.190:6832/3023382814,v1:172.21.15.190:6833/3023382814] up:boot 2024-03-04T09:12:35.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:35 smithi190 ceph-mon[36341]: fsmap 1 up:standby 2024-03-04T09:12:35.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:35 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-04T09:12:35.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:35 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:35.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:35 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:35.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:35 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:35.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:35 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-04T09:12:35.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:35 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-04T09:12:35.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:35 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:12:36.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:36 smithi190 ceph-mon[36341]: Deploying daemon mds.k on smithi102 2024-03-04T09:12:36.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:36 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/3937080661' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:12:36.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:36 smithi102 ceph-mon[36220]: Deploying daemon mds.k on smithi102 2024-03-04T09:12:36.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:36 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/3937080661' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:12:36.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:36 smithi082 ceph-mon[32880]: Deploying daemon mds.k on smithi102 2024-03-04T09:12:36.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:36 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/3937080661' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:12:37.159 INFO:journalctl@ceph.mds.k.smithi102.stdout:Mar 04 09:12:36 smithi102 systemd[1]: Starting Ceph mds.k for 2e533fc8-da06-11ee-95c6-87774f69a715... 2024-03-04T09:12:37.420 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:37 smithi102 ceph-mon[36220]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:12:37.421 INFO:journalctl@ceph.mds.k.smithi102.stdout:Mar 04 09:12:37 smithi102 podman[64999]: 2024-03-04 09:12:37.066556488 +0000 UTC m=+0.017513298 image pull f88ffb32aa6a7d5dfdc954d9f096f0c9cc47981d05ec8d117ba859a22d8185ba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5 2024-03-04T09:12:37.421 INFO:journalctl@ceph.mds.k.smithi102.stdout:Mar 04 09:12:37 smithi102 podman[64999]: 2024-03-04 09:12:37.189070004 +0000 UTC m=+0.140026803 container create 1650eab41f0d876b04dad939e1cf98553b8241f71d69350568828071e3f5c49c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-k, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-qdb-1bc250c, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-04T09:12:37.472 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T09:12:37.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.591+0000 7f700d3e2640 1 -- 172.21.15.82:0/3017279852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70081020d0 msgr2=0x7f70081044c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:37.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.591+0000 7f700d3e2640 1 --2- 172.21.15.82:0/3017279852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70081020d0 0x7f70081044c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7000009900 tx=0x7f700002bc30 comp rx=0 tx=0).stop 2024-03-04T09:12:37.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.591+0000 7f700d3e2640 1 -- 172.21.15.82:0/3017279852 shutdown_connections 2024-03-04T09:12:37.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.591+0000 7f700d3e2640 1 --2- 172.21.15.82:0/3017279852 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7008107330 0x7f7008109720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:37.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.591+0000 7f700d3e2640 1 --2- 172.21.15.82:0/3017279852 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7008104a00 0x7f7008106df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:37.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.591+0000 7f700d3e2640 1 --2- 172.21.15.82:0/3017279852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70081020d0 0x7f70081044c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:37.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.591+0000 7f700d3e2640 1 -- 172.21.15.82:0/3017279852 >> 172.21.15.82:0/3017279852 conn(0x7f70080fba60 msgr2=0x7f70080fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:12:37.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.592+0000 7f700d3e2640 1 -- 172.21.15.82:0/3017279852 shutdown_connections 2024-03-04T09:12:37.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.592+0000 7f700d3e2640 1 -- 172.21.15.82:0/3017279852 wait complete. 2024-03-04T09:12:37.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.592+0000 7f700d3e2640 1 Processor -- start 2024-03-04T09:12:37.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.592+0000 7f700d3e2640 1 -- start start 2024-03-04T09:12:37.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.592+0000 7f700d3e2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70081020d0 0x7f7008101a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:37.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.593+0000 7f700d3e2640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7008104a00 0x7f7008100080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:37.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.593+0000 7f700d3e2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7008107330 0x7f70081005c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:37.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.593+0000 7f700d3e2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f700810d270 con 0x7f7008107330 2024-03-04T09:12:37.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.593+0000 7f700d3e2640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f700810d0f0 con 0x7f70081020d0 2024-03-04T09:12:37.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.593+0000 7f700d3e2640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f700810d3f0 con 0x7f7008104a00 2024-03-04T09:12:37.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.593+0000 7f70077fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7008107330 0x7f70081005c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:37.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.593+0000 7f7006ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70081020d0 0x7f7008101a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:37.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.593+0000 7f70077fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7008107330 0x7f70081005c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51402/0 (socket says 172.21.15.82:51402) 2024-03-04T09:12:37.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.593+0000 7f70077fe640 1 -- 172.21.15.82:0/979738328 learned_addr learned my addr 172.21.15.82:0/979738328 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:12:37.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.593+0000 7f7006ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70081020d0 0x7f7008101a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.82:57600/0 (socket says 172.21.15.82:57600) 2024-03-04T09:12:37.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.593+0000 7f70067fc640 1 --2- 172.21.15.82:0/979738328 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7008104a00 0x7f7008100080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:37.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.593+0000 7f7006ffd640 1 -- 172.21.15.82:0/979738328 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7008104a00 msgr2=0x7f7008100080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:37.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.593+0000 7f7006ffd640 1 --2- 172.21.15.82:0/979738328 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7008104a00 0x7f7008100080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:37.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.593+0000 7f7006ffd640 1 -- 172.21.15.82:0/979738328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7008107330 msgr2=0x7f70081005c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:37.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.593+0000 7f7006ffd640 1 --2- 172.21.15.82:0/979738328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7008107330 0x7f70081005c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:37.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.593+0000 7f7006ffd640 1 -- 172.21.15.82:0/979738328 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7008100e50 con 0x7f70081020d0 2024-03-04T09:12:37.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.593+0000 7f70077fe640 1 --2- 172.21.15.82:0/979738328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7008107330 0x7f70081005c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:12:37.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.593+0000 7f7006ffd640 1 --2- 172.21.15.82:0/979738328 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70081020d0 0x7f7008101a40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7000009230 tx=0x7f7000004e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:12:37.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.593+0000 7f6feffff640 1 -- 172.21.15.82:0/979738328 <== mon.2 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7000043020 con 0x7f70081020d0 2024-03-04T09:12:37.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.593+0000 7f6feffff640 1 -- 172.21.15.82:0/979738328 <== mon.2 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f70000054f0 con 0x7f70081020d0 2024-03-04T09:12:37.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.593+0000 7f700d3e2640 1 -- 172.21.15.82:0/979738328 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70081a1a60 con 0x7f70081020d0 2024-03-04T09:12:37.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.593+0000 7f6feffff640 1 -- 172.21.15.82:0/979738328 <== mon.2 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7000003d40 con 0x7f70081020d0 2024-03-04T09:12:37.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.593+0000 7f700d3e2640 1 -- 172.21.15.82:0/979738328 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70081a1f80 con 0x7f70081020d0 2024-03-04T09:12:37.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.594+0000 7f700d3e2640 1 -- 172.21.15.82:0/979738328 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70080683c0 con 0x7f70081020d0 2024-03-04T09:12:37.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.595+0000 7f6feffff640 1 -- 172.21.15.82:0/979738328 <== mon.2 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f7000046020 con 0x7f70081020d0 2024-03-04T09:12:37.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.596+0000 7f6feffff640 1 --2- 172.21.15.82:0/979738328 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f6ff00a1d80 0x7f6ff00a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:37.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.596+0000 7f70067fc640 1 --2- 172.21.15.82:0/979738328 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f6ff00a1d80 0x7f6ff00a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:37.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.596+0000 7f6feffff640 1 -- 172.21.15.82:0/979738328 <== mon.2 v2:172.21.15.102:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f70000ef4e0 con 0x7f70081020d0 2024-03-04T09:12:37.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.596+0000 7f70067fc640 1 --2- 172.21.15.82:0/979738328 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f6ff00a1d80 0x7f6ff00a4240 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f70081017b0 tx=0x7f6ffc009680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:12:37.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.601+0000 7f6feffff640 1 -- 172.21.15.82:0/979738328 <== mon.2 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f700004d070 con 0x7f70081020d0 2024-03-04T09:12:37.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:37 smithi190 ceph-mon[36341]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:12:37.679 INFO:journalctl@ceph.mds.k.smithi102.stdout:Mar 04 09:12:37 smithi102 podman[64999]: 2024-03-04 09:12:37.425320412 +0000 UTC m=+0.376277211 container init 1650eab41f0d876b04dad939e1cf98553b8241f71d69350568828071e3f5c49c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-lusov-qdb-1bc250c, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-03-04T09:12:37.679 INFO:journalctl@ceph.mds.k.smithi102.stdout:Mar 04 09:12:37 smithi102 podman[64999]: 2024-03-04 09:12:37.42894584 +0000 UTC m=+0.379902648 container start 1650eab41f0d876b04dad939e1cf98553b8241f71d69350568828071e3f5c49c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-k, RELEASE=wip-lusov-qdb-1bc250c, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-03-04T09:12:37.679 INFO:journalctl@ceph.mds.k.smithi102.stdout:Mar 04 09:12:37 smithi102 ceph-mds[65018]: -- 172.21.15.102:0/3449021283 <== mon.2 v2:172.21.15.102:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c449559a40 con 0x55c44952d000 2024-03-04T09:12:37.679 INFO:journalctl@ceph.mds.k.smithi102.stdout:Mar 04 09:12:37 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-k[65014]: starting mds.k at 2024-03-04T09:12:37.679 INFO:journalctl@ceph.mds.k.smithi102.stdout:Mar 04 09:12:37 smithi102 bash[64999]: 1650eab41f0d876b04dad939e1cf98553b8241f71d69350568828071e3f5c49c 2024-03-04T09:12:37.679 INFO:journalctl@ceph.mds.k.smithi102.stdout:Mar 04 09:12:37 smithi102 systemd[1]: Started Ceph mds.k for 2e533fc8-da06-11ee-95c6-87774f69a715. 2024-03-04T09:12:37.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:37 smithi082 ceph-mon[32880]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:12:37.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.822+0000 7f700d3e2640 1 -- 172.21.15.82:0/979738328 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f700802cff0 con 0x7f70081020d0 2024-03-04T09:12:37.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.823+0000 7f6feffff640 1 -- 172.21.15.82:0/979738328 <== mon.2 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1328 (secure 0 0 0) 0x7f70000dae20 con 0x7f70081020d0 2024-03-04T09:12:37.819 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:12:37.819 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/3023382814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":3023382814},{"type":"v1","addr":"172.21.15.190:6833","nonce":3023382814}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-03-04T09:12:37.820 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 2 2024-03-04T09:12:37.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.825+0000 7f700d3e2640 1 -- 172.21.15.82:0/979738328 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f6ff00a1d80 msgr2=0x7f6ff00a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:37.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.825+0000 7f700d3e2640 1 --2- 172.21.15.82:0/979738328 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f6ff00a1d80 0x7f6ff00a4240 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f70081017b0 tx=0x7f6ffc009680 comp rx=0 tx=0).stop 2024-03-04T09:12:37.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.825+0000 7f700d3e2640 1 -- 172.21.15.82:0/979738328 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70081020d0 msgr2=0x7f7008101a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:37.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.825+0000 7f700d3e2640 1 --2- 172.21.15.82:0/979738328 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70081020d0 0x7f7008101a40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7000009230 tx=0x7f7000004e90 comp rx=0 tx=0).stop 2024-03-04T09:12:37.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.825+0000 7f700d3e2640 1 -- 172.21.15.82:0/979738328 shutdown_connections 2024-03-04T09:12:37.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.825+0000 7f700d3e2640 1 --2- 172.21.15.82:0/979738328 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f6ff00a1d80 0x7f6ff00a4240 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:37.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.825+0000 7f700d3e2640 1 --2- 172.21.15.82:0/979738328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7008107330 0x7f70081005c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:37.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.825+0000 7f700d3e2640 1 --2- 172.21.15.82:0/979738328 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7008104a00 0x7f7008100080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:37.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.825+0000 7f700d3e2640 1 --2- 172.21.15.82:0/979738328 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70081020d0 0x7f7008101a40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:37.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.825+0000 7f700d3e2640 1 -- 172.21.15.82:0/979738328 >> 172.21.15.82:0/979738328 conn(0x7f70080fba60 msgr2=0x7f7008102b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:12:37.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.825+0000 7f700d3e2640 1 -- 172.21.15.82:0/979738328 shutdown_connections 2024-03-04T09:12:37.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:37.825+0000 7f700d3e2640 1 -- 172.21.15.82:0/979738328 wait complete. 2024-03-04T09:12:38.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:38 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:38.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:38 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:38.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:38 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:38.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:38 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-04T09:12:38.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:38 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-04T09:12:38.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:38 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:12:38.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:38 smithi082 ceph-mon[32880]: Deploying daemon mds.j on smithi082 2024-03-04T09:12:38.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:38 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/979738328' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:12:38.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:38 smithi082 ceph-mon[32880]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:12:38.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:38 smithi082 ceph-mon[32880]: mds.? [v2:172.21.15.102:6832/1142302200,v1:172.21.15.102:6833/1142302200] up:boot 2024-03-04T09:12:38.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:38 smithi082 ceph-mon[32880]: fsmap 2 up:standby 2024-03-04T09:12:38.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:38 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-03-04T09:12:38.846 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:38 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:38.847 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:38 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:38.847 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:38 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:38.847 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:38 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-04T09:12:38.847 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:38 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-04T09:12:38.847 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:38 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:12:38.847 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:38 smithi102 ceph-mon[36220]: Deploying daemon mds.j on smithi082 2024-03-04T09:12:38.847 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:38 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/979738328' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:12:38.847 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:38 smithi102 ceph-mon[36220]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:12:38.847 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:38 smithi102 ceph-mon[36220]: mds.? [v2:172.21.15.102:6832/1142302200,v1:172.21.15.102:6833/1142302200] up:boot 2024-03-04T09:12:38.847 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:38 smithi102 ceph-mon[36220]: fsmap 2 up:standby 2024-03-04T09:12:38.847 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:38 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-03-04T09:12:38.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:38 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:38.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:38 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:38.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:38 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:38.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:38 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-04T09:12:38.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:38 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-04T09:12:38.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:38 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:12:38.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:38 smithi190 ceph-mon[36341]: Deploying daemon mds.j on smithi082 2024-03-04T09:12:38.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:38 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/979738328' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:12:38.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:38 smithi190 ceph-mon[36341]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:12:38.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:38 smithi190 ceph-mon[36341]: mds.? [v2:172.21.15.102:6832/1142302200,v1:172.21.15.102:6833/1142302200] up:boot 2024-03-04T09:12:38.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:38 smithi190 ceph-mon[36341]: fsmap 2 up:standby 2024-03-04T09:12:38.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:38 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-03-04T09:12:39.834 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T09:12:39.861 INFO:journalctl@ceph.mds.j.smithi082.stdout:Mar 04 09:12:39 smithi082 systemd[1]: Starting Ceph mds.j for 2e533fc8-da06-11ee-95c6-87774f69a715... 2024-03-04T09:12:39.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:39.946+0000 7f22543d6640 1 -- 172.21.15.82:0/1557616128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f224c1020a0 msgr2=0x7f224c108930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:39.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:39.946+0000 7f22543d6640 1 --2- 172.21.15.82:0/1557616128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f224c1020a0 0x7f224c108930 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2248009900 tx=0x7f224802bc30 comp rx=0 tx=0).stop 2024-03-04T09:12:39.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:39.946+0000 7f22543d6640 1 -- 172.21.15.82:0/1557616128 shutdown_connections 2024-03-04T09:12:39.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:39.946+0000 7f22543d6640 1 --2- 172.21.15.82:0/1557616128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f224c1020a0 0x7f224c108930 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:39.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:39.946+0000 7f22543d6640 1 --2- 172.21.15.82:0/1557616128 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f224c1016e0 0x7f224c101b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:39.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:39.946+0000 7f22543d6640 1 --2- 172.21.15.82:0/1557616128 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f224c1004f0 0x7f224c100910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:39.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:39.946+0000 7f22543d6640 1 -- 172.21.15.82:0/1557616128 >> 172.21.15.82:0/1557616128 conn(0x7f224c0fba60 msgr2=0x7f224c0fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:12:39.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:39.946+0000 7f22543d6640 1 -- 172.21.15.82:0/1557616128 shutdown_connections 2024-03-04T09:12:39.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:39.947+0000 7f22543d6640 1 -- 172.21.15.82:0/1557616128 wait complete. 2024-03-04T09:12:39.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:39.947+0000 7f22543d6640 1 Processor -- start 2024-03-04T09:12:39.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:39.947+0000 7f22543d6640 1 -- start start 2024-03-04T09:12:39.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:39.947+0000 7f22543d6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f224c1004f0 0x7f224c1978f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:39.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:39.947+0000 7f22543d6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f224c1016e0 0x7f224c197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:39.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:39.947+0000 7f22543d6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f224c1020a0 0x7f224c19eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:39.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:39.947+0000 7f22543d6640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224c10c150 con 0x7f224c1004f0 2024-03-04T09:12:39.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:39.947+0000 7f22543d6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224c10bfd0 con 0x7f224c1016e0 2024-03-04T09:12:39.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:39.947+0000 7f22543d6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224c10c2d0 con 0x7f224c1020a0 2024-03-04T09:12:39.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:39.947+0000 7f2252172640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f224c1004f0 0x7f224c1978f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:39.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:39.947+0000 7f2252172640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f224c1004f0 0x7f224c1978f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51424/0 (socket says 172.21.15.82:51424) 2024-03-04T09:12:39.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:39.947+0000 7f2252172640 1 -- 172.21.15.82:0/1546162859 learned_addr learned my addr 172.21.15.82:0/1546162859 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:12:39.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:39.947+0000 7f2251971640 1 --2- 172.21.15.82:0/1546162859 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f224c1016e0 0x7f224c197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:39.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:39.947+0000 7f2252172640 1 -- 172.21.15.82:0/1546162859 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f224c1020a0 msgr2=0x7f224c19eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:39.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:39.947+0000 7f2252172640 1 --2- 172.21.15.82:0/1546162859 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f224c1020a0 0x7f224c19eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:39.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:39.947+0000 7f2252172640 1 -- 172.21.15.82:0/1546162859 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f224c1016e0 msgr2=0x7f224c197e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:39.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:39.947+0000 7f2252172640 1 --2- 172.21.15.82:0/1546162859 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f224c1016e0 0x7f224c197e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:39.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:39.948+0000 7f2252172640 1 -- 172.21.15.82:0/1546162859 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f224c19f510 con 0x7f224c1004f0 2024-03-04T09:12:39.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:39.948+0000 7f2252172640 1 --2- 172.21.15.82:0/1546162859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f224c1004f0 0x7f224c1978f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f224400ccb0 tx=0x7f224400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:12:39.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:39.948+0000 7f22437fe640 1 -- 172.21.15.82:0/1546162859 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2244004b20 con 0x7f224c1004f0 2024-03-04T09:12:39.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:39.948+0000 7f22543d6640 1 -- 172.21.15.82:0/1546162859 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f224c19f800 con 0x7f224c1004f0 2024-03-04T09:12:39.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:39.948+0000 7f22437fe640 1 -- 172.21.15.82:0/1546162859 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f2244004cc0 con 0x7f224c1004f0 2024-03-04T09:12:39.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:39.948+0000 7f22437fe640 1 -- 172.21.15.82:0/1546162859 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2244005020 con 0x7f224c1004f0 2024-03-04T09:12:39.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:39.948+0000 7f22543d6640 1 -- 172.21.15.82:0/1546162859 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f224c19fd50 con 0x7f224c1004f0 2024-03-04T09:12:39.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:39.949+0000 7f22543d6640 1 -- 172.21.15.82:0/1546162859 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f224c1a0010 con 0x7f224c1004f0 2024-03-04T09:12:39.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:39.950+0000 7f22437fe640 1 -- 172.21.15.82:0/1546162859 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f2244003990 con 0x7f224c1004f0 2024-03-04T09:12:39.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:39.950+0000 7f22437fe640 1 --2- 172.21.15.82:0/1546162859 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f22380a1d80 0x7f22380a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:39.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:39.950+0000 7f2251971640 1 --2- 172.21.15.82:0/1546162859 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f22380a1d80 0x7f22380a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:39.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:39.950+0000 7f22437fe640 1 -- 172.21.15.82:0/1546162859 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f22440cdea0 con 0x7f224c1004f0 2024-03-04T09:12:39.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:39.951+0000 7f2251971640 1 --2- 172.21.15.82:0/1546162859 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f22380a1d80 0x7f22380a4240 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f224c198e00 tx=0x7f223c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:12:39.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:39.954+0000 7f22437fe640 1 -- 172.21.15.82:0/1546162859 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f2244014030 con 0x7f224c1004f0 2024-03-04T09:12:40.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:40.173+0000 7f22543d6640 1 -- 172.21.15.82:0/1546162859 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f224c1a01e0 con 0x7f224c1004f0 2024-03-04T09:12:40.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:40.173+0000 7f22437fe640 1 -- 172.21.15.82:0/1546162859 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2122 (secure 0 0 0) 0x7f224409b770 con 0x7f224c1004f0 2024-03-04T09:12:40.170 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:12:40.170 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/1142302200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":1142302200},{"type":"v1","addr":"172.21.15.102:6833","nonce":1142302200}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/3023382814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":3023382814},{"type":"v1","addr":"172.21.15.190:6833","nonce":3023382814}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-03-04T09:12:40.170 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 3 2024-03-04T09:12:40.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:40.175+0000 7f22543d6640 1 -- 172.21.15.82:0/1546162859 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f22380a1d80 msgr2=0x7f22380a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:40.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:40.175+0000 7f22543d6640 1 --2- 172.21.15.82:0/1546162859 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f22380a1d80 0x7f22380a4240 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f224c198e00 tx=0x7f223c00b410 comp rx=0 tx=0).stop 2024-03-04T09:12:40.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:40.175+0000 7f22543d6640 1 -- 172.21.15.82:0/1546162859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f224c1004f0 msgr2=0x7f224c1978f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:40.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:40.175+0000 7f22543d6640 1 --2- 172.21.15.82:0/1546162859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f224c1004f0 0x7f224c1978f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f224400ccb0 tx=0x7f224400a620 comp rx=0 tx=0).stop 2024-03-04T09:12:40.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:40.175+0000 7f22543d6640 1 -- 172.21.15.82:0/1546162859 shutdown_connections 2024-03-04T09:12:40.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:40.175+0000 7f22543d6640 1 --2- 172.21.15.82:0/1546162859 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f22380a1d80 0x7f22380a4240 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:40.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:40.175+0000 7f22543d6640 1 --2- 172.21.15.82:0/1546162859 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f224c1020a0 0x7f224c19eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:40.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:40.175+0000 7f22543d6640 1 --2- 172.21.15.82:0/1546162859 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f224c1016e0 0x7f224c197e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:40.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:40.175+0000 7f22543d6640 1 --2- 172.21.15.82:0/1546162859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f224c1004f0 0x7f224c1978f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:40.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:40.175+0000 7f22543d6640 1 -- 172.21.15.82:0/1546162859 >> 172.21.15.82:0/1546162859 conn(0x7f224c0fba60 msgr2=0x7f224c0fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:12:40.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:40.175+0000 7f22543d6640 1 -- 172.21.15.82:0/1546162859 shutdown_connections 2024-03-04T09:12:40.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:40.175+0000 7f22543d6640 1 -- 172.21.15.82:0/1546162859 wait complete. 2024-03-04T09:12:40.181 INFO:journalctl@ceph.mds.j.smithi082.stdout:Mar 04 09:12:39 smithi082 podman[72952]: 2024-03-04 09:12:39.961269317 +0000 UTC m=+0.105604686 container create 915a00d14ff39821a1617410d0397f999ed6e11ffe89f02ee4eb806104794234 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-j, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-04T09:12:40.181 INFO:journalctl@ceph.mds.j.smithi082.stdout:Mar 04 09:12:39 smithi082 podman[72952]: 2024-03-04 09:12:39.874511128 +0000 UTC m=+0.018846496 image pull f88ffb32aa6a7d5dfdc954d9f096f0c9cc47981d05ec8d117ba859a22d8185ba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5 2024-03-04T09:12:40.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:40 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/1546162859' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:12:40.567 INFO:journalctl@ceph.mds.j.smithi082.stdout:Mar 04 09:12:40 smithi082 podman[72952]: 2024-03-04 09:12:40.230570334 +0000 UTC m=+0.374905716 container init 915a00d14ff39821a1617410d0397f999ed6e11ffe89f02ee4eb806104794234 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-j, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-04T09:12:40.567 INFO:journalctl@ceph.mds.j.smithi082.stdout:Mar 04 09:12:40 smithi082 podman[72952]: 2024-03-04 09:12:40.233447391 +0000 UTC m=+0.377782768 container start 915a00d14ff39821a1617410d0397f999ed6e11ffe89f02ee4eb806104794234 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-j, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-03-04T09:12:40.567 INFO:journalctl@ceph.mds.j.smithi082.stdout:Mar 04 09:12:40 smithi082 ceph-mds[72998]: -- 172.21.15.82:0/353835188 <== mon.0 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5584527d7a40 con 0x5584527ab000 2024-03-04T09:12:40.567 INFO:journalctl@ceph.mds.j.smithi082.stdout:Mar 04 09:12:40 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-j[72992]: starting mds.j at 2024-03-04T09:12:40.568 INFO:journalctl@ceph.mds.j.smithi082.stdout:Mar 04 09:12:40 smithi082 bash[72952]: 915a00d14ff39821a1617410d0397f999ed6e11ffe89f02ee4eb806104794234 2024-03-04T09:12:40.568 INFO:journalctl@ceph.mds.j.smithi082.stdout:Mar 04 09:12:40 smithi082 systemd[1]: Started Ceph mds.j for 2e533fc8-da06-11ee-95c6-87774f69a715. 2024-03-04T09:12:40.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:40 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/1546162859' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:12:40.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:40 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/1546162859' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:12:41.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:41 smithi190 ceph-mon[36341]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:12:41.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:41 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:41.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:41 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:41.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:41 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:41.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:41 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-04T09:12:41.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:41 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-04T09:12:41.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:41 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:12:41.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:41 smithi190 ceph-mon[36341]: mds.? [v2:172.21.15.82:6834/3123844705,v1:172.21.15.82:6835/3123844705] up:boot 2024-03-04T09:12:41.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:41 smithi190 ceph-mon[36341]: fsmap 3 up:standby 2024-03-04T09:12:41.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:41 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-03-04T09:12:41.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:41 smithi102 ceph-mon[36220]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:12:41.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:41 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:41.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:41 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:41.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:41 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:41.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:41 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-04T09:12:41.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:41 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-04T09:12:41.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:41 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:12:41.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:41 smithi102 ceph-mon[36220]: mds.? [v2:172.21.15.82:6834/3123844705,v1:172.21.15.82:6835/3123844705] up:boot 2024-03-04T09:12:41.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:41 smithi102 ceph-mon[36220]: fsmap 3 up:standby 2024-03-04T09:12:41.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:41 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-03-04T09:12:41.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:41 smithi082 ceph-mon[32880]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:12:41.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:41 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:41.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:41 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:41.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:41 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:41.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:41 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-04T09:12:41.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:41 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-04T09:12:41.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:41 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:12:41.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:41 smithi082 ceph-mon[32880]: mds.? [v2:172.21.15.82:6834/3123844705,v1:172.21.15.82:6835/3123844705] up:boot 2024-03-04T09:12:41.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:41 smithi082 ceph-mon[32880]: fsmap 3 up:standby 2024-03-04T09:12:41.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:41 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-03-04T09:12:42.183 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T09:12:42.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.450+0000 7f5924a78640 1 -- 172.21.15.82:0/2841108539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59201020a0 msgr2=0x7f5920108930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:42.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.450+0000 7f5924a78640 1 --2- 172.21.15.82:0/2841108539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59201020a0 0x7f5920108930 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5918009ca0 tx=0x7f591802c0f0 comp rx=0 tx=0).stop 2024-03-04T09:12:42.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.450+0000 7f5924a78640 1 -- 172.21.15.82:0/2841108539 shutdown_connections 2024-03-04T09:12:42.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.450+0000 7f5924a78640 1 --2- 172.21.15.82:0/2841108539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59201020a0 0x7f5920108930 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:42.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.450+0000 7f5924a78640 1 --2- 172.21.15.82:0/2841108539 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59201016e0 0x7f5920101b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:42.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.450+0000 7f5924a78640 1 --2- 172.21.15.82:0/2841108539 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f59201004f0 0x7f5920100910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:42.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.450+0000 7f5924a78640 1 -- 172.21.15.82:0/2841108539 >> 172.21.15.82:0/2841108539 conn(0x7f59200fba60 msgr2=0x7f59200fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:12:42.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.450+0000 7f5924a78640 1 -- 172.21.15.82:0/2841108539 shutdown_connections 2024-03-04T09:12:42.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.450+0000 7f5924a78640 1 -- 172.21.15.82:0/2841108539 wait complete. 2024-03-04T09:12:42.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.451+0000 7f5924a78640 1 Processor -- start 2024-03-04T09:12:42.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.451+0000 7f5924a78640 1 -- start start 2024-03-04T09:12:42.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.451+0000 7f5924a78640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59201004f0 0x7f5920196790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:42.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.451+0000 7f5924a78640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f59201016e0 0x7f5920196cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:42.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.451+0000 7f5924a78640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59201020a0 0x7f592019dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:42.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.451+0000 7f5924a78640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592010c150 con 0x7f59201004f0 2024-03-04T09:12:42.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.451+0000 7f5924a78640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592010bfd0 con 0x7f59201020a0 2024-03-04T09:12:42.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.451+0000 7f5924a78640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592010c2d0 con 0x7f59201016e0 2024-03-04T09:12:42.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.451+0000 7f591e59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59201004f0 0x7f5920196790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:42.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.451+0000 7f591e59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59201004f0 0x7f5920196790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51464/0 (socket says 172.21.15.82:51464) 2024-03-04T09:12:42.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.451+0000 7f591e59c640 1 -- 172.21.15.82:0/1960335876 learned_addr learned my addr 172.21.15.82:0/1960335876 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:12:42.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.452+0000 7f5917fff640 1 --2- 172.21.15.82:0/1960335876 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f59201016e0 0x7f5920196cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:42.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.452+0000 7f591ed9d640 1 --2- 172.21.15.82:0/1960335876 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59201020a0 0x7f592019dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:42.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.452+0000 7f591e59c640 1 -- 172.21.15.82:0/1960335876 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f59201016e0 msgr2=0x7f5920196cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:42.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.452+0000 7f591e59c640 1 --2- 172.21.15.82:0/1960335876 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f59201016e0 0x7f5920196cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:42.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.452+0000 7f591e59c640 1 -- 172.21.15.82:0/1960335876 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59201020a0 msgr2=0x7f592019dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:42.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.452+0000 7f591e59c640 1 --2- 172.21.15.82:0/1960335876 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59201020a0 0x7f592019dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:42.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.452+0000 7f591e59c640 1 -- 172.21.15.82:0/1960335876 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f592019e3b0 con 0x7f59201004f0 2024-03-04T09:12:42.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.452+0000 7f591ed9d640 1 --2- 172.21.15.82:0/1960335876 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59201020a0 0x7f592019dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T09:12:42.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.452+0000 7f591e59c640 1 --2- 172.21.15.82:0/1960335876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59201004f0 0x7f5920196790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f591000c970 tx=0x7f591000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:12:42.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.452+0000 7f59177fe640 1 -- 172.21.15.82:0/1960335876 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5910004220 con 0x7f59201004f0 2024-03-04T09:12:42.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.452+0000 7f59177fe640 1 -- 172.21.15.82:0/1960335876 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f59100043c0 con 0x7f59201004f0 2024-03-04T09:12:42.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.452+0000 7f5924a78640 1 -- 172.21.15.82:0/1960335876 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f592019e6a0 con 0x7f59201004f0 2024-03-04T09:12:42.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.452+0000 7f59177fe640 1 -- 172.21.15.82:0/1960335876 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5910004a00 con 0x7f59201004f0 2024-03-04T09:12:42.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.452+0000 7f5924a78640 1 -- 172.21.15.82:0/1960335876 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f592019ebf0 con 0x7f59201004f0 2024-03-04T09:12:42.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.453+0000 7f5924a78640 1 -- 172.21.15.82:0/1960335876 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5920107810 con 0x7f59201004f0 2024-03-04T09:12:42.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.454+0000 7f59177fe640 1 -- 172.21.15.82:0/1960335876 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f5910004ba0 con 0x7f59201004f0 2024-03-04T09:12:42.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.455+0000 7f59177fe640 1 --2- 172.21.15.82:0/1960335876 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f590c0a1e00 0x7f590c0a42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:42.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.455+0000 7f59177fe640 1 -- 172.21.15.82:0/1960335876 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f59100cda50 con 0x7f59201004f0 2024-03-04T09:12:42.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.455+0000 7f5917fff640 1 --2- 172.21.15.82:0/1960335876 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f590c0a1e00 0x7f590c0a42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:42.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.455+0000 7f5917fff640 1 --2- 172.21.15.82:0/1960335876 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f590c0a1e00 0x7f590c0a42c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5920197ca0 tx=0x7f5908005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:12:42.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.458+0000 7f59177fe640 1 -- 172.21.15.82:0/1960335876 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f5910014030 con 0x7f59201004f0 2024-03-04T09:12:42.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:42 smithi190 ceph-mon[36341]: Deploying daemon mds.d on smithi082 2024-03-04T09:12:42.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.681+0000 7f5924a78640 1 -- 172.21.15.82:0/1960335876 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f592002cff0 con 0x7f59201004f0 2024-03-04T09:12:42.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.682+0000 7f59177fe640 1 -- 172.21.15.82:0/1960335876 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2913 (secure 0 0 0) 0x7f591009b3a0 con 0x7f59201004f0 2024-03-04T09:12:42.678 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:12:42.679 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3123844705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3123844705},{"type":"v1","addr":"172.21.15.82:6835","nonce":3123844705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/1142302200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":1142302200},{"type":"v1","addr":"172.21.15.102:6833","nonce":1142302200}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/3023382814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":3023382814},{"type":"v1","addr":"172.21.15.190:6833","nonce":3023382814}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-03-04T09:12:42.679 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 4 2024-03-04T09:12:42.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:42 smithi102 ceph-mon[36220]: Deploying daemon mds.d on smithi082 2024-03-04T09:12:42.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.684+0000 7f5924a78640 1 -- 172.21.15.82:0/1960335876 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f590c0a1e00 msgr2=0x7f590c0a42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:42.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.684+0000 7f5924a78640 1 --2- 172.21.15.82:0/1960335876 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f590c0a1e00 0x7f590c0a42c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5920197ca0 tx=0x7f5908005f90 comp rx=0 tx=0).stop 2024-03-04T09:12:42.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.684+0000 7f5924a78640 1 -- 172.21.15.82:0/1960335876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59201004f0 msgr2=0x7f5920196790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:42.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.684+0000 7f5924a78640 1 --2- 172.21.15.82:0/1960335876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59201004f0 0x7f5920196790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f591000c970 tx=0x7f591000ce30 comp rx=0 tx=0).stop 2024-03-04T09:12:42.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.684+0000 7f5924a78640 1 -- 172.21.15.82:0/1960335876 shutdown_connections 2024-03-04T09:12:42.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.684+0000 7f5924a78640 1 --2- 172.21.15.82:0/1960335876 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f590c0a1e00 0x7f590c0a42c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:42.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.684+0000 7f5924a78640 1 --2- 172.21.15.82:0/1960335876 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59201020a0 0x7f592019dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:42.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.684+0000 7f5924a78640 1 --2- 172.21.15.82:0/1960335876 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f59201016e0 0x7f5920196cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:42.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.684+0000 7f5924a78640 1 --2- 172.21.15.82:0/1960335876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59201004f0 0x7f5920196790 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:42.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.684+0000 7f5924a78640 1 -- 172.21.15.82:0/1960335876 >> 172.21.15.82:0/1960335876 conn(0x7f59200fba60 msgr2=0x7f59201049e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:12:42.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.684+0000 7f5924a78640 1 -- 172.21.15.82:0/1960335876 shutdown_connections 2024-03-04T09:12:42.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:42.684+0000 7f5924a78640 1 -- 172.21.15.82:0/1960335876 wait complete. 2024-03-04T09:12:42.691 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:42 smithi082 ceph-mon[32880]: Deploying daemon mds.d on smithi082 2024-03-04T09:12:43.317 INFO:journalctl@ceph.mds.d.smithi082.stdout:Mar 04 09:12:43 smithi082 systemd[1]: Started Ceph mds.d for 2e533fc8-da06-11ee-95c6-87774f69a715. 2024-03-04T09:12:43.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:43 smithi190 ceph-mon[36341]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:12:43.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:43 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/1960335876' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:12:43.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:43 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:43.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:43 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:43.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:43 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:43.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:43 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-04T09:12:43.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:43 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-04T09:12:43.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:43 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:12:43.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:43 smithi102 ceph-mon[36220]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:12:43.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:43 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/1960335876' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:12:43.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:43 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:43.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:43 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:43.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:43 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:43.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:43 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-04T09:12:43.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:43 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-04T09:12:43.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:43 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:12:43.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:43 smithi082 ceph-mon[32880]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:12:43.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:43 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/1960335876' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:12:43.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:43 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:43.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:43 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:43.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:43 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:43.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:43 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-04T09:12:43.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:43 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-04T09:12:43.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:43 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:12:44.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:44 smithi190 ceph-mon[36341]: Deploying daemon mds.e on smithi102 2024-03-04T09:12:44.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:44 smithi190 ceph-mon[36341]: mds.? [v2:172.21.15.82:6836/2620634252,v1:172.21.15.82:6837/2620634252] up:boot 2024-03-04T09:12:44.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:44 smithi190 ceph-mon[36341]: fsmap 4 up:standby 2024-03-04T09:12:44.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:44 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-03-04T09:12:44.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:44 smithi102 ceph-mon[36220]: Deploying daemon mds.e on smithi102 2024-03-04T09:12:44.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:44 smithi102 ceph-mon[36220]: mds.? [v2:172.21.15.82:6836/2620634252,v1:172.21.15.82:6837/2620634252] up:boot 2024-03-04T09:12:44.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:44 smithi102 ceph-mon[36220]: fsmap 4 up:standby 2024-03-04T09:12:44.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:44 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-03-04T09:12:44.694 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T09:12:44.725 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:44 smithi082 ceph-mon[32880]: Deploying daemon mds.e on smithi102 2024-03-04T09:12:44.725 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:44 smithi082 ceph-mon[32880]: mds.? [v2:172.21.15.82:6836/2620634252,v1:172.21.15.82:6837/2620634252] up:boot 2024-03-04T09:12:44.725 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:44 smithi082 ceph-mon[32880]: fsmap 4 up:standby 2024-03-04T09:12:44.725 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:44 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-03-04T09:12:44.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:44.814+0000 7f74febe9640 1 -- 172.21.15.82:0/2964460081 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74f8104a20 msgr2=0x7f74f8106e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:44.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:44.814+0000 7f74febe9640 1 --2- 172.21.15.82:0/2964460081 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74f8104a20 0x7f74f8106e10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f74e4009900 tx=0x7f74e402bc30 comp rx=0 tx=0).stop 2024-03-04T09:12:44.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:44.814+0000 7f74febe9640 1 -- 172.21.15.82:0/2964460081 shutdown_connections 2024-03-04T09:12:44.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:44.814+0000 7f74febe9640 1 --2- 172.21.15.82:0/2964460081 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f74f8107350 0x7f74f8109740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:44.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:44.814+0000 7f74febe9640 1 --2- 172.21.15.82:0/2964460081 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74f8104a20 0x7f74f8106e10 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:44.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:44.814+0000 7f74febe9640 1 --2- 172.21.15.82:0/2964460081 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74f81020f0 0x7f74f81044e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:44.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:44.814+0000 7f74febe9640 1 -- 172.21.15.82:0/2964460081 >> 172.21.15.82:0/2964460081 conn(0x7f74f80fba60 msgr2=0x7f74f80fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:12:44.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:44.814+0000 7f74febe9640 1 -- 172.21.15.82:0/2964460081 shutdown_connections 2024-03-04T09:12:44.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:44.814+0000 7f74febe9640 1 -- 172.21.15.82:0/2964460081 wait complete. 2024-03-04T09:12:44.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:44.815+0000 7f74febe9640 1 Processor -- start 2024-03-04T09:12:44.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:44.815+0000 7f74febe9640 1 -- start start 2024-03-04T09:12:44.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:44.815+0000 7f74febe9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74f81020f0 0x7f74f8197970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:44.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:44.815+0000 7f74febe9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74f8104a20 0x7f74f8197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:44.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:44.815+0000 7f74febe9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f74f8107350 0x7f74f819ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:44.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:44.815+0000 7f74febe9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f810d300 con 0x7f74f8104a20 2024-03-04T09:12:44.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:44.815+0000 7f74febe9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f810d180 con 0x7f74f81020f0 2024-03-04T09:12:44.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:44.815+0000 7f74febe9640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f810d480 con 0x7f74f8107350 2024-03-04T09:12:44.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:44.815+0000 7f74f7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74f8104a20 0x7f74f8197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:44.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:44.815+0000 7f74f7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74f8104a20 0x7f74f8197eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51486/0 (socket says 172.21.15.82:51486) 2024-03-04T09:12:44.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:44.815+0000 7f74f7fff640 1 -- 172.21.15.82:0/2420447417 learned_addr learned my addr 172.21.15.82:0/2420447417 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:12:44.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:44.815+0000 7f74fc985640 1 --2- 172.21.15.82:0/2420447417 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74f81020f0 0x7f74f8197970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:44.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:44.815+0000 7f74f7fff640 1 -- 172.21.15.82:0/2420447417 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f74f8107350 msgr2=0x7f74f819ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:44.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:44.815+0000 7f74f7fff640 1 --2- 172.21.15.82:0/2420447417 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f74f8107350 0x7f74f819ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:44.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:44.815+0000 7f74f7fff640 1 -- 172.21.15.82:0/2420447417 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74f81020f0 msgr2=0x7f74f8197970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:44.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:44.815+0000 7f74f7fff640 1 --2- 172.21.15.82:0/2420447417 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74f81020f0 0x7f74f8197970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:44.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:44.815+0000 7f74f7fff640 1 -- 172.21.15.82:0/2420447417 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f819f590 con 0x7f74f8104a20 2024-03-04T09:12:44.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:44.815+0000 7f74f7fff640 1 --2- 172.21.15.82:0/2420447417 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74f8104a20 0x7f74f8197eb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f74e402c170 tx=0x7f74e4004f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:12:44.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:44.816+0000 7f74f5ffb640 1 -- 172.21.15.82:0/2420447417 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e4043020 con 0x7f74f8104a20 2024-03-04T09:12:44.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:44.816+0000 7f74f5ffb640 1 -- 172.21.15.82:0/2420447417 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f74e4004410 con 0x7f74f8104a20 2024-03-04T09:12:44.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:44.816+0000 7f74f5ffb640 1 -- 172.21.15.82:0/2420447417 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e4003df0 con 0x7f74f8104a20 2024-03-04T09:12:44.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:44.816+0000 7f74febe9640 1 -- 172.21.15.82:0/2420447417 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74f819f820 con 0x7f74f8104a20 2024-03-04T09:12:44.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:44.816+0000 7f74febe9640 1 -- 172.21.15.82:0/2420447417 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74f819fe40 con 0x7f74f8104a20 2024-03-04T09:12:44.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:44.817+0000 7f74febe9640 1 -- 172.21.15.82:0/2420447417 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74f80fd550 con 0x7f74f8104a20 2024-03-04T09:12:44.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:44.818+0000 7f74f5ffb640 1 -- 172.21.15.82:0/2420447417 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f74e4046020 con 0x7f74f8104a20 2024-03-04T09:12:44.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:44.818+0000 7f74f5ffb640 1 --2- 172.21.15.82:0/2420447417 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f74e80a1e00 0x7f74e80a42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:44.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:44.819+0000 7f74fc985640 1 --2- 172.21.15.82:0/2420447417 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f74e80a1e00 0x7f74e80a42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:44.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:44.819+0000 7f74f5ffb640 1 -- 172.21.15.82:0/2420447417 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f74e40efe10 con 0x7f74f8104a20 2024-03-04T09:12:44.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:44.819+0000 7f74fc985640 1 --2- 172.21.15.82:0/2420447417 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f74e80a1e00 0x7f74e80a42c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f74ec0058c0 tx=0x7f74ec005c60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:12:44.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:44.823+0000 7f74f5ffb640 1 -- 172.21.15.82:0/2420447417 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f74e404d020 con 0x7f74f8104a20 2024-03-04T09:12:45.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:45.033+0000 7f74febe9640 1 -- 172.21.15.82:0/2420447417 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f74f802cff0 con 0x7f74f8104a20 2024-03-04T09:12:45.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:45.034+0000 7f74f5ffb640 1 -- 172.21.15.82:0/2420447417 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+3704 (secure 0 0 0) 0x7f74e40bd6e0 con 0x7f74f8104a20 2024-03-04T09:12:45.031 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:12:45.031 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3123844705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3123844705},{"type":"v1","addr":"172.21.15.82:6835","nonce":3123844705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2620634252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2620634252},{"type":"v1","addr":"172.21.15.82:6837","nonce":2620634252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/1142302200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":1142302200},{"type":"v1","addr":"172.21.15.102:6833","nonce":1142302200}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/3023382814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":3023382814},{"type":"v1","addr":"172.21.15.190:6833","nonce":3023382814}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-03-04T09:12:45.031 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 5 2024-03-04T09:12:45.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:45.036+0000 7f74febe9640 1 -- 172.21.15.82:0/2420447417 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f74e80a1e00 msgr2=0x7f74e80a42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:45.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:45.036+0000 7f74febe9640 1 --2- 172.21.15.82:0/2420447417 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f74e80a1e00 0x7f74e80a42c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f74ec0058c0 tx=0x7f74ec005c60 comp rx=0 tx=0).stop 2024-03-04T09:12:45.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:45.036+0000 7f74febe9640 1 -- 172.21.15.82:0/2420447417 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74f8104a20 msgr2=0x7f74f8197eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:45.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:45.036+0000 7f74febe9640 1 --2- 172.21.15.82:0/2420447417 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74f8104a20 0x7f74f8197eb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f74e402c170 tx=0x7f74e4004f10 comp rx=0 tx=0).stop 2024-03-04T09:12:45.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:45.036+0000 7f74febe9640 1 -- 172.21.15.82:0/2420447417 shutdown_connections 2024-03-04T09:12:45.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:45.036+0000 7f74febe9640 1 --2- 172.21.15.82:0/2420447417 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f74e80a1e00 0x7f74e80a42c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:45.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:45.036+0000 7f74febe9640 1 --2- 172.21.15.82:0/2420447417 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f74f8107350 0x7f74f819ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:45.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:45.036+0000 7f74febe9640 1 --2- 172.21.15.82:0/2420447417 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74f8104a20 0x7f74f8197eb0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:45.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:45.036+0000 7f74febe9640 1 --2- 172.21.15.82:0/2420447417 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74f81020f0 0x7f74f8197970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:45.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:45.036+0000 7f74febe9640 1 -- 172.21.15.82:0/2420447417 >> 172.21.15.82:0/2420447417 conn(0x7f74f80fba60 msgr2=0x7f74f8102990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:12:45.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:45.036+0000 7f74febe9640 1 -- 172.21.15.82:0/2420447417 shutdown_connections 2024-03-04T09:12:45.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:45.036+0000 7f74febe9640 1 -- 172.21.15.82:0/2420447417 wait complete. 2024-03-04T09:12:45.410 INFO:journalctl@ceph.mds.e.smithi102.stdout:Mar 04 09:12:45 smithi102 systemd[1]: Starting Ceph mds.e for 2e533fc8-da06-11ee-95c6-87774f69a715... 2024-03-04T09:12:45.663 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:45 smithi102 ceph-mon[36220]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:12:45.663 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:45 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/2420447417' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:12:45.663 INFO:journalctl@ceph.mds.e.smithi102.stdout:Mar 04 09:12:45 smithi102 podman[65320]: 2024-03-04 09:12:45.437484014 +0000 UTC m=+0.017642955 image pull f88ffb32aa6a7d5dfdc954d9f096f0c9cc47981d05ec8d117ba859a22d8185ba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5 2024-03-04T09:12:45.664 INFO:journalctl@ceph.mds.e.smithi102.stdout:Mar 04 09:12:45 smithi102 podman[65320]: 2024-03-04 09:12:45.553798409 +0000 UTC m=+0.133957340 container create e3feb706fe2ebc7388283fbb317e157c109ab2243eb23ddf23014af4abb1eb6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-e, ceph=True, RELEASE=wip-lusov-qdb-1bc250c, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8) 2024-03-04T09:12:45.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:45 smithi190 ceph-mon[36341]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:12:45.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:45 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/2420447417' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:12:45.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:45 smithi082 ceph-mon[32880]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:12:45.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:45 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/2420447417' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:12:45.929 INFO:journalctl@ceph.mds.e.smithi102.stdout:Mar 04 09:12:45 smithi102 podman[65320]: 2024-03-04 09:12:45.789766906 +0000 UTC m=+0.369925852 container init e3feb706fe2ebc7388283fbb317e157c109ab2243eb23ddf23014af4abb1eb6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-e, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-qdb-1bc250c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-03-04T09:12:45.929 INFO:journalctl@ceph.mds.e.smithi102.stdout:Mar 04 09:12:45 smithi102 podman[65320]: 2024-03-04 09:12:45.792327312 +0000 UTC m=+0.372486251 container start e3feb706fe2ebc7388283fbb317e157c109ab2243eb23ddf23014af4abb1eb6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-e, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-lusov-qdb-1bc250c, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-03-04T09:12:45.929 INFO:journalctl@ceph.mds.e.smithi102.stdout:Mar 04 09:12:45 smithi102 ceph-mds[65338]: -- 172.21.15.102:0/2292448999 <== mon.2 v2:172.21.15.102:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56090a4bfa40 con 0x56090a492800 2024-03-04T09:12:45.929 INFO:journalctl@ceph.mds.e.smithi102.stdout:Mar 04 09:12:45 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-e[65334]: starting mds.e at 2024-03-04T09:12:45.929 INFO:journalctl@ceph.mds.e.smithi102.stdout:Mar 04 09:12:45 smithi102 bash[65320]: e3feb706fe2ebc7388283fbb317e157c109ab2243eb23ddf23014af4abb1eb6f 2024-03-04T09:12:45.929 INFO:journalctl@ceph.mds.e.smithi102.stdout:Mar 04 09:12:45 smithi102 systemd[1]: Started Ceph mds.e for 2e533fc8-da06-11ee-95c6-87774f69a715. 2024-03-04T09:12:47.044 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T09:12:47.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:47.163+0000 7f608d3c7640 1 -- 172.21.15.82:0/1065882536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60880ffc80 msgr2=0x7f60881000a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:47.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:47.163+0000 7f608d3c7640 1 --2- 172.21.15.82:0/1065882536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60880ffc80 0x7f60881000a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f607c009900 tx=0x7f607c02bc30 comp rx=0 tx=0).stop 2024-03-04T09:12:47.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:47.163+0000 7f608d3c7640 1 -- 172.21.15.82:0/1065882536 shutdown_connections 2024-03-04T09:12:47.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:47.163+0000 7f608d3c7640 1 --2- 172.21.15.82:0/1065882536 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6088101830 0x7f60881080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:47.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:47.163+0000 7f608d3c7640 1 --2- 172.21.15.82:0/1065882536 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6088100e70 0x7f60881012f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:47.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:47.163+0000 7f608d3c7640 1 --2- 172.21.15.82:0/1065882536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60880ffc80 0x7f60881000a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:47.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:47.163+0000 7f608d3c7640 1 -- 172.21.15.82:0/1065882536 >> 172.21.15.82:0/1065882536 conn(0x7f60880fb1b0 msgr2=0x7f60880fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:12:47.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:47.163+0000 7f608d3c7640 1 -- 172.21.15.82:0/1065882536 shutdown_connections 2024-03-04T09:12:47.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:47.163+0000 7f608d3c7640 1 -- 172.21.15.82:0/1065882536 wait complete. 2024-03-04T09:12:47.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:47.163+0000 7f608d3c7640 1 Processor -- start 2024-03-04T09:12:47.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:47.163+0000 7f608d3c7640 1 -- start start 2024-03-04T09:12:47.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:47.164+0000 7f608d3c7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60880ffc80 0x7f6088199bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:47.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:47.164+0000 7f608d3c7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6088100e70 0x7f608819a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:47.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:47.164+0000 7f608d3c7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6088101830 0x7f60881a1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:47.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:47.164+0000 7f608d3c7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f608810b060 con 0x7f6088100e70 2024-03-04T09:12:47.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:47.164+0000 7f608d3c7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f608810aee0 con 0x7f60880ffc80 2024-03-04T09:12:47.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:47.164+0000 7f608d3c7640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f608810b1e0 con 0x7f6088101830 2024-03-04T09:12:47.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:47.164+0000 7f60867fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6088100e70 0x7f608819a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:47.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:47.164+0000 7f60867fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6088100e70 0x7f608819a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40378/0 (socket says 172.21.15.82:40378) 2024-03-04T09:12:47.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:47.164+0000 7f60867fc640 1 -- 172.21.15.82:0/3674181683 learned_addr learned my addr 172.21.15.82:0/3674181683 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:12:47.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:47.164+0000 7f6086ffd640 1 --2- 172.21.15.82:0/3674181683 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60880ffc80 0x7f6088199bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:47.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:47.164+0000 7f60877fe640 1 --2- 172.21.15.82:0/3674181683 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6088101830 0x7f60881a1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:47.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:47.164+0000 7f60867fc640 1 -- 172.21.15.82:0/3674181683 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6088101830 msgr2=0x7f60881a1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:47.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:47.164+0000 7f60867fc640 1 --2- 172.21.15.82:0/3674181683 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6088101830 0x7f60881a1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:47.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:47.164+0000 7f60867fc640 1 -- 172.21.15.82:0/3674181683 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60880ffc80 msgr2=0x7f6088199bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:47.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:47.164+0000 7f60867fc640 1 --2- 172.21.15.82:0/3674181683 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60880ffc80 0x7f6088199bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:47.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:47.164+0000 7f60867fc640 1 -- 172.21.15.82:0/3674181683 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60881a1790 con 0x7f6088100e70 2024-03-04T09:12:47.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:47.164+0000 7f60867fc640 1 --2- 172.21.15.82:0/3674181683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6088100e70 0x7f608819a100 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f607800ddc0 tx=0x7f607800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:12:47.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:47.164+0000 7f606ffff640 1 -- 172.21.15.82:0/3674181683 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607800be60 con 0x7f6088100e70 2024-03-04T09:12:47.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:47.164+0000 7f608d3c7640 1 -- 172.21.15.82:0/3674181683 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60881a1a80 con 0x7f6088100e70 2024-03-04T09:12:47.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:47.164+0000 7f606ffff640 1 -- 172.21.15.82:0/3674181683 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f60780054f0 con 0x7f6088100e70 2024-03-04T09:12:47.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:47.164+0000 7f606ffff640 1 -- 172.21.15.82:0/3674181683 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60780035f0 con 0x7f6088100e70 2024-03-04T09:12:47.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:47.164+0000 7f608d3c7640 1 -- 172.21.15.82:0/3674181683 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60881a2020 con 0x7f6088100e70 2024-03-04T09:12:47.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:47.165+0000 7f608d3c7640 1 -- 172.21.15.82:0/3674181683 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6088106fd0 con 0x7f6088100e70 2024-03-04T09:12:47.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:47.167+0000 7f606ffff640 1 -- 172.21.15.82:0/3674181683 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f607801d020 con 0x7f6088100e70 2024-03-04T09:12:47.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:47.167+0000 7f606ffff640 1 --2- 172.21.15.82:0/3674181683 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f60700a1d80 0x7f60700a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:47.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:47.167+0000 7f6086ffd640 1 --2- 172.21.15.82:0/3674181683 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f60700a1d80 0x7f60700a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:47.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:47.167+0000 7f606ffff640 1 -- 172.21.15.82:0/3674181683 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f60780cd610 con 0x7f6088100e70 2024-03-04T09:12:47.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:47.168+0000 7f6086ffd640 1 --2- 172.21.15.82:0/3674181683 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f60700a1d80 0x7f60700a4240 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f607c000c00 tx=0x7f607c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:12:47.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:47.172+0000 7f606ffff640 1 -- 172.21.15.82:0/3674181683 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f607809aee0 con 0x7f6088100e70 2024-03-04T09:12:47.170 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:46 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:47.170 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:46 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:47.170 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:46 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:47.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:46 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-04T09:12:47.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:46 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-04T09:12:47.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:46 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:12:47.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:46 smithi190 ceph-mon[36341]: Deploying daemon mds.f on smithi190 2024-03-04T09:12:47.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:46 smithi190 ceph-mon[36341]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:12:47.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:46 smithi190 ceph-mon[36341]: mds.? [v2:172.21.15.102:6834/2134310473,v1:172.21.15.102:6835/2134310473] up:boot 2024-03-04T09:12:47.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:46 smithi190 ceph-mon[36341]: fsmap 5 up:standby 2024-03-04T09:12:47.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:46 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-03-04T09:12:47.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:46 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:47.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:46 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:47.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:46 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:47.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:46 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-04T09:12:47.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:46 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-04T09:12:47.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:46 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:12:47.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:46 smithi082 ceph-mon[32880]: Deploying daemon mds.f on smithi190 2024-03-04T09:12:47.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:46 smithi082 ceph-mon[32880]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:12:47.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:46 smithi082 ceph-mon[32880]: mds.? [v2:172.21.15.102:6834/2134310473,v1:172.21.15.102:6835/2134310473] up:boot 2024-03-04T09:12:47.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:46 smithi082 ceph-mon[32880]: fsmap 5 up:standby 2024-03-04T09:12:47.318 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:46 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-03-04T09:12:47.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:47.385+0000 7f608d3c7640 1 -- 172.21.15.82:0/3674181683 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f608802d3d0 con 0x7f6088100e70 2024-03-04T09:12:47.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:47.385+0000 7f606ffff640 1 -- 172.21.15.82:0/3674181683 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4498 (secure 0 0 0) 0x7f608802d3d0 con 0x7f6088100e70 2024-03-04T09:12:47.382 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:12:47.382 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3123844705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3123844705},{"type":"v1","addr":"172.21.15.82:6835","nonce":3123844705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2620634252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2620634252},{"type":"v1","addr":"172.21.15.82:6837","nonce":2620634252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/1142302200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":1142302200},{"type":"v1","addr":"172.21.15.102:6833","nonce":1142302200}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/3023382814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":3023382814},{"type":"v1","addr":"172.21.15.190:6833","nonce":3023382814}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/2134310473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":2134310473},{"type":"v1","addr":"172.21.15.102:6835","nonce":2134310473}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[]} 2024-03-04T09:12:47.382 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 6 2024-03-04T09:12:47.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:47.387+0000 7f608d3c7640 1 -- 172.21.15.82:0/3674181683 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f60700a1d80 msgr2=0x7f60700a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:47.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:47.387+0000 7f608d3c7640 1 --2- 172.21.15.82:0/3674181683 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f60700a1d80 0x7f60700a4240 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f607c000c00 tx=0x7f607c005fd0 comp rx=0 tx=0).stop 2024-03-04T09:12:47.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:47.387+0000 7f608d3c7640 1 -- 172.21.15.82:0/3674181683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6088100e70 msgr2=0x7f608819a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:47.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:47.387+0000 7f608d3c7640 1 --2- 172.21.15.82:0/3674181683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6088100e70 0x7f608819a100 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f607800ddc0 tx=0x7f607800a620 comp rx=0 tx=0).stop 2024-03-04T09:12:47.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:47.387+0000 7f608d3c7640 1 -- 172.21.15.82:0/3674181683 shutdown_connections 2024-03-04T09:12:47.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:47.387+0000 7f608d3c7640 1 --2- 172.21.15.82:0/3674181683 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f60700a1d80 0x7f60700a4240 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:47.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:47.387+0000 7f608d3c7640 1 --2- 172.21.15.82:0/3674181683 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6088101830 0x7f60881a1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:47.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:47.387+0000 7f608d3c7640 1 --2- 172.21.15.82:0/3674181683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6088100e70 0x7f608819a100 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:47.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:47.387+0000 7f608d3c7640 1 --2- 172.21.15.82:0/3674181683 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60880ffc80 0x7f6088199bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:47.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:47.387+0000 7f608d3c7640 1 -- 172.21.15.82:0/3674181683 >> 172.21.15.82:0/3674181683 conn(0x7f60880fb1b0 msgr2=0x7f60881041a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:12:47.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:47.388+0000 7f608d3c7640 1 -- 172.21.15.82:0/3674181683 shutdown_connections 2024-03-04T09:12:47.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:47.388+0000 7f608d3c7640 1 -- 172.21.15.82:0/3674181683 wait complete. 2024-03-04T09:12:47.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:46 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:47.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:46 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:47.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:46 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:47.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:46 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-04T09:12:47.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:46 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-04T09:12:47.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:46 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:12:47.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:46 smithi102 ceph-mon[36220]: Deploying daemon mds.f on smithi190 2024-03-04T09:12:47.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:46 smithi102 ceph-mon[36220]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:12:47.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:46 smithi102 ceph-mon[36220]: mds.? [v2:172.21.15.102:6834/2134310473,v1:172.21.15.102:6835/2134310473] up:boot 2024-03-04T09:12:47.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:46 smithi102 ceph-mon[36220]: fsmap 5 up:standby 2024-03-04T09:12:47.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:46 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-03-04T09:12:48.170 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:47 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/3674181683' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:12:48.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:47 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/3674181683' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:12:48.428 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:47 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/3674181683' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:12:48.440 INFO:journalctl@ceph.mds.f.smithi190.stdout:Mar 04 09:12:48 smithi190 ceph-mds[66977]: -- 172.21.15.190:0/1602172271 <== mon.1 v2:172.21.15.190:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ab663a9a40 con 0x55ab6637cc00 2024-03-04T09:12:48.920 INFO:journalctl@ceph.mds.f.smithi190.stdout:Mar 04 09:12:48 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-f[66973]: starting mds.f at 2024-03-04T09:12:48.921 INFO:journalctl@ceph.mds.f.smithi190.stdout:Mar 04 09:12:48 smithi190 bash[66958]: f653b0cd9cbbfe05c2a46e6e3db4f9b7c099259bcc0109610b9d7e0bc2dd41d7 2024-03-04T09:12:48.921 INFO:journalctl@ceph.mds.f.smithi190.stdout:Mar 04 09:12:48 smithi190 systemd[1]: Started Ceph mds.f for 2e533fc8-da06-11ee-95c6-87774f69a715. 2024-03-04T09:12:49.272 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:49 smithi102 ceph-mon[36220]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:12:49.273 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:49 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:49.273 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:49 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:49.273 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:49 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:49.273 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:49 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-04T09:12:49.273 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:49 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-04T09:12:49.273 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:49 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:12:49.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:49 smithi082 ceph-mon[32880]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:12:49.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:49 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:49.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:49 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:49.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:49 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:49.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:49 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-04T09:12:49.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:49 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-04T09:12:49.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:49 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:12:49.350 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:49 smithi190 ceph-mon[36341]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:12:49.350 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:49 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:49.350 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:49 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:49.350 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:49 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:49.350 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:49 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-04T09:12:49.350 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:49 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-04T09:12:49.350 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:49 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:12:49.396 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T09:12:49.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.513+0000 7f552e21c640 1 -- 172.21.15.82:0/3734176553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55281007c0 msgr2=0x7f5528100c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:49.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.513+0000 7f552e21c640 1 --2- 172.21.15.82:0/3734176553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55281007c0 0x7f5528100c20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f551c009900 tx=0x7f551c02bc30 comp rx=0 tx=0).stop 2024-03-04T09:12:49.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.513+0000 7f552e21c640 1 -- 172.21.15.82:0/3734176553 shutdown_connections 2024-03-04T09:12:49.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.513+0000 7f552e21c640 1 --2- 172.21.15.82:0/3734176553 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5528101160 0x7f55281015e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:49.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.513+0000 7f552e21c640 1 --2- 172.21.15.82:0/3734176553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55281007c0 0x7f5528100c20 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:49.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.513+0000 7f552e21c640 1 --2- 172.21.15.82:0/3734176553 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f55280ffe60 0x7f5528100280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:49.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.513+0000 7f552e21c640 1 -- 172.21.15.82:0/3734176553 >> 172.21.15.82:0/3734176553 conn(0x7f55280fba60 msgr2=0x7f55280fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:12:49.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.513+0000 7f552e21c640 1 -- 172.21.15.82:0/3734176553 shutdown_connections 2024-03-04T09:12:49.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.513+0000 7f552e21c640 1 -- 172.21.15.82:0/3734176553 wait complete. 2024-03-04T09:12:49.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.514+0000 7f552e21c640 1 Processor -- start 2024-03-04T09:12:49.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.514+0000 7f552e21c640 1 -- start start 2024-03-04T09:12:49.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.514+0000 7f552e21c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55280ffe60 0x7f5528199ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:49.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.514+0000 7f552e21c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55281007c0 0x7f552819a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:49.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.514+0000 7f552e21c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5528101160 0x7f55281a1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:49.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.514+0000 7f552e21c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552810f4b0 con 0x7f55281007c0 2024-03-04T09:12:49.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.514+0000 7f552e21c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552810f330 con 0x7f5528101160 2024-03-04T09:12:49.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.514+0000 7f552e21c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552810f630 con 0x7f55280ffe60 2024-03-04T09:12:49.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.514+0000 7f5526ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55281007c0 0x7f552819a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:49.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.514+0000 7f5526ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55281007c0 0x7f552819a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40396/0 (socket says 172.21.15.82:40396) 2024-03-04T09:12:49.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.514+0000 7f5526ffd640 1 -- 172.21.15.82:0/1995166161 learned_addr learned my addr 172.21.15.82:0/1995166161 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:12:49.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.514+0000 7f55277fe640 1 --2- 172.21.15.82:0/1995166161 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55280ffe60 0x7f5528199ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:49.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.514+0000 7f5527fff640 1 --2- 172.21.15.82:0/1995166161 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5528101160 0x7f55281a1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:49.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.514+0000 7f5526ffd640 1 -- 172.21.15.82:0/1995166161 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55280ffe60 msgr2=0x7f5528199ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:49.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.514+0000 7f5526ffd640 1 --2- 172.21.15.82:0/1995166161 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55280ffe60 0x7f5528199ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:49.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.514+0000 7f5526ffd640 1 -- 172.21.15.82:0/1995166161 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5528101160 msgr2=0x7f55281a1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:49.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.514+0000 7f5526ffd640 1 --2- 172.21.15.82:0/1995166161 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5528101160 0x7f55281a1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:49.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.514+0000 7f5526ffd640 1 -- 172.21.15.82:0/1995166161 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55281a16f0 con 0x7f55281007c0 2024-03-04T09:12:49.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.514+0000 7f55277fe640 1 --2- 172.21.15.82:0/1995166161 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55280ffe60 0x7f5528199ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:12:49.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.514+0000 7f5527fff640 1 --2- 172.21.15.82:0/1995166161 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5528101160 0x7f55281a1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T09:12:49.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.515+0000 7f5526ffd640 1 --2- 172.21.15.82:0/1995166161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55281007c0 0x7f552819a010 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f551c000c00 tx=0x7f551c004e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:12:49.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.515+0000 7f5524ff9640 1 -- 172.21.15.82:0/1995166161 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551c043020 con 0x7f55281007c0 2024-03-04T09:12:49.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.515+0000 7f5524ff9640 1 -- 172.21.15.82:0/1995166161 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f551c005460 con 0x7f55281007c0 2024-03-04T09:12:49.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.515+0000 7f552e21c640 1 -- 172.21.15.82:0/1995166161 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55281a1980 con 0x7f55281007c0 2024-03-04T09:12:49.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.515+0000 7f5524ff9640 1 -- 172.21.15.82:0/1995166161 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551c003d00 con 0x7f55281007c0 2024-03-04T09:12:49.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.515+0000 7f552e21c640 1 -- 172.21.15.82:0/1995166161 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55281a1ed0 con 0x7f55281007c0 2024-03-04T09:12:49.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.516+0000 7f552e21c640 1 -- 172.21.15.82:0/1995166161 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f552810ad10 con 0x7f55281007c0 2024-03-04T09:12:49.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.517+0000 7f5524ff9640 1 -- 172.21.15.82:0/1995166161 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f551c046020 con 0x7f55281007c0 2024-03-04T09:12:49.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.517+0000 7f5524ff9640 1 --2- 172.21.15.82:0/1995166161 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f55100a1d80 0x7f55100a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:49.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.518+0000 7f55277fe640 1 --2- 172.21.15.82:0/1995166161 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f55100a1d80 0x7f55100a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:49.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.518+0000 7f5524ff9640 1 -- 172.21.15.82:0/1995166161 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f551c0eff00 con 0x7f55281007c0 2024-03-04T09:12:49.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.518+0000 7f55277fe640 1 --2- 172.21.15.82:0/1995166161 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f55100a1d80 0x7f55100a4240 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5518005d00 tx=0x7f551800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:12:49.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.521+0000 7f5524ff9640 1 -- 172.21.15.82:0/1995166161 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f551c04d020 con 0x7f55281007c0 2024-03-04T09:12:49.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.732+0000 7f552e21c640 1 -- 172.21.15.82:0/1995166161 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f552802d260 con 0x7f55281007c0 2024-03-04T09:12:49.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.732+0000 7f5524ff9640 1 -- 172.21.15.82:0/1995166161 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+5292 (secure 0 0 0) 0x7f551c0bd7d0 con 0x7f55281007c0 2024-03-04T09:12:49.729 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:12:49.729 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3123844705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3123844705},{"type":"v1","addr":"172.21.15.82:6835","nonce":3123844705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2620634252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2620634252},{"type":"v1","addr":"172.21.15.82:6837","nonce":2620634252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/1142302200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":1142302200},{"type":"v1","addr":"172.21.15.102:6833","nonce":1142302200}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/3023382814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":3023382814},{"type":"v1","addr":"172.21.15.190:6833","nonce":3023382814}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/2134310473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":2134310473},{"type":"v1","addr":"172.21.15.102:6835","nonce":2134310473}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/3183532624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3183532624},{"type":"v1","addr":"172.21.15.190:6835","nonce":3183532624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7}],"filesystems":[]} 2024-03-04T09:12:49.730 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 7 2024-03-04T09:12:49.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.734+0000 7f552e21c640 1 -- 172.21.15.82:0/1995166161 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f55100a1d80 msgr2=0x7f55100a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:49.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.734+0000 7f552e21c640 1 --2- 172.21.15.82:0/1995166161 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f55100a1d80 0x7f55100a4240 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5518005d00 tx=0x7f551800b410 comp rx=0 tx=0).stop 2024-03-04T09:12:49.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.734+0000 7f552e21c640 1 -- 172.21.15.82:0/1995166161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55281007c0 msgr2=0x7f552819a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:49.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.734+0000 7f552e21c640 1 --2- 172.21.15.82:0/1995166161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55281007c0 0x7f552819a010 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f551c000c00 tx=0x7f551c004e20 comp rx=0 tx=0).stop 2024-03-04T09:12:49.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.734+0000 7f552e21c640 1 -- 172.21.15.82:0/1995166161 shutdown_connections 2024-03-04T09:12:49.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.734+0000 7f552e21c640 1 --2- 172.21.15.82:0/1995166161 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f55100a1d80 0x7f55100a4240 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:49.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.734+0000 7f552e21c640 1 --2- 172.21.15.82:0/1995166161 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5528101160 0x7f55281a1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:49.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.734+0000 7f552e21c640 1 --2- 172.21.15.82:0/1995166161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55281007c0 0x7f552819a010 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:49.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.734+0000 7f552e21c640 1 --2- 172.21.15.82:0/1995166161 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55280ffe60 0x7f5528199ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:49.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.734+0000 7f552e21c640 1 -- 172.21.15.82:0/1995166161 >> 172.21.15.82:0/1995166161 conn(0x7f55280fba60 msgr2=0x7f55280fd150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:12:49.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.735+0000 7f552e21c640 1 -- 172.21.15.82:0/1995166161 shutdown_connections 2024-03-04T09:12:49.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:49.735+0000 7f552e21c640 1 -- 172.21.15.82:0/1995166161 wait complete. 2024-03-04T09:12:50.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:50 smithi102 ceph-mon[36220]: Deploying daemon mds.c on smithi190 2024-03-04T09:12:50.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:50 smithi102 ceph-mon[36220]: mds.? [v2:172.21.15.190:6834/3183532624,v1:172.21.15.190:6835/3183532624] up:boot 2024-03-04T09:12:50.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:50 smithi102 ceph-mon[36220]: fsmap 6 up:standby 2024-03-04T09:12:50.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:50 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-04T09:12:50.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:50 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/1995166161' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:12:50.305 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:50 smithi190 ceph-mon[36341]: Deploying daemon mds.c on smithi190 2024-03-04T09:12:50.305 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:50 smithi190 ceph-mon[36341]: mds.? [v2:172.21.15.190:6834/3183532624,v1:172.21.15.190:6835/3183532624] up:boot 2024-03-04T09:12:50.305 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:50 smithi190 ceph-mon[36341]: fsmap 6 up:standby 2024-03-04T09:12:50.305 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:50 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-04T09:12:50.305 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:50 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/1995166161' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:12:50.316 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:50 smithi082 ceph-mon[32880]: Deploying daemon mds.c on smithi190 2024-03-04T09:12:50.316 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:50 smithi082 ceph-mon[32880]: mds.? [v2:172.21.15.190:6834/3183532624,v1:172.21.15.190:6835/3183532624] up:boot 2024-03-04T09:12:50.316 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:50 smithi082 ceph-mon[32880]: fsmap 6 up:standby 2024-03-04T09:12:50.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:50 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-04T09:12:50.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:50 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/1995166161' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:12:51.007 INFO:journalctl@ceph.mds.c.smithi190.stdout:Mar 04 09:12:50 smithi190 podman[67263]: 2024-03-04 09:12:50.904559119 +0000 UTC m=+0.116993802 container create b8ad6f518f396ff20ccd5408b2c249db9be04b9f455da66590e929b8b70466e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-c, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-lusov-qdb-1bc250c, io.buildah.version=1.33.5) 2024-03-04T09:12:51.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:51 smithi082 ceph-mon[32880]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:12:51.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:51 smithi190 ceph-mon[36341]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:12:51.421 INFO:journalctl@ceph.mds.c.smithi190.stdout:Mar 04 09:12:51 smithi190 podman[67263]: 2024-03-04 09:12:51.158071194 +0000 UTC m=+0.370505850 container init b8ad6f518f396ff20ccd5408b2c249db9be04b9f455da66590e929b8b70466e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-c, org.label-schema.build-date=20240222, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-lusov-qdb-1bc250c, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-03-04T09:12:51.421 INFO:journalctl@ceph.mds.c.smithi190.stdout:Mar 04 09:12:51 smithi190 podman[67263]: 2024-03-04 09:12:51.160784099 +0000 UTC m=+0.373218743 container start b8ad6f518f396ff20ccd5408b2c249db9be04b9f455da66590e929b8b70466e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-c, org.label-schema.build-date=20240222, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True) 2024-03-04T09:12:51.421 INFO:journalctl@ceph.mds.c.smithi190.stdout:Mar 04 09:12:51 smithi190 ceph-mds[67282]: -- 172.21.15.190:0/1544277308 <== mon.1 v2:172.21.15.190:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5561fe3cda40 con 0x5561fe3a1000 2024-03-04T09:12:51.421 INFO:journalctl@ceph.mds.c.smithi190.stdout:Mar 04 09:12:51 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-c[67278]: starting mds.c at 2024-03-04T09:12:51.421 INFO:journalctl@ceph.mds.c.smithi190.stdout:Mar 04 09:12:51 smithi190 bash[67263]: b8ad6f518f396ff20ccd5408b2c249db9be04b9f455da66590e929b8b70466e9 2024-03-04T09:12:51.421 INFO:journalctl@ceph.mds.c.smithi190.stdout:Mar 04 09:12:51 smithi190 systemd[1]: Started Ceph mds.c for 2e533fc8-da06-11ee-95c6-87774f69a715. 2024-03-04T09:12:51.428 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:51 smithi102 ceph-mon[36220]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:12:51.743 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T09:12:51.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:51.860+0000 7f56789ee640 1 -- 172.21.15.82:0/4235968990 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56741027d0 msgr2=0x7f5674102c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:51.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:51.860+0000 7f56789ee640 1 --2- 172.21.15.82:0/4235968990 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56741027d0 0x7f5674102c50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f565c009900 tx=0x7f565c02bc30 comp rx=0 tx=0).stop 2024-03-04T09:12:51.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:51.860+0000 7f56789ee640 1 -- 172.21.15.82:0/4235968990 shutdown_connections 2024-03-04T09:12:51.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:51.860+0000 7f56789ee640 1 --2- 172.21.15.82:0/4235968990 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5674103190 0x7f5674109a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:51.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:51.860+0000 7f56789ee640 1 --2- 172.21.15.82:0/4235968990 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56741027d0 0x7f5674102c50 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:51.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:51.860+0000 7f56789ee640 1 --2- 172.21.15.82:0/4235968990 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f56741015e0 0x7f5674101a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:51.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:51.860+0000 7f56789ee640 1 -- 172.21.15.82:0/4235968990 >> 172.21.15.82:0/4235968990 conn(0x7f56740fcbb0 msgr2=0x7f56740fefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:12:51.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:51.860+0000 7f56789ee640 1 -- 172.21.15.82:0/4235968990 shutdown_connections 2024-03-04T09:12:51.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:51.860+0000 7f56789ee640 1 -- 172.21.15.82:0/4235968990 wait complete. 2024-03-04T09:12:51.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:51.861+0000 7f56789ee640 1 Processor -- start 2024-03-04T09:12:51.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:51.861+0000 7f56789ee640 1 -- start start 2024-03-04T09:12:51.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:51.861+0000 7f56789ee640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f56741015e0 0x7f56741978f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:51.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:51.861+0000 7f56789ee640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56741027d0 0x7f5674197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:51.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:51.861+0000 7f56789ee640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5674103190 0x7f567419eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:51.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:51.861+0000 7f56789ee640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f567410d240 con 0x7f56741027d0 2024-03-04T09:12:51.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:51.861+0000 7f56789ee640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f567410d0c0 con 0x7f5674103190 2024-03-04T09:12:51.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:51.861+0000 7f56789ee640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f567410d3c0 con 0x7f56741015e0 2024-03-04T09:12:51.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:51.861+0000 7f5671d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56741027d0 0x7f5674197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:51.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:51.861+0000 7f5671d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56741027d0 0x7f5674197e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40410/0 (socket says 172.21.15.82:40410) 2024-03-04T09:12:51.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:51.861+0000 7f5671d9b640 1 -- 172.21.15.82:0/2497608639 learned_addr learned my addr 172.21.15.82:0/2497608639 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:12:51.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:51.861+0000 7f5672d9d640 1 --2- 172.21.15.82:0/2497608639 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5674103190 0x7f567419eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:51.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:51.861+0000 7f567259c640 1 --2- 172.21.15.82:0/2497608639 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f56741015e0 0x7f56741978f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:51.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:51.861+0000 7f5671d9b640 1 -- 172.21.15.82:0/2497608639 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f56741015e0 msgr2=0x7f56741978f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:51.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:51.861+0000 7f5671d9b640 1 --2- 172.21.15.82:0/2497608639 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f56741015e0 0x7f56741978f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:51.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:51.861+0000 7f5671d9b640 1 -- 172.21.15.82:0/2497608639 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5674103190 msgr2=0x7f567419eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:51.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:51.861+0000 7f5671d9b640 1 --2- 172.21.15.82:0/2497608639 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5674103190 0x7f567419eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:51.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:51.861+0000 7f5671d9b640 1 -- 172.21.15.82:0/2497608639 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f567419f510 con 0x7f56741027d0 2024-03-04T09:12:51.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:51.861+0000 7f567259c640 1 --2- 172.21.15.82:0/2497608639 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f56741015e0 0x7f56741978f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T09:12:51.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:51.861+0000 7f5671d9b640 1 --2- 172.21.15.82:0/2497608639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56741027d0 0x7f5674197e30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f565c009230 tx=0x7f565c004e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:12:51.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:51.862+0000 7f566b7fe640 1 -- 172.21.15.82:0/2497608639 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565c043020 con 0x7f56741027d0 2024-03-04T09:12:51.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:51.862+0000 7f56789ee640 1 -- 172.21.15.82:0/2497608639 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f567419f7a0 con 0x7f56741027d0 2024-03-04T09:12:51.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:51.862+0000 7f566b7fe640 1 -- 172.21.15.82:0/2497608639 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f565c005460 con 0x7f56741027d0 2024-03-04T09:12:51.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:51.862+0000 7f566b7fe640 1 -- 172.21.15.82:0/2497608639 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565c003c60 con 0x7f56741027d0 2024-03-04T09:12:51.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:51.862+0000 7f56789ee640 1 -- 172.21.15.82:0/2497608639 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f567419fd40 con 0x7f56741027d0 2024-03-04T09:12:51.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:51.863+0000 7f56789ee640 1 -- 172.21.15.82:0/2497608639 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5674108980 con 0x7f56741027d0 2024-03-04T09:12:51.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:51.864+0000 7f566b7fe640 1 -- 172.21.15.82:0/2497608639 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f565c046020 con 0x7f56741027d0 2024-03-04T09:12:51.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:51.864+0000 7f566b7fe640 1 --2- 172.21.15.82:0/2497608639 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f56600a1d80 0x7f56600a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:51.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:51.864+0000 7f567259c640 1 --2- 172.21.15.82:0/2497608639 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f56600a1d80 0x7f56600a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:51.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:51.864+0000 7f566b7fe640 1 -- 172.21.15.82:0/2497608639 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f565c0efd60 con 0x7f56741027d0 2024-03-04T09:12:51.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:51.865+0000 7f567259c640 1 --2- 172.21.15.82:0/2497608639 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f56600a1d80 0x7f56600a4240 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5674102630 tx=0x7f5664005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:12:51.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:51.868+0000 7f566b7fe640 1 -- 172.21.15.82:0/2497608639 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f565c04d070 con 0x7f56741027d0 2024-03-04T09:12:52.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:52.081+0000 7f56789ee640 1 -- 172.21.15.82:0/2497608639 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f567402cff0 con 0x7f56741027d0 2024-03-04T09:12:52.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:52.082+0000 7f566b7fe640 1 -- 172.21.15.82:0/2497608639 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6086 (secure 0 0 0) 0x7f565c0bd630 con 0x7f56741027d0 2024-03-04T09:12:52.078 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:12:52.079 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3123844705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3123844705},{"type":"v1","addr":"172.21.15.82:6835","nonce":3123844705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2620634252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2620634252},{"type":"v1","addr":"172.21.15.82:6837","nonce":2620634252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/1142302200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":1142302200},{"type":"v1","addr":"172.21.15.102:6833","nonce":1142302200}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/3023382814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":3023382814},{"type":"v1","addr":"172.21.15.190:6833","nonce":3023382814}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/2134310473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":2134310473},{"type":"v1","addr":"172.21.15.102:6835","nonce":2134310473}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/3183532624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3183532624},{"type":"v1","addr":"172.21.15.190:6835","nonce":3183532624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/1198639527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":1198639527},{"type":"v1","addr":"172.21.15.190:6837","nonce":1198639527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8}],"filesystems":[]} 2024-03-04T09:12:52.079 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 8 2024-03-04T09:12:52.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:52.084+0000 7f56789ee640 1 -- 172.21.15.82:0/2497608639 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f56600a1d80 msgr2=0x7f56600a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:52.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:52.084+0000 7f56789ee640 1 --2- 172.21.15.82:0/2497608639 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f56600a1d80 0x7f56600a4240 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5674102630 tx=0x7f5664005f90 comp rx=0 tx=0).stop 2024-03-04T09:12:52.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:52.084+0000 7f56789ee640 1 -- 172.21.15.82:0/2497608639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56741027d0 msgr2=0x7f5674197e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:52.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:52.084+0000 7f56789ee640 1 --2- 172.21.15.82:0/2497608639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56741027d0 0x7f5674197e30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f565c009230 tx=0x7f565c004e20 comp rx=0 tx=0).stop 2024-03-04T09:12:52.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:52.084+0000 7f56789ee640 1 -- 172.21.15.82:0/2497608639 shutdown_connections 2024-03-04T09:12:52.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:52.084+0000 7f56789ee640 1 --2- 172.21.15.82:0/2497608639 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f56600a1d80 0x7f56600a4240 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:52.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:52.084+0000 7f56789ee640 1 --2- 172.21.15.82:0/2497608639 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5674103190 0x7f567419eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:52.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:52.084+0000 7f56789ee640 1 --2- 172.21.15.82:0/2497608639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56741027d0 0x7f5674197e30 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:52.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:52.084+0000 7f56789ee640 1 --2- 172.21.15.82:0/2497608639 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f56741015e0 0x7f56741978f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:52.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:52.084+0000 7f56789ee640 1 -- 172.21.15.82:0/2497608639 >> 172.21.15.82:0/2497608639 conn(0x7f56740fcbb0 msgr2=0x7f5674105b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:12:52.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:52.084+0000 7f56789ee640 1 -- 172.21.15.82:0/2497608639 shutdown_connections 2024-03-04T09:12:52.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:52.084+0000 7f56789ee640 1 -- 172.21.15.82:0/2497608639 wait complete. 2024-03-04T09:12:52.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:52 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:52.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:52 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:52.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:52 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:52.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:52 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-04T09:12:52.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:52 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-04T09:12:52.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:52 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:12:52.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:52 smithi082 ceph-mon[32880]: Deploying daemon mds.h on smithi102 2024-03-04T09:12:52.568 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:52 smithi082 ceph-mon[32880]: mds.? [v2:172.21.15.190:6836/1198639527,v1:172.21.15.190:6837/1198639527] up:boot 2024-03-04T09:12:52.568 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:52 smithi082 ceph-mon[32880]: fsmap 7 up:standby 2024-03-04T09:12:52.568 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:52 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-03-04T09:12:52.568 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:52 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/2497608639' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:12:52.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:52 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:52.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:52 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:52.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:52 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:52.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:52 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-04T09:12:52.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:52 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-04T09:12:52.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:52 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:12:52.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:52 smithi190 ceph-mon[36341]: Deploying daemon mds.h on smithi102 2024-03-04T09:12:52.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:52 smithi190 ceph-mon[36341]: mds.? [v2:172.21.15.190:6836/1198639527,v1:172.21.15.190:6837/1198639527] up:boot 2024-03-04T09:12:52.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:52 smithi190 ceph-mon[36341]: fsmap 7 up:standby 2024-03-04T09:12:52.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:52 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-03-04T09:12:52.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:52 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/2497608639' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:12:52.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:52 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:52.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:52 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:52.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:52 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:52.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:52 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-04T09:12:52.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:52 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-04T09:12:52.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:52 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:12:52.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:52 smithi102 ceph-mon[36220]: Deploying daemon mds.h on smithi102 2024-03-04T09:12:52.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:52 smithi102 ceph-mon[36220]: mds.? [v2:172.21.15.190:6836/1198639527,v1:172.21.15.190:6837/1198639527] up:boot 2024-03-04T09:12:52.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:52 smithi102 ceph-mon[36220]: fsmap 7 up:standby 2024-03-04T09:12:52.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:52 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-03-04T09:12:52.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:52 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/2497608639' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:12:53.537 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:53 smithi102 ceph-mon[36220]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:12:53.538 INFO:journalctl@ceph.mds.h.smithi102.stdout:Mar 04 09:12:53 smithi102 systemd[1]: Starting Ceph mds.h for 2e533fc8-da06-11ee-95c6-87774f69a715... 2024-03-04T09:12:53.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:53 smithi082 ceph-mon[32880]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:12:53.571 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:53 smithi190 ceph-mon[36341]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:12:54.025 INFO:journalctl@ceph.mds.h.smithi102.stdout:Mar 04 09:12:53 smithi102 podman[65628]: 2024-03-04 09:12:53.659836934 +0000 UTC m=+0.017496263 image pull f88ffb32aa6a7d5dfdc954d9f096f0c9cc47981d05ec8d117ba859a22d8185ba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5 2024-03-04T09:12:54.025 INFO:journalctl@ceph.mds.h.smithi102.stdout:Mar 04 09:12:53 smithi102 podman[65628]: 2024-03-04 09:12:53.776803725 +0000 UTC m=+0.134463079 container create 2ef4424c49d9eff146fd4cc76271c355969003740ea74cfbb5c542a6d04bb5ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-h, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.schema-version=1.0) 2024-03-04T09:12:54.025 INFO:journalctl@ceph.mds.h.smithi102.stdout:Mar 04 09:12:54 smithi102 podman[65628]: 2024-03-04 09:12:54.029829196 +0000 UTC m=+0.387488515 container init 2ef4424c49d9eff146fd4cc76271c355969003740ea74cfbb5c542a6d04bb5ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-h, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=wip-lusov-qdb-1bc250c, CEPH_POINT_RELEASE=) 2024-03-04T09:12:54.092 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T09:12:54.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:54.211+0000 7fb870039640 1 -- 172.21.15.82:0/1553399270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8681004f0 msgr2=0x7fb868100910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:54.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:54.211+0000 7fb870039640 1 --2- 172.21.15.82:0/1553399270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8681004f0 0x7fb868100910 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb864009900 tx=0x7fb86402bc30 comp rx=0 tx=0).stop 2024-03-04T09:12:54.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:54.211+0000 7fb870039640 1 -- 172.21.15.82:0/1553399270 shutdown_connections 2024-03-04T09:12:54.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:54.211+0000 7fb870039640 1 --2- 172.21.15.82:0/1553399270 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8681020a0 0x7fb868108930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:54.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:54.211+0000 7fb870039640 1 --2- 172.21.15.82:0/1553399270 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8681016e0 0x7fb868101b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:54.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:54.211+0000 7fb870039640 1 --2- 172.21.15.82:0/1553399270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8681004f0 0x7fb868100910 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:54.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:54.211+0000 7fb870039640 1 -- 172.21.15.82:0/1553399270 >> 172.21.15.82:0/1553399270 conn(0x7fb8680fba60 msgr2=0x7fb8680fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:12:54.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:54.211+0000 7fb870039640 1 -- 172.21.15.82:0/1553399270 shutdown_connections 2024-03-04T09:12:54.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:54.211+0000 7fb870039640 1 -- 172.21.15.82:0/1553399270 wait complete. 2024-03-04T09:12:54.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:54.211+0000 7fb870039640 1 Processor -- start 2024-03-04T09:12:54.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:54.211+0000 7fb870039640 1 -- start start 2024-03-04T09:12:54.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:54.211+0000 7fb870039640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8681004f0 0x7fb868069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:54.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:54.211+0000 7fb870039640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8681016e0 0x7fb86819c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:54.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:54.211+0000 7fb870039640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8681020a0 0x7fb86819ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:54.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:54.211+0000 7fb870039640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86810c150 con 0x7fb8681020a0 2024-03-04T09:12:54.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:54.211+0000 7fb870039640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86810bfd0 con 0x7fb8681016e0 2024-03-04T09:12:54.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:54.211+0000 7fb870039640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86810c2d0 con 0x7fb8681004f0 2024-03-04T09:12:54.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:54.212+0000 7fb86e5d6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8681020a0 0x7fb86819ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:54.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:54.212+0000 7fb86e5d6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8681020a0 0x7fb86819ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40420/0 (socket says 172.21.15.82:40420) 2024-03-04T09:12:54.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:54.212+0000 7fb86e5d6640 1 -- 172.21.15.82:0/3375413901 learned_addr learned my addr 172.21.15.82:0/3375413901 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:12:54.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:54.212+0000 7fb86d5d4640 1 --2- 172.21.15.82:0/3375413901 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8681016e0 0x7fb86819c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:54.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:54.212+0000 7fb86ddd5640 1 --2- 172.21.15.82:0/3375413901 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8681004f0 0x7fb868069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:54.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:54.212+0000 7fb86e5d6640 1 -- 172.21.15.82:0/3375413901 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8681004f0 msgr2=0x7fb868069300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:54.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:54.212+0000 7fb86e5d6640 1 --2- 172.21.15.82:0/3375413901 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8681004f0 0x7fb868069300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:54.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:54.212+0000 7fb86e5d6640 1 -- 172.21.15.82:0/3375413901 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8681016e0 msgr2=0x7fb86819c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:54.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:54.212+0000 7fb86e5d6640 1 --2- 172.21.15.82:0/3375413901 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8681016e0 0x7fb86819c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:54.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:54.212+0000 7fb86e5d6640 1 -- 172.21.15.82:0/3375413901 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb86819f570 con 0x7fb8681020a0 2024-03-04T09:12:54.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:54.212+0000 7fb86e5d6640 1 --2- 172.21.15.82:0/3375413901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8681020a0 0x7fb86819ecb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb86000cad0 tx=0x7fb86000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:12:54.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:54.212+0000 7fb85effd640 1 -- 172.21.15.82:0/3375413901 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86000ae20 con 0x7fb8681020a0 2024-03-04T09:12:54.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:54.212+0000 7fb85effd640 1 -- 172.21.15.82:0/3375413901 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fb860005020 con 0x7fb8681020a0 2024-03-04T09:12:54.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:54.212+0000 7fb870039640 1 -- 172.21.15.82:0/3375413901 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb86819f860 con 0x7fb8681020a0 2024-03-04T09:12:54.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:54.212+0000 7fb85effd640 1 -- 172.21.15.82:0/3375413901 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86000f690 con 0x7fb8681020a0 2024-03-04T09:12:54.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:54.212+0000 7fb870039640 1 -- 172.21.15.82:0/3375413901 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb86819fdb0 con 0x7fb8681020a0 2024-03-04T09:12:54.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:54.213+0000 7fb870039640 1 -- 172.21.15.82:0/3375413901 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8681078e0 con 0x7fb8681020a0 2024-03-04T09:12:54.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:54.214+0000 7fb85effd640 1 -- 172.21.15.82:0/3375413901 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7fb8600051d0 con 0x7fb8681020a0 2024-03-04T09:12:54.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:54.215+0000 7fb85effd640 1 --2- 172.21.15.82:0/3375413901 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb8540a1e00 0x7fb8540a42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:54.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:54.215+0000 7fb86ddd5640 1 --2- 172.21.15.82:0/3375413901 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb8540a1e00 0x7fb8540a42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:54.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:54.215+0000 7fb85effd640 1 -- 172.21.15.82:0/3375413901 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fb8600cd850 con 0x7fb8681020a0 2024-03-04T09:12:54.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:54.215+0000 7fb86ddd5640 1 --2- 172.21.15.82:0/3375413901 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb8540a1e00 0x7fb8540a42c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb864000c00 tx=0x7fb864005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:12:54.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:54.219+0000 7fb85effd640 1 -- 172.21.15.82:0/3375413901 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fb860014030 con 0x7fb8681020a0 2024-03-04T09:12:54.395 INFO:journalctl@ceph.mds.h.smithi102.stdout:Mar 04 09:12:54 smithi102 podman[65628]: 2024-03-04 09:12:54.032375964 +0000 UTC m=+0.390035284 container start 2ef4424c49d9eff146fd4cc76271c355969003740ea74cfbb5c542a6d04bb5ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-h, GIT_BRANCH=HEAD, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, ceph=True) 2024-03-04T09:12:54.395 INFO:journalctl@ceph.mds.h.smithi102.stdout:Mar 04 09:12:54 smithi102 ceph-mds[65647]: -- 172.21.15.102:0/3125376743 <== mon.2 v2:172.21.15.102:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e57717da40 con 0x55e577150800 2024-03-04T09:12:54.395 INFO:journalctl@ceph.mds.h.smithi102.stdout:Mar 04 09:12:54 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-h[65643]: starting mds.h at 2024-03-04T09:12:54.395 INFO:journalctl@ceph.mds.h.smithi102.stdout:Mar 04 09:12:54 smithi102 bash[65628]: 2ef4424c49d9eff146fd4cc76271c355969003740ea74cfbb5c542a6d04bb5ce 2024-03-04T09:12:54.395 INFO:journalctl@ceph.mds.h.smithi102.stdout:Mar 04 09:12:54 smithi102 systemd[1]: Started Ceph mds.h for 2e533fc8-da06-11ee-95c6-87774f69a715. 2024-03-04T09:12:54.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:54.436+0000 7fb870039640 1 -- 172.21.15.82:0/3375413901 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb8680621d0 con 0x7fb8681020a0 2024-03-04T09:12:54.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:54.436+0000 7fb85effd640 1 -- 172.21.15.82:0/3375413901 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6880 (secure 0 0 0) 0x7fb86009aad0 con 0x7fb8681020a0 2024-03-04T09:12:54.433 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:12:54.433 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3123844705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3123844705},{"type":"v1","addr":"172.21.15.82:6835","nonce":3123844705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2620634252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2620634252},{"type":"v1","addr":"172.21.15.82:6837","nonce":2620634252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/1142302200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":1142302200},{"type":"v1","addr":"172.21.15.102:6833","nonce":1142302200}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/3023382814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":3023382814},{"type":"v1","addr":"172.21.15.190:6833","nonce":3023382814}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/2134310473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":2134310473},{"type":"v1","addr":"172.21.15.102:6835","nonce":2134310473}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/3183532624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3183532624},{"type":"v1","addr":"172.21.15.190:6835","nonce":3183532624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/1210579527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1210579527},{"type":"v1","addr":"172.21.15.102:6837","nonce":1210579527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/1198639527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":1198639527},{"type":"v1","addr":"172.21.15.190:6837","nonce":1198639527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8}],"filesystems":[]} 2024-03-04T09:12:54.433 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 9 2024-03-04T09:12:54.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:54.438+0000 7fb870039640 1 -- 172.21.15.82:0/3375413901 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb8540a1e00 msgr2=0x7fb8540a42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:54.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:54.438+0000 7fb870039640 1 --2- 172.21.15.82:0/3375413901 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb8540a1e00 0x7fb8540a42c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb864000c00 tx=0x7fb864005fd0 comp rx=0 tx=0).stop 2024-03-04T09:12:54.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:54.438+0000 7fb870039640 1 -- 172.21.15.82:0/3375413901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8681020a0 msgr2=0x7fb86819ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:54.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:54.438+0000 7fb870039640 1 --2- 172.21.15.82:0/3375413901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8681020a0 0x7fb86819ecb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb86000cad0 tx=0x7fb86000cf90 comp rx=0 tx=0).stop 2024-03-04T09:12:54.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:54.438+0000 7fb870039640 1 -- 172.21.15.82:0/3375413901 shutdown_connections 2024-03-04T09:12:54.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:54.438+0000 7fb870039640 1 --2- 172.21.15.82:0/3375413901 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb8540a1e00 0x7fb8540a42c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:54.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:54.438+0000 7fb870039640 1 --2- 172.21.15.82:0/3375413901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8681020a0 0x7fb86819ecb0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:54.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:54.438+0000 7fb870039640 1 --2- 172.21.15.82:0/3375413901 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8681016e0 0x7fb86819c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:54.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:54.438+0000 7fb870039640 1 --2- 172.21.15.82:0/3375413901 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8681004f0 0x7fb868069300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:54.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:54.438+0000 7fb870039640 1 -- 172.21.15.82:0/3375413901 >> 172.21.15.82:0/3375413901 conn(0x7fb8680fba60 msgr2=0x7fb868104ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:12:54.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:54.438+0000 7fb870039640 1 -- 172.21.15.82:0/3375413901 shutdown_connections 2024-03-04T09:12:54.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:54.438+0000 7fb870039640 1 -- 172.21.15.82:0/3375413901 wait complete. 2024-03-04T09:12:55.512 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:55 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:55.512 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:55 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:55.512 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:55 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:55.512 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:55 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-04T09:12:55.512 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:55 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-04T09:12:55.512 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:55 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:12:55.513 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:55 smithi190 ceph-mon[36341]: Deploying daemon mds.i on smithi190 2024-03-04T09:12:55.513 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:55 smithi190 ceph-mon[36341]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:12:55.513 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:55 smithi190 ceph-mon[36341]: mds.? [v2:172.21.15.102:6836/1210579527,v1:172.21.15.102:6837/1210579527] up:boot 2024-03-04T09:12:55.513 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:55 smithi190 ceph-mon[36341]: fsmap 8 up:standby 2024-03-04T09:12:55.513 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:55 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-04T09:12:55.513 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:55 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/3375413901' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:12:55.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:55 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:55.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:55 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:55.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:55 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:55.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:55 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-04T09:12:55.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:55 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-04T09:12:55.568 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:55 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:12:55.568 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:55 smithi082 ceph-mon[32880]: Deploying daemon mds.i on smithi190 2024-03-04T09:12:55.568 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:55 smithi082 ceph-mon[32880]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:12:55.568 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:55 smithi082 ceph-mon[32880]: mds.? [v2:172.21.15.102:6836/1210579527,v1:172.21.15.102:6837/1210579527] up:boot 2024-03-04T09:12:55.568 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:55 smithi082 ceph-mon[32880]: fsmap 8 up:standby 2024-03-04T09:12:55.568 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:55 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-04T09:12:55.568 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:55 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/3375413901' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:12:55.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:55 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:55.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:55 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:55.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:55 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:55.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:55 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-04T09:12:55.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:55 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-04T09:12:55.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:55 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:12:55.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:55 smithi102 ceph-mon[36220]: Deploying daemon mds.i on smithi190 2024-03-04T09:12:55.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:55 smithi102 ceph-mon[36220]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:12:55.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:55 smithi102 ceph-mon[36220]: mds.? [v2:172.21.15.102:6836/1210579527,v1:172.21.15.102:6837/1210579527] up:boot 2024-03-04T09:12:55.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:55 smithi102 ceph-mon[36220]: fsmap 8 up:standby 2024-03-04T09:12:55.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:55 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-04T09:12:55.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:55 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/3375413901' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:12:56.447 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T09:12:56.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.564+0000 7f4c0dc9a640 1 -- 172.21.15.82:0/2605925572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c081004f0 msgr2=0x7f4c08100910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:56.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.564+0000 7f4c0dc9a640 1 --2- 172.21.15.82:0/2605925572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c081004f0 0x7f4c08100910 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8009900 tx=0x7f4bf802bc30 comp rx=0 tx=0).stop 2024-03-04T09:12:56.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.564+0000 7f4c0dc9a640 1 -- 172.21.15.82:0/2605925572 shutdown_connections 2024-03-04T09:12:56.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.564+0000 7f4c0dc9a640 1 --2- 172.21.15.82:0/2605925572 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c081020a0 0x7f4c08108930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:56.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.564+0000 7f4c0dc9a640 1 --2- 172.21.15.82:0/2605925572 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c081016e0 0x7f4c08101b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:56.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.564+0000 7f4c0dc9a640 1 --2- 172.21.15.82:0/2605925572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c081004f0 0x7f4c08100910 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:56.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.564+0000 7f4c0dc9a640 1 -- 172.21.15.82:0/2605925572 >> 172.21.15.82:0/2605925572 conn(0x7f4c080fba60 msgr2=0x7f4c080fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:12:56.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.564+0000 7f4c0dc9a640 1 -- 172.21.15.82:0/2605925572 shutdown_connections 2024-03-04T09:12:56.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.564+0000 7f4c0dc9a640 1 -- 172.21.15.82:0/2605925572 wait complete. 2024-03-04T09:12:56.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.565+0000 7f4c0dc9a640 1 Processor -- start 2024-03-04T09:12:56.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.565+0000 7f4c0dc9a640 1 -- start start 2024-03-04T09:12:56.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.565+0000 7f4c0dc9a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c081004f0 0x7f4c081978d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:56.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.565+0000 7f4c0dc9a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c081016e0 0x7f4c08197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:56.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.565+0000 7f4c0dc9a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c081020a0 0x7f4c0819ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:56.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.565+0000 7f4c0dc9a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0810d260 con 0x7f4c081004f0 2024-03-04T09:12:56.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.565+0000 7f4c0dc9a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0810d0e0 con 0x7f4c081016e0 2024-03-04T09:12:56.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.565+0000 7f4c0dc9a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0810d3e0 con 0x7f4c081020a0 2024-03-04T09:12:56.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.565+0000 7f4c077fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c081004f0 0x7f4c081978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:56.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.565+0000 7f4c077fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c081004f0 0x7f4c081978d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45854/0 (socket says 172.21.15.82:45854) 2024-03-04T09:12:56.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.565+0000 7f4c077fe640 1 -- 172.21.15.82:0/2486998682 learned_addr learned my addr 172.21.15.82:0/2486998682 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:12:56.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.566+0000 7f4c07fff640 1 --2- 172.21.15.82:0/2486998682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c081020a0 0x7f4c0819ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:56.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.566+0000 7f4c06ffd640 1 --2- 172.21.15.82:0/2486998682 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c081016e0 0x7f4c08197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:56.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.566+0000 7f4c077fe640 1 -- 172.21.15.82:0/2486998682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c081020a0 msgr2=0x7f4c0819ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:56.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.566+0000 7f4c077fe640 1 --2- 172.21.15.82:0/2486998682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c081020a0 0x7f4c0819ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:56.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.566+0000 7f4c077fe640 1 -- 172.21.15.82:0/2486998682 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c081016e0 msgr2=0x7f4c08197e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:56.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.566+0000 7f4c077fe640 1 --2- 172.21.15.82:0/2486998682 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c081016e0 0x7f4c08197e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:56.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.566+0000 7f4c077fe640 1 -- 172.21.15.82:0/2486998682 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c0819f4f0 con 0x7f4c081004f0 2024-03-04T09:12:56.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.566+0000 7f4c06ffd640 1 --2- 172.21.15.82:0/2486998682 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c081016e0 0x7f4c08197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T09:12:56.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.566+0000 7f4c077fe640 1 --2- 172.21.15.82:0/2486998682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c081004f0 0x7f4c081978d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8005ab0 tx=0x7f4bf8004e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:12:56.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.566+0000 7f4c04ff9640 1 -- 172.21.15.82:0/2486998682 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf8043020 con 0x7f4c081004f0 2024-03-04T09:12:56.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.566+0000 7f4c0dc9a640 1 -- 172.21.15.82:0/2486998682 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c0819f780 con 0x7f4c081004f0 2024-03-04T09:12:56.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.566+0000 7f4c04ff9640 1 -- 172.21.15.82:0/2486998682 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f4bf80054f0 con 0x7f4c081004f0 2024-03-04T09:12:56.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.566+0000 7f4c04ff9640 1 -- 172.21.15.82:0/2486998682 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf8003d10 con 0x7f4c081004f0 2024-03-04T09:12:56.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.566+0000 7f4c0dc9a640 1 -- 172.21.15.82:0/2486998682 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c0819fcd0 con 0x7f4c081004f0 2024-03-04T09:12:56.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.567+0000 7f4c0dc9a640 1 -- 172.21.15.82:0/2486998682 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c08107810 con 0x7f4c081004f0 2024-03-04T09:12:56.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.568+0000 7f4c04ff9640 1 -- 172.21.15.82:0/2486998682 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f4bf8046020 con 0x7f4c081004f0 2024-03-04T09:12:56.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.569+0000 7f4c04ff9640 1 --2- 172.21.15.82:0/2486998682 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f4bf00a1d80 0x7f4bf00a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:56.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.569+0000 7f4c06ffd640 1 --2- 172.21.15.82:0/2486998682 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f4bf00a1d80 0x7f4bf00a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:56.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.569+0000 7f4c04ff9640 1 -- 172.21.15.82:0/2486998682 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f4bf80ef720 con 0x7f4c081004f0 2024-03-04T09:12:56.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.569+0000 7f4c06ffd640 1 --2- 172.21.15.82:0/2486998682 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f4bf00a1d80 0x7f4bf00a4240 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4c08198de0 tx=0x7f4bfc005e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:12:56.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.573+0000 7f4c04ff9640 1 -- 172.21.15.82:0/2486998682 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f4bf804d070 con 0x7f4c081004f0 2024-03-04T09:12:56.585 INFO:journalctl@ceph.mds.i.smithi190.stdout:Mar 04 09:12:56 smithi190 systemd[1]: Starting Ceph mds.i for 2e533fc8-da06-11ee-95c6-87774f69a715... 2024-03-04T09:12:56.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.786+0000 7f4c0dc9a640 1 -- 172.21.15.82:0/2486998682 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4c0802cff0 con 0x7f4c081004f0 2024-03-04T09:12:56.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.787+0000 7f4c04ff9640 1 -- 172.21.15.82:0/2486998682 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6880 (secure 0 0 0) 0x7f4bf80bcff0 con 0x7f4c081004f0 2024-03-04T09:12:56.784 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:12:56.784 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3123844705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3123844705},{"type":"v1","addr":"172.21.15.82:6835","nonce":3123844705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2620634252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2620634252},{"type":"v1","addr":"172.21.15.82:6837","nonce":2620634252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/1142302200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":1142302200},{"type":"v1","addr":"172.21.15.102:6833","nonce":1142302200}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/3023382814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":3023382814},{"type":"v1","addr":"172.21.15.190:6833","nonce":3023382814}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/2134310473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":2134310473},{"type":"v1","addr":"172.21.15.102:6835","nonce":2134310473}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/3183532624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3183532624},{"type":"v1","addr":"172.21.15.190:6835","nonce":3183532624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/1210579527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1210579527},{"type":"v1","addr":"172.21.15.102:6837","nonce":1210579527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/1198639527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":1198639527},{"type":"v1","addr":"172.21.15.190:6837","nonce":1198639527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8}],"filesystems":[]} 2024-03-04T09:12:56.788 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 9 2024-03-04T09:12:56.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.789+0000 7f4c0dc9a640 1 -- 172.21.15.82:0/2486998682 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f4bf00a1d80 msgr2=0x7f4bf00a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:56.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.789+0000 7f4c0dc9a640 1 --2- 172.21.15.82:0/2486998682 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f4bf00a1d80 0x7f4bf00a4240 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4c08198de0 tx=0x7f4bfc005e50 comp rx=0 tx=0).stop 2024-03-04T09:12:56.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.789+0000 7f4c0dc9a640 1 -- 172.21.15.82:0/2486998682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c081004f0 msgr2=0x7f4c081978d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:56.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.789+0000 7f4c0dc9a640 1 --2- 172.21.15.82:0/2486998682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c081004f0 0x7f4c081978d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8005ab0 tx=0x7f4bf8004e90 comp rx=0 tx=0).stop 2024-03-04T09:12:56.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.789+0000 7f4c0dc9a640 1 -- 172.21.15.82:0/2486998682 shutdown_connections 2024-03-04T09:12:56.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.789+0000 7f4c0dc9a640 1 --2- 172.21.15.82:0/2486998682 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f4bf00a1d80 0x7f4bf00a4240 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:56.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.789+0000 7f4c0dc9a640 1 --2- 172.21.15.82:0/2486998682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c081020a0 0x7f4c0819ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:56.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.789+0000 7f4c0dc9a640 1 --2- 172.21.15.82:0/2486998682 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c081016e0 0x7f4c08197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:56.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.789+0000 7f4c0dc9a640 1 --2- 172.21.15.82:0/2486998682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c081004f0 0x7f4c081978d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:56.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.789+0000 7f4c0dc9a640 1 -- 172.21.15.82:0/2486998682 >> 172.21.15.82:0/2486998682 conn(0x7f4c080fba60 msgr2=0x7f4c081049e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:12:56.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.789+0000 7f4c0dc9a640 1 -- 172.21.15.82:0/2486998682 shutdown_connections 2024-03-04T09:12:56.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:56.789+0000 7f4c0dc9a640 1 -- 172.21.15.82:0/2486998682 wait complete. 2024-03-04T09:12:56.887 INFO:journalctl@ceph.mds.i.smithi190.stdout:Mar 04 09:12:56 smithi190 podman[67582]: 2024-03-04 09:12:56.491432125 +0000 UTC m=+0.017064709 image pull f88ffb32aa6a7d5dfdc954d9f096f0c9cc47981d05ec8d117ba859a22d8185ba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5 2024-03-04T09:12:56.888 INFO:journalctl@ceph.mds.i.smithi190.stdout:Mar 04 09:12:56 smithi190 podman[67582]: 2024-03-04 09:12:56.601957619 +0000 UTC m=+0.127590203 container create 6cd20d28ba89f5c3dcafc453f0f5a3029b455d120ebd270b9d0a36e2c2f8346d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-i, org.label-schema.build-date=20240222, RELEASE=wip-lusov-qdb-1bc250c, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-03-04T09:12:56.888 INFO:journalctl@ceph.mds.i.smithi190.stdout:Mar 04 09:12:56 smithi190 podman[67582]: 2024-03-04 09:12:56.787866975 +0000 UTC m=+0.313499573 container init 6cd20d28ba89f5c3dcafc453f0f5a3029b455d120ebd270b9d0a36e2c2f8346d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-i, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8) 2024-03-04T09:12:56.888 INFO:journalctl@ceph.mds.i.smithi190.stdout:Mar 04 09:12:56 smithi190 podman[67582]: 2024-03-04 09:12:56.790744997 +0000 UTC m=+0.316377582 container start 6cd20d28ba89f5c3dcafc453f0f5a3029b455d120ebd270b9d0a36e2c2f8346d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-i, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-qdb-1bc250c) 2024-03-04T09:12:56.888 INFO:journalctl@ceph.mds.i.smithi190.stdout:Mar 04 09:12:56 smithi190 ceph-mds[67601]: -- 172.21.15.190:0/2953710732 <== mon.1 v2:172.21.15.190:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55dcb5f3ba40 con 0x55dcb5f0f000 2024-03-04T09:12:56.888 INFO:journalctl@ceph.mds.i.smithi190.stdout:Mar 04 09:12:56 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-i[67597]: starting mds.i at 2024-03-04T09:12:56.888 INFO:journalctl@ceph.mds.i.smithi190.stdout:Mar 04 09:12:56 smithi190 bash[67582]: 6cd20d28ba89f5c3dcafc453f0f5a3029b455d120ebd270b9d0a36e2c2f8346d 2024-03-04T09:12:57.170 INFO:journalctl@ceph.mds.i.smithi190.stdout:Mar 04 09:12:56 smithi190 systemd[1]: Started Ceph mds.i for 2e533fc8-da06-11ee-95c6-87774f69a715. 2024-03-04T09:12:57.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:57 smithi082 ceph-mon[32880]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:12:57.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:57 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/2486998682' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:12:57.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:57 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:57.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:57 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:57.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:57 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:57.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:57 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-04T09:12:57.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:57 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-04T09:12:57.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:57 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:12:57.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:57 smithi190 ceph-mon[36341]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:12:57.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:57 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/2486998682' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:12:57.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:57 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:57.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:57 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:57.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:57 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:57.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:57 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-04T09:12:57.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:57 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-04T09:12:57.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:57 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:12:57.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:57 smithi102 ceph-mon[36220]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:12:57.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:57 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/2486998682' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:12:57.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:57 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:57.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:57 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:57.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:57 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:12:57.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:57 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-04T09:12:57.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:57 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-04T09:12:57.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:57 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:12:58.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:58 smithi082 ceph-mon[32880]: Deploying daemon mds.g on smithi082 2024-03-04T09:12:58.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:58 smithi082 ceph-mon[32880]: mds.? [v2:172.21.15.190:6838/878555510,v1:172.21.15.190:6839/878555510] up:boot 2024-03-04T09:12:58.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:58 smithi082 ceph-mon[32880]: fsmap 9 up:standby 2024-03-04T09:12:58.568 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:58 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-04T09:12:58.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:58 smithi190 ceph-mon[36341]: Deploying daemon mds.g on smithi082 2024-03-04T09:12:58.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:58 smithi190 ceph-mon[36341]: mds.? [v2:172.21.15.190:6838/878555510,v1:172.21.15.190:6839/878555510] up:boot 2024-03-04T09:12:58.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:58 smithi190 ceph-mon[36341]: fsmap 9 up:standby 2024-03-04T09:12:58.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:58 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-04T09:12:58.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:58 smithi102 ceph-mon[36220]: Deploying daemon mds.g on smithi082 2024-03-04T09:12:58.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:58 smithi102 ceph-mon[36220]: mds.? [v2:172.21.15.190:6838/878555510,v1:172.21.15.190:6839/878555510] up:boot 2024-03-04T09:12:58.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:58 smithi102 ceph-mon[36220]: fsmap 9 up:standby 2024-03-04T09:12:58.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:58 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-04T09:12:58.798 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T09:12:59.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.073+0000 7fb5f105c640 1 -- 172.21.15.82:0/130606885 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5ec1016e0 msgr2=0x7fb5ec101b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:59.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.073+0000 7fb5f105c640 1 --2- 172.21.15.82:0/130606885 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5ec1016e0 0x7fb5ec101b60 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4009900 tx=0x7fb5d402bc30 comp rx=0 tx=0).stop 2024-03-04T09:12:59.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.073+0000 7fb5f105c640 1 -- 172.21.15.82:0/130606885 shutdown_connections 2024-03-04T09:12:59.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.073+0000 7fb5f105c640 1 --2- 172.21.15.82:0/130606885 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5ec1020a0 0x7fb5ec108930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:59.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.073+0000 7fb5f105c640 1 --2- 172.21.15.82:0/130606885 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5ec1016e0 0x7fb5ec101b60 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:59.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.073+0000 7fb5f105c640 1 --2- 172.21.15.82:0/130606885 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5ec1004f0 0x7fb5ec100910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:59.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.073+0000 7fb5f105c640 1 -- 172.21.15.82:0/130606885 >> 172.21.15.82:0/130606885 conn(0x7fb5ec0fba60 msgr2=0x7fb5ec0fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:12:59.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.073+0000 7fb5f105c640 1 -- 172.21.15.82:0/130606885 shutdown_connections 2024-03-04T09:12:59.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.073+0000 7fb5f105c640 1 -- 172.21.15.82:0/130606885 wait complete. 2024-03-04T09:12:59.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.074+0000 7fb5f105c640 1 Processor -- start 2024-03-04T09:12:59.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.074+0000 7fb5f105c640 1 -- start start 2024-03-04T09:12:59.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.074+0000 7fb5f105c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5ec1004f0 0x7fb5ec0692c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:59.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.074+0000 7fb5f105c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5ec1016e0 0x7fb5ec19c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:59.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.074+0000 7fb5f105c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5ec1020a0 0x7fb5ec19ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:59.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.074+0000 7fb5f105c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec10c1d0 con 0x7fb5ec1004f0 2024-03-04T09:12:59.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.074+0000 7fb5f105c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec10c050 con 0x7fb5ec1020a0 2024-03-04T09:12:59.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.074+0000 7fb5f105c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec10c350 con 0x7fb5ec1016e0 2024-03-04T09:12:59.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.074+0000 7fb5ead9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5ec1004f0 0x7fb5ec0692c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:59.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.074+0000 7fb5ead9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5ec1004f0 0x7fb5ec0692c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45878/0 (socket says 172.21.15.82:45878) 2024-03-04T09:12:59.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.074+0000 7fb5ead9d640 1 -- 172.21.15.82:0/1285151848 learned_addr learned my addr 172.21.15.82:0/1285151848 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:12:59.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.074+0000 7fb5eb59e640 1 --2- 172.21.15.82:0/1285151848 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5ec1020a0 0x7fb5ec19ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:59.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.074+0000 7fb5e3fff640 1 --2- 172.21.15.82:0/1285151848 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5ec1016e0 0x7fb5ec19c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:59.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.075+0000 7fb5ead9d640 1 -- 172.21.15.82:0/1285151848 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5ec1016e0 msgr2=0x7fb5ec19c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:59.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.075+0000 7fb5ead9d640 1 --2- 172.21.15.82:0/1285151848 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5ec1016e0 0x7fb5ec19c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:59.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.075+0000 7fb5ead9d640 1 -- 172.21.15.82:0/1285151848 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5ec1020a0 msgr2=0x7fb5ec19ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:59.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.075+0000 7fb5ead9d640 1 --2- 172.21.15.82:0/1285151848 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5ec1020a0 0x7fb5ec19ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:59.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.075+0000 7fb5ead9d640 1 -- 172.21.15.82:0/1285151848 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ec19f5f0 con 0x7fb5ec1004f0 2024-03-04T09:12:59.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.075+0000 7fb5eb59e640 1 --2- 172.21.15.82:0/1285151848 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5ec1020a0 0x7fb5ec19ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T09:12:59.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.075+0000 7fb5ead9d640 1 --2- 172.21.15.82:0/1285151848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5ec1004f0 0x7fb5ec0692c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc00b450 tx=0x7fb5dc00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:12:59.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.075+0000 7fb5e8d99640 1 -- 172.21.15.82:0/1285151848 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc015020 con 0x7fb5ec1004f0 2024-03-04T09:12:59.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.075+0000 7fb5f105c640 1 -- 172.21.15.82:0/1285151848 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5ec19f8e0 con 0x7fb5ec1004f0 2024-03-04T09:12:59.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.075+0000 7fb5f105c640 1 -- 172.21.15.82:0/1285151848 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5ec19ff00 con 0x7fb5ec1004f0 2024-03-04T09:12:59.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.075+0000 7fb5e8d99640 1 -- 172.21.15.82:0/1285151848 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fb5dc011d60 con 0x7fb5ec1004f0 2024-03-04T09:12:59.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.075+0000 7fb5e8d99640 1 -- 172.21.15.82:0/1285151848 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc0103e0 con 0x7fb5ec1004f0 2024-03-04T09:12:59.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.076+0000 7fb5f105c640 1 -- 172.21.15.82:0/1285151848 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5cc0052c0 con 0x7fb5ec1004f0 2024-03-04T09:12:59.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.077+0000 7fb5e8d99640 1 -- 172.21.15.82:0/1285151848 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7fb5dc018020 con 0x7fb5ec1004f0 2024-03-04T09:12:59.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.078+0000 7fb5e8d99640 1 --2- 172.21.15.82:0/1285151848 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb5d80a1d80 0x7fb5d80a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:12:59.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.078+0000 7fb5e8d99640 1 -- 172.21.15.82:0/1285151848 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fb5dc0cd970 con 0x7fb5ec1004f0 2024-03-04T09:12:59.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.078+0000 7fb5e3fff640 1 --2- 172.21.15.82:0/1285151848 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb5d80a1d80 0x7fb5d80a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:12:59.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.078+0000 7fb5e3fff640 1 --2- 172.21.15.82:0/1285151848 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb5d80a1d80 0x7fb5d80a4240 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec069030 tx=0x7fb5d4000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:12:59.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.081+0000 7fb5e8d99640 1 -- 172.21.15.82:0/1285151848 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fb5dc01f020 con 0x7fb5ec1004f0 2024-03-04T09:12:59.310 INFO:journalctl@ceph.mds.g.smithi082.stdout:Mar 04 09:12:59 smithi082 systemd[1]: Starting Ceph mds.g for 2e533fc8-da06-11ee-95c6-87774f69a715... 2024-03-04T09:12:59.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.314+0000 7fb5f105c640 1 -- 172.21.15.82:0/1285151848 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb5cc0055b0 con 0x7fb5ec1004f0 2024-03-04T09:12:59.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.317+0000 7fb5e8d99640 1 -- 172.21.15.82:0/1285151848 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7673 (secure 0 0 0) 0x7fb5dc00d040 con 0x7fb5ec1004f0 2024-03-04T09:12:59.313 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:12:59.313 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3123844705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3123844705},{"type":"v1","addr":"172.21.15.82:6835","nonce":3123844705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2620634252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2620634252},{"type":"v1","addr":"172.21.15.82:6837","nonce":2620634252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/1142302200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":1142302200},{"type":"v1","addr":"172.21.15.102:6833","nonce":1142302200}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/3023382814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":3023382814},{"type":"v1","addr":"172.21.15.190:6833","nonce":3023382814}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/2134310473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":2134310473},{"type":"v1","addr":"172.21.15.102:6835","nonce":2134310473}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/3183532624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3183532624},{"type":"v1","addr":"172.21.15.190:6835","nonce":3183532624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/1210579527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1210579527},{"type":"v1","addr":"172.21.15.102:6837","nonce":1210579527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/1198639527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":1198639527},{"type":"v1","addr":"172.21.15.190:6837","nonce":1198639527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24469,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6839/878555510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":878555510},{"type":"v1","addr":"172.21.15.190:6839","nonce":878555510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2024-03-04T09:12:59.314 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 10 2024-03-04T09:12:59.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.320+0000 7fb5f105c640 1 -- 172.21.15.82:0/1285151848 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb5d80a1d80 msgr2=0x7fb5d80a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:59.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.320+0000 7fb5f105c640 1 --2- 172.21.15.82:0/1285151848 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb5d80a1d80 0x7fb5d80a4240 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec069030 tx=0x7fb5d4000bc0 comp rx=0 tx=0).stop 2024-03-04T09:12:59.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.320+0000 7fb5f105c640 1 -- 172.21.15.82:0/1285151848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5ec1004f0 msgr2=0x7fb5ec0692c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:12:59.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.320+0000 7fb5f105c640 1 --2- 172.21.15.82:0/1285151848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5ec1004f0 0x7fb5ec0692c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc00b450 tx=0x7fb5dc00b910 comp rx=0 tx=0).stop 2024-03-04T09:12:59.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.320+0000 7fb5f105c640 1 -- 172.21.15.82:0/1285151848 shutdown_connections 2024-03-04T09:12:59.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.320+0000 7fb5f105c640 1 --2- 172.21.15.82:0/1285151848 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb5d80a1d80 0x7fb5d80a4240 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:59.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.320+0000 7fb5f105c640 1 --2- 172.21.15.82:0/1285151848 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5ec1020a0 0x7fb5ec19ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:59.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.320+0000 7fb5f105c640 1 --2- 172.21.15.82:0/1285151848 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5ec1016e0 0x7fb5ec19c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:59.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.320+0000 7fb5f105c640 1 --2- 172.21.15.82:0/1285151848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5ec1004f0 0x7fb5ec0692c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:12:59.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.320+0000 7fb5f105c640 1 -- 172.21.15.82:0/1285151848 >> 172.21.15.82:0/1285151848 conn(0x7fb5ec0fba60 msgr2=0x7fb5ec1049e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:12:59.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.320+0000 7fb5f105c640 1 -- 172.21.15.82:0/1285151848 shutdown_connections 2024-03-04T09:12:59.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:12:59.320+0000 7fb5f105c640 1 -- 172.21.15.82:0/1285151848 wait complete. 2024-03-04T09:12:59.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:12:59 smithi082 ceph-mon[32880]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:12:59.567 INFO:journalctl@ceph.mds.g.smithi082.stdout:Mar 04 09:12:59 smithi082 podman[73921]: 2024-03-04 09:12:59.33926188 +0000 UTC m=+0.023600638 image pull f88ffb32aa6a7d5dfdc954d9f096f0c9cc47981d05ec8d117ba859a22d8185ba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5 2024-03-04T09:12:59.567 INFO:journalctl@ceph.mds.g.smithi082.stdout:Mar 04 09:12:59 smithi082 podman[73921]: 2024-03-04 09:12:59.460067672 +0000 UTC m=+0.144406430 container create 2d46f426b5af844f37ebca2506e250519df05ccee58f76a68866f737d4a9b6bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-g, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-qdb-1bc250c, maintainer=Guillaume Abrioux ) 2024-03-04T09:12:59.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:12:59 smithi190 ceph-mon[36341]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:12:59.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:12:59 smithi102 ceph-mon[36220]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:13:00.067 INFO:journalctl@ceph.mds.g.smithi082.stdout:Mar 04 09:12:59 smithi082 podman[73921]: 2024-03-04 09:12:59.714954101 +0000 UTC m=+0.399292859 container init 2d46f426b5af844f37ebca2506e250519df05ccee58f76a68866f737d4a9b6bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-g, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.build-date=20240222, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-03-04T09:13:00.067 INFO:journalctl@ceph.mds.g.smithi082.stdout:Mar 04 09:12:59 smithi082 podman[73921]: 2024-03-04 09:12:59.717689131 +0000 UTC m=+0.402027903 container start 2d46f426b5af844f37ebca2506e250519df05ccee58f76a68866f737d4a9b6bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-g, RELEASE=wip-lusov-qdb-1bc250c, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-03-04T09:13:00.067 INFO:journalctl@ceph.mds.g.smithi082.stdout:Mar 04 09:12:59 smithi082 ceph-mds[73943]: -- 172.21.15.82:0/1889025820 <== mon.0 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561e9e089a40 con 0x561e9e05cc00 2024-03-04T09:13:00.067 INFO:journalctl@ceph.mds.g.smithi082.stdout:Mar 04 09:12:59 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-g[73939]: starting mds.g at 2024-03-04T09:13:00.067 INFO:journalctl@ceph.mds.g.smithi082.stdout:Mar 04 09:12:59 smithi082 bash[73921]: 2d46f426b5af844f37ebca2506e250519df05ccee58f76a68866f737d4a9b6bd 2024-03-04T09:13:00.067 INFO:journalctl@ceph.mds.g.smithi082.stdout:Mar 04 09:12:59 smithi082 systemd[1]: Started Ceph mds.g for 2e533fc8-da06-11ee-95c6-87774f69a715. 2024-03-04T09:13:00.508 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:00 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/1285151848' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:13:00.508 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:00 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:00.509 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:00 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:00.509 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:00 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:00.509 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:00 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-04T09:13:00.509 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:00 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-04T09:13:00.509 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:00 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:13:00.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:00 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/1285151848' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:13:00.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:00 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:00.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:00 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:00.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:00 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:00.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:00 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-04T09:13:00.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:00 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-04T09:13:00.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:00 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:13:00.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:00 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/1285151848' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:13:00.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:00 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:00.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:00 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:00.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:00 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:00.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:00 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-04T09:13:00.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:00 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-04T09:13:00.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:00 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:13:01.332 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T09:13:01.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:01.446+0000 7f7a8e6fb640 1 -- 172.21.15.82:0/199721301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a88102810 msgr2=0x7f7a88102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:01.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:01.446+0000 7f7a8e6fb640 1 --2- 172.21.15.82:0/199721301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a88102810 0x7f7a88102c90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7a78009900 tx=0x7f7a7802bc30 comp rx=0 tx=0).stop 2024-03-04T09:13:01.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:01.446+0000 7f7a8e6fb640 1 -- 172.21.15.82:0/199721301 shutdown_connections 2024-03-04T09:13:01.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:01.446+0000 7f7a8e6fb640 1 --2- 172.21.15.82:0/199721301 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7a881031d0 0x7f7a88109a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:01.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:01.446+0000 7f7a8e6fb640 1 --2- 172.21.15.82:0/199721301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a88102810 0x7f7a88102c90 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:01.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:01.446+0000 7f7a8e6fb640 1 --2- 172.21.15.82:0/199721301 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7a88101620 0x7f7a88101a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:01.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:01.446+0000 7f7a8e6fb640 1 -- 172.21.15.82:0/199721301 >> 172.21.15.82:0/199721301 conn(0x7f7a880fcb70 msgr2=0x7f7a880fefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:01.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:01.446+0000 7f7a8e6fb640 1 -- 172.21.15.82:0/199721301 shutdown_connections 2024-03-04T09:13:01.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:01.446+0000 7f7a8e6fb640 1 -- 172.21.15.82:0/199721301 wait complete. 2024-03-04T09:13:01.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:01.447+0000 7f7a8e6fb640 1 Processor -- start 2024-03-04T09:13:01.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:01.447+0000 7f7a8e6fb640 1 -- start start 2024-03-04T09:13:01.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:01.447+0000 7f7a8e6fb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a88101620 0x7f7a88197930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:01.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:01.447+0000 7f7a8e6fb640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7a88102810 0x7f7a88197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:01.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:01.447+0000 7f7a8e6fb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7a881031d0 0x7f7a8819eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:01.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:01.447+0000 7f7a8e6fb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8810d2e0 con 0x7f7a88101620 2024-03-04T09:13:01.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:01.447+0000 7f7a8e6fb640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8810d160 con 0x7f7a881031d0 2024-03-04T09:13:01.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:01.447+0000 7f7a8e6fb640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8810d460 con 0x7f7a88102810 2024-03-04T09:13:01.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:01.447+0000 7f7a87fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a88101620 0x7f7a88197930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:01.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:01.447+0000 7f7a87fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a88101620 0x7f7a88197930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45924/0 (socket says 172.21.15.82:45924) 2024-03-04T09:13:01.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:01.447+0000 7f7a87fff640 1 -- 172.21.15.82:0/3178502513 learned_addr learned my addr 172.21.15.82:0/3178502513 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:01.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:01.447+0000 7f7a8cc98640 1 --2- 172.21.15.82:0/3178502513 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7a881031d0 0x7f7a8819eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:01.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:01.447+0000 7f7a877fe640 1 --2- 172.21.15.82:0/3178502513 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7a88102810 0x7f7a88197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:01.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:01.447+0000 7f7a87fff640 1 -- 172.21.15.82:0/3178502513 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7a88102810 msgr2=0x7f7a88197e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:01.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:01.447+0000 7f7a87fff640 1 --2- 172.21.15.82:0/3178502513 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7a88102810 0x7f7a88197e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:01.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:01.447+0000 7f7a87fff640 1 -- 172.21.15.82:0/3178502513 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7a881031d0 msgr2=0x7f7a8819eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:01.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:01.447+0000 7f7a87fff640 1 --2- 172.21.15.82:0/3178502513 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7a881031d0 0x7f7a8819eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:01.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:01.447+0000 7f7a87fff640 1 -- 172.21.15.82:0/3178502513 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a8819f550 con 0x7f7a88101620 2024-03-04T09:13:01.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:01.447+0000 7f7a87fff640 1 --2- 172.21.15.82:0/3178502513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a88101620 0x7f7a88197930 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7a7000c970 tx=0x7f7a7000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:01.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:01.448+0000 7f7a857fa640 1 -- 172.21.15.82:0/3178502513 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a70007c10 con 0x7f7a88101620 2024-03-04T09:13:01.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:01.448+0000 7f7a857fa640 1 -- 172.21.15.82:0/3178502513 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f7a70007db0 con 0x7f7a88101620 2024-03-04T09:13:01.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:01.448+0000 7f7a8e6fb640 1 -- 172.21.15.82:0/3178502513 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a8819f840 con 0x7f7a88101620 2024-03-04T09:13:01.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:01.448+0000 7f7a857fa640 1 -- 172.21.15.82:0/3178502513 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7000f8e0 con 0x7f7a88101620 2024-03-04T09:13:01.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:01.448+0000 7f7a8e6fb640 1 -- 172.21.15.82:0/3178502513 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a8819fe10 con 0x7f7a88101620 2024-03-04T09:13:01.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:01.449+0000 7f7a8e6fb640 1 -- 172.21.15.82:0/3178502513 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a881088e0 con 0x7f7a88101620 2024-03-04T09:13:01.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:01.450+0000 7f7a857fa640 1 -- 172.21.15.82:0/3178502513 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f7a7000fa80 con 0x7f7a88101620 2024-03-04T09:13:01.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:01.450+0000 7f7a857fa640 1 --2- 172.21.15.82:0/3178502513 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f7a740a1d80 0x7f7a740a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:01.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:01.450+0000 7f7a877fe640 1 --2- 172.21.15.82:0/3178502513 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f7a740a1d80 0x7f7a740a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:01.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:01.451+0000 7f7a857fa640 1 -- 172.21.15.82:0/3178502513 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f7a700cdcf0 con 0x7f7a88101620 2024-03-04T09:13:01.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:01.451+0000 7f7a877fe640 1 --2- 172.21.15.82:0/3178502513 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f7a740a1d80 0x7f7a740a4240 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7a88198e40 tx=0x7f7a78000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:01.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:01.455+0000 7f7a857fa640 1 -- 172.21.15.82:0/3178502513 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f7a700d2070 con 0x7f7a88101620 2024-03-04T09:13:01.511 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:01 smithi082 ceph-mon[32880]: Deploying daemon mds.a on smithi082 2024-03-04T09:13:01.512 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:01 smithi082 ceph-mon[32880]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:13:01.512 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:01 smithi082 ceph-mon[32880]: mds.? [v2:172.21.15.82:6838/1240838024,v1:172.21.15.82:6839/1240838024] up:boot 2024-03-04T09:13:01.512 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:01 smithi082 ceph-mon[32880]: fsmap 10 up:standby 2024-03-04T09:13:01.512 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:01 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-04T09:13:01.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:01 smithi190 ceph-mon[36341]: Deploying daemon mds.a on smithi082 2024-03-04T09:13:01.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:01 smithi190 ceph-mon[36341]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:13:01.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:01 smithi190 ceph-mon[36341]: mds.? [v2:172.21.15.82:6838/1240838024,v1:172.21.15.82:6839/1240838024] up:boot 2024-03-04T09:13:01.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:01 smithi190 ceph-mon[36341]: fsmap 10 up:standby 2024-03-04T09:13:01.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:01 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-04T09:13:01.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:01 smithi102 ceph-mon[36220]: Deploying daemon mds.a on smithi082 2024-03-04T09:13:01.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:01 smithi102 ceph-mon[36220]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:13:01.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:01 smithi102 ceph-mon[36220]: mds.? [v2:172.21.15.82:6838/1240838024,v1:172.21.15.82:6839/1240838024] up:boot 2024-03-04T09:13:01.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:01 smithi102 ceph-mon[36220]: fsmap 10 up:standby 2024-03-04T09:13:01.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:01 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-04T09:13:01.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:01.708+0000 7f7a8e6fb640 1 -- 172.21.15.82:0/3178502513 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7a8802d1e0 con 0x7f7a88101620 2024-03-04T09:13:01.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:01.709+0000 7f7a857fa640 1 -- 172.21.15.82:0/3178502513 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+8465 (secure 0 0 0) 0x7f7a7009b650 con 0x7f7a88101620 2024-03-04T09:13:01.705 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:13:01.706 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3123844705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3123844705},{"type":"v1","addr":"172.21.15.82:6835","nonce":3123844705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2620634252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2620634252},{"type":"v1","addr":"172.21.15.82:6837","nonce":2620634252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6839/1240838024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1240838024},{"type":"v1","addr":"172.21.15.82:6839","nonce":1240838024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/1142302200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":1142302200},{"type":"v1","addr":"172.21.15.102:6833","nonce":1142302200}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/3023382814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":3023382814},{"type":"v1","addr":"172.21.15.190:6833","nonce":3023382814}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/2134310473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":2134310473},{"type":"v1","addr":"172.21.15.102:6835","nonce":2134310473}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/3183532624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3183532624},{"type":"v1","addr":"172.21.15.190:6835","nonce":3183532624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/1210579527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1210579527},{"type":"v1","addr":"172.21.15.102:6837","nonce":1210579527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/1198639527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":1198639527},{"type":"v1","addr":"172.21.15.190:6837","nonce":1198639527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24469,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6839/878555510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":878555510},{"type":"v1","addr":"172.21.15.190:6839","nonce":878555510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2024-03-04T09:13:01.706 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 11 2024-03-04T09:13:01.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:01.711+0000 7f7a8e6fb640 1 -- 172.21.15.82:0/3178502513 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f7a740a1d80 msgr2=0x7f7a740a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:01.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:01.711+0000 7f7a8e6fb640 1 --2- 172.21.15.82:0/3178502513 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f7a740a1d80 0x7f7a740a4240 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7a88198e40 tx=0x7f7a78000bc0 comp rx=0 tx=0).stop 2024-03-04T09:13:01.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:01.711+0000 7f7a8e6fb640 1 -- 172.21.15.82:0/3178502513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a88101620 msgr2=0x7f7a88197930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:01.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:01.711+0000 7f7a8e6fb640 1 --2- 172.21.15.82:0/3178502513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a88101620 0x7f7a88197930 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7a7000c970 tx=0x7f7a7000ce30 comp rx=0 tx=0).stop 2024-03-04T09:13:01.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:01.711+0000 7f7a8e6fb640 1 -- 172.21.15.82:0/3178502513 shutdown_connections 2024-03-04T09:13:01.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:01.711+0000 7f7a8e6fb640 1 --2- 172.21.15.82:0/3178502513 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f7a740a1d80 0x7f7a740a4240 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:01.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:01.711+0000 7f7a8e6fb640 1 --2- 172.21.15.82:0/3178502513 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7a881031d0 0x7f7a8819eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:01.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:01.711+0000 7f7a8e6fb640 1 --2- 172.21.15.82:0/3178502513 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7a88102810 0x7f7a88197e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:01.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:01.711+0000 7f7a8e6fb640 1 --2- 172.21.15.82:0/3178502513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a88101620 0x7f7a88197930 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:01.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:01.711+0000 7f7a8e6fb640 1 -- 172.21.15.82:0/3178502513 >> 172.21.15.82:0/3178502513 conn(0x7f7a880fcb70 msgr2=0x7f7a88105ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:01.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:01.711+0000 7f7a8e6fb640 1 -- 172.21.15.82:0/3178502513 shutdown_connections 2024-03-04T09:13:01.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:01.711+0000 7f7a8e6fb640 1 -- 172.21.15.82:0/3178502513 wait complete. 2024-03-04T09:13:02.067 INFO:journalctl@ceph.mds.a.smithi082.stdout:Mar 04 09:13:02 smithi082 systemd[1]: Starting Ceph mds.a for 2e533fc8-da06-11ee-95c6-87774f69a715... 2024-03-04T09:13:02.490 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:02 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/3178502513' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:13:02.491 INFO:journalctl@ceph.mds.a.smithi082.stdout:Mar 04 09:13:02 smithi082 podman[74280]: 2024-03-04 09:13:02.142117217 +0000 UTC m=+0.018098328 image pull f88ffb32aa6a7d5dfdc954d9f096f0c9cc47981d05ec8d117ba859a22d8185ba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5 2024-03-04T09:13:02.491 INFO:journalctl@ceph.mds.a.smithi082.stdout:Mar 04 09:13:02 smithi082 podman[74280]: 2024-03-04 09:13:02.242028451 +0000 UTC m=+0.118009546 container create e7eed8ee517d59bd308e1bd32480d84f5e970ca440c59bfe62b639040dbb9fee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-a, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, RELEASE=wip-lusov-qdb-1bc250c, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_CLEAN=True) 2024-03-04T09:13:02.491 INFO:journalctl@ceph.mds.a.smithi082.stdout:Mar 04 09:13:02 smithi082 podman[74280]: 2024-03-04 09:13:02.46962536 +0000 UTC m=+0.345606456 container init e7eed8ee517d59bd308e1bd32480d84f5e970ca440c59bfe62b639040dbb9fee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-a, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-qdb-1bc250c, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-03-04T09:13:02.491 INFO:journalctl@ceph.mds.a.smithi082.stdout:Mar 04 09:13:02 smithi082 podman[74280]: 2024-03-04 09:13:02.472263353 +0000 UTC m=+0.348244459 container start e7eed8ee517d59bd308e1bd32480d84f5e970ca440c59bfe62b639040dbb9fee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-a, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-qdb-1bc250c, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-04T09:13:02.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:02 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/3178502513' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:13:02.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:02 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/3178502513' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:13:02.817 INFO:journalctl@ceph.mds.a.smithi082.stdout:Mar 04 09:13:02 smithi082 ceph-mds[74299]: -- 172.21.15.82:0/1496772637 <== mon.0 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c85aa9ba40 con 0x55c85aa6e800 2024-03-04T09:13:02.817 INFO:journalctl@ceph.mds.a.smithi082.stdout:Mar 04 09:13:02 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-a[74295]: starting mds.a at 2024-03-04T09:13:02.817 INFO:journalctl@ceph.mds.a.smithi082.stdout:Mar 04 09:13:02 smithi082 bash[74280]: e7eed8ee517d59bd308e1bd32480d84f5e970ca440c59bfe62b639040dbb9fee 2024-03-04T09:13:02.817 INFO:journalctl@ceph.mds.a.smithi082.stdout:Mar 04 09:13:02 smithi082 systemd[1]: Started Ceph mds.a for 2e533fc8-da06-11ee-95c6-87774f69a715. 2024-03-04T09:13:03.537 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:03 smithi102 ceph-mon[36220]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:13:03.538 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:03 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:03.538 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:03 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:03.538 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:03 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:03.538 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:03 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-04T09:13:03.538 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:03 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-04T09:13:03.538 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:03 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:13:03.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:03 smithi190 ceph-mon[36341]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:13:03.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:03 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:03.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:03 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:03.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:03 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:03.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:03 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-04T09:13:03.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:03 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-04T09:13:03.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:03 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:13:03.720 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T09:13:03.751 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:03 smithi082 ceph-mon[32880]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:13:03.751 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:03 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:03.751 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:03 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:03.751 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:03 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:03.751 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:03 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-04T09:13:03.751 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:03 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-04T09:13:03.751 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:03 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:13:03.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:03.840+0000 7f4499313640 1 -- 172.21.15.82:0/3216439425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44941004f0 msgr2=0x7f4494100910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:03.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:03.840+0000 7f4499313640 1 --2- 172.21.15.82:0/3216439425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44941004f0 0x7f4494100910 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f447c009900 tx=0x7f447c02bc30 comp rx=0 tx=0).stop 2024-03-04T09:13:03.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:03.840+0000 7f4499313640 1 -- 172.21.15.82:0/3216439425 shutdown_connections 2024-03-04T09:13:03.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:03.840+0000 7f4499313640 1 --2- 172.21.15.82:0/3216439425 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44941020a0 0x7f4494108930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:03.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:03.840+0000 7f4499313640 1 --2- 172.21.15.82:0/3216439425 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44941016e0 0x7f4494101b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:03.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:03.840+0000 7f4499313640 1 --2- 172.21.15.82:0/3216439425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44941004f0 0x7f4494100910 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:03.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:03.840+0000 7f4499313640 1 -- 172.21.15.82:0/3216439425 >> 172.21.15.82:0/3216439425 conn(0x7f44940fba80 msgr2=0x7f44940fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:03.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:03.840+0000 7f4499313640 1 -- 172.21.15.82:0/3216439425 shutdown_connections 2024-03-04T09:13:03.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:03.840+0000 7f4499313640 1 -- 172.21.15.82:0/3216439425 wait complete. 2024-03-04T09:13:03.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:03.841+0000 7f4499313640 1 Processor -- start 2024-03-04T09:13:03.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:03.841+0000 7f4499313640 1 -- start start 2024-03-04T09:13:03.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:03.841+0000 7f4499313640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44941004f0 0x7f449406a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:03.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:03.841+0000 7f4499313640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44941016e0 0x7f449419c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:03.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:03.841+0000 7f4499313640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44941020a0 0x7f449419ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:03.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:03.841+0000 7f4499313640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449410c150 con 0x7f44941004f0 2024-03-04T09:13:03.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:03.841+0000 7f4499313640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449410bfd0 con 0x7f44941020a0 2024-03-04T09:13:03.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:03.841+0000 7f4499313640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449410c2d0 con 0x7f44941016e0 2024-03-04T09:13:03.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:03.841+0000 7f4492ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44941004f0 0x7f449406a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:03.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:03.841+0000 7f4492ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44941004f0 0x7f449406a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45982/0 (socket says 172.21.15.82:45982) 2024-03-04T09:13:03.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:03.841+0000 7f4492ffd640 1 -- 172.21.15.82:0/3680470397 learned_addr learned my addr 172.21.15.82:0/3680470397 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:03.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:03.842+0000 7f4492ffd640 1 -- 172.21.15.82:0/3680470397 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44941016e0 msgr2=0x7f449419c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:03.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:03.842+0000 7f44927fc640 1 --2- 172.21.15.82:0/3680470397 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44941016e0 0x7f449419c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:03.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:03.842+0000 7f44937fe640 1 --2- 172.21.15.82:0/3680470397 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44941020a0 0x7f449419ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:03.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:03.842+0000 7f4492ffd640 1 --2- 172.21.15.82:0/3680470397 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44941016e0 0x7f449419c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:03.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:03.842+0000 7f4492ffd640 1 -- 172.21.15.82:0/3680470397 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44941020a0 msgr2=0x7f449419ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:03.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:03.842+0000 7f4492ffd640 1 --2- 172.21.15.82:0/3680470397 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44941020a0 0x7f449419ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:03.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:03.842+0000 7f4492ffd640 1 -- 172.21.15.82:0/3680470397 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449419f550 con 0x7f44941004f0 2024-03-04T09:13:03.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:03.842+0000 7f44927fc640 1 --2- 172.21.15.82:0/3680470397 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44941016e0 0x7f449419c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T09:13:03.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:03.842+0000 7f4492ffd640 1 --2- 172.21.15.82:0/3680470397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44941004f0 0x7f449406a730 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f447c02c880 tx=0x7f447c004e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:03.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:03.842+0000 7f448bfff640 1 -- 172.21.15.82:0/3680470397 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c043020 con 0x7f44941004f0 2024-03-04T09:13:03.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:03.842+0000 7f4499313640 1 -- 172.21.15.82:0/3680470397 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f449419f7e0 con 0x7f44941004f0 2024-03-04T09:13:03.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:03.842+0000 7f448bfff640 1 -- 172.21.15.82:0/3680470397 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f447c0054f0 con 0x7f44941004f0 2024-03-04T09:13:03.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:03.842+0000 7f448bfff640 1 -- 172.21.15.82:0/3680470397 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c003cd0 con 0x7f44941004f0 2024-03-04T09:13:03.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:03.842+0000 7f4499313640 1 -- 172.21.15.82:0/3680470397 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f449419fd80 con 0x7f44941004f0 2024-03-04T09:13:03.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:03.843+0000 7f4499313640 1 -- 172.21.15.82:0/3680470397 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4494107930 con 0x7f44941004f0 2024-03-04T09:13:03.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:03.844+0000 7f448bfff640 1 -- 172.21.15.82:0/3680470397 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f447c046020 con 0x7f44941004f0 2024-03-04T09:13:03.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:03.844+0000 7f448bfff640 1 --2- 172.21.15.82:0/3680470397 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f44800a1e00 0x7f44800a42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:03.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:03.845+0000 7f44927fc640 1 --2- 172.21.15.82:0/3680470397 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f44800a1e00 0x7f44800a42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:03.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:03.845+0000 7f448bfff640 1 -- 172.21.15.82:0/3680470397 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f447c0ef5e0 con 0x7f44941004f0 2024-03-04T09:13:03.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:03.845+0000 7f44927fc640 1 --2- 172.21.15.82:0/3680470397 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f44800a1e00 0x7f44800a42c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f449406a4a0 tx=0x7f4484005d30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:03.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:03.849+0000 7f448bfff640 1 -- 172.21.15.82:0/3680470397 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f447c04d070 con 0x7f44941004f0 2024-03-04T09:13:04.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:04.064+0000 7f4499313640 1 -- 172.21.15.82:0/3680470397 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f449402d1c0 con 0x7f44941004f0 2024-03-04T09:13:04.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:04.065+0000 7f448bfff640 1 -- 172.21.15.82:0/3680470397 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+9254 (secure 0 0 0) 0x7f447c0bceb0 con 0x7f44941004f0 2024-03-04T09:13:04.062 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:13:04.062 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3123844705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3123844705},{"type":"v1","addr":"172.21.15.82:6835","nonce":3123844705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2620634252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2620634252},{"type":"v1","addr":"172.21.15.82:6837","nonce":2620634252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6839/1240838024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1240838024},{"type":"v1","addr":"172.21.15.82:6839","nonce":1240838024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/213594267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":213594267},{"type":"v1","addr":"172.21.15.82:6841","nonce":213594267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/1142302200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":1142302200},{"type":"v1","addr":"172.21.15.102:6833","nonce":1142302200}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/3023382814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":3023382814},{"type":"v1","addr":"172.21.15.190:6833","nonce":3023382814}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/2134310473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":2134310473},{"type":"v1","addr":"172.21.15.102:6835","nonce":2134310473}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/3183532624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3183532624},{"type":"v1","addr":"172.21.15.190:6835","nonce":3183532624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/1210579527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1210579527},{"type":"v1","addr":"172.21.15.102:6837","nonce":1210579527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/1198639527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":1198639527},{"type":"v1","addr":"172.21.15.190:6837","nonce":1198639527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24469,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6839/878555510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":878555510},{"type":"v1","addr":"172.21.15.190:6839","nonce":878555510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2024-03-04T09:13:04.062 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 12 2024-03-04T09:13:04.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:04.067+0000 7f4499313640 1 -- 172.21.15.82:0/3680470397 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f44800a1e00 msgr2=0x7f44800a42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:04.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:04.067+0000 7f4499313640 1 --2- 172.21.15.82:0/3680470397 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f44800a1e00 0x7f44800a42c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f449406a4a0 tx=0x7f4484005d30 comp rx=0 tx=0).stop 2024-03-04T09:13:04.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:04.067+0000 7f4499313640 1 -- 172.21.15.82:0/3680470397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44941004f0 msgr2=0x7f449406a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:04.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:04.067+0000 7f4499313640 1 --2- 172.21.15.82:0/3680470397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44941004f0 0x7f449406a730 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f447c02c880 tx=0x7f447c004e20 comp rx=0 tx=0).stop 2024-03-04T09:13:04.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:04.068+0000 7f4499313640 1 -- 172.21.15.82:0/3680470397 shutdown_connections 2024-03-04T09:13:04.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:04.068+0000 7f4499313640 1 --2- 172.21.15.82:0/3680470397 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f44800a1e00 0x7f44800a42c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:04.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:04.068+0000 7f4499313640 1 --2- 172.21.15.82:0/3680470397 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44941020a0 0x7f449419ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:04.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:04.068+0000 7f4499313640 1 --2- 172.21.15.82:0/3680470397 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44941016e0 0x7f449419c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:04.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:04.068+0000 7f4499313640 1 --2- 172.21.15.82:0/3680470397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44941004f0 0x7f449406a730 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:04.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:04.068+0000 7f4499313640 1 -- 172.21.15.82:0/3680470397 >> 172.21.15.82:0/3680470397 conn(0x7f44940fba80 msgr2=0x7f4494104b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:04.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:04.068+0000 7f4499313640 1 -- 172.21.15.82:0/3680470397 shutdown_connections 2024-03-04T09:13:04.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:04.068+0000 7f4499313640 1 -- 172.21.15.82:0/3680470397 wait complete. 2024-03-04T09:13:04.619 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:04 smithi102 ceph-mon[36220]: Deploying daemon mds.b on smithi102 2024-03-04T09:13:04.619 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:04 smithi102 ceph-mon[36220]: mds.? [v2:172.21.15.82:6840/213594267,v1:172.21.15.82:6841/213594267] up:boot 2024-03-04T09:13:04.619 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:04 smithi102 ceph-mon[36220]: fsmap 11 up:standby 2024-03-04T09:13:04.619 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:04 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-04T09:13:04.619 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:04 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/3680470397' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:13:04.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:04 smithi190 ceph-mon[36341]: Deploying daemon mds.b on smithi102 2024-03-04T09:13:04.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:04 smithi190 ceph-mon[36341]: mds.? [v2:172.21.15.82:6840/213594267,v1:172.21.15.82:6841/213594267] up:boot 2024-03-04T09:13:04.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:04 smithi190 ceph-mon[36341]: fsmap 11 up:standby 2024-03-04T09:13:04.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:04 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-04T09:13:04.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:04 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/3680470397' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:13:04.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:04 smithi082 ceph-mon[32880]: Deploying daemon mds.b on smithi102 2024-03-04T09:13:04.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:04 smithi082 ceph-mon[32880]: mds.? [v2:172.21.15.82:6840/213594267,v1:172.21.15.82:6841/213594267] up:boot 2024-03-04T09:13:04.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:04 smithi082 ceph-mon[32880]: fsmap 11 up:standby 2024-03-04T09:13:04.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:04 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-04T09:13:04.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:04 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/3680470397' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:13:05.337 INFO:journalctl@ceph.mds.b.smithi102.stdout:Mar 04 09:13:05 smithi102 podman[65954]: 2024-03-04 09:13:05.242348918 +0000 UTC m=+0.134437653 container create c6738d754c0d7c82462374028d92b4cf8ed831ef3e25bca0a9b6791adac5acf1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-b, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-qdb-1bc250c, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8) 2024-03-04T09:13:05.616 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:05 smithi102 ceph-mon[36220]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:13:05.616 INFO:journalctl@ceph.mds.b.smithi102.stdout:Mar 04 09:13:05 smithi102 podman[65954]: 2024-03-04 09:13:05.520841777 +0000 UTC m=+0.412930511 container init c6738d754c0d7c82462374028d92b4cf8ed831ef3e25bca0a9b6791adac5acf1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-b, RELEASE=wip-lusov-qdb-1bc250c, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-03-04T09:13:05.617 INFO:journalctl@ceph.mds.b.smithi102.stdout:Mar 04 09:13:05 smithi102 podman[65954]: 2024-03-04 09:13:05.523589696 +0000 UTC m=+0.415678439 container start c6738d754c0d7c82462374028d92b4cf8ed831ef3e25bca0a9b6791adac5acf1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-b, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.build-date=20240222) 2024-03-04T09:13:05.617 INFO:journalctl@ceph.mds.b.smithi102.stdout:Mar 04 09:13:05 smithi102 ceph-mds[65974]: -- 172.21.15.102:0/995043074 <== mon.2 v2:172.21.15.102:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c5896c1a40 con 0x55c589694c00 2024-03-04T09:13:05.617 INFO:journalctl@ceph.mds.b.smithi102.stdout:Mar 04 09:13:05 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-b[65969]: starting mds.b at 2024-03-04T09:13:05.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:05 smithi190 ceph-mon[36341]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:13:05.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:05 smithi082 ceph-mon[32880]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:13:05.928 INFO:journalctl@ceph.mds.b.smithi102.stdout:Mar 04 09:13:05 smithi102 bash[65954]: c6738d754c0d7c82462374028d92b4cf8ed831ef3e25bca0a9b6791adac5acf1 2024-03-04T09:13:05.929 INFO:journalctl@ceph.mds.b.smithi102.stdout:Mar 04 09:13:05 smithi102 systemd[1]: Started Ceph mds.b for 2e533fc8-da06-11ee-95c6-87774f69a715. 2024-03-04T09:13:06.076 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T09:13:06.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.183+0000 7f4391ec9640 1 -- 172.21.15.82:0/1861121883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f438c102810 msgr2=0x7f438c102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:06.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.183+0000 7f4391ec9640 1 --2- 172.21.15.82:0/1861121883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f438c102810 0x7f438c102c90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f437c009900 tx=0x7f437c02bc30 comp rx=0 tx=0).stop 2024-03-04T09:13:06.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.183+0000 7f4391ec9640 1 -- 172.21.15.82:0/1861121883 shutdown_connections 2024-03-04T09:13:06.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.183+0000 7f4391ec9640 1 --2- 172.21.15.82:0/1861121883 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f438c1031d0 0x7f438c109a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:06.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.183+0000 7f4391ec9640 1 --2- 172.21.15.82:0/1861121883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f438c102810 0x7f438c102c90 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:06.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.183+0000 7f4391ec9640 1 --2- 172.21.15.82:0/1861121883 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f438c101620 0x7f438c101a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:06.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.183+0000 7f4391ec9640 1 -- 172.21.15.82:0/1861121883 >> 172.21.15.82:0/1861121883 conn(0x7f438c0fcb70 msgr2=0x7f438c0fefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:06.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.183+0000 7f4391ec9640 1 -- 172.21.15.82:0/1861121883 shutdown_connections 2024-03-04T09:13:06.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.183+0000 7f4391ec9640 1 -- 172.21.15.82:0/1861121883 wait complete. 2024-03-04T09:13:06.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.184+0000 7f4391ec9640 1 Processor -- start 2024-03-04T09:13:06.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.184+0000 7f4391ec9640 1 -- start start 2024-03-04T09:13:06.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.184+0000 7f4391ec9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f438c101620 0x7f438c075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:06.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.184+0000 7f4391ec9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f438c102810 0x7f438c0739c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:06.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.184+0000 7f4391ec9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f438c1031d0 0x7f438c073f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:06.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.184+0000 7f4391ec9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438c10d280 con 0x7f438c102810 2024-03-04T09:13:06.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.184+0000 7f4391ec9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438c10d100 con 0x7f438c1031d0 2024-03-04T09:13:06.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.184+0000 7f4391ec9640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438c10d400 con 0x7f438c101620 2024-03-04T09:13:06.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.184+0000 7f438affd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f438c102810 0x7f438c0739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:06.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.184+0000 7f438affd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f438c102810 0x7f438c0739c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46000/0 (socket says 172.21.15.82:46000) 2024-03-04T09:13:06.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.184+0000 7f438affd640 1 -- 172.21.15.82:0/1057396708 learned_addr learned my addr 172.21.15.82:0/1057396708 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:06.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.184+0000 7f438bfff640 1 --2- 172.21.15.82:0/1057396708 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f438c1031d0 0x7f438c073f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:06.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.184+0000 7f438b7fe640 1 --2- 172.21.15.82:0/1057396708 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f438c101620 0x7f438c075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:06.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.185+0000 7f438affd640 1 -- 172.21.15.82:0/1057396708 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f438c101620 msgr2=0x7f438c075380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:06.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.185+0000 7f438affd640 1 --2- 172.21.15.82:0/1057396708 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f438c101620 0x7f438c075380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:06.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.185+0000 7f438affd640 1 -- 172.21.15.82:0/1057396708 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f438c1031d0 msgr2=0x7f438c073f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:06.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.185+0000 7f438affd640 1 --2- 172.21.15.82:0/1057396708 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f438c1031d0 0x7f438c073f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:06.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.185+0000 7f438affd640 1 -- 172.21.15.82:0/1057396708 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f438c074790 con 0x7f438c102810 2024-03-04T09:13:06.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.185+0000 7f438bfff640 1 --2- 172.21.15.82:0/1057396708 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f438c1031d0 0x7f438c073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:13:06.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.185+0000 7f438affd640 1 --2- 172.21.15.82:0/1057396708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f438c102810 0x7f438c0739c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f437c009230 tx=0x7f437c005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:06.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.185+0000 7f4388ff9640 1 -- 172.21.15.82:0/1057396708 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f437c043020 con 0x7f438c102810 2024-03-04T09:13:06.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.185+0000 7f4391ec9640 1 -- 172.21.15.82:0/1057396708 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f438c1a1a40 con 0x7f438c102810 2024-03-04T09:13:06.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.185+0000 7f4388ff9640 1 -- 172.21.15.82:0/1057396708 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f437c0054b0 con 0x7f438c102810 2024-03-04T09:13:06.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.185+0000 7f4388ff9640 1 -- 172.21.15.82:0/1057396708 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f437c003b80 con 0x7f438c102810 2024-03-04T09:13:06.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.185+0000 7f4391ec9640 1 -- 172.21.15.82:0/1057396708 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f438c1a1fe0 con 0x7f438c102810 2024-03-04T09:13:06.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.186+0000 7f4391ec9640 1 -- 172.21.15.82:0/1057396708 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f438c108940 con 0x7f438c102810 2024-03-04T09:13:06.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.187+0000 7f4388ff9640 1 -- 172.21.15.82:0/1057396708 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f437c046020 con 0x7f438c102810 2024-03-04T09:13:06.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.188+0000 7f4388ff9640 1 --2- 172.21.15.82:0/1057396708 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f43740a1d80 0x7f43740a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:06.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.188+0000 7f438b7fe640 1 --2- 172.21.15.82:0/1057396708 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f43740a1d80 0x7f43740a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:06.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.188+0000 7f4388ff9640 1 -- 172.21.15.82:0/1057396708 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f437c0ef550 con 0x7f438c102810 2024-03-04T09:13:06.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.188+0000 7f438b7fe640 1 --2- 172.21.15.82:0/1057396708 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f43740a1d80 0x7f43740a4240 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f438c102670 tx=0x7f4380005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:06.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.192+0000 7f4388ff9640 1 -- 172.21.15.82:0/1057396708 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f437c04d070 con 0x7f438c102810 2024-03-04T09:13:06.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.434+0000 7f4391ec9640 1 -- 172.21.15.82:0/1057396708 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f438c02cff0 con 0x7f438c102810 2024-03-04T09:13:06.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.434+0000 7f4388ff9640 1 -- 172.21.15.82:0/1057396708 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+10043 (secure 0 0 0) 0x7f437c0bce20 con 0x7f438c102810 2024-03-04T09:13:06.431 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:13:06.431 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3123844705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3123844705},{"type":"v1","addr":"172.21.15.82:6835","nonce":3123844705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2620634252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2620634252},{"type":"v1","addr":"172.21.15.82:6837","nonce":2620634252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6839/1240838024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1240838024},{"type":"v1","addr":"172.21.15.82:6839","nonce":1240838024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/213594267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":213594267},{"type":"v1","addr":"172.21.15.82:6841","nonce":213594267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/1142302200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":1142302200},{"type":"v1","addr":"172.21.15.102:6833","nonce":1142302200}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/3023382814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":3023382814},{"type":"v1","addr":"172.21.15.190:6833","nonce":3023382814}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/2134310473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":2134310473},{"type":"v1","addr":"172.21.15.102:6835","nonce":2134310473}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/3183532624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3183532624},{"type":"v1","addr":"172.21.15.190:6835","nonce":3183532624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/1210579527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1210579527},{"type":"v1","addr":"172.21.15.102:6837","nonce":1210579527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/1198639527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":1198639527},{"type":"v1","addr":"172.21.15.190:6837","nonce":1198639527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24469,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6839/878555510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":878555510},{"type":"v1","addr":"172.21.15.190:6839","nonce":878555510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":24476,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6839/35424130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":35424130},{"type":"v1","addr":"172.21.15.102:6839","nonce":35424130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[]} 2024-03-04T09:13:06.431 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 13 2024-03-04T09:13:06.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.436+0000 7f4391ec9640 1 -- 172.21.15.82:0/1057396708 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f43740a1d80 msgr2=0x7f43740a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:06.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.436+0000 7f4391ec9640 1 --2- 172.21.15.82:0/1057396708 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f43740a1d80 0x7f43740a4240 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f438c102670 tx=0x7f4380005f90 comp rx=0 tx=0).stop 2024-03-04T09:13:06.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.436+0000 7f4391ec9640 1 -- 172.21.15.82:0/1057396708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f438c102810 msgr2=0x7f438c0739c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:06.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.436+0000 7f4391ec9640 1 --2- 172.21.15.82:0/1057396708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f438c102810 0x7f438c0739c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f437c009230 tx=0x7f437c005dd0 comp rx=0 tx=0).stop 2024-03-04T09:13:06.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.436+0000 7f4391ec9640 1 -- 172.21.15.82:0/1057396708 shutdown_connections 2024-03-04T09:13:06.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.436+0000 7f4391ec9640 1 --2- 172.21.15.82:0/1057396708 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f43740a1d80 0x7f43740a4240 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:06.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.436+0000 7f4391ec9640 1 --2- 172.21.15.82:0/1057396708 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f438c1031d0 0x7f438c073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:06.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.436+0000 7f4391ec9640 1 --2- 172.21.15.82:0/1057396708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f438c102810 0x7f438c0739c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:06.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.436+0000 7f4391ec9640 1 --2- 172.21.15.82:0/1057396708 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f438c101620 0x7f438c075380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:06.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.436+0000 7f4391ec9640 1 -- 172.21.15.82:0/1057396708 >> 172.21.15.82:0/1057396708 conn(0x7f438c0fcb70 msgr2=0x7f438c105b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:06.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.437+0000 7f4391ec9640 1 -- 172.21.15.82:0/1057396708 shutdown_connections 2024-03-04T09:13:06.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.437+0000 7f4391ec9640 1 -- 172.21.15.82:0/1057396708 wait complete. 2024-03-04T09:13:06.446 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T09:13:06.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.559+0000 7f67eaec9640 1 -- 172.21.15.82:0/2024109106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67e41020d0 msgr2=0x7f67e41044c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:06.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.559+0000 7f67eaec9640 1 --2- 172.21.15.82:0/2024109106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67e41020d0 0x7f67e41044c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f67d8009900 tx=0x7f67d802bc30 comp rx=0 tx=0).stop 2024-03-04T09:13:06.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.559+0000 7f67eaec9640 1 -- 172.21.15.82:0/2024109106 shutdown_connections 2024-03-04T09:13:06.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.559+0000 7f67eaec9640 1 --2- 172.21.15.82:0/2024109106 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67e4107330 0x7f67e4109720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:06.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.559+0000 7f67eaec9640 1 --2- 172.21.15.82:0/2024109106 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f67e4104a00 0x7f67e4106df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:06.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.559+0000 7f67eaec9640 1 --2- 172.21.15.82:0/2024109106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67e41020d0 0x7f67e41044c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:06.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.559+0000 7f67eaec9640 1 -- 172.21.15.82:0/2024109106 >> 172.21.15.82:0/2024109106 conn(0x7f67e40fba60 msgr2=0x7f67e40fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:06.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.559+0000 7f67eaec9640 1 -- 172.21.15.82:0/2024109106 shutdown_connections 2024-03-04T09:13:06.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.559+0000 7f67eaec9640 1 -- 172.21.15.82:0/2024109106 wait complete. 2024-03-04T09:13:06.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.559+0000 7f67eaec9640 1 Processor -- start 2024-03-04T09:13:06.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.560+0000 7f67eaec9640 1 -- start start 2024-03-04T09:13:06.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.560+0000 7f67eaec9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67e41020d0 0x7f67e41978b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:06.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.560+0000 7f67eaec9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f67e4104a00 0x7f67e4197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:06.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.560+0000 7f67eaec9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67e4107330 0x7f67e419ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:06.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.560+0000 7f67eaec9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e410d270 con 0x7f67e4107330 2024-03-04T09:13:06.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.560+0000 7f67eaec9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e410d0f0 con 0x7f67e4104a00 2024-03-04T09:13:06.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.560+0000 7f67eaec9640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e410d3f0 con 0x7f67e41020d0 2024-03-04T09:13:06.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.560+0000 7f67e9466640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67e4107330 0x7f67e419ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:06.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.560+0000 7f67e9466640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67e4107330 0x7f67e419ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54254/0 (socket says 172.21.15.82:54254) 2024-03-04T09:13:06.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.560+0000 7f67e9466640 1 -- 172.21.15.82:0/1328339233 learned_addr learned my addr 172.21.15.82:0/1328339233 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:06.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.560+0000 7f67e3fff640 1 --2- 172.21.15.82:0/1328339233 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f67e4104a00 0x7f67e4197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:06.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.560+0000 7f67e8c65640 1 --2- 172.21.15.82:0/1328339233 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67e41020d0 0x7f67e41978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:06.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.560+0000 7f67e9466640 1 -- 172.21.15.82:0/1328339233 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67e41020d0 msgr2=0x7f67e41978b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:06.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.560+0000 7f67e9466640 1 --2- 172.21.15.82:0/1328339233 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67e41020d0 0x7f67e41978b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:06.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.560+0000 7f67e9466640 1 -- 172.21.15.82:0/1328339233 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f67e4104a00 msgr2=0x7f67e4197df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:06.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.560+0000 7f67e9466640 1 --2- 172.21.15.82:0/1328339233 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f67e4104a00 0x7f67e4197df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:06.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.560+0000 7f67e9466640 1 -- 172.21.15.82:0/1328339233 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e419f4d0 con 0x7f67e4107330 2024-03-04T09:13:06.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.560+0000 7f67e9466640 1 --2- 172.21.15.82:0/1328339233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67e4107330 0x7f67e419ee60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f67dc00cad0 tx=0x7f67dc00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:06.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.560+0000 7f67e1ffb640 1 -- 172.21.15.82:0/1328339233 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67dc00ad60 con 0x7f67e4107330 2024-03-04T09:13:06.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.560+0000 7f67e1ffb640 1 -- 172.21.15.82:0/1328339233 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f67dc005020 con 0x7f67e4107330 2024-03-04T09:13:06.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.560+0000 7f67eaec9640 1 -- 172.21.15.82:0/1328339233 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67e419f7c0 con 0x7f67e4107330 2024-03-04T09:13:06.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.560+0000 7f67e1ffb640 1 -- 172.21.15.82:0/1328339233 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67dc00f6b0 con 0x7f67e4107330 2024-03-04T09:13:06.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.561+0000 7f67eaec9640 1 -- 172.21.15.82:0/1328339233 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67e419fd10 con 0x7f67e4107330 2024-03-04T09:13:06.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.561+0000 7f67eaec9640 1 -- 172.21.15.82:0/1328339233 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67e40fd550 con 0x7f67e4107330 2024-03-04T09:13:06.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.562+0000 7f67e1ffb640 1 -- 172.21.15.82:0/1328339233 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f67dc0051d0 con 0x7f67e4107330 2024-03-04T09:13:06.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.563+0000 7f67e1ffb640 1 --2- 172.21.15.82:0/1328339233 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f67d40a1d80 0x7f67d40a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:06.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.563+0000 7f67e8c65640 1 --2- 172.21.15.82:0/1328339233 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f67d40a1d80 0x7f67d40a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:06.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.563+0000 7f67e1ffb640 1 -- 172.21.15.82:0/1328339233 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f67dc0cd910 con 0x7f67e4107330 2024-03-04T09:13:06.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.563+0000 7f67e8c65640 1 --2- 172.21.15.82:0/1328339233 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f67d40a1d80 0x7f67d40a4240 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f67d802c710 tx=0x7f67d8000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:06.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.567+0000 7f67e1ffb640 1 -- 172.21.15.82:0/1328339233 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f67dc014030 con 0x7f67e4107330 2024-03-04T09:13:06.736 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:06 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:06.736 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:06 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:06.737 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:06 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:06.737 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:06 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:06.737 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:06 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:06.737 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:06 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:13:06.737 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:06 smithi082 ceph-mon[32880]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:13:06.737 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:06 smithi082 ceph-mon[32880]: mds.? [v2:172.21.15.102:6838/35424130,v1:172.21.15.102:6839/35424130] up:boot 2024-03-04T09:13:06.737 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:06 smithi082 ceph-mon[32880]: fsmap 12 up:standby 2024-03-04T09:13:06.737 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:06 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-04T09:13:06.737 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:06 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/1057396708' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:13:06.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.747+0000 7f67eaec9640 1 -- 172.21.15.82:0/1328339233 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f67e40621d0 con 0x7f67e4107330 2024-03-04T09:13:06.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.749+0000 7f67e1ffb640 1 -- 172.21.15.82:0/1328339233 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+18420 (secure 0 0 0) 0x7f67dc09b1e0 con 0x7f67e4107330 2024-03-04T09:13:06.745 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:13:06.746 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":82,"fsid":"2e533fc8-da06-11ee-95c6-87774f69a715","created":"2024-03-04T09:05:16.488249+0000","modified":"2024-03-04T09:12:23.316714+0000","last_up_change":"2024-03-04T09:12:22.308711+0000","last_in_change":"2024-03-04T09:12:02.548212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T09:08:36.508257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"085b5c4b-ede9-4d0d-b994-50c89d991012","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6803","nonce":709655235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6805","nonce":709655235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6809","nonce":709655235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6807","nonce":709655235}]},"public_addr":"172.21.15.82:6803/709655235","cluster_addr":"172.21.15.82:6805/709655235","heartbeat_back_addr":"172.21.15.82:6809/709655235","heartbeat_front_addr":"172.21.15.82:6807/709655235","state":["exists","up"]},{"osd":1,"uuid":"e4dd7079-333e-4bcf-b3af-11fb082a5af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6801","nonce":270721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6803","nonce":270721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6807","nonce":270721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6805","nonce":270721212}]},"public_addr":"172.21.15.102:6801/270721212","cluster_addr":"172.21.15.102:6803/270721212","heartbeat_back_addr":"172.21.15.102:6807/270721212","heartbeat_front_addr":"172.21.15.102:6805/270721212","state":["exists","up"]},{"osd":2,"uuid":"6fed5fd6-dc82-497f-9d69-c10a5e5802da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6801","nonce":946410459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6803","nonce":946410459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6807","nonce":946410459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6805","nonce":946410459}]},"public_addr":"172.21.15.190:6801/946410459","cluster_addr":"172.21.15.190:6803/946410459","heartbeat_back_addr":"172.21.15.190:6807/946410459","heartbeat_front_addr":"172.21.15.190:6805/946410459","state":["exists","up"]},{"osd":3,"uuid":"91ccbdc3-3da6-4d39-8a89-3a7b7bb4adc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6811","nonce":980870924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6813","nonce":980870924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6817","nonce":980870924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6815","nonce":980870924}]},"public_addr":"172.21.15.82:6811/980870924","cluster_addr":"172.21.15.82:6813/980870924","heartbeat_back_addr":"172.21.15.82:6817/980870924","heartbeat_front_addr":"172.21.15.82:6815/980870924","state":["exists","up"]},{"osd":4,"uuid":"dbb9d486-5daa-4819-bbed-04fc76ca473e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6809","nonce":1229627753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6811","nonce":1229627753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6815","nonce":1229627753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6813","nonce":1229627753}]},"public_addr":"172.21.15.102:6809/1229627753","cluster_addr":"172.21.15.102:6811/1229627753","heartbeat_back_addr":"172.21.15.102:6815/1229627753","heartbeat_front_addr":"172.21.15.102:6813/1229627753","state":["exists","up"]},{"osd":5,"uuid":"6b50127b-df2b-4c95-8e53-9d42b40273fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6809","nonce":2171194148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6811","nonce":2171194148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6815","nonce":2171194148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6813","nonce":2171194148}]},"public_addr":"172.21.15.190:6809/2171194148","cluster_addr":"172.21.15.190:6811/2171194148","heartbeat_back_addr":"172.21.15.190:6815/2171194148","heartbeat_front_addr":"172.21.15.190:6813/2171194148","state":["exists","up"]},{"osd":6,"uuid":"e72bebb0-5939-4210-950a-41c25c23c62f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6819","nonce":454436959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6821","nonce":454436959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6825","nonce":454436959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6823","nonce":454436959}]},"public_addr":"172.21.15.82:6819/454436959","cluster_addr":"172.21.15.82:6821/454436959","heartbeat_back_addr":"172.21.15.82:6825/454436959","heartbeat_front_addr":"172.21.15.82:6823/454436959","state":["exists","up"]},{"osd":7,"uuid":"72f83f97-f496-4503-8284-6a7b8f99a6f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6817","nonce":2745057274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6819","nonce":2745057274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6823","nonce":2745057274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6821","nonce":2745057274}]},"public_addr":"172.21.15.102:6817/2745057274","cluster_addr":"172.21.15.102:6819/2745057274","heartbeat_back_addr":"172.21.15.102:6823/2745057274","heartbeat_front_addr":"172.21.15.102:6821/2745057274","state":["exists","up"]},{"osd":8,"uuid":"92c9109d-6ebb-4c50-9944-28cd7b2f9c0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6817","nonce":1679683516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6819","nonce":1679683516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6823","nonce":1679683516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6821","nonce":1679683516}]},"public_addr":"172.21.15.190:6817/1679683516","cluster_addr":"172.21.15.190:6819/1679683516","heartbeat_back_addr":"172.21.15.190:6823/1679683516","heartbeat_front_addr":"172.21.15.190:6821/1679683516","state":["exists","up"]},{"osd":9,"uuid":"a3cfce03-0148-475d-bf55-b8284ae1cad2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6827","nonce":1777272933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6829","nonce":1777272933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6833","nonce":1777272933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6831","nonce":1777272933}]},"public_addr":"172.21.15.82:6827/1777272933","cluster_addr":"172.21.15.82:6829/1777272933","heartbeat_back_addr":"172.21.15.82:6833/1777272933","heartbeat_front_addr":"172.21.15.82:6831/1777272933","state":["exists","up"]},{"osd":10,"uuid":"db156ccf-4396-43cb-b69a-bb9095b94b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6825","nonce":1012784035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6827","nonce":1012784035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6831","nonce":1012784035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6829","nonce":1012784035}]},"public_addr":"172.21.15.102:6825/1012784035","cluster_addr":"172.21.15.102:6827/1012784035","heartbeat_back_addr":"172.21.15.102:6831/1012784035","heartbeat_front_addr":"172.21.15.102:6829/1012784035","state":["exists","up"]},{"osd":11,"uuid":"b4d52576-f5b4-479f-8ff6-8fdba4635ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6825","nonce":144700355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6827","nonce":144700355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6831","nonce":144700355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6829","nonce":144700355}]},"public_addr":"172.21.15.190:6825/144700355","cluster_addr":"172.21.15.190:6827/144700355","heartbeat_back_addr":"172.21.15.190:6831/144700355","heartbeat_front_addr":"172.21.15.190:6829/144700355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:07:47.007772+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:09.944738+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:33.183567+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:58.302023+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:09:23.042488+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:09:47.616009+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:10:13.122887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:10:38.584530+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:03.473453+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:29.847105+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:55.152195+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:12:20.401765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6800/1901539016":"2024-03-05T09:06:12.169231+0000","172.21.15.82:0/1124105204":"2024-03-05T09:06:12.169231+0000","172.21.15.82:6801/1901539016":"2024-03-05T09:06:12.169231+0000","172.21.15.82:0/735262841":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/2402774828":"2024-03-05T09:05:44.913099+0000","172.21.15.82:6801/3291527077":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/1846720385":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/3757201752":"2024-03-05T09:06:12.169231+0000","172.21.15.82:6800/3291527077":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/984630078":"2024-03-05T09:06:12.169231+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T09:13:06.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.751+0000 7f67eaec9640 1 -- 172.21.15.82:0/1328339233 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f67d40a1d80 msgr2=0x7f67d40a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:06.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.751+0000 7f67eaec9640 1 --2- 172.21.15.82:0/1328339233 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f67d40a1d80 0x7f67d40a4240 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f67d802c710 tx=0x7f67d8000bc0 comp rx=0 tx=0).stop 2024-03-04T09:13:06.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.751+0000 7f67eaec9640 1 -- 172.21.15.82:0/1328339233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67e4107330 msgr2=0x7f67e419ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:06.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.751+0000 7f67eaec9640 1 --2- 172.21.15.82:0/1328339233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67e4107330 0x7f67e419ee60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f67dc00cad0 tx=0x7f67dc00ced0 comp rx=0 tx=0).stop 2024-03-04T09:13:06.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.751+0000 7f67eaec9640 1 -- 172.21.15.82:0/1328339233 shutdown_connections 2024-03-04T09:13:06.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.751+0000 7f67eaec9640 1 --2- 172.21.15.82:0/1328339233 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f67d40a1d80 0x7f67d40a4240 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:06.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.751+0000 7f67eaec9640 1 --2- 172.21.15.82:0/1328339233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67e4107330 0x7f67e419ee60 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:06.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.751+0000 7f67eaec9640 1 --2- 172.21.15.82:0/1328339233 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f67e4104a00 0x7f67e4197df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:06.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.751+0000 7f67eaec9640 1 --2- 172.21.15.82:0/1328339233 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67e41020d0 0x7f67e41978b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:06.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.751+0000 7f67eaec9640 1 -- 172.21.15.82:0/1328339233 >> 172.21.15.82:0/1328339233 conn(0x7f67e40fba60 msgr2=0x7f67e4102a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:06.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.751+0000 7f67eaec9640 1 -- 172.21.15.82:0/1328339233 shutdown_connections 2024-03-04T09:13:06.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.751+0000 7f67eaec9640 1 -- 172.21.15.82:0/1328339233 wait complete. 2024-03-04T09:13:06.758 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T09:08:36.508257+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-04T09:13:06.759 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-04T09:13:06.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.872+0000 7f6f4b46f640 1 -- 172.21.15.82:0/4094898782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f441027b0 msgr2=0x7f6f44104c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:06.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.872+0000 7f6f4b46f640 1 --2- 172.21.15.82:0/4094898782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f441027b0 0x7f6f44104c20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6f34009900 tx=0x7f6f3402bc30 comp rx=0 tx=0).stop 2024-03-04T09:13:06.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.872+0000 7f6f4b46f640 1 -- 172.21.15.82:0/4094898782 shutdown_connections 2024-03-04T09:13:06.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.872+0000 7f6f4b46f640 1 --2- 172.21.15.82:0/4094898782 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f44105160 0x7f6f441055e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:06.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.872+0000 7f6f4b46f640 1 --2- 172.21.15.82:0/4094898782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f441027b0 0x7f6f44104c20 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:06.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.872+0000 7f6f4b46f640 1 --2- 172.21.15.82:0/4094898782 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f440ffe40 0x7f6f44102270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:06.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.872+0000 7f6f4b46f640 1 -- 172.21.15.82:0/4094898782 >> 172.21.15.82:0/4094898782 conn(0x7f6f440fba60 msgr2=0x7f6f440fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:06.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.873+0000 7f6f4b46f640 1 -- 172.21.15.82:0/4094898782 shutdown_connections 2024-03-04T09:13:06.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.873+0000 7f6f4b46f640 1 -- 172.21.15.82:0/4094898782 wait complete. 2024-03-04T09:13:06.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.873+0000 7f6f4b46f640 1 Processor -- start 2024-03-04T09:13:06.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.873+0000 7f6f4b46f640 1 -- start start 2024-03-04T09:13:06.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.873+0000 7f6f4b46f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f440ffe40 0x7f6f4419def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:06.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.873+0000 7f6f4b46f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f441027b0 0x7f6f4419e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:06.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.873+0000 7f6f4b46f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f44105160 0x7f6f441a54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:06.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.873+0000 7f6f4b46f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f44113840 con 0x7f6f44105160 2024-03-04T09:13:06.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.873+0000 7f6f4b46f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f441136c0 con 0x7f6f440ffe40 2024-03-04T09:13:06.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.873+0000 7f6f4b46f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f441139c0 con 0x7f6f441027b0 2024-03-04T09:13:06.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.873+0000 7f6f49a0c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f44105160 0x7f6f441a54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:06.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.873+0000 7f6f49a0c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f44105160 0x7f6f441a54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54278/0 (socket says 172.21.15.82:54278) 2024-03-04T09:13:06.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.873+0000 7f6f49a0c640 1 -- 172.21.15.82:0/376646566 learned_addr learned my addr 172.21.15.82:0/376646566 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:06.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.873+0000 7f6f4920b640 1 --2- 172.21.15.82:0/376646566 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f440ffe40 0x7f6f4419def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:06.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.874+0000 7f6f48a0a640 1 --2- 172.21.15.82:0/376646566 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f441027b0 0x7f6f4419e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:06.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.874+0000 7f6f49a0c640 1 -- 172.21.15.82:0/376646566 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f441027b0 msgr2=0x7f6f4419e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:06.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.874+0000 7f6f49a0c640 1 --2- 172.21.15.82:0/376646566 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f441027b0 0x7f6f4419e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:06.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.874+0000 7f6f49a0c640 1 -- 172.21.15.82:0/376646566 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f440ffe40 msgr2=0x7f6f4419def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:06.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.874+0000 7f6f49a0c640 1 --2- 172.21.15.82:0/376646566 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f440ffe40 0x7f6f4419def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:06.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.874+0000 7f6f49a0c640 1 -- 172.21.15.82:0/376646566 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f441a5b10 con 0x7f6f44105160 2024-03-04T09:13:06.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.874+0000 7f6f4920b640 1 --2- 172.21.15.82:0/376646566 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f440ffe40 0x7f6f4419def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T09:13:06.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.874+0000 7f6f49a0c640 1 --2- 172.21.15.82:0/376646566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f44105160 0x7f6f441a54a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c00eaa0 tx=0x7f6f3c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:06.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.874+0000 7f6f3a7fc640 1 -- 172.21.15.82:0/376646566 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c00cdb0 con 0x7f6f44105160 2024-03-04T09:13:06.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.874+0000 7f6f3a7fc640 1 -- 172.21.15.82:0/376646566 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f6f3c005020 con 0x7f6f44105160 2024-03-04T09:13:06.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.874+0000 7f6f3a7fc640 1 -- 172.21.15.82:0/376646566 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c0116b0 con 0x7f6f44105160 2024-03-04T09:13:06.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.874+0000 7f6f4b46f640 1 -- 172.21.15.82:0/376646566 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f441a5e00 con 0x7f6f44105160 2024-03-04T09:13:06.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.874+0000 7f6f4b46f640 1 -- 172.21.15.82:0/376646566 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f441a6310 con 0x7f6f44105160 2024-03-04T09:13:06.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.875+0000 7f6f4b46f640 1 -- 172.21.15.82:0/376646566 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f440fd550 con 0x7f6f44105160 2024-03-04T09:13:06.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.876+0000 7f6f3a7fc640 1 -- 172.21.15.82:0/376646566 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f6f3c0051d0 con 0x7f6f44105160 2024-03-04T09:13:06.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.876+0000 7f6f3a7fc640 1 --2- 172.21.15.82:0/376646566 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f6f300a1e00 0x7f6f300a42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:06.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.877+0000 7f6f4920b640 1 --2- 172.21.15.82:0/376646566 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f6f300a1e00 0x7f6f300a42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:06.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.877+0000 7f6f3a7fc640 1 -- 172.21.15.82:0/376646566 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f6f3c0cdac0 con 0x7f6f44105160 2024-03-04T09:13:06.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.877+0000 7f6f4920b640 1 --2- 172.21.15.82:0/376646566 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f6f300a1e00 0x7f6f300a42c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6f40005d00 tx=0x7f6f40005c70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:06.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:06.881+0000 7f6f3a7fc640 1 -- 172.21.15.82:0/376646566 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f6f3c016030 con 0x7f6f44105160 2024-03-04T09:13:06.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:06 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:06.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:06 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:06.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:06 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:06.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:06 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:06.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:06 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:06.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:06 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:13:06.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:06 smithi190 ceph-mon[36341]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:13:06.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:06 smithi190 ceph-mon[36341]: mds.? [v2:172.21.15.102:6838/35424130,v1:172.21.15.102:6839/35424130] up:boot 2024-03-04T09:13:06.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:06 smithi190 ceph-mon[36341]: fsmap 12 up:standby 2024-03-04T09:13:06.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:06 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-04T09:13:06.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:06 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/1057396708' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:13:06.928 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:06 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:06.928 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:06 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:06.928 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:06 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:06.928 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:06 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:06.928 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:06 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:06.928 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:06 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:13:06.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:06 smithi102 ceph-mon[36220]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:13:06.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:06 smithi102 ceph-mon[36220]: mds.? [v2:172.21.15.102:6838/35424130,v1:172.21.15.102:6839/35424130] up:boot 2024-03-04T09:13:06.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:06 smithi102 ceph-mon[36220]: fsmap 12 up:standby 2024-03-04T09:13:06.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:06 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-04T09:13:06.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:06 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/1057396708' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:13:07.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.058+0000 7f6f4b46f640 1 -- 172.21.15.82:0/376646566 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6f4402d240 con 0x7f6f44105160 2024-03-04T09:13:07.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.058+0000 7f6f3a7fc640 1 -- 172.21.15.82:0/376646566 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6f3c09b390 con 0x7f6f44105160 2024-03-04T09:13:07.055 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-03-04T09:13:07.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.060+0000 7f6f4b46f640 1 -- 172.21.15.82:0/376646566 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f6f300a1e00 msgr2=0x7f6f300a42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:07.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.060+0000 7f6f4b46f640 1 --2- 172.21.15.82:0/376646566 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f6f300a1e00 0x7f6f300a42c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6f40005d00 tx=0x7f6f40005c70 comp rx=0 tx=0).stop 2024-03-04T09:13:07.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.060+0000 7f6f4b46f640 1 -- 172.21.15.82:0/376646566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f44105160 msgr2=0x7f6f441a54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:07.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.060+0000 7f6f4b46f640 1 --2- 172.21.15.82:0/376646566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f44105160 0x7f6f441a54a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c00eaa0 tx=0x7f6f3c00ef60 comp rx=0 tx=0).stop 2024-03-04T09:13:07.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.060+0000 7f6f4b46f640 1 -- 172.21.15.82:0/376646566 shutdown_connections 2024-03-04T09:13:07.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.060+0000 7f6f4b46f640 1 --2- 172.21.15.82:0/376646566 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f6f300a1e00 0x7f6f300a42c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:07.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.060+0000 7f6f4b46f640 1 --2- 172.21.15.82:0/376646566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f44105160 0x7f6f441a54a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:07.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.060+0000 7f6f4b46f640 1 --2- 172.21.15.82:0/376646566 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f441027b0 0x7f6f4419e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:07.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.060+0000 7f6f4b46f640 1 --2- 172.21.15.82:0/376646566 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f440ffe40 0x7f6f4419def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:07.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.060+0000 7f6f4b46f640 1 -- 172.21.15.82:0/376646566 >> 172.21.15.82:0/376646566 conn(0x7f6f440fba60 msgr2=0x7f6f44100880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:07.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.060+0000 7f6f4b46f640 1 -- 172.21.15.82:0/376646566 shutdown_connections 2024-03-04T09:13:07.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.061+0000 7f6f4b46f640 1 -- 172.21.15.82:0/376646566 wait complete. 2024-03-04T09:13:07.067 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-04T09:13:07.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.173+0000 7f8b13615640 1 -- 172.21.15.82:0/486859507 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b0c1020a0 msgr2=0x7f8b0c108930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:07.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.173+0000 7f8b13615640 1 --2- 172.21.15.82:0/486859507 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b0c1020a0 0x7f8b0c108930 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8b04009900 tx=0x7f8b0402bc30 comp rx=0 tx=0).stop 2024-03-04T09:13:07.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.173+0000 7f8b13615640 1 -- 172.21.15.82:0/486859507 shutdown_connections 2024-03-04T09:13:07.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.173+0000 7f8b13615640 1 --2- 172.21.15.82:0/486859507 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b0c1020a0 0x7f8b0c108930 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:07.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.173+0000 7f8b13615640 1 --2- 172.21.15.82:0/486859507 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b0c1016e0 0x7f8b0c101b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:07.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.173+0000 7f8b13615640 1 --2- 172.21.15.82:0/486859507 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b0c1004f0 0x7f8b0c100910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:07.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.173+0000 7f8b13615640 1 -- 172.21.15.82:0/486859507 >> 172.21.15.82:0/486859507 conn(0x7f8b0c0fba60 msgr2=0x7f8b0c0fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:07.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.173+0000 7f8b13615640 1 -- 172.21.15.82:0/486859507 shutdown_connections 2024-03-04T09:13:07.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.173+0000 7f8b13615640 1 -- 172.21.15.82:0/486859507 wait complete. 2024-03-04T09:13:07.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.174+0000 7f8b13615640 1 Processor -- start 2024-03-04T09:13:07.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.174+0000 7f8b13615640 1 -- start start 2024-03-04T09:13:07.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.174+0000 7f8b13615640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b0c1004f0 0x7f8b0c0692c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:07.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.174+0000 7f8b13615640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b0c1016e0 0x7f8b0c19c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:07.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.174+0000 7f8b13615640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b0c1020a0 0x7f8b0c19ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:07.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.174+0000 7f8b13615640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0c10c150 con 0x7f8b0c1004f0 2024-03-04T09:13:07.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.174+0000 7f8b13615640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0c10bfd0 con 0x7f8b0c1020a0 2024-03-04T09:13:07.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.174+0000 7f8b13615640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0c10c2d0 con 0x7f8b0c1016e0 2024-03-04T09:13:07.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.174+0000 7f8b113b1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b0c1004f0 0x7f8b0c0692c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:07.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.174+0000 7f8b113b1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b0c1004f0 0x7f8b0c0692c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54294/0 (socket says 172.21.15.82:54294) 2024-03-04T09:13:07.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.174+0000 7f8b113b1640 1 -- 172.21.15.82:0/1873515038 learned_addr learned my addr 172.21.15.82:0/1873515038 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:07.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.174+0000 7f8b11bb2640 1 --2- 172.21.15.82:0/1873515038 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b0c1020a0 0x7f8b0c19ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:07.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.175+0000 7f8b113b1640 1 -- 172.21.15.82:0/1873515038 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b0c1016e0 msgr2=0x7f8b0c19c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:07.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.175+0000 7f8b113b1640 1 --2- 172.21.15.82:0/1873515038 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b0c1016e0 0x7f8b0c19c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:07.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.175+0000 7f8b113b1640 1 -- 172.21.15.82:0/1873515038 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b0c1020a0 msgr2=0x7f8b0c19ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:07.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.175+0000 7f8b113b1640 1 --2- 172.21.15.82:0/1873515038 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b0c1020a0 0x7f8b0c19ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:07.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.175+0000 7f8b113b1640 1 -- 172.21.15.82:0/1873515038 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b0c19f4c0 con 0x7f8b0c1004f0 2024-03-04T09:13:07.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.175+0000 7f8b113b1640 1 --2- 172.21.15.82:0/1873515038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b0c1004f0 0x7f8b0c0692c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8b0800ebc0 tx=0x7f8b0800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:07.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.175+0000 7f8b027fc640 1 -- 172.21.15.82:0/1873515038 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b08003b70 con 0x7f8b0c1004f0 2024-03-04T09:13:07.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.175+0000 7f8b027fc640 1 -- 172.21.15.82:0/1873515038 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f8b08003d10 con 0x7f8b0c1004f0 2024-03-04T09:13:07.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.175+0000 7f8b13615640 1 -- 172.21.15.82:0/1873515038 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b0c19f7b0 con 0x7f8b0c1004f0 2024-03-04T09:13:07.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.175+0000 7f8b027fc640 1 -- 172.21.15.82:0/1873515038 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b08019880 con 0x7f8b0c1004f0 2024-03-04T09:13:07.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.175+0000 7f8b13615640 1 -- 172.21.15.82:0/1873515038 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b0c19fd50 con 0x7f8b0c1004f0 2024-03-04T09:13:07.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.176+0000 7f8b13615640 1 -- 172.21.15.82:0/1873515038 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b0c107810 con 0x7f8b0c1004f0 2024-03-04T09:13:07.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.177+0000 7f8b027fc640 1 -- 172.21.15.82:0/1873515038 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f8b08019a20 con 0x7f8b0c1004f0 2024-03-04T09:13:07.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.177+0000 7f8b027fc640 1 --2- 172.21.15.82:0/1873515038 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f8af80a1e00 0x7f8af80a42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:07.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.178+0000 7f8b10bb0640 1 --2- 172.21.15.82:0/1873515038 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f8af80a1e00 0x7f8af80a42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:07.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.178+0000 7f8b027fc640 1 -- 172.21.15.82:0/1873515038 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f8b080ce250 con 0x7f8b0c1004f0 2024-03-04T09:13:07.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.178+0000 7f8b10bb0640 1 --2- 172.21.15.82:0/1873515038 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f8af80a1e00 0x7f8af80a42c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8afc005fd0 tx=0x7f8afc005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:07.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.182+0000 7f8b027fc640 1 -- 172.21.15.82:0/1873515038 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f8b0809bb20 con 0x7f8b0c1004f0 2024-03-04T09:13:07.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.375+0000 7f8b13615640 1 -- 172.21.15.82:0/1873515038 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f8b0c02cff0 con 0x7f8b0c1004f0 2024-03-04T09:13:07.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.375+0000 7f8b027fc640 1 -- 172.21.15.82:0/1873515038 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v82) v1 ==== 84+0+65 (secure 0 0 0) 0x7f8b0809b420 con 0x7f8b0c1004f0 2024-03-04T09:13:07.372 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:13:07.372 INFO:teuthology.orchestra.run.smithi082.stdout:[ 2024-03-04T09:13:07.372 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:13:07.372 INFO:teuthology.orchestra.run.smithi082.stdout: "poolnum": 1, 2024-03-04T09:13:07.372 INFO:teuthology.orchestra.run.smithi082.stdout: "poolname": ".mgr" 2024-03-04T09:13:07.372 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:13:07.372 INFO:teuthology.orchestra.run.smithi082.stdout:] 2024-03-04T09:13:07.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.377+0000 7f8b13615640 1 -- 172.21.15.82:0/1873515038 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f8af80a1e00 msgr2=0x7f8af80a42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:07.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.377+0000 7f8b13615640 1 --2- 172.21.15.82:0/1873515038 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f8af80a1e00 0x7f8af80a42c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8afc005fd0 tx=0x7f8afc005850 comp rx=0 tx=0).stop 2024-03-04T09:13:07.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.377+0000 7f8b13615640 1 -- 172.21.15.82:0/1873515038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b0c1004f0 msgr2=0x7f8b0c0692c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:07.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.377+0000 7f8b13615640 1 --2- 172.21.15.82:0/1873515038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b0c1004f0 0x7f8b0c0692c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8b0800ebc0 tx=0x7f8b0800c6a0 comp rx=0 tx=0).stop 2024-03-04T09:13:07.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.377+0000 7f8b13615640 1 -- 172.21.15.82:0/1873515038 shutdown_connections 2024-03-04T09:13:07.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.377+0000 7f8b13615640 1 --2- 172.21.15.82:0/1873515038 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f8af80a1e00 0x7f8af80a42c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:07.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.377+0000 7f8b13615640 1 --2- 172.21.15.82:0/1873515038 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b0c1020a0 0x7f8b0c19ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:07.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.377+0000 7f8b13615640 1 --2- 172.21.15.82:0/1873515038 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b0c1016e0 0x7f8b0c19c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:07.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.377+0000 7f8b13615640 1 --2- 172.21.15.82:0/1873515038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b0c1004f0 0x7f8b0c0692c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:07.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.377+0000 7f8b13615640 1 -- 172.21.15.82:0/1873515038 >> 172.21.15.82:0/1873515038 conn(0x7f8b0c0fba60 msgr2=0x7f8b0c1049e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:07.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.377+0000 7f8b13615640 1 -- 172.21.15.82:0/1873515038 shutdown_connections 2024-03-04T09:13:07.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.377+0000 7f8b13615640 1 -- 172.21.15.82:0/1873515038 wait complete. 2024-03-04T09:13:07.385 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-04T09:13:07.385 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-04T09:13:07.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.501+0000 7fb2a08b5640 1 -- 172.21.15.82:0/369829045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb29c0ff8b0 msgr2=0x7fb29c0ffcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:07.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.501+0000 7fb2a08b5640 1 --2- 172.21.15.82:0/369829045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb29c0ff8b0 0x7fb29c0ffcd0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb28c009930 tx=0x7fb28c02bc30 comp rx=0 tx=0).stop 2024-03-04T09:13:07.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.501+0000 7fb2a08b5640 1 -- 172.21.15.82:0/369829045 shutdown_connections 2024-03-04T09:13:07.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.501+0000 7fb2a08b5640 1 --2- 172.21.15.82:0/369829045 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb29c103240 0x7fb29c109ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:07.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.501+0000 7fb2a08b5640 1 --2- 172.21.15.82:0/369829045 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb29c102880 0x7fb29c102d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:07.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.501+0000 7fb2a08b5640 1 --2- 172.21.15.82:0/369829045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb29c0ff8b0 0x7fb29c0ffcd0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:07.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.501+0000 7fb2a08b5640 1 -- 172.21.15.82:0/369829045 >> 172.21.15.82:0/369829045 conn(0x7fb29c0fb1e0 msgr2=0x7fb29c0fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:07.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.501+0000 7fb2a08b5640 1 -- 172.21.15.82:0/369829045 shutdown_connections 2024-03-04T09:13:07.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.501+0000 7fb2a08b5640 1 -- 172.21.15.82:0/369829045 wait complete. 2024-03-04T09:13:07.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.502+0000 7fb2a08b5640 1 Processor -- start 2024-03-04T09:13:07.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.502+0000 7fb2a08b5640 1 -- start start 2024-03-04T09:13:07.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.502+0000 7fb2a08b5640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb29c0ff8b0 0x7fb29c197990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:07.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.502+0000 7fb2a08b5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb29c102880 0x7fb29c197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:07.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.502+0000 7fb2a08b5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb29c103240 0x7fb29c19ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:07.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.502+0000 7fb2a08b5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb29c10d290 con 0x7fb29c103240 2024-03-04T09:13:07.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.502+0000 7fb2a08b5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb29c10d110 con 0x7fb29c102880 2024-03-04T09:13:07.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.502+0000 7fb2a08b5640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb29c10d410 con 0x7fb29c0ff8b0 2024-03-04T09:13:07.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.502+0000 7fb29ad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb29c103240 0x7fb29c19ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:07.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.502+0000 7fb29ad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb29c103240 0x7fb29c19ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54320/0 (socket says 172.21.15.82:54320) 2024-03-04T09:13:07.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.502+0000 7fb29ad9d640 1 -- 172.21.15.82:0/4184803795 learned_addr learned my addr 172.21.15.82:0/4184803795 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:07.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.502+0000 7fb29a59c640 1 --2- 172.21.15.82:0/4184803795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb29c0ff8b0 0x7fb29c197990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:07.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.502+0000 7fb293fff640 1 --2- 172.21.15.82:0/4184803795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb29c102880 0x7fb29c197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:07.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.502+0000 7fb29ad9d640 1 -- 172.21.15.82:0/4184803795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb29c0ff8b0 msgr2=0x7fb29c197990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:07.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.502+0000 7fb29ad9d640 1 --2- 172.21.15.82:0/4184803795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb29c0ff8b0 0x7fb29c197990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:07.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.502+0000 7fb29ad9d640 1 -- 172.21.15.82:0/4184803795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb29c102880 msgr2=0x7fb29c197ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:07.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.502+0000 7fb29ad9d640 1 --2- 172.21.15.82:0/4184803795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb29c102880 0x7fb29c197ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:07.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.502+0000 7fb29ad9d640 1 -- 172.21.15.82:0/4184803795 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb29c19f5b0 con 0x7fb29c103240 2024-03-04T09:13:07.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.502+0000 7fb29ad9d640 1 --2- 172.21.15.82:0/4184803795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb29c103240 0x7fb29c19ef40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb29400eb10 tx=0x7fb29400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:07.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.502+0000 7fb2937fe640 1 -- 172.21.15.82:0/4184803795 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb294004b20 con 0x7fb29c103240 2024-03-04T09:13:07.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.503+0000 7fb2a08b5640 1 -- 172.21.15.82:0/4184803795 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb29c19f8a0 con 0x7fb29c103240 2024-03-04T09:13:07.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.503+0000 7fb2937fe640 1 -- 172.21.15.82:0/4184803795 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fb294004cc0 con 0x7fb29c103240 2024-03-04T09:13:07.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.503+0000 7fb2937fe640 1 -- 172.21.15.82:0/4184803795 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb294010700 con 0x7fb29c103240 2024-03-04T09:13:07.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.503+0000 7fb2a08b5640 1 -- 172.21.15.82:0/4184803795 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb29c19fe40 con 0x7fb29c103240 2024-03-04T09:13:07.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.504+0000 7fb2a08b5640 1 -- 172.21.15.82:0/4184803795 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb29c108a20 con 0x7fb29c103240 2024-03-04T09:13:07.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.505+0000 7fb2937fe640 1 -- 172.21.15.82:0/4184803795 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7fb294005020 con 0x7fb29c103240 2024-03-04T09:13:07.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.505+0000 7fb2937fe640 1 --2- 172.21.15.82:0/4184803795 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb2880a1d80 0x7fb2880a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:07.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.506+0000 7fb29a59c640 1 --2- 172.21.15.82:0/4184803795 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb2880a1d80 0x7fb2880a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:07.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.506+0000 7fb2937fe640 1 -- 172.21.15.82:0/4184803795 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fb2940cde60 con 0x7fb29c103240 2024-03-04T09:13:07.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.506+0000 7fb29a59c640 1 --2- 172.21.15.82:0/4184803795 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb2880a1d80 0x7fb2880a4240 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb28c009900 tx=0x7fb28c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:07.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.511+0000 7fb2937fe640 1 -- 172.21.15.82:0/4184803795 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fb29409b730 con 0x7fb29c103240 2024-03-04T09:13:07.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:07.744+0000 7fb2a08b5640 1 -- 172.21.15.82:0/4184803795 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb29c02cff0 con 0x7fb29c103240 2024-03-04T09:13:08.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:07 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/1328339233' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:13:08.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:07 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/376646566' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-04T09:13:08.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:07 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:08.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:07 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/1873515038' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-03-04T09:13:08.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:07 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:08.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:07 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:08.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:07 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:08.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:07 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:08.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:07 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:08.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:07 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:08.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:07 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:13:08.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:07 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:13:08.068 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:07 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:08.170 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:07 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/1328339233' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:13:08.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:07 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/376646566' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-04T09:13:08.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:07 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:08.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:07 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/1873515038' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-03-04T09:13:08.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:07 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:08.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:07 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:08.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:07 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:08.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:07 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:08.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:07 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:08.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:07 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:08.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:07 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:13:08.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:07 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:13:08.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:07 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:08.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:07 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/1328339233' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:13:08.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:07 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/376646566' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-04T09:13:08.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:07 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:08.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:07 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/1873515038' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-03-04T09:13:08.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:07 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:08.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:07 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:08.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:07 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:08.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:07 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:08.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:07 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:08.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:07 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:08.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:07 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:13:08.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:07 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:13:08.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:07 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:08.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:08.718+0000 7fb2937fe640 1 -- 172.21.15.82:0/4184803795 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v83) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb29409b030 con 0x7fb29c103240 2024-03-04T09:13:08.715 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' created 2024-03-04T09:13:08.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:08.720+0000 7fb2a08b5640 1 -- 172.21.15.82:0/4184803795 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb2880a1d80 msgr2=0x7fb2880a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:08.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:08.720+0000 7fb2a08b5640 1 --2- 172.21.15.82:0/4184803795 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb2880a1d80 0x7fb2880a4240 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb28c009900 tx=0x7fb28c005fd0 comp rx=0 tx=0).stop 2024-03-04T09:13:08.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:08.720+0000 7fb2a08b5640 1 -- 172.21.15.82:0/4184803795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb29c103240 msgr2=0x7fb29c19ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:08.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:08.720+0000 7fb2a08b5640 1 --2- 172.21.15.82:0/4184803795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb29c103240 0x7fb29c19ef40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb29400eb10 tx=0x7fb29400c2d0 comp rx=0 tx=0).stop 2024-03-04T09:13:08.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:08.720+0000 7fb2a08b5640 1 -- 172.21.15.82:0/4184803795 shutdown_connections 2024-03-04T09:13:08.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:08.720+0000 7fb2a08b5640 1 --2- 172.21.15.82:0/4184803795 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb2880a1d80 0x7fb2880a4240 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:08.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:08.720+0000 7fb2a08b5640 1 --2- 172.21.15.82:0/4184803795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb29c103240 0x7fb29c19ef40 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:08.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:08.720+0000 7fb2a08b5640 1 --2- 172.21.15.82:0/4184803795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb29c102880 0x7fb29c197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:08.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:08.720+0000 7fb2a08b5640 1 --2- 172.21.15.82:0/4184803795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb29c0ff8b0 0x7fb29c197990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:08.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:08.720+0000 7fb2a08b5640 1 -- 172.21.15.82:0/4184803795 >> 172.21.15.82:0/4184803795 conn(0x7fb29c0fb1e0 msgr2=0x7fb29c105bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:08.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:08.720+0000 7fb2a08b5640 1 -- 172.21.15.82:0/4184803795 shutdown_connections 2024-03-04T09:13:08.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:08.720+0000 7fb2a08b5640 1 -- 172.21.15.82:0/4184803795 wait complete. 2024-03-04T09:13:08.731 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-03-04T09:13:08.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:08.846+0000 7fd2172fa640 1 -- 172.21.15.82:0/1618897673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2101016d0 msgr2=0x7fd210101b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:08.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:08.846+0000 7fd2172fa640 1 --2- 172.21.15.82:0/1618897673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2101016d0 0x7fd210101b50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd200009900 tx=0x7fd20002bc30 comp rx=0 tx=0).stop 2024-03-04T09:13:08.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:08.846+0000 7fd2172fa640 1 -- 172.21.15.82:0/1618897673 shutdown_connections 2024-03-04T09:13:08.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:08.846+0000 7fd2172fa640 1 --2- 172.21.15.82:0/1618897673 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd210102090 0x7fd210108920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:08.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:08.847+0000 7fd2172fa640 1 --2- 172.21.15.82:0/1618897673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2101016d0 0x7fd210101b50 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:08.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:08.847+0000 7fd2172fa640 1 --2- 172.21.15.82:0/1618897673 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2101004e0 0x7fd210100900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:08.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:08.847+0000 7fd2172fa640 1 -- 172.21.15.82:0/1618897673 >> 172.21.15.82:0/1618897673 conn(0x7fd2100fba70 msgr2=0x7fd2100fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:08.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:08.847+0000 7fd2172fa640 1 -- 172.21.15.82:0/1618897673 shutdown_connections 2024-03-04T09:13:08.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:08.847+0000 7fd2172fa640 1 -- 172.21.15.82:0/1618897673 wait complete. 2024-03-04T09:13:08.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:08.847+0000 7fd2172fa640 1 Processor -- start 2024-03-04T09:13:08.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:08.847+0000 7fd2172fa640 1 -- start start 2024-03-04T09:13:08.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:08.847+0000 7fd2172fa640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2101004e0 0x7fd210196820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:08.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:08.847+0000 7fd2172fa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2101016d0 0x7fd210196d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:08.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:08.847+0000 7fd2172fa640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd210102090 0x7fd21019ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:08.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:08.847+0000 7fd2172fa640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd21010c140 con 0x7fd2101016d0 2024-03-04T09:13:08.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:08.847+0000 7fd2172fa640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd21010bfc0 con 0x7fd2101004e0 2024-03-04T09:13:08.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:08.847+0000 7fd2172fa640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd21010c2c0 con 0x7fd210102090 2024-03-04T09:13:08.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:08.847+0000 7fd214895640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2101016d0 0x7fd210196d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:08.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:08.847+0000 7fd214895640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2101016d0 0x7fd210196d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54334/0 (socket says 172.21.15.82:54334) 2024-03-04T09:13:08.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:08.848+0000 7fd214895640 1 -- 172.21.15.82:0/3165121842 learned_addr learned my addr 172.21.15.82:0/3165121842 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:08.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:08.848+0000 7fd215897640 1 --2- 172.21.15.82:0/3165121842 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd210102090 0x7fd21019ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:08.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:08.848+0000 7fd215096640 1 --2- 172.21.15.82:0/3165121842 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2101004e0 0x7fd210196820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:08.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:08.848+0000 7fd214895640 1 -- 172.21.15.82:0/3165121842 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd210102090 msgr2=0x7fd21019ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:08.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:08.848+0000 7fd214895640 1 --2- 172.21.15.82:0/3165121842 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd210102090 0x7fd21019ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:08.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:08.848+0000 7fd214895640 1 -- 172.21.15.82:0/3165121842 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2101004e0 msgr2=0x7fd210196820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:08.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:08.848+0000 7fd214895640 1 --2- 172.21.15.82:0/3165121842 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2101004e0 0x7fd210196820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:08.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:08.848+0000 7fd214895640 1 -- 172.21.15.82:0/3165121842 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd21019e440 con 0x7fd2101016d0 2024-03-04T09:13:08.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:08.848+0000 7fd215897640 1 --2- 172.21.15.82:0/3165121842 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd210102090 0x7fd21019ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:13:08.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:08.848+0000 7fd214895640 1 --2- 172.21.15.82:0/3165121842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2101016d0 0x7fd210196d60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd200009230 tx=0x7fd200004e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:08.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:08.848+0000 7fd2067fc640 1 -- 172.21.15.82:0/3165121842 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd200043020 con 0x7fd2101016d0 2024-03-04T09:13:08.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:08.848+0000 7fd2172fa640 1 -- 172.21.15.82:0/3165121842 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd21019e6d0 con 0x7fd2101016d0 2024-03-04T09:13:08.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:08.848+0000 7fd2067fc640 1 -- 172.21.15.82:0/3165121842 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fd200005460 con 0x7fd2101016d0 2024-03-04T09:13:08.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:08.848+0000 7fd2067fc640 1 -- 172.21.15.82:0/3165121842 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd200003c60 con 0x7fd2101016d0 2024-03-04T09:13:08.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:08.848+0000 7fd2172fa640 1 -- 172.21.15.82:0/3165121842 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd21019ec20 con 0x7fd2101016d0 2024-03-04T09:13:08.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:08.849+0000 7fd2172fa640 1 -- 172.21.15.82:0/3165121842 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd210107880 con 0x7fd2101016d0 2024-03-04T09:13:08.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:08.850+0000 7fd2067fc640 1 -- 172.21.15.82:0/3165121842 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7fd200046020 con 0x7fd2101016d0 2024-03-04T09:13:08.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:08.851+0000 7fd2067fc640 1 --2- 172.21.15.82:0/3165121842 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fd1fc0a1d80 0x7fd1fc0a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:08.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:08.851+0000 7fd215096640 1 --2- 172.21.15.82:0/3165121842 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fd1fc0a1d80 0x7fd1fc0a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:08.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:08.851+0000 7fd2067fc640 1 -- 172.21.15.82:0/3165121842 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7497+0+0 (secure 0 0 0) 0x7fd2000efe30 con 0x7fd2101016d0 2024-03-04T09:13:08.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:08.852+0000 7fd215096640 1 --2- 172.21.15.82:0/3165121842 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fd1fc0a1d80 0x7fd1fc0a4240 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd20c005fd0 tx=0x7fd20c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:08.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:08.855+0000 7fd2067fc640 1 -- 172.21.15.82:0/3165121842 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fd20004d070 con 0x7fd2101016d0 2024-03-04T09:13:08.982 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:08 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/4184803795' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-03-04T09:13:08.982 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:08 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:13:08.982 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:08 smithi190 ceph-mon[36341]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:13:09.016 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:08 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/4184803795' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-03-04T09:13:09.016 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:08 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:13:09.016 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:08 smithi102 ceph-mon[36220]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:13:09.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:09.044+0000 7fd2172fa640 1 -- 172.21.15.82:0/3165121842 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7fd21002cff0 con 0x7fd2101016d0 2024-03-04T09:13:09.066 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:08 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/4184803795' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-03-04T09:13:09.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:08 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:13:09.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:08 smithi082 ceph-mon[32880]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:13:09.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:09.720+0000 7fd2067fc640 1 -- 172.21.15.82:0/3165121842 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v84) v1 ==== 171+0+0 (secure 0 0 0) 0x7fd2000bd570 con 0x7fd2101016d0 2024-03-04T09:13:09.717 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' created 2024-03-04T09:13:09.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:09.723+0000 7fd2172fa640 1 -- 172.21.15.82:0/3165121842 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fd1fc0a1d80 msgr2=0x7fd1fc0a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:09.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:09.723+0000 7fd2172fa640 1 --2- 172.21.15.82:0/3165121842 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fd1fc0a1d80 0x7fd1fc0a4240 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd20c005fd0 tx=0x7fd20c00b410 comp rx=0 tx=0).stop 2024-03-04T09:13:09.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:09.723+0000 7fd2172fa640 1 -- 172.21.15.82:0/3165121842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2101016d0 msgr2=0x7fd210196d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:09.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:09.723+0000 7fd2172fa640 1 --2- 172.21.15.82:0/3165121842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2101016d0 0x7fd210196d60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd200009230 tx=0x7fd200004e20 comp rx=0 tx=0).stop 2024-03-04T09:13:09.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:09.723+0000 7fd2172fa640 1 -- 172.21.15.82:0/3165121842 shutdown_connections 2024-03-04T09:13:09.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:09.723+0000 7fd2172fa640 1 --2- 172.21.15.82:0/3165121842 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fd1fc0a1d80 0x7fd1fc0a4240 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:09.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:09.723+0000 7fd2172fa640 1 --2- 172.21.15.82:0/3165121842 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd210102090 0x7fd21019ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:09.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:09.723+0000 7fd2172fa640 1 --2- 172.21.15.82:0/3165121842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2101016d0 0x7fd210196d60 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:09.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:09.723+0000 7fd2172fa640 1 --2- 172.21.15.82:0/3165121842 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2101004e0 0x7fd210196820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:09.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:09.723+0000 7fd2172fa640 1 -- 172.21.15.82:0/3165121842 >> 172.21.15.82:0/3165121842 conn(0x7fd2100fba70 msgr2=0x7fd210104a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:09.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:09.723+0000 7fd2172fa640 1 -- 172.21.15.82:0/3165121842 shutdown_connections 2024-03-04T09:13:09.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:09.723+0000 7fd2172fa640 1 -- 172.21.15.82:0/3165121842 wait complete. 2024-03-04T09:13:09.742 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-04T09:13:09.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:09.855+0000 7f8f5dbf7640 1 -- 172.21.15.82:0/1403540151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f581072b0 msgr2=0x7f8f58109700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:09.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:09.855+0000 7f8f5dbf7640 1 --2- 172.21.15.82:0/1403540151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f581072b0 0x7f8f58109700 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8f50009ca0 tx=0x7f8f5002c0f0 comp rx=0 tx=0).stop 2024-03-04T09:13:09.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:09.855+0000 7f8f5dbf7640 1 -- 172.21.15.82:0/1403540151 shutdown_connections 2024-03-04T09:13:09.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:09.855+0000 7f8f5dbf7640 1 --2- 172.21.15.82:0/1403540151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f581072b0 0x7f8f58109700 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:09.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:09.855+0000 7f8f5dbf7640 1 --2- 172.21.15.82:0/1403540151 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f58104980 0x7f8f58106d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:09.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:09.855+0000 7f8f5dbf7640 1 --2- 172.21.15.82:0/1403540151 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8f58102050 0x7f8f58104440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:09.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:09.855+0000 7f8f5dbf7640 1 -- 172.21.15.82:0/1403540151 >> 172.21.15.82:0/1403540151 conn(0x7f8f580fba40 msgr2=0x7f8f580fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:09.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:09.855+0000 7f8f5dbf7640 1 -- 172.21.15.82:0/1403540151 shutdown_connections 2024-03-04T09:13:09.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:09.855+0000 7f8f5dbf7640 1 -- 172.21.15.82:0/1403540151 wait complete. 2024-03-04T09:13:09.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:09.855+0000 7f8f5dbf7640 1 Processor -- start 2024-03-04T09:13:09.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:09.855+0000 7f8f5dbf7640 1 -- start start 2024-03-04T09:13:09.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:09.856+0000 7f8f5dbf7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8f58102050 0x7f8f581978f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:09.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:09.856+0000 7f8f5dbf7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f58104980 0x7f8f58197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:09.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:09.856+0000 7f8f5dbf7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f581072b0 0x7f8f5819eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:09.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:09.856+0000 7f8f5dbf7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5810d2d0 con 0x7f8f581072b0 2024-03-04T09:13:09.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:09.856+0000 7f8f5dbf7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5810d150 con 0x7f8f58104980 2024-03-04T09:13:09.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:09.856+0000 7f8f5dbf7640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5810d450 con 0x7f8f58102050 2024-03-04T09:13:09.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:09.856+0000 7f8f57fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f581072b0 0x7f8f5819eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:09.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:09.856+0000 7f8f57fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f581072b0 0x7f8f5819eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54350/0 (socket says 172.21.15.82:54350) 2024-03-04T09:13:09.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:09.856+0000 7f8f57fff640 1 -- 172.21.15.82:0/546352622 learned_addr learned my addr 172.21.15.82:0/546352622 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:09.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:09.856+0000 7f8f577fe640 1 --2- 172.21.15.82:0/546352622 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8f58102050 0x7f8f581978f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:09.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:09.856+0000 7f8f56ffd640 1 --2- 172.21.15.82:0/546352622 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f58104980 0x7f8f58197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:09.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:09.856+0000 7f8f57fff640 1 -- 172.21.15.82:0/546352622 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8f58102050 msgr2=0x7f8f581978f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:09.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:09.856+0000 7f8f57fff640 1 --2- 172.21.15.82:0/546352622 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8f58102050 0x7f8f581978f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:09.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:09.856+0000 7f8f57fff640 1 -- 172.21.15.82:0/546352622 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f58104980 msgr2=0x7f8f58197e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:09.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:09.856+0000 7f8f57fff640 1 --2- 172.21.15.82:0/546352622 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f58104980 0x7f8f58197e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:09.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:09.856+0000 7f8f57fff640 1 -- 172.21.15.82:0/546352622 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f5819f510 con 0x7f8f581072b0 2024-03-04T09:13:09.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:09.856+0000 7f8f57fff640 1 --2- 172.21.15.82:0/546352622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f581072b0 0x7f8f5819eea0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8f5002c630 tx=0x7f8f50032980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:09.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:09.856+0000 7f8f54ff9640 1 -- 172.21.15.82:0/546352622 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f50039050 con 0x7f8f581072b0 2024-03-04T09:13:09.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:09.856+0000 7f8f54ff9640 1 -- 172.21.15.82:0/546352622 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f8f5003a040 con 0x7f8f581072b0 2024-03-04T09:13:09.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:09.856+0000 7f8f5dbf7640 1 -- 172.21.15.82:0/546352622 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f5819f7a0 con 0x7f8f581072b0 2024-03-04T09:13:09.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:09.856+0000 7f8f54ff9640 1 -- 172.21.15.82:0/546352622 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f50040450 con 0x7f8f581072b0 2024-03-04T09:13:09.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:09.856+0000 7f8f5dbf7640 1 -- 172.21.15.82:0/546352622 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f5819fd60 con 0x7f8f581072b0 2024-03-04T09:13:09.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:09.857+0000 7f8f5dbf7640 1 -- 172.21.15.82:0/546352622 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f580fd530 con 0x7f8f581072b0 2024-03-04T09:13:09.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:09.859+0000 7f8f54ff9640 1 -- 172.21.15.82:0/546352622 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f8f50003c00 con 0x7f8f581072b0 2024-03-04T09:13:09.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:09.859+0000 7f8f54ff9640 1 --2- 172.21.15.82:0/546352622 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f8f400a1e00 0x7f8f400a42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:09.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:09.859+0000 7f8f577fe640 1 --2- 172.21.15.82:0/546352622 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f8f400a1e00 0x7f8f400a42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:09.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:09.859+0000 7f8f54ff9640 1 -- 172.21.15.82:0/546352622 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7879+0+0 (secure 0 0 0) 0x7f8f500f1220 con 0x7f8f581072b0 2024-03-04T09:13:09.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:09.860+0000 7f8f577fe640 1 --2- 172.21.15.82:0/546352622 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f8f400a1e00 0x7f8f400a42c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8f48005fd0 tx=0x7f8f4800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:09.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:09.863+0000 7f8f54ff9640 1 -- 172.21.15.82:0/546352622 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f8f500be800 con 0x7f8f581072b0 2024-03-04T09:13:10.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:09 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/4184803795' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-03-04T09:13:10.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:09 smithi082 ceph-mon[32880]: osdmap e83: 12 total, 12 up, 12 in 2024-03-04T09:13:10.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:09 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/3165121842' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-03-04T09:13:10.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:09 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:10.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:09 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:10.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:09 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:10.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:09 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:10.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:09 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:10.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:09 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:10.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:09 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:13:10.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:09 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:13:10.068 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:09 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:10.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:10.074+0000 7f8f5dbf7640 1 -- 172.21.15.82:0/546352622 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f8f58062240 con 0x7f8f581072b0 2024-03-04T09:13:10.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:09 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/4184803795' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-03-04T09:13:10.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:09 smithi190 ceph-mon[36341]: osdmap e83: 12 total, 12 up, 12 in 2024-03-04T09:13:10.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:09 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/3165121842' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-03-04T09:13:10.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:09 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:10.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:09 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:10.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:09 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:10.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:09 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:10.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:09 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:10.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:09 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:10.172 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:09 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:13:10.172 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:09 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:13:10.172 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:09 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:10.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:09 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/4184803795' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-03-04T09:13:10.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:09 smithi102 ceph-mon[36220]: osdmap e83: 12 total, 12 up, 12 in 2024-03-04T09:13:10.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:09 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/3165121842' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-03-04T09:13:10.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:09 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:10.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:09 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:10.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:09 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:10.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:09 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:10.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:09 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:10.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:09 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:10.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:09 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:13:10.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:09 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:13:10.180 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:09 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:13:10.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:10.747+0000 7f8f54ff9640 1 -- 172.21.15.82:0/546352622 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f8f500be100 con 0x7f8f581072b0 2024-03-04T09:13:10.743 INFO:teuthology.orchestra.run.smithi082.stderr:new fs with metadata pool 2 and data pool 3 2024-03-04T09:13:10.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:10.750+0000 7f8f5dbf7640 1 -- 172.21.15.82:0/546352622 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f8f400a1e00 msgr2=0x7f8f400a42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:10.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:10.750+0000 7f8f5dbf7640 1 --2- 172.21.15.82:0/546352622 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f8f400a1e00 0x7f8f400a42c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8f48005fd0 tx=0x7f8f4800b390 comp rx=0 tx=0).stop 2024-03-04T09:13:10.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:10.751+0000 7f8f5dbf7640 1 -- 172.21.15.82:0/546352622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f581072b0 msgr2=0x7f8f5819eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:10.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:10.751+0000 7f8f5dbf7640 1 --2- 172.21.15.82:0/546352622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f581072b0 0x7f8f5819eea0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8f5002c630 tx=0x7f8f50032980 comp rx=0 tx=0).stop 2024-03-04T09:13:10.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:10.751+0000 7f8f5dbf7640 1 -- 172.21.15.82:0/546352622 shutdown_connections 2024-03-04T09:13:10.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:10.751+0000 7f8f5dbf7640 1 --2- 172.21.15.82:0/546352622 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f8f400a1e00 0x7f8f400a42c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:10.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:10.751+0000 7f8f5dbf7640 1 --2- 172.21.15.82:0/546352622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f581072b0 0x7f8f5819eea0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:10.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:10.751+0000 7f8f5dbf7640 1 --2- 172.21.15.82:0/546352622 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f58104980 0x7f8f58197e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:10.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:10.751+0000 7f8f5dbf7640 1 --2- 172.21.15.82:0/546352622 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8f58102050 0x7f8f581978f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:10.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:10.751+0000 7f8f5dbf7640 1 -- 172.21.15.82:0/546352622 >> 172.21.15.82:0/546352622 conn(0x7f8f580fba40 msgr2=0x7f8f58102990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:10.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:10.751+0000 7f8f5dbf7640 1 -- 172.21.15.82:0/546352622 shutdown_connections 2024-03-04T09:13:10.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:10.751+0000 7f8f5dbf7640 1 -- 172.21.15.82:0/546352622 wait complete. 2024-03-04T09:13:10.768 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-03-04T09:13:10.768 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-03-04T09:13:10.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:10.881+0000 7f3c1e484640 1 -- 172.21.15.82:0/2912425252 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c18103190 msgr2=0x7f3c18109a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:10.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:10.881+0000 7f3c1e484640 1 --2- 172.21.15.82:0/2912425252 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c18103190 0x7f3c18109a20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3c10009ca0 tx=0x7f3c1002c0f0 comp rx=0 tx=0).stop 2024-03-04T09:13:10.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:10.881+0000 7f3c1e484640 1 -- 172.21.15.82:0/2912425252 shutdown_connections 2024-03-04T09:13:10.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:10.881+0000 7f3c1e484640 1 --2- 172.21.15.82:0/2912425252 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c18103190 0x7f3c18109a20 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:10.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:10.881+0000 7f3c1e484640 1 --2- 172.21.15.82:0/2912425252 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3c181027d0 0x7f3c18102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:10.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:10.881+0000 7f3c1e484640 1 --2- 172.21.15.82:0/2912425252 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3c181015e0 0x7f3c18101a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:10.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:10.881+0000 7f3c1e484640 1 -- 172.21.15.82:0/2912425252 >> 172.21.15.82:0/2912425252 conn(0x7f3c180fcb70 msgr2=0x7f3c180fef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:10.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:10.881+0000 7f3c1e484640 1 -- 172.21.15.82:0/2912425252 shutdown_connections 2024-03-04T09:13:10.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:10.881+0000 7f3c1e484640 1 -- 172.21.15.82:0/2912425252 wait complete. 2024-03-04T09:13:10.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:10.881+0000 7f3c1e484640 1 Processor -- start 2024-03-04T09:13:10.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:10.881+0000 7f3c1e484640 1 -- start start 2024-03-04T09:13:10.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:10.882+0000 7f3c1e484640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3c181015e0 0x7f3c18197820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:10.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:10.882+0000 7f3c1e484640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c181027d0 0x7f3c18197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:10.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:10.882+0000 7f3c1e484640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3c18103190 0x7f3c1819edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:10.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:10.882+0000 7f3c1e484640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1810d240 con 0x7f3c181027d0 2024-03-04T09:13:10.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:10.882+0000 7f3c1e484640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1810d0c0 con 0x7f3c181015e0 2024-03-04T09:13:10.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:10.882+0000 7f3c1e484640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1810d3c0 con 0x7f3c18103190 2024-03-04T09:13:10.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:10.882+0000 7f3c177fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c181027d0 0x7f3c18197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:10.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:10.882+0000 7f3c177fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c181027d0 0x7f3c18197d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54368/0 (socket says 172.21.15.82:54368) 2024-03-04T09:13:10.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:10.882+0000 7f3c177fe640 1 -- 172.21.15.82:0/3472853829 learned_addr learned my addr 172.21.15.82:0/3472853829 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:10.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:10.882+0000 7f3c17fff640 1 --2- 172.21.15.82:0/3472853829 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3c181015e0 0x7f3c18197820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:10.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:10.882+0000 7f3c1ca21640 1 --2- 172.21.15.82:0/3472853829 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3c18103190 0x7f3c1819edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:10.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:10.882+0000 7f3c177fe640 1 -- 172.21.15.82:0/3472853829 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3c18103190 msgr2=0x7f3c1819edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:10.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:10.882+0000 7f3c177fe640 1 --2- 172.21.15.82:0/3472853829 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3c18103190 0x7f3c1819edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:10.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:10.882+0000 7f3c177fe640 1 -- 172.21.15.82:0/3472853829 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3c181015e0 msgr2=0x7f3c18197820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:10.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:10.882+0000 7f3c177fe640 1 --2- 172.21.15.82:0/3472853829 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3c181015e0 0x7f3c18197820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:10.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:10.882+0000 7f3c177fe640 1 -- 172.21.15.82:0/3472853829 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c1819f440 con 0x7f3c181027d0 2024-03-04T09:13:10.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:10.882+0000 7f3c177fe640 1 --2- 172.21.15.82:0/3472853829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c181027d0 0x7f3c18197d60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3c0800c920 tx=0x7f3c0800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:10.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:10.882+0000 7f3c157fa640 1 -- 172.21.15.82:0/3472853829 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c08007c70 con 0x7f3c181027d0 2024-03-04T09:13:10.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:10.882+0000 7f3c157fa640 1 -- 172.21.15.82:0/3472853829 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f3c08007e10 con 0x7f3c181027d0 2024-03-04T09:13:10.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:10.882+0000 7f3c1e484640 1 -- 172.21.15.82:0/3472853829 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c1819f730 con 0x7f3c181027d0 2024-03-04T09:13:10.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:10.882+0000 7f3c157fa640 1 -- 172.21.15.82:0/3472853829 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c08018850 con 0x7f3c181027d0 2024-03-04T09:13:10.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:10.882+0000 7f3c1e484640 1 -- 172.21.15.82:0/3472853829 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c1819fc80 con 0x7f3c181027d0 2024-03-04T09:13:10.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:10.884+0000 7f3c1e484640 1 -- 172.21.15.82:0/3472853829 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c181088a0 con 0x7f3c181027d0 2024-03-04T09:13:10.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:10.885+0000 7f3c157fa640 1 -- 172.21.15.82:0/3472853829 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f3c08018a30 con 0x7f3c181027d0 2024-03-04T09:13:10.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:10.885+0000 7f3c157fa640 1 --2- 172.21.15.82:0/3472853829 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f3c000a1d80 0x7f3c000a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:10.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:10.885+0000 7f3c17fff640 1 --2- 172.21.15.82:0/3472853829 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f3c000a1d80 0x7f3c000a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:10.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:10.885+0000 7f3c157fa640 1 -- 172.21.15.82:0/3472853829 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f3c080cdd00 con 0x7f3c181027d0 2024-03-04T09:13:10.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:10.886+0000 7f3c17fff640 1 --2- 172.21.15.82:0/3472853829 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f3c000a1d80 0x7f3c000a4240 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c005fd0 tx=0x7f3c0c00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:10.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:10.890+0000 7f3c157fa640 1 -- 172.21.15.82:0/3472853829 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f3c08014030 con 0x7f3c181027d0 2024-03-04T09:13:11.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:10 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/3165121842' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-03-04T09:13:11.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:10 smithi082 ceph-mon[32880]: osdmap e84: 12 total, 12 up, 12 in 2024-03-04T09:13:11.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:10 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/546352622' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-03-04T09:13:11.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:10 smithi082 ceph-mon[32880]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-03-04T09:13:11.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:10 smithi082 ceph-mon[32880]: pgmap v283: 97 pgs: 5 creating+peering, 1 active+clean, 91 unknown; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:13:11.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:11.074+0000 7f3c1e484640 1 -- 172.21.15.82:0/3472853829 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f3c1802cff0 con 0x7f3c181027d0 2024-03-04T09:13:11.170 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:10 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/3165121842' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-03-04T09:13:11.170 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:10 smithi190 ceph-mon[36341]: osdmap e84: 12 total, 12 up, 12 in 2024-03-04T09:13:11.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:10 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/546352622' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-03-04T09:13:11.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:10 smithi190 ceph-mon[36341]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-03-04T09:13:11.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:10 smithi190 ceph-mon[36341]: pgmap v283: 97 pgs: 5 creating+peering, 1 active+clean, 91 unknown; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:13:11.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:10 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/3165121842' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-03-04T09:13:11.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:10 smithi102 ceph-mon[36220]: osdmap e84: 12 total, 12 up, 12 in 2024-03-04T09:13:11.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:10 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/546352622' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-03-04T09:13:11.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:10 smithi102 ceph-mon[36220]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-03-04T09:13:11.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:10 smithi102 ceph-mon[36220]: pgmap v283: 97 pgs: 5 creating+peering, 1 active+clean, 91 unknown; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:13:11.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:11.757+0000 7f3c157fa640 1 -- 172.21.15.82:0/3472853829 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v86) v1 ==== 157+0+0 (secure 0 0 0) 0x7f3c0809b280 con 0x7f3c181027d0 2024-03-04T09:13:11.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:11.759+0000 7f3c1e484640 1 -- 172.21.15.82:0/3472853829 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f3c000a1d80 msgr2=0x7f3c000a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:11.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:11.759+0000 7f3c1e484640 1 --2- 172.21.15.82:0/3472853829 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f3c000a1d80 0x7f3c000a4240 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c005fd0 tx=0x7f3c0c00b390 comp rx=0 tx=0).stop 2024-03-04T09:13:11.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:11.759+0000 7f3c1e484640 1 -- 172.21.15.82:0/3472853829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c181027d0 msgr2=0x7f3c18197d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:11.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:11.759+0000 7f3c1e484640 1 --2- 172.21.15.82:0/3472853829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c181027d0 0x7f3c18197d60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3c0800c920 tx=0x7f3c0800cde0 comp rx=0 tx=0).stop 2024-03-04T09:13:11.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:11.759+0000 7f3c1e484640 1 -- 172.21.15.82:0/3472853829 shutdown_connections 2024-03-04T09:13:11.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:11.759+0000 7f3c1e484640 1 --2- 172.21.15.82:0/3472853829 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f3c000a1d80 0x7f3c000a4240 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:11.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:11.759+0000 7f3c1e484640 1 --2- 172.21.15.82:0/3472853829 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3c18103190 0x7f3c1819edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:11.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:11.759+0000 7f3c1e484640 1 --2- 172.21.15.82:0/3472853829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c181027d0 0x7f3c18197d60 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:11.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:11.759+0000 7f3c1e484640 1 --2- 172.21.15.82:0/3472853829 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3c181015e0 0x7f3c18197820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:11.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:11.759+0000 7f3c1e484640 1 -- 172.21.15.82:0/3472853829 >> 172.21.15.82:0/3472853829 conn(0x7f3c180fcb70 msgr2=0x7f3c18105a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:11.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:11.759+0000 7f3c1e484640 1 -- 172.21.15.82:0/3472853829 shutdown_connections 2024-03-04T09:13:11.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:11.760+0000 7f3c1e484640 1 -- 172.21.15.82:0/3472853829 wait complete. 2024-03-04T09:13:11.769 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-03-04T09:13:11.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:11.884+0000 7f6ebc4aa640 1 -- 172.21.15.82:0/165386991 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6eb41015f0 msgr2=0x7f6eb4101a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:11.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:11.884+0000 7f6ebc4aa640 1 --2- 172.21.15.82:0/165386991 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6eb41015f0 0x7f6eb4101a10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0009ca0 tx=0x7f6eb002c0f0 comp rx=0 tx=0).stop 2024-03-04T09:13:11.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:11.884+0000 7f6ebc4aa640 1 -- 172.21.15.82:0/165386991 shutdown_connections 2024-03-04T09:13:11.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:11.884+0000 7f6ebc4aa640 1 --2- 172.21.15.82:0/165386991 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6eb41031a0 0x7f6eb4109a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:11.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:11.884+0000 7f6ebc4aa640 1 --2- 172.21.15.82:0/165386991 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6eb41027e0 0x7f6eb4102c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:11.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:11.884+0000 7f6ebc4aa640 1 --2- 172.21.15.82:0/165386991 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6eb41015f0 0x7f6eb4101a10 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:11.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:11.884+0000 7f6ebc4aa640 1 -- 172.21.15.82:0/165386991 >> 172.21.15.82:0/165386991 conn(0x7f6eb40fcb80 msgr2=0x7f6eb40fefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:11.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:11.884+0000 7f6ebc4aa640 1 -- 172.21.15.82:0/165386991 shutdown_connections 2024-03-04T09:13:11.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:11.884+0000 7f6ebc4aa640 1 -- 172.21.15.82:0/165386991 wait complete. 2024-03-04T09:13:11.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:11.885+0000 7f6ebc4aa640 1 Processor -- start 2024-03-04T09:13:11.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:11.885+0000 7f6ebc4aa640 1 -- start start 2024-03-04T09:13:11.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:11.885+0000 7f6ebc4aa640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6eb41015f0 0x7f6eb4197980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:11.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:11.885+0000 7f6ebc4aa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6eb41027e0 0x7f6eb4197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:11.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:11.885+0000 7f6ebc4aa640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6eb41031a0 0x7f6eb419ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:11.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:11.885+0000 7f6ebc4aa640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb410d2b0 con 0x7f6eb41027e0 2024-03-04T09:13:11.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:11.885+0000 7f6ebc4aa640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb410d130 con 0x7f6eb41031a0 2024-03-04T09:13:11.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:11.885+0000 7f6ebc4aa640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb410d430 con 0x7f6eb41015f0 2024-03-04T09:13:11.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:11.885+0000 7f6eb9a45640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6eb41027e0 0x7f6eb4197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:11.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:11.885+0000 7f6eb9a45640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6eb41027e0 0x7f6eb4197ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54376/0 (socket says 172.21.15.82:54376) 2024-03-04T09:13:11.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:11.885+0000 7f6eb9a45640 1 -- 172.21.15.82:0/3958661598 learned_addr learned my addr 172.21.15.82:0/3958661598 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:11.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:11.885+0000 7f6ebaa47640 1 --2- 172.21.15.82:0/3958661598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6eb41031a0 0x7f6eb419ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:11.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:11.885+0000 7f6eba246640 1 --2- 172.21.15.82:0/3958661598 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6eb41015f0 0x7f6eb4197980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:11.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:11.885+0000 7f6eb9a45640 1 -- 172.21.15.82:0/3958661598 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6eb41015f0 msgr2=0x7f6eb4197980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:11.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:11.885+0000 7f6eb9a45640 1 --2- 172.21.15.82:0/3958661598 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6eb41015f0 0x7f6eb4197980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:11.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:11.885+0000 7f6eb9a45640 1 -- 172.21.15.82:0/3958661598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6eb41031a0 msgr2=0x7f6eb419ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:11.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:11.885+0000 7f6eb9a45640 1 --2- 172.21.15.82:0/3958661598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6eb41031a0 0x7f6eb419ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:11.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:11.885+0000 7f6eb9a45640 1 -- 172.21.15.82:0/3958661598 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb419f5a0 con 0x7f6eb41027e0 2024-03-04T09:13:11.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:11.886+0000 7f6eb9a45640 1 --2- 172.21.15.82:0/3958661598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6eb41027e0 0x7f6eb4197ec0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6ea400e9f0 tx=0x7f6ea400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:11.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:11.886+0000 7f6eab7fe640 1 -- 172.21.15.82:0/3958661598 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea400cd80 con 0x7f6eb41027e0 2024-03-04T09:13:11.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:11.886+0000 7f6ebc4aa640 1 -- 172.21.15.82:0/3958661598 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eb419f890 con 0x7f6eb41027e0 2024-03-04T09:13:11.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:11.886+0000 7f6eab7fe640 1 -- 172.21.15.82:0/3958661598 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f6ea4010900 con 0x7f6eb41027e0 2024-03-04T09:13:11.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:11.886+0000 7f6eab7fe640 1 -- 172.21.15.82:0/3958661598 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea40189e0 con 0x7f6eb41027e0 2024-03-04T09:13:11.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:11.886+0000 7f6ebc4aa640 1 -- 172.21.15.82:0/3958661598 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eb419feb0 con 0x7f6eb41027e0 2024-03-04T09:13:11.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:11.887+0000 7f6ebc4aa640 1 -- 172.21.15.82:0/3958661598 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eb4108990 con 0x7f6eb41027e0 2024-03-04T09:13:11.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:11.888+0000 7f6eab7fe640 1 -- 172.21.15.82:0/3958661598 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f6ea4010ab0 con 0x7f6eb41027e0 2024-03-04T09:13:11.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:11.888+0000 7f6eab7fe640 1 --2- 172.21.15.82:0/3958661598 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f6ea00a1d80 0x7f6ea00a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:11.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:11.889+0000 7f6eba246640 1 --2- 172.21.15.82:0/3958661598 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f6ea00a1d80 0x7f6ea00a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:11.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:11.889+0000 7f6eab7fe640 1 -- 172.21.15.82:0/3958661598 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8277+0+0 (secure 0 0 0) 0x7f6ea40ce670 con 0x7f6eb41027e0 2024-03-04T09:13:11.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:11.889+0000 7f6eba246640 1 --2- 172.21.15.82:0/3958661598 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f6ea00a1d80 0x7f6ea00a4240 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6eb002c700 tx=0x7f6eb0009360 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:11.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:11.892+0000 7f6eab7fe640 1 -- 172.21.15.82:0/3958661598 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f6ea409ba70 con 0x7f6eb41027e0 2024-03-04T09:13:12.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:12.068+0000 7f6ebc4aa640 1 -- 172.21.15.82:0/3958661598 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f6eb402cff0 con 0x7f6eb41027e0 2024-03-04T09:13:12.066 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:11 smithi082 ceph-mon[32880]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-04T09:13:12.066 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:11 smithi082 ceph-mon[32880]: osdmap e85: 12 total, 12 up, 12 in 2024-03-04T09:13:12.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:11 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/546352622' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-03-04T09:13:12.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:11 smithi082 ceph-mon[32880]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-03-04T09:13:12.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:11 smithi082 ceph-mon[32880]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-03-04T09:13:12.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:11 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/3472853829' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-03-04T09:13:12.170 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:11 smithi190 ceph-mon[36341]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-04T09:13:12.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:11 smithi190 ceph-mon[36341]: osdmap e85: 12 total, 12 up, 12 in 2024-03-04T09:13:12.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:11 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/546352622' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-03-04T09:13:12.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:11 smithi190 ceph-mon[36341]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-03-04T09:13:12.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:11 smithi190 ceph-mon[36341]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-03-04T09:13:12.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:11 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/3472853829' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-03-04T09:13:12.178 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:11 smithi102 ceph-mon[36220]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-04T09:13:12.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:11 smithi102 ceph-mon[36220]: osdmap e85: 12 total, 12 up, 12 in 2024-03-04T09:13:12.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:11 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/546352622' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-03-04T09:13:12.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:11 smithi102 ceph-mon[36220]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-03-04T09:13:12.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:11 smithi102 ceph-mon[36220]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-03-04T09:13:12.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:11 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/3472853829' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-03-04T09:13:13.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:12 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/3472853829' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-03-04T09:13:13.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:12 smithi082 ceph-mon[32880]: osdmap e86: 12 total, 12 up, 12 in 2024-03-04T09:13:13.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:12 smithi082 ceph-mon[32880]: mds.? [v2:172.21.15.102:6838/35424130,v1:172.21.15.102:6839/35424130] up:active 2024-03-04T09:13:13.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:12 smithi082 ceph-mon[32880]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-04T09:13:13.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:12 smithi082 ceph-mon[32880]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-04T09:13:13.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:12 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/3958661598' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-03-04T09:13:13.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:12 smithi082 ceph-mon[32880]: pgmap v286: 97 pgs: 17 creating+peering, 41 active+clean, 39 unknown; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 6 op/s 2024-03-04T09:13:13.170 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:12 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/3472853829' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-03-04T09:13:13.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:12 smithi190 ceph-mon[36341]: osdmap e86: 12 total, 12 up, 12 in 2024-03-04T09:13:13.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:12 smithi190 ceph-mon[36341]: mds.? [v2:172.21.15.102:6838/35424130,v1:172.21.15.102:6839/35424130] up:active 2024-03-04T09:13:13.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:12 smithi190 ceph-mon[36341]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-04T09:13:13.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:12 smithi190 ceph-mon[36341]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-04T09:13:13.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:12 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/3958661598' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-03-04T09:13:13.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:12 smithi190 ceph-mon[36341]: pgmap v286: 97 pgs: 17 creating+peering, 41 active+clean, 39 unknown; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 6 op/s 2024-03-04T09:13:13.178 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:12 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/3472853829' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-03-04T09:13:13.178 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:12 smithi102 ceph-mon[36220]: osdmap e86: 12 total, 12 up, 12 in 2024-03-04T09:13:13.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:12 smithi102 ceph-mon[36220]: mds.? [v2:172.21.15.102:6838/35424130,v1:172.21.15.102:6839/35424130] up:active 2024-03-04T09:13:13.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:12 smithi102 ceph-mon[36220]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-04T09:13:13.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:12 smithi102 ceph-mon[36220]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-04T09:13:13.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:12 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/3958661598' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-03-04T09:13:13.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:12 smithi102 ceph-mon[36220]: pgmap v286: 97 pgs: 17 creating+peering, 41 active+clean, 39 unknown; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 6 op/s 2024-03-04T09:13:13.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:13.771+0000 7f6eab7fe640 1 -- 172.21.15.82:0/3958661598 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v88) v1 ==== 228+0+0 (secure 0 0 0) 0x7f6ea409b370 con 0x7f6eb41027e0 2024-03-04T09:13:13.768 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data_ec' created 2024-03-04T09:13:13.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:13.774+0000 7f6ebc4aa640 1 -- 172.21.15.82:0/3958661598 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f6ea00a1d80 msgr2=0x7f6ea00a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:13.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:13.774+0000 7f6ebc4aa640 1 --2- 172.21.15.82:0/3958661598 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f6ea00a1d80 0x7f6ea00a4240 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6eb002c700 tx=0x7f6eb0009360 comp rx=0 tx=0).stop 2024-03-04T09:13:13.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:13.774+0000 7f6ebc4aa640 1 -- 172.21.15.82:0/3958661598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6eb41027e0 msgr2=0x7f6eb4197ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:13.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:13.774+0000 7f6ebc4aa640 1 --2- 172.21.15.82:0/3958661598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6eb41027e0 0x7f6eb4197ec0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6ea400e9f0 tx=0x7f6ea400eeb0 comp rx=0 tx=0).stop 2024-03-04T09:13:13.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:13.774+0000 7f6ebc4aa640 1 -- 172.21.15.82:0/3958661598 shutdown_connections 2024-03-04T09:13:13.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:13.774+0000 7f6ebc4aa640 1 --2- 172.21.15.82:0/3958661598 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f6ea00a1d80 0x7f6ea00a4240 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:13.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:13.774+0000 7f6ebc4aa640 1 --2- 172.21.15.82:0/3958661598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6eb41031a0 0x7f6eb419ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:13.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:13.774+0000 7f6ebc4aa640 1 --2- 172.21.15.82:0/3958661598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6eb41027e0 0x7f6eb4197ec0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:13.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:13.774+0000 7f6ebc4aa640 1 --2- 172.21.15.82:0/3958661598 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6eb41015f0 0x7f6eb4197980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:13.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:13.774+0000 7f6ebc4aa640 1 -- 172.21.15.82:0/3958661598 >> 172.21.15.82:0/3958661598 conn(0x7f6eb40fcb80 msgr2=0x7f6eb4105b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:13.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:13.774+0000 7f6ebc4aa640 1 -- 172.21.15.82:0/3958661598 shutdown_connections 2024-03-04T09:13:13.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:13.774+0000 7f6ebc4aa640 1 -- 172.21.15.82:0/3958661598 wait complete. 2024-03-04T09:13:13.789 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-03-04T09:13:13.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:13.903+0000 7f1e63556640 1 -- 172.21.15.82:0/550063307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e5c1016c0 msgr2=0x7f1e5c101b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:13.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:13.903+0000 7f1e63556640 1 --2- 172.21.15.82:0/550063307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e5c1016c0 0x7f1e5c101b40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c009900 tx=0x7f1e4c02bc30 comp rx=0 tx=0).stop 2024-03-04T09:13:13.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:13.903+0000 7f1e63556640 1 -- 172.21.15.82:0/550063307 shutdown_connections 2024-03-04T09:13:13.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:13.904+0000 7f1e63556640 1 --2- 172.21.15.82:0/550063307 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1e5c102080 0x7f1e5c108910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:13.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:13.904+0000 7f1e63556640 1 --2- 172.21.15.82:0/550063307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e5c1016c0 0x7f1e5c101b40 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:13.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:13.904+0000 7f1e63556640 1 --2- 172.21.15.82:0/550063307 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e5c1004d0 0x7f1e5c1008f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:13.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:13.904+0000 7f1e63556640 1 -- 172.21.15.82:0/550063307 >> 172.21.15.82:0/550063307 conn(0x7f1e5c0fba40 msgr2=0x7f1e5c0fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:13.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:13.904+0000 7f1e63556640 1 -- 172.21.15.82:0/550063307 shutdown_connections 2024-03-04T09:13:13.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:13.904+0000 7f1e63556640 1 -- 172.21.15.82:0/550063307 wait complete. 2024-03-04T09:13:13.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:13.904+0000 7f1e63556640 1 Processor -- start 2024-03-04T09:13:13.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:13.904+0000 7f1e63556640 1 -- start start 2024-03-04T09:13:13.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:13.904+0000 7f1e63556640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e5c1004d0 0x7f1e5c1978e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:13.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:13.904+0000 7f1e63556640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e5c1016c0 0x7f1e5c197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:13.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:13.904+0000 7f1e63556640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1e5c102080 0x7f1e5c19ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:13.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:13.904+0000 7f1e63556640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5c10d240 con 0x7f1e5c1004d0 2024-03-04T09:13:13.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:13.904+0000 7f1e63556640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5c10d0c0 con 0x7f1e5c1016c0 2024-03-04T09:13:13.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:13.904+0000 7f1e63556640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5c10d3c0 con 0x7f1e5c102080 2024-03-04T09:13:13.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:13.904+0000 7f1e612f2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e5c1004d0 0x7f1e5c1978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:13.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:13.904+0000 7f1e612f2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e5c1004d0 0x7f1e5c1978e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54396/0 (socket says 172.21.15.82:54396) 2024-03-04T09:13:13.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:13.904+0000 7f1e612f2640 1 -- 172.21.15.82:0/3773874498 learned_addr learned my addr 172.21.15.82:0/3773874498 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:13.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:13.904+0000 7f1e60af1640 1 --2- 172.21.15.82:0/3773874498 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e5c1016c0 0x7f1e5c197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:13.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:13.905+0000 7f1e612f2640 1 -- 172.21.15.82:0/3773874498 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1e5c102080 msgr2=0x7f1e5c19ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:13.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:13.905+0000 7f1e612f2640 1 --2- 172.21.15.82:0/3773874498 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1e5c102080 0x7f1e5c19ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:13.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:13.905+0000 7f1e612f2640 1 -- 172.21.15.82:0/3773874498 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e5c1016c0 msgr2=0x7f1e5c197e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:13.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:13.905+0000 7f1e612f2640 1 --2- 172.21.15.82:0/3773874498 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e5c1016c0 0x7f1e5c197e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:13.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:13.905+0000 7f1e612f2640 1 -- 172.21.15.82:0/3773874498 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e5c19f500 con 0x7f1e5c1004d0 2024-03-04T09:13:13.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:13.905+0000 7f1e612f2640 1 --2- 172.21.15.82:0/3773874498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e5c1004d0 0x7f1e5c1978e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1e5800e9c0 tx=0x7f1e5800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:13.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:13.905+0000 7f1e527fc640 1 -- 172.21.15.82:0/3773874498 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5800cde0 con 0x7f1e5c1004d0 2024-03-04T09:13:13.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:13.905+0000 7f1e63556640 1 -- 172.21.15.82:0/3773874498 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e5c19f7f0 con 0x7f1e5c1004d0 2024-03-04T09:13:13.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:13.905+0000 7f1e527fc640 1 -- 172.21.15.82:0/3773874498 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f1e58010900 con 0x7f1e5c1004d0 2024-03-04T09:13:13.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:13.905+0000 7f1e527fc640 1 -- 172.21.15.82:0/3773874498 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e58018970 con 0x7f1e5c1004d0 2024-03-04T09:13:13.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:13.905+0000 7f1e63556640 1 -- 172.21.15.82:0/3773874498 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e5c19fd10 con 0x7f1e5c1004d0 2024-03-04T09:13:13.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:13.906+0000 7f1e63556640 1 -- 172.21.15.82:0/3773874498 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e5c1077f0 con 0x7f1e5c1004d0 2024-03-04T09:13:13.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:13.907+0000 7f1e527fc640 1 -- 172.21.15.82:0/3773874498 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f1e5801f020 con 0x7f1e5c1004d0 2024-03-04T09:13:13.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:13.908+0000 7f1e527fc640 1 --2- 172.21.15.82:0/3773874498 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f1e480a1d80 0x7f1e480a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:13.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:13.908+0000 7f1e527fc640 1 -- 172.21.15.82:0/3773874498 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8770+0+0 (secure 0 0 0) 0x7f1e580ce6b0 con 0x7f1e5c1004d0 2024-03-04T09:13:13.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:13.908+0000 7f1e60af1640 1 --2- 172.21.15.82:0/3773874498 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f1e480a1d80 0x7f1e480a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:13.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:13.908+0000 7f1e60af1640 1 --2- 172.21.15.82:0/3773874498 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f1e480a1d80 0x7f1e480a4240 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c005ab0 tx=0x7f1e4c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:13.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:13.911+0000 7f1e527fc640 1 -- 172.21.15.82:0/3773874498 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f1e5809b8c0 con 0x7f1e5c1004d0 2024-03-04T09:13:14.066 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:13 smithi082 ceph-mon[32880]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-03-04T09:13:14.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:13 smithi082 ceph-mon[32880]: Cluster is now healthy 2024-03-04T09:13:14.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:13 smithi082 ceph-mon[32880]: osdmap e87: 12 total, 12 up, 12 in 2024-03-04T09:13:14.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:14.085+0000 7f1e63556640 1 -- 172.21.15.82:0/3773874498 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f1e5c0622e0 con 0x7f1e5c1004d0 2024-03-04T09:13:14.170 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:13 smithi190 ceph-mon[36341]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-03-04T09:13:14.170 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:13 smithi190 ceph-mon[36341]: Cluster is now healthy 2024-03-04T09:13:14.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:13 smithi190 ceph-mon[36341]: osdmap e87: 12 total, 12 up, 12 in 2024-03-04T09:13:14.178 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:13 smithi102 ceph-mon[36220]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-03-04T09:13:14.178 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:13 smithi102 ceph-mon[36220]: Cluster is now healthy 2024-03-04T09:13:14.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:13 smithi102 ceph-mon[36220]: osdmap e87: 12 total, 12 up, 12 in 2024-03-04T09:13:14.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:14.777+0000 7f1e527fc640 1 -- 172.21.15.82:0/3773874498 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v89) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1e5809b1c0 con 0x7f1e5c1004d0 2024-03-04T09:13:14.774 INFO:teuthology.orchestra.run.smithi082.stderr:set pool 4 allow_ec_overwrites to true 2024-03-04T09:13:14.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:14.780+0000 7f1e63556640 1 -- 172.21.15.82:0/3773874498 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f1e480a1d80 msgr2=0x7f1e480a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:14.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:14.780+0000 7f1e63556640 1 --2- 172.21.15.82:0/3773874498 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f1e480a1d80 0x7f1e480a4240 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c005ab0 tx=0x7f1e4c005fd0 comp rx=0 tx=0).stop 2024-03-04T09:13:14.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:14.780+0000 7f1e63556640 1 -- 172.21.15.82:0/3773874498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e5c1004d0 msgr2=0x7f1e5c1978e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:14.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:14.780+0000 7f1e63556640 1 --2- 172.21.15.82:0/3773874498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e5c1004d0 0x7f1e5c1978e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1e5800e9c0 tx=0x7f1e5800ee80 comp rx=0 tx=0).stop 2024-03-04T09:13:14.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:14.780+0000 7f1e63556640 1 -- 172.21.15.82:0/3773874498 shutdown_connections 2024-03-04T09:13:14.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:14.780+0000 7f1e63556640 1 --2- 172.21.15.82:0/3773874498 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f1e480a1d80 0x7f1e480a4240 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:14.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:14.780+0000 7f1e63556640 1 --2- 172.21.15.82:0/3773874498 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1e5c102080 0x7f1e5c19ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:14.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:14.780+0000 7f1e63556640 1 --2- 172.21.15.82:0/3773874498 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e5c1016c0 0x7f1e5c197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:14.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:14.780+0000 7f1e63556640 1 --2- 172.21.15.82:0/3773874498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e5c1004d0 0x7f1e5c1978e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:14.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:14.780+0000 7f1e63556640 1 -- 172.21.15.82:0/3773874498 >> 172.21.15.82:0/3773874498 conn(0x7f1e5c0fba40 msgr2=0x7f1e5c1049c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:14.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:14.781+0000 7f1e63556640 1 -- 172.21.15.82:0/3773874498 shutdown_connections 2024-03-04T09:13:14.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:14.781+0000 7f1e63556640 1 -- 172.21.15.82:0/3773874498 wait complete. 2024-03-04T09:13:14.800 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-03-04T09:13:14.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:14.913+0000 7f771e95c640 1 -- 172.21.15.82:0/442486552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7718102080 msgr2=0x7f7718108910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:14.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:14.913+0000 7f771e95c640 1 --2- 172.21.15.82:0/442486552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7718102080 0x7f7718108910 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7710009ca0 tx=0x7f771002c0f0 comp rx=0 tx=0).stop 2024-03-04T09:13:14.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:14.913+0000 7f771e95c640 1 -- 172.21.15.82:0/442486552 shutdown_connections 2024-03-04T09:13:14.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:14.913+0000 7f771e95c640 1 --2- 172.21.15.82:0/442486552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7718102080 0x7f7718108910 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:14.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:14.913+0000 7f771e95c640 1 --2- 172.21.15.82:0/442486552 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77181016c0 0x7f7718101b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:14.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:14.913+0000 7f771e95c640 1 --2- 172.21.15.82:0/442486552 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f77181004d0 0x7f77181008f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:14.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:14.913+0000 7f771e95c640 1 -- 172.21.15.82:0/442486552 >> 172.21.15.82:0/442486552 conn(0x7f77180fba60 msgr2=0x7f77180fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:14.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:14.913+0000 7f771e95c640 1 -- 172.21.15.82:0/442486552 shutdown_connections 2024-03-04T09:13:14.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:14.913+0000 7f771e95c640 1 -- 172.21.15.82:0/442486552 wait complete. 2024-03-04T09:13:14.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:14.913+0000 7f771e95c640 1 Processor -- start 2024-03-04T09:13:14.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:14.913+0000 7f771e95c640 1 -- start start 2024-03-04T09:13:14.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:14.914+0000 7f771e95c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77181004d0 0x7f77180692c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:14.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:14.914+0000 7f771e95c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77181016c0 0x7f771819c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:14.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:14.914+0000 7f771e95c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7718102080 0x7f771819ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:14.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:14.914+0000 7f771e95c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f771810c130 con 0x7f77181004d0 2024-03-04T09:13:14.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:14.914+0000 7f771e95c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f771810bfb0 con 0x7f7718102080 2024-03-04T09:13:14.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:14.914+0000 7f771e95c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f771810c2b0 con 0x7f77181016c0 2024-03-04T09:13:14.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:14.914+0000 7f7717fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77181004d0 0x7f77180692c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:14.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:14.914+0000 7f7717fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77181004d0 0x7f77180692c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54404/0 (socket says 172.21.15.82:54404) 2024-03-04T09:13:14.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:14.914+0000 7f7717fff640 1 -- 172.21.15.82:0/3058260154 learned_addr learned my addr 172.21.15.82:0/3058260154 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:14.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:14.914+0000 7f771cef9640 1 --2- 172.21.15.82:0/3058260154 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7718102080 0x7f771819ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:14.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:14.914+0000 7f77177fe640 1 --2- 172.21.15.82:0/3058260154 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77181016c0 0x7f771819c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:14.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:14.914+0000 7f7717fff640 1 -- 172.21.15.82:0/3058260154 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77181016c0 msgr2=0x7f771819c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:14.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:14.914+0000 7f7717fff640 1 --2- 172.21.15.82:0/3058260154 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77181016c0 0x7f771819c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:14.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:14.914+0000 7f7717fff640 1 -- 172.21.15.82:0/3058260154 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7718102080 msgr2=0x7f771819ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:14.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:14.914+0000 7f7717fff640 1 --2- 172.21.15.82:0/3058260154 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7718102080 0x7f771819ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:14.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:14.914+0000 7f7717fff640 1 -- 172.21.15.82:0/3058260154 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f771819f500 con 0x7f77181004d0 2024-03-04T09:13:14.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:14.914+0000 7f7717fff640 1 --2- 172.21.15.82:0/3058260154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77181004d0 0x7f77180692c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f770800e9c0 tx=0x7f770800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:14.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:14.914+0000 7f77157fa640 1 -- 172.21.15.82:0/3058260154 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770800cd80 con 0x7f77181004d0 2024-03-04T09:13:14.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:14.914+0000 7f77157fa640 1 -- 172.21.15.82:0/3058260154 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f77080035f0 con 0x7f77181004d0 2024-03-04T09:13:14.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:14.914+0000 7f77157fa640 1 -- 172.21.15.82:0/3058260154 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7708010690 con 0x7f77181004d0 2024-03-04T09:13:14.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:14.914+0000 7f771e95c640 1 -- 172.21.15.82:0/3058260154 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f771819f7f0 con 0x7f77181004d0 2024-03-04T09:13:14.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:14.914+0000 7f771e95c640 1 -- 172.21.15.82:0/3058260154 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f771819fcf0 con 0x7f77181004d0 2024-03-04T09:13:14.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:14.915+0000 7f771e95c640 1 -- 172.21.15.82:0/3058260154 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77181077f0 con 0x7f77181004d0 2024-03-04T09:13:14.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:14.916+0000 7f77157fa640 1 -- 172.21.15.82:0/3058260154 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f77080037a0 con 0x7f77181004d0 2024-03-04T09:13:14.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:14.917+0000 7f77157fa640 1 --2- 172.21.15.82:0/3058260154 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f77000a1d80 0x7f77000a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:14.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:14.917+0000 7f77177fe640 1 --2- 172.21.15.82:0/3058260154 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f77000a1d80 0x7f77000a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:14.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:14.917+0000 7f77157fa640 1 -- 172.21.15.82:0/3058260154 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8770+0+0 (secure 0 0 0) 0x7f77080ce440 con 0x7f77181004d0 2024-03-04T09:13:14.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:14.917+0000 7f77177fe640 1 --2- 172.21.15.82:0/3058260154 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f77000a1d80 0x7f77000a4240 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f770c005fd0 tx=0x7f770c005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:14.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:14.921+0000 7f77157fa640 1 -- 172.21.15.82:0/3058260154 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f770809b650 con 0x7f77181004d0 2024-03-04T09:13:15.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:14 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/3958661598' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-03-04T09:13:15.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:14 smithi082 ceph-mon[32880]: osdmap e88: 12 total, 12 up, 12 in 2024-03-04T09:13:15.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:14 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/3773874498' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-03-04T09:13:15.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:14 smithi082 ceph-mon[32880]: pgmap v289: 129 pgs: 17 creating+peering, 67 active+clean, 45 unknown; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 8 op/s 2024-03-04T09:13:15.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:15.135+0000 7f771e95c640 1 -- 172.21.15.82:0/3058260154 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f7718062200 con 0x7f77181004d0 2024-03-04T09:13:15.170 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:14 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/3958661598' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-03-04T09:13:15.170 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:14 smithi190 ceph-mon[36341]: osdmap e88: 12 total, 12 up, 12 in 2024-03-04T09:13:15.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:14 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/3773874498' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-03-04T09:13:15.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:14 smithi190 ceph-mon[36341]: pgmap v289: 129 pgs: 17 creating+peering, 67 active+clean, 45 unknown; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 8 op/s 2024-03-04T09:13:15.178 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:14 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/3958661598' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-03-04T09:13:15.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:14 smithi102 ceph-mon[36220]: osdmap e88: 12 total, 12 up, 12 in 2024-03-04T09:13:15.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:14 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/3773874498' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-03-04T09:13:15.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:14 smithi102 ceph-mon[36220]: pgmap v289: 129 pgs: 17 creating+peering, 67 active+clean, 45 unknown; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 8 op/s 2024-03-04T09:13:15.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:15.779+0000 7f77157fa640 1 -- 172.21.15.82:0/3058260154 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) v1 ==== 137+0+0 (secure 0 0 0) 0x7f770809af50 con 0x7f77181004d0 2024-03-04T09:13:15.775 INFO:teuthology.orchestra.run.smithi082.stderr:added data pool 4 to fsmap 2024-03-04T09:13:15.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:15.781+0000 7f771e95c640 1 -- 172.21.15.82:0/3058260154 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f77000a1d80 msgr2=0x7f77000a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:15.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:15.781+0000 7f771e95c640 1 --2- 172.21.15.82:0/3058260154 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f77000a1d80 0x7f77000a4240 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f770c005fd0 tx=0x7f770c005850 comp rx=0 tx=0).stop 2024-03-04T09:13:15.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:15.781+0000 7f771e95c640 1 -- 172.21.15.82:0/3058260154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77181004d0 msgr2=0x7f77180692c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:15.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:15.781+0000 7f771e95c640 1 --2- 172.21.15.82:0/3058260154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77181004d0 0x7f77180692c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f770800e9c0 tx=0x7f770800ee80 comp rx=0 tx=0).stop 2024-03-04T09:13:15.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:15.781+0000 7f771e95c640 1 -- 172.21.15.82:0/3058260154 shutdown_connections 2024-03-04T09:13:15.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:15.781+0000 7f771e95c640 1 --2- 172.21.15.82:0/3058260154 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f77000a1d80 0x7f77000a4240 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:15.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:15.781+0000 7f771e95c640 1 --2- 172.21.15.82:0/3058260154 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7718102080 0x7f771819ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:15.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:15.781+0000 7f771e95c640 1 --2- 172.21.15.82:0/3058260154 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77181016c0 0x7f771819c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:15.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:15.781+0000 7f771e95c640 1 --2- 172.21.15.82:0/3058260154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77181004d0 0x7f77180692c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:15.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:15.781+0000 7f771e95c640 1 -- 172.21.15.82:0/3058260154 >> 172.21.15.82:0/3058260154 conn(0x7f77180fba60 msgr2=0x7f77181049c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:15.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:15.781+0000 7f771e95c640 1 -- 172.21.15.82:0/3058260154 shutdown_connections 2024-03-04T09:13:15.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:15.781+0000 7f771e95c640 1 -- 172.21.15.82:0/3058260154 wait complete. 2024-03-04T09:13:15.791 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T09:13:15.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:15.899+0000 7fb889f20640 1 -- 172.21.15.82:0/117552228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8841031a0 msgr2=0x7fb884109a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:15.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:15.899+0000 7fb889f20640 1 --2- 172.21.15.82:0/117552228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8841031a0 0x7fb884109a30 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb87c009ca0 tx=0x7fb87c02c0f0 comp rx=0 tx=0).stop 2024-03-04T09:13:15.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:15.899+0000 7fb889f20640 1 -- 172.21.15.82:0/117552228 shutdown_connections 2024-03-04T09:13:15.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:15.899+0000 7fb889f20640 1 --2- 172.21.15.82:0/117552228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8841031a0 0x7fb884109a30 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:15.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:15.899+0000 7fb889f20640 1 --2- 172.21.15.82:0/117552228 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8841027e0 0x7fb884102c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:15.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:15.899+0000 7fb889f20640 1 --2- 172.21.15.82:0/117552228 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8841015f0 0x7fb884101a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:15.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:15.899+0000 7fb889f20640 1 -- 172.21.15.82:0/117552228 >> 172.21.15.82:0/117552228 conn(0x7fb8840fcb80 msgr2=0x7fb8840fefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:15.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:15.899+0000 7fb889f20640 1 -- 172.21.15.82:0/117552228 shutdown_connections 2024-03-04T09:13:15.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:15.899+0000 7fb889f20640 1 -- 172.21.15.82:0/117552228 wait complete. 2024-03-04T09:13:15.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:15.900+0000 7fb889f20640 1 Processor -- start 2024-03-04T09:13:15.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:15.900+0000 7fb889f20640 1 -- start start 2024-03-04T09:13:15.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:15.900+0000 7fb889f20640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8841015f0 0x7fb8841978b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:15.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:15.900+0000 7fb889f20640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8841027e0 0x7fb884197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:15.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:15.900+0000 7fb889f20640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8841031a0 0x7fb88419ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:15.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:15.900+0000 7fb889f20640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb88410d240 con 0x7fb8841027e0 2024-03-04T09:13:15.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:15.900+0000 7fb889f20640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb88410d0c0 con 0x7fb8841031a0 2024-03-04T09:13:15.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:15.900+0000 7fb889f20640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb88410d3c0 con 0x7fb8841015f0 2024-03-04T09:13:15.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:15.900+0000 7fb87affd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8841027e0 0x7fb884197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:15.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:15.900+0000 7fb87affd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8841027e0 0x7fb884197df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54414/0 (socket says 172.21.15.82:54414) 2024-03-04T09:13:15.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:15.900+0000 7fb87affd640 1 -- 172.21.15.82:0/3390988512 learned_addr learned my addr 172.21.15.82:0/3390988512 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:15.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:15.900+0000 7fb883fff640 1 --2- 172.21.15.82:0/3390988512 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8841031a0 0x7fb88419ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:15.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:15.901+0000 7fb8837fe640 1 --2- 172.21.15.82:0/3390988512 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8841015f0 0x7fb8841978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:15.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:15.901+0000 7fb87affd640 1 -- 172.21.15.82:0/3390988512 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8841015f0 msgr2=0x7fb8841978b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:15.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:15.901+0000 7fb87affd640 1 --2- 172.21.15.82:0/3390988512 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8841015f0 0x7fb8841978b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:15.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:15.901+0000 7fb87affd640 1 -- 172.21.15.82:0/3390988512 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8841031a0 msgr2=0x7fb88419ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:15.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:15.901+0000 7fb87affd640 1 --2- 172.21.15.82:0/3390988512 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8841031a0 0x7fb88419ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:15.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:15.901+0000 7fb87affd640 1 -- 172.21.15.82:0/3390988512 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb88419f4d0 con 0x7fb8841027e0 2024-03-04T09:13:15.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:15.901+0000 7fb87affd640 1 --2- 172.21.15.82:0/3390988512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8841027e0 0x7fb884197df0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb86c00c890 tx=0x7fb86c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:15.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:15.901+0000 7fb8817fa640 1 -- 172.21.15.82:0/3390988512 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86c004220 con 0x7fb8841027e0 2024-03-04T09:13:15.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:15.901+0000 7fb889f20640 1 -- 172.21.15.82:0/3390988512 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb88419f7c0 con 0x7fb8841027e0 2024-03-04T09:13:15.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:15.901+0000 7fb8817fa640 1 -- 172.21.15.82:0/3390988512 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fb86c0043c0 con 0x7fb8841027e0 2024-03-04T09:13:15.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:15.901+0000 7fb8817fa640 1 -- 172.21.15.82:0/3390988512 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86c004a00 con 0x7fb8841027e0 2024-03-04T09:13:15.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:15.901+0000 7fb889f20640 1 -- 172.21.15.82:0/3390988512 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb88419fd10 con 0x7fb8841027e0 2024-03-04T09:13:15.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:15.902+0000 7fb889f20640 1 -- 172.21.15.82:0/3390988512 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb884108910 con 0x7fb8841027e0 2024-03-04T09:13:15.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:15.903+0000 7fb8817fa640 1 -- 172.21.15.82:0/3390988512 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7fb86c004ba0 con 0x7fb8841027e0 2024-03-04T09:13:15.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:15.903+0000 7fb8817fa640 1 --2- 172.21.15.82:0/3390988512 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb8700a1d80 0x7fb8700a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:15.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:15.904+0000 7fb8837fe640 1 --2- 172.21.15.82:0/3390988512 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb8700a1d80 0x7fb8700a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:15.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:15.904+0000 7fb8817fa640 1 -- 172.21.15.82:0/3390988512 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8802+0+0 (secure 0 0 0) 0x7fb86c0cdd40 con 0x7fb8841027e0 2024-03-04T09:13:15.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:15.904+0000 7fb8837fe640 1 --2- 172.21.15.82:0/3390988512 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb8700a1d80 0x7fb8700a4240 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb884102640 tx=0x7fb874005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:15.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:15.908+0000 7fb8817fa640 1 -- 172.21.15.82:0/3390988512 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fb86c014030 con 0x7fb8841027e0 2024-03-04T09:13:16.066 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:15 smithi082 ceph-mon[32880]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-04T09:13:16.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:15 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/3773874498' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-03-04T09:13:16.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:15 smithi082 ceph-mon[32880]: osdmap e89: 12 total, 12 up, 12 in 2024-03-04T09:13:16.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:15 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/3058260154' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-03-04T09:13:16.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.123+0000 7fb889f20640 1 -- 172.21.15.82:0/3390988512 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb88402cff0 con 0x7fb8841027e0 2024-03-04T09:13:16.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.124+0000 7fb8817fa640 1 -- 172.21.15.82:0/3390988512 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+11327 (secure 0 0 0) 0x7fb86c09af30 con 0x7fb8841027e0 2024-03-04T09:13:16.120 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:13:16.121 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3123844705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3123844705},{"type":"v1","addr":"172.21.15.82:6835","nonce":3123844705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2620634252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2620634252},{"type":"v1","addr":"172.21.15.82:6837","nonce":2620634252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6839/1240838024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1240838024},{"type":"v1","addr":"172.21.15.82:6839","nonce":1240838024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/213594267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":213594267},{"type":"v1","addr":"172.21.15.82:6841","nonce":213594267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/1142302200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":1142302200},{"type":"v1","addr":"172.21.15.102:6833","nonce":1142302200}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/3023382814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":3023382814},{"type":"v1","addr":"172.21.15.190:6833","nonce":3023382814}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/2134310473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":2134310473},{"type":"v1","addr":"172.21.15.102:6835","nonce":2134310473}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/3183532624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3183532624},{"type":"v1","addr":"172.21.15.190:6835","nonce":3183532624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/1210579527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1210579527},{"type":"v1","addr":"172.21.15.102:6837","nonce":1210579527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/1198639527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":1198639527},{"type":"v1","addr":"172.21.15.190:6837","nonce":1198639527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24469,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6839/878555510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":878555510},{"type":"v1","addr":"172.21.15.190:6839","nonce":878555510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-04T09:13:10.076732+0000","modified":"2024-03-04T09:13:15.136993+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6839/35424130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":35424130},{"type":"v1","addr":"172.21.15.102:6839","nonce":35424130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24476,"qdb_cluster":[24476]},"id":1}]} 2024-03-04T09:13:16.121 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 17 2024-03-04T09:13:16.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.126+0000 7fb889f20640 1 -- 172.21.15.82:0/3390988512 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb8700a1d80 msgr2=0x7fb8700a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:16.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.126+0000 7fb889f20640 1 --2- 172.21.15.82:0/3390988512 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb8700a1d80 0x7fb8700a4240 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb884102640 tx=0x7fb874005f90 comp rx=0 tx=0).stop 2024-03-04T09:13:16.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.126+0000 7fb889f20640 1 -- 172.21.15.82:0/3390988512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8841027e0 msgr2=0x7fb884197df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:16.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.126+0000 7fb889f20640 1 --2- 172.21.15.82:0/3390988512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8841027e0 0x7fb884197df0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb86c00c890 tx=0x7fb86c00cd50 comp rx=0 tx=0).stop 2024-03-04T09:13:16.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.126+0000 7fb889f20640 1 -- 172.21.15.82:0/3390988512 shutdown_connections 2024-03-04T09:13:16.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.126+0000 7fb889f20640 1 --2- 172.21.15.82:0/3390988512 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb8700a1d80 0x7fb8700a4240 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:16.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.126+0000 7fb889f20640 1 --2- 172.21.15.82:0/3390988512 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8841031a0 0x7fb88419ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:16.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.126+0000 7fb889f20640 1 --2- 172.21.15.82:0/3390988512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8841027e0 0x7fb884197df0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:16.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.126+0000 7fb889f20640 1 --2- 172.21.15.82:0/3390988512 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8841015f0 0x7fb8841978b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:16.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.126+0000 7fb889f20640 1 -- 172.21.15.82:0/3390988512 >> 172.21.15.82:0/3390988512 conn(0x7fb8840fcb80 msgr2=0x7fb884105ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:16.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.126+0000 7fb889f20640 1 -- 172.21.15.82:0/3390988512 shutdown_connections 2024-03-04T09:13:16.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.126+0000 7fb889f20640 1 -- 172.21.15.82:0/3390988512 wait complete. 2024-03-04T09:13:16.133 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T09:13:16.170 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:15 smithi190 ceph-mon[36341]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-04T09:13:16.170 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:15 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/3773874498' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-03-04T09:13:16.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:15 smithi190 ceph-mon[36341]: osdmap e89: 12 total, 12 up, 12 in 2024-03-04T09:13:16.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:15 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/3058260154' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-03-04T09:13:16.178 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:15 smithi102 ceph-mon[36220]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-04T09:13:16.178 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:15 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/3773874498' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-03-04T09:13:16.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:15 smithi102 ceph-mon[36220]: osdmap e89: 12 total, 12 up, 12 in 2024-03-04T09:13:16.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:15 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/3058260154' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-03-04T09:13:16.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.238+0000 7f696b902640 1 -- 172.21.15.82:0/513176359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69641016e0 msgr2=0x7f6964101b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:16.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.238+0000 7f696b902640 1 --2- 172.21.15.82:0/513176359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69641016e0 0x7f6964101b60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6958009900 tx=0x7f695802bc30 comp rx=0 tx=0).stop 2024-03-04T09:13:16.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.238+0000 7f696b902640 1 -- 172.21.15.82:0/513176359 shutdown_connections 2024-03-04T09:13:16.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.238+0000 7f696b902640 1 --2- 172.21.15.82:0/513176359 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69641020a0 0x7f6964108930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:16.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.238+0000 7f696b902640 1 --2- 172.21.15.82:0/513176359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69641016e0 0x7f6964101b60 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:16.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.238+0000 7f696b902640 1 --2- 172.21.15.82:0/513176359 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69641004f0 0x7f6964100910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:16.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.238+0000 7f696b902640 1 -- 172.21.15.82:0/513176359 >> 172.21.15.82:0/513176359 conn(0x7f69640fba60 msgr2=0x7f69640fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:16.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.238+0000 7f696b902640 1 -- 172.21.15.82:0/513176359 shutdown_connections 2024-03-04T09:13:16.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.238+0000 7f696b902640 1 -- 172.21.15.82:0/513176359 wait complete. 2024-03-04T09:13:16.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.238+0000 7f696b902640 1 Processor -- start 2024-03-04T09:13:16.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.238+0000 7f696b902640 1 -- start start 2024-03-04T09:13:16.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.239+0000 7f696b902640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69641004f0 0x7f6964197900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:16.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.239+0000 7f696b902640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69641016e0 0x7f6964197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:16.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.239+0000 7f696b902640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69641020a0 0x7f696419eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:16.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.239+0000 7f696b902640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696410c150 con 0x7f69641004f0 2024-03-04T09:13:16.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.239+0000 7f696b902640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696410bfd0 con 0x7f69641016e0 2024-03-04T09:13:16.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.239+0000 7f696b902640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696410c2d0 con 0x7f69641020a0 2024-03-04T09:13:16.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.239+0000 7f696969e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69641004f0 0x7f6964197900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:16.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.239+0000 7f696969e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69641004f0 0x7f6964197900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54442/0 (socket says 172.21.15.82:54442) 2024-03-04T09:13:16.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.239+0000 7f696969e640 1 -- 172.21.15.82:0/1087903468 learned_addr learned my addr 172.21.15.82:0/1087903468 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:16.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.239+0000 7f6968e9d640 1 --2- 172.21.15.82:0/1087903468 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69641016e0 0x7f6964197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:16.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.239+0000 7f6969e9f640 1 --2- 172.21.15.82:0/1087903468 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69641020a0 0x7f696419eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:16.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.239+0000 7f696969e640 1 -- 172.21.15.82:0/1087903468 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69641020a0 msgr2=0x7f696419eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:16.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.239+0000 7f696969e640 1 --2- 172.21.15.82:0/1087903468 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69641020a0 0x7f696419eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:16.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.239+0000 7f696969e640 1 -- 172.21.15.82:0/1087903468 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69641016e0 msgr2=0x7f6964197e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:16.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.239+0000 7f696969e640 1 --2- 172.21.15.82:0/1087903468 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69641016e0 0x7f6964197e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:16.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.239+0000 7f696969e640 1 -- 172.21.15.82:0/1087903468 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f696419f520 con 0x7f69641004f0 2024-03-04T09:13:16.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.239+0000 7f696969e640 1 --2- 172.21.15.82:0/1087903468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69641004f0 0x7f6964197900 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f696000e9c0 tx=0x7f696000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:16.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.239+0000 7f69567fc640 1 -- 172.21.15.82:0/1087903468 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696000cd80 con 0x7f69641004f0 2024-03-04T09:13:16.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.239+0000 7f69567fc640 1 -- 172.21.15.82:0/1087903468 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f69600035f0 con 0x7f69641004f0 2024-03-04T09:13:16.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.239+0000 7f696b902640 1 -- 172.21.15.82:0/1087903468 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f696419f810 con 0x7f69641004f0 2024-03-04T09:13:16.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.239+0000 7f69567fc640 1 -- 172.21.15.82:0/1087903468 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6960010690 con 0x7f69641004f0 2024-03-04T09:13:16.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.239+0000 7f696b902640 1 -- 172.21.15.82:0/1087903468 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f696419fd80 con 0x7f69641004f0 2024-03-04T09:13:16.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.240+0000 7f696b902640 1 -- 172.21.15.82:0/1087903468 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f696419ffe0 con 0x7f69641004f0 2024-03-04T09:13:16.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.241+0000 7f69567fc640 1 -- 172.21.15.82:0/1087903468 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f69600037a0 con 0x7f69641004f0 2024-03-04T09:13:16.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.242+0000 7f69567fc640 1 --2- 172.21.15.82:0/1087903468 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f69500a1e00 0x7f69500a42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:16.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.242+0000 7f6968e9d640 1 --2- 172.21.15.82:0/1087903468 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f69500a1e00 0x7f69500a42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:16.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.242+0000 7f69567fc640 1 -- 172.21.15.82:0/1087903468 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8802+0+0 (secure 0 0 0) 0x7f69600ce3c0 con 0x7f69641004f0 2024-03-04T09:13:16.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.243+0000 7f6968e9d640 1 --2- 172.21.15.82:0/1087903468 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f69500a1e00 0x7f69500a42c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6958005ab0 tx=0x7f6958005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:16.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.247+0000 7f69567fc640 1 -- 172.21.15.82:0/1087903468 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f696009b5b0 con 0x7f69641004f0 2024-03-04T09:13:16.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.420+0000 7f696b902640 1 -- 172.21.15.82:0/1087903468 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f69641a01b0 con 0x7f69641004f0 2024-03-04T09:13:16.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.421+0000 7f69567fc640 1 -- 172.21.15.82:0/1087903468 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+24092 (secure 0 0 0) 0x7f696009aeb0 con 0x7f69641004f0 2024-03-04T09:13:16.418 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:13:16.418 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":90,"fsid":"2e533fc8-da06-11ee-95c6-87774f69a715","created":"2024-03-04T09:05:16.488249+0000","modified":"2024-03-04T09:13:15.136817+0000","last_up_change":"2024-03-04T09:12:22.308711+0000","last_in_change":"2024-03-04T09:12:02.548212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T09:08:36.508257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T09:13:07.981726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T09:13:09.289799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-04T09:13:13.008516+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"085b5c4b-ede9-4d0d-b994-50c89d991012","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6803","nonce":709655235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6805","nonce":709655235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6809","nonce":709655235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6807","nonce":709655235}]},"public_addr":"172.21.15.82:6803/709655235","cluster_addr":"172.21.15.82:6805/709655235","heartbeat_back_addr":"172.21.15.82:6809/709655235","heartbeat_front_addr":"172.21.15.82:6807/709655235","state":["exists","up"]},{"osd":1,"uuid":"e4dd7079-333e-4bcf-b3af-11fb082a5af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6801","nonce":270721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6803","nonce":270721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6807","nonce":270721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6805","nonce":270721212}]},"public_addr":"172.21.15.102:6801/270721212","cluster_addr":"172.21.15.102:6803/270721212","heartbeat_back_addr":"172.21.15.102:6807/270721212","heartbeat_front_addr":"172.21.15.102:6805/270721212","state":["exists","up"]},{"osd":2,"uuid":"6fed5fd6-dc82-497f-9d69-c10a5e5802da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6801","nonce":946410459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6803","nonce":946410459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6807","nonce":946410459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6805","nonce":946410459}]},"public_addr":"172.21.15.190:6801/946410459","cluster_addr":"172.21.15.190:6803/946410459","heartbeat_back_addr":"172.21.15.190:6807/946410459","heartbeat_front_addr":"172.21.15.190:6805/946410459","state":["exists","up"]},{"osd":3,"uuid":"91ccbdc3-3da6-4d39-8a89-3a7b7bb4adc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6811","nonce":980870924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6813","nonce":980870924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6817","nonce":980870924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6815","nonce":980870924}]},"public_addr":"172.21.15.82:6811/980870924","cluster_addr":"172.21.15.82:6813/980870924","heartbeat_back_addr":"172.21.15.82:6817/980870924","heartbeat_front_addr":"172.21.15.82:6815/980870924","state":["exists","up"]},{"osd":4,"uuid":"dbb9d486-5daa-4819-bbed-04fc76ca473e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6809","nonce":1229627753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6811","nonce":1229627753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6815","nonce":1229627753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6813","nonce":1229627753}]},"public_addr":"172.21.15.102:6809/1229627753","cluster_addr":"172.21.15.102:6811/1229627753","heartbeat_back_addr":"172.21.15.102:6815/1229627753","heartbeat_front_addr":"172.21.15.102:6813/1229627753","state":["exists","up"]},{"osd":5,"uuid":"6b50127b-df2b-4c95-8e53-9d42b40273fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6809","nonce":2171194148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6811","nonce":2171194148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6815","nonce":2171194148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6813","nonce":2171194148}]},"public_addr":"172.21.15.190:6809/2171194148","cluster_addr":"172.21.15.190:6811/2171194148","heartbeat_back_addr":"172.21.15.190:6815/2171194148","heartbeat_front_addr":"172.21.15.190:6813/2171194148","state":["exists","up"]},{"osd":6,"uuid":"e72bebb0-5939-4210-950a-41c25c23c62f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6819","nonce":454436959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6821","nonce":454436959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6825","nonce":454436959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6823","nonce":454436959}]},"public_addr":"172.21.15.82:6819/454436959","cluster_addr":"172.21.15.82:6821/454436959","heartbeat_back_addr":"172.21.15.82:6825/454436959","heartbeat_front_addr":"172.21.15.82:6823/454436959","state":["exists","up"]},{"osd":7,"uuid":"72f83f97-f496-4503-8284-6a7b8f99a6f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6817","nonce":2745057274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6819","nonce":2745057274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6823","nonce":2745057274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6821","nonce":2745057274}]},"public_addr":"172.21.15.102:6817/2745057274","cluster_addr":"172.21.15.102:6819/2745057274","heartbeat_back_addr":"172.21.15.102:6823/2745057274","heartbeat_front_addr":"172.21.15.102:6821/2745057274","state":["exists","up"]},{"osd":8,"uuid":"92c9109d-6ebb-4c50-9944-28cd7b2f9c0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6817","nonce":1679683516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6819","nonce":1679683516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6823","nonce":1679683516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6821","nonce":1679683516}]},"public_addr":"172.21.15.190:6817/1679683516","cluster_addr":"172.21.15.190:6819/1679683516","heartbeat_back_addr":"172.21.15.190:6823/1679683516","heartbeat_front_addr":"172.21.15.190:6821/1679683516","state":["exists","up"]},{"osd":9,"uuid":"a3cfce03-0148-475d-bf55-b8284ae1cad2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6827","nonce":1777272933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6829","nonce":1777272933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6833","nonce":1777272933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6831","nonce":1777272933}]},"public_addr":"172.21.15.82:6827/1777272933","cluster_addr":"172.21.15.82:6829/1777272933","heartbeat_back_addr":"172.21.15.82:6833/1777272933","heartbeat_front_addr":"172.21.15.82:6831/1777272933","state":["exists","up"]},{"osd":10,"uuid":"db156ccf-4396-43cb-b69a-bb9095b94b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6825","nonce":1012784035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6827","nonce":1012784035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6831","nonce":1012784035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6829","nonce":1012784035}]},"public_addr":"172.21.15.102:6825/1012784035","cluster_addr":"172.21.15.102:6827/1012784035","heartbeat_back_addr":"172.21.15.102:6831/1012784035","heartbeat_front_addr":"172.21.15.102:6829/1012784035","state":["exists","up"]},{"osd":11,"uuid":"b4d52576-f5b4-479f-8ff6-8fdba4635ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6825","nonce":144700355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6827","nonce":144700355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6831","nonce":144700355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6829","nonce":144700355}]},"public_addr":"172.21.15.190:6825/144700355","cluster_addr":"172.21.15.190:6827/144700355","heartbeat_back_addr":"172.21.15.190:6831/144700355","heartbeat_front_addr":"172.21.15.190:6829/144700355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:07:47.007772+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:09.944738+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:33.183567+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:58.302023+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:09:23.042488+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:09:47.616009+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:10:13.122887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:10:38.584530+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:03.473453+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:29.847105+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:55.152195+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:12:20.401765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6800/1901539016":"2024-03-05T09:06:12.169231+0000","172.21.15.82:0/1124105204":"2024-03-05T09:06:12.169231+0000","172.21.15.82:6801/1901539016":"2024-03-05T09:06:12.169231+0000","172.21.15.82:0/735262841":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/2402774828":"2024-03-05T09:05:44.913099+0000","172.21.15.82:6801/3291527077":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/1846720385":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/3757201752":"2024-03-05T09:06:12.169231+0000","172.21.15.82:6800/3291527077":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/984630078":"2024-03-05T09:06:12.169231+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T09:13:16.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.423+0000 7f696b902640 1 -- 172.21.15.82:0/1087903468 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f69500a1e00 msgr2=0x7f69500a42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:16.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.423+0000 7f696b902640 1 --2- 172.21.15.82:0/1087903468 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f69500a1e00 0x7f69500a42c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6958005ab0 tx=0x7f6958005fd0 comp rx=0 tx=0).stop 2024-03-04T09:13:16.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.423+0000 7f696b902640 1 -- 172.21.15.82:0/1087903468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69641004f0 msgr2=0x7f6964197900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:16.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.423+0000 7f696b902640 1 --2- 172.21.15.82:0/1087903468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69641004f0 0x7f6964197900 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f696000e9c0 tx=0x7f696000ee80 comp rx=0 tx=0).stop 2024-03-04T09:13:16.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.423+0000 7f696b902640 1 -- 172.21.15.82:0/1087903468 shutdown_connections 2024-03-04T09:13:16.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.423+0000 7f696b902640 1 --2- 172.21.15.82:0/1087903468 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f69500a1e00 0x7f69500a42c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:16.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.423+0000 7f696b902640 1 --2- 172.21.15.82:0/1087903468 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69641020a0 0x7f696419eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:16.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.423+0000 7f696b902640 1 --2- 172.21.15.82:0/1087903468 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69641016e0 0x7f6964197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:16.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.423+0000 7f696b902640 1 --2- 172.21.15.82:0/1087903468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69641004f0 0x7f6964197900 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:16.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.423+0000 7f696b902640 1 -- 172.21.15.82:0/1087903468 >> 172.21.15.82:0/1087903468 conn(0x7f69640fba60 msgr2=0x7f6964068730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:16.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.423+0000 7f696b902640 1 -- 172.21.15.82:0/1087903468 shutdown_connections 2024-03-04T09:13:16.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.423+0000 7f696b902640 1 -- 172.21.15.82:0/1087903468 wait complete. 2024-03-04T09:13:16.431 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T09:13:16.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.536+0000 7fd3e4afb640 1 -- 172.21.15.82:0/2812996362 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3e0107380 msgr2=0x7fd3e0109770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:16.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.536+0000 7fd3e4afb640 1 --2- 172.21.15.82:0/2812996362 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3e0107380 0x7fd3e0109770 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd3d8009ca0 tx=0x7fd3d802c0f0 comp rx=0 tx=0).stop 2024-03-04T09:13:16.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.536+0000 7fd3e4afb640 1 -- 172.21.15.82:0/2812996362 shutdown_connections 2024-03-04T09:13:16.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.536+0000 7fd3e4afb640 1 --2- 172.21.15.82:0/2812996362 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3e0107380 0x7fd3e0109770 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:16.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.536+0000 7fd3e4afb640 1 --2- 172.21.15.82:0/2812996362 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3e0104a50 0x7fd3e0106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:16.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.536+0000 7fd3e4afb640 1 --2- 172.21.15.82:0/2812996362 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3e0102120 0x7fd3e0104510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:16.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.536+0000 7fd3e4afb640 1 -- 172.21.15.82:0/2812996362 >> 172.21.15.82:0/2812996362 conn(0x7fd3e00fbab0 msgr2=0x7fd3e00fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:16.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.536+0000 7fd3e4afb640 1 -- 172.21.15.82:0/2812996362 shutdown_connections 2024-03-04T09:13:16.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.536+0000 7fd3e4afb640 1 -- 172.21.15.82:0/2812996362 wait complete. 2024-03-04T09:13:16.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.537+0000 7fd3e4afb640 1 Processor -- start 2024-03-04T09:13:16.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.537+0000 7fd3e4afb640 1 -- start start 2024-03-04T09:13:16.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.537+0000 7fd3e4afb640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3e0102120 0x7fd3e01978d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:16.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.537+0000 7fd3e4afb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3e0104a50 0x7fd3e0197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:16.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.537+0000 7fd3e4afb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3e0107380 0x7fd3e019ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:16.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.537+0000 7fd3e4afb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e010d280 con 0x7fd3e0104a50 2024-03-04T09:13:16.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.537+0000 7fd3e4afb640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e010d100 con 0x7fd3e0107380 2024-03-04T09:13:16.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.537+0000 7fd3e4afb640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e010d400 con 0x7fd3e0102120 2024-03-04T09:13:16.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.537+0000 7fd3d5d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3e0104a50 0x7fd3e0197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:16.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.537+0000 7fd3d5d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3e0104a50 0x7fd3e0197e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51026/0 (socket says 172.21.15.82:51026) 2024-03-04T09:13:16.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.537+0000 7fd3d5d9b640 1 -- 172.21.15.82:0/2905075451 learned_addr learned my addr 172.21.15.82:0/2905075451 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:16.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.537+0000 7fd3ded9d640 1 --2- 172.21.15.82:0/2905075451 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3e0107380 0x7fd3e019ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:16.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.537+0000 7fd3de59c640 1 --2- 172.21.15.82:0/2905075451 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3e0102120 0x7fd3e01978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:16.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.537+0000 7fd3d5d9b640 1 -- 172.21.15.82:0/2905075451 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3e0102120 msgr2=0x7fd3e01978d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:16.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.537+0000 7fd3d5d9b640 1 --2- 172.21.15.82:0/2905075451 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3e0102120 0x7fd3e01978d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:16.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.537+0000 7fd3d5d9b640 1 -- 172.21.15.82:0/2905075451 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3e0107380 msgr2=0x7fd3e019ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:16.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.537+0000 7fd3d5d9b640 1 --2- 172.21.15.82:0/2905075451 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3e0107380 0x7fd3e019ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:16.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.537+0000 7fd3d5d9b640 1 -- 172.21.15.82:0/2905075451 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e019f4f0 con 0x7fd3e0104a50 2024-03-04T09:13:16.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.538+0000 7fd3d5d9b640 1 --2- 172.21.15.82:0/2905075451 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3e0104a50 0x7fd3e0197e10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd3c800e9c0 tx=0x7fd3c800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:16.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.538+0000 7fd3d7fff640 1 -- 172.21.15.82:0/2905075451 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c800cd80 con 0x7fd3e0104a50 2024-03-04T09:13:16.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.538+0000 7fd3d7fff640 1 -- 172.21.15.82:0/2905075451 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fd3c80054f0 con 0x7fd3e0104a50 2024-03-04T09:13:16.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.538+0000 7fd3e4afb640 1 -- 172.21.15.82:0/2905075451 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3e019f7e0 con 0x7fd3e0104a50 2024-03-04T09:13:16.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.538+0000 7fd3d7fff640 1 -- 172.21.15.82:0/2905075451 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c8010690 con 0x7fd3e0104a50 2024-03-04T09:13:16.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.538+0000 7fd3e4afb640 1 -- 172.21.15.82:0/2905075451 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3e019fd30 con 0x7fd3e0104a50 2024-03-04T09:13:16.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.539+0000 7fd3e4afb640 1 -- 172.21.15.82:0/2905075451 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3e00fd5a0 con 0x7fd3e0104a50 2024-03-04T09:13:16.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.540+0000 7fd3d7fff640 1 -- 172.21.15.82:0/2905075451 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7fd3c8004e10 con 0x7fd3e0104a50 2024-03-04T09:13:16.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.540+0000 7fd3d7fff640 1 --2- 172.21.15.82:0/2905075451 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fd3cc0a1d80 0x7fd3cc0a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:16.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.540+0000 7fd3de59c640 1 --2- 172.21.15.82:0/2905075451 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fd3cc0a1d80 0x7fd3cc0a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:16.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.541+0000 7fd3d7fff640 1 -- 172.21.15.82:0/2905075451 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8802+0+0 (secure 0 0 0) 0x7fd3c80ce420 con 0x7fd3e0104a50 2024-03-04T09:13:16.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.541+0000 7fd3de59c640 1 --2- 172.21.15.82:0/2905075451 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fd3cc0a1d80 0x7fd3cc0a4240 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd3d0005fd0 tx=0x7fd3d0005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:16.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.545+0000 7fd3d7fff640 1 -- 172.21.15.82:0/2905075451 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fd3c809b610 con 0x7fd3e0104a50 2024-03-04T09:13:16.678 INFO:journalctl@ceph.mds.b.smithi102.stdout:Mar 04 09:13:16 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-b[65969]: 2024-03-04T09:13:16.347+0000 7fcae7145700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-04T09:13:16.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.722+0000 7fd3e4afb640 1 -- 172.21.15.82:0/2905075451 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd3e00621d0 con 0x7fd3e0104a50 2024-03-04T09:13:16.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.724+0000 7fd3d7fff640 1 -- 172.21.15.82:0/2905075451 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+24092 (secure 0 0 0) 0x7fd3c809af10 con 0x7fd3e0104a50 2024-03-04T09:13:16.721 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:13:16.721 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":90,"fsid":"2e533fc8-da06-11ee-95c6-87774f69a715","created":"2024-03-04T09:05:16.488249+0000","modified":"2024-03-04T09:13:15.136817+0000","last_up_change":"2024-03-04T09:12:22.308711+0000","last_in_change":"2024-03-04T09:12:02.548212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T09:08:36.508257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T09:13:07.981726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T09:13:09.289799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-04T09:13:13.008516+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"085b5c4b-ede9-4d0d-b994-50c89d991012","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6803","nonce":709655235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6805","nonce":709655235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6809","nonce":709655235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6807","nonce":709655235}]},"public_addr":"172.21.15.82:6803/709655235","cluster_addr":"172.21.15.82:6805/709655235","heartbeat_back_addr":"172.21.15.82:6809/709655235","heartbeat_front_addr":"172.21.15.82:6807/709655235","state":["exists","up"]},{"osd":1,"uuid":"e4dd7079-333e-4bcf-b3af-11fb082a5af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6801","nonce":270721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6803","nonce":270721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6807","nonce":270721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6805","nonce":270721212}]},"public_addr":"172.21.15.102:6801/270721212","cluster_addr":"172.21.15.102:6803/270721212","heartbeat_back_addr":"172.21.15.102:6807/270721212","heartbeat_front_addr":"172.21.15.102:6805/270721212","state":["exists","up"]},{"osd":2,"uuid":"6fed5fd6-dc82-497f-9d69-c10a5e5802da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6801","nonce":946410459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6803","nonce":946410459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6807","nonce":946410459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6805","nonce":946410459}]},"public_addr":"172.21.15.190:6801/946410459","cluster_addr":"172.21.15.190:6803/946410459","heartbeat_back_addr":"172.21.15.190:6807/946410459","heartbeat_front_addr":"172.21.15.190:6805/946410459","state":["exists","up"]},{"osd":3,"uuid":"91ccbdc3-3da6-4d39-8a89-3a7b7bb4adc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6811","nonce":980870924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6813","nonce":980870924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6817","nonce":980870924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6815","nonce":980870924}]},"public_addr":"172.21.15.82:6811/980870924","cluster_addr":"172.21.15.82:6813/980870924","heartbeat_back_addr":"172.21.15.82:6817/980870924","heartbeat_front_addr":"172.21.15.82:6815/980870924","state":["exists","up"]},{"osd":4,"uuid":"dbb9d486-5daa-4819-bbed-04fc76ca473e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6809","nonce":1229627753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6811","nonce":1229627753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6815","nonce":1229627753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6813","nonce":1229627753}]},"public_addr":"172.21.15.102:6809/1229627753","cluster_addr":"172.21.15.102:6811/1229627753","heartbeat_back_addr":"172.21.15.102:6815/1229627753","heartbeat_front_addr":"172.21.15.102:6813/1229627753","state":["exists","up"]},{"osd":5,"uuid":"6b50127b-df2b-4c95-8e53-9d42b40273fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6809","nonce":2171194148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6811","nonce":2171194148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6815","nonce":2171194148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6813","nonce":2171194148}]},"public_addr":"172.21.15.190:6809/2171194148","cluster_addr":"172.21.15.190:6811/2171194148","heartbeat_back_addr":"172.21.15.190:6815/2171194148","heartbeat_front_addr":"172.21.15.190:6813/2171194148","state":["exists","up"]},{"osd":6,"uuid":"e72bebb0-5939-4210-950a-41c25c23c62f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6819","nonce":454436959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6821","nonce":454436959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6825","nonce":454436959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6823","nonce":454436959}]},"public_addr":"172.21.15.82:6819/454436959","cluster_addr":"172.21.15.82:6821/454436959","heartbeat_back_addr":"172.21.15.82:6825/454436959","heartbeat_front_addr":"172.21.15.82:6823/454436959","state":["exists","up"]},{"osd":7,"uuid":"72f83f97-f496-4503-8284-6a7b8f99a6f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6817","nonce":2745057274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6819","nonce":2745057274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6823","nonce":2745057274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6821","nonce":2745057274}]},"public_addr":"172.21.15.102:6817/2745057274","cluster_addr":"172.21.15.102:6819/2745057274","heartbeat_back_addr":"172.21.15.102:6823/2745057274","heartbeat_front_addr":"172.21.15.102:6821/2745057274","state":["exists","up"]},{"osd":8,"uuid":"92c9109d-6ebb-4c50-9944-28cd7b2f9c0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6817","nonce":1679683516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6819","nonce":1679683516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6823","nonce":1679683516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6821","nonce":1679683516}]},"public_addr":"172.21.15.190:6817/1679683516","cluster_addr":"172.21.15.190:6819/1679683516","heartbeat_back_addr":"172.21.15.190:6823/1679683516","heartbeat_front_addr":"172.21.15.190:6821/1679683516","state":["exists","up"]},{"osd":9,"uuid":"a3cfce03-0148-475d-bf55-b8284ae1cad2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6827","nonce":1777272933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6829","nonce":1777272933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6833","nonce":1777272933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6831","nonce":1777272933}]},"public_addr":"172.21.15.82:6827/1777272933","cluster_addr":"172.21.15.82:6829/1777272933","heartbeat_back_addr":"172.21.15.82:6833/1777272933","heartbeat_front_addr":"172.21.15.82:6831/1777272933","state":["exists","up"]},{"osd":10,"uuid":"db156ccf-4396-43cb-b69a-bb9095b94b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6825","nonce":1012784035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6827","nonce":1012784035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6831","nonce":1012784035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6829","nonce":1012784035}]},"public_addr":"172.21.15.102:6825/1012784035","cluster_addr":"172.21.15.102:6827/1012784035","heartbeat_back_addr":"172.21.15.102:6831/1012784035","heartbeat_front_addr":"172.21.15.102:6829/1012784035","state":["exists","up"]},{"osd":11,"uuid":"b4d52576-f5b4-479f-8ff6-8fdba4635ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6825","nonce":144700355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6827","nonce":144700355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6831","nonce":144700355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6829","nonce":144700355}]},"public_addr":"172.21.15.190:6825/144700355","cluster_addr":"172.21.15.190:6827/144700355","heartbeat_back_addr":"172.21.15.190:6831/144700355","heartbeat_front_addr":"172.21.15.190:6829/144700355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:07:47.007772+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:09.944738+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:33.183567+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:58.302023+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:09:23.042488+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:09:47.616009+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:10:13.122887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:10:38.584530+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:03.473453+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:29.847105+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:55.152195+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:12:20.401765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6800/1901539016":"2024-03-05T09:06:12.169231+0000","172.21.15.82:0/1124105204":"2024-03-05T09:06:12.169231+0000","172.21.15.82:6801/1901539016":"2024-03-05T09:06:12.169231+0000","172.21.15.82:0/735262841":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/2402774828":"2024-03-05T09:05:44.913099+0000","172.21.15.82:6801/3291527077":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/1846720385":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/3757201752":"2024-03-05T09:06:12.169231+0000","172.21.15.82:6800/3291527077":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/984630078":"2024-03-05T09:06:12.169231+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T09:13:16.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.726+0000 7fd3e4afb640 1 -- 172.21.15.82:0/2905075451 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fd3cc0a1d80 msgr2=0x7fd3cc0a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:16.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.726+0000 7fd3e4afb640 1 --2- 172.21.15.82:0/2905075451 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fd3cc0a1d80 0x7fd3cc0a4240 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd3d0005fd0 tx=0x7fd3d0005850 comp rx=0 tx=0).stop 2024-03-04T09:13:16.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.726+0000 7fd3e4afb640 1 -- 172.21.15.82:0/2905075451 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3e0104a50 msgr2=0x7fd3e0197e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:16.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.726+0000 7fd3e4afb640 1 --2- 172.21.15.82:0/2905075451 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3e0104a50 0x7fd3e0197e10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd3c800e9c0 tx=0x7fd3c800ee80 comp rx=0 tx=0).stop 2024-03-04T09:13:16.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.726+0000 7fd3e4afb640 1 -- 172.21.15.82:0/2905075451 shutdown_connections 2024-03-04T09:13:16.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.726+0000 7fd3e4afb640 1 --2- 172.21.15.82:0/2905075451 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fd3cc0a1d80 0x7fd3cc0a4240 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:16.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.726+0000 7fd3e4afb640 1 --2- 172.21.15.82:0/2905075451 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3e0107380 0x7fd3e019ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:16.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.726+0000 7fd3e4afb640 1 --2- 172.21.15.82:0/2905075451 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3e0104a50 0x7fd3e0197e10 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:16.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.726+0000 7fd3e4afb640 1 --2- 172.21.15.82:0/2905075451 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3e0102120 0x7fd3e01978d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:16.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.726+0000 7fd3e4afb640 1 -- 172.21.15.82:0/2905075451 >> 172.21.15.82:0/2905075451 conn(0x7fd3e00fbab0 msgr2=0x7fd3e0102a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:16.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.726+0000 7fd3e4afb640 1 -- 172.21.15.82:0/2905075451 shutdown_connections 2024-03-04T09:13:16.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.726+0000 7fd3e4afb640 1 -- 172.21.15.82:0/2905075451 wait complete. 2024-03-04T09:13:16.749 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T09:13:16.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.855+0000 7f76c517a640 1 -- 172.21.15.82:0/840896330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76c00ff650 msgr2=0x7f76c00ffad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:16.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.855+0000 7f76c517a640 1 --2- 172.21.15.82:0/840896330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76c00ff650 0x7f76c00ffad0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f76b4009900 tx=0x7f76b402bc30 comp rx=0 tx=0).stop 2024-03-04T09:13:16.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.855+0000 7f76c517a640 1 -- 172.21.15.82:0/840896330 shutdown_connections 2024-03-04T09:13:16.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.855+0000 7f76c517a640 1 --2- 172.21.15.82:0/840896330 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76c0100010 0x7f76c0109bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:16.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.855+0000 7f76c517a640 1 --2- 172.21.15.82:0/840896330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76c00ff650 0x7f76c00ffad0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:16.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.855+0000 7f76c517a640 1 --2- 172.21.15.82:0/840896330 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76c0102be0 0x7f76c0103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:16.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.855+0000 7f76c517a640 1 -- 172.21.15.82:0/840896330 >> 172.21.15.82:0/840896330 conn(0x7f76c00fb1f0 msgr2=0x7f76c00fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:16.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.855+0000 7f76c517a640 1 -- 172.21.15.82:0/840896330 shutdown_connections 2024-03-04T09:13:16.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.855+0000 7f76c517a640 1 -- 172.21.15.82:0/840896330 wait complete. 2024-03-04T09:13:16.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.855+0000 7f76c517a640 1 Processor -- start 2024-03-04T09:13:16.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.856+0000 7f76c517a640 1 -- start start 2024-03-04T09:13:16.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.856+0000 7f76c517a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76c00ff650 0x7f76c01978a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:16.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.856+0000 7f76c517a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76c0100010 0x7f76c0197de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:16.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.856+0000 7f76c517a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76c0102be0 0x7f76c019ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:16.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.856+0000 7f76c517a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c010d290 con 0x7f76c0102be0 2024-03-04T09:13:16.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.856+0000 7f76c517a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c010d110 con 0x7f76c00ff650 2024-03-04T09:13:16.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.856+0000 7f76c517a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c010d410 con 0x7f76c0100010 2024-03-04T09:13:16.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.856+0000 7f76bf59e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76c0102be0 0x7f76c019ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:16.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.856+0000 7f76bf59e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76c0102be0 0x7f76c019ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51052/0 (socket says 172.21.15.82:51052) 2024-03-04T09:13:16.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.856+0000 7f76bf59e640 1 -- 172.21.15.82:0/3475911288 learned_addr learned my addr 172.21.15.82:0/3475911288 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:16.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.856+0000 7f76bed9d640 1 --2- 172.21.15.82:0/3475911288 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76c00ff650 0x7f76c01978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:16.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.856+0000 7f76bf59e640 1 -- 172.21.15.82:0/3475911288 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76c0100010 msgr2=0x7f76c0197de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:16.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.856+0000 7f76bf59e640 1 --2- 172.21.15.82:0/3475911288 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76c0100010 0x7f76c0197de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:16.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.856+0000 7f76bf59e640 1 -- 172.21.15.82:0/3475911288 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76c00ff650 msgr2=0x7f76c01978a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:16.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.856+0000 7f76bf59e640 1 --2- 172.21.15.82:0/3475911288 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76c00ff650 0x7f76c01978a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:16.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.856+0000 7f76bf59e640 1 -- 172.21.15.82:0/3475911288 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c019f4c0 con 0x7f76c0102be0 2024-03-04T09:13:16.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.856+0000 7f76bf59e640 1 --2- 172.21.15.82:0/3475911288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76c0102be0 0x7f76c019ee50 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f76b800eb10 tx=0x7f76b800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:16.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.856+0000 7f76a7fff640 1 -- 172.21.15.82:0/3475911288 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b8004b20 con 0x7f76c0102be0 2024-03-04T09:13:16.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.856+0000 7f76c517a640 1 -- 172.21.15.82:0/3475911288 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76c019f7b0 con 0x7f76c0102be0 2024-03-04T09:13:16.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.856+0000 7f76a7fff640 1 -- 172.21.15.82:0/3475911288 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f76b8004cc0 con 0x7f76c0102be0 2024-03-04T09:13:16.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.856+0000 7f76a7fff640 1 -- 172.21.15.82:0/3475911288 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b8010700 con 0x7f76c0102be0 2024-03-04T09:13:16.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.857+0000 7f76c517a640 1 -- 172.21.15.82:0/3475911288 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76c019fcb0 con 0x7f76c0102be0 2024-03-04T09:13:16.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.857+0000 7f76c517a640 1 -- 172.21.15.82:0/3475911288 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76c0108aa0 con 0x7f76c0102be0 2024-03-04T09:13:16.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.859+0000 7f76a7fff640 1 -- 172.21.15.82:0/3475911288 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f76b8004e70 con 0x7f76c0102be0 2024-03-04T09:13:16.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.859+0000 7f76a7fff640 1 --2- 172.21.15.82:0/3475911288 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f76a80a1d80 0x7f76a80a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:16.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.859+0000 7f76bed9d640 1 --2- 172.21.15.82:0/3475911288 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f76a80a1d80 0x7f76a80a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:16.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.859+0000 7f76a7fff640 1 -- 172.21.15.82:0/3475911288 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8802+0+0 (secure 0 0 0) 0x7f76b80ce830 con 0x7f76c0102be0 2024-03-04T09:13:16.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.860+0000 7f76bed9d640 1 --2- 172.21.15.82:0/3475911288 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f76a80a1d80 0x7f76a80a4240 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f76c00699a0 tx=0x7f76b000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:16.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:16.863+0000 7f76a7fff640 1 -- 172.21.15.82:0/3475911288 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f76b8053280 con 0x7f76c0102be0 2024-03-04T09:13:17.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:16 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/3058260154' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-03-04T09:13:17.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:16 smithi082 ceph-mon[32880]: osdmap e90: 12 total, 12 up, 12 in 2024-03-04T09:13:17.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:16 smithi082 ceph-mon[32880]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-04T09:13:17.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:16 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/3390988512' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:13:17.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:16 smithi082 ceph-mon[32880]: pgmap v292: 129 pgs: 6 creating+peering, 114 active+clean, 9 unknown; 579 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 4 op/s 2024-03-04T09:13:17.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:16 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/1087903468' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:13:17.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:16 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/2905075451' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:13:17.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.074+0000 7f76c517a640 1 -- 172.21.15.82:0/3475911288 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f76c002d260 con 0x7f76c0102be0 2024-03-04T09:13:17.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.074+0000 7f76a7fff640 1 -- 172.21.15.82:0/3475911288 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+11327 (secure 0 0 0) 0x7f76b809ba20 con 0x7f76c0102be0 2024-03-04T09:13:17.071 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:13:17.071 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3123844705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3123844705},{"type":"v1","addr":"172.21.15.82:6835","nonce":3123844705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2620634252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2620634252},{"type":"v1","addr":"172.21.15.82:6837","nonce":2620634252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6839/1240838024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1240838024},{"type":"v1","addr":"172.21.15.82:6839","nonce":1240838024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/213594267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":213594267},{"type":"v1","addr":"172.21.15.82:6841","nonce":213594267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/1142302200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":1142302200},{"type":"v1","addr":"172.21.15.102:6833","nonce":1142302200}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/3023382814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":3023382814},{"type":"v1","addr":"172.21.15.190:6833","nonce":3023382814}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24422,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/2134310473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":2134310473},{"type":"v1","addr":"172.21.15.102:6835","nonce":2134310473}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/3183532624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3183532624},{"type":"v1","addr":"172.21.15.190:6835","nonce":3183532624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/1210579527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1210579527},{"type":"v1","addr":"172.21.15.102:6837","nonce":1210579527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/1198639527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":1198639527},{"type":"v1","addr":"172.21.15.190:6837","nonce":1198639527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24469,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6839/878555510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":878555510},{"type":"v1","addr":"172.21.15.190:6839","nonce":878555510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-04T09:13:10.076732+0000","modified":"2024-03-04T09:13:15.136993+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6839/35424130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":35424130},{"type":"v1","addr":"172.21.15.102:6839","nonce":35424130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24476,"qdb_cluster":[24476]},"id":1}]} 2024-03-04T09:13:17.071 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 17 2024-03-04T09:13:17.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.076+0000 7f76c517a640 1 -- 172.21.15.82:0/3475911288 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f76a80a1d80 msgr2=0x7f76a80a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:17.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.076+0000 7f76c517a640 1 --2- 172.21.15.82:0/3475911288 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f76a80a1d80 0x7f76a80a4240 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f76c00699a0 tx=0x7f76b000b390 comp rx=0 tx=0).stop 2024-03-04T09:13:17.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.076+0000 7f76c517a640 1 -- 172.21.15.82:0/3475911288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76c0102be0 msgr2=0x7f76c019ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:17.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.076+0000 7f76c517a640 1 --2- 172.21.15.82:0/3475911288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76c0102be0 0x7f76c019ee50 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f76b800eb10 tx=0x7f76b800c2d0 comp rx=0 tx=0).stop 2024-03-04T09:13:17.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.076+0000 7f76c517a640 1 -- 172.21.15.82:0/3475911288 shutdown_connections 2024-03-04T09:13:17.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.076+0000 7f76c517a640 1 --2- 172.21.15.82:0/3475911288 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f76a80a1d80 0x7f76a80a4240 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:17.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.076+0000 7f76c517a640 1 --2- 172.21.15.82:0/3475911288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76c0102be0 0x7f76c019ee50 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:17.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.076+0000 7f76c517a640 1 --2- 172.21.15.82:0/3475911288 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76c0100010 0x7f76c0197de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:17.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.076+0000 7f76c517a640 1 --2- 172.21.15.82:0/3475911288 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76c00ff650 0x7f76c01978a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:17.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.076+0000 7f76c517a640 1 -- 172.21.15.82:0/3475911288 >> 172.21.15.82:0/3475911288 conn(0x7f76c00fb1f0 msgr2=0x7f76c0105c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:17.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.077+0000 7f76c517a640 1 -- 172.21.15.82:0/3475911288 shutdown_connections 2024-03-04T09:13:17.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.077+0000 7f76c517a640 1 -- 172.21.15.82:0/3475911288 wait complete. 2024-03-04T09:13:17.085 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T09:13:17.170 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:16 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/3058260154' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-03-04T09:13:17.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:16 smithi190 ceph-mon[36341]: osdmap e90: 12 total, 12 up, 12 in 2024-03-04T09:13:17.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:16 smithi190 ceph-mon[36341]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-04T09:13:17.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:16 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/3390988512' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:13:17.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:16 smithi190 ceph-mon[36341]: pgmap v292: 129 pgs: 6 creating+peering, 114 active+clean, 9 unknown; 579 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 4 op/s 2024-03-04T09:13:17.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:16 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/1087903468' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:13:17.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:16 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/2905075451' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:13:17.178 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:16 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/3058260154' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-03-04T09:13:17.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:16 smithi102 ceph-mon[36220]: osdmap e90: 12 total, 12 up, 12 in 2024-03-04T09:13:17.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:16 smithi102 ceph-mon[36220]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-04T09:13:17.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:16 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/3390988512' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:13:17.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:16 smithi102 ceph-mon[36220]: pgmap v292: 129 pgs: 6 creating+peering, 114 active+clean, 9 unknown; 579 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 4 op/s 2024-03-04T09:13:17.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:16 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/1087903468' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:13:17.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:16 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/2905075451' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:13:17.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.190+0000 7fefa45f7640 1 -- 172.21.15.82:0/998784306 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef9c104a40 msgr2=0x7fef9c106e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:17.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.190+0000 7fefa45f7640 1 --2- 172.21.15.82:0/998784306 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef9c104a40 0x7fef9c106e30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fef8c009900 tx=0x7fef8c02bc30 comp rx=0 tx=0).stop 2024-03-04T09:13:17.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.190+0000 7fefa45f7640 1 -- 172.21.15.82:0/998784306 shutdown_connections 2024-03-04T09:13:17.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.190+0000 7fefa45f7640 1 --2- 172.21.15.82:0/998784306 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef9c107370 0x7fef9c109760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:17.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.190+0000 7fefa45f7640 1 --2- 172.21.15.82:0/998784306 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef9c104a40 0x7fef9c106e30 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:17.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.190+0000 7fefa45f7640 1 --2- 172.21.15.82:0/998784306 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef9c102110 0x7fef9c104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:17.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.190+0000 7fefa45f7640 1 -- 172.21.15.82:0/998784306 >> 172.21.15.82:0/998784306 conn(0x7fef9c0fba80 msgr2=0x7fef9c0fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:17.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.190+0000 7fefa45f7640 1 -- 172.21.15.82:0/998784306 shutdown_connections 2024-03-04T09:13:17.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.190+0000 7fefa45f7640 1 -- 172.21.15.82:0/998784306 wait complete. 2024-03-04T09:13:17.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.190+0000 7fefa45f7640 1 Processor -- start 2024-03-04T09:13:17.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.190+0000 7fefa45f7640 1 -- start start 2024-03-04T09:13:17.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.190+0000 7fefa45f7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef9c102110 0x7fef9c197970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:17.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.190+0000 7fefa45f7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef9c104a40 0x7fef9c197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:17.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.190+0000 7fefa45f7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef9c107370 0x7fef9c19ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:17.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.190+0000 7fefa45f7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c10d270 con 0x7fef9c104a40 2024-03-04T09:13:17.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.190+0000 7fefa45f7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c10d0f0 con 0x7fef9c102110 2024-03-04T09:13:17.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.191+0000 7fefa45f7640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c10d3f0 con 0x7fef9c107370 2024-03-04T09:13:17.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.191+0000 7fefa1b92640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef9c104a40 0x7fef9c197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:17.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.191+0000 7fefa1b92640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef9c104a40 0x7fef9c197eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51066/0 (socket says 172.21.15.82:51066) 2024-03-04T09:13:17.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.191+0000 7fefa1b92640 1 -- 172.21.15.82:0/1680232952 learned_addr learned my addr 172.21.15.82:0/1680232952 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:17.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.191+0000 7fefa2393640 1 --2- 172.21.15.82:0/1680232952 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef9c102110 0x7fef9c197970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:17.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.191+0000 7fefa2b94640 1 --2- 172.21.15.82:0/1680232952 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef9c107370 0x7fef9c19ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:17.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.191+0000 7fefa1b92640 1 -- 172.21.15.82:0/1680232952 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef9c107370 msgr2=0x7fef9c19ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:17.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.191+0000 7fefa1b92640 1 --2- 172.21.15.82:0/1680232952 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef9c107370 0x7fef9c19ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:17.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.191+0000 7fefa1b92640 1 -- 172.21.15.82:0/1680232952 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef9c102110 msgr2=0x7fef9c197970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:17.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.191+0000 7fefa1b92640 1 --2- 172.21.15.82:0/1680232952 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef9c102110 0x7fef9c197970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:17.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.191+0000 7fefa1b92640 1 -- 172.21.15.82:0/1680232952 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef9c19f590 con 0x7fef9c104a40 2024-03-04T09:13:17.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.191+0000 7fefa1b92640 1 --2- 172.21.15.82:0/1680232952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef9c104a40 0x7fef9c197eb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fef8c005ab0 tx=0x7fef8c005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:17.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.191+0000 7fef937fe640 1 -- 172.21.15.82:0/1680232952 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8c043020 con 0x7fef9c104a40 2024-03-04T09:13:17.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.191+0000 7fef937fe640 1 -- 172.21.15.82:0/1680232952 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fef8c0054b0 con 0x7fef9c104a40 2024-03-04T09:13:17.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.191+0000 7fefa45f7640 1 -- 172.21.15.82:0/1680232952 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef9c19f820 con 0x7fef9c104a40 2024-03-04T09:13:17.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.191+0000 7fef937fe640 1 -- 172.21.15.82:0/1680232952 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8c003bb0 con 0x7fef9c104a40 2024-03-04T09:13:17.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.191+0000 7fefa45f7640 1 -- 172.21.15.82:0/1680232952 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef9c19fd70 con 0x7fef9c104a40 2024-03-04T09:13:17.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.192+0000 7fefa45f7640 1 -- 172.21.15.82:0/1680232952 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef9c0fd570 con 0x7fef9c104a40 2024-03-04T09:13:17.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.193+0000 7fef937fe640 1 -- 172.21.15.82:0/1680232952 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7fef8c046020 con 0x7fef9c104a40 2024-03-04T09:13:17.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.194+0000 7fef937fe640 1 --2- 172.21.15.82:0/1680232952 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fef880a1d80 0x7fef880a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:17.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.194+0000 7fefa2393640 1 --2- 172.21.15.82:0/1680232952 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fef880a1d80 0x7fef880a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:17.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.194+0000 7fef937fe640 1 -- 172.21.15.82:0/1680232952 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8802+0+0 (secure 0 0 0) 0x7fef8c0efb60 con 0x7fef9c104a40 2024-03-04T09:13:17.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.194+0000 7fefa2393640 1 --2- 172.21.15.82:0/1680232952 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fef880a1d80 0x7fef880a4240 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fef94005fd0 tx=0x7fef94009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:17.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.198+0000 7fef937fe640 1 -- 172.21.15.82:0/1680232952 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fef8c04d070 con 0x7fef9c104a40 2024-03-04T09:13:17.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.374+0000 7fefa45f7640 1 -- 172.21.15.82:0/1680232952 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef9c0621d0 con 0x7fef9c104a40 2024-03-04T09:13:17.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.376+0000 7fef937fe640 1 -- 172.21.15.82:0/1680232952 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+24092 (secure 0 0 0) 0x7fef8c0bcd50 con 0x7fef9c104a40 2024-03-04T09:13:17.372 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:13:17.373 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":90,"fsid":"2e533fc8-da06-11ee-95c6-87774f69a715","created":"2024-03-04T09:05:16.488249+0000","modified":"2024-03-04T09:13:15.136817+0000","last_up_change":"2024-03-04T09:12:22.308711+0000","last_in_change":"2024-03-04T09:12:02.548212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T09:08:36.508257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T09:13:07.981726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T09:13:09.289799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-04T09:13:13.008516+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"085b5c4b-ede9-4d0d-b994-50c89d991012","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6803","nonce":709655235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6805","nonce":709655235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6809","nonce":709655235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6807","nonce":709655235}]},"public_addr":"172.21.15.82:6803/709655235","cluster_addr":"172.21.15.82:6805/709655235","heartbeat_back_addr":"172.21.15.82:6809/709655235","heartbeat_front_addr":"172.21.15.82:6807/709655235","state":["exists","up"]},{"osd":1,"uuid":"e4dd7079-333e-4bcf-b3af-11fb082a5af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6801","nonce":270721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6803","nonce":270721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6807","nonce":270721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6805","nonce":270721212}]},"public_addr":"172.21.15.102:6801/270721212","cluster_addr":"172.21.15.102:6803/270721212","heartbeat_back_addr":"172.21.15.102:6807/270721212","heartbeat_front_addr":"172.21.15.102:6805/270721212","state":["exists","up"]},{"osd":2,"uuid":"6fed5fd6-dc82-497f-9d69-c10a5e5802da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6801","nonce":946410459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6803","nonce":946410459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6807","nonce":946410459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6805","nonce":946410459}]},"public_addr":"172.21.15.190:6801/946410459","cluster_addr":"172.21.15.190:6803/946410459","heartbeat_back_addr":"172.21.15.190:6807/946410459","heartbeat_front_addr":"172.21.15.190:6805/946410459","state":["exists","up"]},{"osd":3,"uuid":"91ccbdc3-3da6-4d39-8a89-3a7b7bb4adc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6811","nonce":980870924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6813","nonce":980870924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6817","nonce":980870924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6815","nonce":980870924}]},"public_addr":"172.21.15.82:6811/980870924","cluster_addr":"172.21.15.82:6813/980870924","heartbeat_back_addr":"172.21.15.82:6817/980870924","heartbeat_front_addr":"172.21.15.82:6815/980870924","state":["exists","up"]},{"osd":4,"uuid":"dbb9d486-5daa-4819-bbed-04fc76ca473e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6809","nonce":1229627753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6811","nonce":1229627753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6815","nonce":1229627753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6813","nonce":1229627753}]},"public_addr":"172.21.15.102:6809/1229627753","cluster_addr":"172.21.15.102:6811/1229627753","heartbeat_back_addr":"172.21.15.102:6815/1229627753","heartbeat_front_addr":"172.21.15.102:6813/1229627753","state":["exists","up"]},{"osd":5,"uuid":"6b50127b-df2b-4c95-8e53-9d42b40273fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6809","nonce":2171194148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6811","nonce":2171194148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6815","nonce":2171194148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6813","nonce":2171194148}]},"public_addr":"172.21.15.190:6809/2171194148","cluster_addr":"172.21.15.190:6811/2171194148","heartbeat_back_addr":"172.21.15.190:6815/2171194148","heartbeat_front_addr":"172.21.15.190:6813/2171194148","state":["exists","up"]},{"osd":6,"uuid":"e72bebb0-5939-4210-950a-41c25c23c62f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6819","nonce":454436959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6821","nonce":454436959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6825","nonce":454436959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6823","nonce":454436959}]},"public_addr":"172.21.15.82:6819/454436959","cluster_addr":"172.21.15.82:6821/454436959","heartbeat_back_addr":"172.21.15.82:6825/454436959","heartbeat_front_addr":"172.21.15.82:6823/454436959","state":["exists","up"]},{"osd":7,"uuid":"72f83f97-f496-4503-8284-6a7b8f99a6f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6817","nonce":2745057274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6819","nonce":2745057274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6823","nonce":2745057274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6821","nonce":2745057274}]},"public_addr":"172.21.15.102:6817/2745057274","cluster_addr":"172.21.15.102:6819/2745057274","heartbeat_back_addr":"172.21.15.102:6823/2745057274","heartbeat_front_addr":"172.21.15.102:6821/2745057274","state":["exists","up"]},{"osd":8,"uuid":"92c9109d-6ebb-4c50-9944-28cd7b2f9c0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6817","nonce":1679683516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6819","nonce":1679683516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6823","nonce":1679683516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6821","nonce":1679683516}]},"public_addr":"172.21.15.190:6817/1679683516","cluster_addr":"172.21.15.190:6819/1679683516","heartbeat_back_addr":"172.21.15.190:6823/1679683516","heartbeat_front_addr":"172.21.15.190:6821/1679683516","state":["exists","up"]},{"osd":9,"uuid":"a3cfce03-0148-475d-bf55-b8284ae1cad2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6827","nonce":1777272933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6829","nonce":1777272933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6833","nonce":1777272933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6831","nonce":1777272933}]},"public_addr":"172.21.15.82:6827/1777272933","cluster_addr":"172.21.15.82:6829/1777272933","heartbeat_back_addr":"172.21.15.82:6833/1777272933","heartbeat_front_addr":"172.21.15.82:6831/1777272933","state":["exists","up"]},{"osd":10,"uuid":"db156ccf-4396-43cb-b69a-bb9095b94b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6825","nonce":1012784035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6827","nonce":1012784035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6831","nonce":1012784035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6829","nonce":1012784035}]},"public_addr":"172.21.15.102:6825/1012784035","cluster_addr":"172.21.15.102:6827/1012784035","heartbeat_back_addr":"172.21.15.102:6831/1012784035","heartbeat_front_addr":"172.21.15.102:6829/1012784035","state":["exists","up"]},{"osd":11,"uuid":"b4d52576-f5b4-479f-8ff6-8fdba4635ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6825","nonce":144700355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6827","nonce":144700355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6831","nonce":144700355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6829","nonce":144700355}]},"public_addr":"172.21.15.190:6825/144700355","cluster_addr":"172.21.15.190:6827/144700355","heartbeat_back_addr":"172.21.15.190:6831/144700355","heartbeat_front_addr":"172.21.15.190:6829/144700355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:07:47.007772+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:09.944738+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:33.183567+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:58.302023+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:09:23.042488+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:09:47.616009+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:10:13.122887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:10:38.584530+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:03.473453+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:29.847105+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:55.152195+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:12:20.401765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6800/1901539016":"2024-03-05T09:06:12.169231+0000","172.21.15.82:0/1124105204":"2024-03-05T09:06:12.169231+0000","172.21.15.82:6801/1901539016":"2024-03-05T09:06:12.169231+0000","172.21.15.82:0/735262841":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/2402774828":"2024-03-05T09:05:44.913099+0000","172.21.15.82:6801/3291527077":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/1846720385":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/3757201752":"2024-03-05T09:06:12.169231+0000","172.21.15.82:6800/3291527077":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/984630078":"2024-03-05T09:06:12.169231+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T09:13:17.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.378+0000 7fefa45f7640 1 -- 172.21.15.82:0/1680232952 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fef880a1d80 msgr2=0x7fef880a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:17.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.378+0000 7fefa45f7640 1 --2- 172.21.15.82:0/1680232952 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fef880a1d80 0x7fef880a4240 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fef94005fd0 tx=0x7fef94009500 comp rx=0 tx=0).stop 2024-03-04T09:13:17.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.378+0000 7fefa45f7640 1 -- 172.21.15.82:0/1680232952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef9c104a40 msgr2=0x7fef9c197eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:17.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.378+0000 7fefa45f7640 1 --2- 172.21.15.82:0/1680232952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef9c104a40 0x7fef9c197eb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fef8c005ab0 tx=0x7fef8c005de0 comp rx=0 tx=0).stop 2024-03-04T09:13:17.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.378+0000 7fefa45f7640 1 -- 172.21.15.82:0/1680232952 shutdown_connections 2024-03-04T09:13:17.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.378+0000 7fefa45f7640 1 --2- 172.21.15.82:0/1680232952 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fef880a1d80 0x7fef880a4240 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:17.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.378+0000 7fefa45f7640 1 --2- 172.21.15.82:0/1680232952 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef9c107370 0x7fef9c19ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:17.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.378+0000 7fefa45f7640 1 --2- 172.21.15.82:0/1680232952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef9c104a40 0x7fef9c197eb0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:17.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.378+0000 7fefa45f7640 1 --2- 172.21.15.82:0/1680232952 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef9c102110 0x7fef9c197970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:17.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.378+0000 7fefa45f7640 1 -- 172.21.15.82:0/1680232952 >> 172.21.15.82:0/1680232952 conn(0x7fef9c0fba80 msgr2=0x7fef9c102b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:17.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.378+0000 7fefa45f7640 1 -- 172.21.15.82:0/1680232952 shutdown_connections 2024-03-04T09:13:17.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.378+0000 7fefa45f7640 1 -- 172.21.15.82:0/1680232952 wait complete. 2024-03-04T09:13:17.386 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-04T09:13:10.076732+0000', 'modified': '2024-03-04T09:13:15.136993+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24476}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24476': {'gid': 24476, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.102:6839/35424130', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6838', 'nonce': 35424130}, {'type': 'v1', 'addr': '172.21.15.102:6839', 'nonce': 35424130}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24476, 'qdb_cluster': [24476]} 2024-03-04T09:13:17.386 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-04T09:13:17.386 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-03-04T09:13:17.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.493+0000 7fb8cf678640 1 -- 172.21.15.82:0/382224422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8c80ff6a0 msgr2=0x7fb8c80ffb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:17.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.493+0000 7fb8cf678640 1 --2- 172.21.15.82:0/382224422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8c80ff6a0 0x7fb8c80ffb20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8009900 tx=0x7fb8b802bc30 comp rx=0 tx=0).stop 2024-03-04T09:13:17.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.493+0000 7fb8cf678640 1 -- 172.21.15.82:0/382224422 shutdown_connections 2024-03-04T09:13:17.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.493+0000 7fb8cf678640 1 --2- 172.21.15.82:0/382224422 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8c8100060 0x7fb8c8109c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:17.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.493+0000 7fb8cf678640 1 --2- 172.21.15.82:0/382224422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8c80ff6a0 0x7fb8c80ffb20 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:17.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.493+0000 7fb8cf678640 1 --2- 172.21.15.82:0/382224422 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8c8102c30 0x7fb8c8103050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:17.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.493+0000 7fb8cf678640 1 -- 172.21.15.82:0/382224422 >> 172.21.15.82:0/382224422 conn(0x7fb8c80fb200 msgr2=0x7fb8c80fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:17.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.493+0000 7fb8cf678640 1 -- 172.21.15.82:0/382224422 shutdown_connections 2024-03-04T09:13:17.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.493+0000 7fb8cf678640 1 -- 172.21.15.82:0/382224422 wait complete. 2024-03-04T09:13:17.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.494+0000 7fb8cf678640 1 Processor -- start 2024-03-04T09:13:17.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.494+0000 7fb8cf678640 1 -- start start 2024-03-04T09:13:17.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.494+0000 7fb8cf678640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8c80ff6a0 0x7fb8c8197930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:17.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.494+0000 7fb8cf678640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8c8100060 0x7fb8c8197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:17.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.494+0000 7fb8cf678640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8c8102c30 0x7fb8c819eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:17.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.494+0000 7fb8cf678640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c810d290 con 0x7fb8c8100060 2024-03-04T09:13:17.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.494+0000 7fb8cf678640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c810d110 con 0x7fb8c8102c30 2024-03-04T09:13:17.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.494+0000 7fb8cf678640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c810d410 con 0x7fb8c80ff6a0 2024-03-04T09:13:17.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.494+0000 7fb8ccc13640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8c8100060 0x7fb8c8197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:17.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.494+0000 7fb8ccc13640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8c8100060 0x7fb8c8197e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51096/0 (socket says 172.21.15.82:51096) 2024-03-04T09:13:17.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.494+0000 7fb8ccc13640 1 -- 172.21.15.82:0/1579844560 learned_addr learned my addr 172.21.15.82:0/1579844560 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:17.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.494+0000 7fb8cd414640 1 --2- 172.21.15.82:0/1579844560 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8c80ff6a0 0x7fb8c8197930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:17.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.494+0000 7fb8cdc15640 1 --2- 172.21.15.82:0/1579844560 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8c8102c30 0x7fb8c819eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:17.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.494+0000 7fb8ccc13640 1 -- 172.21.15.82:0/1579844560 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8c80ff6a0 msgr2=0x7fb8c8197930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:17.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.494+0000 7fb8ccc13640 1 --2- 172.21.15.82:0/1579844560 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8c80ff6a0 0x7fb8c8197930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:17.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.494+0000 7fb8ccc13640 1 -- 172.21.15.82:0/1579844560 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8c8102c30 msgr2=0x7fb8c819eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:17.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.494+0000 7fb8ccc13640 1 --2- 172.21.15.82:0/1579844560 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8c8102c30 0x7fb8c819eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:17.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.494+0000 7fb8ccc13640 1 -- 172.21.15.82:0/1579844560 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c819f550 con 0x7fb8c8100060 2024-03-04T09:13:17.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.494+0000 7fb8cd414640 1 --2- 172.21.15.82:0/1579844560 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8c80ff6a0 0x7fb8c8197930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T09:13:17.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.494+0000 7fb8cdc15640 1 --2- 172.21.15.82:0/1579844560 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8c8102c30 0x7fb8c819eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T09:13:17.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.494+0000 7fb8ccc13640 1 --2- 172.21.15.82:0/1579844560 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8c8100060 0x7fb8c8197e70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8009230 tx=0x7fb8b8004e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:17.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.494+0000 7fb8be7fc640 1 -- 172.21.15.82:0/1579844560 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b8043020 con 0x7fb8c8100060 2024-03-04T09:13:17.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.495+0000 7fb8cf678640 1 -- 172.21.15.82:0/1579844560 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8c819f7e0 con 0x7fb8c8100060 2024-03-04T09:13:17.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.495+0000 7fb8be7fc640 1 -- 172.21.15.82:0/1579844560 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fb8b8005460 con 0x7fb8c8100060 2024-03-04T09:13:17.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.495+0000 7fb8be7fc640 1 -- 172.21.15.82:0/1579844560 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b8003c60 con 0x7fb8c8100060 2024-03-04T09:13:17.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.495+0000 7fb8cf678640 1 -- 172.21.15.82:0/1579844560 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8c819fd30 con 0x7fb8c8100060 2024-03-04T09:13:17.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.497+0000 7fb8be7fc640 1 -- 172.21.15.82:0/1579844560 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7fb8b8046020 con 0x7fb8c8100060 2024-03-04T09:13:17.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.497+0000 7fb8d225c740 1 Processor -- start 2024-03-04T09:13:17.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.497+0000 7fb8d225c740 1 -- start start 2024-03-04T09:13:17.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.497+0000 7fb8be7fc640 1 --2- 172.21.15.82:0/1579844560 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb8b40a1d80 0x7fb8b40a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:17.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.497+0000 7fb8d225c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560bc9e6d7b0 0x560bc9e6dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:17.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.497+0000 7fb8d225c740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560bc9e6e980 0x560bc9e6ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:17.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.497+0000 7fb8d225c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560bc9e6f340 0x560bc9e75bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:17.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.497+0000 7fb8d225c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bc9dd26b0 con 0x560bc9e6f340 2024-03-04T09:13:17.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.497+0000 7fb8d225c740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bc9d7ba60 con 0x560bc9e6e980 2024-03-04T09:13:17.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.497+0000 7fb8d225c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bc9dce750 con 0x560bc9e6d7b0 2024-03-04T09:13:17.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.498+0000 7fb8cdc15640 1 --2- 172.21.15.82:0/1579844560 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb8b40a1d80 0x7fb8b40a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:17.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.498+0000 7fb8cdc15640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560bc9e6f340 0x560bc9e75bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:17.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.498+0000 7fb8be7fc640 1 -- 172.21.15.82:0/1579844560 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8802+0+0 (secure 0 0 0) 0x7fb8b80efdf0 con 0x7fb8c8100060 2024-03-04T09:13:17.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.498+0000 7fb8ccc13640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560bc9e6e980 0x560bc9e6ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:17.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.498+0000 7fb8cdc15640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560bc9e6f340 0x560bc9e75bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51102/0 (socket says 172.21.15.82:51102) 2024-03-04T09:13:17.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.498+0000 7fb8cdc15640 1 -- 172.21.15.82:0/2711106686 learned_addr learned my addr 172.21.15.82:0/2711106686 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:17.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.498+0000 7fb8ccc13640 1 --2- 172.21.15.82:0/2711106686 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560bc9e6e980 0x560bc9e6ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.82:38214/0 (socket says 172.21.15.82:38214) 2024-03-04T09:13:17.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.498+0000 7fb8cd414640 1 --2- 172.21.15.82:0/2711106686 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560bc9e6d7b0 0x560bc9e6dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:17.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.498+0000 7fb8cdc15640 1 -- 172.21.15.82:0/2711106686 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560bc9e6d7b0 msgr2=0x560bc9e6dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:13:17.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.498+0000 7fb8cdc15640 1 --2- 172.21.15.82:0/2711106686 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560bc9e6d7b0 0x560bc9e6dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:17.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.498+0000 7fb8cdc15640 1 -- 172.21.15.82:0/2711106686 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560bc9e6e980 msgr2=0x560bc9e6ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:13:17.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.498+0000 7fb8cdc15640 1 --2- 172.21.15.82:0/2711106686 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560bc9e6e980 0x560bc9e6ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:17.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.498+0000 7fb8cdc15640 1 -- 172.21.15.82:0/2711106686 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560bc9d99f30 con 0x560bc9e6f340 2024-03-04T09:13:17.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.498+0000 7fb8ccc13640 1 --2- 172.21.15.82:0/2711106686 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560bc9e6e980 0x560bc9e6ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:13:17.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.498+0000 7fb8cdc15640 1 --2- 172.21.15.82:0/2711106686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560bc9e6f340 0x560bc9e75bd0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0012d70 tx=0x7fb8c000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b3c9a2a426a6881 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:17.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.498+0000 7fb8cdc15640 1 --2- 172.21.15.82:0/1579844560 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb8b40a1d80 0x7fb8b40a4240 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb8c000fc30 tx=0x7fb8c001d000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:17.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.498+0000 7fb8b37fe640 1 -- 172.21.15.82:0/2711106686 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c0022070 con 0x560bc9e6f340 2024-03-04T09:13:17.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.498+0000 7fb8b37fe640 1 -- 172.21.15.82:0/2711106686 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fb8c0009d20 con 0x560bc9e6f340 2024-03-04T09:13:17.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.498+0000 7fb8b37fe640 1 -- 172.21.15.82:0/2711106686 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c0005280 con 0x560bc9e6f340 2024-03-04T09:13:17.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.499+0000 7fb8d225c740 1 -- 172.21.15.82:0/2711106686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560bc9e6f340 msgr2=0x560bc9e75bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:17.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.499+0000 7fb8d225c740 1 --2- 172.21.15.82:0/2711106686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560bc9e6f340 0x560bc9e75bd0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0012d70 tx=0x7fb8c000f730 comp rx=0 tx=0).stop 2024-03-04T09:13:17.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.499+0000 7fb8d225c740 1 -- 172.21.15.82:0/2711106686 shutdown_connections 2024-03-04T09:13:17.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.499+0000 7fb8d225c740 1 --2- 172.21.15.82:0/2711106686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560bc9e6f340 0x560bc9e75bd0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:17.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.499+0000 7fb8d225c740 1 --2- 172.21.15.82:0/2711106686 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560bc9e6e980 0x560bc9e6ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:17.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.499+0000 7fb8d225c740 1 --2- 172.21.15.82:0/2711106686 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560bc9e6d7b0 0x560bc9e6dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:17.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.499+0000 7fb8d225c740 1 -- 172.21.15.82:0/2711106686 >> 172.21.15.82:0/2711106686 conn(0x560bc9e68ba0 msgr2=0x560bc9e68fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:17.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.499+0000 7fb8d225c740 1 -- 172.21.15.82:0/2711106686 shutdown_connections 2024-03-04T09:13:17.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.499+0000 7fb8d225c740 1 -- 172.21.15.82:0/2711106686 wait complete. 2024-03-04T09:13:17.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.499+0000 7fb8d225c740 1 -- start start 2024-03-04T09:13:17.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.499+0000 7fb8d225c740 1 Processor -- start 2024-03-04T09:13:17.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.500+0000 7fb8d225c740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560bc9e6d7b0 0x560bc9e77dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:17.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.500+0000 7fb8d225c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560bc9e6e980 0x560bc9e78310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:17.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.500+0000 7fb8d225c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560bc9e6f340 0x560bc9e7f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:17.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.500+0000 7fb8d225c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bc9e762f0 con 0x560bc9e6e980 2024-03-04T09:13:17.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.500+0000 7fb8d225c740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bc9d8eea0 con 0x560bc9e6d7b0 2024-03-04T09:13:17.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.500+0000 7fb8d225c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bc9e76470 con 0x560bc9e6f340 2024-03-04T09:13:17.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.500+0000 7fb8d225c740 10 client.0 _ll_register_callbacks cb 0x560bc9d8e870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-04T09:13:17.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.500+0000 7fb8ccc13640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560bc9e6e980 0x560bc9e78310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:17.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.500+0000 7fb8ccc13640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560bc9e6e980 0x560bc9e78310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51112/0 (socket says 172.21.15.82:51112) 2024-03-04T09:13:17.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.500+0000 7fb8ccc13640 1 -- 172.21.15.82:0/1483699723 learned_addr learned my addr 172.21.15.82:0/1483699723 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:17.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.500+0000 7fb8cd414640 1 --2- 172.21.15.82:0/1483699723 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560bc9e6d7b0 0x560bc9e77dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:17.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.500+0000 7fb8cdc15640 1 --2- 172.21.15.82:0/1483699723 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560bc9e6f340 0x560bc9e7f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:17.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.500+0000 7fb8ccc13640 1 -- 172.21.15.82:0/1483699723 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560bc9e6f340 msgr2=0x560bc9e7f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:13:17.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.500+0000 7fb8ccc13640 1 --2- 172.21.15.82:0/1483699723 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560bc9e6f340 0x560bc9e7f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:17.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.500+0000 7fb8ccc13640 1 -- 172.21.15.82:0/1483699723 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560bc9e6d7b0 msgr2=0x560bc9e77dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:13:17.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.500+0000 7fb8ccc13640 1 --2- 172.21.15.82:0/1483699723 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560bc9e6d7b0 0x560bc9e77dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:17.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.500+0000 7fb8ccc13640 1 -- 172.21.15.82:0/1483699723 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560bc9d8f270 con 0x560bc9e6e980 2024-03-04T09:13:17.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.500+0000 7fb8ccc13640 1 --2- 172.21.15.82:0/1483699723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560bc9e6e980 0x560bc9e78310 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb8b80ed700 tx=0x7fb8b80bc240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4871fe87c6343a93 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:17.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.500+0000 7fb8b0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-04T09:13:17.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.500+0000 7fb8b0ff9640 1 -- 172.21.15.82:0/1483699723 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b80bcfe0 con 0x560bc9e6e980 2024-03-04T09:13:17.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.500+0000 7fb8b0ff9640 1 -- 172.21.15.82:0/1483699723 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8802+0+0 (secure 0 0 0) 0x7fb8b80babe0 con 0x560bc9e6e980 2024-03-04T09:13:17.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.500+0000 7fb8d225c740 1 -- 172.21.15.82:0/1483699723 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560bc9ddfbf0 con 0x560bc9e6e980 2024-03-04T09:13:17.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.501+0000 7fb8b0ff9640 1 -- 172.21.15.82:0/1483699723 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb8b80bc8e0 con 0x560bc9e6e980 2024-03-04T09:13:17.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.501+0000 7fb8d225c740 10 client.14742 fetch_fsmap learned FSMap version 17 2024-03-04T09:13:17.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.501+0000 7fb8d225c740 1 -- 172.21.15.82:0/1483699723 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) v3 -- 0x560bc9ae72d0 con 0x560bc9e6e980 2024-03-04T09:13:17.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.501+0000 7fb8b0ff9640 1 -- 172.21.15.82:0/1483699723 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x560bc9ddfbf0 con 0x560bc9e6e980 2024-03-04T09:13:17.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.501+0000 7fb8b0ff9640 1 -- 172.21.15.82:0/1483699723 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 17) v1 ==== 7922+0+0 (secure 0 0 0) 0x7fb8b80e4a90 con 0x560bc9e6e980 2024-03-04T09:13:17.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.501+0000 7fb8d225c740 10 client.14742 fetch_fsmap finished waiting for FSMap version 17 2024-03-04T09:13:17.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.501+0000 7fb8d225c740 10 client.14742 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-04T09:13:17.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.501+0000 7fb8d225c740 20 client.14742 populate_metadata read hostname 'smithi082' 2024-03-04T09:13:17.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.501+0000 7fb8d225c740 1 --2- 172.21.15.82:0/1483699723 >> [v2:172.21.15.102:6838/35424130,v1:172.21.15.102:6839/35424130] conn(0x560bc9e848d0 0x560bc9e837d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:17.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.501+0000 7fb8d225c740 4 client.14742 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-04T09:13:17.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.501+0000 7fb8d225c740 1 -- 172.21.15.82:0/1483699723 --> [v2:172.21.15.102:6838/35424130,v1:172.21.15.102:6839/35424130] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560bc9dd9f40 con 0x560bc9e848d0 2024-03-04T09:13:17.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.501+0000 7fb8cd414640 1 --2- 172.21.15.82:0/1483699723 >> [v2:172.21.15.102:6838/35424130,v1:172.21.15.102:6839/35424130] conn(0x560bc9e848d0 0x560bc9e837d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:17.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.502+0000 7fb8cd414640 1 --2- 172.21.15.82:0/1483699723 >> [v2:172.21.15.102:6838/35424130,v1:172.21.15.102:6839/35424130] conn(0x560bc9e848d0 0x560bc9e837d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=588221fd2d03ed2a server_cookie=13372b824936b096 in_seq=0 out_seq=0 2024-03-04T09:13:17.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.502+0000 7fb8b0ff9640 10 client.14742 ms_handle_connect on v2:172.21.15.102:6838/35424130 2024-03-04T09:13:17.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.502+0000 7fb8b0ff9640 1 -- 172.21.15.82:0/1483699723 <== mds.0 v2:172.21.15.102:6838/35424130 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x560bc9dd9f40 con 0x560bc9e848d0 2024-03-04T09:13:17.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.502+0000 7fb8b0ff9640 10 client.14742 handle_command_reply: tid=0 2024-03-04T09:13:17.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.502+0000 7fb8d225c740 1 client.14742 shutdown 2024-03-04T09:13:17.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.502+0000 7fb8d225c740 1 -- 172.21.15.82:0/1483699723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560bc9e6e980 msgr2=0x560bc9e78310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:17.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.502+0000 7fb8d225c740 1 --2- 172.21.15.82:0/1483699723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560bc9e6e980 0x560bc9e78310 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb8b80ed700 tx=0x7fb8b80bc240 comp rx=0 tx=0).stop 2024-03-04T09:13:17.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.502+0000 7fb8d225c740 1 -- 172.21.15.82:0/1483699723 shutdown_connections 2024-03-04T09:13:17.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.502+0000 7fb8d225c740 1 --2- 172.21.15.82:0/1483699723 >> [v2:172.21.15.102:6838/35424130,v1:172.21.15.102:6839/35424130] conn(0x560bc9e848d0 0x560bc9e837d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:17.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.502+0000 7fb8d225c740 1 --2- 172.21.15.82:0/1483699723 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560bc9e6f340 0x560bc9e7f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:17.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.502+0000 7fb8b0ff9640 0 client.14742 ms_handle_reset on v2:172.21.15.102:6838/35424130 2024-03-04T09:13:17.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.502+0000 7fb8d225c740 1 --2- 172.21.15.82:0/1483699723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560bc9e6e980 0x560bc9e78310 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:17.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.502+0000 7fb8d225c740 1 --2- 172.21.15.82:0/1483699723 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560bc9e6d7b0 0x560bc9e77dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:17.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.502+0000 7fb8d225c740 1 -- 172.21.15.82:0/1483699723 >> 172.21.15.82:0/1483699723 conn(0x560bc9e68ba0 msgr2=0x560bc9e67da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:17.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.503+0000 7fb8d225c740 1 -- 172.21.15.82:0/1483699723 shutdown_connections 2024-03-04T09:13:17.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.503+0000 7fb8d225c740 1 -- 172.21.15.82:0/1483699723 wait complete. 2024-03-04T09:13:17.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.503+0000 7fb8d225c740 20 client.14742 trim_cache size 0 max 16384 2024-03-04T09:13:17.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.519+0000 7fb8d225c740 1 Processor -- start 2024-03-04T09:13:17.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.519+0000 7fb8d225c740 1 -- start start 2024-03-04T09:13:17.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.519+0000 7fb8d225c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560bc9e6d7b0 0x560bc9e726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:17.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.519+0000 7fb8d225c740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560bc9e6e980 0x560bc9e72be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:17.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.519+0000 7fb8d225c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560bc9e6f340 0x560bc9e7f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:17.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.519+0000 7fb8d225c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bc9e840f0 con 0x560bc9e6f340 2024-03-04T09:13:17.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.519+0000 7fb8d225c740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bc9e84750 con 0x560bc9e6e980 2024-03-04T09:13:17.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.519+0000 7fb8d225c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bc9e84db0 con 0x560bc9e6d7b0 2024-03-04T09:13:17.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.520+0000 7fb8cdc15640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560bc9e6f340 0x560bc9e7f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:17.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.520+0000 7fb8cdc15640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560bc9e6f340 0x560bc9e7f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51122/0 (socket says 172.21.15.82:51122) 2024-03-04T09:13:17.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.520+0000 7fb8cdc15640 1 -- 172.21.15.82:0/1036142037 learned_addr learned my addr 172.21.15.82:0/1036142037 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:17.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.520+0000 7fb8ccc13640 1 --2- 172.21.15.82:0/1036142037 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560bc9e6e980 0x560bc9e72be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:17.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.520+0000 7fb8cd414640 1 --2- 172.21.15.82:0/1036142037 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560bc9e6d7b0 0x560bc9e726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:17.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.520+0000 7fb8cdc15640 1 -- 172.21.15.82:0/1036142037 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560bc9e6d7b0 msgr2=0x560bc9e726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:13:17.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.520+0000 7fb8cdc15640 1 --2- 172.21.15.82:0/1036142037 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560bc9e6d7b0 0x560bc9e726a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:17.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.520+0000 7fb8cdc15640 1 -- 172.21.15.82:0/1036142037 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560bc9e6e980 msgr2=0x560bc9e72be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:13:17.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.520+0000 7fb8cdc15640 1 --2- 172.21.15.82:0/1036142037 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560bc9e6e980 0x560bc9e72be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:17.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.520+0000 7fb8cdc15640 1 -- 172.21.15.82:0/1036142037 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560bc9bb16b0 con 0x560bc9e6f340 2024-03-04T09:13:17.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.520+0000 7fb8ccc13640 1 --2- 172.21.15.82:0/1036142037 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560bc9e6e980 0x560bc9e72be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T09:13:17.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.520+0000 7fb8cd414640 1 --2- 172.21.15.82:0/1036142037 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560bc9e6d7b0 0x560bc9e726a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T09:13:17.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.520+0000 7fb8cdc15640 1 --2- 172.21.15.82:0/1036142037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560bc9e6f340 0x560bc9e7f2a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0009520 tx=0x7fb8c0009620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d830e913856bc862 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:17.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.520+0000 7fb8b2ffd640 1 -- 172.21.15.82:0/1036142037 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c0022070 con 0x560bc9e6f340 2024-03-04T09:13:17.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.520+0000 7fb8b2ffd640 1 -- 172.21.15.82:0/1036142037 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fb8c000fe40 con 0x560bc9e6f340 2024-03-04T09:13:17.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.520+0000 7fb8b2ffd640 1 -- 172.21.15.82:0/1036142037 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c00052a0 con 0x560bc9e6f340 2024-03-04T09:13:17.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.521+0000 7fb8d225c740 1 -- 172.21.15.82:0/1036142037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560bc9e6f340 msgr2=0x560bc9e7f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:17.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.521+0000 7fb8d225c740 1 --2- 172.21.15.82:0/1036142037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560bc9e6f340 0x560bc9e7f2a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0009520 tx=0x7fb8c0009620 comp rx=0 tx=0).stop 2024-03-04T09:13:17.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.521+0000 7fb8d225c740 1 -- 172.21.15.82:0/1036142037 shutdown_connections 2024-03-04T09:13:17.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.521+0000 7fb8d225c740 1 --2- 172.21.15.82:0/1036142037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560bc9e6f340 0x560bc9e7f2a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:17.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.521+0000 7fb8d225c740 1 --2- 172.21.15.82:0/1036142037 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560bc9e6e980 0x560bc9e72be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:17.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.521+0000 7fb8d225c740 1 --2- 172.21.15.82:0/1036142037 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560bc9e6d7b0 0x560bc9e726a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:17.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.521+0000 7fb8d225c740 1 -- 172.21.15.82:0/1036142037 >> 172.21.15.82:0/1036142037 conn(0x560bc9e68ba0 msgr2=0x560bc9e68f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:17.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.521+0000 7fb8d225c740 1 -- 172.21.15.82:0/1036142037 shutdown_connections 2024-03-04T09:13:17.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.521+0000 7fb8d225c740 1 -- 172.21.15.82:0/1036142037 wait complete. 2024-03-04T09:13:17.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.521+0000 7fb8d225c740 1 -- start start 2024-03-04T09:13:17.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.521+0000 7fb8d225c740 1 Processor -- start 2024-03-04T09:13:17.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.521+0000 7fb8d225c740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560bc9e6d7b0 0x560bc9e79bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:17.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.521+0000 7fb8d225c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560bc9e6e980 0x560bc9e7f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:17.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.521+0000 7fb8d225c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560bc9e6f340 0x560bc9e7a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:17.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.521+0000 7fb8d225c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bc9e85a70 con 0x560bc9e6f340 2024-03-04T09:13:17.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.521+0000 7fb8d225c740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bc9e85410 con 0x560bc9e6d7b0 2024-03-04T09:13:17.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.521+0000 7fb8d225c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bc9e860d0 con 0x560bc9e6e980 2024-03-04T09:13:17.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.522+0000 7fb8d225c740 10 client.0 _ll_register_callbacks cb 0x7fb8b80bc420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-04T09:13:17.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.522+0000 7fb8cdc15640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560bc9e6f340 0x560bc9e7a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:17.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.522+0000 7fb8cdc15640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560bc9e6f340 0x560bc9e7a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51128/0 (socket says 172.21.15.82:51128) 2024-03-04T09:13:17.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.522+0000 7fb8cdc15640 1 -- 172.21.15.82:0/4046576145 learned_addr learned my addr 172.21.15.82:0/4046576145 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:17.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.522+0000 7fb8ccc13640 1 --2- 172.21.15.82:0/4046576145 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560bc9e6e980 0x560bc9e7f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:17.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.522+0000 7fb8cd414640 1 --2- 172.21.15.82:0/4046576145 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560bc9e6d7b0 0x560bc9e79bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:17.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.522+0000 7fb8cdc15640 1 -- 172.21.15.82:0/4046576145 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560bc9e6e980 msgr2=0x560bc9e7f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:13:17.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.522+0000 7fb8cdc15640 1 --2- 172.21.15.82:0/4046576145 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560bc9e6e980 0x560bc9e7f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:17.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.522+0000 7fb8cdc15640 1 -- 172.21.15.82:0/4046576145 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560bc9e6d7b0 msgr2=0x560bc9e79bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:13:17.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.522+0000 7fb8cdc15640 1 --2- 172.21.15.82:0/4046576145 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560bc9e6d7b0 0x560bc9e79bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:17.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.522+0000 7fb8cdc15640 1 -- 172.21.15.82:0/4046576145 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560bc9edf930 con 0x560bc9e6f340 2024-03-04T09:13:17.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.522+0000 7fb8cdc15640 1 --2- 172.21.15.82:0/4046576145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560bc9e6f340 0x560bc9e7a130 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0006010 tx=0x7fb8c000fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=609e3eeee7f3e7ca server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:17.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.522+0000 7fb8b0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-04T09:13:17.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.522+0000 7fb8b0ff9640 1 -- 172.21.15.82:0/4046576145 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c0022040 con 0x560bc9e6f340 2024-03-04T09:13:17.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.522+0000 7fb8b0ff9640 1 -- 172.21.15.82:0/4046576145 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8802+0+0 (secure 0 0 0) 0x7fb8c0005000 con 0x560bc9e6f340 2024-03-04T09:13:17.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.522+0000 7fb8d225c740 1 -- 172.21.15.82:0/4046576145 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb8c000fe40 con 0x560bc9e6f340 2024-03-04T09:13:17.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.522+0000 7fb8b0ff9640 1 -- 172.21.15.82:0/4046576145 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb8c0004e10 con 0x560bc9e6f340 2024-03-04T09:13:17.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.522+0000 7fb8d225c740 10 client.14748 fetch_fsmap learned FSMap version 17 2024-03-04T09:13:17.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.522+0000 7fb8d225c740 1 -- 172.21.15.82:0/4046576145 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) v3 -- 0x560bc9ee09e0 con 0x560bc9e6f340 2024-03-04T09:13:17.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.522+0000 7fb8b0ff9640 1 -- 172.21.15.82:0/4046576145 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fb8c000fe40 con 0x560bc9e6f340 2024-03-04T09:13:17.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.523+0000 7fb8b0ff9640 1 -- 172.21.15.82:0/4046576145 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 17) v1 ==== 7922+0+0 (secure 0 0 0) 0x7fb8c00396d0 con 0x560bc9e6f340 2024-03-04T09:13:17.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.523+0000 7fb8d225c740 10 client.14748 fetch_fsmap finished waiting for FSMap version 17 2024-03-04T09:13:17.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.523+0000 7fb8d225c740 10 client.14748 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-04T09:13:17.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.523+0000 7fb8d225c740 20 client.14748 populate_metadata read hostname 'smithi082' 2024-03-04T09:13:17.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.523+0000 7fb8d225c740 1 --2- 172.21.15.82:0/4046576145 >> [v2:172.21.15.102:6838/35424130,v1:172.21.15.102:6839/35424130] conn(0x560bc9ee4920 0x560bc9ee0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:17.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.523+0000 7fb8d225c740 4 client.14748 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-04T09:13:17.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.523+0000 7fb8d225c740 1 -- 172.21.15.82:0/4046576145 --> [v2:172.21.15.102:6838/35424130,v1:172.21.15.102:6839/35424130] -- command(tid 0: {"prefix": "status"}) v1 -- 0x560bc9d589a0 con 0x560bc9ee4920 2024-03-04T09:13:17.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.523+0000 7fb8cd414640 1 --2- 172.21.15.82:0/4046576145 >> [v2:172.21.15.102:6838/35424130,v1:172.21.15.102:6839/35424130] conn(0x560bc9ee4920 0x560bc9ee0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:17.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.523+0000 7fb8b0ff9640 10 client.14748 ms_handle_connect on v2:172.21.15.102:6838/35424130 2024-03-04T09:13:17.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.523+0000 7fb8cd414640 1 --2- 172.21.15.82:0/4046576145 >> [v2:172.21.15.102:6838/35424130,v1:172.21.15.102:6839/35424130] conn(0x560bc9ee4920 0x560bc9ee0bb0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86949d25f3623493 server_cookie=e429d9795e658426 in_seq=0 out_seq=0 2024-03-04T09:13:17.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.523+0000 7fb8b0ff9640 1 -- 172.21.15.82:0/4046576145 <== mds.0 v2:172.21.15.102:6838/35424130 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x560bc9d589a0 con 0x560bc9ee4920 2024-03-04T09:13:17.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.523+0000 7fb8b0ff9640 10 client.14748 handle_command_reply: tid=0 2024-03-04T09:13:17.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.523+0000 7fb8d225c740 1 client.14748 shutdown 2024-03-04T09:13:17.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.523+0000 7fb8d225c740 1 -- 172.21.15.82:0/4046576145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560bc9e6f340 msgr2=0x560bc9e7a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:17.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.523+0000 7fb8d225c740 1 --2- 172.21.15.82:0/4046576145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560bc9e6f340 0x560bc9e7a130 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0006010 tx=0x7fb8c000fce0 comp rx=0 tx=0).stop 2024-03-04T09:13:17.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.523+0000 7fb8d225c740 1 -- 172.21.15.82:0/4046576145 shutdown_connections 2024-03-04T09:13:17.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.523+0000 7fb8d225c740 1 --2- 172.21.15.82:0/4046576145 >> [v2:172.21.15.102:6838/35424130,v1:172.21.15.102:6839/35424130] conn(0x560bc9ee4920 0x560bc9ee0bb0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:17.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.523+0000 7fb8d225c740 1 --2- 172.21.15.82:0/4046576145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560bc9e6f340 0x560bc9e7a130 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:17.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.523+0000 7fb8d225c740 1 --2- 172.21.15.82:0/4046576145 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560bc9e6e980 0x560bc9e7f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:17.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.523+0000 7fb8b0ff9640 0 client.14748 ms_handle_reset on v2:172.21.15.102:6838/35424130 2024-03-04T09:13:17.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.523+0000 7fb8d225c740 1 --2- 172.21.15.82:0/4046576145 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560bc9e6d7b0 0x560bc9e79bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:17.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.523+0000 7fb8d225c740 1 -- 172.21.15.82:0/4046576145 >> 172.21.15.82:0/4046576145 conn(0x560bc9e68ba0 msgr2=0x560bc9e71bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:17.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.524+0000 7fb8d225c740 1 -- 172.21.15.82:0/4046576145 shutdown_connections 2024-03-04T09:13:17.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.524+0000 7fb8d225c740 1 -- 172.21.15.82:0/4046576145 wait complete. 2024-03-04T09:13:17.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.524+0000 7fb8d225c740 20 client.14748 trim_cache size 0 max 16384 2024-03-04T09:13:17.529 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-04T09:13:17.529 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "2e533fc8-da06-11ee-95c6-87774f69a715", 2024-03-04T09:13:17.529 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 0, 2024-03-04T09:13:17.529 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24476, 2024-03-04T09:13:17.530 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-03-04T09:13:17.530 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-03-04T09:13:17.530 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-03-04T09:13:17.530 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 6.7724090270000001, 2024-03-04T09:13:17.530 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 17, 2024-03-04T09:13:17.530 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 90, 2024-03-04T09:13:17.530 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 89, 2024-03-04T09:13:17.530 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 11.97538076 2024-03-04T09:13:17.530 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-04T09:13:17.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.524+0000 7fb8cf678640 1 -- 172.21.15.82:0/1579844560 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb8b40a1d80 msgr2=0x7fb8b40a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:17.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.524+0000 7fb8cf678640 1 --2- 172.21.15.82:0/1579844560 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb8b40a1d80 0x7fb8b40a4240 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb8c000fc30 tx=0x7fb8c001d000 comp rx=0 tx=0).stop 2024-03-04T09:13:17.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.524+0000 7fb8cf678640 1 -- 172.21.15.82:0/1579844560 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8c8100060 msgr2=0x7fb8c8197e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:17.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.524+0000 7fb8cf678640 1 --2- 172.21.15.82:0/1579844560 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8c8100060 0x7fb8c8197e70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8009230 tx=0x7fb8b8004e20 comp rx=0 tx=0).stop 2024-03-04T09:13:17.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.524+0000 7fb8cf678640 1 -- 172.21.15.82:0/1579844560 shutdown_connections 2024-03-04T09:13:17.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.524+0000 7fb8cf678640 1 --2- 172.21.15.82:0/1579844560 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb8b40a1d80 0x7fb8b40a4240 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:17.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.524+0000 7fb8cf678640 1 --2- 172.21.15.82:0/1579844560 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8c8102c30 0x7fb8c819eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:17.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.524+0000 7fb8cf678640 1 --2- 172.21.15.82:0/1579844560 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8c8100060 0x7fb8c8197e70 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:17.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.524+0000 7fb8cf678640 1 --2- 172.21.15.82:0/1579844560 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8c80ff6a0 0x7fb8c8197930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:17.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.524+0000 7fb8cf678640 1 -- 172.21.15.82:0/1579844560 >> 172.21.15.82:0/1579844560 conn(0x7fb8c80fb200 msgr2=0x7fb8c8105d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:17.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.524+0000 7fb8cf678640 1 -- 172.21.15.82:0/1579844560 shutdown_connections 2024-03-04T09:13:17.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:17.524+0000 7fb8cf678640 1 -- 172.21.15.82:0/1579844560 wait complete. 2024-03-04T09:13:17.534 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-04T09:13:17.534 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-03-04T09:13:17.534 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph fs ls 2024-03-04T09:13:17.772 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:13:18.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:17 smithi082 ceph-mon[32880]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-03-04T09:13:18.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:17 smithi082 ceph-mon[32880]: Cluster is now healthy 2024-03-04T09:13:18.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:17 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/3475911288' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:13:18.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:17 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/1680232952' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:13:18.170 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:17 smithi190 ceph-mon[36341]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-03-04T09:13:18.170 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:17 smithi190 ceph-mon[36341]: Cluster is now healthy 2024-03-04T09:13:18.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:17 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/3475911288' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:13:18.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:17 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/1680232952' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:13:18.178 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:17 smithi102 ceph-mon[36220]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-03-04T09:13:18.178 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:17 smithi102 ceph-mon[36220]: Cluster is now healthy 2024-03-04T09:13:18.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:17 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/3475911288' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:13:18.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:17 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/1680232952' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:13:19.158 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:19 smithi082 ceph-mon[32880]: pgmap v293: 129 pgs: 6 creating+peering, 120 active+clean, 3 unknown; 579 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 2 op/s 2024-03-04T09:13:19.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.388+0000 7f056f1c8700 1 -- 172.21.15.82:0/1937501144 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f056810eaf0 msgr2=0x7f0568110ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:19.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.388+0000 7f056f1c8700 1 --2- 172.21.15.82:0/1937501144 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f056810eaf0 0x7f0568110ee0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f056000b0a0 tx=0x7f056000b3b0 comp rx=0 tx=0).stop 2024-03-04T09:13:19.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.388+0000 7f056f1c8700 1 -- 172.21.15.82:0/1937501144 shutdown_connections 2024-03-04T09:13:19.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.388+0000 7f056f1c8700 1 --2- 172.21.15.82:0/1937501144 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f056810eaf0 0x7f0568110ee0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:19.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.388+0000 7f056f1c8700 1 --2- 172.21.15.82:0/1937501144 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05680742f0 0x7f05680746d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:19.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.388+0000 7f056f1c8700 1 --2- 172.21.15.82:0/1937501144 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0568074c10 0x7f056810e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:19.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.388+0000 7f056f1c8700 1 -- 172.21.15.82:0/1937501144 >> 172.21.15.82:0/1937501144 conn(0x7f0568079210 msgr2=0x7f0568079620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:19.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.388+0000 7f056f1c8700 1 -- 172.21.15.82:0/1937501144 shutdown_connections 2024-03-04T09:13:19.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.388+0000 7f056f1c8700 1 -- 172.21.15.82:0/1937501144 wait complete. 2024-03-04T09:13:19.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.389+0000 7f056f1c8700 1 Processor -- start 2024-03-04T09:13:19.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.389+0000 7f056f1c8700 1 -- start start 2024-03-04T09:13:19.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.389+0000 7f056f1c8700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05680742f0 0x7f05681a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:19.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.389+0000 7f056f1c8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0568074c10 0x7f05681a0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:19.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.389+0000 7f056f1c8700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f056810eaf0 0x7f056819a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:19.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.389+0000 7f056f1c8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05681145f0 con 0x7f0568074c10 2024-03-04T09:13:19.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.389+0000 7f056f1c8700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0568114470 con 0x7f056810eaf0 2024-03-04T09:13:19.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.389+0000 7f056f1c8700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0568114770 con 0x7f05680742f0 2024-03-04T09:13:19.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.389+0000 7f0567fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0568074c10 0x7f05681a0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:19.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.389+0000 7f0567fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0568074c10 0x7f05681a0bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51146/0 (socket says 172.21.15.82:51146) 2024-03-04T09:13:19.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.389+0000 7f0567fff700 1 -- 172.21.15.82:0/3552270449 learned_addr learned my addr 172.21.15.82:0/3552270449 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:19.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.389+0000 7f056d765700 1 --2- 172.21.15.82:0/3552270449 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f056810eaf0 0x7f056819a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:19.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.389+0000 7f056cf64700 1 --2- 172.21.15.82:0/3552270449 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05680742f0 0x7f05681a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:19.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.389+0000 7f0567fff700 1 -- 172.21.15.82:0/3552270449 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05680742f0 msgr2=0x7f05681a06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:19.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.389+0000 7f0567fff700 1 --2- 172.21.15.82:0/3552270449 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05680742f0 0x7f05681a06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:19.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.389+0000 7f0567fff700 1 -- 172.21.15.82:0/3552270449 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f056810eaf0 msgr2=0x7f056819a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:19.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.390+0000 7f0567fff700 1 --2- 172.21.15.82:0/3552270449 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f056810eaf0 0x7f056819a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:19.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.390+0000 7f0567fff700 1 -- 172.21.15.82:0/3552270449 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f056819afd0 con 0x7f0568074c10 2024-03-04T09:13:19.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.390+0000 7f056d765700 1 --2- 172.21.15.82:0/3552270449 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f056810eaf0 0x7f056819a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:13:19.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.390+0000 7f0567fff700 1 --2- 172.21.15.82:0/3552270449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0568074c10 0x7f05681a0bf0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f055400eb30 tx=0x7f055400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:19.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.390+0000 7f0565ffb700 1 -- 172.21.15.82:0/3552270449 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055400cbd0 con 0x7f0568074c10 2024-03-04T09:13:19.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.390+0000 7f0565ffb700 1 -- 172.21.15.82:0/3552270449 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f05540044f0 con 0x7f0568074c10 2024-03-04T09:13:19.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.390+0000 7f0565ffb700 1 -- 172.21.15.82:0/3552270449 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0554010430 con 0x7f0568074c10 2024-03-04T09:13:19.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.390+0000 7f056f1c8700 1 -- 172.21.15.82:0/3552270449 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f056819b2c0 con 0x7f0568074c10 2024-03-04T09:13:19.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.390+0000 7f056f1c8700 1 -- 172.21.15.82:0/3552270449 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05681a7580 con 0x7f0568074c10 2024-03-04T09:13:19.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.391+0000 7f056f1c8700 1 -- 172.21.15.82:0/3552270449 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0568068d80 con 0x7f0568074c10 2024-03-04T09:13:19.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.392+0000 7f0565ffb700 1 -- 172.21.15.82:0/3552270449 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f0554003ed0 con 0x7f0568074c10 2024-03-04T09:13:19.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.392+0000 7f0565ffb700 1 --2- 172.21.15.82:0/3552270449 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f05580a1e90 0x7f05580a4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:19.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.393+0000 7f056cf64700 1 --2- 172.21.15.82:0/3552270449 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f05580a1e90 0x7f05580a4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:19.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.393+0000 7f0565ffb700 1 -- 172.21.15.82:0/3552270449 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8802+0+0 (secure 0 0 0) 0x7f05540ce220 con 0x7f0568074c10 2024-03-04T09:13:19.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.393+0000 7f056cf64700 1 --2- 172.21.15.82:0/3552270449 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f05580a1e90 0x7f05580a4350 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f056819b9b0 tx=0x7f055c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:19.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.397+0000 7f0565ffb700 1 -- 172.21.15.82:0/3552270449 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f055409b410 con 0x7f0568074c10 2024-03-04T09:13:19.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:19 smithi190 ceph-mon[36341]: pgmap v293: 129 pgs: 6 creating+peering, 120 active+clean, 3 unknown; 579 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 2 op/s 2024-03-04T09:13:19.428 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:19 smithi102 ceph-mon[36220]: pgmap v293: 129 pgs: 6 creating+peering, 120 active+clean, 3 unknown; 579 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 2 op/s 2024-03-04T09:13:19.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.637+0000 7f056f1c8700 1 -- 172.21.15.82:0/3552270449 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f056819bda0 con 0x7f0568074c10 2024-03-04T09:13:19.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.638+0000 7f0565ffb700 1 -- 172.21.15.82:0/3552270449 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+88 (secure 0 0 0) 0x7f056819bda0 con 0x7f0568074c10 2024-03-04T09:13:19.634 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-03-04T09:13:19.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.640+0000 7f056f1c8700 1 -- 172.21.15.82:0/3552270449 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f05580a1e90 msgr2=0x7f05580a4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:19.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.640+0000 7f056f1c8700 1 --2- 172.21.15.82:0/3552270449 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f05580a1e90 0x7f05580a4350 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f056819b9b0 tx=0x7f055c009260 comp rx=0 tx=0).stop 2024-03-04T09:13:19.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.640+0000 7f056f1c8700 1 -- 172.21.15.82:0/3552270449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0568074c10 msgr2=0x7f05681a0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:19.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.640+0000 7f056f1c8700 1 --2- 172.21.15.82:0/3552270449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0568074c10 0x7f05681a0bf0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f055400eb30 tx=0x7f055400ee40 comp rx=0 tx=0).stop 2024-03-04T09:13:19.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.640+0000 7f056f1c8700 1 -- 172.21.15.82:0/3552270449 shutdown_connections 2024-03-04T09:13:19.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.640+0000 7f056f1c8700 1 --2- 172.21.15.82:0/3552270449 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f05580a1e90 0x7f05580a4350 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:19.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.640+0000 7f056f1c8700 1 --2- 172.21.15.82:0/3552270449 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f056810eaf0 0x7f056819a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:19.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.640+0000 7f056f1c8700 1 --2- 172.21.15.82:0/3552270449 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05680742f0 0x7f05681a06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:19.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.640+0000 7f056f1c8700 1 --2- 172.21.15.82:0/3552270449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0568074c10 0x7f05681a0bf0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:19.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.640+0000 7f056f1c8700 1 -- 172.21.15.82:0/3552270449 >> 172.21.15.82:0/3552270449 conn(0x7f0568079210 msgr2=0x7f05680ff2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:19.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.640+0000 7f056f1c8700 1 -- 172.21.15.82:0/3552270449 shutdown_connections 2024-03-04T09:13:19.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:19.640+0000 7f056f1c8700 1 -- 172.21.15.82:0/3552270449 wait complete. 2024-03-04T09:13:20.255 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:20 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/3552270449' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-03-04T09:13:20.282 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-03-04T09:13:20.282 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-04T09:13:20.282 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi082.front.sepia.ceph.com 2024-03-04T09:13:20.282 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-03-04T09:13:20.282 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-03-04T09:13:20.282 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-03-04T09:13:20.282 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-04T09:13:20.282 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-04T09:13:20.282 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-03-04T09:13:20.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T09:13:20.283 DEBUG:teuthology.orchestra.run.smithi082:> ip addr 2024-03-04T09:13:20.299 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-04T09:13:20.300 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-04T09:13:20.300 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2024-03-04T09:13:20.300 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-03-04T09:13:20.300 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2024-03-04T09:13:20.300 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-03-04T09:13:20.300 INFO:teuthology.orchestra.run.smithi082.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-04T09:13:20.300 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c6 brd ff:ff:ff:ff:ff:ff 2024-03-04T09:13:20.301 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f0 2024-03-04T09:13:20.301 INFO:teuthology.orchestra.run.smithi082.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-04T09:13:20.301 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c7 brd ff:ff:ff:ff:ff:ff 2024-03-04T09:13:20.301 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f1 2024-03-04T09:13:20.301 INFO:teuthology.orchestra.run.smithi082.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-04T09:13:20.301 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:fe brd ff:ff:ff:ff:ff:ff 2024-03-04T09:13:20.301 INFO:teuthology.orchestra.run.smithi082.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-04T09:13:20.301 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:ff brd ff:ff:ff:ff:ff:ff 2024-03-04T09:13:20.301 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.21.15.82/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-04T09:13:20.301 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft 42195sec preferred_lft 42195sec 2024-03-04T09:13:20.301 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2024-03-04T09:13:20.301 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-03-04T09:13:20.302 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-04T09:13:20.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T09:13:20.302 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2024-03-04T09:13:20.303 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-03-04T09:13:20.303 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link add name ceph-brx type bridge 2024-03-04T09:13:20.303 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip addr flush dev ceph-brx 2024-03-04T09:13:20.303 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set ceph-brx up 2024-03-04T09:13:20.303 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-04T09:13:20.303 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-03-04T09:13:20.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:20 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/3552270449' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-03-04T09:13:20.428 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:20 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/3552270449' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-03-04T09:13:20.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T09:13:20.463 DEBUG:teuthology.orchestra.run.smithi082:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-04T09:13:20.489 INFO:teuthology.orchestra.run.smithi082.stdout:1 2024-03-04T09:13:20.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T09:13:20.491 DEBUG:teuthology.orchestra.run.smithi082:> route 2024-03-04T09:13:20.563 INFO:teuthology.orchestra.run.smithi082.stdout:Kernel IP routing table 2024-03-04T09:13:20.563 INFO:teuthology.orchestra.run.smithi082.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-04T09:13:20.563 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-04T09:13:20.563 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-04T09:13:20.563 INFO:teuthology.orchestra.run.smithi082.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-04T09:13:20.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T09:13:20.564 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2024-03-04T09:13:20.564 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-03-04T09:13:20.564 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-04T09:13:20.564 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-04T09:13:20.564 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-04T09:13:20.564 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-03-04T09:13:20.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T09:13:20.823 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-03-04T09:13:20.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T09:13:20.838 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list-id 2024-03-04T09:13:20.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T09:13:20.894 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2024-03-04T09:13:20.895 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-03-04T09:13:20.895 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-04T09:13:20.895 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-03-04T09:13:20.895 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-03-04T09:13:20.976 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-03-04T09:13:20.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T09:13:20.977 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2024-03-04T09:13:20.977 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-03-04T09:13:20.977 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-03-04T09:13:20.977 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-04T09:13:20.977 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-03-04T09:13:20.977 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-03-04T09:13:20.978 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-03-04T09:13:20.978 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-03-04T09:13:21.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T09:13:21.111 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2024-03-04T09:13:21.112 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-03-04T09:13:21.112 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set brx.0 up 2024-03-04T09:13:21.112 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set dev brx.0 master ceph-brx 2024-03-04T09:13:21.112 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-03-04T09:13:21.153 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-03-04T09:13:21.153 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-04T09:13:21.154 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-03-04T09:13:21.213 INFO:teuthology.orchestra.run.smithi082.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-03-04T09:13:21.213 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-04T09:13:21.214 DEBUG:teuthology.orchestra.run.smithi082:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-03-04T09:13:21.268 DEBUG:teuthology.orchestra.run.smithi082:> sudo modprobe fuse 2024-03-04T09:13:21.316 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:21 smithi082 ceph-mon[32880]: pgmap v294: 129 pgs: 129 active+clean; 579 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 1 op/s 2024-03-04T09:13:21.336 DEBUG:teuthology.orchestra.run.smithi082:> cat /proc/self/mounts | awk '{print $2}' 2024-03-04T09:13:21.392 INFO:teuthology.orchestra.run.smithi082.stdout:/proc 2024-03-04T09:13:21.392 INFO:teuthology.orchestra.run.smithi082.stdout:/sys 2024-03-04T09:13:21.392 INFO:teuthology.orchestra.run.smithi082.stdout:/dev 2024-03-04T09:13:21.392 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/security 2024-03-04T09:13:21.392 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/shm 2024-03-04T09:13:21.392 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/pts 2024-03-04T09:13:21.392 INFO:teuthology.orchestra.run.smithi082.stdout:/run 2024-03-04T09:13:21.392 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/cgroup 2024-03-04T09:13:21.393 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/pstore 2024-03-04T09:13:21.393 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/bpf 2024-03-04T09:13:21.393 INFO:teuthology.orchestra.run.smithi082.stdout:/ 2024-03-04T09:13:21.393 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/selinux 2024-03-04T09:13:21.393 INFO:teuthology.orchestra.run.smithi082.stdout:/proc/sys/fs/binfmt_misc 2024-03-04T09:13:21.393 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/mqueue 2024-03-04T09:13:21.393 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/hugepages 2024-03-04T09:13:21.393 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/debug 2024-03-04T09:13:21.393 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/tracing 2024-03-04T09:13:21.393 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-04T09:13:21.393 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/fuse/connections 2024-03-04T09:13:21.393 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-sysctl.service 2024-03-04T09:13:21.393 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/config 2024-03-04T09:13:21.393 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-04T09:13:21.393 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/nfs/rpc_pipefs 2024-03-04T09:13:21.394 INFO:teuthology.orchestra.run.smithi082.stdout:/run/user/1000 2024-03-04T09:13:21.394 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph 2024-03-04T09:13:21.394 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay 2024-03-04T09:13:21.394 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/da0108e0274a2327ce79079bd48b76735c940bb9cfd4df9b40266a721caa8793/merged 2024-03-04T09:13:21.394 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/30fcf765d083a7489da0daf27a3e27bfba29f51e425bd9ca7c77849f4dc652b9/merged 2024-03-04T09:13:21.394 INFO:teuthology.orchestra.run.smithi082.stdout:/run/user/0 2024-03-04T09:13:21.394 INFO:teuthology.orchestra.run.smithi082.stdout:/proc/sys/fs/binfmt_misc 2024-03-04T09:13:21.394 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/f7be2e8cc64a6302de7c1fb624d205384c6cc97a4603eb1e1cfde905997b9dd9/merged 2024-03-04T09:13:21.394 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/b12c5c634cfcdbe1f46d6888c628ffd47c6365791103f8eba2fdba65c118bd26/merged 2024-03-04T09:13:21.394 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/168950f35057454c6e681f62b53b4680dfa38932e5b8c4963d27caeadd34aadd/merged 2024-03-04T09:13:21.394 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/3210b6571f74524d4c0ae2e50ba2ffb24c19e097fd9b95995393553992388887/merged 2024-03-04T09:13:21.394 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/399d87fe5c475bc0e99d88c207618456f76c5a3725cf00d12562b2bb966f1b4c/merged 2024-03-04T09:13:21.394 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/e77e1360832dc3fe58d78fa55e8c2e6321a3fe2a17c3f2314a24d9accc5d1f55/merged 2024-03-04T09:13:21.394 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/bcad1ad7ad348be0dc0017b8e90198ed0a47cc553dd4d1a5cfae474f8b12a17c/merged 2024-03-04T09:13:21.395 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/f06ef84d9d7df151261f6a6b7a0d1fec461c8df2cb247f091b66043698771305/merged 2024-03-04T09:13:21.395 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns 2024-03-04T09:13:21.395 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-04T09:13:21.395 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-04T09:13:21.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T09:13:21.395 DEBUG:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2024-03-04T09:13:21.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:21 smithi190 ceph-mon[36341]: pgmap v294: 129 pgs: 129 active+clean; 579 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 1 op/s 2024-03-04T09:13:21.428 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:21 smithi102 ceph-mon[36220]: pgmap v294: 129 pgs: 129 active+clean; 579 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 1 op/s 2024-03-04T09:13:21.446 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-04T09:13:21.447 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-03-04T09:13:21.489 DEBUG:teuthology.orchestra.run.smithi082:> sudo modprobe fuse 2024-03-04T09:13:21.516 DEBUG:teuthology.orchestra.run.smithi082:> cat /proc/self/mounts | awk '{print $2}' 2024-03-04T09:13:21.572 INFO:teuthology.orchestra.run.smithi082.stdout:/proc 2024-03-04T09:13:21.572 INFO:teuthology.orchestra.run.smithi082.stdout:/sys 2024-03-04T09:13:21.572 INFO:teuthology.orchestra.run.smithi082.stdout:/dev 2024-03-04T09:13:21.572 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/security 2024-03-04T09:13:21.572 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/shm 2024-03-04T09:13:21.572 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/pts 2024-03-04T09:13:21.573 INFO:teuthology.orchestra.run.smithi082.stdout:/run 2024-03-04T09:13:21.573 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/cgroup 2024-03-04T09:13:21.573 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/pstore 2024-03-04T09:13:21.573 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/bpf 2024-03-04T09:13:21.573 INFO:teuthology.orchestra.run.smithi082.stdout:/ 2024-03-04T09:13:21.573 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/selinux 2024-03-04T09:13:21.573 INFO:teuthology.orchestra.run.smithi082.stdout:/proc/sys/fs/binfmt_misc 2024-03-04T09:13:21.573 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/mqueue 2024-03-04T09:13:21.573 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/hugepages 2024-03-04T09:13:21.573 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/debug 2024-03-04T09:13:21.573 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/tracing 2024-03-04T09:13:21.573 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-04T09:13:21.573 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/fuse/connections 2024-03-04T09:13:21.573 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-sysctl.service 2024-03-04T09:13:21.574 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/config 2024-03-04T09:13:21.574 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-04T09:13:21.574 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/nfs/rpc_pipefs 2024-03-04T09:13:21.574 INFO:teuthology.orchestra.run.smithi082.stdout:/run/user/1000 2024-03-04T09:13:21.574 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph 2024-03-04T09:13:21.574 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay 2024-03-04T09:13:21.574 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/da0108e0274a2327ce79079bd48b76735c940bb9cfd4df9b40266a721caa8793/merged 2024-03-04T09:13:21.574 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/30fcf765d083a7489da0daf27a3e27bfba29f51e425bd9ca7c77849f4dc652b9/merged 2024-03-04T09:13:21.574 INFO:teuthology.orchestra.run.smithi082.stdout:/run/user/0 2024-03-04T09:13:21.574 INFO:teuthology.orchestra.run.smithi082.stdout:/proc/sys/fs/binfmt_misc 2024-03-04T09:13:21.574 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/f7be2e8cc64a6302de7c1fb624d205384c6cc97a4603eb1e1cfde905997b9dd9/merged 2024-03-04T09:13:21.574 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/b12c5c634cfcdbe1f46d6888c628ffd47c6365791103f8eba2fdba65c118bd26/merged 2024-03-04T09:13:21.574 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/168950f35057454c6e681f62b53b4680dfa38932e5b8c4963d27caeadd34aadd/merged 2024-03-04T09:13:21.574 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/3210b6571f74524d4c0ae2e50ba2ffb24c19e097fd9b95995393553992388887/merged 2024-03-04T09:13:21.574 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/399d87fe5c475bc0e99d88c207618456f76c5a3725cf00d12562b2bb966f1b4c/merged 2024-03-04T09:13:21.575 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/e77e1360832dc3fe58d78fa55e8c2e6321a3fe2a17c3f2314a24d9accc5d1f55/merged 2024-03-04T09:13:21.575 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/bcad1ad7ad348be0dc0017b8e90198ed0a47cc553dd4d1a5cfae474f8b12a17c/merged 2024-03-04T09:13:21.575 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/f06ef84d9d7df151261f6a6b7a0d1fec461c8df2cb247f091b66043698771305/merged 2024-03-04T09:13:21.575 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns 2024-03-04T09:13:21.575 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-04T09:13:21.575 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-04T09:13:21.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T09:13:21.575 DEBUG:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2024-03-04T09:13:21.586 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi082.stderr:2024-03-04T09:13:21.590+0000 7f243ba36480 -1 init, newargv = 0x5581dc536af0 newargc=15 2024-03-04T09:13:21.586 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi082.stderr:ceph-fuse[76402]: starting ceph client 2024-03-04T09:13:21.592 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi082.stderr:ceph-fuse[76402]: starting fuse 2024-03-04T09:13:21.601 INFO:teuthology.orchestra.run.smithi082.stdout:119 2024-03-04T09:13:21.601 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [119] 2024-03-04T09:13:21.601 DEBUG:teuthology.orchestra.run.smithi082:> sudo stdin-killer -- python3 -c ' 2024-03-04T09:13:21.601 DEBUG:teuthology.orchestra.run.smithi082:> import glob 2024-03-04T09:13:21.601 DEBUG:teuthology.orchestra.run.smithi082:> import re 2024-03-04T09:13:21.601 DEBUG:teuthology.orchestra.run.smithi082:> import os 2024-03-04T09:13:21.601 DEBUG:teuthology.orchestra.run.smithi082:> import subprocess 2024-03-04T09:13:21.601 DEBUG:teuthology.orchestra.run.smithi082:> 2024-03-04T09:13:21.601 DEBUG:teuthology.orchestra.run.smithi082:> def _find_admin_socket(client_name): 2024-03-04T09:13:21.601 DEBUG:teuthology.orchestra.run.smithi082:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-03-04T09:13:21.602 DEBUG:teuthology.orchestra.run.smithi082:> files = glob.glob(asok_path) 2024-03-04T09:13:21.602 DEBUG:teuthology.orchestra.run.smithi082:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-03-04T09:13:21.602 DEBUG:teuthology.orchestra.run.smithi082:> 2024-03-04T09:13:21.602 DEBUG:teuthology.orchestra.run.smithi082:> # Given a non-glob path, it better be there 2024-03-04T09:13:21.602 DEBUG:teuthology.orchestra.run.smithi082:> if "*" not in asok_path: 2024-03-04T09:13:21.602 DEBUG:teuthology.orchestra.run.smithi082:> assert(len(files) == 1) 2024-03-04T09:13:21.602 DEBUG:teuthology.orchestra.run.smithi082:> return files[0] 2024-03-04T09:13:21.602 DEBUG:teuthology.orchestra.run.smithi082:> 2024-03-04T09:13:21.602 DEBUG:teuthology.orchestra.run.smithi082:> for f in files: 2024-03-04T09:13:21.602 DEBUG:teuthology.orchestra.run.smithi082:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-04T09:13:21.602 DEBUG:teuthology.orchestra.run.smithi082:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-04T09:13:21.602 DEBUG:teuthology.orchestra.run.smithi082:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-04T09:13:21.602 DEBUG:teuthology.orchestra.run.smithi082:> contents = proc_f.read() 2024-03-04T09:13:21.602 DEBUG:teuthology.orchestra.run.smithi082:> if mountpoint in contents: 2024-03-04T09:13:21.602 DEBUG:teuthology.orchestra.run.smithi082:> return f 2024-03-04T09:13:21.602 DEBUG:teuthology.orchestra.run.smithi082:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-04T09:13:21.603 DEBUG:teuthology.orchestra.run.smithi082:> 2024-03-04T09:13:21.603 DEBUG:teuthology.orchestra.run.smithi082:> print(_find_admin_socket("client.admin")) 2024-03-04T09:13:21.603 DEBUG:teuthology.orchestra.run.smithi082:> ' 2024-03-04T09:13:21.721 INFO:teuthology.orchestra.run.smithi082.stdout:/var/run/ceph/ceph-client.admin.76402.asok 2024-03-04T09:13:21.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-04T09:13:21.731 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.76402.asok 2024-03-04T09:13:21.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T09:13:21.732 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.76402.asok status 2024-03-04T09:13:21.868 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-04T09:13:21.869 INFO:teuthology.orchestra.run.smithi082.stdout: "metadata": { 2024-03-04T09:13:21.869 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_sha1": "1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd", 2024-03-04T09:13:21.869 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_version": "ceph version 19.0.0-1739-g1bc250c7 (1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd) squid (dev)", 2024-03-04T09:13:21.869 INFO:teuthology.orchestra.run.smithi082.stdout: "entity_id": "admin", 2024-03-04T09:13:21.869 INFO:teuthology.orchestra.run.smithi082.stdout: "hostname": "smithi082", 2024-03-04T09:13:21.869 INFO:teuthology.orchestra.run.smithi082.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-03-04T09:13:21.869 INFO:teuthology.orchestra.run.smithi082.stdout: "pid": "76402", 2024-03-04T09:13:21.869 INFO:teuthology.orchestra.run.smithi082.stdout: "root": "/" 2024-03-04T09:13:21.869 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:13:21.869 INFO:teuthology.orchestra.run.smithi082.stdout: "dentry_count": 0, 2024-03-04T09:13:21.869 INFO:teuthology.orchestra.run.smithi082.stdout: "dentry_pinned_count": 0, 2024-03-04T09:13:21.869 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 14760, 2024-03-04T09:13:21.869 INFO:teuthology.orchestra.run.smithi082.stdout: "inst": { 2024-03-04T09:13:21.870 INFO:teuthology.orchestra.run.smithi082.stdout: "name": { 2024-03-04T09:13:21.870 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "client", 2024-03-04T09:13:21.870 INFO:teuthology.orchestra.run.smithi082.stdout: "num": 14760 2024-03-04T09:13:21.870 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:13:21.870 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": { 2024-03-04T09:13:21.870 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v1", 2024-03-04T09:13:21.870 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "192.168.0.1:0", 2024-03-04T09:13:21.870 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 2290665312 2024-03-04T09:13:21.870 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:13:21.870 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:13:21.870 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": { 2024-03-04T09:13:21.870 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v1", 2024-03-04T09:13:21.870 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "192.168.0.1:0", 2024-03-04T09:13:21.870 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 2290665312 2024-03-04T09:13:21.871 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:13:21.871 INFO:teuthology.orchestra.run.smithi082.stdout: "inst_str": "client.14760 192.168.0.1:0/2290665312", 2024-03-04T09:13:21.871 INFO:teuthology.orchestra.run.smithi082.stdout: "addr_str": "192.168.0.1:0/2290665312", 2024-03-04T09:13:21.871 INFO:teuthology.orchestra.run.smithi082.stdout: "inode_count": 1, 2024-03-04T09:13:21.871 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_epoch": 17, 2024-03-04T09:13:21.871 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_epoch": 90, 2024-03-04T09:13:21.871 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_epoch_barrier": 0, 2024-03-04T09:13:21.871 INFO:teuthology.orchestra.run.smithi082.stdout: "blocklisted": false, 2024-03-04T09:13:21.871 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs" 2024-03-04T09:13:21.871 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-04T09:13:21.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T09:13:21.877 DEBUG:teuthology.orchestra.run.smithi082:> stat --file-system '--printf=%T 2024-03-04T09:13:21.877 DEBUG:teuthology.orchestra.run.smithi082:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-03-04T09:13:21.892 INFO:teuthology.orchestra.run.smithi082.stdout:fuseblk 2024-03-04T09:13:21.892 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-03-04T09:13:21.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T09:13:21.892 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-03-04T09:13:21.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T09:13:21.960 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-03-04T09:13:22.042 INFO:teuthology.orchestra.run.smithi082.stdout:# file: . 2024-03-04T09:13:22.042 INFO:teuthology.orchestra.run.smithi082.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-03-04T09:13:22.042 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:13:22.042 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-03-04T09:13:22.042 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-04T09:13:22.098 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T09:13:22.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.244+0000 7f6a07e46640 1 -- 172.21.15.82:0/3445928939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a00107350 msgr2=0x7f6a001097a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:22.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.244+0000 7f6a07e46640 1 --2- 172.21.15.82:0/3445928939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a00107350 0x7f6a001097a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f69f8009ca0 tx=0x7f69f802c0f0 comp rx=0 tx=0).stop 2024-03-04T09:13:22.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.244+0000 7f6a07e46640 1 -- 172.21.15.82:0/3445928939 shutdown_connections 2024-03-04T09:13:22.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.244+0000 7f6a07e46640 1 --2- 172.21.15.82:0/3445928939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a00107350 0x7f6a001097a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:22.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.244+0000 7f6a07e46640 1 --2- 172.21.15.82:0/3445928939 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a00104a20 0x7f6a00106e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:22.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.244+0000 7f6a07e46640 1 --2- 172.21.15.82:0/3445928939 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a001020f0 0x7f6a001044e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:22.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.244+0000 7f6a07e46640 1 -- 172.21.15.82:0/3445928939 >> 172.21.15.82:0/3445928939 conn(0x7f6a000fbb00 msgr2=0x7f6a000fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:22.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.244+0000 7f6a07e46640 1 -- 172.21.15.82:0/3445928939 shutdown_connections 2024-03-04T09:13:22.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.244+0000 7f6a07e46640 1 -- 172.21.15.82:0/3445928939 wait complete. 2024-03-04T09:13:22.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.245+0000 7f6a07e46640 1 Processor -- start 2024-03-04T09:13:22.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.245+0000 7f6a07e46640 1 -- start start 2024-03-04T09:13:22.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.245+0000 7f6a07e46640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a001020f0 0x7f6a00197880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:22.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.245+0000 7f6a07e46640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a00104a20 0x7f6a00197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:22.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.245+0000 7f6a07e46640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a00107350 0x7f6a0019ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:22.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.245+0000 7f6a07e46640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0010d260 con 0x7f6a001020f0 2024-03-04T09:13:22.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.245+0000 7f6a07e46640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0010d0e0 con 0x7f6a00104a20 2024-03-04T09:13:22.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.245+0000 7f6a07e46640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0010d3e0 con 0x7f6a00107350 2024-03-04T09:13:22.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.245+0000 7f6a05be2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a001020f0 0x7f6a00197880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:22.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.245+0000 7f6a05be2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a001020f0 0x7f6a00197880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51164/0 (socket says 172.21.15.82:51164) 2024-03-04T09:13:22.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.245+0000 7f6a05be2640 1 -- 172.21.15.82:0/4182155765 learned_addr learned my addr 172.21.15.82:0/4182155765 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:22.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.245+0000 7f6a053e1640 1 --2- 172.21.15.82:0/4182155765 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a00104a20 0x7f6a00197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:22.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.245+0000 7f6a063e3640 1 --2- 172.21.15.82:0/4182155765 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a00107350 0x7f6a0019ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:22.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.245+0000 7f6a05be2640 1 -- 172.21.15.82:0/4182155765 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a00107350 msgr2=0x7f6a0019ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:22.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.245+0000 7f6a05be2640 1 --2- 172.21.15.82:0/4182155765 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a00107350 0x7f6a0019ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:22.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.245+0000 7f6a05be2640 1 -- 172.21.15.82:0/4182155765 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a00104a20 msgr2=0x7f6a00197dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:22.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.245+0000 7f6a05be2640 1 --2- 172.21.15.82:0/4182155765 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a00104a20 0x7f6a00197dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:22.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.245+0000 7f6a05be2640 1 -- 172.21.15.82:0/4182155765 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a0019f4a0 con 0x7f6a001020f0 2024-03-04T09:13:22.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.245+0000 7f6a053e1640 1 --2- 172.21.15.82:0/4182155765 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a00104a20 0x7f6a00197dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:13:22.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.246+0000 7f6a05be2640 1 --2- 172.21.15.82:0/4182155765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a001020f0 0x7f6a00197880 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f69fc00d950 tx=0x7f69fc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:22.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.246+0000 7f69f6ffd640 1 -- 172.21.15.82:0/4182155765 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69fc017070 con 0x7f6a001020f0 2024-03-04T09:13:22.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.246+0000 7f69f6ffd640 1 -- 172.21.15.82:0/4182155765 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f69fc009c30 con 0x7f6a001020f0 2024-03-04T09:13:22.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.246+0000 7f6a07e46640 1 -- 172.21.15.82:0/4182155765 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a0019f790 con 0x7f6a001020f0 2024-03-04T09:13:22.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.246+0000 7f69f6ffd640 1 -- 172.21.15.82:0/4182155765 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69fc00f6b0 con 0x7f6a001020f0 2024-03-04T09:13:22.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.246+0000 7f6a07e46640 1 -- 172.21.15.82:0/4182155765 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a0019fce0 con 0x7f6a001020f0 2024-03-04T09:13:22.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.247+0000 7f6a07e46640 1 -- 172.21.15.82:0/4182155765 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a000fd5f0 con 0x7f6a001020f0 2024-03-04T09:13:22.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.248+0000 7f69f6ffd640 1 -- 172.21.15.82:0/4182155765 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f69fc010a50 con 0x7f6a001020f0 2024-03-04T09:13:22.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.248+0000 7f69f6ffd640 1 --2- 172.21.15.82:0/4182155765 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f69ec0a1d80 0x7f69ec0a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:22.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.248+0000 7f6a053e1640 1 --2- 172.21.15.82:0/4182155765 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f69ec0a1d80 0x7f69ec0a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:22.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.248+0000 7f69f6ffd640 1 -- 172.21.15.82:0/4182155765 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8802+0+0 (secure 0 0 0) 0x7f69fc0cdc50 con 0x7f6a001020f0 2024-03-04T09:13:22.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.249+0000 7f6a053e1640 1 --2- 172.21.15.82:0/4182155765 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f69ec0a1d80 0x7f69ec0a4240 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6a00198d90 tx=0x7f69f0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:22.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.253+0000 7f69f6ffd640 1 -- 172.21.15.82:0/4182155765 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f69fc0d3020 con 0x7f6a001020f0 2024-03-04T09:13:22.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.430+0000 7f6a07e46640 1 -- 172.21.15.82:0/4182155765 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a000621d0 con 0x7f6a001020f0 2024-03-04T09:13:22.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.431+0000 7f69f6ffd640 1 -- 172.21.15.82:0/4182155765 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+24092 (secure 0 0 0) 0x7f69fc009de0 con 0x7f6a001020f0 2024-03-04T09:13:22.428 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:13:22.428 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":90,"fsid":"2e533fc8-da06-11ee-95c6-87774f69a715","created":"2024-03-04T09:05:16.488249+0000","modified":"2024-03-04T09:13:15.136817+0000","last_up_change":"2024-03-04T09:12:22.308711+0000","last_in_change":"2024-03-04T09:12:02.548212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T09:08:36.508257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T09:13:07.981726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T09:13:09.289799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-04T09:13:13.008516+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"085b5c4b-ede9-4d0d-b994-50c89d991012","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6803","nonce":709655235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6805","nonce":709655235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6809","nonce":709655235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6807","nonce":709655235}]},"public_addr":"172.21.15.82:6803/709655235","cluster_addr":"172.21.15.82:6805/709655235","heartbeat_back_addr":"172.21.15.82:6809/709655235","heartbeat_front_addr":"172.21.15.82:6807/709655235","state":["exists","up"]},{"osd":1,"uuid":"e4dd7079-333e-4bcf-b3af-11fb082a5af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6801","nonce":270721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6803","nonce":270721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6807","nonce":270721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6805","nonce":270721212}]},"public_addr":"172.21.15.102:6801/270721212","cluster_addr":"172.21.15.102:6803/270721212","heartbeat_back_addr":"172.21.15.102:6807/270721212","heartbeat_front_addr":"172.21.15.102:6805/270721212","state":["exists","up"]},{"osd":2,"uuid":"6fed5fd6-dc82-497f-9d69-c10a5e5802da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6801","nonce":946410459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6803","nonce":946410459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6807","nonce":946410459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6805","nonce":946410459}]},"public_addr":"172.21.15.190:6801/946410459","cluster_addr":"172.21.15.190:6803/946410459","heartbeat_back_addr":"172.21.15.190:6807/946410459","heartbeat_front_addr":"172.21.15.190:6805/946410459","state":["exists","up"]},{"osd":3,"uuid":"91ccbdc3-3da6-4d39-8a89-3a7b7bb4adc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6811","nonce":980870924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6813","nonce":980870924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6817","nonce":980870924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6815","nonce":980870924}]},"public_addr":"172.21.15.82:6811/980870924","cluster_addr":"172.21.15.82:6813/980870924","heartbeat_back_addr":"172.21.15.82:6817/980870924","heartbeat_front_addr":"172.21.15.82:6815/980870924","state":["exists","up"]},{"osd":4,"uuid":"dbb9d486-5daa-4819-bbed-04fc76ca473e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6809","nonce":1229627753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6811","nonce":1229627753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6815","nonce":1229627753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6813","nonce":1229627753}]},"public_addr":"172.21.15.102:6809/1229627753","cluster_addr":"172.21.15.102:6811/1229627753","heartbeat_back_addr":"172.21.15.102:6815/1229627753","heartbeat_front_addr":"172.21.15.102:6813/1229627753","state":["exists","up"]},{"osd":5,"uuid":"6b50127b-df2b-4c95-8e53-9d42b40273fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6809","nonce":2171194148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6811","nonce":2171194148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6815","nonce":2171194148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6813","nonce":2171194148}]},"public_addr":"172.21.15.190:6809/2171194148","cluster_addr":"172.21.15.190:6811/2171194148","heartbeat_back_addr":"172.21.15.190:6815/2171194148","heartbeat_front_addr":"172.21.15.190:6813/2171194148","state":["exists","up"]},{"osd":6,"uuid":"e72bebb0-5939-4210-950a-41c25c23c62f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6819","nonce":454436959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6821","nonce":454436959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6825","nonce":454436959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6823","nonce":454436959}]},"public_addr":"172.21.15.82:6819/454436959","cluster_addr":"172.21.15.82:6821/454436959","heartbeat_back_addr":"172.21.15.82:6825/454436959","heartbeat_front_addr":"172.21.15.82:6823/454436959","state":["exists","up"]},{"osd":7,"uuid":"72f83f97-f496-4503-8284-6a7b8f99a6f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6817","nonce":2745057274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6819","nonce":2745057274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6823","nonce":2745057274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6821","nonce":2745057274}]},"public_addr":"172.21.15.102:6817/2745057274","cluster_addr":"172.21.15.102:6819/2745057274","heartbeat_back_addr":"172.21.15.102:6823/2745057274","heartbeat_front_addr":"172.21.15.102:6821/2745057274","state":["exists","up"]},{"osd":8,"uuid":"92c9109d-6ebb-4c50-9944-28cd7b2f9c0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6817","nonce":1679683516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6819","nonce":1679683516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6823","nonce":1679683516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6821","nonce":1679683516}]},"public_addr":"172.21.15.190:6817/1679683516","cluster_addr":"172.21.15.190:6819/1679683516","heartbeat_back_addr":"172.21.15.190:6823/1679683516","heartbeat_front_addr":"172.21.15.190:6821/1679683516","state":["exists","up"]},{"osd":9,"uuid":"a3cfce03-0148-475d-bf55-b8284ae1cad2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6827","nonce":1777272933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6829","nonce":1777272933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6833","nonce":1777272933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6831","nonce":1777272933}]},"public_addr":"172.21.15.82:6827/1777272933","cluster_addr":"172.21.15.82:6829/1777272933","heartbeat_back_addr":"172.21.15.82:6833/1777272933","heartbeat_front_addr":"172.21.15.82:6831/1777272933","state":["exists","up"]},{"osd":10,"uuid":"db156ccf-4396-43cb-b69a-bb9095b94b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6825","nonce":1012784035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6827","nonce":1012784035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6831","nonce":1012784035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6829","nonce":1012784035}]},"public_addr":"172.21.15.102:6825/1012784035","cluster_addr":"172.21.15.102:6827/1012784035","heartbeat_back_addr":"172.21.15.102:6831/1012784035","heartbeat_front_addr":"172.21.15.102:6829/1012784035","state":["exists","up"]},{"osd":11,"uuid":"b4d52576-f5b4-479f-8ff6-8fdba4635ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6825","nonce":144700355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6827","nonce":144700355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6831","nonce":144700355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6829","nonce":144700355}]},"public_addr":"172.21.15.190:6825/144700355","cluster_addr":"172.21.15.190:6827/144700355","heartbeat_back_addr":"172.21.15.190:6831/144700355","heartbeat_front_addr":"172.21.15.190:6829/144700355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:07:47.007772+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:09.944738+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:33.183567+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:58.302023+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:09:23.042488+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:09:47.616009+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:10:13.122887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:10:38.584530+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:03.473453+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:29.847105+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:55.152195+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:12:20.401765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6800/1901539016":"2024-03-05T09:06:12.169231+0000","172.21.15.82:0/1124105204":"2024-03-05T09:06:12.169231+0000","172.21.15.82:6801/1901539016":"2024-03-05T09:06:12.169231+0000","172.21.15.82:0/735262841":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/2402774828":"2024-03-05T09:05:44.913099+0000","172.21.15.82:6801/3291527077":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/1846720385":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/3757201752":"2024-03-05T09:06:12.169231+0000","172.21.15.82:6800/3291527077":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/984630078":"2024-03-05T09:06:12.169231+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T09:13:22.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.433+0000 7f6a07e46640 1 -- 172.21.15.82:0/4182155765 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f69ec0a1d80 msgr2=0x7f69ec0a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:22.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.433+0000 7f6a07e46640 1 --2- 172.21.15.82:0/4182155765 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f69ec0a1d80 0x7f69ec0a4240 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6a00198d90 tx=0x7f69f0005f90 comp rx=0 tx=0).stop 2024-03-04T09:13:22.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.433+0000 7f6a07e46640 1 -- 172.21.15.82:0/4182155765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a001020f0 msgr2=0x7f6a00197880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:22.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.433+0000 7f6a07e46640 1 --2- 172.21.15.82:0/4182155765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a001020f0 0x7f6a00197880 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f69fc00d950 tx=0x7f69fc00de10 comp rx=0 tx=0).stop 2024-03-04T09:13:22.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.433+0000 7f6a07e46640 1 -- 172.21.15.82:0/4182155765 shutdown_connections 2024-03-04T09:13:22.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.433+0000 7f6a07e46640 1 --2- 172.21.15.82:0/4182155765 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f69ec0a1d80 0x7f69ec0a4240 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:22.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.433+0000 7f6a07e46640 1 --2- 172.21.15.82:0/4182155765 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a00107350 0x7f6a0019ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:22.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.433+0000 7f6a07e46640 1 --2- 172.21.15.82:0/4182155765 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a00104a20 0x7f6a00197dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:22.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.433+0000 7f6a07e46640 1 --2- 172.21.15.82:0/4182155765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a001020f0 0x7f6a00197880 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:22.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.433+0000 7f6a07e46640 1 -- 172.21.15.82:0/4182155765 >> 172.21.15.82:0/4182155765 conn(0x7f6a000fbb00 msgr2=0x7f6a00102a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:22.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.433+0000 7f6a07e46640 1 -- 172.21.15.82:0/4182155765 shutdown_connections 2024-03-04T09:13:22.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.433+0000 7f6a07e46640 1 -- 172.21.15.82:0/4182155765 wait complete. 2024-03-04T09:13:22.441 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T09:08:36.508257+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-04T09:13:07.981726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-04T09:13:09.289799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-04T09:13:13.008516+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-04T09:13:22.442 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-04T09:13:22.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.550+0000 7f3d2792b640 1 -- 172.21.15.82:0/1827085317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d201004d0 msgr2=0x7f3d201008f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:22.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.550+0000 7f3d2792b640 1 --2- 172.21.15.82:0/1827085317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d201004d0 0x7f3d201008f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3d10009900 tx=0x7f3d1002bc30 comp rx=0 tx=0).stop 2024-03-04T09:13:22.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.550+0000 7f3d2792b640 1 -- 172.21.15.82:0/1827085317 shutdown_connections 2024-03-04T09:13:22.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.550+0000 7f3d2792b640 1 --2- 172.21.15.82:0/1827085317 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d20102080 0x7f3d20108910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:22.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.550+0000 7f3d2792b640 1 --2- 172.21.15.82:0/1827085317 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d201016c0 0x7f3d20101b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:22.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.550+0000 7f3d2792b640 1 --2- 172.21.15.82:0/1827085317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d201004d0 0x7f3d201008f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:22.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.550+0000 7f3d2792b640 1 -- 172.21.15.82:0/1827085317 >> 172.21.15.82:0/1827085317 conn(0x7f3d200fba60 msgr2=0x7f3d200fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:22.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.550+0000 7f3d2792b640 1 -- 172.21.15.82:0/1827085317 shutdown_connections 2024-03-04T09:13:22.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.550+0000 7f3d2792b640 1 -- 172.21.15.82:0/1827085317 wait complete. 2024-03-04T09:13:22.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.550+0000 7f3d2792b640 1 Processor -- start 2024-03-04T09:13:22.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.550+0000 7f3d2792b640 1 -- start start 2024-03-04T09:13:22.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.550+0000 7f3d2792b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d201004d0 0x7f3d20069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:22.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.550+0000 7f3d2792b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d201016c0 0x7f3d2019c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:22.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.550+0000 7f3d2792b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d20102080 0x7f3d2019ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:22.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.550+0000 7f3d2792b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2010c130 con 0x7f3d201004d0 2024-03-04T09:13:22.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.550+0000 7f3d2792b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2010bfb0 con 0x7f3d201016c0 2024-03-04T09:13:22.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.550+0000 7f3d2792b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2010c2b0 con 0x7f3d20102080 2024-03-04T09:13:22.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.551+0000 7f3d256c7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d201004d0 0x7f3d20069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:22.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.551+0000 7f3d256c7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d201004d0 0x7f3d20069300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51172/0 (socket says 172.21.15.82:51172) 2024-03-04T09:13:22.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.551+0000 7f3d256c7640 1 -- 172.21.15.82:0/2353572258 learned_addr learned my addr 172.21.15.82:0/2353572258 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:22.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.551+0000 7f3d24ec6640 1 --2- 172.21.15.82:0/2353572258 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d201016c0 0x7f3d2019c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:22.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.551+0000 7f3d25ec8640 1 --2- 172.21.15.82:0/2353572258 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d20102080 0x7f3d2019ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:22.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.551+0000 7f3d256c7640 1 -- 172.21.15.82:0/2353572258 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d20102080 msgr2=0x7f3d2019ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:22.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.551+0000 7f3d256c7640 1 --2- 172.21.15.82:0/2353572258 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d20102080 0x7f3d2019ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:22.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.551+0000 7f3d256c7640 1 -- 172.21.15.82:0/2353572258 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d201016c0 msgr2=0x7f3d2019c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:22.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.551+0000 7f3d256c7640 1 --2- 172.21.15.82:0/2353572258 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d201016c0 0x7f3d2019c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:22.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.551+0000 7f3d256c7640 1 -- 172.21.15.82:0/2353572258 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d2019f4f0 con 0x7f3d201004d0 2024-03-04T09:13:22.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.551+0000 7f3d256c7640 1 --2- 172.21.15.82:0/2353572258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d201004d0 0x7f3d20069300 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3d1002c880 tx=0x7f3d10004e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:22.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.551+0000 7f3d167fc640 1 -- 172.21.15.82:0/2353572258 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d10043020 con 0x7f3d201004d0 2024-03-04T09:13:22.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.551+0000 7f3d167fc640 1 -- 172.21.15.82:0/2353572258 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f3d100054f0 con 0x7f3d201004d0 2024-03-04T09:13:22.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.551+0000 7f3d167fc640 1 -- 172.21.15.82:0/2353572258 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d10003cd0 con 0x7f3d201004d0 2024-03-04T09:13:22.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.551+0000 7f3d2792b640 1 -- 172.21.15.82:0/2353572258 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d2019f780 con 0x7f3d201004d0 2024-03-04T09:13:22.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.551+0000 7f3d2792b640 1 -- 172.21.15.82:0/2353572258 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d2019fcd0 con 0x7f3d201004d0 2024-03-04T09:13:22.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.552+0000 7f3d2792b640 1 -- 172.21.15.82:0/2353572258 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d201077f0 con 0x7f3d201004d0 2024-03-04T09:13:22.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.553+0000 7f3d167fc640 1 -- 172.21.15.82:0/2353572258 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f3d10046020 con 0x7f3d201004d0 2024-03-04T09:13:22.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.554+0000 7f3d167fc640 1 --2- 172.21.15.82:0/2353572258 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f3d0c0a1d80 0x7f3d0c0a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:22.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.554+0000 7f3d24ec6640 1 --2- 172.21.15.82:0/2353572258 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f3d0c0a1d80 0x7f3d0c0a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:22.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.554+0000 7f3d167fc640 1 -- 172.21.15.82:0/2353572258 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8802+0+0 (secure 0 0 0) 0x7f3d100efc90 con 0x7f3d201004d0 2024-03-04T09:13:22.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.554+0000 7f3d24ec6640 1 --2- 172.21.15.82:0/2353572258 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f3d0c0a1d80 0x7f3d0c0a4240 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c0095f0 tx=0x7f3d1c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:22.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.558+0000 7f3d167fc640 1 -- 172.21.15.82:0/2353572258 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f3d1004d070 con 0x7f3d201004d0 2024-03-04T09:13:22.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.730+0000 7f3d2792b640 1 -- 172.21.15.82:0/2353572258 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3d200621d0 con 0x7f3d201004d0 2024-03-04T09:13:22.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.731+0000 7f3d167fc640 1 -- 172.21.15.82:0/2353572258 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3d100bce80 con 0x7f3d201004d0 2024-03-04T09:13:22.727 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-03-04T09:13:22.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.733+0000 7f3d2792b640 1 -- 172.21.15.82:0/2353572258 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f3d0c0a1d80 msgr2=0x7f3d0c0a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:22.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.733+0000 7f3d2792b640 1 --2- 172.21.15.82:0/2353572258 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f3d0c0a1d80 0x7f3d0c0a4240 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c0095f0 tx=0x7f3d1c005f90 comp rx=0 tx=0).stop 2024-03-04T09:13:22.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.733+0000 7f3d2792b640 1 -- 172.21.15.82:0/2353572258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d201004d0 msgr2=0x7f3d20069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:22.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.733+0000 7f3d2792b640 1 --2- 172.21.15.82:0/2353572258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d201004d0 0x7f3d20069300 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3d1002c880 tx=0x7f3d10004e20 comp rx=0 tx=0).stop 2024-03-04T09:13:22.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.733+0000 7f3d2792b640 1 -- 172.21.15.82:0/2353572258 shutdown_connections 2024-03-04T09:13:22.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.733+0000 7f3d2792b640 1 --2- 172.21.15.82:0/2353572258 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f3d0c0a1d80 0x7f3d0c0a4240 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:22.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.733+0000 7f3d2792b640 1 --2- 172.21.15.82:0/2353572258 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d20102080 0x7f3d2019ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:22.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.733+0000 7f3d2792b640 1 --2- 172.21.15.82:0/2353572258 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d201016c0 0x7f3d2019c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:22.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.733+0000 7f3d2792b640 1 --2- 172.21.15.82:0/2353572258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d201004d0 0x7f3d20069300 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:22.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.733+0000 7f3d2792b640 1 -- 172.21.15.82:0/2353572258 >> 172.21.15.82:0/2353572258 conn(0x7f3d200fba60 msgr2=0x7f3d201049c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:22.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.733+0000 7f3d2792b640 1 -- 172.21.15.82:0/2353572258 shutdown_connections 2024-03-04T09:13:22.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.733+0000 7f3d2792b640 1 -- 172.21.15.82:0/2353572258 wait complete. 2024-03-04T09:13:22.740 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-04T09:13:22.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.852+0000 7fee289eb640 1 -- 172.21.15.82:0/708683129 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee241015e0 msgr2=0x7fee24101a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:22.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.852+0000 7fee289eb640 1 --2- 172.21.15.82:0/708683129 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee241015e0 0x7fee24101a00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fee14009860 tx=0x7fee1402bb70 comp rx=0 tx=0).stop 2024-03-04T09:13:22.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.852+0000 7fee289eb640 1 -- 172.21.15.82:0/708683129 shutdown_connections 2024-03-04T09:13:22.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.852+0000 7fee289eb640 1 --2- 172.21.15.82:0/708683129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee24103190 0x7fee24109a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:22.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.852+0000 7fee289eb640 1 --2- 172.21.15.82:0/708683129 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee241027d0 0x7fee24102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:22.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.852+0000 7fee289eb640 1 --2- 172.21.15.82:0/708683129 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee241015e0 0x7fee24101a00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:22.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.852+0000 7fee289eb640 1 -- 172.21.15.82:0/708683129 >> 172.21.15.82:0/708683129 conn(0x7fee240fcb70 msgr2=0x7fee240fef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:22.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.852+0000 7fee289eb640 1 -- 172.21.15.82:0/708683129 shutdown_connections 2024-03-04T09:13:22.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.852+0000 7fee289eb640 1 -- 172.21.15.82:0/708683129 wait complete. 2024-03-04T09:13:22.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.853+0000 7fee289eb640 1 Processor -- start 2024-03-04T09:13:22.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.853+0000 7fee289eb640 1 -- start start 2024-03-04T09:13:22.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.853+0000 7fee289eb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee241015e0 0x7fee24075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:22.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.853+0000 7fee289eb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee241027d0 0x7fee240739c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:22.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.853+0000 7fee289eb640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee24103190 0x7fee24073f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:22.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.853+0000 7fee289eb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2410d1e0 con 0x7fee241015e0 2024-03-04T09:13:22.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.853+0000 7fee289eb640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2410d060 con 0x7fee241027d0 2024-03-04T09:13:22.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.853+0000 7fee289eb640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2410d360 con 0x7fee24103190 2024-03-04T09:13:22.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.853+0000 7fee2259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee241015e0 0x7fee24075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:22.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.853+0000 7fee2259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee241015e0 0x7fee24075380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51190/0 (socket says 172.21.15.82:51190) 2024-03-04T09:13:22.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.853+0000 7fee2259c640 1 -- 172.21.15.82:0/3196738499 learned_addr learned my addr 172.21.15.82:0/3196738499 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:22.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.853+0000 7fee1bfff640 1 --2- 172.21.15.82:0/3196738499 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee241027d0 0x7fee240739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:22.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.853+0000 7fee22d9d640 1 --2- 172.21.15.82:0/3196738499 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee24103190 0x7fee24073f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:22.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.853+0000 7fee2259c640 1 -- 172.21.15.82:0/3196738499 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee24103190 msgr2=0x7fee24073f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:22.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.853+0000 7fee2259c640 1 --2- 172.21.15.82:0/3196738499 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee24103190 0x7fee24073f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:22.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.853+0000 7fee2259c640 1 -- 172.21.15.82:0/3196738499 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee241027d0 msgr2=0x7fee240739c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:22.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.853+0000 7fee2259c640 1 --2- 172.21.15.82:0/3196738499 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee241027d0 0x7fee240739c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:22.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.853+0000 7fee2259c640 1 -- 172.21.15.82:0/3196738499 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee24074790 con 0x7fee241015e0 2024-03-04T09:13:22.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.853+0000 7fee1bfff640 1 --2- 172.21.15.82:0/3196738499 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee241027d0 0x7fee240739c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:13:22.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.853+0000 7fee2259c640 1 --2- 172.21.15.82:0/3196738499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee241015e0 0x7fee24075380 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fee14000c00 tx=0x7fee14004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:22.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.854+0000 7fee1b7fe640 1 -- 172.21.15.82:0/3196738499 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee14042020 con 0x7fee241015e0 2024-03-04T09:13:22.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.854+0000 7fee1b7fe640 1 -- 172.21.15.82:0/3196738499 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fee1403a040 con 0x7fee241015e0 2024-03-04T09:13:22.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.854+0000 7fee289eb640 1 -- 172.21.15.82:0/3196738499 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee241a1a10 con 0x7fee241015e0 2024-03-04T09:13:22.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.854+0000 7fee1b7fe640 1 -- 172.21.15.82:0/3196738499 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee14039070 con 0x7fee241015e0 2024-03-04T09:13:22.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.854+0000 7fee289eb640 1 -- 172.21.15.82:0/3196738499 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee241a1f60 con 0x7fee241015e0 2024-03-04T09:13:22.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.855+0000 7fee289eb640 1 -- 172.21.15.82:0/3196738499 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee24108ac0 con 0x7fee241015e0 2024-03-04T09:13:22.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.856+0000 7fee1b7fe640 1 -- 172.21.15.82:0/3196738499 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7fee14045020 con 0x7fee241015e0 2024-03-04T09:13:22.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.856+0000 7fee1b7fe640 1 --2- 172.21.15.82:0/3196738499 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fee100a1d80 0x7fee100a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:22.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.856+0000 7fee1b7fe640 1 -- 172.21.15.82:0/3196738499 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8802+0+0 (secure 0 0 0) 0x7fee140ef900 con 0x7fee241015e0 2024-03-04T09:13:22.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.856+0000 7fee1bfff640 1 --2- 172.21.15.82:0/3196738499 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fee100a1d80 0x7fee100a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:22.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.857+0000 7fee1bfff640 1 --2- 172.21.15.82:0/3196738499 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fee100a1d80 0x7fee100a4240 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fee240750f0 tx=0x7fee0c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:22.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:22.861+0000 7fee1b7fe640 1 -- 172.21.15.82:0/3196738499 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fee1404c070 con 0x7fee241015e0 2024-03-04T09:13:23.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.035+0000 7fee289eb640 1 -- 172.21.15.82:0/3196738499 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fee240621d0 con 0x7fee241015e0 2024-03-04T09:13:23.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.035+0000 7fee1b7fe640 1 -- 172.21.15.82:0/3196738499 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) v1 ==== 104+0+11 (secure 0 0 0) 0x7fee14005050 con 0x7fee241015e0 2024-03-04T09:13:23.032 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-03-04T09:13:23.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.037+0000 7fee289eb640 1 -- 172.21.15.82:0/3196738499 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fee100a1d80 msgr2=0x7fee100a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:23.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.037+0000 7fee289eb640 1 --2- 172.21.15.82:0/3196738499 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fee100a1d80 0x7fee100a4240 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fee240750f0 tx=0x7fee0c00b410 comp rx=0 tx=0).stop 2024-03-04T09:13:23.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.037+0000 7fee289eb640 1 -- 172.21.15.82:0/3196738499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee241015e0 msgr2=0x7fee24075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:23.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.037+0000 7fee289eb640 1 --2- 172.21.15.82:0/3196738499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee241015e0 0x7fee24075380 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fee14000c00 tx=0x7fee14004270 comp rx=0 tx=0).stop 2024-03-04T09:13:23.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.037+0000 7fee289eb640 1 -- 172.21.15.82:0/3196738499 shutdown_connections 2024-03-04T09:13:23.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.037+0000 7fee289eb640 1 --2- 172.21.15.82:0/3196738499 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fee100a1d80 0x7fee100a4240 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:23.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.037+0000 7fee289eb640 1 --2- 172.21.15.82:0/3196738499 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee24103190 0x7fee24073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:23.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.037+0000 7fee289eb640 1 --2- 172.21.15.82:0/3196738499 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee241027d0 0x7fee240739c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:23.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.037+0000 7fee289eb640 1 --2- 172.21.15.82:0/3196738499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee241015e0 0x7fee24075380 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:23.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.037+0000 7fee289eb640 1 -- 172.21.15.82:0/3196738499 >> 172.21.15.82:0/3196738499 conn(0x7fee240fcb70 msgr2=0x7fee24105c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:23.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.037+0000 7fee289eb640 1 -- 172.21.15.82:0/3196738499 shutdown_connections 2024-03-04T09:13:23.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.037+0000 7fee289eb640 1 -- 172.21.15.82:0/3196738499 wait complete. 2024-03-04T09:13:23.044 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-04T09:13:23.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.153+0000 7f1915fa0640 1 -- 172.21.15.82:0/1181871032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1910101f80 msgr2=0x7f1910108810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:23.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.153+0000 7f1915fa0640 1 --2- 172.21.15.82:0/1181871032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1910101f80 0x7f1910108810 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1908009ca0 tx=0x7f190802c0f0 comp rx=0 tx=0).stop 2024-03-04T09:13:23.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.153+0000 7f1915fa0640 1 -- 172.21.15.82:0/1181871032 shutdown_connections 2024-03-04T09:13:23.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.153+0000 7f1915fa0640 1 --2- 172.21.15.82:0/1181871032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1910101f80 0x7f1910108810 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:23.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.153+0000 7f1915fa0640 1 --2- 172.21.15.82:0/1181871032 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f19101015c0 0x7f1910101a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:23.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.153+0000 7f1915fa0640 1 --2- 172.21.15.82:0/1181871032 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19101003d0 0x7f19101007f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:23.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.153+0000 7f1915fa0640 1 -- 172.21.15.82:0/1181871032 >> 172.21.15.82:0/1181871032 conn(0x7f19100fb980 msgr2=0x7f19100fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:23.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.153+0000 7f1915fa0640 1 -- 172.21.15.82:0/1181871032 shutdown_connections 2024-03-04T09:13:23.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.153+0000 7f1915fa0640 1 -- 172.21.15.82:0/1181871032 wait complete. 2024-03-04T09:13:23.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.153+0000 7f1915fa0640 1 Processor -- start 2024-03-04T09:13:23.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.153+0000 7f1915fa0640 1 -- start start 2024-03-04T09:13:23.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.154+0000 7f1915fa0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19101003d0 0x7f1910197730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:23.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.154+0000 7f1915fa0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19101015c0 0x7f1910197c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:23.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.154+0000 7f1915fa0640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1910101f80 0x7f191019ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:23.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.154+0000 7f1915fa0640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f191010d120 con 0x7f19101003d0 2024-03-04T09:13:23.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.154+0000 7f1915fa0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f191010cfa0 con 0x7f19101015c0 2024-03-04T09:13:23.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.154+0000 7f1915fa0640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f191010d2a0 con 0x7f1910101f80 2024-03-04T09:13:23.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.154+0000 7f1914f9e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19101003d0 0x7f1910197730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:23.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.154+0000 7f1914f9e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19101003d0 0x7f1910197730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51206/0 (socket says 172.21.15.82:51206) 2024-03-04T09:13:23.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.154+0000 7f1914f9e640 1 -- 172.21.15.82:0/2419974691 learned_addr learned my addr 172.21.15.82:0/2419974691 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:23.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.154+0000 7f190ffff640 1 --2- 172.21.15.82:0/2419974691 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19101015c0 0x7f1910197c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:23.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.154+0000 7f1914f9e640 1 -- 172.21.15.82:0/2419974691 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1910101f80 msgr2=0x7f191019ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:23.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.154+0000 7f1914f9e640 1 --2- 172.21.15.82:0/2419974691 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1910101f80 0x7f191019ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:23.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.154+0000 7f1914f9e640 1 -- 172.21.15.82:0/2419974691 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19101015c0 msgr2=0x7f1910197c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:23.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.154+0000 7f1914f9e640 1 --2- 172.21.15.82:0/2419974691 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19101015c0 0x7f1910197c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:23.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.154+0000 7f1914f9e640 1 -- 172.21.15.82:0/2419974691 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f191019f350 con 0x7f19101003d0 2024-03-04T09:13:23.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.154+0000 7f1914f9e640 1 --2- 172.21.15.82:0/2419974691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19101003d0 0x7f1910197730 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f190400e9c0 tx=0x7f190400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:23.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.154+0000 7f190dffb640 1 -- 172.21.15.82:0/2419974691 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190400cde0 con 0x7f19101003d0 2024-03-04T09:13:23.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.154+0000 7f190dffb640 1 -- 172.21.15.82:0/2419974691 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f1904010900 con 0x7f19101003d0 2024-03-04T09:13:23.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.154+0000 7f1915fa0640 1 -- 172.21.15.82:0/2419974691 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f191019f640 con 0x7f19101003d0 2024-03-04T09:13:23.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.154+0000 7f190dffb640 1 -- 172.21.15.82:0/2419974691 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1904018a20 con 0x7f19101003d0 2024-03-04T09:13:23.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.155+0000 7f1915fa0640 1 -- 172.21.15.82:0/2419974691 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f191019fbe0 con 0x7f19101003d0 2024-03-04T09:13:23.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.155+0000 7f1915fa0640 1 -- 172.21.15.82:0/2419974691 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19101076f0 con 0x7f19101003d0 2024-03-04T09:13:23.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.156+0000 7f190dffb640 1 -- 172.21.15.82:0/2419974691 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f190401f020 con 0x7f19101003d0 2024-03-04T09:13:23.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.157+0000 7f190dffb640 1 --2- 172.21.15.82:0/2419974691 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f19000a1e00 0x7f19000a42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:23.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.157+0000 7f190ffff640 1 --2- 172.21.15.82:0/2419974691 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f19000a1e00 0x7f19000a42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:23.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.157+0000 7f190dffb640 1 -- 172.21.15.82:0/2419974691 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8802+0+0 (secure 0 0 0) 0x7f19040ce200 con 0x7f19101003d0 2024-03-04T09:13:23.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.158+0000 7f190ffff640 1 --2- 172.21.15.82:0/2419974691 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f19000a1e00 0x7f19000a42c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1910198c40 tx=0x7f18fc00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:23.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.162+0000 7f190dffb640 1 -- 172.21.15.82:0/2419974691 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f190409b3f0 con 0x7f19101003d0 2024-03-04T09:13:23.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.339+0000 7f1915fa0640 1 -- 172.21.15.82:0/2419974691 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f19100621d0 con 0x7f19101003d0 2024-03-04T09:13:23.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.339+0000 7f190dffb640 1 -- 172.21.15.82:0/2419974691 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) v1 ==== 100+0+11 (secure 0 0 0) 0x7f190409acf0 con 0x7f19101003d0 2024-03-04T09:13:23.336 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2024-03-04T09:13:23.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.341+0000 7f1915fa0640 1 -- 172.21.15.82:0/2419974691 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f19000a1e00 msgr2=0x7f19000a42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:23.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.341+0000 7f1915fa0640 1 --2- 172.21.15.82:0/2419974691 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f19000a1e00 0x7f19000a42c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1910198c40 tx=0x7f18fc00b410 comp rx=0 tx=0).stop 2024-03-04T09:13:23.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.341+0000 7f1915fa0640 1 -- 172.21.15.82:0/2419974691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19101003d0 msgr2=0x7f1910197730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:23.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.341+0000 7f1915fa0640 1 --2- 172.21.15.82:0/2419974691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19101003d0 0x7f1910197730 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f190400e9c0 tx=0x7f190400ee80 comp rx=0 tx=0).stop 2024-03-04T09:13:23.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.341+0000 7f1915fa0640 1 -- 172.21.15.82:0/2419974691 shutdown_connections 2024-03-04T09:13:23.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.341+0000 7f1915fa0640 1 --2- 172.21.15.82:0/2419974691 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f19000a1e00 0x7f19000a42c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:23.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.341+0000 7f1915fa0640 1 --2- 172.21.15.82:0/2419974691 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1910101f80 0x7f191019ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:23.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.341+0000 7f1915fa0640 1 --2- 172.21.15.82:0/2419974691 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19101015c0 0x7f1910197c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:23.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.341+0000 7f1915fa0640 1 --2- 172.21.15.82:0/2419974691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19101003d0 0x7f1910197730 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:23.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.341+0000 7f1915fa0640 1 -- 172.21.15.82:0/2419974691 >> 172.21.15.82:0/2419974691 conn(0x7f19100fb980 msgr2=0x7f19101048c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:23.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.341+0000 7f1915fa0640 1 -- 172.21.15.82:0/2419974691 shutdown_connections 2024-03-04T09:13:23.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.341+0000 7f1915fa0640 1 -- 172.21.15.82:0/2419974691 wait complete. 2024-03-04T09:13:23.348 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-04T09:13:23.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.457+0000 7fbba2b81640 1 -- 172.21.15.82:0/2150560318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb9c1016c0 msgr2=0x7fbb9c101b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:23.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.457+0000 7fbba2b81640 1 --2- 172.21.15.82:0/2150560318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb9c1016c0 0x7fbb9c101b40 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbb88009900 tx=0x7fbb8802bc30 comp rx=0 tx=0).stop 2024-03-04T09:13:23.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.457+0000 7fbba2b81640 1 -- 172.21.15.82:0/2150560318 shutdown_connections 2024-03-04T09:13:23.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.457+0000 7fbba2b81640 1 --2- 172.21.15.82:0/2150560318 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbb9c102080 0x7fbb9c108910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:23.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.457+0000 7fbba2b81640 1 --2- 172.21.15.82:0/2150560318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb9c1016c0 0x7fbb9c101b40 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:23.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.457+0000 7fbba2b81640 1 --2- 172.21.15.82:0/2150560318 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb9c1004d0 0x7fbb9c1008f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:23.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.457+0000 7fbba2b81640 1 -- 172.21.15.82:0/2150560318 >> 172.21.15.82:0/2150560318 conn(0x7fbb9c0fba60 msgr2=0x7fbb9c0fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:23.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.457+0000 7fbba2b81640 1 -- 172.21.15.82:0/2150560318 shutdown_connections 2024-03-04T09:13:23.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.457+0000 7fbba2b81640 1 -- 172.21.15.82:0/2150560318 wait complete. 2024-03-04T09:13:23.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.457+0000 7fbba2b81640 1 Processor -- start 2024-03-04T09:13:23.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.457+0000 7fbba2b81640 1 -- start start 2024-03-04T09:13:23.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.457+0000 7fbba2b81640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbb9c1004d0 0x7fbb9c104410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:23.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.457+0000 7fbba2b81640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb9c1016c0 0x7fbb9c102aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:23.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.457+0000 7fbba2b81640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb9c102080 0x7fbb9c102fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:23.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.457+0000 7fbba2b81640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9c10c130 con 0x7fbb9c1016c0 2024-03-04T09:13:23.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.457+0000 7fbba2b81640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9c10bfb0 con 0x7fbb9c1004d0 2024-03-04T09:13:23.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.457+0000 7fbba2b81640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9c10c2b0 con 0x7fbb9c102080 2024-03-04T09:13:23.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.457+0000 7fbb9bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb9c1016c0 0x7fbb9c102aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:23.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.457+0000 7fbb9bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb9c1016c0 0x7fbb9c102aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51236/0 (socket says 172.21.15.82:51236) 2024-03-04T09:13:23.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.457+0000 7fbb9bfff640 1 -- 172.21.15.82:0/3683851751 learned_addr learned my addr 172.21.15.82:0/3683851751 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:23.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.458+0000 7fbba091d640 1 --2- 172.21.15.82:0/3683851751 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbb9c1004d0 0x7fbb9c104410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:23.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.458+0000 7fbba111e640 1 --2- 172.21.15.82:0/3683851751 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb9c102080 0x7fbb9c102fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:23.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.458+0000 7fbb9bfff640 1 -- 172.21.15.82:0/3683851751 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb9c102080 msgr2=0x7fbb9c102fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:23.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.458+0000 7fbb9bfff640 1 --2- 172.21.15.82:0/3683851751 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb9c102080 0x7fbb9c102fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:23.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.458+0000 7fbb9bfff640 1 -- 172.21.15.82:0/3683851751 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbb9c1004d0 msgr2=0x7fbb9c104410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:23.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.458+0000 7fbb9bfff640 1 --2- 172.21.15.82:0/3683851751 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbb9c1004d0 0x7fbb9c104410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:23.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.458+0000 7fbb9bfff640 1 -- 172.21.15.82:0/3683851751 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb9c1038a0 con 0x7fbb9c1016c0 2024-03-04T09:13:23.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.458+0000 7fbb9bfff640 1 --2- 172.21.15.82:0/3683851751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb9c1016c0 0x7fbb9c102aa0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbb88009230 tx=0x7fbb88005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:23.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.458+0000 7fbb99ffb640 1 -- 172.21.15.82:0/3683851751 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb88043020 con 0x7fbb9c1016c0 2024-03-04T09:13:23.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.458+0000 7fbba2b81640 1 -- 172.21.15.82:0/3683851751 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb9c1a1a10 con 0x7fbb9c1016c0 2024-03-04T09:13:23.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.458+0000 7fbb99ffb640 1 -- 172.21.15.82:0/3683851751 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fbb880054b0 con 0x7fbb9c1016c0 2024-03-04T09:13:23.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.458+0000 7fbb99ffb640 1 -- 172.21.15.82:0/3683851751 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb88003b80 con 0x7fbb9c1016c0 2024-03-04T09:13:23.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.458+0000 7fbba2b81640 1 -- 172.21.15.82:0/3683851751 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb9c1a1f30 con 0x7fbb9c1016c0 2024-03-04T09:13:23.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.459+0000 7fbba2b81640 1 -- 172.21.15.82:0/3683851751 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb9c1a2100 con 0x7fbb9c1016c0 2024-03-04T09:13:23.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.460+0000 7fbb99ffb640 1 -- 172.21.15.82:0/3683851751 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7fbb88046020 con 0x7fbb9c1016c0 2024-03-04T09:13:23.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.461+0000 7fbb99ffb640 1 --2- 172.21.15.82:0/3683851751 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fbb8c0a1d80 0x7fbb8c0a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:23.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.461+0000 7fbb99ffb640 1 -- 172.21.15.82:0/3683851751 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8802+0+0 (secure 0 0 0) 0x7fbb880f0420 con 0x7fbb9c1016c0 2024-03-04T09:13:23.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.461+0000 7fbba091d640 1 --2- 172.21.15.82:0/3683851751 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fbb8c0a1d80 0x7fbb8c0a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:23.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.461+0000 7fbba091d640 1 --2- 172.21.15.82:0/3683851751 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fbb8c0a1d80 0x7fbb8c0a4240 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c101520 tx=0x7fbb90005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:23.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.464+0000 7fbb99ffb640 1 -- 172.21.15.82:0/3683851751 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fbb8804d070 con 0x7fbb9c1016c0 2024-03-04T09:13:23.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:23 smithi082 ceph-mon[32880]: pgmap v295: 129 pgs: 129 active+clean; 579 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 1 op/s 2024-03-04T09:13:23.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:23 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/4182155765' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:13:23.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:23 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/2353572258' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-04T09:13:23.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:23 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/3196738499' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-04T09:13:23.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.637+0000 7fbba2b81640 1 -- 172.21.15.82:0/3683851751 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fbb9c1a22d0 con 0x7fbb9c1016c0 2024-03-04T09:13:23.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.637+0000 7fbb99ffb640 1 -- 172.21.15.82:0/3683851751 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v90) v1 ==== 103+0+11 (secure 0 0 0) 0x7fbb880bd610 con 0x7fbb9c1016c0 2024-03-04T09:13:23.634 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-03-04T09:13:23.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.640+0000 7fbba2b81640 1 -- 172.21.15.82:0/3683851751 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fbb8c0a1d80 msgr2=0x7fbb8c0a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:23.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.640+0000 7fbba2b81640 1 --2- 172.21.15.82:0/3683851751 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fbb8c0a1d80 0x7fbb8c0a4240 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c101520 tx=0x7fbb90005f90 comp rx=0 tx=0).stop 2024-03-04T09:13:23.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.640+0000 7fbba2b81640 1 -- 172.21.15.82:0/3683851751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb9c1016c0 msgr2=0x7fbb9c102aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:23.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.640+0000 7fbba2b81640 1 --2- 172.21.15.82:0/3683851751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb9c1016c0 0x7fbb9c102aa0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbb88009230 tx=0x7fbb88005dd0 comp rx=0 tx=0).stop 2024-03-04T09:13:23.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.640+0000 7fbba2b81640 1 -- 172.21.15.82:0/3683851751 shutdown_connections 2024-03-04T09:13:23.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.640+0000 7fbba2b81640 1 --2- 172.21.15.82:0/3683851751 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fbb8c0a1d80 0x7fbb8c0a4240 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:23.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.640+0000 7fbba2b81640 1 --2- 172.21.15.82:0/3683851751 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb9c102080 0x7fbb9c102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:23.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.640+0000 7fbba2b81640 1 --2- 172.21.15.82:0/3683851751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb9c1016c0 0x7fbb9c102aa0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:23.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.640+0000 7fbba2b81640 1 --2- 172.21.15.82:0/3683851751 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbb9c1004d0 0x7fbb9c104410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:23.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.640+0000 7fbba2b81640 1 -- 172.21.15.82:0/3683851751 >> 172.21.15.82:0/3683851751 conn(0x7fbb9c0fba60 msgr2=0x7fbb9c0fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:23.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.640+0000 7fbba2b81640 1 -- 172.21.15.82:0/3683851751 shutdown_connections 2024-03-04T09:13:23.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.640+0000 7fbba2b81640 1 -- 172.21.15.82:0/3683851751 wait complete. 2024-03-04T09:13:23.647 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-04T09:13:23.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:23 smithi190 ceph-mon[36341]: pgmap v295: 129 pgs: 129 active+clean; 579 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 1 op/s 2024-03-04T09:13:23.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:23 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/4182155765' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:13:23.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:23 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/2353572258' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-04T09:13:23.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:23 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/3196738499' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-04T09:13:23.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:23 smithi102 ceph-mon[36220]: pgmap v295: 129 pgs: 129 active+clean; 579 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 1 op/s 2024-03-04T09:13:23.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:23 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/4182155765' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:13:23.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:23 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/2353572258' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-04T09:13:23.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:23 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/3196738499' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-04T09:13:23.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.754+0000 7f46b17c9640 1 -- 172.21.15.82:0/1854472316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46ac1004f0 msgr2=0x7f46ac100910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:23.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.754+0000 7f46b17c9640 1 --2- 172.21.15.82:0/1854472316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46ac1004f0 0x7f46ac100910 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f469c009900 tx=0x7f469c02bc30 comp rx=0 tx=0).stop 2024-03-04T09:13:23.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.754+0000 7f46b17c9640 1 -- 172.21.15.82:0/1854472316 shutdown_connections 2024-03-04T09:13:23.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.754+0000 7f46b17c9640 1 --2- 172.21.15.82:0/1854472316 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46ac1020a0 0x7f46ac108930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:23.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.754+0000 7f46b17c9640 1 --2- 172.21.15.82:0/1854472316 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f46ac1016e0 0x7f46ac101b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:23.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.754+0000 7f46b17c9640 1 --2- 172.21.15.82:0/1854472316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46ac1004f0 0x7f46ac100910 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:23.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.754+0000 7f46b17c9640 1 -- 172.21.15.82:0/1854472316 >> 172.21.15.82:0/1854472316 conn(0x7f46ac0fba80 msgr2=0x7f46ac0fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:23.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.754+0000 7f46b17c9640 1 -- 172.21.15.82:0/1854472316 shutdown_connections 2024-03-04T09:13:23.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.754+0000 7f46b17c9640 1 -- 172.21.15.82:0/1854472316 wait complete. 2024-03-04T09:13:23.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.755+0000 7f46b17c9640 1 Processor -- start 2024-03-04T09:13:23.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.755+0000 7f46b17c9640 1 -- start start 2024-03-04T09:13:23.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.755+0000 7f46b17c9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46ac1004f0 0x7f46ac06a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:23.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.755+0000 7f46b17c9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46ac1016e0 0x7f46ac19c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:23.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.755+0000 7f46b17c9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f46ac1020a0 0x7f46ac19ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:23.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.755+0000 7f46b17c9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac10c1b0 con 0x7f46ac1004f0 2024-03-04T09:13:23.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.755+0000 7f46b17c9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac10c030 con 0x7f46ac1016e0 2024-03-04T09:13:23.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.755+0000 7f46b17c9640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac10c330 con 0x7f46ac1020a0 2024-03-04T09:13:23.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.755+0000 7f46aaffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46ac1004f0 0x7f46ac06a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:23.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.755+0000 7f46aaffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46ac1004f0 0x7f46ac06a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51244/0 (socket says 172.21.15.82:51244) 2024-03-04T09:13:23.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.755+0000 7f46aaffd640 1 -- 172.21.15.82:0/1119463746 learned_addr learned my addr 172.21.15.82:0/1119463746 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:23.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.755+0000 7f46a3fff640 1 --2- 172.21.15.82:0/1119463746 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46ac1016e0 0x7f46ac19c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:23.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.755+0000 7f46aaffd640 1 -- 172.21.15.82:0/1119463746 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f46ac1020a0 msgr2=0x7f46ac19ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:23.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.755+0000 7f46aaffd640 1 --2- 172.21.15.82:0/1119463746 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f46ac1020a0 0x7f46ac19ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:23.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.755+0000 7f46aaffd640 1 -- 172.21.15.82:0/1119463746 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46ac1016e0 msgr2=0x7f46ac19c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:23.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.755+0000 7f46aaffd640 1 --2- 172.21.15.82:0/1119463746 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46ac1016e0 0x7f46ac19c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:23.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.755+0000 7f46aaffd640 1 -- 172.21.15.82:0/1119463746 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ac19f5d0 con 0x7f46ac1004f0 2024-03-04T09:13:23.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.755+0000 7f46aaffd640 1 --2- 172.21.15.82:0/1119463746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46ac1004f0 0x7f46ac06a770 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f469c005ab0 tx=0x7f469c004e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:23.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.755+0000 7f46a8ff9640 1 -- 172.21.15.82:0/1119463746 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469c043020 con 0x7f46ac1004f0 2024-03-04T09:13:23.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.755+0000 7f46b17c9640 1 -- 172.21.15.82:0/1119463746 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46ac19f860 con 0x7f46ac1004f0 2024-03-04T09:13:23.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.755+0000 7f46a8ff9640 1 -- 172.21.15.82:0/1119463746 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f469c0054f0 con 0x7f46ac1004f0 2024-03-04T09:13:23.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.755+0000 7f46a8ff9640 1 -- 172.21.15.82:0/1119463746 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469c003d10 con 0x7f46ac1004f0 2024-03-04T09:13:23.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.756+0000 7f46b17c9640 1 -- 172.21.15.82:0/1119463746 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46ac19fe80 con 0x7f46ac1004f0 2024-03-04T09:13:23.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.757+0000 7f46b17c9640 1 -- 172.21.15.82:0/1119463746 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46ac107880 con 0x7f46ac1004f0 2024-03-04T09:13:23.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.758+0000 7f46a8ff9640 1 -- 172.21.15.82:0/1119463746 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f469c046020 con 0x7f46ac1004f0 2024-03-04T09:13:23.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.758+0000 7f46a8ff9640 1 --2- 172.21.15.82:0/1119463746 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f46980a1d80 0x7f46980a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:23.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.758+0000 7f46a3fff640 1 --2- 172.21.15.82:0/1119463746 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f46980a1d80 0x7f46980a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:23.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.758+0000 7f46a8ff9640 1 -- 172.21.15.82:0/1119463746 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8802+0+0 (secure 0 0 0) 0x7f469c0f04e0 con 0x7f46ac1004f0 2024-03-04T09:13:23.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.759+0000 7f46a3fff640 1 --2- 172.21.15.82:0/1119463746 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f46980a1d80 0x7f46980a4240 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f46ac06a4e0 tx=0x7f469400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:23.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.762+0000 7f46a8ff9640 1 -- 172.21.15.82:0/1119463746 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f469c04d070 con 0x7f46ac1004f0 2024-03-04T09:13:23.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.949+0000 7f46b17c9640 1 -- 172.21.15.82:0/1119463746 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f46ac0621d0 con 0x7f46ac1004f0 2024-03-04T09:13:23.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.949+0000 7f46a8ff9640 1 -- 172.21.15.82:0/1119463746 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v90) v1 ==== 81+0+590 (secure 0 0 0) 0x7f469c0bd6d0 con 0x7f46ac1004f0 2024-03-04T09:13:23.946 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/1901539016 2024-03-05T09:06:12.169231+0000 2024-03-04T09:13:23.946 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1124105204 2024-03-05T09:06:12.169231+0000 2024-03-04T09:13:23.946 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/1901539016 2024-03-05T09:06:12.169231+0000 2024-03-04T09:13:23.946 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/735262841 2024-03-05T09:05:44.913099+0000 2024-03-04T09:13:23.947 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/2402774828 2024-03-05T09:05:44.913099+0000 2024-03-04T09:13:23.947 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/3291527077 2024-03-05T09:05:44.913099+0000 2024-03-04T09:13:23.947 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1846720385 2024-03-05T09:05:44.913099+0000 2024-03-04T09:13:23.947 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3757201752 2024-03-05T09:06:12.169231+0000 2024-03-04T09:13:23.947 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/3291527077 2024-03-05T09:05:44.913099+0000 2024-03-04T09:13:23.947 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/984630078 2024-03-05T09:06:12.169231+0000 2024-03-04T09:13:23.947 INFO:teuthology.orchestra.run.smithi082.stderr:listed 10 entries 2024-03-04T09:13:23.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.952+0000 7f46b17c9640 1 -- 172.21.15.82:0/1119463746 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f46980a1d80 msgr2=0x7f46980a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:23.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.952+0000 7f46b17c9640 1 --2- 172.21.15.82:0/1119463746 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f46980a1d80 0x7f46980a4240 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f46ac06a4e0 tx=0x7f469400b390 comp rx=0 tx=0).stop 2024-03-04T09:13:23.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.952+0000 7f46b17c9640 1 -- 172.21.15.82:0/1119463746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46ac1004f0 msgr2=0x7f46ac06a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:23.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.952+0000 7f46b17c9640 1 --2- 172.21.15.82:0/1119463746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46ac1004f0 0x7f46ac06a770 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f469c005ab0 tx=0x7f469c004e90 comp rx=0 tx=0).stop 2024-03-04T09:13:23.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.952+0000 7f46b17c9640 1 -- 172.21.15.82:0/1119463746 shutdown_connections 2024-03-04T09:13:23.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.952+0000 7f46b17c9640 1 --2- 172.21.15.82:0/1119463746 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f46980a1d80 0x7f46980a4240 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:23.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.952+0000 7f46b17c9640 1 --2- 172.21.15.82:0/1119463746 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f46ac1020a0 0x7f46ac19ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:23.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.952+0000 7f46b17c9640 1 --2- 172.21.15.82:0/1119463746 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46ac1016e0 0x7f46ac19c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:23.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.952+0000 7f46b17c9640 1 --2- 172.21.15.82:0/1119463746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46ac1004f0 0x7f46ac06a770 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:23.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.952+0000 7f46b17c9640 1 -- 172.21.15.82:0/1119463746 >> 172.21.15.82:0/1119463746 conn(0x7f46ac0fba80 msgr2=0x7f46ac104a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:23.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.952+0000 7f46b17c9640 1 -- 172.21.15.82:0/1119463746 shutdown_connections 2024-03-04T09:13:23.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:23.952+0000 7f46b17c9640 1 -- 172.21.15.82:0/1119463746 wait complete. 2024-03-04T09:13:23.959 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-03-04T09:13:23.959 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-04T09:13:23.975 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T09:13:24.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.119+0000 7ff8b942a640 1 -- 172.21.15.82:0/3997457880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8b40ff690 msgr2=0x7ff8b40ffb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:24.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.119+0000 7ff8b942a640 1 --2- 172.21.15.82:0/3997457880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8b40ff690 0x7ff8b40ffb10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff8a8009900 tx=0x7ff8a802bc30 comp rx=0 tx=0).stop 2024-03-04T09:13:24.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.119+0000 7ff8b942a640 1 -- 172.21.15.82:0/3997457880 shutdown_connections 2024-03-04T09:13:24.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.119+0000 7ff8b942a640 1 --2- 172.21.15.82:0/3997457880 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8b4100050 0x7ff8b4109c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:24.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.119+0000 7ff8b942a640 1 --2- 172.21.15.82:0/3997457880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8b40ff690 0x7ff8b40ffb10 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:24.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.119+0000 7ff8b942a640 1 --2- 172.21.15.82:0/3997457880 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff8b4102c20 0x7ff8b4103040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:24.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.119+0000 7ff8b942a640 1 -- 172.21.15.82:0/3997457880 >> 172.21.15.82:0/3997457880 conn(0x7ff8b40fb210 msgr2=0x7ff8b40fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:24.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.120+0000 7ff8b942a640 1 -- 172.21.15.82:0/3997457880 shutdown_connections 2024-03-04T09:13:24.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.120+0000 7ff8b942a640 1 -- 172.21.15.82:0/3997457880 wait complete. 2024-03-04T09:13:24.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.120+0000 7ff8b942a640 1 Processor -- start 2024-03-04T09:13:24.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.120+0000 7ff8b942a640 1 -- start start 2024-03-04T09:13:24.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.120+0000 7ff8b942a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8b40ff690 0x7ff8b4197910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:24.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.120+0000 7ff8b942a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8b4100050 0x7ff8b4197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:24.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.120+0000 7ff8b942a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff8b4102c20 0x7ff8b419eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:24.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.120+0000 7ff8b942a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b410d2d0 con 0x7ff8b40ff690 2024-03-04T09:13:24.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.120+0000 7ff8b942a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b410d150 con 0x7ff8b4100050 2024-03-04T09:13:24.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.120+0000 7ff8b942a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b410d450 con 0x7ff8b4102c20 2024-03-04T09:13:24.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.120+0000 7ff8b2ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8b40ff690 0x7ff8b4197910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:24.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.121+0000 7ff8b2ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8b40ff690 0x7ff8b4197910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51270/0 (socket says 172.21.15.82:51270) 2024-03-04T09:13:24.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.121+0000 7ff8b2ffd640 1 -- 172.21.15.82:0/668319686 learned_addr learned my addr 172.21.15.82:0/668319686 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:24.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.121+0000 7ff8b27fc640 1 --2- 172.21.15.82:0/668319686 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8b4100050 0x7ff8b4197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:24.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.121+0000 7ff8b37fe640 1 --2- 172.21.15.82:0/668319686 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff8b4102c20 0x7ff8b419eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:24.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.121+0000 7ff8b2ffd640 1 -- 172.21.15.82:0/668319686 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff8b4102c20 msgr2=0x7ff8b419eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:24.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.121+0000 7ff8b2ffd640 1 --2- 172.21.15.82:0/668319686 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff8b4102c20 0x7ff8b419eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:24.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.121+0000 7ff8b2ffd640 1 -- 172.21.15.82:0/668319686 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8b4100050 msgr2=0x7ff8b4197e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:24.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.121+0000 7ff8b2ffd640 1 --2- 172.21.15.82:0/668319686 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8b4100050 0x7ff8b4197e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:24.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.121+0000 7ff8b2ffd640 1 -- 172.21.15.82:0/668319686 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b419f530 con 0x7ff8b40ff690 2024-03-04T09:13:24.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.121+0000 7ff8b2ffd640 1 --2- 172.21.15.82:0/668319686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8b40ff690 0x7ff8b4197910 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac00ebc0 tx=0x7ff8ac00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:24.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.121+0000 7ff89bfff640 1 -- 172.21.15.82:0/668319686 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac003b70 con 0x7ff8b40ff690 2024-03-04T09:13:24.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.121+0000 7ff89bfff640 1 -- 172.21.15.82:0/668319686 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7ff8ac003d10 con 0x7ff8b40ff690 2024-03-04T09:13:24.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.121+0000 7ff8b942a640 1 -- 172.21.15.82:0/668319686 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8b419f820 con 0x7ff8b40ff690 2024-03-04T09:13:24.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.121+0000 7ff89bfff640 1 -- 172.21.15.82:0/668319686 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac019880 con 0x7ff8b40ff690 2024-03-04T09:13:24.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.121+0000 7ff8b942a640 1 -- 172.21.15.82:0/668319686 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8b419fd40 con 0x7ff8b40ff690 2024-03-04T09:13:24.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.122+0000 7ff8b942a640 1 -- 172.21.15.82:0/668319686 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8b4108b00 con 0x7ff8b40ff690 2024-03-04T09:13:24.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.123+0000 7ff89bfff640 1 -- 172.21.15.82:0/668319686 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7ff8ac019a20 con 0x7ff8b40ff690 2024-03-04T09:13:24.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.124+0000 7ff89bfff640 1 --2- 172.21.15.82:0/668319686 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff89c0a1d80 0x7ff89c0a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:24.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.124+0000 7ff89bfff640 1 -- 172.21.15.82:0/668319686 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8802+0+0 (secure 0 0 0) 0x7ff8ac0ce900 con 0x7ff8b40ff690 2024-03-04T09:13:24.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.124+0000 7ff8b27fc640 1 --2- 172.21.15.82:0/668319686 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff89c0a1d80 0x7ff89c0a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:24.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.124+0000 7ff8b27fc640 1 --2- 172.21.15.82:0/668319686 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff89c0a1d80 0x7ff89c0a4240 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff8a8005ab0 tx=0x7ff8a8005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:24.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.128+0000 7ff89bfff640 1 -- 172.21.15.82:0/668319686 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7ff8ac09baf0 con 0x7ff8b40ff690 2024-03-04T09:13:24.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.302+0000 7ff8b942a640 1 -- 172.21.15.82:0/668319686 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8b4062200 con 0x7ff8b40ff690 2024-03-04T09:13:24.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.303+0000 7ff89bfff640 1 -- 172.21.15.82:0/668319686 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+24092 (secure 0 0 0) 0x7ff8ac09b3f0 con 0x7ff8b40ff690 2024-03-04T09:13:24.300 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:13:24.300 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":90,"fsid":"2e533fc8-da06-11ee-95c6-87774f69a715","created":"2024-03-04T09:05:16.488249+0000","modified":"2024-03-04T09:13:15.136817+0000","last_up_change":"2024-03-04T09:12:22.308711+0000","last_in_change":"2024-03-04T09:12:02.548212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T09:08:36.508257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T09:13:07.981726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T09:13:09.289799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-04T09:13:13.008516+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"085b5c4b-ede9-4d0d-b994-50c89d991012","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6803","nonce":709655235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6805","nonce":709655235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6809","nonce":709655235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6807","nonce":709655235}]},"public_addr":"172.21.15.82:6803/709655235","cluster_addr":"172.21.15.82:6805/709655235","heartbeat_back_addr":"172.21.15.82:6809/709655235","heartbeat_front_addr":"172.21.15.82:6807/709655235","state":["exists","up"]},{"osd":1,"uuid":"e4dd7079-333e-4bcf-b3af-11fb082a5af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6801","nonce":270721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6803","nonce":270721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6807","nonce":270721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6805","nonce":270721212}]},"public_addr":"172.21.15.102:6801/270721212","cluster_addr":"172.21.15.102:6803/270721212","heartbeat_back_addr":"172.21.15.102:6807/270721212","heartbeat_front_addr":"172.21.15.102:6805/270721212","state":["exists","up"]},{"osd":2,"uuid":"6fed5fd6-dc82-497f-9d69-c10a5e5802da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6801","nonce":946410459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6803","nonce":946410459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6807","nonce":946410459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6805","nonce":946410459}]},"public_addr":"172.21.15.190:6801/946410459","cluster_addr":"172.21.15.190:6803/946410459","heartbeat_back_addr":"172.21.15.190:6807/946410459","heartbeat_front_addr":"172.21.15.190:6805/946410459","state":["exists","up"]},{"osd":3,"uuid":"91ccbdc3-3da6-4d39-8a89-3a7b7bb4adc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6811","nonce":980870924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6813","nonce":980870924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6817","nonce":980870924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6815","nonce":980870924}]},"public_addr":"172.21.15.82:6811/980870924","cluster_addr":"172.21.15.82:6813/980870924","heartbeat_back_addr":"172.21.15.82:6817/980870924","heartbeat_front_addr":"172.21.15.82:6815/980870924","state":["exists","up"]},{"osd":4,"uuid":"dbb9d486-5daa-4819-bbed-04fc76ca473e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6809","nonce":1229627753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6811","nonce":1229627753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6815","nonce":1229627753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6813","nonce":1229627753}]},"public_addr":"172.21.15.102:6809/1229627753","cluster_addr":"172.21.15.102:6811/1229627753","heartbeat_back_addr":"172.21.15.102:6815/1229627753","heartbeat_front_addr":"172.21.15.102:6813/1229627753","state":["exists","up"]},{"osd":5,"uuid":"6b50127b-df2b-4c95-8e53-9d42b40273fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6809","nonce":2171194148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6811","nonce":2171194148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6815","nonce":2171194148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6813","nonce":2171194148}]},"public_addr":"172.21.15.190:6809/2171194148","cluster_addr":"172.21.15.190:6811/2171194148","heartbeat_back_addr":"172.21.15.190:6815/2171194148","heartbeat_front_addr":"172.21.15.190:6813/2171194148","state":["exists","up"]},{"osd":6,"uuid":"e72bebb0-5939-4210-950a-41c25c23c62f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6819","nonce":454436959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6821","nonce":454436959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6825","nonce":454436959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6823","nonce":454436959}]},"public_addr":"172.21.15.82:6819/454436959","cluster_addr":"172.21.15.82:6821/454436959","heartbeat_back_addr":"172.21.15.82:6825/454436959","heartbeat_front_addr":"172.21.15.82:6823/454436959","state":["exists","up"]},{"osd":7,"uuid":"72f83f97-f496-4503-8284-6a7b8f99a6f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6817","nonce":2745057274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6819","nonce":2745057274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6823","nonce":2745057274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6821","nonce":2745057274}]},"public_addr":"172.21.15.102:6817/2745057274","cluster_addr":"172.21.15.102:6819/2745057274","heartbeat_back_addr":"172.21.15.102:6823/2745057274","heartbeat_front_addr":"172.21.15.102:6821/2745057274","state":["exists","up"]},{"osd":8,"uuid":"92c9109d-6ebb-4c50-9944-28cd7b2f9c0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6817","nonce":1679683516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6819","nonce":1679683516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6823","nonce":1679683516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6821","nonce":1679683516}]},"public_addr":"172.21.15.190:6817/1679683516","cluster_addr":"172.21.15.190:6819/1679683516","heartbeat_back_addr":"172.21.15.190:6823/1679683516","heartbeat_front_addr":"172.21.15.190:6821/1679683516","state":["exists","up"]},{"osd":9,"uuid":"a3cfce03-0148-475d-bf55-b8284ae1cad2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6827","nonce":1777272933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6829","nonce":1777272933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6833","nonce":1777272933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6831","nonce":1777272933}]},"public_addr":"172.21.15.82:6827/1777272933","cluster_addr":"172.21.15.82:6829/1777272933","heartbeat_back_addr":"172.21.15.82:6833/1777272933","heartbeat_front_addr":"172.21.15.82:6831/1777272933","state":["exists","up"]},{"osd":10,"uuid":"db156ccf-4396-43cb-b69a-bb9095b94b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6825","nonce":1012784035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6827","nonce":1012784035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6831","nonce":1012784035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6829","nonce":1012784035}]},"public_addr":"172.21.15.102:6825/1012784035","cluster_addr":"172.21.15.102:6827/1012784035","heartbeat_back_addr":"172.21.15.102:6831/1012784035","heartbeat_front_addr":"172.21.15.102:6829/1012784035","state":["exists","up"]},{"osd":11,"uuid":"b4d52576-f5b4-479f-8ff6-8fdba4635ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6825","nonce":144700355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6827","nonce":144700355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6831","nonce":144700355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6829","nonce":144700355}]},"public_addr":"172.21.15.190:6825/144700355","cluster_addr":"172.21.15.190:6827/144700355","heartbeat_back_addr":"172.21.15.190:6831/144700355","heartbeat_front_addr":"172.21.15.190:6829/144700355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:07:47.007772+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:09.944738+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:33.183567+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:58.302023+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:09:23.042488+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:09:47.616009+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:10:13.122887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:10:38.584530+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:03.473453+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:29.847105+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:55.152195+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:12:20.401765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6800/1901539016":"2024-03-05T09:06:12.169231+0000","172.21.15.82:0/1124105204":"2024-03-05T09:06:12.169231+0000","172.21.15.82:6801/1901539016":"2024-03-05T09:06:12.169231+0000","172.21.15.82:0/735262841":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/2402774828":"2024-03-05T09:05:44.913099+0000","172.21.15.82:6801/3291527077":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/1846720385":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/3757201752":"2024-03-05T09:06:12.169231+0000","172.21.15.82:6800/3291527077":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/984630078":"2024-03-05T09:06:12.169231+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T09:13:24.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.306+0000 7ff8b942a640 1 -- 172.21.15.82:0/668319686 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff89c0a1d80 msgr2=0x7ff89c0a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:24.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.306+0000 7ff8b942a640 1 --2- 172.21.15.82:0/668319686 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff89c0a1d80 0x7ff89c0a4240 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff8a8005ab0 tx=0x7ff8a8005fd0 comp rx=0 tx=0).stop 2024-03-04T09:13:24.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.306+0000 7ff8b942a640 1 -- 172.21.15.82:0/668319686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8b40ff690 msgr2=0x7ff8b4197910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:24.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.306+0000 7ff8b942a640 1 --2- 172.21.15.82:0/668319686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8b40ff690 0x7ff8b4197910 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac00ebc0 tx=0x7ff8ac00c6a0 comp rx=0 tx=0).stop 2024-03-04T09:13:24.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.306+0000 7ff8b942a640 1 -- 172.21.15.82:0/668319686 shutdown_connections 2024-03-04T09:13:24.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.306+0000 7ff8b942a640 1 --2- 172.21.15.82:0/668319686 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff89c0a1d80 0x7ff89c0a4240 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:24.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.306+0000 7ff8b942a640 1 --2- 172.21.15.82:0/668319686 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff8b4102c20 0x7ff8b419eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:24.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.306+0000 7ff8b942a640 1 --2- 172.21.15.82:0/668319686 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8b4100050 0x7ff8b4197e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:24.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.306+0000 7ff8b942a640 1 --2- 172.21.15.82:0/668319686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8b40ff690 0x7ff8b4197910 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:24.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.306+0000 7ff8b942a640 1 -- 172.21.15.82:0/668319686 >> 172.21.15.82:0/668319686 conn(0x7ff8b40fb210 msgr2=0x7ff8b4105cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:24.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.306+0000 7ff8b942a640 1 -- 172.21.15.82:0/668319686 shutdown_connections 2024-03-04T09:13:24.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.306+0000 7ff8b942a640 1 -- 172.21.15.82:0/668319686 wait complete. 2024-03-04T09:13:24.316 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T09:08:36.508257+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-04T09:13:07.981726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-04T09:13:09.289799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-04T09:13:13.008516+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-04T09:13:24.316 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-04T09:13:24.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.423+0000 7fd5f75f7640 1 -- 172.21.15.82:0/598672669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5f0100740 msgr2=0x7fd5f0100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:24.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.423+0000 7fd5f75f7640 1 --2- 172.21.15.82:0/598672669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5f0100740 0x7fd5f0100bc0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0009900 tx=0x7fd5e002bc80 comp rx=0 tx=0).stop 2024-03-04T09:13:24.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.424+0000 7fd5f75f7640 1 -- 172.21.15.82:0/598672669 shutdown_connections 2024-03-04T09:13:24.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.424+0000 7fd5f75f7640 1 --2- 172.21.15.82:0/598672669 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5f0101100 0x7fd5f01089a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:24.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.424+0000 7fd5f75f7640 1 --2- 172.21.15.82:0/598672669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5f0100740 0x7fd5f0100bc0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:24.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.424+0000 7fd5f75f7640 1 --2- 172.21.15.82:0/598672669 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd5f0101b80 0x7fd5f0101fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:24.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.424+0000 7fd5f75f7640 1 -- 172.21.15.82:0/598672669 >> 172.21.15.82:0/598672669 conn(0x7fd5f00fb1d0 msgr2=0x7fd5f00fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:24.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.424+0000 7fd5f75f7640 1 -- 172.21.15.82:0/598672669 shutdown_connections 2024-03-04T09:13:24.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.424+0000 7fd5f75f7640 1 -- 172.21.15.82:0/598672669 wait complete. 2024-03-04T09:13:24.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.424+0000 7fd5f75f7640 1 Processor -- start 2024-03-04T09:13:24.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.424+0000 7fd5f75f7640 1 -- start start 2024-03-04T09:13:24.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.424+0000 7fd5f75f7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5f0100740 0x7fd5f0196840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:24.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.424+0000 7fd5f75f7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd5f0101100 0x7fd5f0196d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:24.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.424+0000 7fd5f75f7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5f0101b80 0x7fd5f019ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:24.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.424+0000 7fd5f75f7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f010c1a0 con 0x7fd5f0101b80 2024-03-04T09:13:24.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.424+0000 7fd5f75f7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f010c020 con 0x7fd5f0100740 2024-03-04T09:13:24.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.424+0000 7fd5f75f7640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f010c320 con 0x7fd5f0101100 2024-03-04T09:13:24.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.424+0000 7fd5f5b94640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5f0101b80 0x7fd5f019ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:24.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.424+0000 7fd5f5b94640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5f0101b80 0x7fd5f019ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51284/0 (socket says 172.21.15.82:51284) 2024-03-04T09:13:24.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.424+0000 7fd5f5b94640 1 -- 172.21.15.82:0/2466723377 learned_addr learned my addr 172.21.15.82:0/2466723377 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:24.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.424+0000 7fd5f5393640 1 --2- 172.21.15.82:0/2466723377 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5f0100740 0x7fd5f0196840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:24.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.424+0000 7fd5f4b92640 1 --2- 172.21.15.82:0/2466723377 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd5f0101100 0x7fd5f0196d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:24.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.425+0000 7fd5f5b94640 1 -- 172.21.15.82:0/2466723377 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd5f0101100 msgr2=0x7fd5f0196d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:24.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.425+0000 7fd5f5b94640 1 --2- 172.21.15.82:0/2466723377 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd5f0101100 0x7fd5f0196d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:24.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.425+0000 7fd5f5b94640 1 -- 172.21.15.82:0/2466723377 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5f0100740 msgr2=0x7fd5f0196840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:24.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.425+0000 7fd5f5b94640 1 --2- 172.21.15.82:0/2466723377 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5f0100740 0x7fd5f0196840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:24.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.425+0000 7fd5f5b94640 1 -- 172.21.15.82:0/2466723377 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f019e460 con 0x7fd5f0101b80 2024-03-04T09:13:24.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.425+0000 7fd5f5b94640 1 --2- 172.21.15.82:0/2466723377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5f0101b80 0x7fd5f019ddf0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd5e800eb10 tx=0x7fd5e800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:24.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.425+0000 7fd5e67fc640 1 -- 172.21.15.82:0/2466723377 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e8004b20 con 0x7fd5f0101b80 2024-03-04T09:13:24.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.425+0000 7fd5e67fc640 1 -- 172.21.15.82:0/2466723377 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fd5e8004cc0 con 0x7fd5f0101b80 2024-03-04T09:13:24.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.425+0000 7fd5f75f7640 1 -- 172.21.15.82:0/2466723377 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5f019e750 con 0x7fd5f0101b80 2024-03-04T09:13:24.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.425+0000 7fd5e67fc640 1 -- 172.21.15.82:0/2466723377 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e8010700 con 0x7fd5f0101b80 2024-03-04T09:13:24.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.425+0000 7fd5f75f7640 1 -- 172.21.15.82:0/2466723377 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5f019ec70 con 0x7fd5f0101b80 2024-03-04T09:13:24.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.426+0000 7fd5f75f7640 1 -- 172.21.15.82:0/2466723377 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5f0107950 con 0x7fd5f0101b80 2024-03-04T09:13:24.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.427+0000 7fd5e67fc640 1 -- 172.21.15.82:0/2466723377 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7fd5e8004e70 con 0x7fd5f0101b80 2024-03-04T09:13:24.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.427+0000 7fd5e67fc640 1 --2- 172.21.15.82:0/2466723377 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fd5dc0a1e00 0x7fd5dc0a42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:24.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.428+0000 7fd5f5393640 1 --2- 172.21.15.82:0/2466723377 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fd5dc0a1e00 0x7fd5dc0a42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:24.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.428+0000 7fd5e67fc640 1 -- 172.21.15.82:0/2466723377 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8802+0+0 (secure 0 0 0) 0x7fd5e80ce4f0 con 0x7fd5f0101b80 2024-03-04T09:13:24.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.428+0000 7fd5f5393640 1 --2- 172.21.15.82:0/2466723377 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fd5dc0a1e00 0x7fd5dc0a42c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec009bd0 tx=0x7fd5ec005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:24.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.432+0000 7fd5e67fc640 1 -- 172.21.15.82:0/2466723377 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fd5e809b6e0 con 0x7fd5f0101b80 2024-03-04T09:13:24.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:24 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/2419974691' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-04T09:13:24.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:24 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/3683851751' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-04T09:13:24.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:24 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/1119463746' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-04T09:13:24.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:24 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/668319686' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:13:24.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.606+0000 7fd5f75f7640 1 -- 172.21.15.82:0/2466723377 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd5f00621d0 con 0x7fd5f0101b80 2024-03-04T09:13:24.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.607+0000 7fd5e67fc640 1 -- 172.21.15.82:0/2466723377 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd5e809afe0 con 0x7fd5f0101b80 2024-03-04T09:13:24.603 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-03-04T09:13:24.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.608+0000 7fd5f75f7640 1 -- 172.21.15.82:0/2466723377 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fd5dc0a1e00 msgr2=0x7fd5dc0a42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:24.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.608+0000 7fd5f75f7640 1 --2- 172.21.15.82:0/2466723377 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fd5dc0a1e00 0x7fd5dc0a42c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec009bd0 tx=0x7fd5ec005f90 comp rx=0 tx=0).stop 2024-03-04T09:13:24.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.608+0000 7fd5f75f7640 1 -- 172.21.15.82:0/2466723377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5f0101b80 msgr2=0x7fd5f019ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:24.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.608+0000 7fd5f75f7640 1 --2- 172.21.15.82:0/2466723377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5f0101b80 0x7fd5f019ddf0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd5e800eb10 tx=0x7fd5e800c2d0 comp rx=0 tx=0).stop 2024-03-04T09:13:24.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.609+0000 7fd5f75f7640 1 -- 172.21.15.82:0/2466723377 shutdown_connections 2024-03-04T09:13:24.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.609+0000 7fd5f75f7640 1 --2- 172.21.15.82:0/2466723377 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fd5dc0a1e00 0x7fd5dc0a42c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:24.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.609+0000 7fd5f75f7640 1 --2- 172.21.15.82:0/2466723377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5f0101b80 0x7fd5f019ddf0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:24.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.609+0000 7fd5f75f7640 1 --2- 172.21.15.82:0/2466723377 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd5f0101100 0x7fd5f0196d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:24.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.609+0000 7fd5f75f7640 1 --2- 172.21.15.82:0/2466723377 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5f0100740 0x7fd5f0196840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:24.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.609+0000 7fd5f75f7640 1 -- 172.21.15.82:0/2466723377 >> 172.21.15.82:0/2466723377 conn(0x7fd5f00fb1d0 msgr2=0x7fd5f0104b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:24.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.609+0000 7fd5f75f7640 1 -- 172.21.15.82:0/2466723377 shutdown_connections 2024-03-04T09:13:24.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.609+0000 7fd5f75f7640 1 -- 172.21.15.82:0/2466723377 wait complete. 2024-03-04T09:13:24.616 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-04T09:13:24.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:24 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/2419974691' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-04T09:13:24.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:24 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/3683851751' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-04T09:13:24.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:24 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/1119463746' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-04T09:13:24.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:24 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/668319686' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:13:24.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:24 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/2419974691' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-04T09:13:24.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:24 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/3683851751' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-04T09:13:24.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:24 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/1119463746' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-04T09:13:24.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:24 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/668319686' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:13:24.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.724+0000 7f2ea7f02640 1 -- 172.21.15.82:0/2158898497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ea01004f0 msgr2=0x7f2ea0100910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:24.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.724+0000 7f2ea7f02640 1 --2- 172.21.15.82:0/2158898497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ea01004f0 0x7f2ea0100910 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2e90009900 tx=0x7f2e9002bc30 comp rx=0 tx=0).stop 2024-03-04T09:13:24.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.724+0000 7f2ea7f02640 1 -- 172.21.15.82:0/2158898497 shutdown_connections 2024-03-04T09:13:24.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.724+0000 7f2ea7f02640 1 --2- 172.21.15.82:0/2158898497 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2ea01020a0 0x7f2ea0108930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:24.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.724+0000 7f2ea7f02640 1 --2- 172.21.15.82:0/2158898497 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ea01016e0 0x7f2ea0101b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:24.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.724+0000 7f2ea7f02640 1 --2- 172.21.15.82:0/2158898497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ea01004f0 0x7f2ea0100910 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:24.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.724+0000 7f2ea7f02640 1 -- 172.21.15.82:0/2158898497 >> 172.21.15.82:0/2158898497 conn(0x7f2ea00fba80 msgr2=0x7f2ea00fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:24.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.724+0000 7f2ea7f02640 1 -- 172.21.15.82:0/2158898497 shutdown_connections 2024-03-04T09:13:24.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.724+0000 7f2ea7f02640 1 -- 172.21.15.82:0/2158898497 wait complete. 2024-03-04T09:13:24.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.725+0000 7f2ea7f02640 1 Processor -- start 2024-03-04T09:13:24.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.725+0000 7f2ea7f02640 1 -- start start 2024-03-04T09:13:24.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.725+0000 7f2ea7f02640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2ea01004f0 0x7f2ea006a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:24.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.725+0000 7f2ea7f02640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ea01016e0 0x7f2ea019c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:24.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.725+0000 7f2ea7f02640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ea01020a0 0x7f2ea019ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:24.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.725+0000 7f2ea7f02640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea010c150 con 0x7f2ea01016e0 2024-03-04T09:13:24.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.725+0000 7f2ea7f02640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea010bfd0 con 0x7f2ea01020a0 2024-03-04T09:13:24.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.725+0000 7f2ea7f02640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea010c2d0 con 0x7f2ea01004f0 2024-03-04T09:13:24.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.725+0000 7f2ea549d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ea01016e0 0x7f2ea019c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:24.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.725+0000 7f2ea549d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ea01016e0 0x7f2ea019c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51302/0 (socket says 172.21.15.82:51302) 2024-03-04T09:13:24.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.725+0000 7f2ea549d640 1 -- 172.21.15.82:0/263755493 learned_addr learned my addr 172.21.15.82:0/263755493 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:24.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.725+0000 7f2ea5c9e640 1 --2- 172.21.15.82:0/263755493 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2ea01004f0 0x7f2ea006a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:24.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.725+0000 7f2ea649f640 1 --2- 172.21.15.82:0/263755493 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ea01020a0 0x7f2ea019ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:24.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.725+0000 7f2ea549d640 1 -- 172.21.15.82:0/263755493 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2ea01004f0 msgr2=0x7f2ea006a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:24.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.725+0000 7f2ea549d640 1 --2- 172.21.15.82:0/263755493 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2ea01004f0 0x7f2ea006a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:24.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.725+0000 7f2ea549d640 1 -- 172.21.15.82:0/263755493 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ea01020a0 msgr2=0x7f2ea019ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:24.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.725+0000 7f2ea549d640 1 --2- 172.21.15.82:0/263755493 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ea01020a0 0x7f2ea019ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:24.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.725+0000 7f2ea549d640 1 -- 172.21.15.82:0/263755493 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea019f580 con 0x7f2ea01016e0 2024-03-04T09:13:24.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.725+0000 7f2ea549d640 1 --2- 172.21.15.82:0/263755493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ea01016e0 0x7f2ea019c680 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c00d950 tx=0x7f2e9c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:24.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.725+0000 7f2e96ffd640 1 -- 172.21.15.82:0/263755493 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c017030 con 0x7f2ea01016e0 2024-03-04T09:13:24.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.726+0000 7f2ea7f02640 1 -- 172.21.15.82:0/263755493 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ea019f870 con 0x7f2ea01016e0 2024-03-04T09:13:24.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.726+0000 7f2e96ffd640 1 -- 172.21.15.82:0/263755493 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f2e9c004020 con 0x7f2ea01016e0 2024-03-04T09:13:24.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.726+0000 7f2ea7f02640 1 -- 172.21.15.82:0/263755493 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ea019fe10 con 0x7f2ea01016e0 2024-03-04T09:13:24.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.726+0000 7f2e96ffd640 1 -- 172.21.15.82:0/263755493 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c0047a0 con 0x7f2ea01016e0 2024-03-04T09:13:24.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.726+0000 7f2ea7f02640 1 -- 172.21.15.82:0/263755493 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ea0107860 con 0x7f2ea01016e0 2024-03-04T09:13:24.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.728+0000 7f2e96ffd640 1 -- 172.21.15.82:0/263755493 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f2e9c0041d0 con 0x7f2ea01016e0 2024-03-04T09:13:24.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.728+0000 7f2e96ffd640 1 --2- 172.21.15.82:0/263755493 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f2e8c0a1d80 0x7f2e8c0a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:24.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.728+0000 7f2e96ffd640 1 -- 172.21.15.82:0/263755493 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8802+0+0 (secure 0 0 0) 0x7f2e9c0cd9f0 con 0x7f2ea01016e0 2024-03-04T09:13:24.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.728+0000 7f2ea5c9e640 1 --2- 172.21.15.82:0/263755493 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f2e8c0a1d80 0x7f2e8c0a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:24.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.729+0000 7f2ea5c9e640 1 --2- 172.21.15.82:0/263755493 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f2e8c0a1d80 0x7f2e8c0a4240 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2e90000c00 tx=0x7f2e90005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:24.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.732+0000 7f2e96ffd640 1 -- 172.21.15.82:0/263755493 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f2e9c09abe0 con 0x7f2ea01016e0 2024-03-04T09:13:24.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.907+0000 7f2ea7f02640 1 -- 172.21.15.82:0/263755493 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2ea00621d0 con 0x7f2ea01016e0 2024-03-04T09:13:24.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.908+0000 7f2e96ffd640 1 -- 172.21.15.82:0/263755493 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2e9c09a4e0 con 0x7f2ea01016e0 2024-03-04T09:13:24.904 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-03-04T09:13:24.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.910+0000 7f2ea7f02640 1 -- 172.21.15.82:0/263755493 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f2e8c0a1d80 msgr2=0x7f2e8c0a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:24.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.910+0000 7f2ea7f02640 1 --2- 172.21.15.82:0/263755493 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f2e8c0a1d80 0x7f2e8c0a4240 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2e90000c00 tx=0x7f2e90005fd0 comp rx=0 tx=0).stop 2024-03-04T09:13:24.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.910+0000 7f2ea7f02640 1 -- 172.21.15.82:0/263755493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ea01016e0 msgr2=0x7f2ea019c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:24.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.910+0000 7f2ea7f02640 1 --2- 172.21.15.82:0/263755493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ea01016e0 0x7f2ea019c680 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c00d950 tx=0x7f2e9c00de10 comp rx=0 tx=0).stop 2024-03-04T09:13:24.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.910+0000 7f2ea7f02640 1 -- 172.21.15.82:0/263755493 shutdown_connections 2024-03-04T09:13:24.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.910+0000 7f2ea7f02640 1 --2- 172.21.15.82:0/263755493 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f2e8c0a1d80 0x7f2e8c0a4240 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:24.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.910+0000 7f2ea7f02640 1 --2- 172.21.15.82:0/263755493 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ea01020a0 0x7f2ea019ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:24.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.910+0000 7f2ea7f02640 1 --2- 172.21.15.82:0/263755493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ea01016e0 0x7f2ea019c680 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:24.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.910+0000 7f2ea7f02640 1 --2- 172.21.15.82:0/263755493 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2ea01004f0 0x7f2ea006a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:24.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.910+0000 7f2ea7f02640 1 -- 172.21.15.82:0/263755493 >> 172.21.15.82:0/263755493 conn(0x7f2ea00fba80 msgr2=0x7f2ea0104a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:24.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.910+0000 7f2ea7f02640 1 -- 172.21.15.82:0/263755493 shutdown_connections 2024-03-04T09:13:24.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:24.910+0000 7f2ea7f02640 1 -- 172.21.15.82:0/263755493 wait complete. 2024-03-04T09:13:24.917 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-04T09:13:25.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.025+0000 7f3f2e97a640 1 -- 172.21.15.82:0/2414498276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f281004e0 msgr2=0x7f3f28100900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:25.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.025+0000 7f3f2e97a640 1 --2- 172.21.15.82:0/2414498276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f281004e0 0x7f3f28100900 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3f18009900 tx=0x7f3f1802bc30 comp rx=0 tx=0).stop 2024-03-04T09:13:25.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.025+0000 7f3f2e97a640 1 -- 172.21.15.82:0/2414498276 shutdown_connections 2024-03-04T09:13:25.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.025+0000 7f3f2e97a640 1 --2- 172.21.15.82:0/2414498276 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3f28102090 0x7f3f28108920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:25.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.025+0000 7f3f2e97a640 1 --2- 172.21.15.82:0/2414498276 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3f281016d0 0x7f3f28101b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:25.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.025+0000 7f3f2e97a640 1 --2- 172.21.15.82:0/2414498276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f281004e0 0x7f3f28100900 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:25.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.025+0000 7f3f2e97a640 1 -- 172.21.15.82:0/2414498276 >> 172.21.15.82:0/2414498276 conn(0x7f3f280fba70 msgr2=0x7f3f280fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:25.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.025+0000 7f3f2e97a640 1 -- 172.21.15.82:0/2414498276 shutdown_connections 2024-03-04T09:13:25.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.025+0000 7f3f2e97a640 1 -- 172.21.15.82:0/2414498276 wait complete. 2024-03-04T09:13:25.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.025+0000 7f3f2e97a640 1 Processor -- start 2024-03-04T09:13:25.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.026+0000 7f3f2e97a640 1 -- start start 2024-03-04T09:13:25.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.026+0000 7f3f2e97a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3f281004e0 0x7f3f28197940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:25.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.026+0000 7f3f2e97a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3f281016d0 0x7f3f28197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:25.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.026+0000 7f3f2e97a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f28102090 0x7f3f2819eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:25.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.026+0000 7f3f2e97a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2810c140 con 0x7f3f28102090 2024-03-04T09:13:25.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.026+0000 7f3f2e97a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2810bfc0 con 0x7f3f281016d0 2024-03-04T09:13:25.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.026+0000 7f3f2e97a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2810c2c0 con 0x7f3f281004e0 2024-03-04T09:13:25.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.026+0000 7f3f2cf17640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f28102090 0x7f3f2819eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:25.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.026+0000 7f3f2cf17640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f28102090 0x7f3f2819eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51320/0 (socket says 172.21.15.82:51320) 2024-03-04T09:13:25.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.026+0000 7f3f2cf17640 1 -- 172.21.15.82:0/949729871 learned_addr learned my addr 172.21.15.82:0/949729871 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:25.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.026+0000 7f3f277fe640 1 --2- 172.21.15.82:0/949729871 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3f281016d0 0x7f3f28197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:25.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.026+0000 7f3f2cf17640 1 -- 172.21.15.82:0/949729871 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3f281004e0 msgr2=0x7f3f28197940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:25.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.026+0000 7f3f27fff640 1 --2- 172.21.15.82:0/949729871 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3f281004e0 0x7f3f28197940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:25.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.026+0000 7f3f2cf17640 1 --2- 172.21.15.82:0/949729871 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3f281004e0 0x7f3f28197940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:25.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.026+0000 7f3f2cf17640 1 -- 172.21.15.82:0/949729871 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3f281016d0 msgr2=0x7f3f28197e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:25.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.026+0000 7f3f2cf17640 1 --2- 172.21.15.82:0/949729871 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3f281016d0 0x7f3f28197e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:25.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.026+0000 7f3f2cf17640 1 -- 172.21.15.82:0/949729871 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f2819f560 con 0x7f3f28102090 2024-03-04T09:13:25.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.026+0000 7f3f27fff640 1 --2- 172.21.15.82:0/949729871 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3f281004e0 0x7f3f28197940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T09:13:25.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.026+0000 7f3f2cf17640 1 --2- 172.21.15.82:0/949729871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f28102090 0x7f3f2819eef0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3f2000eb10 tx=0x7f3f2000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:25.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.027+0000 7f3f257fa640 1 -- 172.21.15.82:0/949729871 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f20004b20 con 0x7f3f28102090 2024-03-04T09:13:25.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.027+0000 7f3f257fa640 1 -- 172.21.15.82:0/949729871 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f3f20004cc0 con 0x7f3f28102090 2024-03-04T09:13:25.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.027+0000 7f3f2e97a640 1 -- 172.21.15.82:0/949729871 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f2819f850 con 0x7f3f28102090 2024-03-04T09:13:25.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.027+0000 7f3f257fa640 1 -- 172.21.15.82:0/949729871 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f20010700 con 0x7f3f28102090 2024-03-04T09:13:25.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.027+0000 7f3f2e97a640 1 -- 172.21.15.82:0/949729871 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f2819fda0 con 0x7f3f28102090 2024-03-04T09:13:25.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.028+0000 7f3f2e97a640 1 -- 172.21.15.82:0/949729871 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f281a0000 con 0x7f3f28102090 2024-03-04T09:13:25.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.029+0000 7f3f257fa640 1 -- 172.21.15.82:0/949729871 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f3f20004e70 con 0x7f3f28102090 2024-03-04T09:13:25.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.029+0000 7f3f257fa640 1 --2- 172.21.15.82:0/949729871 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f3f100a1e00 0x7f3f100a42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:25.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.029+0000 7f3f27fff640 1 --2- 172.21.15.82:0/949729871 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f3f100a1e00 0x7f3f100a42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:25.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.029+0000 7f3f257fa640 1 -- 172.21.15.82:0/949729871 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8802+0+0 (secure 0 0 0) 0x7f3f200ce5a0 con 0x7f3f28102090 2024-03-04T09:13:25.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.030+0000 7f3f27fff640 1 --2- 172.21.15.82:0/949729871 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f3f100a1e00 0x7f3f100a42c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3f18005c40 tx=0x7f3f18005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:25.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.034+0000 7f3f257fa640 1 -- 172.21.15.82:0/949729871 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f3f2009b790 con 0x7f3f28102090 2024-03-04T09:13:25.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.205+0000 7f3f2e97a640 1 -- 172.21.15.82:0/949729871 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3f281a01d0 con 0x7f3f28102090 2024-03-04T09:13:25.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.206+0000 7f3f257fa640 1 -- 172.21.15.82:0/949729871 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3f2009b090 con 0x7f3f28102090 2024-03-04T09:13:25.203 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2024-03-04T09:13:25.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.208+0000 7f3f2e97a640 1 -- 172.21.15.82:0/949729871 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f3f100a1e00 msgr2=0x7f3f100a42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:25.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.208+0000 7f3f2e97a640 1 --2- 172.21.15.82:0/949729871 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f3f100a1e00 0x7f3f100a42c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3f18005c40 tx=0x7f3f18005fd0 comp rx=0 tx=0).stop 2024-03-04T09:13:25.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.208+0000 7f3f2e97a640 1 -- 172.21.15.82:0/949729871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f28102090 msgr2=0x7f3f2819eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:25.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.208+0000 7f3f2e97a640 1 --2- 172.21.15.82:0/949729871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f28102090 0x7f3f2819eef0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3f2000eb10 tx=0x7f3f2000c2d0 comp rx=0 tx=0).stop 2024-03-04T09:13:25.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.208+0000 7f3f2e97a640 1 -- 172.21.15.82:0/949729871 shutdown_connections 2024-03-04T09:13:25.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.208+0000 7f3f2e97a640 1 --2- 172.21.15.82:0/949729871 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f3f100a1e00 0x7f3f100a42c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:25.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.208+0000 7f3f2e97a640 1 --2- 172.21.15.82:0/949729871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f28102090 0x7f3f2819eef0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:25.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.208+0000 7f3f2e97a640 1 --2- 172.21.15.82:0/949729871 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3f281016d0 0x7f3f28197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:25.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.208+0000 7f3f2e97a640 1 --2- 172.21.15.82:0/949729871 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3f281004e0 0x7f3f28197940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:25.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.208+0000 7f3f2e97a640 1 -- 172.21.15.82:0/949729871 >> 172.21.15.82:0/949729871 conn(0x7f3f280fba70 msgr2=0x7f3f28069bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:25.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.208+0000 7f3f2e97a640 1 -- 172.21.15.82:0/949729871 shutdown_connections 2024-03-04T09:13:25.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.208+0000 7f3f2e97a640 1 -- 172.21.15.82:0/949729871 wait complete. 2024-03-04T09:13:25.215 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-04T09:13:25.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.325+0000 7fba0b5c7640 1 -- 172.21.15.82:0/2299723384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba04107bf0 msgr2=0x7fba04108010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:25.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.325+0000 7fba0b5c7640 1 --2- 172.21.15.82:0/2299723384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba04107bf0 0x7fba04108010 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fba00009900 tx=0x7fba0002bc30 comp rx=0 tx=0).stop 2024-03-04T09:13:25.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.325+0000 7fba0b5c7640 1 -- 172.21.15.82:0/2299723384 shutdown_connections 2024-03-04T09:13:25.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.325+0000 7fba0b5c7640 1 --2- 172.21.15.82:0/2299723384 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba041097a0 0x7fba04110030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:25.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.325+0000 7fba0b5c7640 1 --2- 172.21.15.82:0/2299723384 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba04108de0 0x7fba04109260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:25.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.325+0000 7fba0b5c7640 1 --2- 172.21.15.82:0/2299723384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba04107bf0 0x7fba04108010 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:25.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.325+0000 7fba0b5c7640 1 -- 172.21.15.82:0/2299723384 >> 172.21.15.82:0/2299723384 conn(0x7fba04076b90 msgr2=0x7fba04078fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:25.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.325+0000 7fba0b5c7640 1 -- 172.21.15.82:0/2299723384 shutdown_connections 2024-03-04T09:13:25.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.325+0000 7fba0b5c7640 1 -- 172.21.15.82:0/2299723384 wait complete. 2024-03-04T09:13:25.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.326+0000 7fba0b5c7640 1 Processor -- start 2024-03-04T09:13:25.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.326+0000 7fba0b5c7640 1 -- start start 2024-03-04T09:13:25.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.326+0000 7fba0b5c7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba04107bf0 0x7fba0419df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:25.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.326+0000 7fba0b5c7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba04108de0 0x7fba0419e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:25.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.326+0000 7fba0b5c7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba041097a0 0x7fba041a54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:25.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.326+0000 7fba0b5c7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba04113850 con 0x7fba04107bf0 2024-03-04T09:13:25.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.326+0000 7fba0b5c7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba041136d0 con 0x7fba04108de0 2024-03-04T09:13:25.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.326+0000 7fba0b5c7640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba041139d0 con 0x7fba041097a0 2024-03-04T09:13:25.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.326+0000 7fba09363640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba04107bf0 0x7fba0419df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:25.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.326+0000 7fba09363640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba04107bf0 0x7fba0419df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51332/0 (socket says 172.21.15.82:51332) 2024-03-04T09:13:25.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.326+0000 7fba09363640 1 -- 172.21.15.82:0/4232086624 learned_addr learned my addr 172.21.15.82:0/4232086624 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:25.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.326+0000 7fba08b62640 1 --2- 172.21.15.82:0/4232086624 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba04108de0 0x7fba0419e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:25.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.326+0000 7fba09b64640 1 --2- 172.21.15.82:0/4232086624 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba041097a0 0x7fba041a54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:25.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.326+0000 7fba09363640 1 -- 172.21.15.82:0/4232086624 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba041097a0 msgr2=0x7fba041a54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:25.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.326+0000 7fba09363640 1 --2- 172.21.15.82:0/4232086624 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba041097a0 0x7fba041a54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:25.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.326+0000 7fba09363640 1 -- 172.21.15.82:0/4232086624 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba04108de0 msgr2=0x7fba0419e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:25.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.326+0000 7fba09363640 1 --2- 172.21.15.82:0/4232086624 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba04108de0 0x7fba0419e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:25.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.326+0000 7fba09363640 1 -- 172.21.15.82:0/4232086624 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba041a5b40 con 0x7fba04107bf0 2024-03-04T09:13:25.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.326+0000 7fba09b64640 1 --2- 172.21.15.82:0/4232086624 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba041097a0 0x7fba041a54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T09:13:25.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.326+0000 7fba09363640 1 --2- 172.21.15.82:0/4232086624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba04107bf0 0x7fba0419df20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fba00005ab0 tx=0x7fba00005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:25.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.327+0000 7fb9fa7fc640 1 -- 172.21.15.82:0/4232086624 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba00043020 con 0x7fba04107bf0 2024-03-04T09:13:25.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.327+0000 7fb9fa7fc640 1 -- 172.21.15.82:0/4232086624 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fba000054b0 con 0x7fba04107bf0 2024-03-04T09:13:25.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.327+0000 7fba0b5c7640 1 -- 172.21.15.82:0/4232086624 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba041a5dd0 con 0x7fba04107bf0 2024-03-04T09:13:25.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.327+0000 7fb9fa7fc640 1 -- 172.21.15.82:0/4232086624 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba00003bb0 con 0x7fba04107bf0 2024-03-04T09:13:25.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.327+0000 7fba0b5c7640 1 -- 172.21.15.82:0/4232086624 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba041a6290 con 0x7fba04107bf0 2024-03-04T09:13:25.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.328+0000 7fba0b5c7640 1 -- 172.21.15.82:0/4232086624 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba0410ef90 con 0x7fba04107bf0 2024-03-04T09:13:25.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.329+0000 7fb9fa7fc640 1 -- 172.21.15.82:0/4232086624 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7fba00046020 con 0x7fba04107bf0 2024-03-04T09:13:25.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.329+0000 7fb9fa7fc640 1 --2- 172.21.15.82:0/4232086624 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb9f00a1e00 0x7fb9f00a42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:25.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.329+0000 7fba08b62640 1 --2- 172.21.15.82:0/4232086624 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb9f00a1e00 0x7fb9f00a42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:25.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.330+0000 7fb9fa7fc640 1 -- 172.21.15.82:0/4232086624 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8802+0+0 (secure 0 0 0) 0x7fba000f02f0 con 0x7fba04107bf0 2024-03-04T09:13:25.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.330+0000 7fba08b62640 1 --2- 172.21.15.82:0/4232086624 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb9f00a1e00 0x7fb9f00a42c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fba0419f430 tx=0x7fb9f4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:25.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.333+0000 7fb9fa7fc640 1 -- 172.21.15.82:0/4232086624 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fba0004d070 con 0x7fba04107bf0 2024-03-04T09:13:25.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.507+0000 7fba0b5c7640 1 -- 172.21.15.82:0/4232086624 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fba0402d240 con 0x7fba04107bf0 2024-03-04T09:13:25.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.507+0000 7fb9fa7fc640 1 -- 172.21.15.82:0/4232086624 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v90) v1 ==== 103+0+11 (secure 0 0 0) 0x7fba000bd4e0 con 0x7fba04107bf0 2024-03-04T09:13:25.504 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-03-04T09:13:25.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.509+0000 7fba0b5c7640 1 -- 172.21.15.82:0/4232086624 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb9f00a1e00 msgr2=0x7fb9f00a42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:25.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.509+0000 7fba0b5c7640 1 --2- 172.21.15.82:0/4232086624 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb9f00a1e00 0x7fb9f00a42c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fba0419f430 tx=0x7fb9f4005f90 comp rx=0 tx=0).stop 2024-03-04T09:13:25.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.509+0000 7fba0b5c7640 1 -- 172.21.15.82:0/4232086624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba04107bf0 msgr2=0x7fba0419df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:25.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.509+0000 7fba0b5c7640 1 --2- 172.21.15.82:0/4232086624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba04107bf0 0x7fba0419df20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fba00005ab0 tx=0x7fba00005de0 comp rx=0 tx=0).stop 2024-03-04T09:13:25.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.509+0000 7fba0b5c7640 1 -- 172.21.15.82:0/4232086624 shutdown_connections 2024-03-04T09:13:25.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.509+0000 7fba0b5c7640 1 --2- 172.21.15.82:0/4232086624 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb9f00a1e00 0x7fb9f00a42c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:25.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.509+0000 7fba0b5c7640 1 --2- 172.21.15.82:0/4232086624 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba041097a0 0x7fba041a54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:25.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.509+0000 7fba0b5c7640 1 --2- 172.21.15.82:0/4232086624 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba04108de0 0x7fba0419e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:25.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.509+0000 7fba0b5c7640 1 --2- 172.21.15.82:0/4232086624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba04107bf0 0x7fba0419df20 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:25.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.509+0000 7fba0b5c7640 1 -- 172.21.15.82:0/4232086624 >> 172.21.15.82:0/4232086624 conn(0x7fba04076b90 msgr2=0x7fba0410c160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:25.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.510+0000 7fba0b5c7640 1 -- 172.21.15.82:0/4232086624 shutdown_connections 2024-03-04T09:13:25.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.510+0000 7fba0b5c7640 1 -- 172.21.15.82:0/4232086624 wait complete. 2024-03-04T09:13:25.516 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:25 smithi082 ceph-mon[32880]: pgmap v296: 129 pgs: 129 active+clean; 581 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 0 op/s 2024-03-04T09:13:25.516 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:25 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/2466723377' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-04T09:13:25.516 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:25 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/263755493' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-04T09:13:25.516 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:25 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/949729871' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-04T09:13:25.517 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-04T09:13:25.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.624+0000 7ff7c4266640 1 -- 172.21.15.82:0/1487988451 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7bc1004f0 msgr2=0x7ff7bc100910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:25.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.624+0000 7ff7c4266640 1 --2- 172.21.15.82:0/1487988451 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7bc1004f0 0x7ff7bc100910 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8009900 tx=0x7ff7b802bc30 comp rx=0 tx=0).stop 2024-03-04T09:13:25.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.624+0000 7ff7c4266640 1 -- 172.21.15.82:0/1487988451 shutdown_connections 2024-03-04T09:13:25.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.624+0000 7ff7c4266640 1 --2- 172.21.15.82:0/1487988451 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7bc1020a0 0x7ff7bc108930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:25.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.624+0000 7ff7c4266640 1 --2- 172.21.15.82:0/1487988451 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff7bc1016e0 0x7ff7bc101b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:25.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.624+0000 7ff7c4266640 1 --2- 172.21.15.82:0/1487988451 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7bc1004f0 0x7ff7bc100910 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:25.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.624+0000 7ff7c4266640 1 -- 172.21.15.82:0/1487988451 >> 172.21.15.82:0/1487988451 conn(0x7ff7bc0fba80 msgr2=0x7ff7bc0fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:25.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.624+0000 7ff7c4266640 1 -- 172.21.15.82:0/1487988451 shutdown_connections 2024-03-04T09:13:25.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.624+0000 7ff7c4266640 1 -- 172.21.15.82:0/1487988451 wait complete. 2024-03-04T09:13:25.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.625+0000 7ff7c4266640 1 Processor -- start 2024-03-04T09:13:25.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.625+0000 7ff7c4266640 1 -- start start 2024-03-04T09:13:25.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.625+0000 7ff7c4266640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7bc1004f0 0x7ff7bc10ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:25.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.625+0000 7ff7c4266640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff7bc1016e0 0x7ff7bc1094b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:25.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.625+0000 7ff7c4266640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7bc1020a0 0x7ff7bc1099f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:25.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.625+0000 7ff7c4266640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc10d260 con 0x7ff7bc1004f0 2024-03-04T09:13:25.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.625+0000 7ff7c4266640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc10d0e0 con 0x7ff7bc1020a0 2024-03-04T09:13:25.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.625+0000 7ff7c4266640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc10d3e0 con 0x7ff7bc1016e0 2024-03-04T09:13:25.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.625+0000 7ff7c2002640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7bc1004f0 0x7ff7bc10ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:25.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.625+0000 7ff7c2002640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7bc1004f0 0x7ff7bc10ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51340/0 (socket says 172.21.15.82:51340) 2024-03-04T09:13:25.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.625+0000 7ff7c2002640 1 -- 172.21.15.82:0/3741305681 learned_addr learned my addr 172.21.15.82:0/3741305681 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:25.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.625+0000 7ff7c2803640 1 --2- 172.21.15.82:0/3741305681 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7bc1020a0 0x7ff7bc1099f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:25.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.625+0000 7ff7c1801640 1 --2- 172.21.15.82:0/3741305681 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff7bc1016e0 0x7ff7bc1094b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:25.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.625+0000 7ff7c2002640 1 -- 172.21.15.82:0/3741305681 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff7bc1016e0 msgr2=0x7ff7bc1094b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:25.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.625+0000 7ff7c2002640 1 --2- 172.21.15.82:0/3741305681 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff7bc1016e0 0x7ff7bc1094b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:25.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.625+0000 7ff7c2002640 1 -- 172.21.15.82:0/3741305681 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7bc1020a0 msgr2=0x7ff7bc1099f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:25.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.625+0000 7ff7c2002640 1 --2- 172.21.15.82:0/3741305681 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7bc1020a0 0x7ff7bc1099f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:25.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.625+0000 7ff7c2002640 1 -- 172.21.15.82:0/3741305681 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7bc10a280 con 0x7ff7bc1004f0 2024-03-04T09:13:25.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.625+0000 7ff7c1801640 1 --2- 172.21.15.82:0/3741305681 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff7bc1016e0 0x7ff7bc1094b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T09:13:25.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.625+0000 7ff7c2002640 1 --2- 172.21.15.82:0/3741305681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7bc1004f0 0x7ff7bc10ae70 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8005ab0 tx=0x7ff7b8005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:25.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.625+0000 7ff7b2ffd640 1 -- 172.21.15.82:0/3741305681 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b8043020 con 0x7ff7bc1004f0 2024-03-04T09:13:25.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.625+0000 7ff7b2ffd640 1 -- 172.21.15.82:0/3741305681 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7ff7b80053f0 con 0x7ff7bc1004f0 2024-03-04T09:13:25.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.625+0000 7ff7c4266640 1 -- 172.21.15.82:0/3741305681 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7bc1a1ab0 con 0x7ff7bc1004f0 2024-03-04T09:13:25.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.626+0000 7ff7b2ffd640 1 -- 172.21.15.82:0/3741305681 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b8003b80 con 0x7ff7bc1004f0 2024-03-04T09:13:25.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.626+0000 7ff7c4266640 1 -- 172.21.15.82:0/3741305681 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7bc1a2050 con 0x7ff7bc1004f0 2024-03-04T09:13:25.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.626+0000 7ff7c4266640 1 -- 172.21.15.82:0/3741305681 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7bc107900 con 0x7ff7bc1004f0 2024-03-04T09:13:25.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.627+0000 7ff7b2ffd640 1 -- 172.21.15.82:0/3741305681 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7ff7b8046020 con 0x7ff7bc1004f0 2024-03-04T09:13:25.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.628+0000 7ff7b2ffd640 1 --2- 172.21.15.82:0/3741305681 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff7a80a1e00 0x7ff7a80a42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:25.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.628+0000 7ff7c1801640 1 --2- 172.21.15.82:0/3741305681 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff7a80a1e00 0x7ff7a80a42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:25.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.628+0000 7ff7b2ffd640 1 -- 172.21.15.82:0/3741305681 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8802+0+0 (secure 0 0 0) 0x7ff7b80efb00 con 0x7ff7bc1004f0 2024-03-04T09:13:25.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.628+0000 7ff7c1801640 1 --2- 172.21.15.82:0/3741305681 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff7a80a1e00 0x7ff7a80a42c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc10abe0 tx=0x7ff7ac005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:25.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.632+0000 7ff7b2ffd640 1 -- 172.21.15.82:0/3741305681 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7ff7b804d070 con 0x7ff7bc1004f0 2024-03-04T09:13:25.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:25 smithi190 ceph-mon[36341]: pgmap v296: 129 pgs: 129 active+clean; 581 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 0 op/s 2024-03-04T09:13:25.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:25 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/2466723377' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-04T09:13:25.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:25 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/263755493' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-04T09:13:25.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:25 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/949729871' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-04T09:13:25.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:25 smithi102 ceph-mon[36220]: pgmap v296: 129 pgs: 129 active+clean; 581 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 0 op/s 2024-03-04T09:13:25.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:25 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/2466723377' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-04T09:13:25.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:25 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/263755493' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-04T09:13:25.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:25 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/949729871' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-04T09:13:25.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.822+0000 7ff7c4266640 1 -- 172.21.15.82:0/3741305681 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff7bc02cff0 con 0x7ff7bc1004f0 2024-03-04T09:13:25.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.823+0000 7ff7b2ffd640 1 -- 172.21.15.82:0/3741305681 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v90) v1 ==== 81+0+590 (secure 0 0 0) 0x7ff7b80bccf0 con 0x7ff7bc1004f0 2024-03-04T09:13:25.819 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/1901539016 2024-03-05T09:06:12.169231+0000 2024-03-04T09:13:25.820 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1124105204 2024-03-05T09:06:12.169231+0000 2024-03-04T09:13:25.820 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/1901539016 2024-03-05T09:06:12.169231+0000 2024-03-04T09:13:25.820 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/735262841 2024-03-05T09:05:44.913099+0000 2024-03-04T09:13:25.820 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/2402774828 2024-03-05T09:05:44.913099+0000 2024-03-04T09:13:25.820 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/3291527077 2024-03-05T09:05:44.913099+0000 2024-03-04T09:13:25.820 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1846720385 2024-03-05T09:05:44.913099+0000 2024-03-04T09:13:25.820 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3757201752 2024-03-05T09:06:12.169231+0000 2024-03-04T09:13:25.820 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/3291527077 2024-03-05T09:05:44.913099+0000 2024-03-04T09:13:25.821 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/984630078 2024-03-05T09:06:12.169231+0000 2024-03-04T09:13:25.821 INFO:teuthology.orchestra.run.smithi082.stderr:listed 10 entries 2024-03-04T09:13:25.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.825+0000 7ff7c4266640 1 -- 172.21.15.82:0/3741305681 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff7a80a1e00 msgr2=0x7ff7a80a42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:25.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.825+0000 7ff7c4266640 1 --2- 172.21.15.82:0/3741305681 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff7a80a1e00 0x7ff7a80a42c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc10abe0 tx=0x7ff7ac005f90 comp rx=0 tx=0).stop 2024-03-04T09:13:25.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.825+0000 7ff7c4266640 1 -- 172.21.15.82:0/3741305681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7bc1004f0 msgr2=0x7ff7bc10ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:25.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.825+0000 7ff7c4266640 1 --2- 172.21.15.82:0/3741305681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7bc1004f0 0x7ff7bc10ae70 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8005ab0 tx=0x7ff7b8005de0 comp rx=0 tx=0).stop 2024-03-04T09:13:25.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.825+0000 7ff7c4266640 1 -- 172.21.15.82:0/3741305681 shutdown_connections 2024-03-04T09:13:25.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.825+0000 7ff7c4266640 1 --2- 172.21.15.82:0/3741305681 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff7a80a1e00 0x7ff7a80a42c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:25.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.825+0000 7ff7c4266640 1 --2- 172.21.15.82:0/3741305681 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7bc1020a0 0x7ff7bc1099f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:25.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.825+0000 7ff7c4266640 1 --2- 172.21.15.82:0/3741305681 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff7bc1016e0 0x7ff7bc1094b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:25.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.825+0000 7ff7c4266640 1 --2- 172.21.15.82:0/3741305681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7bc1004f0 0x7ff7bc10ae70 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:25.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.825+0000 7ff7c4266640 1 -- 172.21.15.82:0/3741305681 >> 172.21.15.82:0/3741305681 conn(0x7ff7bc0fba80 msgr2=0x7ff7bc104ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:25.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.825+0000 7ff7c4266640 1 -- 172.21.15.82:0/3741305681 shutdown_connections 2024-03-04T09:13:25.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:25.825+0000 7ff7c4266640 1 -- 172.21.15.82:0/3741305681 wait complete. 2024-03-04T09:13:25.832 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi082.front.sepia.ceph.com... 2024-03-04T09:13:25.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T09:13:25.833 DEBUG:teuthology.orchestra.run.smithi082:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-03-04T09:13:25.858 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi082.stderr:ceph-fuse[76402]: fuse finished with error 0 and tester_r 0 2024-03-04T09:13:25.860 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T09:13:26.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:26 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/4232086624' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-04T09:13:26.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:26 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/3741305681' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-04T09:13:26.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:26 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/4232086624' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-04T09:13:26.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:26 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/3741305681' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-04T09:13:26.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:26 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/4232086624' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-04T09:13:26.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:26 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/3741305681' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-04T09:13:27.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:27 smithi190 ceph-mon[36341]: pgmap v297: 129 pgs: 129 active+clean; 581 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 293 B/s wr, 0 op/s 2024-03-04T09:13:27.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:27 smithi102 ceph-mon[36220]: pgmap v297: 129 pgs: 129 active+clean; 581 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 293 B/s wr, 0 op/s 2024-03-04T09:13:27.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:27 smithi082 ceph-mon[32880]: pgmap v297: 129 pgs: 129 active+clean; 581 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 293 B/s wr, 0 op/s 2024-03-04T09:13:29.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:29 smithi082 ceph-mon[32880]: pgmap v298: 129 pgs: 129 active+clean; 581 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-03-04T09:13:29.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:29 smithi190 ceph-mon[36341]: pgmap v298: 129 pgs: 129 active+clean; 581 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-03-04T09:13:29.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:29 smithi102 ceph-mon[36220]: pgmap v298: 129 pgs: 129 active+clean; 581 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-03-04T09:13:31.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:31 smithi190 ceph-mon[36341]: pgmap v299: 129 pgs: 129 active+clean; 581 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-03-04T09:13:31.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:31 smithi102 ceph-mon[36220]: pgmap v299: 129 pgs: 129 active+clean; 581 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-03-04T09:13:31.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:31 smithi082 ceph-mon[32880]: pgmap v299: 129 pgs: 129 active+clean; 581 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-03-04T09:13:31.962 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2024-03-04T09:13:31.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T09:13:31.962 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-03-04T09:13:31.988 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T09:13:32.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.134+0000 7ff6d369a640 1 -- 172.21.15.82:0/144505848 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff6cc1027e0 msgr2=0x7ff6cc102c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:32.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.134+0000 7ff6d369a640 1 --2- 172.21.15.82:0/144505848 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff6cc1027e0 0x7ff6cc102c60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc009900 tx=0x7ff6bc02bc50 comp rx=0 tx=0).stop 2024-03-04T09:13:32.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.135+0000 7ff6d369a640 1 -- 172.21.15.82:0/144505848 shutdown_connections 2024-03-04T09:13:32.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.135+0000 7ff6d369a640 1 --2- 172.21.15.82:0/144505848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6cc1031a0 0x7ff6cc109a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:32.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.135+0000 7ff6d369a640 1 --2- 172.21.15.82:0/144505848 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff6cc1027e0 0x7ff6cc102c60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:32.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.135+0000 7ff6d369a640 1 --2- 172.21.15.82:0/144505848 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6cc1015f0 0x7ff6cc101a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:32.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.135+0000 7ff6d369a640 1 -- 172.21.15.82:0/144505848 >> 172.21.15.82:0/144505848 conn(0x7ff6cc0fcb80 msgr2=0x7ff6cc0fefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:32.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.135+0000 7ff6d369a640 1 -- 172.21.15.82:0/144505848 shutdown_connections 2024-03-04T09:13:32.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.135+0000 7ff6d369a640 1 -- 172.21.15.82:0/144505848 wait complete. 2024-03-04T09:13:32.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.135+0000 7ff6d369a640 1 Processor -- start 2024-03-04T09:13:32.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.135+0000 7ff6d369a640 1 -- start start 2024-03-04T09:13:32.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.135+0000 7ff6d369a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff6cc1015f0 0x7ff6cc197870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:32.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.135+0000 7ff6d369a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6cc1027e0 0x7ff6cc197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:32.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.135+0000 7ff6d369a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6cc1031a0 0x7ff6cc19ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:32.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.135+0000 7ff6d369a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6cc10d250 con 0x7ff6cc1027e0 2024-03-04T09:13:32.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.135+0000 7ff6d369a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6cc10d0d0 con 0x7ff6cc1015f0 2024-03-04T09:13:32.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.135+0000 7ff6d369a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6cc10d3d0 con 0x7ff6cc1031a0 2024-03-04T09:13:32.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.135+0000 7ff6d0c35640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6cc1027e0 0x7ff6cc197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:32.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.135+0000 7ff6d0c35640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6cc1027e0 0x7ff6cc197db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38320/0 (socket says 172.21.15.82:38320) 2024-03-04T09:13:32.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.135+0000 7ff6d0c35640 1 -- 172.21.15.82:0/2178058043 learned_addr learned my addr 172.21.15.82:0/2178058043 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:32.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.135+0000 7ff6d1436640 1 --2- 172.21.15.82:0/2178058043 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff6cc1015f0 0x7ff6cc197870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:32.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.136+0000 7ff6d1c37640 1 --2- 172.21.15.82:0/2178058043 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6cc1031a0 0x7ff6cc19ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:32.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.136+0000 7ff6d0c35640 1 -- 172.21.15.82:0/2178058043 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6cc1031a0 msgr2=0x7ff6cc19ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:32.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.136+0000 7ff6d0c35640 1 --2- 172.21.15.82:0/2178058043 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6cc1031a0 0x7ff6cc19ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:32.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.136+0000 7ff6d0c35640 1 -- 172.21.15.82:0/2178058043 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff6cc1015f0 msgr2=0x7ff6cc197870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:32.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.136+0000 7ff6d0c35640 1 --2- 172.21.15.82:0/2178058043 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff6cc1015f0 0x7ff6cc197870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:32.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.136+0000 7ff6d0c35640 1 -- 172.21.15.82:0/2178058043 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6cc19f490 con 0x7ff6cc1027e0 2024-03-04T09:13:32.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.136+0000 7ff6d0c35640 1 --2- 172.21.15.82:0/2178058043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6cc1027e0 0x7ff6cc197db0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc02efd0 tx=0x7ff6bc004e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:32.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.136+0000 7ff6c27fc640 1 -- 172.21.15.82:0/2178058043 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc041070 con 0x7ff6cc1027e0 2024-03-04T09:13:32.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.136+0000 7ff6c27fc640 1 -- 172.21.15.82:0/2178058043 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7ff6bc0044d0 con 0x7ff6cc1027e0 2024-03-04T09:13:32.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.136+0000 7ff6d369a640 1 -- 172.21.15.82:0/2178058043 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6cc19f720 con 0x7ff6cc1027e0 2024-03-04T09:13:32.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.136+0000 7ff6c27fc640 1 -- 172.21.15.82:0/2178058043 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc034440 con 0x7ff6cc1027e0 2024-03-04T09:13:32.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.136+0000 7ff6d369a640 1 -- 172.21.15.82:0/2178058043 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6cc19fc10 con 0x7ff6cc1027e0 2024-03-04T09:13:32.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.137+0000 7ff6d369a640 1 -- 172.21.15.82:0/2178058043 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6cc108960 con 0x7ff6cc1027e0 2024-03-04T09:13:32.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.138+0000 7ff6c27fc640 1 -- 172.21.15.82:0/2178058043 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7ff6bc044070 con 0x7ff6cc1027e0 2024-03-04T09:13:32.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.139+0000 7ff6c27fc640 1 --2- 172.21.15.82:0/2178058043 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff6b80a1d80 0x7ff6b80a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:32.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.139+0000 7ff6d1436640 1 --2- 172.21.15.82:0/2178058043 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff6b80a1d80 0x7ff6b80a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:32.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.139+0000 7ff6c27fc640 1 -- 172.21.15.82:0/2178058043 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8802+0+0 (secure 0 0 0) 0x7ff6bc0efc10 con 0x7ff6cc1027e0 2024-03-04T09:13:32.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.139+0000 7ff6d1436640 1 --2- 172.21.15.82:0/2178058043 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff6b80a1d80 0x7ff6b80a4240 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc102640 tx=0x7ff6c8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:32.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.143+0000 7ff6c27fc640 1 -- 172.21.15.82:0/2178058043 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7ff6bc0bce00 con 0x7ff6cc1027e0 2024-03-04T09:13:32.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.319+0000 7ff6d369a640 1 -- 172.21.15.82:0/2178058043 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6cc0621d0 con 0x7ff6cc1027e0 2024-03-04T09:13:32.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.320+0000 7ff6c27fc640 1 -- 172.21.15.82:0/2178058043 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+24092 (secure 0 0 0) 0x7ff6bc0bc700 con 0x7ff6cc1027e0 2024-03-04T09:13:32.317 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:13:32.317 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":90,"fsid":"2e533fc8-da06-11ee-95c6-87774f69a715","created":"2024-03-04T09:05:16.488249+0000","modified":"2024-03-04T09:13:15.136817+0000","last_up_change":"2024-03-04T09:12:22.308711+0000","last_in_change":"2024-03-04T09:12:02.548212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T09:08:36.508257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T09:13:07.981726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T09:13:09.289799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-04T09:13:13.008516+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"085b5c4b-ede9-4d0d-b994-50c89d991012","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6803","nonce":709655235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6805","nonce":709655235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6809","nonce":709655235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6807","nonce":709655235}]},"public_addr":"172.21.15.82:6803/709655235","cluster_addr":"172.21.15.82:6805/709655235","heartbeat_back_addr":"172.21.15.82:6809/709655235","heartbeat_front_addr":"172.21.15.82:6807/709655235","state":["exists","up"]},{"osd":1,"uuid":"e4dd7079-333e-4bcf-b3af-11fb082a5af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6801","nonce":270721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6803","nonce":270721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6807","nonce":270721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6805","nonce":270721212}]},"public_addr":"172.21.15.102:6801/270721212","cluster_addr":"172.21.15.102:6803/270721212","heartbeat_back_addr":"172.21.15.102:6807/270721212","heartbeat_front_addr":"172.21.15.102:6805/270721212","state":["exists","up"]},{"osd":2,"uuid":"6fed5fd6-dc82-497f-9d69-c10a5e5802da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6801","nonce":946410459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6803","nonce":946410459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6807","nonce":946410459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6805","nonce":946410459}]},"public_addr":"172.21.15.190:6801/946410459","cluster_addr":"172.21.15.190:6803/946410459","heartbeat_back_addr":"172.21.15.190:6807/946410459","heartbeat_front_addr":"172.21.15.190:6805/946410459","state":["exists","up"]},{"osd":3,"uuid":"91ccbdc3-3da6-4d39-8a89-3a7b7bb4adc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6811","nonce":980870924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6813","nonce":980870924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6817","nonce":980870924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6815","nonce":980870924}]},"public_addr":"172.21.15.82:6811/980870924","cluster_addr":"172.21.15.82:6813/980870924","heartbeat_back_addr":"172.21.15.82:6817/980870924","heartbeat_front_addr":"172.21.15.82:6815/980870924","state":["exists","up"]},{"osd":4,"uuid":"dbb9d486-5daa-4819-bbed-04fc76ca473e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6809","nonce":1229627753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6811","nonce":1229627753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6815","nonce":1229627753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6813","nonce":1229627753}]},"public_addr":"172.21.15.102:6809/1229627753","cluster_addr":"172.21.15.102:6811/1229627753","heartbeat_back_addr":"172.21.15.102:6815/1229627753","heartbeat_front_addr":"172.21.15.102:6813/1229627753","state":["exists","up"]},{"osd":5,"uuid":"6b50127b-df2b-4c95-8e53-9d42b40273fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6809","nonce":2171194148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6811","nonce":2171194148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6815","nonce":2171194148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6813","nonce":2171194148}]},"public_addr":"172.21.15.190:6809/2171194148","cluster_addr":"172.21.15.190:6811/2171194148","heartbeat_back_addr":"172.21.15.190:6815/2171194148","heartbeat_front_addr":"172.21.15.190:6813/2171194148","state":["exists","up"]},{"osd":6,"uuid":"e72bebb0-5939-4210-950a-41c25c23c62f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6819","nonce":454436959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6821","nonce":454436959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6825","nonce":454436959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6823","nonce":454436959}]},"public_addr":"172.21.15.82:6819/454436959","cluster_addr":"172.21.15.82:6821/454436959","heartbeat_back_addr":"172.21.15.82:6825/454436959","heartbeat_front_addr":"172.21.15.82:6823/454436959","state":["exists","up"]},{"osd":7,"uuid":"72f83f97-f496-4503-8284-6a7b8f99a6f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6817","nonce":2745057274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6819","nonce":2745057274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6823","nonce":2745057274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6821","nonce":2745057274}]},"public_addr":"172.21.15.102:6817/2745057274","cluster_addr":"172.21.15.102:6819/2745057274","heartbeat_back_addr":"172.21.15.102:6823/2745057274","heartbeat_front_addr":"172.21.15.102:6821/2745057274","state":["exists","up"]},{"osd":8,"uuid":"92c9109d-6ebb-4c50-9944-28cd7b2f9c0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6817","nonce":1679683516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6819","nonce":1679683516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6823","nonce":1679683516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6821","nonce":1679683516}]},"public_addr":"172.21.15.190:6817/1679683516","cluster_addr":"172.21.15.190:6819/1679683516","heartbeat_back_addr":"172.21.15.190:6823/1679683516","heartbeat_front_addr":"172.21.15.190:6821/1679683516","state":["exists","up"]},{"osd":9,"uuid":"a3cfce03-0148-475d-bf55-b8284ae1cad2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6827","nonce":1777272933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6829","nonce":1777272933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6833","nonce":1777272933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6831","nonce":1777272933}]},"public_addr":"172.21.15.82:6827/1777272933","cluster_addr":"172.21.15.82:6829/1777272933","heartbeat_back_addr":"172.21.15.82:6833/1777272933","heartbeat_front_addr":"172.21.15.82:6831/1777272933","state":["exists","up"]},{"osd":10,"uuid":"db156ccf-4396-43cb-b69a-bb9095b94b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6825","nonce":1012784035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6827","nonce":1012784035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6831","nonce":1012784035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6829","nonce":1012784035}]},"public_addr":"172.21.15.102:6825/1012784035","cluster_addr":"172.21.15.102:6827/1012784035","heartbeat_back_addr":"172.21.15.102:6831/1012784035","heartbeat_front_addr":"172.21.15.102:6829/1012784035","state":["exists","up"]},{"osd":11,"uuid":"b4d52576-f5b4-479f-8ff6-8fdba4635ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6825","nonce":144700355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6827","nonce":144700355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6831","nonce":144700355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6829","nonce":144700355}]},"public_addr":"172.21.15.190:6825/144700355","cluster_addr":"172.21.15.190:6827/144700355","heartbeat_back_addr":"172.21.15.190:6831/144700355","heartbeat_front_addr":"172.21.15.190:6829/144700355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:07:47.007772+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:09.944738+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:33.183567+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:58.302023+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:09:23.042488+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:09:47.616009+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:10:13.122887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:10:38.584530+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:03.473453+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:29.847105+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:55.152195+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:12:20.401765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6800/1901539016":"2024-03-05T09:06:12.169231+0000","172.21.15.82:0/1124105204":"2024-03-05T09:06:12.169231+0000","172.21.15.82:6801/1901539016":"2024-03-05T09:06:12.169231+0000","172.21.15.82:0/735262841":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/2402774828":"2024-03-05T09:05:44.913099+0000","172.21.15.82:6801/3291527077":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/1846720385":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/3757201752":"2024-03-05T09:06:12.169231+0000","172.21.15.82:6800/3291527077":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/984630078":"2024-03-05T09:06:12.169231+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T09:13:32.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.322+0000 7ff6d369a640 1 -- 172.21.15.82:0/2178058043 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff6b80a1d80 msgr2=0x7ff6b80a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:32.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.322+0000 7ff6d369a640 1 --2- 172.21.15.82:0/2178058043 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff6b80a1d80 0x7ff6b80a4240 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc102640 tx=0x7ff6c8005f90 comp rx=0 tx=0).stop 2024-03-04T09:13:32.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.322+0000 7ff6d369a640 1 -- 172.21.15.82:0/2178058043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6cc1027e0 msgr2=0x7ff6cc197db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:32.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.322+0000 7ff6d369a640 1 --2- 172.21.15.82:0/2178058043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6cc1027e0 0x7ff6cc197db0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc02efd0 tx=0x7ff6bc004e20 comp rx=0 tx=0).stop 2024-03-04T09:13:32.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.322+0000 7ff6d369a640 1 -- 172.21.15.82:0/2178058043 shutdown_connections 2024-03-04T09:13:32.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.322+0000 7ff6d369a640 1 --2- 172.21.15.82:0/2178058043 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff6b80a1d80 0x7ff6b80a4240 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:32.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.322+0000 7ff6d369a640 1 --2- 172.21.15.82:0/2178058043 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6cc1031a0 0x7ff6cc19ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:32.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.322+0000 7ff6d369a640 1 --2- 172.21.15.82:0/2178058043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6cc1027e0 0x7ff6cc197db0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:32.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.322+0000 7ff6d369a640 1 --2- 172.21.15.82:0/2178058043 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff6cc1015f0 0x7ff6cc197870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:32.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.322+0000 7ff6d369a640 1 -- 172.21.15.82:0/2178058043 >> 172.21.15.82:0/2178058043 conn(0x7ff6cc0fcb80 msgr2=0x7ff6cc105b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:32.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.322+0000 7ff6d369a640 1 -- 172.21.15.82:0/2178058043 shutdown_connections 2024-03-04T09:13:32.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.322+0000 7ff6d369a640 1 -- 172.21.15.82:0/2178058043 wait complete. 2024-03-04T09:13:32.331 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T09:13:32.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.436+0000 7f3c314eb640 1 -- 172.21.15.82:0/2527951905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c2c1049c0 msgr2=0x7f3c2c106db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:32.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.436+0000 7f3c314eb640 1 --2- 172.21.15.82:0/2527951905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c2c1049c0 0x7f3c2c106db0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3c20009ca0 tx=0x7f3c2002c0f0 comp rx=0 tx=0).stop 2024-03-04T09:13:32.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.436+0000 7f3c314eb640 1 -- 172.21.15.82:0/2527951905 shutdown_connections 2024-03-04T09:13:32.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.436+0000 7f3c314eb640 1 --2- 172.21.15.82:0/2527951905 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3c2c1072f0 0x7f3c2c109740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:32.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.436+0000 7f3c314eb640 1 --2- 172.21.15.82:0/2527951905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c2c1049c0 0x7f3c2c106db0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:32.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.436+0000 7f3c314eb640 1 --2- 172.21.15.82:0/2527951905 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3c2c102090 0x7f3c2c104480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:32.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.436+0000 7f3c314eb640 1 -- 172.21.15.82:0/2527951905 >> 172.21.15.82:0/2527951905 conn(0x7f3c2c0fba80 msgr2=0x7f3c2c0fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:32.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.436+0000 7f3c314eb640 1 -- 172.21.15.82:0/2527951905 shutdown_connections 2024-03-04T09:13:32.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.436+0000 7f3c314eb640 1 -- 172.21.15.82:0/2527951905 wait complete. 2024-03-04T09:13:32.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.436+0000 7f3c314eb640 1 Processor -- start 2024-03-04T09:13:32.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.437+0000 7f3c314eb640 1 -- start start 2024-03-04T09:13:32.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.437+0000 7f3c314eb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3c2c102090 0x7f3c2c1979a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:32.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.437+0000 7f3c314eb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c2c1049c0 0x7f3c2c197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:32.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.437+0000 7f3c314eb640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3c2c1072f0 0x7f3c2c19ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:32.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.437+0000 7f3c314eb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2c10d2d0 con 0x7f3c2c1049c0 2024-03-04T09:13:32.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.437+0000 7f3c314eb640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2c10d150 con 0x7f3c2c102090 2024-03-04T09:13:32.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.437+0000 7f3c314eb640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2c10d450 con 0x7f3c2c1072f0 2024-03-04T09:13:32.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.437+0000 7f3c2a7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c2c1049c0 0x7f3c2c197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:32.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.437+0000 7f3c2a7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c2c1049c0 0x7f3c2c197ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38344/0 (socket says 172.21.15.82:38344) 2024-03-04T09:13:32.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.437+0000 7f3c2a7fc640 1 -- 172.21.15.82:0/3872014304 learned_addr learned my addr 172.21.15.82:0/3872014304 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:32.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.437+0000 7f3c2affd640 1 --2- 172.21.15.82:0/3872014304 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3c2c102090 0x7f3c2c1979a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:32.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.437+0000 7f3c2a7fc640 1 -- 172.21.15.82:0/3872014304 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3c2c1072f0 msgr2=0x7f3c2c19ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:32.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.437+0000 7f3c2a7fc640 1 --2- 172.21.15.82:0/3872014304 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3c2c1072f0 0x7f3c2c19ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:32.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.437+0000 7f3c2a7fc640 1 -- 172.21.15.82:0/3872014304 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3c2c102090 msgr2=0x7f3c2c1979a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:32.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.437+0000 7f3c2a7fc640 1 --2- 172.21.15.82:0/3872014304 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3c2c102090 0x7f3c2c1979a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:32.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.437+0000 7f3c2a7fc640 1 -- 172.21.15.82:0/3872014304 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c2c19f5c0 con 0x7f3c2c1049c0 2024-03-04T09:13:32.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.437+0000 7f3c2a7fc640 1 --2- 172.21.15.82:0/3872014304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c2c1049c0 0x7f3c2c197ee0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3c2002c630 tx=0x7f3c20032980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:32.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.437+0000 7f3c13fff640 1 -- 172.21.15.82:0/3872014304 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c20039050 con 0x7f3c2c1049c0 2024-03-04T09:13:32.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.437+0000 7f3c13fff640 1 -- 172.21.15.82:0/3872014304 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f3c2003a040 con 0x7f3c2c1049c0 2024-03-04T09:13:32.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.437+0000 7f3c13fff640 1 -- 172.21.15.82:0/3872014304 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c20040450 con 0x7f3c2c1049c0 2024-03-04T09:13:32.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.437+0000 7f3c314eb640 1 -- 172.21.15.82:0/3872014304 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c2c19f850 con 0x7f3c2c1049c0 2024-03-04T09:13:32.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.438+0000 7f3c314eb640 1 -- 172.21.15.82:0/3872014304 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c2c19fe10 con 0x7f3c2c1049c0 2024-03-04T09:13:32.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.439+0000 7f3c314eb640 1 -- 172.21.15.82:0/3872014304 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c2c0fd570 con 0x7f3c2c1049c0 2024-03-04T09:13:32.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.440+0000 7f3c13fff640 1 -- 172.21.15.82:0/3872014304 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f3c20003c00 con 0x7f3c2c1049c0 2024-03-04T09:13:32.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.440+0000 7f3c13fff640 1 --2- 172.21.15.82:0/3872014304 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f3c140a1e00 0x7f3c140a42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:32.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.440+0000 7f3c2affd640 1 --2- 172.21.15.82:0/3872014304 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f3c140a1e00 0x7f3c140a42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:32.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.440+0000 7f3c13fff640 1 -- 172.21.15.82:0/3872014304 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8802+0+0 (secure 0 0 0) 0x7f3c200f1530 con 0x7f3c2c1049c0 2024-03-04T09:13:32.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.441+0000 7f3c2affd640 1 --2- 172.21.15.82:0/3872014304 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f3c140a1e00 0x7f3c140a42c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3c240095f0 tx=0x7f3c24005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:32.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.444+0000 7f3c13fff640 1 -- 172.21.15.82:0/3872014304 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f3c200be720 con 0x7f3c2c1049c0 2024-03-04T09:13:32.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.618+0000 7f3c314eb640 1 -- 172.21.15.82:0/3872014304 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c2c02d240 con 0x7f3c2c1049c0 2024-03-04T09:13:32.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.619+0000 7f3c13fff640 1 -- 172.21.15.82:0/3872014304 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+24092 (secure 0 0 0) 0x7f3c200be020 con 0x7f3c2c1049c0 2024-03-04T09:13:32.616 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:13:32.616 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":90,"fsid":"2e533fc8-da06-11ee-95c6-87774f69a715","created":"2024-03-04T09:05:16.488249+0000","modified":"2024-03-04T09:13:15.136817+0000","last_up_change":"2024-03-04T09:12:22.308711+0000","last_in_change":"2024-03-04T09:12:02.548212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T09:08:36.508257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T09:13:07.981726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T09:13:09.289799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-04T09:13:13.008516+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"085b5c4b-ede9-4d0d-b994-50c89d991012","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6803","nonce":709655235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6805","nonce":709655235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6809","nonce":709655235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6807","nonce":709655235}]},"public_addr":"172.21.15.82:6803/709655235","cluster_addr":"172.21.15.82:6805/709655235","heartbeat_back_addr":"172.21.15.82:6809/709655235","heartbeat_front_addr":"172.21.15.82:6807/709655235","state":["exists","up"]},{"osd":1,"uuid":"e4dd7079-333e-4bcf-b3af-11fb082a5af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6801","nonce":270721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6803","nonce":270721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6807","nonce":270721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6805","nonce":270721212}]},"public_addr":"172.21.15.102:6801/270721212","cluster_addr":"172.21.15.102:6803/270721212","heartbeat_back_addr":"172.21.15.102:6807/270721212","heartbeat_front_addr":"172.21.15.102:6805/270721212","state":["exists","up"]},{"osd":2,"uuid":"6fed5fd6-dc82-497f-9d69-c10a5e5802da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6801","nonce":946410459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6803","nonce":946410459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6807","nonce":946410459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6805","nonce":946410459}]},"public_addr":"172.21.15.190:6801/946410459","cluster_addr":"172.21.15.190:6803/946410459","heartbeat_back_addr":"172.21.15.190:6807/946410459","heartbeat_front_addr":"172.21.15.190:6805/946410459","state":["exists","up"]},{"osd":3,"uuid":"91ccbdc3-3da6-4d39-8a89-3a7b7bb4adc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6811","nonce":980870924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6813","nonce":980870924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6817","nonce":980870924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6815","nonce":980870924}]},"public_addr":"172.21.15.82:6811/980870924","cluster_addr":"172.21.15.82:6813/980870924","heartbeat_back_addr":"172.21.15.82:6817/980870924","heartbeat_front_addr":"172.21.15.82:6815/980870924","state":["exists","up"]},{"osd":4,"uuid":"dbb9d486-5daa-4819-bbed-04fc76ca473e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6809","nonce":1229627753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6811","nonce":1229627753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6815","nonce":1229627753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6813","nonce":1229627753}]},"public_addr":"172.21.15.102:6809/1229627753","cluster_addr":"172.21.15.102:6811/1229627753","heartbeat_back_addr":"172.21.15.102:6815/1229627753","heartbeat_front_addr":"172.21.15.102:6813/1229627753","state":["exists","up"]},{"osd":5,"uuid":"6b50127b-df2b-4c95-8e53-9d42b40273fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6809","nonce":2171194148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6811","nonce":2171194148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6815","nonce":2171194148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6813","nonce":2171194148}]},"public_addr":"172.21.15.190:6809/2171194148","cluster_addr":"172.21.15.190:6811/2171194148","heartbeat_back_addr":"172.21.15.190:6815/2171194148","heartbeat_front_addr":"172.21.15.190:6813/2171194148","state":["exists","up"]},{"osd":6,"uuid":"e72bebb0-5939-4210-950a-41c25c23c62f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6819","nonce":454436959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6821","nonce":454436959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6825","nonce":454436959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6823","nonce":454436959}]},"public_addr":"172.21.15.82:6819/454436959","cluster_addr":"172.21.15.82:6821/454436959","heartbeat_back_addr":"172.21.15.82:6825/454436959","heartbeat_front_addr":"172.21.15.82:6823/454436959","state":["exists","up"]},{"osd":7,"uuid":"72f83f97-f496-4503-8284-6a7b8f99a6f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6817","nonce":2745057274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6819","nonce":2745057274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6823","nonce":2745057274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6821","nonce":2745057274}]},"public_addr":"172.21.15.102:6817/2745057274","cluster_addr":"172.21.15.102:6819/2745057274","heartbeat_back_addr":"172.21.15.102:6823/2745057274","heartbeat_front_addr":"172.21.15.102:6821/2745057274","state":["exists","up"]},{"osd":8,"uuid":"92c9109d-6ebb-4c50-9944-28cd7b2f9c0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6817","nonce":1679683516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6819","nonce":1679683516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6823","nonce":1679683516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6821","nonce":1679683516}]},"public_addr":"172.21.15.190:6817/1679683516","cluster_addr":"172.21.15.190:6819/1679683516","heartbeat_back_addr":"172.21.15.190:6823/1679683516","heartbeat_front_addr":"172.21.15.190:6821/1679683516","state":["exists","up"]},{"osd":9,"uuid":"a3cfce03-0148-475d-bf55-b8284ae1cad2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6827","nonce":1777272933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6829","nonce":1777272933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6833","nonce":1777272933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6831","nonce":1777272933}]},"public_addr":"172.21.15.82:6827/1777272933","cluster_addr":"172.21.15.82:6829/1777272933","heartbeat_back_addr":"172.21.15.82:6833/1777272933","heartbeat_front_addr":"172.21.15.82:6831/1777272933","state":["exists","up"]},{"osd":10,"uuid":"db156ccf-4396-43cb-b69a-bb9095b94b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6825","nonce":1012784035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6827","nonce":1012784035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6831","nonce":1012784035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6829","nonce":1012784035}]},"public_addr":"172.21.15.102:6825/1012784035","cluster_addr":"172.21.15.102:6827/1012784035","heartbeat_back_addr":"172.21.15.102:6831/1012784035","heartbeat_front_addr":"172.21.15.102:6829/1012784035","state":["exists","up"]},{"osd":11,"uuid":"b4d52576-f5b4-479f-8ff6-8fdba4635ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6825","nonce":144700355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6827","nonce":144700355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6831","nonce":144700355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6829","nonce":144700355}]},"public_addr":"172.21.15.190:6825/144700355","cluster_addr":"172.21.15.190:6827/144700355","heartbeat_back_addr":"172.21.15.190:6831/144700355","heartbeat_front_addr":"172.21.15.190:6829/144700355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:07:47.007772+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:09.944738+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:33.183567+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:58.302023+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:09:23.042488+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:09:47.616009+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:10:13.122887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:10:38.584530+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:03.473453+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:29.847105+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:55.152195+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:12:20.401765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6800/1901539016":"2024-03-05T09:06:12.169231+0000","172.21.15.82:0/1124105204":"2024-03-05T09:06:12.169231+0000","172.21.15.82:6801/1901539016":"2024-03-05T09:06:12.169231+0000","172.21.15.82:0/735262841":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/2402774828":"2024-03-05T09:05:44.913099+0000","172.21.15.82:6801/3291527077":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/1846720385":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/3757201752":"2024-03-05T09:06:12.169231+0000","172.21.15.82:6800/3291527077":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/984630078":"2024-03-05T09:06:12.169231+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T09:13:32.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.621+0000 7f3c314eb640 1 -- 172.21.15.82:0/3872014304 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f3c140a1e00 msgr2=0x7f3c140a42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:32.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.621+0000 7f3c314eb640 1 --2- 172.21.15.82:0/3872014304 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f3c140a1e00 0x7f3c140a42c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3c240095f0 tx=0x7f3c24005f90 comp rx=0 tx=0).stop 2024-03-04T09:13:32.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.621+0000 7f3c314eb640 1 -- 172.21.15.82:0/3872014304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c2c1049c0 msgr2=0x7f3c2c197ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:32.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.621+0000 7f3c314eb640 1 --2- 172.21.15.82:0/3872014304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c2c1049c0 0x7f3c2c197ee0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3c2002c630 tx=0x7f3c20032980 comp rx=0 tx=0).stop 2024-03-04T09:13:32.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.621+0000 7f3c314eb640 1 -- 172.21.15.82:0/3872014304 shutdown_connections 2024-03-04T09:13:32.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.621+0000 7f3c314eb640 1 --2- 172.21.15.82:0/3872014304 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f3c140a1e00 0x7f3c140a42c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:32.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.621+0000 7f3c314eb640 1 --2- 172.21.15.82:0/3872014304 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3c2c1072f0 0x7f3c2c19ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:32.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.621+0000 7f3c314eb640 1 --2- 172.21.15.82:0/3872014304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c2c1049c0 0x7f3c2c197ee0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:32.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.621+0000 7f3c314eb640 1 --2- 172.21.15.82:0/3872014304 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3c2c102090 0x7f3c2c1979a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:32.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.621+0000 7f3c314eb640 1 -- 172.21.15.82:0/3872014304 >> 172.21.15.82:0/3872014304 conn(0x7f3c2c0fba80 msgr2=0x7f3c2c102950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:32.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.621+0000 7f3c314eb640 1 -- 172.21.15.82:0/3872014304 shutdown_connections 2024-03-04T09:13:32.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.621+0000 7f3c314eb640 1 -- 172.21.15.82:0/3872014304 wait complete. 2024-03-04T09:13:32.627 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:32 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/2178058043' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:13:32.629 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-04T09:13:32.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:32 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/2178058043' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:13:32.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:32 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/2178058043' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:13:32.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.736+0000 7fddc5a4e640 1 -- 172.21.15.82:0/1174002469 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fddc01027f0 msgr2=0x7fddc0102c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:32.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.736+0000 7fddc5a4e640 1 --2- 172.21.15.82:0/1174002469 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fddc01027f0 0x7fddc0102c70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fddb4009860 tx=0x7fddb402bb70 comp rx=0 tx=0).stop 2024-03-04T09:13:32.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.736+0000 7fddc5a4e640 1 -- 172.21.15.82:0/1174002469 shutdown_connections 2024-03-04T09:13:32.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.736+0000 7fddc5a4e640 1 --2- 172.21.15.82:0/1174002469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddc01031b0 0x7fddc0109a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:32.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.736+0000 7fddc5a4e640 1 --2- 172.21.15.82:0/1174002469 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fddc01027f0 0x7fddc0102c70 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:32.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.736+0000 7fddc5a4e640 1 --2- 172.21.15.82:0/1174002469 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fddc0101600 0x7fddc0101a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:32.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.736+0000 7fddc5a4e640 1 -- 172.21.15.82:0/1174002469 >> 172.21.15.82:0/1174002469 conn(0x7fddc00fcb70 msgr2=0x7fddc00fefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:32.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.736+0000 7fddc5a4e640 1 -- 172.21.15.82:0/1174002469 shutdown_connections 2024-03-04T09:13:32.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.736+0000 7fddc5a4e640 1 -- 172.21.15.82:0/1174002469 wait complete. 2024-03-04T09:13:32.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.737+0000 7fddc5a4e640 1 Processor -- start 2024-03-04T09:13:32.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.737+0000 7fddc5a4e640 1 -- start start 2024-03-04T09:13:32.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.737+0000 7fddc5a4e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fddc0101600 0x7fddc0197960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:32.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.737+0000 7fddc5a4e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddc01027f0 0x7fddc0197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:32.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.737+0000 7fddc5a4e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fddc01031b0 0x7fddc019ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:32.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.737+0000 7fddc5a4e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc010d210 con 0x7fddc01027f0 2024-03-04T09:13:32.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.737+0000 7fddc5a4e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc010d090 con 0x7fddc01031b0 2024-03-04T09:13:32.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.737+0000 7fddc5a4e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc010d390 con 0x7fddc0101600 2024-03-04T09:13:32.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.737+0000 7fddbe7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddc01027f0 0x7fddc0197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:32.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.737+0000 7fddbe7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddc01027f0 0x7fddc0197ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38360/0 (socket says 172.21.15.82:38360) 2024-03-04T09:13:32.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.737+0000 7fddbe7fc640 1 -- 172.21.15.82:0/1244882404 learned_addr learned my addr 172.21.15.82:0/1244882404 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:32.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.737+0000 7fddbf7fe640 1 --2- 172.21.15.82:0/1244882404 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fddc01031b0 0x7fddc019ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:32.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.738+0000 7fddbeffd640 1 --2- 172.21.15.82:0/1244882404 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fddc0101600 0x7fddc0197960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:32.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.738+0000 7fddbe7fc640 1 -- 172.21.15.82:0/1244882404 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fddc0101600 msgr2=0x7fddc0197960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:32.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.738+0000 7fddbe7fc640 1 --2- 172.21.15.82:0/1244882404 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fddc0101600 0x7fddc0197960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:32.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.738+0000 7fddbe7fc640 1 -- 172.21.15.82:0/1244882404 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fddc01031b0 msgr2=0x7fddc019ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:32.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.738+0000 7fddbe7fc640 1 --2- 172.21.15.82:0/1244882404 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fddc01031b0 0x7fddc019ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:32.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.738+0000 7fddbe7fc640 1 -- 172.21.15.82:0/1244882404 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc019f580 con 0x7fddc01027f0 2024-03-04T09:13:32.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.738+0000 7fddbe7fc640 1 --2- 172.21.15.82:0/1244882404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddc01027f0 0x7fddc0197ea0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fddb4009980 tx=0x7fddb4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:32.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.738+0000 7fddc4a4c640 1 -- 172.21.15.82:0/1244882404 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb4039050 con 0x7fddc01027f0 2024-03-04T09:13:32.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.738+0000 7fddc5a4e640 1 -- 172.21.15.82:0/1244882404 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddc019f810 con 0x7fddc01027f0 2024-03-04T09:13:32.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.738+0000 7fddc4a4c640 1 -- 172.21.15.82:0/1244882404 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fddb4045070 con 0x7fddc01027f0 2024-03-04T09:13:32.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.738+0000 7fddc4a4c640 1 -- 172.21.15.82:0/1244882404 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb40406b0 con 0x7fddc01027f0 2024-03-04T09:13:32.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.738+0000 7fddc5a4e640 1 -- 172.21.15.82:0/1244882404 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddc019fd50 con 0x7fddc01027f0 2024-03-04T09:13:32.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.739+0000 7fddc5a4e640 1 -- 172.21.15.82:0/1244882404 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddc01089f0 con 0x7fddc01027f0 2024-03-04T09:13:32.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.740+0000 7fddc4a4c640 1 -- 172.21.15.82:0/1244882404 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7fddb40035f0 con 0x7fddc01027f0 2024-03-04T09:13:32.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.740+0000 7fddc4a4c640 1 --2- 172.21.15.82:0/1244882404 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fdda80a1d80 0x7fdda80a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:32.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.741+0000 7fddbeffd640 1 --2- 172.21.15.82:0/1244882404 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fdda80a1d80 0x7fdda80a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:32.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.741+0000 7fddc4a4c640 1 -- 172.21.15.82:0/1244882404 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8802+0+0 (secure 0 0 0) 0x7fddb40eff50 con 0x7fddc01027f0 2024-03-04T09:13:32.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.741+0000 7fddbeffd640 1 --2- 172.21.15.82:0/1244882404 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fdda80a1d80 0x7fdda80a4240 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fddc0102650 tx=0x7fddb0009870 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:32.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.745+0000 7fddc4a4c640 1 -- 172.21.15.82:0/1244882404 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fddb404e020 con 0x7fddc01027f0 2024-03-04T09:13:32.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:32.956+0000 7fddc5a4e640 1 -- 172.21.15.82:0/1244882404 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fddc002cff0 con 0x7fddc01027f0 2024-03-04T09:13:33.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:33.337+0000 7fddc4a4c640 1 -- 172.21.15.82:0/1244882404 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) v1 ==== 118+0+0 (secure 0 0 0) 0x7fddb40dc020 con 0x7fddc01027f0 2024-03-04T09:13:33.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:33.339+0000 7fddc5a4e640 1 -- 172.21.15.82:0/1244882404 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fdda80a1d80 msgr2=0x7fdda80a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:33.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:33.339+0000 7fddc5a4e640 1 --2- 172.21.15.82:0/1244882404 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fdda80a1d80 0x7fdda80a4240 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fddc0102650 tx=0x7fddb0009870 comp rx=0 tx=0).stop 2024-03-04T09:13:33.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:33.339+0000 7fddc5a4e640 1 -- 172.21.15.82:0/1244882404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddc01027f0 msgr2=0x7fddc0197ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:33.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:33.339+0000 7fddc5a4e640 1 --2- 172.21.15.82:0/1244882404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddc01027f0 0x7fddc0197ea0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fddb4009980 tx=0x7fddb4004270 comp rx=0 tx=0).stop 2024-03-04T09:13:33.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:33.339+0000 7fddc5a4e640 1 -- 172.21.15.82:0/1244882404 shutdown_connections 2024-03-04T09:13:33.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:33.339+0000 7fddc5a4e640 1 --2- 172.21.15.82:0/1244882404 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fdda80a1d80 0x7fdda80a4240 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:33.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:33.339+0000 7fddc5a4e640 1 --2- 172.21.15.82:0/1244882404 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fddc01031b0 0x7fddc019ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:33.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:33.339+0000 7fddc5a4e640 1 --2- 172.21.15.82:0/1244882404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddc01027f0 0x7fddc0197ea0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:33.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:33.339+0000 7fddc5a4e640 1 --2- 172.21.15.82:0/1244882404 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fddc0101600 0x7fddc0197960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:33.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:33.339+0000 7fddc5a4e640 1 -- 172.21.15.82:0/1244882404 >> 172.21.15.82:0/1244882404 conn(0x7fddc00fcb70 msgr2=0x7fddc0105bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:33.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:33.339+0000 7fddc5a4e640 1 -- 172.21.15.82:0/1244882404 shutdown_connections 2024-03-04T09:13:33.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:33.339+0000 7fddc5a4e640 1 -- 172.21.15.82:0/1244882404 wait complete. 2024-03-04T09:13:33.348 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-03-04T09:13:33.348 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2024-03-04T09:13:33.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:33.458+0000 7fcc1bd81640 1 -- 172.21.15.82:0/2762161726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc141004d0 msgr2=0x7fcc141008f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:33.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:33.458+0000 7fcc1bd81640 1 --2- 172.21.15.82:0/2762161726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc141004d0 0x7fcc141008f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fcc10009900 tx=0x7fcc1002bc30 comp rx=0 tx=0).stop 2024-03-04T09:13:33.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:33.458+0000 7fcc1bd81640 1 -- 172.21.15.82:0/2762161726 shutdown_connections 2024-03-04T09:13:33.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:33.458+0000 7fcc1bd81640 1 --2- 172.21.15.82:0/2762161726 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc14102080 0x7fcc14108910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:33.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:33.458+0000 7fcc1bd81640 1 --2- 172.21.15.82:0/2762161726 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc141016c0 0x7fcc14101b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:33.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:33.458+0000 7fcc1bd81640 1 --2- 172.21.15.82:0/2762161726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc141004d0 0x7fcc141008f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:33.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:33.458+0000 7fcc1bd81640 1 -- 172.21.15.82:0/2762161726 >> 172.21.15.82:0/2762161726 conn(0x7fcc140fba60 msgr2=0x7fcc140fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:33.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:33.458+0000 7fcc1bd81640 1 -- 172.21.15.82:0/2762161726 shutdown_connections 2024-03-04T09:13:33.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:33.458+0000 7fcc1bd81640 1 -- 172.21.15.82:0/2762161726 wait complete. 2024-03-04T09:13:33.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:33.459+0000 7fcc1bd81640 1 Processor -- start 2024-03-04T09:13:33.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:33.459+0000 7fcc1bd81640 1 -- start start 2024-03-04T09:13:33.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:33.459+0000 7fcc1bd81640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc141004d0 0x7fcc141978e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:33.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:33.459+0000 7fcc1bd81640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc141016c0 0x7fcc14197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:33.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:33.459+0000 7fcc1bd81640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc14102080 0x7fcc1419ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:33.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:33.459+0000 7fcc1bd81640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1410d240 con 0x7fcc141016c0 2024-03-04T09:13:33.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:33.459+0000 7fcc1bd81640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1410d0c0 con 0x7fcc14102080 2024-03-04T09:13:33.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:33.459+0000 7fcc1bd81640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1410d3c0 con 0x7fcc141004d0 2024-03-04T09:13:33.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:33.459+0000 7fcc1931c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc141016c0 0x7fcc14197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:33.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:33.459+0000 7fcc1931c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc141016c0 0x7fcc14197e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38370/0 (socket says 172.21.15.82:38370) 2024-03-04T09:13:33.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:33.459+0000 7fcc1931c640 1 -- 172.21.15.82:0/1422070378 learned_addr learned my addr 172.21.15.82:0/1422070378 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:33.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:33.459+0000 7fcc1a31e640 1 --2- 172.21.15.82:0/1422070378 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc14102080 0x7fcc1419ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:33.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:33.459+0000 7fcc19b1d640 1 --2- 172.21.15.82:0/1422070378 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc141004d0 0x7fcc141978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:33.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:33.459+0000 7fcc1931c640 1 -- 172.21.15.82:0/1422070378 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc141004d0 msgr2=0x7fcc141978e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:33.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:33.459+0000 7fcc1931c640 1 --2- 172.21.15.82:0/1422070378 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc141004d0 0x7fcc141978e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:33.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:33.459+0000 7fcc1931c640 1 -- 172.21.15.82:0/1422070378 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc14102080 msgr2=0x7fcc1419ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:33.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:33.459+0000 7fcc1931c640 1 --2- 172.21.15.82:0/1422070378 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc14102080 0x7fcc1419ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:33.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:33.459+0000 7fcc1931c640 1 -- 172.21.15.82:0/1422070378 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc1419f500 con 0x7fcc141016c0 2024-03-04T09:13:33.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:33.459+0000 7fcc1931c640 1 --2- 172.21.15.82:0/1422070378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc141016c0 0x7fcc14197e20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcc0400e9f0 tx=0x7fcc0400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:33.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:33.459+0000 7fcc0affd640 1 -- 172.21.15.82:0/1422070378 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc0400cd80 con 0x7fcc141016c0 2024-03-04T09:13:33.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:33.459+0000 7fcc0affd640 1 -- 172.21.15.82:0/1422070378 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fcc04010900 con 0x7fcc141016c0 2024-03-04T09:13:33.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:33.460+0000 7fcc0affd640 1 -- 172.21.15.82:0/1422070378 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc040189e0 con 0x7fcc141016c0 2024-03-04T09:13:33.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:33.460+0000 7fcc1bd81640 1 -- 172.21.15.82:0/1422070378 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc1419f7f0 con 0x7fcc141016c0 2024-03-04T09:13:33.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:33.460+0000 7fcc1bd81640 1 -- 172.21.15.82:0/1422070378 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc1419fd40 con 0x7fcc141016c0 2024-03-04T09:13:33.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:33.460+0000 7fcc1bd81640 1 -- 172.21.15.82:0/1422070378 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc141077f0 con 0x7fcc141016c0 2024-03-04T09:13:33.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:33.461+0000 7fcc0affd640 1 -- 172.21.15.82:0/1422070378 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7fcc04010ab0 con 0x7fcc141016c0 2024-03-04T09:13:33.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:33.462+0000 7fcc0affd640 1 --2- 172.21.15.82:0/1422070378 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fcc000a1d80 0x7fcc000a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:33.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:33.462+0000 7fcc19b1d640 1 --2- 172.21.15.82:0/1422070378 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fcc000a1d80 0x7fcc000a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:33.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:33.462+0000 7fcc0affd640 1 -- 172.21.15.82:0/1422070378 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8802+0+0 (secure 0 0 0) 0x7fcc040ce390 con 0x7fcc141016c0 2024-03-04T09:13:33.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:33.462+0000 7fcc19b1d640 1 --2- 172.21.15.82:0/1422070378 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fcc000a1d80 0x7fcc000a4240 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcc10006010 tx=0x7fcc10000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:33.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:33.466+0000 7fcc0affd640 1 -- 172.21.15.82:0/1422070378 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fcc0409b580 con 0x7fcc141016c0 2024-03-04T09:13:33.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:33 smithi190 ceph-mon[36341]: pgmap v300: 129 pgs: 129 active+clean; 581 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-03-04T09:13:33.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:33 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/3872014304' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:13:33.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:33 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/1244882404' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-03-04T09:13:33.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:33.677+0000 7fcc1bd81640 1 -- 172.21.15.82:0/1422070378 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) v1 -- 0x7fcc140621d0 con 0x7fcc141016c0 2024-03-04T09:13:33.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:33 smithi102 ceph-mon[36220]: pgmap v300: 129 pgs: 129 active+clean; 581 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-03-04T09:13:33.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:33 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/3872014304' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:13:33.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:33 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/1244882404' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-03-04T09:13:33.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:33 smithi082 ceph-mon[32880]: pgmap v300: 129 pgs: 129 active+clean; 581 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-03-04T09:13:33.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:33 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/3872014304' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:13:33.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:33 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/1244882404' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-03-04T09:13:34.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.344+0000 7fcc0affd640 1 -- 172.21.15.82:0/1422070378 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v19) v1 ==== 105+0+0 (secure 0 0 0) 0x7fcc0409ae80 con 0x7fcc141016c0 2024-03-04T09:13:34.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.346+0000 7fcc1bd81640 1 -- 172.21.15.82:0/1422070378 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fcc000a1d80 msgr2=0x7fcc000a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:34.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.346+0000 7fcc1bd81640 1 --2- 172.21.15.82:0/1422070378 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fcc000a1d80 0x7fcc000a4240 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcc10006010 tx=0x7fcc10000bc0 comp rx=0 tx=0).stop 2024-03-04T09:13:34.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.346+0000 7fcc1bd81640 1 -- 172.21.15.82:0/1422070378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc141016c0 msgr2=0x7fcc14197e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:34.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.346+0000 7fcc1bd81640 1 --2- 172.21.15.82:0/1422070378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc141016c0 0x7fcc14197e20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcc0400e9f0 tx=0x7fcc0400eeb0 comp rx=0 tx=0).stop 2024-03-04T09:13:34.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.346+0000 7fcc1bd81640 1 -- 172.21.15.82:0/1422070378 shutdown_connections 2024-03-04T09:13:34.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.346+0000 7fcc1bd81640 1 --2- 172.21.15.82:0/1422070378 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fcc000a1d80 0x7fcc000a4240 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:34.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.346+0000 7fcc1bd81640 1 --2- 172.21.15.82:0/1422070378 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc14102080 0x7fcc1419ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:34.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.346+0000 7fcc1bd81640 1 --2- 172.21.15.82:0/1422070378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc141016c0 0x7fcc14197e20 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:34.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.346+0000 7fcc1bd81640 1 --2- 172.21.15.82:0/1422070378 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc141004d0 0x7fcc141978e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:34.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.346+0000 7fcc1bd81640 1 -- 172.21.15.82:0/1422070378 >> 172.21.15.82:0/1422070378 conn(0x7fcc140fba60 msgr2=0x7fcc141049c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:34.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.346+0000 7fcc1bd81640 1 -- 172.21.15.82:0/1422070378 shutdown_connections 2024-03-04T09:13:34.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.346+0000 7fcc1bd81640 1 -- 172.21.15.82:0/1422070378 wait complete. 2024-03-04T09:13:34.359 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2024-03-04T09:13:34.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.471+0000 7f5548a81640 1 -- 172.21.15.82:0/3956000260 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5544103190 msgr2=0x7f5544109a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:34.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.471+0000 7f5548a81640 1 --2- 172.21.15.82:0/3956000260 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5544103190 0x7f5544109a20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f553c009ca0 tx=0x7f553c02c0f0 comp rx=0 tx=0).stop 2024-03-04T09:13:34.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.471+0000 7f5548a81640 1 -- 172.21.15.82:0/3956000260 shutdown_connections 2024-03-04T09:13:34.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.471+0000 7f5548a81640 1 --2- 172.21.15.82:0/3956000260 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5544103190 0x7f5544109a20 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:34.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.471+0000 7f5548a81640 1 --2- 172.21.15.82:0/3956000260 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55441027d0 0x7f5544102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:34.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.471+0000 7f5548a81640 1 --2- 172.21.15.82:0/3956000260 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f55441015e0 0x7f5544101a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:34.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.471+0000 7f5548a81640 1 -- 172.21.15.82:0/3956000260 >> 172.21.15.82:0/3956000260 conn(0x7f55440fcb70 msgr2=0x7f55440fef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:34.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.471+0000 7f5548a81640 1 -- 172.21.15.82:0/3956000260 shutdown_connections 2024-03-04T09:13:34.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.471+0000 7f5548a81640 1 -- 172.21.15.82:0/3956000260 wait complete. 2024-03-04T09:13:34.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.471+0000 7f5548a81640 1 Processor -- start 2024-03-04T09:13:34.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.472+0000 7f5548a81640 1 -- start start 2024-03-04T09:13:34.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.472+0000 7f5548a81640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55441015e0 0x7f5544197890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:34.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.472+0000 7f5548a81640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55441027d0 0x7f5544197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:34.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.472+0000 7f5548a81640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5544103190 0x7f554419ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:34.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.472+0000 7f5548a81640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554410d240 con 0x7f55441015e0 2024-03-04T09:13:34.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.472+0000 7f5548a81640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554410d0c0 con 0x7f5544103190 2024-03-04T09:13:34.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.472+0000 7f5548a81640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554410d3c0 con 0x7f55441027d0 2024-03-04T09:13:34.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.472+0000 7f554259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55441015e0 0x7f5544197890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:34.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.472+0000 7f554259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55441015e0 0x7f5544197890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38384/0 (socket says 172.21.15.82:38384) 2024-03-04T09:13:34.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.472+0000 7f554259c640 1 -- 172.21.15.82:0/1705358120 learned_addr learned my addr 172.21.15.82:0/1705358120 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:34.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.472+0000 7f553bfff640 1 --2- 172.21.15.82:0/1705358120 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55441027d0 0x7f5544197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:34.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.472+0000 7f554259c640 1 -- 172.21.15.82:0/1705358120 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55441027d0 msgr2=0x7f5544197dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:34.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.472+0000 7f554259c640 1 --2- 172.21.15.82:0/1705358120 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55441027d0 0x7f5544197dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:34.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.472+0000 7f554259c640 1 -- 172.21.15.82:0/1705358120 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5544103190 msgr2=0x7f554419ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:34.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.472+0000 7f5542d9d640 1 --2- 172.21.15.82:0/1705358120 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5544103190 0x7f554419ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:34.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.472+0000 7f554259c640 1 --2- 172.21.15.82:0/1705358120 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5544103190 0x7f554419ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:34.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.472+0000 7f554259c640 1 -- 172.21.15.82:0/1705358120 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f554419f4b0 con 0x7f55441015e0 2024-03-04T09:13:34.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.472+0000 7f5542d9d640 1 --2- 172.21.15.82:0/1705358120 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5544103190 0x7f554419ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T09:13:34.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.472+0000 7f554259c640 1 --2- 172.21.15.82:0/1705358120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55441015e0 0x7f5544197890 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f553400d950 tx=0x7f553400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:34.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.472+0000 7f553b7fe640 1 -- 172.21.15.82:0/1705358120 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5534017020 con 0x7f55441015e0 2024-03-04T09:13:34.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.472+0000 7f553b7fe640 1 -- 172.21.15.82:0/1705358120 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f5534009c30 con 0x7f55441015e0 2024-03-04T09:13:34.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.472+0000 7f5548a81640 1 -- 172.21.15.82:0/1705358120 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f554419f7a0 con 0x7f55441015e0 2024-03-04T09:13:34.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.472+0000 7f553b7fe640 1 -- 172.21.15.82:0/1705358120 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553400f740 con 0x7f55441015e0 2024-03-04T09:13:34.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.472+0000 7f5548a81640 1 -- 172.21.15.82:0/1705358120 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f554419fcf0 con 0x7f55441015e0 2024-03-04T09:13:34.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.473+0000 7f5548a81640 1 -- 172.21.15.82:0/1705358120 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5544108900 con 0x7f55441015e0 2024-03-04T09:13:34.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.474+0000 7f553b7fe640 1 -- 172.21.15.82:0/1705358120 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f553401a020 con 0x7f55441015e0 2024-03-04T09:13:34.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.475+0000 7f553b7fe640 1 --2- 172.21.15.82:0/1705358120 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f55300a1d80 0x7f55300a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:34.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.475+0000 7f553bfff640 1 --2- 172.21.15.82:0/1705358120 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f55300a1d80 0x7f55300a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:34.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.475+0000 7f553b7fe640 1 -- 172.21.15.82:0/1705358120 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8802+0+0 (secure 0 0 0) 0x7f55340ce010 con 0x7f55441015e0 2024-03-04T09:13:34.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.475+0000 7f553bfff640 1 --2- 172.21.15.82:0/1705358120 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f55300a1d80 0x7f55300a4240 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f552c005d70 tx=0x7f552c005d00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:34.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.479+0000 7f553b7fe640 1 -- 172.21.15.82:0/1705358120 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f5534021020 con 0x7f55441015e0 2024-03-04T09:13:34.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:34 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/1244882404' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-03-04T09:13:34.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:34 smithi190 ceph-mon[36341]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-04T09:13:34.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:34 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/1422070378' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-03-04T09:13:34.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:34 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/1244882404' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-03-04T09:13:34.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:34 smithi102 ceph-mon[36220]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-04T09:13:34.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:34 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/1422070378' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-03-04T09:13:34.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:34.690+0000 7f5548a81640 1 -- 172.21.15.82:0/1705358120 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f554402cff0 con 0x7f55441015e0 2024-03-04T09:13:34.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:34 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/1244882404' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-03-04T09:13:34.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:34 smithi082 ceph-mon[32880]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-04T09:13:34.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:34 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/1422070378' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-03-04T09:13:35.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:35.350+0000 7f553b7fe640 1 -- 172.21.15.82:0/1705358120 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v21) v1 ==== 121+0+0 (secure 0 0 0) 0x7f553409b200 con 0x7f55441015e0 2024-03-04T09:13:35.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:35.352+0000 7f5548a81640 1 -- 172.21.15.82:0/1705358120 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f55300a1d80 msgr2=0x7f55300a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:35.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:35.352+0000 7f5548a81640 1 --2- 172.21.15.82:0/1705358120 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f55300a1d80 0x7f55300a4240 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f552c005d70 tx=0x7f552c005d00 comp rx=0 tx=0).stop 2024-03-04T09:13:35.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:35.352+0000 7f5548a81640 1 -- 172.21.15.82:0/1705358120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55441015e0 msgr2=0x7f5544197890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:35.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:35.352+0000 7f5548a81640 1 --2- 172.21.15.82:0/1705358120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55441015e0 0x7f5544197890 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f553400d950 tx=0x7f553400de10 comp rx=0 tx=0).stop 2024-03-04T09:13:35.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:35.352+0000 7f5548a81640 1 -- 172.21.15.82:0/1705358120 shutdown_connections 2024-03-04T09:13:35.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:35.352+0000 7f5548a81640 1 --2- 172.21.15.82:0/1705358120 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f55300a1d80 0x7f55300a4240 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:35.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:35.352+0000 7f5548a81640 1 --2- 172.21.15.82:0/1705358120 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5544103190 0x7f554419ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:35.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:35.352+0000 7f5548a81640 1 --2- 172.21.15.82:0/1705358120 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55441027d0 0x7f5544197dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:35.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:35.352+0000 7f5548a81640 1 --2- 172.21.15.82:0/1705358120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55441015e0 0x7f5544197890 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:35.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:35.352+0000 7f5548a81640 1 -- 172.21.15.82:0/1705358120 >> 172.21.15.82:0/1705358120 conn(0x7f55440fcb70 msgr2=0x7f5544105ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:35.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:35.352+0000 7f5548a81640 1 -- 172.21.15.82:0/1705358120 shutdown_connections 2024-03-04T09:13:35.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:35.352+0000 7f5548a81640 1 -- 172.21.15.82:0/1705358120 wait complete. 2024-03-04T09:13:35.364 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-03-04T09:13:35.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:35.473+0000 7f48bc278640 1 -- 172.21.15.82:0/3176385110 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48b41072c0 msgr2=0x7f48b4109710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:35.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:35.473+0000 7f48bc278640 1 --2- 172.21.15.82:0/3176385110 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48b41072c0 0x7f48b4109710 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f48ac009ca0 tx=0x7f48ac02c0f0 comp rx=0 tx=0).stop 2024-03-04T09:13:35.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:35.473+0000 7f48bc278640 1 -- 172.21.15.82:0/3176385110 shutdown_connections 2024-03-04T09:13:35.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:35.473+0000 7f48bc278640 1 --2- 172.21.15.82:0/3176385110 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48b41072c0 0x7f48b4109710 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:35.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:35.473+0000 7f48bc278640 1 --2- 172.21.15.82:0/3176385110 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f48b4104990 0x7f48b4106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:35.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:35.473+0000 7f48bc278640 1 --2- 172.21.15.82:0/3176385110 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48b4102060 0x7f48b4104450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:35.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:35.473+0000 7f48bc278640 1 -- 172.21.15.82:0/3176385110 >> 172.21.15.82:0/3176385110 conn(0x7f48b40fba70 msgr2=0x7f48b40fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:35.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:35.473+0000 7f48bc278640 1 -- 172.21.15.82:0/3176385110 shutdown_connections 2024-03-04T09:13:35.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:35.473+0000 7f48bc278640 1 -- 172.21.15.82:0/3176385110 wait complete. 2024-03-04T09:13:35.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:35.474+0000 7f48bc278640 1 Processor -- start 2024-03-04T09:13:35.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:35.474+0000 7f48bc278640 1 -- start start 2024-03-04T09:13:35.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:35.474+0000 7f48bc278640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48b4102060 0x7f48b41978d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:35.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:35.474+0000 7f48bc278640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48b4104990 0x7f48b4197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:35.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:35.474+0000 7f48bc278640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f48b41072c0 0x7f48b419ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:35.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:35.474+0000 7f48bc278640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b410d260 con 0x7f48b4104990 2024-03-04T09:13:35.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:35.474+0000 7f48bc278640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b410d0e0 con 0x7f48b4102060 2024-03-04T09:13:35.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:35.474+0000 7f48bc278640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b410d3e0 con 0x7f48b41072c0 2024-03-04T09:13:35.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:35.474+0000 7f48b9813640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48b4104990 0x7f48b4197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:35.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:35.474+0000 7f48b9813640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48b4104990 0x7f48b4197e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38396/0 (socket says 172.21.15.82:38396) 2024-03-04T09:13:35.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:35.474+0000 7f48b9813640 1 -- 172.21.15.82:0/2556021136 learned_addr learned my addr 172.21.15.82:0/2556021136 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:35.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:35.474+0000 7f48ba815640 1 --2- 172.21.15.82:0/2556021136 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f48b41072c0 0x7f48b419ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:35.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:35.474+0000 7f48ba014640 1 --2- 172.21.15.82:0/2556021136 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48b4102060 0x7f48b41978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:35.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:35.474+0000 7f48b9813640 1 -- 172.21.15.82:0/2556021136 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f48b41072c0 msgr2=0x7f48b419ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:35.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:35.474+0000 7f48b9813640 1 --2- 172.21.15.82:0/2556021136 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f48b41072c0 0x7f48b419ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:35.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:35.474+0000 7f48b9813640 1 -- 172.21.15.82:0/2556021136 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48b4102060 msgr2=0x7f48b41978d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:35.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:35.474+0000 7f48b9813640 1 --2- 172.21.15.82:0/2556021136 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48b4102060 0x7f48b41978d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:35.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:35.474+0000 7f48b9813640 1 -- 172.21.15.82:0/2556021136 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b419f4f0 con 0x7f48b4104990 2024-03-04T09:13:35.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:35.474+0000 7f48b9813640 1 --2- 172.21.15.82:0/2556021136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48b4104990 0x7f48b4197e10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f48a400e9f0 tx=0x7f48a400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:35.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:35.475+0000 7f48ab7fe640 1 -- 172.21.15.82:0/2556021136 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a400ccc0 con 0x7f48b4104990 2024-03-04T09:13:35.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:35.475+0000 7f48ab7fe640 1 -- 172.21.15.82:0/2556021136 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f48a40054f0 con 0x7f48b4104990 2024-03-04T09:13:35.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:35.475+0000 7f48bc278640 1 -- 172.21.15.82:0/2556021136 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48b419f7e0 con 0x7f48b4104990 2024-03-04T09:13:35.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:35.475+0000 7f48ab7fe640 1 -- 172.21.15.82:0/2556021136 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a4010690 con 0x7f48b4104990 2024-03-04T09:13:35.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:35.475+0000 7f48bc278640 1 -- 172.21.15.82:0/2556021136 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48b419fce0 con 0x7f48b4104990 2024-03-04T09:13:35.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:35.476+0000 7f48bc278640 1 -- 172.21.15.82:0/2556021136 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48b40fd560 con 0x7f48b4104990 2024-03-04T09:13:35.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:35.477+0000 7f48ab7fe640 1 -- 172.21.15.82:0/2556021136 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f48a4004e80 con 0x7f48b4104990 2024-03-04T09:13:35.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:35.477+0000 7f48ab7fe640 1 --2- 172.21.15.82:0/2556021136 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f48a00a1d80 0x7f48a00a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:35.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:35.477+0000 7f48ab7fe640 1 -- 172.21.15.82:0/2556021136 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8802+0+0 (secure 0 0 0) 0x7f48a40ce530 con 0x7f48b4104990 2024-03-04T09:13:35.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:35.477+0000 7f48ba014640 1 --2- 172.21.15.82:0/2556021136 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f48a00a1d80 0x7f48a00a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:35.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:35.478+0000 7f48ba014640 1 --2- 172.21.15.82:0/2556021136 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f48a00a1d80 0x7f48a00a4240 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f48b0009bd0 tx=0x7f48b0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:35.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:35.481+0000 7f48ab7fe640 1 -- 172.21.15.82:0/2556021136 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f48a4053280 con 0x7f48b4104990 2024-03-04T09:13:35.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:35 smithi190 ceph-mon[36341]: pgmap v301: 129 pgs: 129 active+clean; 581 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-03-04T09:13:35.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:35 smithi190 ceph-mon[36341]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-03-04T09:13:35.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:35 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/1422070378' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-03-04T09:13:35.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:35 smithi190 ceph-mon[36341]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-03-04T09:13:35.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:35 smithi190 ceph-mon[36341]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-04T09:13:35.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:35 smithi190 ceph-mon[36341]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-03-04T09:13:35.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:35 smithi190 ceph-mon[36341]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-03-04T09:13:35.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:35 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/1705358120' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-03-04T09:13:35.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:35 smithi102 ceph-mon[36220]: pgmap v301: 129 pgs: 129 active+clean; 581 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-03-04T09:13:35.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:35 smithi102 ceph-mon[36220]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-03-04T09:13:35.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:35 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/1422070378' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-03-04T09:13:35.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:35 smithi102 ceph-mon[36220]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-03-04T09:13:35.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:35 smithi102 ceph-mon[36220]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-04T09:13:35.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:35 smithi102 ceph-mon[36220]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-03-04T09:13:35.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:35 smithi102 ceph-mon[36220]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-03-04T09:13:35.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:35 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/1705358120' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-03-04T09:13:35.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:35.694+0000 7f48bc278640 1 -- 172.21.15.82:0/2556021136 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f48b402cff0 con 0x7f48b4104990 2024-03-04T09:13:35.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:35 smithi082 ceph-mon[32880]: pgmap v301: 129 pgs: 129 active+clean; 581 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-03-04T09:13:35.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:35 smithi082 ceph-mon[32880]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-03-04T09:13:35.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:35 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/1422070378' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-03-04T09:13:35.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:35 smithi082 ceph-mon[32880]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-03-04T09:13:35.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:35 smithi082 ceph-mon[32880]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-04T09:13:35.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:35 smithi082 ceph-mon[32880]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-03-04T09:13:35.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:35 smithi082 ceph-mon[32880]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-03-04T09:13:35.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:35 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/1705358120' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-03-04T09:13:36.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.361+0000 7f48ab7fe640 1 -- 172.21.15.82:0/2556021136 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v23) v1 ==== 115+0+0 (secure 0 0 0) 0x7f48a409b720 con 0x7f48b4104990 2024-03-04T09:13:36.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.364+0000 7f48bc278640 1 -- 172.21.15.82:0/2556021136 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f48a00a1d80 msgr2=0x7f48a00a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:36.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.364+0000 7f48bc278640 1 --2- 172.21.15.82:0/2556021136 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f48a00a1d80 0x7f48a00a4240 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f48b0009bd0 tx=0x7f48b0005f90 comp rx=0 tx=0).stop 2024-03-04T09:13:36.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.365+0000 7f48bc278640 1 -- 172.21.15.82:0/2556021136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48b4104990 msgr2=0x7f48b4197e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:36.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.365+0000 7f48bc278640 1 --2- 172.21.15.82:0/2556021136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48b4104990 0x7f48b4197e10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f48a400e9f0 tx=0x7f48a400eeb0 comp rx=0 tx=0).stop 2024-03-04T09:13:36.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.365+0000 7f48bc278640 1 -- 172.21.15.82:0/2556021136 shutdown_connections 2024-03-04T09:13:36.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.365+0000 7f48bc278640 1 --2- 172.21.15.82:0/2556021136 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f48a00a1d80 0x7f48a00a4240 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:36.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.365+0000 7f48bc278640 1 --2- 172.21.15.82:0/2556021136 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f48b41072c0 0x7f48b419ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:36.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.365+0000 7f48bc278640 1 --2- 172.21.15.82:0/2556021136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48b4104990 0x7f48b4197e10 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:36.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.365+0000 7f48bc278640 1 --2- 172.21.15.82:0/2556021136 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48b4102060 0x7f48b41978d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:36.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.365+0000 7f48bc278640 1 -- 172.21.15.82:0/2556021136 >> 172.21.15.82:0/2556021136 conn(0x7f48b40fba70 msgr2=0x7f48b4102900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:36.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.365+0000 7f48bc278640 1 -- 172.21.15.82:0/2556021136 shutdown_connections 2024-03-04T09:13:36.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.365+0000 7f48bc278640 1 -- 172.21.15.82:0/2556021136 wait complete. 2024-03-04T09:13:36.378 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2024-03-04T09:13:36.378 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs qa 2024-03-04T09:13:36.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.491+0000 7f8dc049a640 1 -- 172.21.15.82:0/2041982951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8db81020f0 msgr2=0x7f8db81044e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:36.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.491+0000 7f8dc049a640 1 --2- 172.21.15.82:0/2041982951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8db81020f0 0x7f8db81044e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8db4009900 tx=0x7f8db402bc30 comp rx=0 tx=0).stop 2024-03-04T09:13:36.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.492+0000 7f8dc049a640 1 -- 172.21.15.82:0/2041982951 shutdown_connections 2024-03-04T09:13:36.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.492+0000 7f8dc049a640 1 --2- 172.21.15.82:0/2041982951 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8db8107350 0x7f8db8109740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:36.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.492+0000 7f8dc049a640 1 --2- 172.21.15.82:0/2041982951 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8db8104a20 0x7f8db8106e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:36.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.492+0000 7f8dc049a640 1 --2- 172.21.15.82:0/2041982951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8db81020f0 0x7f8db81044e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:36.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.492+0000 7f8dc049a640 1 -- 172.21.15.82:0/2041982951 >> 172.21.15.82:0/2041982951 conn(0x7f8db80fba60 msgr2=0x7f8db80fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:36.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.492+0000 7f8dc049a640 1 -- 172.21.15.82:0/2041982951 shutdown_connections 2024-03-04T09:13:36.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.492+0000 7f8dc049a640 1 -- 172.21.15.82:0/2041982951 wait complete. 2024-03-04T09:13:36.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.492+0000 7f8dc049a640 1 Processor -- start 2024-03-04T09:13:36.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.492+0000 7f8dc049a640 1 -- start start 2024-03-04T09:13:36.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.492+0000 7f8dc049a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8db81020f0 0x7f8db8197960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:36.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.492+0000 7f8dc049a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8db8104a20 0x7f8db8197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:36.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.492+0000 7f8dc049a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8db8107350 0x7f8db819ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:36.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.492+0000 7f8dc049a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db810d250 con 0x7f8db8107350 2024-03-04T09:13:36.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.492+0000 7f8dc049a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db810d0d0 con 0x7f8db8104a20 2024-03-04T09:13:36.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.492+0000 7f8dc049a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db810d3d0 con 0x7f8db81020f0 2024-03-04T09:13:36.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.492+0000 7f8dbe236640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8db81020f0 0x7f8db8197960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:36.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.492+0000 7f8dbea37640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8db8107350 0x7f8db819ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:36.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.492+0000 7f8dbe236640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8db81020f0 0x7f8db8197960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.82:39374/0 (socket says 172.21.15.82:39374) 2024-03-04T09:13:36.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.492+0000 7f8dbe236640 1 -- 172.21.15.82:0/682647458 learned_addr learned my addr 172.21.15.82:0/682647458 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:36.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.493+0000 7f8dbda35640 1 --2- 172.21.15.82:0/682647458 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8db8104a20 0x7f8db8197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:36.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.493+0000 7f8dbe236640 1 -- 172.21.15.82:0/682647458 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8db8104a20 msgr2=0x7f8db8197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:36.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.493+0000 7f8dbe236640 1 --2- 172.21.15.82:0/682647458 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8db8104a20 0x7f8db8197ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:36.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.493+0000 7f8dbe236640 1 -- 172.21.15.82:0/682647458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8db8107350 msgr2=0x7f8db819ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:36.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.493+0000 7f8dbe236640 1 --2- 172.21.15.82:0/682647458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8db8107350 0x7f8db819ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:36.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.493+0000 7f8dbe236640 1 -- 172.21.15.82:0/682647458 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db819f580 con 0x7f8db81020f0 2024-03-04T09:13:36.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.493+0000 7f8dbea37640 1 --2- 172.21.15.82:0/682647458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8db8107350 0x7f8db819ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:13:36.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.493+0000 7f8dbe236640 1 --2- 172.21.15.82:0/682647458 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8db81020f0 0x7f8db8197960 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8db4009230 tx=0x7f8db4005dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:36.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.493+0000 7f8daf7fe640 1 -- 172.21.15.82:0/682647458 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db4043020 con 0x7f8db81020f0 2024-03-04T09:13:36.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.493+0000 7f8dc049a640 1 -- 172.21.15.82:0/682647458 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8db819f810 con 0x7f8db81020f0 2024-03-04T09:13:36.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.493+0000 7f8daf7fe640 1 -- 172.21.15.82:0/682647458 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f8db40054b0 con 0x7f8db81020f0 2024-03-04T09:13:36.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.493+0000 7f8daf7fe640 1 -- 172.21.15.82:0/682647458 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db4003b20 con 0x7f8db81020f0 2024-03-04T09:13:36.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.493+0000 7f8dc049a640 1 -- 172.21.15.82:0/682647458 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8db819fdb0 con 0x7f8db81020f0 2024-03-04T09:13:36.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.494+0000 7f8dc049a640 1 -- 172.21.15.82:0/682647458 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8db80fd550 con 0x7f8db81020f0 2024-03-04T09:13:36.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.495+0000 7f8daf7fe640 1 -- 172.21.15.82:0/682647458 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f8db4046020 con 0x7f8db81020f0 2024-03-04T09:13:36.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.496+0000 7f8daf7fe640 1 --2- 172.21.15.82:0/682647458 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f8da40a1d80 0x7f8da40a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:36.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.496+0000 7f8dbda35640 1 --2- 172.21.15.82:0/682647458 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f8da40a1d80 0x7f8da40a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:36.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.496+0000 7f8daf7fe640 1 -- 172.21.15.82:0/682647458 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8802+0+0 (secure 0 0 0) 0x7f8db40f01f0 con 0x7f8db81020f0 2024-03-04T09:13:36.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.496+0000 7f8dbda35640 1 --2- 172.21.15.82:0/682647458 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f8da40a1d80 0x7f8da40a4240 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8db8198e70 tx=0x7f8da8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:36.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.505+0000 7f8daf7fe640 1 -- 172.21.15.82:0/682647458 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f8db40bd3e0 con 0x7f8db81020f0 2024-03-04T09:13:36.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:36 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/1705358120' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-03-04T09:13:36.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:36 smithi190 ceph-mon[36341]: mds.? [v2:172.21.15.190:6838/878555510,v1:172.21.15.190:6839/878555510] up:active 2024-03-04T09:13:36.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:36 smithi190 ceph-mon[36341]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-03-04T09:13:36.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:36 smithi190 ceph-mon[36341]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-03-04T09:13:36.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:36 smithi190 ceph-mon[36341]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-03-04T09:13:36.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:36 smithi190 ceph-mon[36341]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-03-04T09:13:36.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:36 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/2556021136' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-03-04T09:13:36.679 INFO:journalctl@ceph.mds.b.smithi102.stdout:Mar 04 09:13:36 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-b[65969]: 2024-03-04T09:13:36.348+0000 7fcae7145700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-03-04T09:13:36.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:36 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/1705358120' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-03-04T09:13:36.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:36 smithi102 ceph-mon[36220]: mds.? [v2:172.21.15.190:6838/878555510,v1:172.21.15.190:6839/878555510] up:active 2024-03-04T09:13:36.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:36 smithi102 ceph-mon[36220]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-03-04T09:13:36.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:36 smithi102 ceph-mon[36220]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-03-04T09:13:36.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:36 smithi102 ceph-mon[36220]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-03-04T09:13:36.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:36 smithi102 ceph-mon[36220]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-03-04T09:13:36.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:36 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/2556021136' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-03-04T09:13:36.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.703+0000 7f8dc049a640 1 -- 172.21.15.82:0/682647458 --> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7f8db8061a10 con 0x7f8da40a1d80 2024-03-04T09:13:36.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:36 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/1705358120' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-03-04T09:13:36.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:36 smithi082 ceph-mon[32880]: mds.? [v2:172.21.15.190:6838/878555510,v1:172.21.15.190:6839/878555510] up:active 2024-03-04T09:13:36.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:36 smithi082 ceph-mon[32880]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-03-04T09:13:36.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:36 smithi082 ceph-mon[32880]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-03-04T09:13:36.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:36 smithi082 ceph-mon[32880]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-03-04T09:13:36.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:36 smithi082 ceph-mon[32880]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-03-04T09:13:36.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:36 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/2556021136' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-03-04T09:13:36.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.725+0000 7f8daf7fe640 1 -- 172.21.15.82:0/682647458 <== mgr.14152 v2:172.21.15.82:6800/1278635224 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f8db8061a10 con 0x7f8da40a1d80 2024-03-04T09:13:36.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.726+0000 7f8dc049a640 1 -- 172.21.15.82:0/682647458 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f8da40a1d80 msgr2=0x7f8da40a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:36.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.726+0000 7f8dc049a640 1 --2- 172.21.15.82:0/682647458 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f8da40a1d80 0x7f8da40a4240 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8db8198e70 tx=0x7f8da8005f90 comp rx=0 tx=0).stop 2024-03-04T09:13:36.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.726+0000 7f8dc049a640 1 -- 172.21.15.82:0/682647458 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8db81020f0 msgr2=0x7f8db8197960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:36.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.726+0000 7f8dc049a640 1 --2- 172.21.15.82:0/682647458 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8db81020f0 0x7f8db8197960 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8db4009230 tx=0x7f8db4005dd0 comp rx=0 tx=0).stop 2024-03-04T09:13:36.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.726+0000 7f8dc049a640 1 -- 172.21.15.82:0/682647458 shutdown_connections 2024-03-04T09:13:36.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.726+0000 7f8dc049a640 1 --2- 172.21.15.82:0/682647458 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f8da40a1d80 0x7f8da40a4240 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:36.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.726+0000 7f8dc049a640 1 --2- 172.21.15.82:0/682647458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8db8107350 0x7f8db819ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:36.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.726+0000 7f8dc049a640 1 --2- 172.21.15.82:0/682647458 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8db8104a20 0x7f8db8197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:36.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.726+0000 7f8dc049a640 1 --2- 172.21.15.82:0/682647458 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8db81020f0 0x7f8db8197960 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:36.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.726+0000 7f8dc049a640 1 -- 172.21.15.82:0/682647458 >> 172.21.15.82:0/682647458 conn(0x7f8db80fba60 msgr2=0x7f8db8102b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:36.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.726+0000 7f8dc049a640 1 -- 172.21.15.82:0/682647458 shutdown_connections 2024-03-04T09:13:36.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.726+0000 7f8dc049a640 1 -- 172.21.15.82:0/682647458 wait complete. 2024-03-04T09:13:36.733 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 --group_name qa 2024-03-04T09:13:36.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.843+0000 7fa2a08d4640 1 -- 172.21.15.82:0/2031374752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa29c1020b0 msgr2=0x7fa29c1044a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:36.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.843+0000 7fa2a08d4640 1 --2- 172.21.15.82:0/2031374752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa29c1020b0 0x7fa29c1044a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa294009900 tx=0x7fa29402bc30 comp rx=0 tx=0).stop 2024-03-04T09:13:36.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.844+0000 7fa2a08d4640 1 -- 172.21.15.82:0/2031374752 shutdown_connections 2024-03-04T09:13:36.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.844+0000 7fa2a08d4640 1 --2- 172.21.15.82:0/2031374752 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa29c107310 0x7fa29c109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:36.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.844+0000 7fa2a08d4640 1 --2- 172.21.15.82:0/2031374752 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa29c1049e0 0x7fa29c106dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:36.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.844+0000 7fa2a08d4640 1 --2- 172.21.15.82:0/2031374752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa29c1020b0 0x7fa29c1044a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:36.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.844+0000 7fa2a08d4640 1 -- 172.21.15.82:0/2031374752 >> 172.21.15.82:0/2031374752 conn(0x7fa29c0fba60 msgr2=0x7fa29c0fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:36.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.844+0000 7fa2a08d4640 1 -- 172.21.15.82:0/2031374752 shutdown_connections 2024-03-04T09:13:36.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.844+0000 7fa2a08d4640 1 -- 172.21.15.82:0/2031374752 wait complete. 2024-03-04T09:13:36.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.844+0000 7fa2a08d4640 1 Processor -- start 2024-03-04T09:13:36.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.844+0000 7fa2a08d4640 1 -- start start 2024-03-04T09:13:36.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.844+0000 7fa2a08d4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa29c1020b0 0x7fa29c197960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:36.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.844+0000 7fa2a08d4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa29c1049e0 0x7fa29c197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:36.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.844+0000 7fa2a08d4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa29c107310 0x7fa29c19ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:36.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.844+0000 7fa2a08d4640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c10d230 con 0x7fa29c107310 2024-03-04T09:13:36.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.844+0000 7fa2a08d4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c10d0b0 con 0x7fa29c1020b0 2024-03-04T09:13:36.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.844+0000 7fa2a08d4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c10d3b0 con 0x7fa29c1049e0 2024-03-04T09:13:36.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.845+0000 7fa29ad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa29c107310 0x7fa29c19ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:36.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.845+0000 7fa29ad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa29c107310 0x7fa29c19ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43028/0 (socket says 172.21.15.82:43028) 2024-03-04T09:13:36.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.845+0000 7fa29ad9d640 1 -- 172.21.15.82:0/870463626 learned_addr learned my addr 172.21.15.82:0/870463626 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:36.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.845+0000 7fa299d9b640 1 --2- 172.21.15.82:0/870463626 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa29c1049e0 0x7fa29c197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:36.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.845+0000 7fa29a59c640 1 --2- 172.21.15.82:0/870463626 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa29c1020b0 0x7fa29c197960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:36.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.845+0000 7fa29ad9d640 1 -- 172.21.15.82:0/870463626 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa29c1049e0 msgr2=0x7fa29c197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:36.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.845+0000 7fa29ad9d640 1 --2- 172.21.15.82:0/870463626 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa29c1049e0 0x7fa29c197ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:36.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.845+0000 7fa29ad9d640 1 -- 172.21.15.82:0/870463626 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa29c1020b0 msgr2=0x7fa29c197960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:36.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.845+0000 7fa29ad9d640 1 --2- 172.21.15.82:0/870463626 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa29c1020b0 0x7fa29c197960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:36.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.845+0000 7fa29ad9d640 1 -- 172.21.15.82:0/870463626 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa29c19f580 con 0x7fa29c107310 2024-03-04T09:13:36.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.845+0000 7fa29ad9d640 1 --2- 172.21.15.82:0/870463626 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa29c107310 0x7fa29c19ef10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa28c00efd0 tx=0x7fa28c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:36.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.845+0000 7fa28b7fe640 1 -- 172.21.15.82:0/870463626 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c003b70 con 0x7fa29c107310 2024-03-04T09:13:36.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.845+0000 7fa2a08d4640 1 -- 172.21.15.82:0/870463626 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa29c19f870 con 0x7fa29c107310 2024-03-04T09:13:36.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.845+0000 7fa28b7fe640 1 -- 172.21.15.82:0/870463626 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fa28c003d10 con 0x7fa29c107310 2024-03-04T09:13:36.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.845+0000 7fa28b7fe640 1 -- 172.21.15.82:0/870463626 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c0109f0 con 0x7fa29c107310 2024-03-04T09:13:36.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.845+0000 7fa2a08d4640 1 -- 172.21.15.82:0/870463626 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa29c19fd70 con 0x7fa29c107310 2024-03-04T09:13:36.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.846+0000 7fa2a08d4640 1 -- 172.21.15.82:0/870463626 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa29c0fd550 con 0x7fa29c107310 2024-03-04T09:13:36.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.847+0000 7fa28b7fe640 1 -- 172.21.15.82:0/870463626 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7fa28c010b90 con 0x7fa29c107310 2024-03-04T09:13:36.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.848+0000 7fa28b7fe640 1 --2- 172.21.15.82:0/870463626 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fa2840a1d80 0x7fa2840a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:36.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.848+0000 7fa29a59c640 1 --2- 172.21.15.82:0/870463626 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fa2840a1d80 0x7fa2840a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:36.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.848+0000 7fa28b7fe640 1 -- 172.21.15.82:0/870463626 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8802+0+0 (secure 0 0 0) 0x7fa28c0ce800 con 0x7fa29c107310 2024-03-04T09:13:36.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.848+0000 7fa29a59c640 1 --2- 172.21.15.82:0/870463626 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fa2840a1d80 0x7fa2840a4240 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa294005ab0 tx=0x7fa294005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:36.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:36.852+0000 7fa28b7fe640 1 -- 172.21.15.82:0/870463626 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fa28c09b9f0 con 0x7fa29c107310 2024-03-04T09:13:37.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.052+0000 7fa2a08d4640 1 -- 172.21.15.82:0/870463626 --> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7fa29c061a10 con 0x7fa2840a1d80 2024-03-04T09:13:37.067 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:13:36 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:13:36.707+0000 7f119a718700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T09:13:37.067 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:13:36 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:13:36.707+0000 7f119a718700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T09:13:37.067 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:13:36 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:13:36.707+0000 7f119a718700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T09:13:37.067 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:13:36 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:13:36.707+0000 7f119a718700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T09:13:37.067 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:13:36 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:13:36.707+0000 7f119a718700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T09:13:37.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.074+0000 7fa28b7fe640 1 -- 172.21.15.82:0/870463626 <== mgr.14152 v2:172.21.15.82:6800/1278635224 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fa29c061a10 con 0x7fa2840a1d80 2024-03-04T09:13:37.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.077+0000 7fa2a08d4640 1 -- 172.21.15.82:0/870463626 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fa2840a1d80 msgr2=0x7fa2840a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:37.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.077+0000 7fa2a08d4640 1 --2- 172.21.15.82:0/870463626 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fa2840a1d80 0x7fa2840a4240 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa294005ab0 tx=0x7fa294005fd0 comp rx=0 tx=0).stop 2024-03-04T09:13:37.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.077+0000 7fa2a08d4640 1 -- 172.21.15.82:0/870463626 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa29c107310 msgr2=0x7fa29c19ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:37.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.077+0000 7fa2a08d4640 1 --2- 172.21.15.82:0/870463626 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa29c107310 0x7fa29c19ef10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa28c00efd0 tx=0x7fa28c00c6a0 comp rx=0 tx=0).stop 2024-03-04T09:13:37.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.077+0000 7fa2a08d4640 1 -- 172.21.15.82:0/870463626 shutdown_connections 2024-03-04T09:13:37.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.077+0000 7fa2a08d4640 1 --2- 172.21.15.82:0/870463626 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fa2840a1d80 0x7fa2840a4240 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:37.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.077+0000 7fa2a08d4640 1 --2- 172.21.15.82:0/870463626 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa29c107310 0x7fa29c19ef10 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:37.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.077+0000 7fa2a08d4640 1 --2- 172.21.15.82:0/870463626 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa29c1049e0 0x7fa29c197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:37.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.077+0000 7fa2a08d4640 1 --2- 172.21.15.82:0/870463626 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa29c1020b0 0x7fa29c197960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:37.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.077+0000 7fa2a08d4640 1 -- 172.21.15.82:0/870463626 >> 172.21.15.82:0/870463626 conn(0x7fa29c0fba60 msgr2=0x7fa29c102950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:37.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.077+0000 7fa2a08d4640 1 -- 172.21.15.82:0/870463626 shutdown_connections 2024-03-04T09:13:37.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.077+0000 7fa2a08d4640 1 -- 172.21.15.82:0/870463626 wait complete. 2024-03-04T09:13:37.083 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-03-04T09:13:37.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.192+0000 7fe6f76d4640 1 -- 172.21.15.82:0/3855269229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6f0102070 msgr2=0x7fe6f0104460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:37.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.192+0000 7fe6f76d4640 1 --2- 172.21.15.82:0/3855269229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6f0102070 0x7fe6f0104460 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec009900 tx=0x7fe6ec02bc30 comp rx=0 tx=0).stop 2024-03-04T09:13:37.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.192+0000 7fe6f76d4640 1 -- 172.21.15.82:0/3855269229 shutdown_connections 2024-03-04T09:13:37.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.192+0000 7fe6f76d4640 1 --2- 172.21.15.82:0/3855269229 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe6f01072d0 0x7fe6f0109720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:37.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.192+0000 7fe6f76d4640 1 --2- 172.21.15.82:0/3855269229 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6f01049a0 0x7fe6f0106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:37.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.192+0000 7fe6f76d4640 1 --2- 172.21.15.82:0/3855269229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6f0102070 0x7fe6f0104460 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:37.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.192+0000 7fe6f76d4640 1 -- 172.21.15.82:0/3855269229 >> 172.21.15.82:0/3855269229 conn(0x7fe6f00fba80 msgr2=0x7fe6f00fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:37.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.193+0000 7fe6f76d4640 1 -- 172.21.15.82:0/3855269229 shutdown_connections 2024-03-04T09:13:37.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.193+0000 7fe6f76d4640 1 -- 172.21.15.82:0/3855269229 wait complete. 2024-03-04T09:13:37.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.193+0000 7fe6f76d4640 1 Processor -- start 2024-03-04T09:13:37.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.193+0000 7fe6f76d4640 1 -- start start 2024-03-04T09:13:37.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.193+0000 7fe6f76d4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6f0102070 0x7fe6f0197970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:37.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.193+0000 7fe6f76d4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe6f01049a0 0x7fe6f0197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:37.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.193+0000 7fe6f76d4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6f01072d0 0x7fe6f019ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:37.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.193+0000 7fe6f76d4640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f010d270 con 0x7fe6f0102070 2024-03-04T09:13:37.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.193+0000 7fe6f76d4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f010d0f0 con 0x7fe6f01049a0 2024-03-04T09:13:37.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.193+0000 7fe6f76d4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f010d3f0 con 0x7fe6f01072d0 2024-03-04T09:13:37.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.193+0000 7fe6f5470640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6f0102070 0x7fe6f0197970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:37.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.193+0000 7fe6f5470640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6f0102070 0x7fe6f0197970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43050/0 (socket says 172.21.15.82:43050) 2024-03-04T09:13:37.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.193+0000 7fe6f5470640 1 -- 172.21.15.82:0/4042207956 learned_addr learned my addr 172.21.15.82:0/4042207956 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:37.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.193+0000 7fe6f4c6f640 1 --2- 172.21.15.82:0/4042207956 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe6f01049a0 0x7fe6f0197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:37.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.193+0000 7fe6f5c71640 1 --2- 172.21.15.82:0/4042207956 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6f01072d0 0x7fe6f019ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:37.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.194+0000 7fe6f5470640 1 -- 172.21.15.82:0/4042207956 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6f01072d0 msgr2=0x7fe6f019ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:37.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.194+0000 7fe6f5470640 1 --2- 172.21.15.82:0/4042207956 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6f01072d0 0x7fe6f019ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:37.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.194+0000 7fe6f5470640 1 -- 172.21.15.82:0/4042207956 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe6f01049a0 msgr2=0x7fe6f0197eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:37.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.194+0000 7fe6f5470640 1 --2- 172.21.15.82:0/4042207956 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe6f01049a0 0x7fe6f0197eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:37.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.194+0000 7fe6f5470640 1 -- 172.21.15.82:0/4042207956 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f019f590 con 0x7fe6f0102070 2024-03-04T09:13:37.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.194+0000 7fe6f5470640 1 --2- 172.21.15.82:0/4042207956 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6f0102070 0x7fe6f0197970 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec009230 tx=0x7fe6ec005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:37.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.194+0000 7fe6e67fc640 1 -- 172.21.15.82:0/4042207956 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec043020 con 0x7fe6f0102070 2024-03-04T09:13:37.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.194+0000 7fe6e67fc640 1 -- 172.21.15.82:0/4042207956 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fe6ec0054b0 con 0x7fe6f0102070 2024-03-04T09:13:37.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.194+0000 7fe6e67fc640 1 -- 172.21.15.82:0/4042207956 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec003b80 con 0x7fe6f0102070 2024-03-04T09:13:37.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.194+0000 7fe6f76d4640 1 -- 172.21.15.82:0/4042207956 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6f019f820 con 0x7fe6f0102070 2024-03-04T09:13:37.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.194+0000 7fe6f76d4640 1 -- 172.21.15.82:0/4042207956 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6f019fd20 con 0x7fe6f0102070 2024-03-04T09:13:37.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.195+0000 7fe6f76d4640 1 -- 172.21.15.82:0/4042207956 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6f00fd570 con 0x7fe6f0102070 2024-03-04T09:13:37.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.196+0000 7fe6e67fc640 1 -- 172.21.15.82:0/4042207956 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 136756+0+0 (secure 0 0 0) 0x7fe6ec046020 con 0x7fe6f0102070 2024-03-04T09:13:37.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.197+0000 7fe6e67fc640 1 --2- 172.21.15.82:0/4042207956 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fe6dc0a1d80 0x7fe6dc0a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:37.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.197+0000 7fe6f4c6f640 1 --2- 172.21.15.82:0/4042207956 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fe6dc0a1d80 0x7fe6dc0a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:37.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.197+0000 7fe6e67fc640 1 -- 172.21.15.82:0/4042207956 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8802+0+0 (secure 0 0 0) 0x7fe6ec0efbd0 con 0x7fe6f0102070 2024-03-04T09:13:37.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.197+0000 7fe6f4c6f640 1 --2- 172.21.15.82:0/4042207956 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fe6dc0a1d80 0x7fe6dc0a4240 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0198e80 tx=0x7fe6e0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:37.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.201+0000 7fe6e67fc640 1 -- 172.21.15.82:0/4042207956 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fe6ec04d070 con 0x7fe6f0102070 2024-03-04T09:13:37.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.385+0000 7fe6e67fc640 1 -- 172.21.15.82:0/4042207956 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 17) v1 ==== 136807+0+0 (secure 0 0 0) 0x7fe6ec0b8d30 con 0x7fe6f0102070 2024-03-04T09:13:37.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.412+0000 7fe6f76d4640 1 -- 172.21.15.82:0/4042207956 --> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) v1 -- 0x7fe6f0061a10 con 0x7fe6dc0a1d80 2024-03-04T09:13:37.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.416+0000 7fe6e67fc640 1 -- 172.21.15.82:0/4042207956 <== mgr.14152 v2:172.21.15.82:6800/1278635224 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+54 (secure 0 0 0) 0x7fe6f0061a10 con 0x7fe6dc0a1d80 2024-03-04T09:13:37.412 INFO:teuthology.orchestra.run.smithi082.stdout:/volumes/qa/sv_0/13e71396-3e50-499b-895f-c2eff6f4bf3d 2024-03-04T09:13:37.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.417+0000 7fe6f76d4640 1 -- 172.21.15.82:0/4042207956 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fe6dc0a1d80 msgr2=0x7fe6dc0a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:37.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.417+0000 7fe6f76d4640 1 --2- 172.21.15.82:0/4042207956 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fe6dc0a1d80 0x7fe6dc0a4240 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0198e80 tx=0x7fe6e0005f90 comp rx=0 tx=0).stop 2024-03-04T09:13:37.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.417+0000 7fe6f76d4640 1 -- 172.21.15.82:0/4042207956 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6f0102070 msgr2=0x7fe6f0197970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:37.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.417+0000 7fe6f76d4640 1 --2- 172.21.15.82:0/4042207956 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6f0102070 0x7fe6f0197970 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec009230 tx=0x7fe6ec005dd0 comp rx=0 tx=0).stop 2024-03-04T09:13:37.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.417+0000 7fe6f76d4640 1 -- 172.21.15.82:0/4042207956 shutdown_connections 2024-03-04T09:13:37.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.417+0000 7fe6f76d4640 1 --2- 172.21.15.82:0/4042207956 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fe6dc0a1d80 0x7fe6dc0a4240 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:37.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.417+0000 7fe6f76d4640 1 --2- 172.21.15.82:0/4042207956 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6f01072d0 0x7fe6f019ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:37.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.417+0000 7fe6f76d4640 1 --2- 172.21.15.82:0/4042207956 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe6f01049a0 0x7fe6f0197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:37.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.417+0000 7fe6f76d4640 1 --2- 172.21.15.82:0/4042207956 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6f0102070 0x7fe6f0197970 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:37.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.418+0000 7fe6f76d4640 1 -- 172.21.15.82:0/4042207956 >> 172.21.15.82:0/4042207956 conn(0x7fe6f00fba80 msgr2=0x7fe6f0102af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:37.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.418+0000 7fe6f76d4640 1 -- 172.21.15.82:0/4042207956 shutdown_connections 2024-03-04T09:13:37.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.418+0000 7fe6f76d4640 1 -- 172.21.15.82:0/4042207956 wait complete. 2024-03-04T09:13:37.425 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 --group_name qa 2024-03-04T09:13:37.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.535+0000 7f40f39e9640 1 -- 172.21.15.82:0/1221911701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40ec102940 msgr2=0x7f40ec102dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:37.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.535+0000 7f40f39e9640 1 --2- 172.21.15.82:0/1221911701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40ec102940 0x7f40ec102dc0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f40e8009930 tx=0x7f40e802bc30 comp rx=0 tx=0).stop 2024-03-04T09:13:37.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.535+0000 7f40f39e9640 1 -- 172.21.15.82:0/1221911701 shutdown_connections 2024-03-04T09:13:37.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.535+0000 7f40f39e9640 1 --2- 172.21.15.82:0/1221911701 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40ec103300 0x7f40ec109b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:37.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.535+0000 7f40f39e9640 1 --2- 172.21.15.82:0/1221911701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40ec102940 0x7f40ec102dc0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:37.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.535+0000 7f40f39e9640 1 --2- 172.21.15.82:0/1221911701 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f40ec0ff8d0 0x7f40ec0ffcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:37.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.535+0000 7f40f39e9640 1 -- 172.21.15.82:0/1221911701 >> 172.21.15.82:0/1221911701 conn(0x7f40ec0fb1c0 msgr2=0x7f40ec0fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:37.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.535+0000 7f40f39e9640 1 -- 172.21.15.82:0/1221911701 shutdown_connections 2024-03-04T09:13:37.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.535+0000 7f40f39e9640 1 -- 172.21.15.82:0/1221911701 wait complete. 2024-03-04T09:13:37.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.535+0000 7f40f39e9640 1 Processor -- start 2024-03-04T09:13:37.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.536+0000 7f40f39e9640 1 -- start start 2024-03-04T09:13:37.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.536+0000 7f40f39e9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f40ec0ff8d0 0x7f40ec197930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:37.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.536+0000 7f40f39e9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40ec102940 0x7f40ec197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:37.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.536+0000 7f40f39e9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40ec103300 0x7f40ec19eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:37.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.536+0000 7f40f39e9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ec10d260 con 0x7f40ec103300 2024-03-04T09:13:37.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.536+0000 7f40f39e9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ec10d0e0 con 0x7f40ec102940 2024-03-04T09:13:37.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.536+0000 7f40f39e9640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ec10d3e0 con 0x7f40ec0ff8d0 2024-03-04T09:13:37.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.536+0000 7f40f1f86640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40ec103300 0x7f40ec19eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:37.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.536+0000 7f40f1f86640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40ec103300 0x7f40ec19eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43070/0 (socket says 172.21.15.82:43070) 2024-03-04T09:13:37.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.536+0000 7f40f1f86640 1 -- 172.21.15.82:0/2612043555 learned_addr learned my addr 172.21.15.82:0/2612043555 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:37.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.536+0000 7f40f0f84640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40ec102940 0x7f40ec197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:37.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.536+0000 7f40f1785640 1 --2- 172.21.15.82:0/2612043555 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f40ec0ff8d0 0x7f40ec197930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:37.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.536+0000 7f40f1f86640 1 -- 172.21.15.82:0/2612043555 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f40ec0ff8d0 msgr2=0x7f40ec197930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:37.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.536+0000 7f40f1f86640 1 --2- 172.21.15.82:0/2612043555 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f40ec0ff8d0 0x7f40ec197930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:37.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.536+0000 7f40f1f86640 1 -- 172.21.15.82:0/2612043555 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40ec102940 msgr2=0x7f40ec197e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:37.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.536+0000 7f40f1f86640 1 --2- 172.21.15.82:0/2612043555 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40ec102940 0x7f40ec197e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:37.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.536+0000 7f40f1f86640 1 -- 172.21.15.82:0/2612043555 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ec19f550 con 0x7f40ec103300 2024-03-04T09:13:37.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.536+0000 7f40f1f86640 1 --2- 172.21.15.82:0/2612043555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40ec103300 0x7f40ec19eee0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f40e400eb10 tx=0x7f40e400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:37.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.536+0000 7f40e27fc640 1 -- 172.21.15.82:0/2612043555 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e4004b20 con 0x7f40ec103300 2024-03-04T09:13:37.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.536+0000 7f40e27fc640 1 -- 172.21.15.82:0/2612043555 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f40e4004cc0 con 0x7f40ec103300 2024-03-04T09:13:37.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.536+0000 7f40f39e9640 1 -- 172.21.15.82:0/2612043555 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40ec19f840 con 0x7f40ec103300 2024-03-04T09:13:37.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.537+0000 7f40e27fc640 1 -- 172.21.15.82:0/2612043555 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e4010700 con 0x7f40ec103300 2024-03-04T09:13:37.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.537+0000 7f40f39e9640 1 -- 172.21.15.82:0/2612043555 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40ec19fd10 con 0x7f40ec103300 2024-03-04T09:13:37.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.537+0000 7f40f39e9640 1 -- 172.21.15.82:0/2612043555 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40ec108b90 con 0x7f40ec103300 2024-03-04T09:13:37.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.539+0000 7f40e27fc640 1 -- 172.21.15.82:0/2612043555 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 136807+0+0 (secure 0 0 0) 0x7f40e4004e70 con 0x7f40ec103300 2024-03-04T09:13:37.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.539+0000 7f40e27fc640 1 --2- 172.21.15.82:0/2612043555 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f40d80a1e10 0x7f40d80a42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:37.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.539+0000 7f40f1785640 1 --2- 172.21.15.82:0/2612043555 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f40d80a1e10 0x7f40d80a42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:37.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.539+0000 7f40e27fc640 1 -- 172.21.15.82:0/2612043555 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8802+0+0 (secure 0 0 0) 0x7f40e40ce710 con 0x7f40ec103300 2024-03-04T09:13:37.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.539+0000 7f40f1785640 1 --2- 172.21.15.82:0/2612043555 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f40d80a1e10 0x7f40d80a42d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f40ec0698e0 tx=0x7f40dc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:37.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.544+0000 7f40e27fc640 1 -- 172.21.15.82:0/2612043555 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f40e409b7a0 con 0x7f40ec103300 2024-03-04T09:13:37.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:37 smithi190 ceph-mon[36341]: pgmap v302: 129 pgs: 129 active+clean; 584 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 4 op/s 2024-03-04T09:13:37.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:37 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/2556021136' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-03-04T09:13:37.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:37 smithi190 ceph-mon[36341]: mds.? [v2:172.21.15.190:6836/1198639527,v1:172.21.15.190:6837/1198639527] up:active 2024-03-04T09:13:37.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:37 smithi190 ceph-mon[36341]: daemon mds.h assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-03-04T09:13:37.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:37 smithi190 ceph-mon[36341]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-03-04T09:13:37.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:37 smithi190 ceph-mon[36341]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=h=up:creating} 8 up:standby 2024-03-04T09:13:37.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:37 smithi190 ceph-mon[36341]: daemon mds.h is now active in filesystem cephfs as rank 3 2024-03-04T09:13:37.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:37 smithi102 ceph-mon[36220]: pgmap v302: 129 pgs: 129 active+clean; 584 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 4 op/s 2024-03-04T09:13:37.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:37 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/2556021136' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-03-04T09:13:37.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:37 smithi102 ceph-mon[36220]: mds.? [v2:172.21.15.190:6836/1198639527,v1:172.21.15.190:6837/1198639527] up:active 2024-03-04T09:13:37.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:37 smithi102 ceph-mon[36220]: daemon mds.h assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-03-04T09:13:37.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:37 smithi102 ceph-mon[36220]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-03-04T09:13:37.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:37 smithi102 ceph-mon[36220]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=h=up:creating} 8 up:standby 2024-03-04T09:13:37.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:37 smithi102 ceph-mon[36220]: daemon mds.h is now active in filesystem cephfs as rank 3 2024-03-04T09:13:37.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.748+0000 7f40f39e9640 1 -- 172.21.15.82:0/2612043555 --> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7f40ec061a10 con 0x7f40d80a1e10 2024-03-04T09:13:37.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.768+0000 7f40e27fc640 1 -- 172.21.15.82:0/2612043555 <== mgr.14152 v2:172.21.15.82:6800/1278635224 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f40ec061a10 con 0x7f40d80a1e10 2024-03-04T09:13:37.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.770+0000 7f40f39e9640 1 -- 172.21.15.82:0/2612043555 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f40d80a1e10 msgr2=0x7f40d80a42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:37.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.770+0000 7f40f39e9640 1 --2- 172.21.15.82:0/2612043555 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f40d80a1e10 0x7f40d80a42d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f40ec0698e0 tx=0x7f40dc005f90 comp rx=0 tx=0).stop 2024-03-04T09:13:37.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.770+0000 7f40f39e9640 1 -- 172.21.15.82:0/2612043555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40ec103300 msgr2=0x7f40ec19eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:37.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.770+0000 7f40f39e9640 1 --2- 172.21.15.82:0/2612043555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40ec103300 0x7f40ec19eee0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f40e400eb10 tx=0x7f40e400c2d0 comp rx=0 tx=0).stop 2024-03-04T09:13:37.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.770+0000 7f40f39e9640 1 -- 172.21.15.82:0/2612043555 shutdown_connections 2024-03-04T09:13:37.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.770+0000 7f40f39e9640 1 --2- 172.21.15.82:0/2612043555 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f40d80a1e10 0x7f40d80a42d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:37.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.770+0000 7f40f39e9640 1 --2- 172.21.15.82:0/2612043555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40ec103300 0x7f40ec19eee0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:37.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.770+0000 7f40f39e9640 1 --2- 172.21.15.82:0/2612043555 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40ec102940 0x7f40ec197e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:37.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.770+0000 7f40f39e9640 1 --2- 172.21.15.82:0/2612043555 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f40ec0ff8d0 0x7f40ec197930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:37.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.770+0000 7f40f39e9640 1 -- 172.21.15.82:0/2612043555 >> 172.21.15.82:0/2612043555 conn(0x7f40ec0fb1c0 msgr2=0x7f40ec105d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:37.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.770+0000 7f40f39e9640 1 -- 172.21.15.82:0/2612043555 shutdown_connections 2024-03-04T09:13:37.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.770+0000 7f40f39e9640 1 -- 172.21.15.82:0/2612043555 wait complete. 2024-03-04T09:13:37.775 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:37 smithi082 ceph-mon[32880]: pgmap v302: 129 pgs: 129 active+clean; 584 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 4 op/s 2024-03-04T09:13:37.775 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:37 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/2556021136' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-03-04T09:13:37.775 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:37 smithi082 ceph-mon[32880]: mds.? [v2:172.21.15.190:6836/1198639527,v1:172.21.15.190:6837/1198639527] up:active 2024-03-04T09:13:37.775 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:37 smithi082 ceph-mon[32880]: daemon mds.h assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-03-04T09:13:37.775 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:37 smithi082 ceph-mon[32880]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-03-04T09:13:37.775 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:37 smithi082 ceph-mon[32880]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=h=up:creating} 8 up:standby 2024-03-04T09:13:37.775 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:37 smithi082 ceph-mon[32880]: daemon mds.h is now active in filesystem cephfs as rank 3 2024-03-04T09:13:37.777 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-03-04T09:13:37.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.887+0000 7fdbaffd0640 1 -- 172.21.15.82:0/3419162377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdba8101600 msgr2=0x7fdba8101a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:37.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.887+0000 7fdbaffd0640 1 --2- 172.21.15.82:0/3419162377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdba8101600 0x7fdba8101a20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fdba4009900 tx=0x7fdba402bc30 comp rx=0 tx=0).stop 2024-03-04T09:13:37.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.888+0000 7fdbaffd0640 1 -- 172.21.15.82:0/3419162377 shutdown_connections 2024-03-04T09:13:37.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.888+0000 7fdbaffd0640 1 --2- 172.21.15.82:0/3419162377 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdba81031b0 0x7fdba8109a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:37.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.888+0000 7fdbaffd0640 1 --2- 172.21.15.82:0/3419162377 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdba81027f0 0x7fdba8102c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:37.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.888+0000 7fdbaffd0640 1 --2- 172.21.15.82:0/3419162377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdba8101600 0x7fdba8101a20 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:37.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.888+0000 7fdbaffd0640 1 -- 172.21.15.82:0/3419162377 >> 172.21.15.82:0/3419162377 conn(0x7fdba80fcb70 msgr2=0x7fdba80fefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:37.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.888+0000 7fdbaffd0640 1 -- 172.21.15.82:0/3419162377 shutdown_connections 2024-03-04T09:13:37.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.888+0000 7fdbaffd0640 1 -- 172.21.15.82:0/3419162377 wait complete. 2024-03-04T09:13:37.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.888+0000 7fdbaffd0640 1 Processor -- start 2024-03-04T09:13:37.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.888+0000 7fdbaffd0640 1 -- start start 2024-03-04T09:13:37.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.888+0000 7fdbaffd0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdba8101600 0x7fdba8197960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:37.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.888+0000 7fdbaffd0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdba81027f0 0x7fdba8197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:37.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.888+0000 7fdbaffd0640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdba81031b0 0x7fdba819ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:37.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.888+0000 7fdbaffd0640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba810d260 con 0x7fdba8101600 2024-03-04T09:13:37.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.888+0000 7fdbaffd0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba810d0e0 con 0x7fdba81027f0 2024-03-04T09:13:37.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.888+0000 7fdbaffd0640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba810d3e0 con 0x7fdba81031b0 2024-03-04T09:13:37.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.888+0000 7fdbadd6c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdba8101600 0x7fdba8197960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:37.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.888+0000 7fdbadd6c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdba8101600 0x7fdba8197960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43100/0 (socket says 172.21.15.82:43100) 2024-03-04T09:13:37.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.888+0000 7fdbadd6c640 1 -- 172.21.15.82:0/2573892569 learned_addr learned my addr 172.21.15.82:0/2573892569 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:37.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.889+0000 7fdbae56d640 1 --2- 172.21.15.82:0/2573892569 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdba81031b0 0x7fdba819ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:37.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.889+0000 7fdbad56b640 1 --2- 172.21.15.82:0/2573892569 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdba81027f0 0x7fdba8197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:37.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.889+0000 7fdbadd6c640 1 -- 172.21.15.82:0/2573892569 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdba81031b0 msgr2=0x7fdba819ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:37.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.889+0000 7fdbadd6c640 1 --2- 172.21.15.82:0/2573892569 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdba81031b0 0x7fdba819ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:37.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.889+0000 7fdbadd6c640 1 -- 172.21.15.82:0/2573892569 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdba81027f0 msgr2=0x7fdba8197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:37.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.889+0000 7fdbadd6c640 1 --2- 172.21.15.82:0/2573892569 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdba81027f0 0x7fdba8197ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:37.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.889+0000 7fdbadd6c640 1 -- 172.21.15.82:0/2573892569 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba819f580 con 0x7fdba8101600 2024-03-04T09:13:37.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.889+0000 7fdbad56b640 1 --2- 172.21.15.82:0/2573892569 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdba81027f0 0x7fdba8197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T09:13:37.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.889+0000 7fdbadd6c640 1 --2- 172.21.15.82:0/2573892569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdba8101600 0x7fdba8197960 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fdba4005ab0 tx=0x7fdba4005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:37.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.889+0000 7fdb9effd640 1 -- 172.21.15.82:0/2573892569 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba4043020 con 0x7fdba8101600 2024-03-04T09:13:37.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.889+0000 7fdb9effd640 1 -- 172.21.15.82:0/2573892569 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fdba40054b0 con 0x7fdba8101600 2024-03-04T09:13:37.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.889+0000 7fdbaffd0640 1 -- 172.21.15.82:0/2573892569 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdba819f810 con 0x7fdba8101600 2024-03-04T09:13:37.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.889+0000 7fdb9effd640 1 -- 172.21.15.82:0/2573892569 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba4003bb0 con 0x7fdba8101600 2024-03-04T09:13:37.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.889+0000 7fdbaffd0640 1 -- 172.21.15.82:0/2573892569 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdba819fdb0 con 0x7fdba8101600 2024-03-04T09:13:37.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.890+0000 7fdbaffd0640 1 -- 172.21.15.82:0/2573892569 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdba81089f0 con 0x7fdba8101600 2024-03-04T09:13:37.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.891+0000 7fdb9effd640 1 -- 172.21.15.82:0/2573892569 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 136807+0+0 (secure 0 0 0) 0x7fdba4046020 con 0x7fdba8101600 2024-03-04T09:13:37.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.892+0000 7fdb9effd640 1 --2- 172.21.15.82:0/2573892569 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fdb940a1e90 0x7fdb940a4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:37.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.892+0000 7fdbad56b640 1 --2- 172.21.15.82:0/2573892569 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fdb940a1e90 0x7fdb940a4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:37.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.892+0000 7fdb9effd640 1 -- 172.21.15.82:0/2573892569 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8802+0+0 (secure 0 0 0) 0x7fdba40efbf0 con 0x7fdba8101600 2024-03-04T09:13:37.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.892+0000 7fdbad56b640 1 --2- 172.21.15.82:0/2573892569 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fdb940a1e90 0x7fdb940a4350 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdba8198e70 tx=0x7fdb98005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:37.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:37.896+0000 7fdb9effd640 1 -- 172.21.15.82:0/2573892569 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fdba404d070 con 0x7fdba8101600 2024-03-04T09:13:38.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.103+0000 7fdbaffd0640 1 -- 172.21.15.82:0/2573892569 --> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fdba8061a10 con 0x7fdb940a1e90 2024-03-04T09:13:38.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.106+0000 7fdb9effd640 1 -- 172.21.15.82:0/2573892569 <== mgr.14152 v2:172.21.15.82:6800/1278635224 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+54 (secure 0 0 0) 0x7fdba8061a10 con 0x7fdb940a1e90 2024-03-04T09:13:38.103 INFO:teuthology.orchestra.run.smithi082.stdout:/volumes/qa/sv_1/89a02cee-27ea-4be4-b157-fe2b77fb1539 2024-03-04T09:13:38.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.109+0000 7fdbaffd0640 1 -- 172.21.15.82:0/2573892569 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fdb940a1e90 msgr2=0x7fdb940a4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:38.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.109+0000 7fdbaffd0640 1 --2- 172.21.15.82:0/2573892569 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fdb940a1e90 0x7fdb940a4350 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdba8198e70 tx=0x7fdb98005f90 comp rx=0 tx=0).stop 2024-03-04T09:13:38.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.109+0000 7fdbaffd0640 1 -- 172.21.15.82:0/2573892569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdba8101600 msgr2=0x7fdba8197960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:38.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.109+0000 7fdbaffd0640 1 --2- 172.21.15.82:0/2573892569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdba8101600 0x7fdba8197960 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fdba4005ab0 tx=0x7fdba4005de0 comp rx=0 tx=0).stop 2024-03-04T09:13:38.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.109+0000 7fdbaffd0640 1 -- 172.21.15.82:0/2573892569 shutdown_connections 2024-03-04T09:13:38.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.109+0000 7fdbaffd0640 1 --2- 172.21.15.82:0/2573892569 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fdb940a1e90 0x7fdb940a4350 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:38.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.109+0000 7fdbaffd0640 1 --2- 172.21.15.82:0/2573892569 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdba81031b0 0x7fdba819ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:38.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.109+0000 7fdbaffd0640 1 --2- 172.21.15.82:0/2573892569 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdba81027f0 0x7fdba8197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:38.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.109+0000 7fdbaffd0640 1 --2- 172.21.15.82:0/2573892569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdba8101600 0x7fdba8197960 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:38.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.109+0000 7fdbaffd0640 1 -- 172.21.15.82:0/2573892569 >> 172.21.15.82:0/2573892569 conn(0x7fdba80fcb70 msgr2=0x7fdba8105bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:38.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.109+0000 7fdbaffd0640 1 -- 172.21.15.82:0/2573892569 shutdown_connections 2024-03-04T09:13:38.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.109+0000 7fdbaffd0640 1 -- 172.21.15.82:0/2573892569 wait complete. 2024-03-04T09:13:38.116 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T09:13:38.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.220+0000 7fc62419a640 1 -- 172.21.15.82:0/2863996793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc61c1020a0 msgr2=0x7fc61c108930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:38.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.220+0000 7fc62419a640 1 --2- 172.21.15.82:0/2863996793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc61c1020a0 0x7fc61c108930 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc614009ca0 tx=0x7fc61402c0f0 comp rx=0 tx=0).stop 2024-03-04T09:13:38.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.221+0000 7fc62419a640 1 -- 172.21.15.82:0/2863996793 shutdown_connections 2024-03-04T09:13:38.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.221+0000 7fc62419a640 1 --2- 172.21.15.82:0/2863996793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc61c1020a0 0x7fc61c108930 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:38.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.221+0000 7fc62419a640 1 --2- 172.21.15.82:0/2863996793 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc61c1016e0 0x7fc61c101b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:38.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.221+0000 7fc62419a640 1 --2- 172.21.15.82:0/2863996793 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc61c1004f0 0x7fc61c100910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:38.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.221+0000 7fc62419a640 1 -- 172.21.15.82:0/2863996793 >> 172.21.15.82:0/2863996793 conn(0x7fc61c0fba60 msgr2=0x7fc61c0fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:38.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.221+0000 7fc62419a640 1 -- 172.21.15.82:0/2863996793 shutdown_connections 2024-03-04T09:13:38.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.221+0000 7fc62419a640 1 -- 172.21.15.82:0/2863996793 wait complete. 2024-03-04T09:13:38.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.221+0000 7fc62419a640 1 Processor -- start 2024-03-04T09:13:38.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.221+0000 7fc62419a640 1 -- start start 2024-03-04T09:13:38.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.221+0000 7fc62419a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc61c1004f0 0x7fc61c199aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:38.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.221+0000 7fc62419a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc61c1016e0 0x7fc61c199fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:38.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.221+0000 7fc62419a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc61c1020a0 0x7fc61c1a1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:38.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.221+0000 7fc62419a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c10d260 con 0x7fc61c1020a0 2024-03-04T09:13:38.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.221+0000 7fc62419a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c10d0e0 con 0x7fc61c1016e0 2024-03-04T09:13:38.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.221+0000 7fc62419a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c10d3e0 con 0x7fc61c1004f0 2024-03-04T09:13:38.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.221+0000 7fc622737640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc61c1020a0 0x7fc61c1a1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:38.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.221+0000 7fc622737640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc61c1020a0 0x7fc61c1a1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43116/0 (socket says 172.21.15.82:43116) 2024-03-04T09:13:38.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.222+0000 7fc622737640 1 -- 172.21.15.82:0/491018572 learned_addr learned my addr 172.21.15.82:0/491018572 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:38.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.222+0000 7fc621735640 1 --2- 172.21.15.82:0/491018572 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc61c1016e0 0x7fc61c199fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:38.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.222+0000 7fc621f36640 1 --2- 172.21.15.82:0/491018572 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc61c1004f0 0x7fc61c199aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:38.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.222+0000 7fc622737640 1 -- 172.21.15.82:0/491018572 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc61c1004f0 msgr2=0x7fc61c199aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:38.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.222+0000 7fc622737640 1 --2- 172.21.15.82:0/491018572 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc61c1004f0 0x7fc61c199aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:38.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.222+0000 7fc622737640 1 -- 172.21.15.82:0/491018572 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc61c1016e0 msgr2=0x7fc61c199fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:38.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.222+0000 7fc622737640 1 --2- 172.21.15.82:0/491018572 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc61c1016e0 0x7fc61c199fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:38.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.222+0000 7fc622737640 1 -- 172.21.15.82:0/491018572 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc61c1a16c0 con 0x7fc61c1020a0 2024-03-04T09:13:38.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.222+0000 7fc622737640 1 --2- 172.21.15.82:0/491018572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc61c1020a0 0x7fc61c1a1050 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc61402c630 tx=0x7fc614032980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:38.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.222+0000 7fc612ffd640 1 -- 172.21.15.82:0/491018572 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc614039050 con 0x7fc61c1020a0 2024-03-04T09:13:38.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.222+0000 7fc62419a640 1 -- 172.21.15.82:0/491018572 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc61c1a1950 con 0x7fc61c1020a0 2024-03-04T09:13:38.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.222+0000 7fc612ffd640 1 -- 172.21.15.82:0/491018572 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fc61403a040 con 0x7fc61c1020a0 2024-03-04T09:13:38.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.222+0000 7fc612ffd640 1 -- 172.21.15.82:0/491018572 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc614040450 con 0x7fc61c1020a0 2024-03-04T09:13:38.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.222+0000 7fc62419a640 1 -- 172.21.15.82:0/491018572 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc61c1a1e90 con 0x7fc61c1020a0 2024-03-04T09:13:38.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.223+0000 7fc62419a640 1 -- 172.21.15.82:0/491018572 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc61c1a20c0 con 0x7fc61c1020a0 2024-03-04T09:13:38.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.224+0000 7fc612ffd640 1 -- 172.21.15.82:0/491018572 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 136807+0+0 (secure 0 0 0) 0x7fc614003b70 con 0x7fc61c1020a0 2024-03-04T09:13:38.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.225+0000 7fc612ffd640 1 --2- 172.21.15.82:0/491018572 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fc6080a1e10 0x7fc6080a42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:38.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.225+0000 7fc621f36640 1 --2- 172.21.15.82:0/491018572 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fc6080a1e10 0x7fc6080a42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:38.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.225+0000 7fc612ffd640 1 -- 172.21.15.82:0/491018572 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8802+0+0 (secure 0 0 0) 0x7fc6140f0ab0 con 0x7fc61c1020a0 2024-03-04T09:13:38.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.225+0000 7fc621f36640 1 --2- 172.21.15.82:0/491018572 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fc6080a1e10 0x7fc6080a42d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc61c101540 tx=0x7fc60c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:38.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.229+0000 7fc612ffd640 1 -- 172.21.15.82:0/491018572 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fc6140bdc50 con 0x7fc61c1020a0 2024-03-04T09:13:38.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.442+0000 7fc62419a640 1 -- 172.21.15.82:0/491018572 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc61c1a2290 con 0x7fc61c1020a0 2024-03-04T09:13:38.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.443+0000 7fc612ffd640 1 -- 172.21.15.82:0/491018572 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11462 (secure 0 0 0) 0x7fc6140098b0 con 0x7fc61c1020a0 2024-03-04T09:13:38.439 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:13:38.439 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3123844705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3123844705},{"type":"v1","addr":"172.21.15.82:6835","nonce":3123844705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2620634252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2620634252},{"type":"v1","addr":"172.21.15.82:6837","nonce":2620634252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-04T09:13:10.076732+0000","modified":"2024-03-04T09:13:38.017758+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24476,"mds_1":24469,"mds_2":24451,"mds_3":24449,"mds_4":24439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14613":{"gid":14613,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/1240838024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1240838024},{"type":"v1","addr":"172.21.15.82:6839","nonce":1240838024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14625":{"gid":14625,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/213594267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":213594267},{"type":"v1","addr":"172.21.15.82:6841","nonce":213594267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24398":{"gid":24398,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/1142302200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":1142302200},{"type":"v1","addr":"172.21.15.102:6833","nonce":1142302200}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24403":{"gid":24403,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6833/3023382814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":3023382814},{"type":"v1","addr":"172.21.15.190:6833","nonce":3023382814}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24422":{"gid":24422,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6835/2134310473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":2134310473},{"type":"v1","addr":"172.21.15.102:6835","nonce":2134310473}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24439":{"gid":24439,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":14,"addr":"172.21.15.190:6835/3183532624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3183532624},{"type":"v1","addr":"172.21.15.190:6835","nonce":3183532624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24449":{"gid":24449,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":12,"addr":"172.21.15.102:6837/1210579527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1210579527},{"type":"v1","addr":"172.21.15.102:6837","nonce":1210579527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24451":{"gid":24451,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.190:6837/1198639527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":1198639527},{"type":"v1","addr":"172.21.15.190:6837","nonce":1198639527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.190:6839/878555510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":878555510},{"type":"v1","addr":"172.21.15.190:6839","nonce":878555510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6839/35424130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":35424130},{"type":"v1","addr":"172.21.15.102:6839","nonce":35424130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24449,24439,24451,24476,24469]},"id":1}]} 2024-03-04T09:13:38.439 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 27 2024-03-04T09:13:38.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.444+0000 7fc62419a640 1 -- 172.21.15.82:0/491018572 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fc6080a1e10 msgr2=0x7fc6080a42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:38.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.444+0000 7fc62419a640 1 --2- 172.21.15.82:0/491018572 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fc6080a1e10 0x7fc6080a42d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc61c101540 tx=0x7fc60c005f90 comp rx=0 tx=0).stop 2024-03-04T09:13:38.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.444+0000 7fc62419a640 1 -- 172.21.15.82:0/491018572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc61c1020a0 msgr2=0x7fc61c1a1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:38.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.444+0000 7fc62419a640 1 --2- 172.21.15.82:0/491018572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc61c1020a0 0x7fc61c1a1050 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc61402c630 tx=0x7fc614032980 comp rx=0 tx=0).stop 2024-03-04T09:13:38.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.445+0000 7fc62419a640 1 -- 172.21.15.82:0/491018572 shutdown_connections 2024-03-04T09:13:38.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.445+0000 7fc62419a640 1 --2- 172.21.15.82:0/491018572 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fc6080a1e10 0x7fc6080a42d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:38.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.445+0000 7fc62419a640 1 --2- 172.21.15.82:0/491018572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc61c1020a0 0x7fc61c1a1050 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:38.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.445+0000 7fc62419a640 1 --2- 172.21.15.82:0/491018572 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc61c1016e0 0x7fc61c199fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:38.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.445+0000 7fc62419a640 1 --2- 172.21.15.82:0/491018572 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc61c1004f0 0x7fc61c199aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:38.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.445+0000 7fc62419a640 1 -- 172.21.15.82:0/491018572 >> 172.21.15.82:0/491018572 conn(0x7fc61c0fba60 msgr2=0x7fc61c1092f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:38.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.445+0000 7fc62419a640 1 -- 172.21.15.82:0/491018572 shutdown_connections 2024-03-04T09:13:38.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.445+0000 7fc62419a640 1 -- 172.21.15.82:0/491018572 wait complete. 2024-03-04T09:13:38.452 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T09:13:38.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.557+0000 7f098dcfb640 1 -- 172.21.15.82:0/3710929090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09880ffca0 msgr2=0x7f09881000c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:38.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.557+0000 7f098dcfb640 1 --2- 172.21.15.82:0/3710929090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09880ffca0 0x7f09881000c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0978009900 tx=0x7f097802bc30 comp rx=0 tx=0).stop 2024-03-04T09:13:38.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.557+0000 7f098dcfb640 1 -- 172.21.15.82:0/3710929090 shutdown_connections 2024-03-04T09:13:38.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.557+0000 7f098dcfb640 1 --2- 172.21.15.82:0/3710929090 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0988101850 0x7f09881080e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:38.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.557+0000 7f098dcfb640 1 --2- 172.21.15.82:0/3710929090 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0988100e90 0x7f0988101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:38.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.557+0000 7f098dcfb640 1 --2- 172.21.15.82:0/3710929090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09880ffca0 0x7f09881000c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:38.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.557+0000 7f098dcfb640 1 -- 172.21.15.82:0/3710929090 >> 172.21.15.82:0/3710929090 conn(0x7f09880fb210 msgr2=0x7f09880fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:38.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.557+0000 7f098dcfb640 1 -- 172.21.15.82:0/3710929090 shutdown_connections 2024-03-04T09:13:38.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.557+0000 7f098dcfb640 1 -- 172.21.15.82:0/3710929090 wait complete. 2024-03-04T09:13:38.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.557+0000 7f098dcfb640 1 Processor -- start 2024-03-04T09:13:38.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.557+0000 7f098dcfb640 1 -- start start 2024-03-04T09:13:38.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.558+0000 7f098dcfb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09880ffca0 0x7f0988197940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:38.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.558+0000 7f098dcfb640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0988100e90 0x7f0988197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:38.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.558+0000 7f098dcfb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0988101850 0x7f098819eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:38.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.558+0000 7f098dcfb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f098810b080 con 0x7f09880ffca0 2024-03-04T09:13:38.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.558+0000 7f098dcfb640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f098810af00 con 0x7f0988101850 2024-03-04T09:13:38.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.558+0000 7f098dcfb640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f098810b200 con 0x7f0988100e90 2024-03-04T09:13:38.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.558+0000 7f09877fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09880ffca0 0x7f0988197940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:38.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.558+0000 7f09877fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09880ffca0 0x7f0988197940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43130/0 (socket says 172.21.15.82:43130) 2024-03-04T09:13:38.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.558+0000 7f09877fe640 1 -- 172.21.15.82:0/2916909059 learned_addr learned my addr 172.21.15.82:0/2916909059 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:38.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.558+0000 7f0987fff640 1 --2- 172.21.15.82:0/2916909059 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0988101850 0x7f098819eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:38.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.558+0000 7f0986ffd640 1 --2- 172.21.15.82:0/2916909059 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0988100e90 0x7f0988197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:38.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.558+0000 7f09877fe640 1 -- 172.21.15.82:0/2916909059 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0988100e90 msgr2=0x7f0988197e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:38.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.558+0000 7f09877fe640 1 --2- 172.21.15.82:0/2916909059 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0988100e90 0x7f0988197e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:38.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.558+0000 7f09877fe640 1 -- 172.21.15.82:0/2916909059 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0988101850 msgr2=0x7f098819eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:38.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.558+0000 7f09877fe640 1 --2- 172.21.15.82:0/2916909059 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0988101850 0x7f098819eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:38.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.558+0000 7f09877fe640 1 -- 172.21.15.82:0/2916909059 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f098819f560 con 0x7f09880ffca0 2024-03-04T09:13:38.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.558+0000 7f0986ffd640 1 --2- 172.21.15.82:0/2916909059 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0988100e90 0x7f0988197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T09:13:38.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.558+0000 7f09877fe640 1 --2- 172.21.15.82:0/2916909059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09880ffca0 0x7f0988197940 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f097802c880 tx=0x7f0978004e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:38.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.558+0000 7f0984ff9640 1 -- 172.21.15.82:0/2916909059 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0978043020 con 0x7f09880ffca0 2024-03-04T09:13:38.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.558+0000 7f098dcfb640 1 -- 172.21.15.82:0/2916909059 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f098819f7f0 con 0x7f09880ffca0 2024-03-04T09:13:38.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.558+0000 7f0984ff9640 1 -- 172.21.15.82:0/2916909059 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f09780054f0 con 0x7f09880ffca0 2024-03-04T09:13:38.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.558+0000 7f0984ff9640 1 -- 172.21.15.82:0/2916909059 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0978003cd0 con 0x7f09880ffca0 2024-03-04T09:13:38.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.558+0000 7f098dcfb640 1 -- 172.21.15.82:0/2916909059 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f098819fd40 con 0x7f09880ffca0 2024-03-04T09:13:38.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.559+0000 7f098dcfb640 1 -- 172.21.15.82:0/2916909059 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0988106fc0 con 0x7f09880ffca0 2024-03-04T09:13:38.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.560+0000 7f0984ff9640 1 -- 172.21.15.82:0/2916909059 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 136807+0+0 (secure 0 0 0) 0x7f0978046020 con 0x7f09880ffca0 2024-03-04T09:13:38.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.561+0000 7f0984ff9640 1 --2- 172.21.15.82:0/2916909059 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f09700a1e10 0x7f09700a42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:38.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.561+0000 7f0986ffd640 1 --2- 172.21.15.82:0/2916909059 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f09700a1e10 0x7f09700a42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:38.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.561+0000 7f0984ff9640 1 -- 172.21.15.82:0/2916909059 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8802+0+0 (secure 0 0 0) 0x7f09780efd30 con 0x7f09880ffca0 2024-03-04T09:13:38.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.561+0000 7f0986ffd640 1 --2- 172.21.15.82:0/2916909059 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f09700a1e10 0x7f09700a42d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0988198e50 tx=0x7f097c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:38.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.565+0000 7f0984ff9640 1 -- 172.21.15.82:0/2916909059 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f097804d070 con 0x7f09880ffca0 2024-03-04T09:13:38.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:38 smithi190 ceph-mon[36341]: from='client.24652 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:13:38.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:38 smithi190 ceph-mon[36341]: from='client.14886 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:13:38.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:38 smithi190 ceph-mon[36341]: mds.? [v2:172.21.15.102:6836/1210579527,v1:172.21.15.102:6837/1210579527] up:active 2024-03-04T09:13:38.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:38 smithi190 ceph-mon[36341]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-03-04T09:13:38.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:38 smithi190 ceph-mon[36341]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-03-04T09:13:38.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:38 smithi190 ceph-mon[36341]: Cluster is now healthy 2024-03-04T09:13:38.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:38 smithi190 ceph-mon[36341]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=h=up:active} 8 up:standby 2024-03-04T09:13:38.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:38 smithi190 ceph-mon[36341]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-03-04T09:13:38.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:38 smithi190 ceph-mon[36341]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-03-04T09:13:38.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:38 smithi190 ceph-mon[36341]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-03-04T09:13:38.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:38 smithi190 ceph-mon[36341]: from='client.14892 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:13:38.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:38 smithi190 ceph-mon[36341]: mds.? [v2:172.21.15.190:6834/3183532624,v1:172.21.15.190:6835/3183532624] up:active 2024-03-04T09:13:38.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:38 smithi190 ceph-mon[36341]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:13:38.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:38 smithi102 ceph-mon[36220]: from='client.24652 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:13:38.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:38 smithi102 ceph-mon[36220]: from='client.14886 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:13:38.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:38 smithi102 ceph-mon[36220]: mds.? [v2:172.21.15.102:6836/1210579527,v1:172.21.15.102:6837/1210579527] up:active 2024-03-04T09:13:38.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:38 smithi102 ceph-mon[36220]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-03-04T09:13:38.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:38 smithi102 ceph-mon[36220]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-03-04T09:13:38.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:38 smithi102 ceph-mon[36220]: Cluster is now healthy 2024-03-04T09:13:38.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:38 smithi102 ceph-mon[36220]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=h=up:active} 8 up:standby 2024-03-04T09:13:38.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:38 smithi102 ceph-mon[36220]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-03-04T09:13:38.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:38 smithi102 ceph-mon[36220]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-03-04T09:13:38.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:38 smithi102 ceph-mon[36220]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-03-04T09:13:38.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:38 smithi102 ceph-mon[36220]: from='client.14892 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:13:38.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:38 smithi102 ceph-mon[36220]: mds.? [v2:172.21.15.190:6834/3183532624,v1:172.21.15.190:6835/3183532624] up:active 2024-03-04T09:13:38.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:38 smithi102 ceph-mon[36220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:13:38.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.741+0000 7f098dcfb640 1 -- 172.21.15.82:0/2916909059 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f09880621d0 con 0x7f09880ffca0 2024-03-04T09:13:38.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.743+0000 7f0984ff9640 1 -- 172.21.15.82:0/2916909059 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+24092 (secure 0 0 0) 0x7f09780bced0 con 0x7f09880ffca0 2024-03-04T09:13:38.739 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:13:38.740 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":90,"fsid":"2e533fc8-da06-11ee-95c6-87774f69a715","created":"2024-03-04T09:05:16.488249+0000","modified":"2024-03-04T09:13:15.136817+0000","last_up_change":"2024-03-04T09:12:22.308711+0000","last_in_change":"2024-03-04T09:12:02.548212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T09:08:36.508257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T09:13:07.981726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T09:13:09.289799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-04T09:13:13.008516+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"085b5c4b-ede9-4d0d-b994-50c89d991012","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6803","nonce":709655235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6805","nonce":709655235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6809","nonce":709655235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6807","nonce":709655235}]},"public_addr":"172.21.15.82:6803/709655235","cluster_addr":"172.21.15.82:6805/709655235","heartbeat_back_addr":"172.21.15.82:6809/709655235","heartbeat_front_addr":"172.21.15.82:6807/709655235","state":["exists","up"]},{"osd":1,"uuid":"e4dd7079-333e-4bcf-b3af-11fb082a5af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6801","nonce":270721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6803","nonce":270721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6807","nonce":270721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6805","nonce":270721212}]},"public_addr":"172.21.15.102:6801/270721212","cluster_addr":"172.21.15.102:6803/270721212","heartbeat_back_addr":"172.21.15.102:6807/270721212","heartbeat_front_addr":"172.21.15.102:6805/270721212","state":["exists","up"]},{"osd":2,"uuid":"6fed5fd6-dc82-497f-9d69-c10a5e5802da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6801","nonce":946410459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6803","nonce":946410459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6807","nonce":946410459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6805","nonce":946410459}]},"public_addr":"172.21.15.190:6801/946410459","cluster_addr":"172.21.15.190:6803/946410459","heartbeat_back_addr":"172.21.15.190:6807/946410459","heartbeat_front_addr":"172.21.15.190:6805/946410459","state":["exists","up"]},{"osd":3,"uuid":"91ccbdc3-3da6-4d39-8a89-3a7b7bb4adc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6811","nonce":980870924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6813","nonce":980870924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6817","nonce":980870924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6815","nonce":980870924}]},"public_addr":"172.21.15.82:6811/980870924","cluster_addr":"172.21.15.82:6813/980870924","heartbeat_back_addr":"172.21.15.82:6817/980870924","heartbeat_front_addr":"172.21.15.82:6815/980870924","state":["exists","up"]},{"osd":4,"uuid":"dbb9d486-5daa-4819-bbed-04fc76ca473e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6809","nonce":1229627753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6811","nonce":1229627753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6815","nonce":1229627753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6813","nonce":1229627753}]},"public_addr":"172.21.15.102:6809/1229627753","cluster_addr":"172.21.15.102:6811/1229627753","heartbeat_back_addr":"172.21.15.102:6815/1229627753","heartbeat_front_addr":"172.21.15.102:6813/1229627753","state":["exists","up"]},{"osd":5,"uuid":"6b50127b-df2b-4c95-8e53-9d42b40273fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6809","nonce":2171194148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6811","nonce":2171194148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6815","nonce":2171194148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6813","nonce":2171194148}]},"public_addr":"172.21.15.190:6809/2171194148","cluster_addr":"172.21.15.190:6811/2171194148","heartbeat_back_addr":"172.21.15.190:6815/2171194148","heartbeat_front_addr":"172.21.15.190:6813/2171194148","state":["exists","up"]},{"osd":6,"uuid":"e72bebb0-5939-4210-950a-41c25c23c62f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6819","nonce":454436959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6821","nonce":454436959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6825","nonce":454436959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6823","nonce":454436959}]},"public_addr":"172.21.15.82:6819/454436959","cluster_addr":"172.21.15.82:6821/454436959","heartbeat_back_addr":"172.21.15.82:6825/454436959","heartbeat_front_addr":"172.21.15.82:6823/454436959","state":["exists","up"]},{"osd":7,"uuid":"72f83f97-f496-4503-8284-6a7b8f99a6f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6817","nonce":2745057274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6819","nonce":2745057274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6823","nonce":2745057274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6821","nonce":2745057274}]},"public_addr":"172.21.15.102:6817/2745057274","cluster_addr":"172.21.15.102:6819/2745057274","heartbeat_back_addr":"172.21.15.102:6823/2745057274","heartbeat_front_addr":"172.21.15.102:6821/2745057274","state":["exists","up"]},{"osd":8,"uuid":"92c9109d-6ebb-4c50-9944-28cd7b2f9c0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6817","nonce":1679683516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6819","nonce":1679683516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6823","nonce":1679683516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6821","nonce":1679683516}]},"public_addr":"172.21.15.190:6817/1679683516","cluster_addr":"172.21.15.190:6819/1679683516","heartbeat_back_addr":"172.21.15.190:6823/1679683516","heartbeat_front_addr":"172.21.15.190:6821/1679683516","state":["exists","up"]},{"osd":9,"uuid":"a3cfce03-0148-475d-bf55-b8284ae1cad2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6827","nonce":1777272933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6829","nonce":1777272933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6833","nonce":1777272933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6831","nonce":1777272933}]},"public_addr":"172.21.15.82:6827/1777272933","cluster_addr":"172.21.15.82:6829/1777272933","heartbeat_back_addr":"172.21.15.82:6833/1777272933","heartbeat_front_addr":"172.21.15.82:6831/1777272933","state":["exists","up"]},{"osd":10,"uuid":"db156ccf-4396-43cb-b69a-bb9095b94b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6825","nonce":1012784035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6827","nonce":1012784035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6831","nonce":1012784035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6829","nonce":1012784035}]},"public_addr":"172.21.15.102:6825/1012784035","cluster_addr":"172.21.15.102:6827/1012784035","heartbeat_back_addr":"172.21.15.102:6831/1012784035","heartbeat_front_addr":"172.21.15.102:6829/1012784035","state":["exists","up"]},{"osd":11,"uuid":"b4d52576-f5b4-479f-8ff6-8fdba4635ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6825","nonce":144700355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6827","nonce":144700355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6831","nonce":144700355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6829","nonce":144700355}]},"public_addr":"172.21.15.190:6825/144700355","cluster_addr":"172.21.15.190:6827/144700355","heartbeat_back_addr":"172.21.15.190:6831/144700355","heartbeat_front_addr":"172.21.15.190:6829/144700355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:07:47.007772+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:09.944738+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:33.183567+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:58.302023+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:09:23.042488+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:09:47.616009+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:10:13.122887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:10:38.584530+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:03.473453+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:29.847105+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:55.152195+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:12:20.401765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6800/1901539016":"2024-03-05T09:06:12.169231+0000","172.21.15.82:0/1124105204":"2024-03-05T09:06:12.169231+0000","172.21.15.82:6801/1901539016":"2024-03-05T09:06:12.169231+0000","172.21.15.82:0/735262841":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/2402774828":"2024-03-05T09:05:44.913099+0000","172.21.15.82:6801/3291527077":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/1846720385":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/3757201752":"2024-03-05T09:06:12.169231+0000","172.21.15.82:6800/3291527077":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/984630078":"2024-03-05T09:06:12.169231+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T09:13:38.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.745+0000 7f098dcfb640 1 -- 172.21.15.82:0/2916909059 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f09700a1e10 msgr2=0x7f09700a42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:38.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.745+0000 7f098dcfb640 1 --2- 172.21.15.82:0/2916909059 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f09700a1e10 0x7f09700a42d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0988198e50 tx=0x7f097c005f90 comp rx=0 tx=0).stop 2024-03-04T09:13:38.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.745+0000 7f098dcfb640 1 -- 172.21.15.82:0/2916909059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09880ffca0 msgr2=0x7f0988197940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:38.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.745+0000 7f098dcfb640 1 --2- 172.21.15.82:0/2916909059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09880ffca0 0x7f0988197940 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f097802c880 tx=0x7f0978004e20 comp rx=0 tx=0).stop 2024-03-04T09:13:38.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.745+0000 7f098dcfb640 1 -- 172.21.15.82:0/2916909059 shutdown_connections 2024-03-04T09:13:38.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.745+0000 7f098dcfb640 1 --2- 172.21.15.82:0/2916909059 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f09700a1e10 0x7f09700a42d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:38.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.745+0000 7f098dcfb640 1 --2- 172.21.15.82:0/2916909059 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0988101850 0x7f098819eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:38.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.745+0000 7f098dcfb640 1 --2- 172.21.15.82:0/2916909059 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0988100e90 0x7f0988197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:38.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.745+0000 7f098dcfb640 1 --2- 172.21.15.82:0/2916909059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09880ffca0 0x7f0988197940 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:38.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.745+0000 7f098dcfb640 1 -- 172.21.15.82:0/2916909059 >> 172.21.15.82:0/2916909059 conn(0x7f09880fb210 msgr2=0x7f0988104190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:38.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.745+0000 7f098dcfb640 1 -- 172.21.15.82:0/2916909059 shutdown_connections 2024-03-04T09:13:38.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.745+0000 7f098dcfb640 1 -- 172.21.15.82:0/2916909059 wait complete. 2024-03-04T09:13:38.751 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:38 smithi082 ceph-mon[32880]: from='client.24652 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:13:38.751 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:38 smithi082 ceph-mon[32880]: from='client.14886 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:13:38.751 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:38 smithi082 ceph-mon[32880]: mds.? [v2:172.21.15.102:6836/1210579527,v1:172.21.15.102:6837/1210579527] up:active 2024-03-04T09:13:38.751 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:38 smithi082 ceph-mon[32880]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-03-04T09:13:38.751 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:38 smithi082 ceph-mon[32880]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-03-04T09:13:38.751 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:38 smithi082 ceph-mon[32880]: Cluster is now healthy 2024-03-04T09:13:38.752 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:38 smithi082 ceph-mon[32880]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=h=up:active} 8 up:standby 2024-03-04T09:13:38.752 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:38 smithi082 ceph-mon[32880]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-03-04T09:13:38.752 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:38 smithi082 ceph-mon[32880]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-03-04T09:13:38.752 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:38 smithi082 ceph-mon[32880]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-03-04T09:13:38.752 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:38 smithi082 ceph-mon[32880]: from='client.14892 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:13:38.752 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:38 smithi082 ceph-mon[32880]: mds.? [v2:172.21.15.190:6834/3183532624,v1:172.21.15.190:6835/3183532624] up:active 2024-03-04T09:13:38.752 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:38 smithi082 ceph-mon[32880]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:13:38.754 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-04T09:13:38.754 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-04T09:13:38.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.861+0000 7f0df11e4640 1 -- 172.21.15.82:0/1048799748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0dec1016e0 msgr2=0x7f0dec101b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:38.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.861+0000 7f0df11e4640 1 --2- 172.21.15.82:0/1048799748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0dec1016e0 0x7f0dec101b60 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc009900 tx=0x7f0ddc02bc30 comp rx=0 tx=0).stop 2024-03-04T09:13:38.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.862+0000 7f0df11e4640 1 -- 172.21.15.82:0/1048799748 shutdown_connections 2024-03-04T09:13:38.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.862+0000 7f0df11e4640 1 --2- 172.21.15.82:0/1048799748 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0dec1020a0 0x7f0dec108930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:38.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.862+0000 7f0df11e4640 1 --2- 172.21.15.82:0/1048799748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0dec1016e0 0x7f0dec101b60 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:38.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.862+0000 7f0df11e4640 1 --2- 172.21.15.82:0/1048799748 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0dec1004f0 0x7f0dec100910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:38.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.862+0000 7f0df11e4640 1 -- 172.21.15.82:0/1048799748 >> 172.21.15.82:0/1048799748 conn(0x7f0dec0fba60 msgr2=0x7f0dec0fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:38.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.862+0000 7f0df11e4640 1 -- 172.21.15.82:0/1048799748 shutdown_connections 2024-03-04T09:13:38.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.862+0000 7f0df11e4640 1 -- 172.21.15.82:0/1048799748 wait complete. 2024-03-04T09:13:38.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.862+0000 7f0df11e4640 1 Processor -- start 2024-03-04T09:13:38.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.862+0000 7f0df11e4640 1 -- start start 2024-03-04T09:13:38.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.863+0000 7f0df11e4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0dec1004f0 0x7f0dec06a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:38.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.863+0000 7f0df11e4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0dec1016e0 0x7f0dec19c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:38.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.863+0000 7f0df11e4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0dec1020a0 0x7f0dec19ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:38.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.863+0000 7f0df11e4640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dec10c150 con 0x7f0dec1004f0 2024-03-04T09:13:38.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.863+0000 7f0df11e4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dec10bfd0 con 0x7f0dec1020a0 2024-03-04T09:13:38.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.863+0000 7f0df11e4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dec10c2d0 con 0x7f0dec1016e0 2024-03-04T09:13:38.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.863+0000 7f0dead9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0dec1004f0 0x7f0dec06a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:38.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.863+0000 7f0dead9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0dec1004f0 0x7f0dec06a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43148/0 (socket says 172.21.15.82:43148) 2024-03-04T09:13:38.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.863+0000 7f0dead9d640 1 -- 172.21.15.82:0/1991007569 learned_addr learned my addr 172.21.15.82:0/1991007569 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:38.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.863+0000 7f0dea59c640 1 --2- 172.21.15.82:0/1991007569 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0dec1016e0 0x7f0dec19c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:38.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.863+0000 7f0deb59e640 1 --2- 172.21.15.82:0/1991007569 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0dec1020a0 0x7f0dec19ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:38.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.863+0000 7f0dea59c640 1 -- 172.21.15.82:0/1991007569 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0dec1020a0 msgr2=0x7f0dec19ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:38.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.863+0000 7f0dea59c640 1 --2- 172.21.15.82:0/1991007569 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0dec1020a0 0x7f0dec19ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:38.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.863+0000 7f0dea59c640 1 -- 172.21.15.82:0/1991007569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0dec1004f0 msgr2=0x7f0dec06a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:38.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.863+0000 7f0dea59c640 1 --2- 172.21.15.82:0/1991007569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0dec1004f0 0x7f0dec06a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:38.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.863+0000 7f0dea59c640 1 -- 172.21.15.82:0/1991007569 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dec19f4f0 con 0x7f0dec1016e0 2024-03-04T09:13:38.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.863+0000 7f0dead9d640 1 --2- 172.21.15.82:0/1991007569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0dec1004f0 0x7f0dec06a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:13:38.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.863+0000 7f0dea59c640 1 --2- 172.21.15.82:0/1991007569 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0dec1016e0 0x7f0dec19c5f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc009230 tx=0x7f0ddc005dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:38.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.863+0000 7f0de3fff640 1 -- 172.21.15.82:0/1991007569 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc043020 con 0x7f0dec1016e0 2024-03-04T09:13:38.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.863+0000 7f0df11e4640 1 -- 172.21.15.82:0/1991007569 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dec19f780 con 0x7f0dec1016e0 2024-03-04T09:13:38.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.864+0000 7f0de3fff640 1 -- 172.21.15.82:0/1991007569 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f0ddc0054f0 con 0x7f0dec1016e0 2024-03-04T09:13:38.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.864+0000 7f0df11e4640 1 -- 172.21.15.82:0/1991007569 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dec19fcf0 con 0x7f0dec1016e0 2024-03-04T09:13:38.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.864+0000 7f0de3fff640 1 -- 172.21.15.82:0/1991007569 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc003bb0 con 0x7f0dec1016e0 2024-03-04T09:13:38.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.864+0000 7f0df11e4640 1 -- 172.21.15.82:0/1991007569 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dec107810 con 0x7f0dec1016e0 2024-03-04T09:13:38.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.865+0000 7f0de3fff640 1 -- 172.21.15.82:0/1991007569 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 17) v1 ==== 136807+0+0 (secure 0 0 0) 0x7f0ddc046020 con 0x7f0dec1016e0 2024-03-04T09:13:38.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.866+0000 7f0de3fff640 1 --2- 172.21.15.82:0/1991007569 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f0dd80a1e10 0x7f0dd80a42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:38.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.866+0000 7f0dead9d640 1 --2- 172.21.15.82:0/1991007569 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f0dd80a1e10 0x7f0dd80a42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:38.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.866+0000 7f0de3fff640 1 -- 172.21.15.82:0/1991007569 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8802+0+0 (secure 0 0 0) 0x7f0ddc0efbc0 con 0x7f0dec1016e0 2024-03-04T09:13:38.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.866+0000 7f0dead9d640 1 --2- 172.21.15.82:0/1991007569 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f0dd80a1e10 0x7f0dd80a42d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0dd40095f0 tx=0x7f0dd4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:38.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:38.873+0000 7f0de3fff640 1 -- 172.21.15.82:0/1991007569 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f0ddc04d070 con 0x7f0dec1016e0 2024-03-04T09:13:39.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.045+0000 7f0df11e4640 1 -- 172.21.15.82:0/1991007569 --> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0dec061a10 con 0x7f0dd80a1e10 2024-03-04T09:13:39.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.055+0000 7f0de3fff640 1 -- 172.21.15.82:0/1991007569 <== mgr.14152 v2:172.21.15.82:6800/1278635224 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+340572 (secure 0 0 0) 0x7f0dec061a10 con 0x7f0dd80a1e10 2024-03-04T09:13:39.056 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:13:39.058 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-03-04T09:13:39.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.059+0000 7f0df11e4640 1 -- 172.21.15.82:0/1991007569 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f0dd80a1e10 msgr2=0x7f0dd80a42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:39.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.059+0000 7f0df11e4640 1 --2- 172.21.15.82:0/1991007569 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f0dd80a1e10 0x7f0dd80a42d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0dd40095f0 tx=0x7f0dd4005f90 comp rx=0 tx=0).stop 2024-03-04T09:13:39.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.059+0000 7f0df11e4640 1 -- 172.21.15.82:0/1991007569 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0dec1016e0 msgr2=0x7f0dec19c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:39.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.059+0000 7f0df11e4640 1 --2- 172.21.15.82:0/1991007569 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0dec1016e0 0x7f0dec19c5f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc009230 tx=0x7f0ddc005dc0 comp rx=0 tx=0).stop 2024-03-04T09:13:39.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.059+0000 7f0df11e4640 1 -- 172.21.15.82:0/1991007569 shutdown_connections 2024-03-04T09:13:39.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.059+0000 7f0df11e4640 1 --2- 172.21.15.82:0/1991007569 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f0dd80a1e10 0x7f0dd80a42d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:39.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.059+0000 7f0df11e4640 1 --2- 172.21.15.82:0/1991007569 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0dec1020a0 0x7f0dec19ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:39.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.059+0000 7f0df11e4640 1 --2- 172.21.15.82:0/1991007569 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0dec1016e0 0x7f0dec19c5f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:39.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.059+0000 7f0df11e4640 1 --2- 172.21.15.82:0/1991007569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0dec1004f0 0x7f0dec06a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:39.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.059+0000 7f0df11e4640 1 -- 172.21.15.82:0/1991007569 >> 172.21.15.82:0/1991007569 conn(0x7f0dec0fba60 msgr2=0x7f0dec1049e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:39.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.059+0000 7f0df11e4640 1 -- 172.21.15.82:0/1991007569 shutdown_connections 2024-03-04T09:13:39.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.059+0000 7f0df11e4640 1 -- 172.21.15.82:0/1991007569 wait complete. 2024-03-04T09:13:39.066 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":303,"stamp":"2024-03-04T09:13:38.256734+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":634539,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":142,"num_read_kb":162,"num_write":341,"num_write_kb":3023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":274,"ondisk_log_size":274,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":352604,"kb_used_data":11748,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124589220,"statfs":{"total":1151940427776,"available":1151579361280,"internally_reserved":0,"allocated":12029952,"data_stored":7592825,"data_compressed":283371,"data_compressed_allocated":380928,"data_compressed_original":2260992,"omap_allocated":19142,"internal_metadata":348894522},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":39672,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":6,"num_read_kb":43,"num_write":113,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003673"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.548652+0000","last_change":"2024-03-04T09:13:10.759614+0000","last_active":"2024-03-04T09:13:16.548652+0000","last_peered":"2024-03-04T09:13:16.548652+0000","last_clean":"2024-03-04T09:13:16.548652+0000","last_became_active":"2024-03-04T09:13:10.759313+0000","last_became_peered":"2024-03-04T09:13:10.759313+0000","last_unstale":"2024-03-04T09:13:16.548652+0000","last_undegraded":"2024-03-04T09:13:16.548652+0000","last_fullsized":"2024-03-04T09:13:16.548652+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:08:15.568079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547591+0000","last_change":"2024-03-04T09:13:10.754367+0000","last_active":"2024-03-04T09:13:16.547591+0000","last_peered":"2024-03-04T09:13:16.547591+0000","last_clean":"2024-03-04T09:13:16.547591+0000","last_became_active":"2024-03-04T09:13:10.753984+0000","last_became_peered":"2024-03-04T09:13:10.753984+0000","last_unstale":"2024-03-04T09:13:16.547591+0000","last_undegraded":"2024-03-04T09:13:16.547591+0000","last_fullsized":"2024-03-04T09:13:16.547591+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:14:29.000334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547357+0000","last_change":"2024-03-04T09:13:10.754951+0000","last_active":"2024-03-04T09:13:16.547357+0000","last_peered":"2024-03-04T09:13:16.547357+0000","last_clean":"2024-03-04T09:13:16.547357+0000","last_became_active":"2024-03-04T09:13:10.753579+0000","last_became_peered":"2024-03-04T09:13:10.753579+0000","last_unstale":"2024-03-04T09:13:16.547357+0000","last_undegraded":"2024-03-04T09:13:16.547357+0000","last_fullsized":"2024-03-04T09:13:16.547357+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:58.949790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.548399+0000","last_change":"2024-03-04T09:13:10.763372+0000","last_active":"2024-03-04T09:13:16.548399+0000","last_peered":"2024-03-04T09:13:16.548399+0000","last_clean":"2024-03-04T09:13:16.548399+0000","last_became_active":"2024-03-04T09:13:10.762664+0000","last_became_peered":"2024-03-04T09:13:10.762664+0000","last_unstale":"2024-03-04T09:13:16.548399+0000","last_undegraded":"2024-03-04T09:13:16.548399+0000","last_fullsized":"2024-03-04T09:13:16.548399+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:44:58.854969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.635792+0000","last_change":"2024-03-04T09:13:10.750348+0000","last_active":"2024-03-04T09:13:16.635792+0000","last_peered":"2024-03-04T09:13:16.635792+0000","last_clean":"2024-03-04T09:13:16.635792+0000","last_became_active":"2024-03-04T09:13:10.749997+0000","last_became_peered":"2024-03-04T09:13:10.749997+0000","last_unstale":"2024-03-04T09:13:16.635792+0000","last_undegraded":"2024-03-04T09:13:16.635792+0000","last_fullsized":"2024-03-04T09:13:16.635792+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:40.701906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.548537+0000","last_change":"2024-03-04T09:13:10.760385+0000","last_active":"2024-03-04T09:13:16.548537+0000","last_peered":"2024-03-04T09:13:16.548537+0000","last_clean":"2024-03-04T09:13:16.548537+0000","last_became_active":"2024-03-04T09:13:10.758679+0000","last_became_peered":"2024-03-04T09:13:10.758679+0000","last_unstale":"2024-03-04T09:13:16.548537+0000","last_undegraded":"2024-03-04T09:13:16.548537+0000","last_fullsized":"2024-03-04T09:13:16.548537+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:42:53.692190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547684+0000","last_change":"2024-03-04T09:13:10.765288+0000","last_active":"2024-03-04T09:13:16.547684+0000","last_peered":"2024-03-04T09:13:16.547684+0000","last_clean":"2024-03-04T09:13:16.547684+0000","last_became_active":"2024-03-04T09:13:10.763295+0000","last_became_peered":"2024-03-04T09:13:10.763295+0000","last_unstale":"2024-03-04T09:13:16.547684+0000","last_undegraded":"2024-03-04T09:13:16.547684+0000","last_fullsized":"2024-03-04T09:13:16.547684+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:57:09.795996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.046398+0000","last_change":"2024-03-04T09:13:10.766450+0000","last_active":"2024-03-04T09:13:16.046398+0000","last_peered":"2024-03-04T09:13:16.046398+0000","last_clean":"2024-03-04T09:13:16.046398+0000","last_became_active":"2024-03-04T09:13:10.764686+0000","last_became_peered":"2024-03-04T09:13:10.764686+0000","last_unstale":"2024-03-04T09:13:16.046398+0000","last_undegraded":"2024-03-04T09:13:16.046398+0000","last_fullsized":"2024-03-04T09:13:16.046398+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:09:35.938741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.782712+0000","last_change":"2024-03-04T09:13:10.755868+0000","last_active":"2024-03-04T09:13:15.782712+0000","last_peered":"2024-03-04T09:13:15.782712+0000","last_clean":"2024-03-04T09:13:15.782712+0000","last_became_active":"2024-03-04T09:13:10.755543+0000","last_became_peered":"2024-03-04T09:13:10.755543+0000","last_unstale":"2024-03-04T09:13:15.782712+0000","last_undegraded":"2024-03-04T09:13:15.782712+0000","last_fullsized":"2024-03-04T09:13:15.782712+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:50.255712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.548849+0000","last_change":"2024-03-04T09:13:10.763599+0000","last_active":"2024-03-04T09:13:16.548849+0000","last_peered":"2024-03-04T09:13:16.548849+0000","last_clean":"2024-03-04T09:13:16.548849+0000","last_became_active":"2024-03-04T09:13:10.763281+0000","last_became_peered":"2024-03-04T09:13:10.763281+0000","last_unstale":"2024-03-04T09:13:16.548849+0000","last_undegraded":"2024-03-04T09:13:16.548849+0000","last_fullsized":"2024-03-04T09:13:16.548849+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:55:00.941408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.548531+0000","last_change":"2024-03-04T09:13:10.763605+0000","last_active":"2024-03-04T09:13:16.548531+0000","last_peered":"2024-03-04T09:13:16.548531+0000","last_clean":"2024-03-04T09:13:16.548531+0000","last_became_active":"2024-03-04T09:13:10.763291+0000","last_became_peered":"2024-03-04T09:13:10.763291+0000","last_unstale":"2024-03-04T09:13:16.548531+0000","last_undegraded":"2024-03-04T09:13:16.548531+0000","last_fullsized":"2024-03-04T09:13:16.548531+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:59:55.256414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.548306+0000","last_change":"2024-03-04T09:13:10.767306+0000","last_active":"2024-03-04T09:13:16.548306+0000","last_peered":"2024-03-04T09:13:16.548306+0000","last_clean":"2024-03-04T09:13:16.548306+0000","last_became_active":"2024-03-04T09:13:10.766933+0000","last_became_peered":"2024-03-04T09:13:10.766933+0000","last_unstale":"2024-03-04T09:13:16.548306+0000","last_undegraded":"2024-03-04T09:13:16.548306+0000","last_fullsized":"2024-03-04T09:13:16.548306+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:20:30.242853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.784394+0000","last_change":"2024-03-04T09:13:10.753710+0000","last_active":"2024-03-04T09:13:15.784394+0000","last_peered":"2024-03-04T09:13:15.784394+0000","last_clean":"2024-03-04T09:13:15.784394+0000","last_became_active":"2024-03-04T09:13:10.753377+0000","last_became_peered":"2024-03-04T09:13:10.753377+0000","last_unstale":"2024-03-04T09:13:15.784394+0000","last_undegraded":"2024-03-04T09:13:15.784394+0000","last_fullsized":"2024-03-04T09:13:15.784394+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:06.234019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.546994+0000","last_change":"2024-03-04T09:13:10.758250+0000","last_active":"2024-03-04T09:13:16.546994+0000","last_peered":"2024-03-04T09:13:16.546994+0000","last_clean":"2024-03-04T09:13:16.546994+0000","last_became_active":"2024-03-04T09:13:10.756245+0000","last_became_peered":"2024-03-04T09:13:10.756245+0000","last_unstale":"2024-03-04T09:13:16.546994+0000","last_undegraded":"2024-03-04T09:13:16.546994+0000","last_fullsized":"2024-03-04T09:13:16.546994+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:57:29.303193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547077+0000","last_change":"2024-03-04T09:13:10.759521+0000","last_active":"2024-03-04T09:13:16.547077+0000","last_peered":"2024-03-04T09:13:16.547077+0000","last_clean":"2024-03-04T09:13:16.547077+0000","last_became_active":"2024-03-04T09:13:10.759118+0000","last_became_peered":"2024-03-04T09:13:10.759118+0000","last_unstale":"2024-03-04T09:13:16.547077+0000","last_undegraded":"2024-03-04T09:13:16.547077+0000","last_fullsized":"2024-03-04T09:13:16.547077+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:11:12.293247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.782152+0000","last_change":"2024-03-04T09:13:10.757374+0000","last_active":"2024-03-04T09:13:15.782152+0000","last_peered":"2024-03-04T09:13:15.782152+0000","last_clean":"2024-03-04T09:13:15.782152+0000","last_became_active":"2024-03-04T09:13:10.757056+0000","last_became_peered":"2024-03-04T09:13:10.757056+0000","last_unstale":"2024-03-04T09:13:15.782152+0000","last_undegraded":"2024-03-04T09:13:15.782152+0000","last_fullsized":"2024-03-04T09:13:15.782152+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:42:28.258326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.548493+0000","last_change":"2024-03-04T09:13:10.762375+0000","last_active":"2024-03-04T09:13:16.548493+0000","last_peered":"2024-03-04T09:13:16.548493+0000","last_clean":"2024-03-04T09:13:16.548493+0000","last_became_active":"2024-03-04T09:13:10.761813+0000","last_became_peered":"2024-03-04T09:13:10.761813+0000","last_unstale":"2024-03-04T09:13:16.548493+0000","last_undegraded":"2024-03-04T09:13:16.548493+0000","last_fullsized":"2024-03-04T09:13:16.548493+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:16:55.448189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.548241+0000","last_change":"2024-03-04T09:13:10.755239+0000","last_active":"2024-03-04T09:13:16.548241+0000","last_peered":"2024-03-04T09:13:16.548241+0000","last_clean":"2024-03-04T09:13:16.548241+0000","last_became_active":"2024-03-04T09:13:10.754863+0000","last_became_peered":"2024-03-04T09:13:10.754863+0000","last_unstale":"2024-03-04T09:13:16.548241+0000","last_undegraded":"2024-03-04T09:13:16.548241+0000","last_fullsized":"2024-03-04T09:13:16.548241+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:39:22.385097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.548490+0000","last_change":"2024-03-04T09:13:10.757899+0000","last_active":"2024-03-04T09:13:16.548490+0000","last_peered":"2024-03-04T09:13:16.548490+0000","last_clean":"2024-03-04T09:13:16.548490+0000","last_became_active":"2024-03-04T09:13:10.756155+0000","last_became_peered":"2024-03-04T09:13:10.756155+0000","last_unstale":"2024-03-04T09:13:16.548490+0000","last_undegraded":"2024-03-04T09:13:16.548490+0000","last_fullsized":"2024-03-04T09:13:16.548490+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:24:08.750137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.548126+0000","last_change":"2024-03-04T09:13:14.804112+0000","last_active":"2024-03-04T09:13:16.548126+0000","last_peered":"2024-03-04T09:13:16.548126+0000","last_clean":"2024-03-04T09:13:16.548126+0000","last_became_active":"2024-03-04T09:13:14.803405+0000","last_became_peered":"2024-03-04T09:13:14.803405+0000","last_unstale":"2024-03-04T09:13:16.548126+0000","last_undegraded":"2024-03-04T09:13:16.548126+0000","last_fullsized":"2024-03-04T09:13:16.548126+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:45:38.650375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"90'11","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:36.377177+0000","last_change":"2024-03-04T09:13:09.732569+0000","last_active":"2024-03-04T09:13:36.377177+0000","last_peered":"2024-03-04T09:13:36.377177+0000","last_clean":"2024-03-04T09:13:36.377177+0000","last_became_active":"2024-03-04T09:13:09.732257+0000","last_became_peered":"2024-03-04T09:13:09.732257+0000","last_unstale":"2024-03-04T09:13:36.377177+0000","last_undegraded":"2024-03-04T09:13:36.377177+0000","last_fullsized":"2024-03-04T09:13:36.377177+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:11:32.462839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.046662+0000","last_change":"2024-03-04T09:13:10.758073+0000","last_active":"2024-03-04T09:13:16.046662+0000","last_peered":"2024-03-04T09:13:16.046662+0000","last_clean":"2024-03-04T09:13:16.046662+0000","last_became_active":"2024-03-04T09:13:10.757560+0000","last_became_peered":"2024-03-04T09:13:10.757560+0000","last_unstale":"2024-03-04T09:13:16.046662+0000","last_undegraded":"2024-03-04T09:13:16.046662+0000","last_fullsized":"2024-03-04T09:13:16.046662+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:21:15.482038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547269+0000","last_change":"2024-03-04T09:13:14.803540+0000","last_active":"2024-03-04T09:13:16.547269+0000","last_peered":"2024-03-04T09:13:16.547269+0000","last_clean":"2024-03-04T09:13:16.547269+0000","last_became_active":"2024-03-04T09:13:14.803135+0000","last_became_peered":"2024-03-04T09:13:14.803135+0000","last_unstale":"2024-03-04T09:13:16.547269+0000","last_undegraded":"2024-03-04T09:13:16.547269+0000","last_fullsized":"2024-03-04T09:13:16.547269+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:21:28.193838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"85'1","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.046786+0000","last_change":"2024-03-04T09:13:09.737492+0000","last_active":"2024-03-04T09:13:16.046786+0000","last_peered":"2024-03-04T09:13:16.046786+0000","last_clean":"2024-03-04T09:13:16.046786+0000","last_became_active":"2024-03-04T09:13:09.736976+0000","last_became_peered":"2024-03-04T09:13:09.736976+0000","last_unstale":"2024-03-04T09:13:16.046786+0000","last_undegraded":"2024-03-04T09:13:16.046786+0000","last_fullsized":"2024-03-04T09:13:16.046786+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:40:53.757520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547476+0000","last_change":"2024-03-04T09:13:10.758838+0000","last_active":"2024-03-04T09:13:16.547476+0000","last_peered":"2024-03-04T09:13:16.547476+0000","last_clean":"2024-03-04T09:13:16.547476+0000","last_became_active":"2024-03-04T09:13:10.758476+0000","last_became_peered":"2024-03-04T09:13:10.758476+0000","last_unstale":"2024-03-04T09:13:16.547476+0000","last_undegraded":"2024-03-04T09:13:16.547476+0000","last_fullsized":"2024-03-04T09:13:16.547476+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:22:29.762608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547414+0000","last_change":"2024-03-04T09:13:14.806054+0000","last_active":"2024-03-04T09:13:16.547414+0000","last_peered":"2024-03-04T09:13:16.547414+0000","last_clean":"2024-03-04T09:13:16.547414+0000","last_became_active":"2024-03-04T09:13:14.805613+0000","last_became_peered":"2024-03-04T09:13:14.805613+0000","last_unstale":"2024-03-04T09:13:16.547414+0000","last_undegraded":"2024-03-04T09:13:16.547414+0000","last_fullsized":"2024-03-04T09:13:16.547414+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:07:49.657530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"90'4","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:35.368640+0000","last_change":"2024-03-04T09:13:09.741515+0000","last_active":"2024-03-04T09:13:35.368640+0000","last_peered":"2024-03-04T09:13:35.368640+0000","last_clean":"2024-03-04T09:13:35.368640+0000","last_became_active":"2024-03-04T09:13:09.740967+0000","last_became_peered":"2024-03-04T09:13:09.740967+0000","last_unstale":"2024-03-04T09:13:35.368640+0000","last_undegraded":"2024-03-04T09:13:35.368640+0000","last_fullsized":"2024-03-04T09:13:35.368640+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:56.280060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.782310+0000","last_change":"2024-03-04T09:13:10.751915+0000","last_active":"2024-03-04T09:13:15.782310+0000","last_peered":"2024-03-04T09:13:15.782310+0000","last_clean":"2024-03-04T09:13:15.782310+0000","last_became_active":"2024-03-04T09:13:10.751616+0000","last_became_peered":"2024-03-04T09:13:10.751616+0000","last_unstale":"2024-03-04T09:13:15.782310+0000","last_undegraded":"2024-03-04T09:13:15.782310+0000","last_fullsized":"2024-03-04T09:13:15.782310+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:35:08.099035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547734+0000","last_change":"2024-03-04T09:13:14.798372+0000","last_active":"2024-03-04T09:13:16.547734+0000","last_peered":"2024-03-04T09:13:16.547734+0000","last_clean":"2024-03-04T09:13:16.547734+0000","last_became_active":"2024-03-04T09:13:14.798020+0000","last_became_peered":"2024-03-04T09:13:14.798020+0000","last_unstale":"2024-03-04T09:13:16.547734+0000","last_undegraded":"2024-03-04T09:13:16.547734+0000","last_fullsized":"2024-03-04T09:13:16.547734+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:43:41.153520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"85'2","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.635852+0000","last_change":"2024-03-04T09:13:09.739187+0000","last_active":"2024-03-04T09:13:16.635852+0000","last_peered":"2024-03-04T09:13:16.635852+0000","last_clean":"2024-03-04T09:13:16.635852+0000","last_became_active":"2024-03-04T09:13:09.738753+0000","last_became_peered":"2024-03-04T09:13:09.738753+0000","last_unstale":"2024-03-04T09:13:16.635852+0000","last_undegraded":"2024-03-04T09:13:16.635852+0000","last_fullsized":"2024-03-04T09:13:16.635852+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:29:06.512779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.785105+0000","last_change":"2024-03-04T09:13:10.768484+0000","last_active":"2024-03-04T09:13:15.785105+0000","last_peered":"2024-03-04T09:13:15.785105+0000","last_clean":"2024-03-04T09:13:15.785105+0000","last_became_active":"2024-03-04T09:13:10.768153+0000","last_became_peered":"2024-03-04T09:13:10.768153+0000","last_unstale":"2024-03-04T09:13:15.785105+0000","last_undegraded":"2024-03-04T09:13:15.785105+0000","last_fullsized":"2024-03-04T09:13:15.785105+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:54:28.804596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.548328+0000","last_change":"2024-03-04T09:13:14.796639+0000","last_active":"2024-03-04T09:13:16.548328+0000","last_peered":"2024-03-04T09:13:16.548328+0000","last_clean":"2024-03-04T09:13:16.548328+0000","last_became_active":"2024-03-04T09:13:14.796128+0000","last_became_peered":"2024-03-04T09:13:14.796128+0000","last_unstale":"2024-03-04T09:13:16.548328+0000","last_undegraded":"2024-03-04T09:13:16.548328+0000","last_fullsized":"2024-03-04T09:13:16.548328+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:31:53.013126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'5","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:34.362427+0000","last_change":"2024-03-04T09:13:09.741381+0000","last_active":"2024-03-04T09:13:34.362427+0000","last_peered":"2024-03-04T09:13:34.362427+0000","last_clean":"2024-03-04T09:13:34.362427+0000","last_became_active":"2024-03-04T09:13:09.741032+0000","last_became_peered":"2024-03-04T09:13:09.741032+0000","last_unstale":"2024-03-04T09:13:34.362427+0000","last_undegraded":"2024-03-04T09:13:34.362427+0000","last_fullsized":"2024-03-04T09:13:34.362427+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:36:12.430867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.635978+0000","last_change":"2024-03-04T09:13:10.756778+0000","last_active":"2024-03-04T09:13:16.635978+0000","last_peered":"2024-03-04T09:13:16.635978+0000","last_clean":"2024-03-04T09:13:16.635978+0000","last_became_active":"2024-03-04T09:13:10.755405+0000","last_became_peered":"2024-03-04T09:13:10.755405+0000","last_unstale":"2024-03-04T09:13:16.635978+0000","last_undegraded":"2024-03-04T09:13:16.635978+0000","last_fullsized":"2024-03-04T09:13:16.635978+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:13:47.425603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547659+0000","last_change":"2024-03-04T09:13:14.803737+0000","last_active":"2024-03-04T09:13:16.547659+0000","last_peered":"2024-03-04T09:13:16.547659+0000","last_clean":"2024-03-04T09:13:16.547659+0000","last_became_active":"2024-03-04T09:13:14.803261+0000","last_became_peered":"2024-03-04T09:13:14.803261+0000","last_unstale":"2024-03-04T09:13:16.547659+0000","last_undegraded":"2024-03-04T09:13:16.547659+0000","last_fullsized":"2024-03-04T09:13:16.547659+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:41:03.717797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"90'7","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:36.378067+0000","last_change":"2024-03-04T09:13:09.732193+0000","last_active":"2024-03-04T09:13:36.378067+0000","last_peered":"2024-03-04T09:13:36.378067+0000","last_clean":"2024-03-04T09:13:36.378067+0000","last_became_active":"2024-03-04T09:13:09.731791+0000","last_became_peered":"2024-03-04T09:13:09.731791+0000","last_unstale":"2024-03-04T09:13:36.378067+0000","last_undegraded":"2024-03-04T09:13:36.378067+0000","last_fullsized":"2024-03-04T09:13:36.378067+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:29.685931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.784955+0000","last_change":"2024-03-04T09:13:10.771291+0000","last_active":"2024-03-04T09:13:15.784955+0000","last_peered":"2024-03-04T09:13:15.784955+0000","last_clean":"2024-03-04T09:13:15.784955+0000","last_became_active":"2024-03-04T09:13:10.770978+0000","last_became_peered":"2024-03-04T09:13:10.770978+0000","last_unstale":"2024-03-04T09:13:15.784955+0000","last_undegraded":"2024-03-04T09:13:15.784955+0000","last_fullsized":"2024-03-04T09:13:15.784955+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:21:54.121918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.548579+0000","last_change":"2024-03-04T09:13:14.806788+0000","last_active":"2024-03-04T09:13:16.548579+0000","last_peered":"2024-03-04T09:13:16.548579+0000","last_clean":"2024-03-04T09:13:16.548579+0000","last_became_active":"2024-03-04T09:13:14.806379+0000","last_became_peered":"2024-03-04T09:13:14.806379+0000","last_unstale":"2024-03-04T09:13:16.548579+0000","last_undegraded":"2024-03-04T09:13:16.548579+0000","last_fullsized":"2024-03-04T09:13:16.548579+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:27:42.780954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"90'2","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:35.369159+0000","last_change":"2024-03-04T09:13:09.736299+0000","last_active":"2024-03-04T09:13:35.369159+0000","last_peered":"2024-03-04T09:13:35.369159+0000","last_clean":"2024-03-04T09:13:35.369159+0000","last_became_active":"2024-03-04T09:13:09.735917+0000","last_became_peered":"2024-03-04T09:13:09.735917+0000","last_unstale":"2024-03-04T09:13:35.369159+0000","last_undegraded":"2024-03-04T09:13:35.369159+0000","last_fullsized":"2024-03-04T09:13:35.369159+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:14:22.130089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.046293+0000","last_change":"2024-03-04T09:13:10.761135+0000","last_active":"2024-03-04T09:13:16.046293+0000","last_peered":"2024-03-04T09:13:16.046293+0000","last_clean":"2024-03-04T09:13:16.046293+0000","last_became_active":"2024-03-04T09:13:10.760819+0000","last_became_peered":"2024-03-04T09:13:10.760819+0000","last_unstale":"2024-03-04T09:13:16.046293+0000","last_undegraded":"2024-03-04T09:13:16.046293+0000","last_fullsized":"2024-03-04T09:13:16.046293+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:27:30.315659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547559+0000","last_change":"2024-03-04T09:13:14.799057+0000","last_active":"2024-03-04T09:13:16.547559+0000","last_peered":"2024-03-04T09:13:16.547559+0000","last_clean":"2024-03-04T09:13:16.547559+0000","last_became_active":"2024-03-04T09:13:14.798670+0000","last_became_peered":"2024-03-04T09:13:14.798670+0000","last_unstale":"2024-03-04T09:13:16.547559+0000","last_undegraded":"2024-03-04T09:13:16.547559+0000","last_fullsized":"2024-03-04T09:13:16.547559+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:16:01.777432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"90'1","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.784591+0000","last_change":"2024-03-04T09:13:09.744045+0000","last_active":"2024-03-04T09:13:15.784591+0000","last_peered":"2024-03-04T09:13:15.784591+0000","last_clean":"2024-03-04T09:13:15.784591+0000","last_became_active":"2024-03-04T09:13:09.741411+0000","last_became_peered":"2024-03-04T09:13:09.741411+0000","last_unstale":"2024-03-04T09:13:15.784591+0000","last_undegraded":"2024-03-04T09:13:15.784591+0000","last_fullsized":"2024-03-04T09:13:15.784591+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:44:22.647120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.548090+0000","last_change":"2024-03-04T09:13:10.762598+0000","last_active":"2024-03-04T09:13:16.548090+0000","last_peered":"2024-03-04T09:13:16.548090+0000","last_clean":"2024-03-04T09:13:16.548090+0000","last_became_active":"2024-03-04T09:13:10.762252+0000","last_became_peered":"2024-03-04T09:13:10.762252+0000","last_unstale":"2024-03-04T09:13:16.548090+0000","last_undegraded":"2024-03-04T09:13:16.548090+0000","last_fullsized":"2024-03-04T09:13:16.548090+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:17:02.924550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.046478+0000","last_change":"2024-03-04T09:13:14.805423+0000","last_active":"2024-03-04T09:13:16.046478+0000","last_peered":"2024-03-04T09:13:16.046478+0000","last_clean":"2024-03-04T09:13:16.046478+0000","last_became_active":"2024-03-04T09:13:14.805047+0000","last_became_peered":"2024-03-04T09:13:14.805047+0000","last_unstale":"2024-03-04T09:13:16.046478+0000","last_undegraded":"2024-03-04T09:13:16.046478+0000","last_fullsized":"2024-03-04T09:13:16.046478+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:51:51.804507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"90'4","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:38.025104+0000","last_change":"2024-03-04T09:13:09.736752+0000","last_active":"2024-03-04T09:13:38.025104+0000","last_peered":"2024-03-04T09:13:38.025104+0000","last_clean":"2024-03-04T09:13:38.025104+0000","last_became_active":"2024-03-04T09:13:09.736477+0000","last_became_peered":"2024-03-04T09:13:09.736477+0000","last_unstale":"2024-03-04T09:13:38.025104+0000","last_undegraded":"2024-03-04T09:13:38.025104+0000","last_fullsized":"2024-03-04T09:13:38.025104+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:37:11.270022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.782717+0000","last_change":"2024-03-04T09:13:10.751255+0000","last_active":"2024-03-04T09:13:15.782717+0000","last_peered":"2024-03-04T09:13:15.782717+0000","last_clean":"2024-03-04T09:13:15.782717+0000","last_became_active":"2024-03-04T09:13:10.750891+0000","last_became_peered":"2024-03-04T09:13:10.750891+0000","last_unstale":"2024-03-04T09:13:15.782717+0000","last_undegraded":"2024-03-04T09:13:15.782717+0000","last_fullsized":"2024-03-04T09:13:15.782717+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:29:08.212529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547456+0000","last_change":"2024-03-04T09:13:14.804943+0000","last_active":"2024-03-04T09:13:16.547456+0000","last_peered":"2024-03-04T09:13:16.547456+0000","last_clean":"2024-03-04T09:13:16.547456+0000","last_became_active":"2024-03-04T09:13:14.804528+0000","last_became_peered":"2024-03-04T09:13:14.804528+0000","last_unstale":"2024-03-04T09:13:16.547456+0000","last_undegraded":"2024-03-04T09:13:16.547456+0000","last_fullsized":"2024-03-04T09:13:16.547456+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:23:48.071448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"90'2","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:34.358555+0000","last_change":"2024-03-04T09:13:09.739765+0000","last_active":"2024-03-04T09:13:34.358555+0000","last_peered":"2024-03-04T09:13:34.358555+0000","last_clean":"2024-03-04T09:13:34.358555+0000","last_became_active":"2024-03-04T09:13:09.739163+0000","last_became_peered":"2024-03-04T09:13:09.739163+0000","last_unstale":"2024-03-04T09:13:34.358555+0000","last_undegraded":"2024-03-04T09:13:34.358555+0000","last_fullsized":"2024-03-04T09:13:34.358555+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:30:15.561241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547565+0000","last_change":"2024-03-04T09:13:10.770051+0000","last_active":"2024-03-04T09:13:16.547565+0000","last_peered":"2024-03-04T09:13:16.547565+0000","last_clean":"2024-03-04T09:13:16.547565+0000","last_became_active":"2024-03-04T09:13:10.769709+0000","last_became_peered":"2024-03-04T09:13:10.769709+0000","last_unstale":"2024-03-04T09:13:16.547565+0000","last_undegraded":"2024-03-04T09:13:16.547565+0000","last_fullsized":"2024-03-04T09:13:16.547565+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:42:36.328095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547990+0000","last_change":"2024-03-04T09:13:14.804997+0000","last_active":"2024-03-04T09:13:16.547990+0000","last_peered":"2024-03-04T09:13:16.547990+0000","last_clean":"2024-03-04T09:13:16.547990+0000","last_became_active":"2024-03-04T09:13:14.804631+0000","last_became_peered":"2024-03-04T09:13:14.804631+0000","last_unstale":"2024-03-04T09:13:16.547990+0000","last_undegraded":"2024-03-04T09:13:16.547990+0000","last_fullsized":"2024-03-04T09:13:16.547990+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:15:18.843528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"90'4","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.785176+0000","last_change":"2024-03-04T09:13:09.743900+0000","last_active":"2024-03-04T09:13:15.785176+0000","last_peered":"2024-03-04T09:13:15.785176+0000","last_clean":"2024-03-04T09:13:15.785176+0000","last_became_active":"2024-03-04T09:13:09.743591+0000","last_became_peered":"2024-03-04T09:13:09.743591+0000","last_unstale":"2024-03-04T09:13:15.785176+0000","last_undegraded":"2024-03-04T09:13:15.785176+0000","last_fullsized":"2024-03-04T09:13:15.785176+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:47:31.365014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.782476+0000","last_change":"2024-03-04T09:13:10.754163+0000","last_active":"2024-03-04T09:13:15.782476+0000","last_peered":"2024-03-04T09:13:15.782476+0000","last_clean":"2024-03-04T09:13:15.782476+0000","last_became_active":"2024-03-04T09:13:10.753814+0000","last_became_peered":"2024-03-04T09:13:10.753814+0000","last_unstale":"2024-03-04T09:13:15.782476+0000","last_undegraded":"2024-03-04T09:13:15.782476+0000","last_fullsized":"2024-03-04T09:13:15.782476+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:44:31.771205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.548114+0000","last_change":"2024-03-04T09:13:14.803145+0000","last_active":"2024-03-04T09:13:16.548114+0000","last_peered":"2024-03-04T09:13:16.548114+0000","last_clean":"2024-03-04T09:13:16.548114+0000","last_became_active":"2024-03-04T09:13:14.802695+0000","last_became_peered":"2024-03-04T09:13:14.802695+0000","last_unstale":"2024-03-04T09:13:16.548114+0000","last_undegraded":"2024-03-04T09:13:16.548114+0000","last_fullsized":"2024-03-04T09:13:16.548114+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:43:46.854564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"90'25","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:38.026674+0000","last_change":"2024-03-04T09:13:09.735138+0000","last_active":"2024-03-04T09:13:38.026674+0000","last_peered":"2024-03-04T09:13:38.026674+0000","last_clean":"2024-03-04T09:13:38.026674+0000","last_became_active":"2024-03-04T09:13:09.734566+0000","last_became_peered":"2024-03-04T09:13:09.734566+0000","last_unstale":"2024-03-04T09:13:38.026674+0000","last_undegraded":"2024-03-04T09:13:38.026674+0000","last_fullsized":"2024-03-04T09:13:38.026674+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:37:42.446392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40471,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":41,"num_write":27,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.635992+0000","last_change":"2024-03-04T09:13:10.754584+0000","last_active":"2024-03-04T09:13:16.635992+0000","last_peered":"2024-03-04T09:13:16.635992+0000","last_clean":"2024-03-04T09:13:16.635992+0000","last_became_active":"2024-03-04T09:13:10.754270+0000","last_became_peered":"2024-03-04T09:13:10.754270+0000","last_unstale":"2024-03-04T09:13:16.635992+0000","last_undegraded":"2024-03-04T09:13:16.635992+0000","last_fullsized":"2024-03-04T09:13:16.635992+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:22:26.480337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.785479+0000","last_change":"2024-03-04T09:13:14.797302+0000","last_active":"2024-03-04T09:13:15.785479+0000","last_peered":"2024-03-04T09:13:15.785479+0000","last_clean":"2024-03-04T09:13:15.785479+0000","last_became_active":"2024-03-04T09:13:14.796549+0000","last_became_peered":"2024-03-04T09:13:14.796549+0000","last_unstale":"2024-03-04T09:13:15.785479+0000","last_undegraded":"2024-03-04T09:13:15.785479+0000","last_fullsized":"2024-03-04T09:13:15.785479+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:28:09.499393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"90'6","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:35.366648+0000","last_change":"2024-03-04T09:13:09.737567+0000","last_active":"2024-03-04T09:13:35.366648+0000","last_peered":"2024-03-04T09:13:35.366648+0000","last_clean":"2024-03-04T09:13:35.366648+0000","last_became_active":"2024-03-04T09:13:09.735154+0000","last_became_peered":"2024-03-04T09:13:09.735154+0000","last_unstale":"2024-03-04T09:13:35.366648+0000","last_undegraded":"2024-03-04T09:13:35.366648+0000","last_fullsized":"2024-03-04T09:13:35.366648+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:04:49.719107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.784354+0000","last_change":"2024-03-04T09:13:10.751959+0000","last_active":"2024-03-04T09:13:15.784354+0000","last_peered":"2024-03-04T09:13:15.784354+0000","last_clean":"2024-03-04T09:13:15.784354+0000","last_became_active":"2024-03-04T09:13:10.751638+0000","last_became_peered":"2024-03-04T09:13:10.751638+0000","last_unstale":"2024-03-04T09:13:15.784354+0000","last_undegraded":"2024-03-04T09:13:15.784354+0000","last_fullsized":"2024-03-04T09:13:15.784354+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:52:52.005226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.548292+0000","last_change":"2024-03-04T09:13:14.803490+0000","last_active":"2024-03-04T09:13:16.548292+0000","last_peered":"2024-03-04T09:13:16.548292+0000","last_clean":"2024-03-04T09:13:16.548292+0000","last_became_active":"2024-03-04T09:13:14.803046+0000","last_became_peered":"2024-03-04T09:13:14.803046+0000","last_unstale":"2024-03-04T09:13:16.548292+0000","last_undegraded":"2024-03-04T09:13:16.548292+0000","last_fullsized":"2024-03-04T09:13:16.548292+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:54:48.170806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"90'3","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:34.361655+0000","last_change":"2024-03-04T09:13:09.744437+0000","last_active":"2024-03-04T09:13:34.361655+0000","last_peered":"2024-03-04T09:13:34.361655+0000","last_clean":"2024-03-04T09:13:34.361655+0000","last_became_active":"2024-03-04T09:13:09.743112+0000","last_became_peered":"2024-03-04T09:13:09.743112+0000","last_unstale":"2024-03-04T09:13:34.361655+0000","last_undegraded":"2024-03-04T09:13:34.361655+0000","last_fullsized":"2024-03-04T09:13:34.361655+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:12:16.431869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547754+0000","last_change":"2024-03-04T09:13:10.770817+0000","last_active":"2024-03-04T09:13:16.547754+0000","last_peered":"2024-03-04T09:13:16.547754+0000","last_clean":"2024-03-04T09:13:16.547754+0000","last_became_active":"2024-03-04T09:13:10.770340+0000","last_became_peered":"2024-03-04T09:13:10.770340+0000","last_unstale":"2024-03-04T09:13:16.547754+0000","last_undegraded":"2024-03-04T09:13:16.547754+0000","last_fullsized":"2024-03-04T09:13:16.547754+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:00:53.050111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547596+0000","last_change":"2024-03-04T09:13:14.805982+0000","last_active":"2024-03-04T09:13:16.547596+0000","last_peered":"2024-03-04T09:13:16.547596+0000","last_clean":"2024-03-04T09:13:16.547596+0000","last_became_active":"2024-03-04T09:13:14.805280+0000","last_became_peered":"2024-03-04T09:13:14.805280+0000","last_unstale":"2024-03-04T09:13:16.547596+0000","last_undegraded":"2024-03-04T09:13:16.547596+0000","last_fullsized":"2024-03-04T09:13:16.547596+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:39:23.058890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"90'3","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:35.366438+0000","last_change":"2024-03-04T09:13:09.736144+0000","last_active":"2024-03-04T09:13:35.366438+0000","last_peered":"2024-03-04T09:13:35.366438+0000","last_clean":"2024-03-04T09:13:35.366438+0000","last_became_active":"2024-03-04T09:13:09.735802+0000","last_became_peered":"2024-03-04T09:13:09.735802+0000","last_unstale":"2024-03-04T09:13:35.366438+0000","last_undegraded":"2024-03-04T09:13:35.366438+0000","last_fullsized":"2024-03-04T09:13:35.366438+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:01.935616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547509+0000","last_change":"2024-03-04T09:13:10.754813+0000","last_active":"2024-03-04T09:13:16.547509+0000","last_peered":"2024-03-04T09:13:16.547509+0000","last_clean":"2024-03-04T09:13:16.547509+0000","last_became_active":"2024-03-04T09:13:10.754429+0000","last_became_peered":"2024-03-04T09:13:10.754429+0000","last_unstale":"2024-03-04T09:13:16.547509+0000","last_undegraded":"2024-03-04T09:13:16.547509+0000","last_fullsized":"2024-03-04T09:13:16.547509+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:06:57.885434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.784825+0000","last_change":"2024-03-04T09:13:14.808464+0000","last_active":"2024-03-04T09:13:15.784825+0000","last_peered":"2024-03-04T09:13:15.784825+0000","last_clean":"2024-03-04T09:13:15.784825+0000","last_became_active":"2024-03-04T09:13:14.807967+0000","last_became_peered":"2024-03-04T09:13:14.807967+0000","last_unstale":"2024-03-04T09:13:15.784825+0000","last_undegraded":"2024-03-04T09:13:15.784825+0000","last_fullsized":"2024-03-04T09:13:15.784825+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:05:00.961999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"90'15","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:35.369127+0000","last_change":"2024-03-04T09:13:09.739149+0000","last_active":"2024-03-04T09:13:35.369127+0000","last_peered":"2024-03-04T09:13:35.369127+0000","last_clean":"2024-03-04T09:13:35.369127+0000","last_became_active":"2024-03-04T09:13:09.738823+0000","last_became_peered":"2024-03-04T09:13:09.738823+0000","last_unstale":"2024-03-04T09:13:35.369127+0000","last_undegraded":"2024-03-04T09:13:35.369127+0000","last_fullsized":"2024-03-04T09:13:35.369127+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:33:09.987846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.784683+0000","last_change":"2024-03-04T09:13:10.770355+0000","last_active":"2024-03-04T09:13:15.784683+0000","last_peered":"2024-03-04T09:13:15.784683+0000","last_clean":"2024-03-04T09:13:15.784683+0000","last_became_active":"2024-03-04T09:13:10.770037+0000","last_became_peered":"2024-03-04T09:13:10.770037+0000","last_unstale":"2024-03-04T09:13:15.784683+0000","last_undegraded":"2024-03-04T09:13:15.784683+0000","last_fullsized":"2024-03-04T09:13:15.784683+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:28:59.392418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.784792+0000","last_change":"2024-03-04T09:13:14.797382+0000","last_active":"2024-03-04T09:13:15.784792+0000","last_peered":"2024-03-04T09:13:15.784792+0000","last_clean":"2024-03-04T09:13:15.784792+0000","last_became_active":"2024-03-04T09:13:14.795839+0000","last_became_peered":"2024-03-04T09:13:14.795839+0000","last_unstale":"2024-03-04T09:13:15.784792+0000","last_undegraded":"2024-03-04T09:13:15.784792+0000","last_fullsized":"2024-03-04T09:13:15.784792+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:30.992018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'1","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.636147+0000","last_change":"2024-03-04T09:13:09.740678+0000","last_active":"2024-03-04T09:13:16.636147+0000","last_peered":"2024-03-04T09:13:16.636147+0000","last_clean":"2024-03-04T09:13:16.636147+0000","last_became_active":"2024-03-04T09:13:09.740371+0000","last_became_peered":"2024-03-04T09:13:09.740371+0000","last_unstale":"2024-03-04T09:13:16.636147+0000","last_undegraded":"2024-03-04T09:13:16.636147+0000","last_fullsized":"2024-03-04T09:13:16.636147+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:08:05.098610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.548263+0000","last_change":"2024-03-04T09:13:10.769034+0000","last_active":"2024-03-04T09:13:16.548263+0000","last_peered":"2024-03-04T09:13:16.548263+0000","last_clean":"2024-03-04T09:13:16.548263+0000","last_became_active":"2024-03-04T09:13:10.768700+0000","last_became_peered":"2024-03-04T09:13:10.768700+0000","last_unstale":"2024-03-04T09:13:16.548263+0000","last_undegraded":"2024-03-04T09:13:16.548263+0000","last_fullsized":"2024-03-04T09:13:16.548263+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:34:56.367097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.635926+0000","last_change":"2024-03-04T09:13:14.827541+0000","last_active":"2024-03-04T09:13:16.635926+0000","last_peered":"2024-03-04T09:13:16.635926+0000","last_clean":"2024-03-04T09:13:16.635926+0000","last_became_active":"2024-03-04T09:13:14.827122+0000","last_became_peered":"2024-03-04T09:13:14.827122+0000","last_unstale":"2024-03-04T09:13:16.635926+0000","last_undegraded":"2024-03-04T09:13:16.635926+0000","last_fullsized":"2024-03-04T09:13:16.635926+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:29:09.680052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"90'1","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547657+0000","last_change":"2024-03-04T09:13:09.739307+0000","last_active":"2024-03-04T09:13:16.547657+0000","last_peered":"2024-03-04T09:13:16.547657+0000","last_clean":"2024-03-04T09:13:16.547657+0000","last_became_active":"2024-03-04T09:13:09.739014+0000","last_became_peered":"2024-03-04T09:13:09.739014+0000","last_unstale":"2024-03-04T09:13:16.547657+0000","last_undegraded":"2024-03-04T09:13:16.547657+0000","last_fullsized":"2024-03-04T09:13:16.547657+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:19.128412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.548944+0000","last_change":"2024-03-04T09:13:10.761224+0000","last_active":"2024-03-04T09:13:16.548944+0000","last_peered":"2024-03-04T09:13:16.548944+0000","last_clean":"2024-03-04T09:13:16.548944+0000","last_became_active":"2024-03-04T09:13:10.760861+0000","last_became_peered":"2024-03-04T09:13:10.760861+0000","last_unstale":"2024-03-04T09:13:16.548944+0000","last_undegraded":"2024-03-04T09:13:16.548944+0000","last_fullsized":"2024-03-04T09:13:16.548944+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:58:56.666386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.784819+0000","last_change":"2024-03-04T09:13:14.796490+0000","last_active":"2024-03-04T09:13:15.784819+0000","last_peered":"2024-03-04T09:13:15.784819+0000","last_clean":"2024-03-04T09:13:15.784819+0000","last_became_active":"2024-03-04T09:13:14.796103+0000","last_became_peered":"2024-03-04T09:13:14.796103+0000","last_unstale":"2024-03-04T09:13:15.784819+0000","last_undegraded":"2024-03-04T09:13:15.784819+0000","last_fullsized":"2024-03-04T09:13:15.784819+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:34:05.983201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"90'1","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547617+0000","last_change":"2024-03-04T09:13:09.739500+0000","last_active":"2024-03-04T09:13:16.547617+0000","last_peered":"2024-03-04T09:13:16.547617+0000","last_clean":"2024-03-04T09:13:16.547617+0000","last_became_active":"2024-03-04T09:13:09.739156+0000","last_became_peered":"2024-03-04T09:13:09.739156+0000","last_unstale":"2024-03-04T09:13:16.547617+0000","last_undegraded":"2024-03-04T09:13:16.547617+0000","last_fullsized":"2024-03-04T09:13:16.547617+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:07:05.319066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.548566+0000","last_change":"2024-03-04T09:13:10.762237+0000","last_active":"2024-03-04T09:13:16.548566+0000","last_peered":"2024-03-04T09:13:16.548566+0000","last_clean":"2024-03-04T09:13:16.548566+0000","last_became_active":"2024-03-04T09:13:10.761914+0000","last_became_peered":"2024-03-04T09:13:10.761914+0000","last_unstale":"2024-03-04T09:13:16.548566+0000","last_undegraded":"2024-03-04T09:13:16.548566+0000","last_fullsized":"2024-03-04T09:13:16.548566+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:25:49.156700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.784795+0000","last_change":"2024-03-04T09:13:14.827814+0000","last_active":"2024-03-04T09:13:15.784795+0000","last_peered":"2024-03-04T09:13:15.784795+0000","last_clean":"2024-03-04T09:13:15.784795+0000","last_became_active":"2024-03-04T09:13:14.827411+0000","last_became_peered":"2024-03-04T09:13:14.827411+0000","last_unstale":"2024-03-04T09:13:15.784795+0000","last_undegraded":"2024-03-04T09:13:15.784795+0000","last_fullsized":"2024-03-04T09:13:15.784795+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:23:32.702066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.784794+0000","last_change":"2024-03-04T09:13:10.773292+0000","last_active":"2024-03-04T09:13:15.784794+0000","last_peered":"2024-03-04T09:13:15.784794+0000","last_clean":"2024-03-04T09:13:15.784794+0000","last_became_active":"2024-03-04T09:13:10.772921+0000","last_became_peered":"2024-03-04T09:13:10.772921+0000","last_unstale":"2024-03-04T09:13:15.784794+0000","last_undegraded":"2024-03-04T09:13:15.784794+0000","last_fullsized":"2024-03-04T09:13:15.784794+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:24:41.988400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'4","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:35.368823+0000","last_change":"2024-03-04T09:13:09.727219+0000","last_active":"2024-03-04T09:13:35.368823+0000","last_peered":"2024-03-04T09:13:35.368823+0000","last_clean":"2024-03-04T09:13:35.368823+0000","last_became_active":"2024-03-04T09:13:09.726892+0000","last_became_peered":"2024-03-04T09:13:09.726892+0000","last_unstale":"2024-03-04T09:13:35.368823+0000","last_undegraded":"2024-03-04T09:13:35.368823+0000","last_fullsized":"2024-03-04T09:13:35.368823+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:42:58.059866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547769+0000","last_change":"2024-03-04T09:13:14.804709+0000","last_active":"2024-03-04T09:13:16.547769+0000","last_peered":"2024-03-04T09:13:16.547769+0000","last_clean":"2024-03-04T09:13:16.547769+0000","last_became_active":"2024-03-04T09:13:14.804264+0000","last_became_peered":"2024-03-04T09:13:14.804264+0000","last_unstale":"2024-03-04T09:13:16.547769+0000","last_undegraded":"2024-03-04T09:13:16.547769+0000","last_fullsized":"2024-03-04T09:13:16.547769+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:32:57.714237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.046354+0000","last_change":"2024-03-04T09:13:10.765801+0000","last_active":"2024-03-04T09:13:16.046354+0000","last_peered":"2024-03-04T09:13:16.046354+0000","last_clean":"2024-03-04T09:13:16.046354+0000","last_became_active":"2024-03-04T09:13:10.765398+0000","last_became_peered":"2024-03-04T09:13:10.765398+0000","last_unstale":"2024-03-04T09:13:16.046354+0000","last_undegraded":"2024-03-04T09:13:16.046354+0000","last_fullsized":"2024-03-04T09:13:16.046354+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:54:54.750418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"90'3","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:34.362135+0000","last_change":"2024-03-04T09:13:09.729854+0000","last_active":"2024-03-04T09:13:34.362135+0000","last_peered":"2024-03-04T09:13:34.362135+0000","last_clean":"2024-03-04T09:13:34.362135+0000","last_became_active":"2024-03-04T09:13:09.729512+0000","last_became_peered":"2024-03-04T09:13:09.729512+0000","last_unstale":"2024-03-04T09:13:34.362135+0000","last_undegraded":"2024-03-04T09:13:34.362135+0000","last_fullsized":"2024-03-04T09:13:34.362135+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:24:38.237311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":358,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547370+0000","last_change":"2024-03-04T09:12:00.982045+0000","last_active":"2024-03-04T09:13:16.547370+0000","last_peered":"2024-03-04T09:13:16.547370+0000","last_clean":"2024-03-04T09:13:16.547370+0000","last_became_active":"2024-03-04T09:12:00.981545+0000","last_became_peered":"2024-03-04T09:12:00.981545+0000","last_unstale":"2024-03-04T09:13:16.547370+0000","last_undegraded":"2024-03-04T09:13:16.547370+0000","last_fullsized":"2024-03-04T09:13:16.547370+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:08:36.622880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:08:36.622880+0000","last_clean_scrub_stamp":"2024-03-04T09:08:36.622880+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:44:16.595802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.785193+0000","last_change":"2024-03-04T09:13:14.828364+0000","last_active":"2024-03-04T09:13:15.785193+0000","last_peered":"2024-03-04T09:13:15.785193+0000","last_clean":"2024-03-04T09:13:15.785193+0000","last_became_active":"2024-03-04T09:13:14.827928+0000","last_became_peered":"2024-03-04T09:13:14.827928+0000","last_unstale":"2024-03-04T09:13:15.785193+0000","last_undegraded":"2024-03-04T09:13:15.785193+0000","last_fullsized":"2024-03-04T09:13:15.785193+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:24.071431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.784020+0000","last_change":"2024-03-04T09:13:10.761282+0000","last_active":"2024-03-04T09:13:15.784020+0000","last_peered":"2024-03-04T09:13:15.784020+0000","last_clean":"2024-03-04T09:13:15.784020+0000","last_became_active":"2024-03-04T09:13:10.753614+0000","last_became_peered":"2024-03-04T09:13:10.753614+0000","last_unstale":"2024-03-04T09:13:15.784020+0000","last_undegraded":"2024-03-04T09:13:15.784020+0000","last_fullsized":"2024-03-04T09:13:15.784020+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:00.471478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'3","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:35.366798+0000","last_change":"2024-03-04T09:13:09.739744+0000","last_active":"2024-03-04T09:13:35.366798+0000","last_peered":"2024-03-04T09:13:35.366798+0000","last_clean":"2024-03-04T09:13:35.366798+0000","last_became_active":"2024-03-04T09:13:09.739403+0000","last_became_peered":"2024-03-04T09:13:09.739403+0000","last_unstale":"2024-03-04T09:13:35.366798+0000","last_undegraded":"2024-03-04T09:13:35.366798+0000","last_fullsized":"2024-03-04T09:13:35.366798+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:51:57.056021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547670+0000","last_change":"2024-03-04T09:13:14.797232+0000","last_active":"2024-03-04T09:13:16.547670+0000","last_peered":"2024-03-04T09:13:16.547670+0000","last_clean":"2024-03-04T09:13:16.547670+0000","last_became_active":"2024-03-04T09:13:14.796827+0000","last_became_peered":"2024-03-04T09:13:14.796827+0000","last_unstale":"2024-03-04T09:13:16.547670+0000","last_undegraded":"2024-03-04T09:13:16.547670+0000","last_fullsized":"2024-03-04T09:13:16.547670+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:35:41.206987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"90'1","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.636132+0000","last_change":"2024-03-04T09:13:09.741257+0000","last_active":"2024-03-04T09:13:16.636132+0000","last_peered":"2024-03-04T09:13:16.636132+0000","last_clean":"2024-03-04T09:13:16.636132+0000","last_became_active":"2024-03-04T09:13:09.740559+0000","last_became_peered":"2024-03-04T09:13:09.740559+0000","last_unstale":"2024-03-04T09:13:16.636132+0000","last_undegraded":"2024-03-04T09:13:16.636132+0000","last_fullsized":"2024-03-04T09:13:16.636132+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:39:50.969427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.784661+0000","last_change":"2024-03-04T09:13:10.749685+0000","last_active":"2024-03-04T09:13:15.784661+0000","last_peered":"2024-03-04T09:13:15.784661+0000","last_clean":"2024-03-04T09:13:15.784661+0000","last_became_active":"2024-03-04T09:13:10.749297+0000","last_became_peered":"2024-03-04T09:13:10.749297+0000","last_unstale":"2024-03-04T09:13:15.784661+0000","last_undegraded":"2024-03-04T09:13:15.784661+0000","last_fullsized":"2024-03-04T09:13:15.784661+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:28:17.001946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.046386+0000","last_change":"2024-03-04T09:13:14.827798+0000","last_active":"2024-03-04T09:13:16.046386+0000","last_peered":"2024-03-04T09:13:16.046386+0000","last_clean":"2024-03-04T09:13:16.046386+0000","last_became_active":"2024-03-04T09:13:14.827373+0000","last_became_peered":"2024-03-04T09:13:14.827373+0000","last_unstale":"2024-03-04T09:13:16.046386+0000","last_undegraded":"2024-03-04T09:13:16.046386+0000","last_fullsized":"2024-03-04T09:13:16.046386+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:54:45.560594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'8","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:36.378430+0000","last_change":"2024-03-04T09:13:09.732734+0000","last_active":"2024-03-04T09:13:36.378430+0000","last_peered":"2024-03-04T09:13:36.378430+0000","last_clean":"2024-03-04T09:13:36.378430+0000","last_became_active":"2024-03-04T09:13:09.732418+0000","last_became_peered":"2024-03-04T09:13:09.732418+0000","last_unstale":"2024-03-04T09:13:36.378430+0000","last_undegraded":"2024-03-04T09:13:36.378430+0000","last_fullsized":"2024-03-04T09:13:36.378430+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:58.199821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.046813+0000","last_change":"2024-03-04T09:13:10.759721+0000","last_active":"2024-03-04T09:13:16.046813+0000","last_peered":"2024-03-04T09:13:16.046813+0000","last_clean":"2024-03-04T09:13:16.046813+0000","last_became_active":"2024-03-04T09:13:10.759388+0000","last_became_peered":"2024-03-04T09:13:10.759388+0000","last_unstale":"2024-03-04T09:13:16.046813+0000","last_undegraded":"2024-03-04T09:13:16.046813+0000","last_fullsized":"2024-03-04T09:13:16.046813+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:23:41.865335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547856+0000","last_change":"2024-03-04T09:13:14.788273+0000","last_active":"2024-03-04T09:13:16.547856+0000","last_peered":"2024-03-04T09:13:16.547856+0000","last_clean":"2024-03-04T09:13:16.547856+0000","last_became_active":"2024-03-04T09:13:14.787763+0000","last_became_peered":"2024-03-04T09:13:14.787763+0000","last_unstale":"2024-03-04T09:13:16.547856+0000","last_undegraded":"2024-03-04T09:13:16.547856+0000","last_fullsized":"2024-03-04T09:13:16.547856+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:29:48.247984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"90'4","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:34.361655+0000","last_change":"2024-03-04T09:13:09.745168+0000","last_active":"2024-03-04T09:13:34.361655+0000","last_peered":"2024-03-04T09:13:34.361655+0000","last_clean":"2024-03-04T09:13:34.361655+0000","last_became_active":"2024-03-04T09:13:09.744789+0000","last_became_peered":"2024-03-04T09:13:09.744789+0000","last_unstale":"2024-03-04T09:13:34.361655+0000","last_undegraded":"2024-03-04T09:13:34.361655+0000","last_fullsized":"2024-03-04T09:13:34.361655+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:22:16.428422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547677+0000","last_change":"2024-03-04T09:13:10.770697+0000","last_active":"2024-03-04T09:13:16.547677+0000","last_peered":"2024-03-04T09:13:16.547677+0000","last_clean":"2024-03-04T09:13:16.547677+0000","last_became_active":"2024-03-04T09:13:10.770301+0000","last_became_peered":"2024-03-04T09:13:10.770301+0000","last_unstale":"2024-03-04T09:13:16.547677+0000","last_undegraded":"2024-03-04T09:13:16.547677+0000","last_fullsized":"2024-03-04T09:13:16.547677+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:29:27.520833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547428+0000","last_change":"2024-03-04T09:13:14.828103+0000","last_active":"2024-03-04T09:13:16.547428+0000","last_peered":"2024-03-04T09:13:16.547428+0000","last_clean":"2024-03-04T09:13:16.547428+0000","last_became_active":"2024-03-04T09:13:14.827699+0000","last_became_peered":"2024-03-04T09:13:14.827699+0000","last_unstale":"2024-03-04T09:13:16.547428+0000","last_undegraded":"2024-03-04T09:13:16.547428+0000","last_fullsized":"2024-03-04T09:13:16.547428+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:44:24.215654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:34.358859+0000","last_change":"2024-03-04T09:13:09.737342+0000","last_active":"2024-03-04T09:13:34.358859+0000","last_peered":"2024-03-04T09:13:34.358859+0000","last_clean":"2024-03-04T09:13:34.358859+0000","last_became_active":"2024-03-04T09:13:09.736946+0000","last_became_peered":"2024-03-04T09:13:09.736946+0000","last_unstale":"2024-03-04T09:13:34.358859+0000","last_undegraded":"2024-03-04T09:13:34.358859+0000","last_fullsized":"2024-03-04T09:13:34.358859+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:40:07.419155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.635632+0000","last_change":"2024-03-04T09:13:10.753689+0000","last_active":"2024-03-04T09:13:16.635632+0000","last_peered":"2024-03-04T09:13:16.635632+0000","last_clean":"2024-03-04T09:13:16.635632+0000","last_became_active":"2024-03-04T09:13:10.753352+0000","last_became_peered":"2024-03-04T09:13:10.753352+0000","last_unstale":"2024-03-04T09:13:16.635632+0000","last_undegraded":"2024-03-04T09:13:16.635632+0000","last_fullsized":"2024-03-04T09:13:16.635632+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:57:05.782954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547779+0000","last_change":"2024-03-04T09:13:14.805639+0000","last_active":"2024-03-04T09:13:16.547779+0000","last_peered":"2024-03-04T09:13:16.547779+0000","last_clean":"2024-03-04T09:13:16.547779+0000","last_became_active":"2024-03-04T09:13:14.804764+0000","last_became_peered":"2024-03-04T09:13:14.804764+0000","last_unstale":"2024-03-04T09:13:16.547779+0000","last_undegraded":"2024-03-04T09:13:16.547779+0000","last_fullsized":"2024-03-04T09:13:16.547779+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:31:21.470900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"90'3","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:34.360147+0000","last_change":"2024-03-04T09:13:09.729510+0000","last_active":"2024-03-04T09:13:34.360147+0000","last_peered":"2024-03-04T09:13:34.360147+0000","last_clean":"2024-03-04T09:13:34.360147+0000","last_became_active":"2024-03-04T09:13:09.729100+0000","last_became_peered":"2024-03-04T09:13:09.729100+0000","last_unstale":"2024-03-04T09:13:34.360147+0000","last_undegraded":"2024-03-04T09:13:34.360147+0000","last_fullsized":"2024-03-04T09:13:34.360147+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:00:43.441594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547312+0000","last_change":"2024-03-04T09:13:10.757543+0000","last_active":"2024-03-04T09:13:16.547312+0000","last_peered":"2024-03-04T09:13:16.547312+0000","last_clean":"2024-03-04T09:13:16.547312+0000","last_became_active":"2024-03-04T09:13:10.757205+0000","last_became_peered":"2024-03-04T09:13:10.757205+0000","last_unstale":"2024-03-04T09:13:16.547312+0000","last_undegraded":"2024-03-04T09:13:16.547312+0000","last_fullsized":"2024-03-04T09:13:16.547312+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:49:02.521232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.548142+0000","last_change":"2024-03-04T09:13:14.807608+0000","last_active":"2024-03-04T09:13:16.548142+0000","last_peered":"2024-03-04T09:13:16.548142+0000","last_clean":"2024-03-04T09:13:16.548142+0000","last_became_active":"2024-03-04T09:13:14.807193+0000","last_became_peered":"2024-03-04T09:13:14.807193+0000","last_unstale":"2024-03-04T09:13:16.548142+0000","last_undegraded":"2024-03-04T09:13:16.548142+0000","last_fullsized":"2024-03-04T09:13:16.548142+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:48:33.129309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"90'1","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547634+0000","last_change":"2024-03-04T09:13:09.738539+0000","last_active":"2024-03-04T09:13:16.547634+0000","last_peered":"2024-03-04T09:13:16.547634+0000","last_clean":"2024-03-04T09:13:16.547634+0000","last_became_active":"2024-03-04T09:13:09.738230+0000","last_became_peered":"2024-03-04T09:13:09.738230+0000","last_unstale":"2024-03-04T09:13:16.547634+0000","last_undegraded":"2024-03-04T09:13:16.547634+0000","last_fullsized":"2024-03-04T09:13:16.547634+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:08:56.789510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.046661+0000","last_change":"2024-03-04T09:13:10.766038+0000","last_active":"2024-03-04T09:13:16.046661+0000","last_peered":"2024-03-04T09:13:16.046661+0000","last_clean":"2024-03-04T09:13:16.046661+0000","last_became_active":"2024-03-04T09:13:10.764725+0000","last_became_peered":"2024-03-04T09:13:10.764725+0000","last_unstale":"2024-03-04T09:13:16.046661+0000","last_undegraded":"2024-03-04T09:13:16.046661+0000","last_fullsized":"2024-03-04T09:13:16.046661+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:34:53.027948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.548095+0000","last_change":"2024-03-04T09:13:14.827989+0000","last_active":"2024-03-04T09:13:16.548095+0000","last_peered":"2024-03-04T09:13:16.548095+0000","last_clean":"2024-03-04T09:13:16.548095+0000","last_became_active":"2024-03-04T09:13:14.827601+0000","last_became_peered":"2024-03-04T09:13:14.827601+0000","last_unstale":"2024-03-04T09:13:16.548095+0000","last_undegraded":"2024-03-04T09:13:16.548095+0000","last_fullsized":"2024-03-04T09:13:16.548095+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:41:24.869293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"90'4","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:34.360683+0000","last_change":"2024-03-04T09:13:09.737211+0000","last_active":"2024-03-04T09:13:34.360683+0000","last_peered":"2024-03-04T09:13:34.360683+0000","last_clean":"2024-03-04T09:13:34.360683+0000","last_became_active":"2024-03-04T09:13:09.736899+0000","last_became_peered":"2024-03-04T09:13:09.736899+0000","last_unstale":"2024-03-04T09:13:34.360683+0000","last_undegraded":"2024-03-04T09:13:34.360683+0000","last_fullsized":"2024-03-04T09:13:34.360683+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:59:09.575710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547712+0000","last_change":"2024-03-04T09:13:10.750234+0000","last_active":"2024-03-04T09:13:16.547712+0000","last_peered":"2024-03-04T09:13:16.547712+0000","last_clean":"2024-03-04T09:13:16.547712+0000","last_became_active":"2024-03-04T09:13:10.749868+0000","last_became_peered":"2024-03-04T09:13:10.749868+0000","last_unstale":"2024-03-04T09:13:16.547712+0000","last_undegraded":"2024-03-04T09:13:16.547712+0000","last_fullsized":"2024-03-04T09:13:16.547712+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:14:58.229628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.782314+0000","last_change":"2024-03-04T09:13:14.797360+0000","last_active":"2024-03-04T09:13:15.782314+0000","last_peered":"2024-03-04T09:13:15.782314+0000","last_clean":"2024-03-04T09:13:15.782314+0000","last_became_active":"2024-03-04T09:13:14.796885+0000","last_became_peered":"2024-03-04T09:13:14.796885+0000","last_unstale":"2024-03-04T09:13:15.782314+0000","last_undegraded":"2024-03-04T09:13:15.782314+0000","last_fullsized":"2024-03-04T09:13:15.782314+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:03:36.498833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"90'3","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:35.367870+0000","last_change":"2024-03-04T09:13:09.745299+0000","last_active":"2024-03-04T09:13:35.367870+0000","last_peered":"2024-03-04T09:13:35.367870+0000","last_clean":"2024-03-04T09:13:35.367870+0000","last_became_active":"2024-03-04T09:13:09.745005+0000","last_became_peered":"2024-03-04T09:13:09.745005+0000","last_unstale":"2024-03-04T09:13:35.367870+0000","last_undegraded":"2024-03-04T09:13:35.367870+0000","last_fullsized":"2024-03-04T09:13:35.367870+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:01:49.052431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.548626+0000","last_change":"2024-03-04T09:13:10.764774+0000","last_active":"2024-03-04T09:13:16.548626+0000","last_peered":"2024-03-04T09:13:16.548626+0000","last_clean":"2024-03-04T09:13:16.548626+0000","last_became_active":"2024-03-04T09:13:10.764436+0000","last_became_peered":"2024-03-04T09:13:10.764436+0000","last_unstale":"2024-03-04T09:13:16.548626+0000","last_undegraded":"2024-03-04T09:13:16.548626+0000","last_fullsized":"2024-03-04T09:13:16.548626+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:34:46.343791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547081+0000","last_change":"2024-03-04T09:13:14.809998+0000","last_active":"2024-03-04T09:13:16.547081+0000","last_peered":"2024-03-04T09:13:16.547081+0000","last_clean":"2024-03-04T09:13:16.547081+0000","last_became_active":"2024-03-04T09:13:14.809528+0000","last_became_peered":"2024-03-04T09:13:14.809528+0000","last_unstale":"2024-03-04T09:13:16.547081+0000","last_undegraded":"2024-03-04T09:13:16.547081+0000","last_fullsized":"2024-03-04T09:13:16.547081+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:36:42.404172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"85'1","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.785269+0000","last_change":"2024-03-04T09:13:09.738112+0000","last_active":"2024-03-04T09:13:15.785269+0000","last_peered":"2024-03-04T09:13:15.785269+0000","last_clean":"2024-03-04T09:13:15.785269+0000","last_became_active":"2024-03-04T09:13:09.737798+0000","last_became_peered":"2024-03-04T09:13:09.737798+0000","last_unstale":"2024-03-04T09:13:15.785269+0000","last_undegraded":"2024-03-04T09:13:15.785269+0000","last_fullsized":"2024-03-04T09:13:15.785269+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:04:05.402017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547892+0000","last_change":"2024-03-04T09:13:10.759809+0000","last_active":"2024-03-04T09:13:16.547892+0000","last_peered":"2024-03-04T09:13:16.547892+0000","last_clean":"2024-03-04T09:13:16.547892+0000","last_became_active":"2024-03-04T09:13:10.759439+0000","last_became_peered":"2024-03-04T09:13:10.759439+0000","last_unstale":"2024-03-04T09:13:16.547892+0000","last_undegraded":"2024-03-04T09:13:16.547892+0000","last_fullsized":"2024-03-04T09:13:16.547892+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:15:54.173010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.784412+0000","last_change":"2024-03-04T09:13:14.793488+0000","last_active":"2024-03-04T09:13:15.784412+0000","last_peered":"2024-03-04T09:13:15.784412+0000","last_clean":"2024-03-04T09:13:15.784412+0000","last_became_active":"2024-03-04T09:13:14.792262+0000","last_became_peered":"2024-03-04T09:13:14.792262+0000","last_unstale":"2024-03-04T09:13:15.784412+0000","last_undegraded":"2024-03-04T09:13:15.784412+0000","last_fullsized":"2024-03-04T09:13:15.784412+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:53:00.294874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"85'2","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.784684+0000","last_change":"2024-03-04T09:13:09.729544+0000","last_active":"2024-03-04T09:13:15.784684+0000","last_peered":"2024-03-04T09:13:15.784684+0000","last_clean":"2024-03-04T09:13:15.784684+0000","last_became_active":"2024-03-04T09:13:09.729266+0000","last_became_peered":"2024-03-04T09:13:09.729266+0000","last_unstale":"2024-03-04T09:13:15.784684+0000","last_undegraded":"2024-03-04T09:13:15.784684+0000","last_fullsized":"2024-03-04T09:13:15.784684+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:27.492387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.548428+0000","last_change":"2024-03-04T09:13:10.761494+0000","last_active":"2024-03-04T09:13:16.548428+0000","last_peered":"2024-03-04T09:13:16.548428+0000","last_clean":"2024-03-04T09:13:16.548428+0000","last_became_active":"2024-03-04T09:13:10.760873+0000","last_became_peered":"2024-03-04T09:13:10.760873+0000","last_unstale":"2024-03-04T09:13:16.548428+0000","last_undegraded":"2024-03-04T09:13:16.548428+0000","last_fullsized":"2024-03-04T09:13:16.548428+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:07:25.001910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547387+0000","last_change":"2024-03-04T09:13:10.754079+0000","last_active":"2024-03-04T09:13:16.547387+0000","last_peered":"2024-03-04T09:13:16.547387+0000","last_clean":"2024-03-04T09:13:16.547387+0000","last_became_active":"2024-03-04T09:13:10.753691+0000","last_became_peered":"2024-03-04T09:13:10.753691+0000","last_unstale":"2024-03-04T09:13:16.547387+0000","last_undegraded":"2024-03-04T09:13:16.547387+0000","last_fullsized":"2024-03-04T09:13:16.547387+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:45:23.609172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.548250+0000","last_change":"2024-03-04T09:13:10.754556+0000","last_active":"2024-03-04T09:13:16.548250+0000","last_peered":"2024-03-04T09:13:16.548250+0000","last_clean":"2024-03-04T09:13:16.548250+0000","last_became_active":"2024-03-04T09:13:10.754224+0000","last_became_peered":"2024-03-04T09:13:10.754224+0000","last_unstale":"2024-03-04T09:13:16.548250+0000","last_undegraded":"2024-03-04T09:13:16.548250+0000","last_fullsized":"2024-03-04T09:13:16.548250+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:16:27.092418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547538+0000","last_change":"2024-03-04T09:13:10.753864+0000","last_active":"2024-03-04T09:13:16.547538+0000","last_peered":"2024-03-04T09:13:16.547538+0000","last_clean":"2024-03-04T09:13:16.547538+0000","last_became_active":"2024-03-04T09:13:10.753083+0000","last_became_peered":"2024-03-04T09:13:10.753083+0000","last_unstale":"2024-03-04T09:13:16.547538+0000","last_undegraded":"2024-03-04T09:13:16.547538+0000","last_fullsized":"2024-03-04T09:13:16.547538+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:50:45.119191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547312+0000","last_change":"2024-03-04T09:13:10.771303+0000","last_active":"2024-03-04T09:13:16.547312+0000","last_peered":"2024-03-04T09:13:16.547312+0000","last_clean":"2024-03-04T09:13:16.547312+0000","last_became_active":"2024-03-04T09:13:10.770950+0000","last_became_peered":"2024-03-04T09:13:10.770950+0000","last_unstale":"2024-03-04T09:13:16.547312+0000","last_undegraded":"2024-03-04T09:13:16.547312+0000","last_fullsized":"2024-03-04T09:13:16.547312+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:48:59.832283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.784553+0000","last_change":"2024-03-04T09:13:10.757277+0000","last_active":"2024-03-04T09:13:15.784553+0000","last_peered":"2024-03-04T09:13:15.784553+0000","last_clean":"2024-03-04T09:13:15.784553+0000","last_became_active":"2024-03-04T09:13:10.756878+0000","last_became_peered":"2024-03-04T09:13:10.756878+0000","last_unstale":"2024-03-04T09:13:15.784553+0000","last_undegraded":"2024-03-04T09:13:15.784553+0000","last_fullsized":"2024-03-04T09:13:15.784553+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:24:58.637505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.548033+0000","last_change":"2024-03-04T09:13:10.759449+0000","last_active":"2024-03-04T09:13:16.548033+0000","last_peered":"2024-03-04T09:13:16.548033+0000","last_clean":"2024-03-04T09:13:16.548033+0000","last_became_active":"2024-03-04T09:13:10.759135+0000","last_became_peered":"2024-03-04T09:13:10.759135+0000","last_unstale":"2024-03-04T09:13:16.548033+0000","last_undegraded":"2024-03-04T09:13:16.548033+0000","last_fullsized":"2024-03-04T09:13:16.548033+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:23.062734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.548347+0000","last_change":"2024-03-04T09:13:10.754694+0000","last_active":"2024-03-04T09:13:16.548347+0000","last_peered":"2024-03-04T09:13:16.548347+0000","last_clean":"2024-03-04T09:13:16.548347+0000","last_became_active":"2024-03-04T09:13:10.754370+0000","last_became_peered":"2024-03-04T09:13:10.754370+0000","last_unstale":"2024-03-04T09:13:16.548347+0000","last_undegraded":"2024-03-04T09:13:16.548347+0000","last_fullsized":"2024-03-04T09:13:16.548347+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:43:22.049974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.046918+0000","last_change":"2024-03-04T09:13:10.769685+0000","last_active":"2024-03-04T09:13:16.046918+0000","last_peered":"2024-03-04T09:13:16.046918+0000","last_clean":"2024-03-04T09:13:16.046918+0000","last_became_active":"2024-03-04T09:13:10.769320+0000","last_became_peered":"2024-03-04T09:13:10.769320+0000","last_unstale":"2024-03-04T09:13:16.046918+0000","last_undegraded":"2024-03-04T09:13:16.046918+0000","last_fullsized":"2024-03-04T09:13:16.046918+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:44:52.989449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.784595+0000","last_change":"2024-03-04T09:13:10.759417+0000","last_active":"2024-03-04T09:13:15.784595+0000","last_peered":"2024-03-04T09:13:15.784595+0000","last_clean":"2024-03-04T09:13:15.784595+0000","last_became_active":"2024-03-04T09:13:10.759025+0000","last_became_peered":"2024-03-04T09:13:10.759025+0000","last_unstale":"2024-03-04T09:13:15.784595+0000","last_undegraded":"2024-03-04T09:13:15.784595+0000","last_fullsized":"2024-03-04T09:13:15.784595+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:54:08.931563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.046666+0000","last_change":"2024-03-04T09:13:10.758917+0000","last_active":"2024-03-04T09:13:16.046666+0000","last_peered":"2024-03-04T09:13:16.046666+0000","last_clean":"2024-03-04T09:13:16.046666+0000","last_became_active":"2024-03-04T09:13:10.758604+0000","last_became_peered":"2024-03-04T09:13:10.758604+0000","last_unstale":"2024-03-04T09:13:16.046666+0000","last_undegraded":"2024-03-04T09:13:16.046666+0000","last_fullsized":"2024-03-04T09:13:16.046666+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:38:51.989174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.782505+0000","last_change":"2024-03-04T09:13:10.759544+0000","last_active":"2024-03-04T09:13:15.782505+0000","last_peered":"2024-03-04T09:13:15.782505+0000","last_clean":"2024-03-04T09:13:15.782505+0000","last_became_active":"2024-03-04T09:13:10.759165+0000","last_became_peered":"2024-03-04T09:13:10.759165+0000","last_unstale":"2024-03-04T09:13:15.782505+0000","last_undegraded":"2024-03-04T09:13:15.782505+0000","last_fullsized":"2024-03-04T09:13:15.782505+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:45:55.441307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.784453+0000","last_change":"2024-03-04T09:13:10.758342+0000","last_active":"2024-03-04T09:13:15.784453+0000","last_peered":"2024-03-04T09:13:15.784453+0000","last_clean":"2024-03-04T09:13:15.784453+0000","last_became_active":"2024-03-04T09:13:10.757987+0000","last_became_peered":"2024-03-04T09:13:10.757987+0000","last_unstale":"2024-03-04T09:13:15.784453+0000","last_undegraded":"2024-03-04T09:13:15.784453+0000","last_fullsized":"2024-03-04T09:13:15.784453+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:52:07.029064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.548421+0000","last_change":"2024-03-04T09:13:10.768340+0000","last_active":"2024-03-04T09:13:16.548421+0000","last_peered":"2024-03-04T09:13:16.548421+0000","last_clean":"2024-03-04T09:13:16.548421+0000","last_became_active":"2024-03-04T09:13:10.768000+0000","last_became_peered":"2024-03-04T09:13:10.768000+0000","last_unstale":"2024-03-04T09:13:16.548421+0000","last_undegraded":"2024-03-04T09:13:16.548421+0000","last_fullsized":"2024-03-04T09:13:16.548421+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:50:17.564815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":246013,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":44171,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":6,"num_read_kb":43,"num_write":160,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":331776,"data_stored":97221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892350993,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":970752,"data_stored":480266,"data_compressed":14711,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612631,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28084,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717068,"statfs":{"total":95995035648,"available":95966277632,"internally_reserved":0,"allocated":1093632,"data_stored":1095868,"data_compressed":50324,"data_compressed_allocated":65536,"data_compressed_original":630784,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776156,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":995328,"data_stored":481174,"data_compressed":14711,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037793,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32136,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713016,"statfs":{"total":95995035648,"available":95962128384,"internally_reserved":0,"allocated":983040,"data_stored":480892,"data_compressed":14711,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299430,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1036288,"data_stored":1072426,"data_compressed":50324,"data_compressed_allocated":65536,"data_compressed_original":630784,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462955,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":974848,"data_stored":480356,"data_compressed":14711,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":1015808,"data_stored":505159,"data_compressed":14711,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":974848,"data_stored":480356,"data_compressed":14711,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411391,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":995328,"data_stored":484764,"data_compressed":14711,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149753,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32136,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713016,"statfs":{"total":95995035648,"available":95962128384,"internally_reserved":0,"allocated":983040,"data_stored":480460,"data_compressed":14711,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888117,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":974848,"data_stored":480288,"data_compressed":14711,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724591,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1032192,"data_stored":1070816,"data_compressed":50324,"data_compressed_allocated":65536,"data_compressed_original":630784,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33974,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33974,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":42223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":5192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":42598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T09:13:39.074 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-04T09:13:39.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.211+0000 7f8f61278640 1 -- 172.21.15.82:0/671600255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f5c1020b0 msgr2=0x7f8f5c108940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:39.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.211+0000 7f8f61278640 1 --2- 172.21.15.82:0/671600255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f5c1020b0 0x7f8f5c108940 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8f54009ca0 tx=0x7f8f5402c0f0 comp rx=0 tx=0).stop 2024-03-04T09:13:39.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.211+0000 7f8f61278640 1 -- 172.21.15.82:0/671600255 shutdown_connections 2024-03-04T09:13:39.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.211+0000 7f8f61278640 1 --2- 172.21.15.82:0/671600255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f5c1020b0 0x7f8f5c108940 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:39.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.211+0000 7f8f61278640 1 --2- 172.21.15.82:0/671600255 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f5c1016f0 0x7f8f5c101b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:39.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.211+0000 7f8f61278640 1 --2- 172.21.15.82:0/671600255 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8f5c100500 0x7f8f5c100920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:39.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.211+0000 7f8f61278640 1 -- 172.21.15.82:0/671600255 >> 172.21.15.82:0/671600255 conn(0x7f8f5c0fbab0 msgr2=0x7f8f5c0fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:39.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.211+0000 7f8f61278640 1 -- 172.21.15.82:0/671600255 shutdown_connections 2024-03-04T09:13:39.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.211+0000 7f8f61278640 1 -- 172.21.15.82:0/671600255 wait complete. 2024-03-04T09:13:39.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.211+0000 7f8f61278640 1 Processor -- start 2024-03-04T09:13:39.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.212+0000 7f8f61278640 1 -- start start 2024-03-04T09:13:39.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.212+0000 7f8f61278640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f5c100500 0x7f8f5c1978c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:39.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.212+0000 7f8f61278640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8f5c1016f0 0x7f8f5c197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:39.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.212+0000 7f8f61278640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f5c1020b0 0x7f8f5c19ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:39.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.212+0000 7f8f61278640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5c10c160 con 0x7f8f5c1020b0 2024-03-04T09:13:39.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.212+0000 7f8f61278640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5c10bfe0 con 0x7f8f5c100500 2024-03-04T09:13:39.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.212+0000 7f8f61278640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5c10c2e0 con 0x7f8f5c1016f0 2024-03-04T09:13:39.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.212+0000 7f8f5b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f5c1020b0 0x7f8f5c19ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:39.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.212+0000 7f8f5affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f5c100500 0x7f8f5c1978c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:39.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.212+0000 7f8f5b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f5c1020b0 0x7f8f5c19ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43158/0 (socket says 172.21.15.82:43158) 2024-03-04T09:13:39.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.212+0000 7f8f5b7fe640 1 -- 172.21.15.82:0/1868960490 learned_addr learned my addr 172.21.15.82:0/1868960490 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:39.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.212+0000 7f8f5a7fc640 1 --2- 172.21.15.82:0/1868960490 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8f5c1016f0 0x7f8f5c197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:39.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.212+0000 7f8f5b7fe640 1 -- 172.21.15.82:0/1868960490 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8f5c1016f0 msgr2=0x7f8f5c197e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:39.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.212+0000 7f8f5b7fe640 1 --2- 172.21.15.82:0/1868960490 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8f5c1016f0 0x7f8f5c197e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:39.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.212+0000 7f8f5b7fe640 1 -- 172.21.15.82:0/1868960490 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f5c100500 msgr2=0x7f8f5c1978c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:39.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.212+0000 7f8f5b7fe640 1 --2- 172.21.15.82:0/1868960490 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f5c100500 0x7f8f5c1978c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:39.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.212+0000 7f8f5b7fe640 1 -- 172.21.15.82:0/1868960490 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f5c19f4e0 con 0x7f8f5c1020b0 2024-03-04T09:13:39.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.212+0000 7f8f5affd640 1 --2- 172.21.15.82:0/1868960490 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f5c100500 0x7f8f5c1978c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:13:39.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.212+0000 7f8f5b7fe640 1 --2- 172.21.15.82:0/1868960490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f5c1020b0 0x7f8f5c19ee70 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8f5402c630 tx=0x7f8f54032980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:39.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.212+0000 7f8f43fff640 1 -- 172.21.15.82:0/1868960490 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f54039050 con 0x7f8f5c1020b0 2024-03-04T09:13:39.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.212+0000 7f8f43fff640 1 -- 172.21.15.82:0/1868960490 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f8f5403a040 con 0x7f8f5c1020b0 2024-03-04T09:13:39.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.212+0000 7f8f61278640 1 -- 172.21.15.82:0/1868960490 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f5c19f770 con 0x7f8f5c1020b0 2024-03-04T09:13:39.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.212+0000 7f8f43fff640 1 -- 172.21.15.82:0/1868960490 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f54004850 con 0x7f8f5c1020b0 2024-03-04T09:13:39.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.213+0000 7f8f61278640 1 -- 172.21.15.82:0/1868960490 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f5c19fcb0 con 0x7f8f5c1020b0 2024-03-04T09:13:39.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.214+0000 7f8f61278640 1 -- 172.21.15.82:0/1868960490 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f5c19ff10 con 0x7f8f5c1020b0 2024-03-04T09:13:39.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.215+0000 7f8f43fff640 1 -- 172.21.15.82:0/1868960490 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 136807+0+0 (secure 0 0 0) 0x7f8f54004040 con 0x7f8f5c1020b0 2024-03-04T09:13:39.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.215+0000 7f8f43fff640 1 --2- 172.21.15.82:0/1868960490 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f8f440a2030 0x7f8f440a44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:39.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.215+0000 7f8f5affd640 1 --2- 172.21.15.82:0/1868960490 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f8f440a2030 0x7f8f440a44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:39.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.215+0000 7f8f43fff640 1 -- 172.21.15.82:0/1868960490 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8802+0+0 (secure 0 0 0) 0x7f8f540f0ac0 con 0x7f8f5c1020b0 2024-03-04T09:13:39.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.216+0000 7f8f5affd640 1 --2- 172.21.15.82:0/1868960490 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f8f440a2030 0x7f8f440a44f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c101550 tx=0x7f8f4c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:39.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.220+0000 7f8f43fff640 1 -- 172.21.15.82:0/1868960490 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f8f54004330 con 0x7f8f5c1020b0 2024-03-04T09:13:39.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.392+0000 7f8f61278640 1 -- 172.21.15.82:0/1868960490 --> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8f5c0fdc30 con 0x7f8f440a2030 2024-03-04T09:13:39.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.401+0000 7f8f43fff640 1 -- 172.21.15.82:0/1868960490 <== mgr.14152 v2:172.21.15.82:6800/1278635224 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+340572 (secure 0 0 0) 0x7f8f5c0fdc30 con 0x7f8f440a2030 2024-03-04T09:13:39.402 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:13:39.404 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-03-04T09:13:39.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.405+0000 7f8f61278640 1 -- 172.21.15.82:0/1868960490 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f8f440a2030 msgr2=0x7f8f440a44f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:39.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.405+0000 7f8f61278640 1 --2- 172.21.15.82:0/1868960490 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f8f440a2030 0x7f8f440a44f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c101550 tx=0x7f8f4c005f90 comp rx=0 tx=0).stop 2024-03-04T09:13:39.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.405+0000 7f8f61278640 1 -- 172.21.15.82:0/1868960490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f5c1020b0 msgr2=0x7f8f5c19ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:39.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.405+0000 7f8f61278640 1 --2- 172.21.15.82:0/1868960490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f5c1020b0 0x7f8f5c19ee70 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8f5402c630 tx=0x7f8f54032980 comp rx=0 tx=0).stop 2024-03-04T09:13:39.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.405+0000 7f8f61278640 1 -- 172.21.15.82:0/1868960490 shutdown_connections 2024-03-04T09:13:39.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.405+0000 7f8f61278640 1 --2- 172.21.15.82:0/1868960490 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f8f440a2030 0x7f8f440a44f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:39.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.405+0000 7f8f61278640 1 --2- 172.21.15.82:0/1868960490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f5c1020b0 0x7f8f5c19ee70 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:39.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.405+0000 7f8f61278640 1 --2- 172.21.15.82:0/1868960490 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8f5c1016f0 0x7f8f5c197e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:39.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.405+0000 7f8f61278640 1 --2- 172.21.15.82:0/1868960490 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f5c100500 0x7f8f5c1978c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:39.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.405+0000 7f8f61278640 1 -- 172.21.15.82:0/1868960490 >> 172.21.15.82:0/1868960490 conn(0x7f8f5c0fbab0 msgr2=0x7f8f5c0fd520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:39.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.405+0000 7f8f61278640 1 -- 172.21.15.82:0/1868960490 shutdown_connections 2024-03-04T09:13:39.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:39.405+0000 7f8f61278640 1 -- 172.21.15.82:0/1868960490 wait complete. 2024-03-04T09:13:39.413 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":303,"stamp":"2024-03-04T09:13:38.256734+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":634539,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":142,"num_read_kb":162,"num_write":341,"num_write_kb":3023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":274,"ondisk_log_size":274,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":352604,"kb_used_data":11748,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124589220,"statfs":{"total":1151940427776,"available":1151579361280,"internally_reserved":0,"allocated":12029952,"data_stored":7592825,"data_compressed":283371,"data_compressed_allocated":380928,"data_compressed_original":2260992,"omap_allocated":19142,"internal_metadata":348894522},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":39672,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":6,"num_read_kb":43,"num_write":113,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003673"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.548652+0000","last_change":"2024-03-04T09:13:10.759614+0000","last_active":"2024-03-04T09:13:16.548652+0000","last_peered":"2024-03-04T09:13:16.548652+0000","last_clean":"2024-03-04T09:13:16.548652+0000","last_became_active":"2024-03-04T09:13:10.759313+0000","last_became_peered":"2024-03-04T09:13:10.759313+0000","last_unstale":"2024-03-04T09:13:16.548652+0000","last_undegraded":"2024-03-04T09:13:16.548652+0000","last_fullsized":"2024-03-04T09:13:16.548652+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:08:15.568079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547591+0000","last_change":"2024-03-04T09:13:10.754367+0000","last_active":"2024-03-04T09:13:16.547591+0000","last_peered":"2024-03-04T09:13:16.547591+0000","last_clean":"2024-03-04T09:13:16.547591+0000","last_became_active":"2024-03-04T09:13:10.753984+0000","last_became_peered":"2024-03-04T09:13:10.753984+0000","last_unstale":"2024-03-04T09:13:16.547591+0000","last_undegraded":"2024-03-04T09:13:16.547591+0000","last_fullsized":"2024-03-04T09:13:16.547591+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:14:29.000334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547357+0000","last_change":"2024-03-04T09:13:10.754951+0000","last_active":"2024-03-04T09:13:16.547357+0000","last_peered":"2024-03-04T09:13:16.547357+0000","last_clean":"2024-03-04T09:13:16.547357+0000","last_became_active":"2024-03-04T09:13:10.753579+0000","last_became_peered":"2024-03-04T09:13:10.753579+0000","last_unstale":"2024-03-04T09:13:16.547357+0000","last_undegraded":"2024-03-04T09:13:16.547357+0000","last_fullsized":"2024-03-04T09:13:16.547357+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:58.949790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.548399+0000","last_change":"2024-03-04T09:13:10.763372+0000","last_active":"2024-03-04T09:13:16.548399+0000","last_peered":"2024-03-04T09:13:16.548399+0000","last_clean":"2024-03-04T09:13:16.548399+0000","last_became_active":"2024-03-04T09:13:10.762664+0000","last_became_peered":"2024-03-04T09:13:10.762664+0000","last_unstale":"2024-03-04T09:13:16.548399+0000","last_undegraded":"2024-03-04T09:13:16.548399+0000","last_fullsized":"2024-03-04T09:13:16.548399+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:44:58.854969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.635792+0000","last_change":"2024-03-04T09:13:10.750348+0000","last_active":"2024-03-04T09:13:16.635792+0000","last_peered":"2024-03-04T09:13:16.635792+0000","last_clean":"2024-03-04T09:13:16.635792+0000","last_became_active":"2024-03-04T09:13:10.749997+0000","last_became_peered":"2024-03-04T09:13:10.749997+0000","last_unstale":"2024-03-04T09:13:16.635792+0000","last_undegraded":"2024-03-04T09:13:16.635792+0000","last_fullsized":"2024-03-04T09:13:16.635792+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:40.701906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.548537+0000","last_change":"2024-03-04T09:13:10.760385+0000","last_active":"2024-03-04T09:13:16.548537+0000","last_peered":"2024-03-04T09:13:16.548537+0000","last_clean":"2024-03-04T09:13:16.548537+0000","last_became_active":"2024-03-04T09:13:10.758679+0000","last_became_peered":"2024-03-04T09:13:10.758679+0000","last_unstale":"2024-03-04T09:13:16.548537+0000","last_undegraded":"2024-03-04T09:13:16.548537+0000","last_fullsized":"2024-03-04T09:13:16.548537+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:42:53.692190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547684+0000","last_change":"2024-03-04T09:13:10.765288+0000","last_active":"2024-03-04T09:13:16.547684+0000","last_peered":"2024-03-04T09:13:16.547684+0000","last_clean":"2024-03-04T09:13:16.547684+0000","last_became_active":"2024-03-04T09:13:10.763295+0000","last_became_peered":"2024-03-04T09:13:10.763295+0000","last_unstale":"2024-03-04T09:13:16.547684+0000","last_undegraded":"2024-03-04T09:13:16.547684+0000","last_fullsized":"2024-03-04T09:13:16.547684+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:57:09.795996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.046398+0000","last_change":"2024-03-04T09:13:10.766450+0000","last_active":"2024-03-04T09:13:16.046398+0000","last_peered":"2024-03-04T09:13:16.046398+0000","last_clean":"2024-03-04T09:13:16.046398+0000","last_became_active":"2024-03-04T09:13:10.764686+0000","last_became_peered":"2024-03-04T09:13:10.764686+0000","last_unstale":"2024-03-04T09:13:16.046398+0000","last_undegraded":"2024-03-04T09:13:16.046398+0000","last_fullsized":"2024-03-04T09:13:16.046398+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:09:35.938741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.782712+0000","last_change":"2024-03-04T09:13:10.755868+0000","last_active":"2024-03-04T09:13:15.782712+0000","last_peered":"2024-03-04T09:13:15.782712+0000","last_clean":"2024-03-04T09:13:15.782712+0000","last_became_active":"2024-03-04T09:13:10.755543+0000","last_became_peered":"2024-03-04T09:13:10.755543+0000","last_unstale":"2024-03-04T09:13:15.782712+0000","last_undegraded":"2024-03-04T09:13:15.782712+0000","last_fullsized":"2024-03-04T09:13:15.782712+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:50.255712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.548849+0000","last_change":"2024-03-04T09:13:10.763599+0000","last_active":"2024-03-04T09:13:16.548849+0000","last_peered":"2024-03-04T09:13:16.548849+0000","last_clean":"2024-03-04T09:13:16.548849+0000","last_became_active":"2024-03-04T09:13:10.763281+0000","last_became_peered":"2024-03-04T09:13:10.763281+0000","last_unstale":"2024-03-04T09:13:16.548849+0000","last_undegraded":"2024-03-04T09:13:16.548849+0000","last_fullsized":"2024-03-04T09:13:16.548849+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:55:00.941408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.548531+0000","last_change":"2024-03-04T09:13:10.763605+0000","last_active":"2024-03-04T09:13:16.548531+0000","last_peered":"2024-03-04T09:13:16.548531+0000","last_clean":"2024-03-04T09:13:16.548531+0000","last_became_active":"2024-03-04T09:13:10.763291+0000","last_became_peered":"2024-03-04T09:13:10.763291+0000","last_unstale":"2024-03-04T09:13:16.548531+0000","last_undegraded":"2024-03-04T09:13:16.548531+0000","last_fullsized":"2024-03-04T09:13:16.548531+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:59:55.256414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.548306+0000","last_change":"2024-03-04T09:13:10.767306+0000","last_active":"2024-03-04T09:13:16.548306+0000","last_peered":"2024-03-04T09:13:16.548306+0000","last_clean":"2024-03-04T09:13:16.548306+0000","last_became_active":"2024-03-04T09:13:10.766933+0000","last_became_peered":"2024-03-04T09:13:10.766933+0000","last_unstale":"2024-03-04T09:13:16.548306+0000","last_undegraded":"2024-03-04T09:13:16.548306+0000","last_fullsized":"2024-03-04T09:13:16.548306+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:20:30.242853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.784394+0000","last_change":"2024-03-04T09:13:10.753710+0000","last_active":"2024-03-04T09:13:15.784394+0000","last_peered":"2024-03-04T09:13:15.784394+0000","last_clean":"2024-03-04T09:13:15.784394+0000","last_became_active":"2024-03-04T09:13:10.753377+0000","last_became_peered":"2024-03-04T09:13:10.753377+0000","last_unstale":"2024-03-04T09:13:15.784394+0000","last_undegraded":"2024-03-04T09:13:15.784394+0000","last_fullsized":"2024-03-04T09:13:15.784394+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:06.234019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.546994+0000","last_change":"2024-03-04T09:13:10.758250+0000","last_active":"2024-03-04T09:13:16.546994+0000","last_peered":"2024-03-04T09:13:16.546994+0000","last_clean":"2024-03-04T09:13:16.546994+0000","last_became_active":"2024-03-04T09:13:10.756245+0000","last_became_peered":"2024-03-04T09:13:10.756245+0000","last_unstale":"2024-03-04T09:13:16.546994+0000","last_undegraded":"2024-03-04T09:13:16.546994+0000","last_fullsized":"2024-03-04T09:13:16.546994+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:57:29.303193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547077+0000","last_change":"2024-03-04T09:13:10.759521+0000","last_active":"2024-03-04T09:13:16.547077+0000","last_peered":"2024-03-04T09:13:16.547077+0000","last_clean":"2024-03-04T09:13:16.547077+0000","last_became_active":"2024-03-04T09:13:10.759118+0000","last_became_peered":"2024-03-04T09:13:10.759118+0000","last_unstale":"2024-03-04T09:13:16.547077+0000","last_undegraded":"2024-03-04T09:13:16.547077+0000","last_fullsized":"2024-03-04T09:13:16.547077+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:11:12.293247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.782152+0000","last_change":"2024-03-04T09:13:10.757374+0000","last_active":"2024-03-04T09:13:15.782152+0000","last_peered":"2024-03-04T09:13:15.782152+0000","last_clean":"2024-03-04T09:13:15.782152+0000","last_became_active":"2024-03-04T09:13:10.757056+0000","last_became_peered":"2024-03-04T09:13:10.757056+0000","last_unstale":"2024-03-04T09:13:15.782152+0000","last_undegraded":"2024-03-04T09:13:15.782152+0000","last_fullsized":"2024-03-04T09:13:15.782152+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:42:28.258326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.548493+0000","last_change":"2024-03-04T09:13:10.762375+0000","last_active":"2024-03-04T09:13:16.548493+0000","last_peered":"2024-03-04T09:13:16.548493+0000","last_clean":"2024-03-04T09:13:16.548493+0000","last_became_active":"2024-03-04T09:13:10.761813+0000","last_became_peered":"2024-03-04T09:13:10.761813+0000","last_unstale":"2024-03-04T09:13:16.548493+0000","last_undegraded":"2024-03-04T09:13:16.548493+0000","last_fullsized":"2024-03-04T09:13:16.548493+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:16:55.448189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.548241+0000","last_change":"2024-03-04T09:13:10.755239+0000","last_active":"2024-03-04T09:13:16.548241+0000","last_peered":"2024-03-04T09:13:16.548241+0000","last_clean":"2024-03-04T09:13:16.548241+0000","last_became_active":"2024-03-04T09:13:10.754863+0000","last_became_peered":"2024-03-04T09:13:10.754863+0000","last_unstale":"2024-03-04T09:13:16.548241+0000","last_undegraded":"2024-03-04T09:13:16.548241+0000","last_fullsized":"2024-03-04T09:13:16.548241+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:39:22.385097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.548490+0000","last_change":"2024-03-04T09:13:10.757899+0000","last_active":"2024-03-04T09:13:16.548490+0000","last_peered":"2024-03-04T09:13:16.548490+0000","last_clean":"2024-03-04T09:13:16.548490+0000","last_became_active":"2024-03-04T09:13:10.756155+0000","last_became_peered":"2024-03-04T09:13:10.756155+0000","last_unstale":"2024-03-04T09:13:16.548490+0000","last_undegraded":"2024-03-04T09:13:16.548490+0000","last_fullsized":"2024-03-04T09:13:16.548490+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:24:08.750137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.548126+0000","last_change":"2024-03-04T09:13:14.804112+0000","last_active":"2024-03-04T09:13:16.548126+0000","last_peered":"2024-03-04T09:13:16.548126+0000","last_clean":"2024-03-04T09:13:16.548126+0000","last_became_active":"2024-03-04T09:13:14.803405+0000","last_became_peered":"2024-03-04T09:13:14.803405+0000","last_unstale":"2024-03-04T09:13:16.548126+0000","last_undegraded":"2024-03-04T09:13:16.548126+0000","last_fullsized":"2024-03-04T09:13:16.548126+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:45:38.650375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"90'11","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:36.377177+0000","last_change":"2024-03-04T09:13:09.732569+0000","last_active":"2024-03-04T09:13:36.377177+0000","last_peered":"2024-03-04T09:13:36.377177+0000","last_clean":"2024-03-04T09:13:36.377177+0000","last_became_active":"2024-03-04T09:13:09.732257+0000","last_became_peered":"2024-03-04T09:13:09.732257+0000","last_unstale":"2024-03-04T09:13:36.377177+0000","last_undegraded":"2024-03-04T09:13:36.377177+0000","last_fullsized":"2024-03-04T09:13:36.377177+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:11:32.462839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.046662+0000","last_change":"2024-03-04T09:13:10.758073+0000","last_active":"2024-03-04T09:13:16.046662+0000","last_peered":"2024-03-04T09:13:16.046662+0000","last_clean":"2024-03-04T09:13:16.046662+0000","last_became_active":"2024-03-04T09:13:10.757560+0000","last_became_peered":"2024-03-04T09:13:10.757560+0000","last_unstale":"2024-03-04T09:13:16.046662+0000","last_undegraded":"2024-03-04T09:13:16.046662+0000","last_fullsized":"2024-03-04T09:13:16.046662+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:21:15.482038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547269+0000","last_change":"2024-03-04T09:13:14.803540+0000","last_active":"2024-03-04T09:13:16.547269+0000","last_peered":"2024-03-04T09:13:16.547269+0000","last_clean":"2024-03-04T09:13:16.547269+0000","last_became_active":"2024-03-04T09:13:14.803135+0000","last_became_peered":"2024-03-04T09:13:14.803135+0000","last_unstale":"2024-03-04T09:13:16.547269+0000","last_undegraded":"2024-03-04T09:13:16.547269+0000","last_fullsized":"2024-03-04T09:13:16.547269+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:21:28.193838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"85'1","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.046786+0000","last_change":"2024-03-04T09:13:09.737492+0000","last_active":"2024-03-04T09:13:16.046786+0000","last_peered":"2024-03-04T09:13:16.046786+0000","last_clean":"2024-03-04T09:13:16.046786+0000","last_became_active":"2024-03-04T09:13:09.736976+0000","last_became_peered":"2024-03-04T09:13:09.736976+0000","last_unstale":"2024-03-04T09:13:16.046786+0000","last_undegraded":"2024-03-04T09:13:16.046786+0000","last_fullsized":"2024-03-04T09:13:16.046786+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:40:53.757520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547476+0000","last_change":"2024-03-04T09:13:10.758838+0000","last_active":"2024-03-04T09:13:16.547476+0000","last_peered":"2024-03-04T09:13:16.547476+0000","last_clean":"2024-03-04T09:13:16.547476+0000","last_became_active":"2024-03-04T09:13:10.758476+0000","last_became_peered":"2024-03-04T09:13:10.758476+0000","last_unstale":"2024-03-04T09:13:16.547476+0000","last_undegraded":"2024-03-04T09:13:16.547476+0000","last_fullsized":"2024-03-04T09:13:16.547476+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:22:29.762608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547414+0000","last_change":"2024-03-04T09:13:14.806054+0000","last_active":"2024-03-04T09:13:16.547414+0000","last_peered":"2024-03-04T09:13:16.547414+0000","last_clean":"2024-03-04T09:13:16.547414+0000","last_became_active":"2024-03-04T09:13:14.805613+0000","last_became_peered":"2024-03-04T09:13:14.805613+0000","last_unstale":"2024-03-04T09:13:16.547414+0000","last_undegraded":"2024-03-04T09:13:16.547414+0000","last_fullsized":"2024-03-04T09:13:16.547414+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:07:49.657530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"90'4","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:35.368640+0000","last_change":"2024-03-04T09:13:09.741515+0000","last_active":"2024-03-04T09:13:35.368640+0000","last_peered":"2024-03-04T09:13:35.368640+0000","last_clean":"2024-03-04T09:13:35.368640+0000","last_became_active":"2024-03-04T09:13:09.740967+0000","last_became_peered":"2024-03-04T09:13:09.740967+0000","last_unstale":"2024-03-04T09:13:35.368640+0000","last_undegraded":"2024-03-04T09:13:35.368640+0000","last_fullsized":"2024-03-04T09:13:35.368640+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:56.280060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.782310+0000","last_change":"2024-03-04T09:13:10.751915+0000","last_active":"2024-03-04T09:13:15.782310+0000","last_peered":"2024-03-04T09:13:15.782310+0000","last_clean":"2024-03-04T09:13:15.782310+0000","last_became_active":"2024-03-04T09:13:10.751616+0000","last_became_peered":"2024-03-04T09:13:10.751616+0000","last_unstale":"2024-03-04T09:13:15.782310+0000","last_undegraded":"2024-03-04T09:13:15.782310+0000","last_fullsized":"2024-03-04T09:13:15.782310+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:35:08.099035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547734+0000","last_change":"2024-03-04T09:13:14.798372+0000","last_active":"2024-03-04T09:13:16.547734+0000","last_peered":"2024-03-04T09:13:16.547734+0000","last_clean":"2024-03-04T09:13:16.547734+0000","last_became_active":"2024-03-04T09:13:14.798020+0000","last_became_peered":"2024-03-04T09:13:14.798020+0000","last_unstale":"2024-03-04T09:13:16.547734+0000","last_undegraded":"2024-03-04T09:13:16.547734+0000","last_fullsized":"2024-03-04T09:13:16.547734+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:43:41.153520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"85'2","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.635852+0000","last_change":"2024-03-04T09:13:09.739187+0000","last_active":"2024-03-04T09:13:16.635852+0000","last_peered":"2024-03-04T09:13:16.635852+0000","last_clean":"2024-03-04T09:13:16.635852+0000","last_became_active":"2024-03-04T09:13:09.738753+0000","last_became_peered":"2024-03-04T09:13:09.738753+0000","last_unstale":"2024-03-04T09:13:16.635852+0000","last_undegraded":"2024-03-04T09:13:16.635852+0000","last_fullsized":"2024-03-04T09:13:16.635852+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:29:06.512779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.785105+0000","last_change":"2024-03-04T09:13:10.768484+0000","last_active":"2024-03-04T09:13:15.785105+0000","last_peered":"2024-03-04T09:13:15.785105+0000","last_clean":"2024-03-04T09:13:15.785105+0000","last_became_active":"2024-03-04T09:13:10.768153+0000","last_became_peered":"2024-03-04T09:13:10.768153+0000","last_unstale":"2024-03-04T09:13:15.785105+0000","last_undegraded":"2024-03-04T09:13:15.785105+0000","last_fullsized":"2024-03-04T09:13:15.785105+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:54:28.804596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.548328+0000","last_change":"2024-03-04T09:13:14.796639+0000","last_active":"2024-03-04T09:13:16.548328+0000","last_peered":"2024-03-04T09:13:16.548328+0000","last_clean":"2024-03-04T09:13:16.548328+0000","last_became_active":"2024-03-04T09:13:14.796128+0000","last_became_peered":"2024-03-04T09:13:14.796128+0000","last_unstale":"2024-03-04T09:13:16.548328+0000","last_undegraded":"2024-03-04T09:13:16.548328+0000","last_fullsized":"2024-03-04T09:13:16.548328+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:31:53.013126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'5","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:34.362427+0000","last_change":"2024-03-04T09:13:09.741381+0000","last_active":"2024-03-04T09:13:34.362427+0000","last_peered":"2024-03-04T09:13:34.362427+0000","last_clean":"2024-03-04T09:13:34.362427+0000","last_became_active":"2024-03-04T09:13:09.741032+0000","last_became_peered":"2024-03-04T09:13:09.741032+0000","last_unstale":"2024-03-04T09:13:34.362427+0000","last_undegraded":"2024-03-04T09:13:34.362427+0000","last_fullsized":"2024-03-04T09:13:34.362427+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:36:12.430867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.635978+0000","last_change":"2024-03-04T09:13:10.756778+0000","last_active":"2024-03-04T09:13:16.635978+0000","last_peered":"2024-03-04T09:13:16.635978+0000","last_clean":"2024-03-04T09:13:16.635978+0000","last_became_active":"2024-03-04T09:13:10.755405+0000","last_became_peered":"2024-03-04T09:13:10.755405+0000","last_unstale":"2024-03-04T09:13:16.635978+0000","last_undegraded":"2024-03-04T09:13:16.635978+0000","last_fullsized":"2024-03-04T09:13:16.635978+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:13:47.425603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547659+0000","last_change":"2024-03-04T09:13:14.803737+0000","last_active":"2024-03-04T09:13:16.547659+0000","last_peered":"2024-03-04T09:13:16.547659+0000","last_clean":"2024-03-04T09:13:16.547659+0000","last_became_active":"2024-03-04T09:13:14.803261+0000","last_became_peered":"2024-03-04T09:13:14.803261+0000","last_unstale":"2024-03-04T09:13:16.547659+0000","last_undegraded":"2024-03-04T09:13:16.547659+0000","last_fullsized":"2024-03-04T09:13:16.547659+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:41:03.717797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"90'7","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:36.378067+0000","last_change":"2024-03-04T09:13:09.732193+0000","last_active":"2024-03-04T09:13:36.378067+0000","last_peered":"2024-03-04T09:13:36.378067+0000","last_clean":"2024-03-04T09:13:36.378067+0000","last_became_active":"2024-03-04T09:13:09.731791+0000","last_became_peered":"2024-03-04T09:13:09.731791+0000","last_unstale":"2024-03-04T09:13:36.378067+0000","last_undegraded":"2024-03-04T09:13:36.378067+0000","last_fullsized":"2024-03-04T09:13:36.378067+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:29.685931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.784955+0000","last_change":"2024-03-04T09:13:10.771291+0000","last_active":"2024-03-04T09:13:15.784955+0000","last_peered":"2024-03-04T09:13:15.784955+0000","last_clean":"2024-03-04T09:13:15.784955+0000","last_became_active":"2024-03-04T09:13:10.770978+0000","last_became_peered":"2024-03-04T09:13:10.770978+0000","last_unstale":"2024-03-04T09:13:15.784955+0000","last_undegraded":"2024-03-04T09:13:15.784955+0000","last_fullsized":"2024-03-04T09:13:15.784955+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:21:54.121918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.548579+0000","last_change":"2024-03-04T09:13:14.806788+0000","last_active":"2024-03-04T09:13:16.548579+0000","last_peered":"2024-03-04T09:13:16.548579+0000","last_clean":"2024-03-04T09:13:16.548579+0000","last_became_active":"2024-03-04T09:13:14.806379+0000","last_became_peered":"2024-03-04T09:13:14.806379+0000","last_unstale":"2024-03-04T09:13:16.548579+0000","last_undegraded":"2024-03-04T09:13:16.548579+0000","last_fullsized":"2024-03-04T09:13:16.548579+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:27:42.780954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"90'2","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:35.369159+0000","last_change":"2024-03-04T09:13:09.736299+0000","last_active":"2024-03-04T09:13:35.369159+0000","last_peered":"2024-03-04T09:13:35.369159+0000","last_clean":"2024-03-04T09:13:35.369159+0000","last_became_active":"2024-03-04T09:13:09.735917+0000","last_became_peered":"2024-03-04T09:13:09.735917+0000","last_unstale":"2024-03-04T09:13:35.369159+0000","last_undegraded":"2024-03-04T09:13:35.369159+0000","last_fullsized":"2024-03-04T09:13:35.369159+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:14:22.130089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.046293+0000","last_change":"2024-03-04T09:13:10.761135+0000","last_active":"2024-03-04T09:13:16.046293+0000","last_peered":"2024-03-04T09:13:16.046293+0000","last_clean":"2024-03-04T09:13:16.046293+0000","last_became_active":"2024-03-04T09:13:10.760819+0000","last_became_peered":"2024-03-04T09:13:10.760819+0000","last_unstale":"2024-03-04T09:13:16.046293+0000","last_undegraded":"2024-03-04T09:13:16.046293+0000","last_fullsized":"2024-03-04T09:13:16.046293+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:27:30.315659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547559+0000","last_change":"2024-03-04T09:13:14.799057+0000","last_active":"2024-03-04T09:13:16.547559+0000","last_peered":"2024-03-04T09:13:16.547559+0000","last_clean":"2024-03-04T09:13:16.547559+0000","last_became_active":"2024-03-04T09:13:14.798670+0000","last_became_peered":"2024-03-04T09:13:14.798670+0000","last_unstale":"2024-03-04T09:13:16.547559+0000","last_undegraded":"2024-03-04T09:13:16.547559+0000","last_fullsized":"2024-03-04T09:13:16.547559+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:16:01.777432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"90'1","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.784591+0000","last_change":"2024-03-04T09:13:09.744045+0000","last_active":"2024-03-04T09:13:15.784591+0000","last_peered":"2024-03-04T09:13:15.784591+0000","last_clean":"2024-03-04T09:13:15.784591+0000","last_became_active":"2024-03-04T09:13:09.741411+0000","last_became_peered":"2024-03-04T09:13:09.741411+0000","last_unstale":"2024-03-04T09:13:15.784591+0000","last_undegraded":"2024-03-04T09:13:15.784591+0000","last_fullsized":"2024-03-04T09:13:15.784591+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:44:22.647120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.548090+0000","last_change":"2024-03-04T09:13:10.762598+0000","last_active":"2024-03-04T09:13:16.548090+0000","last_peered":"2024-03-04T09:13:16.548090+0000","last_clean":"2024-03-04T09:13:16.548090+0000","last_became_active":"2024-03-04T09:13:10.762252+0000","last_became_peered":"2024-03-04T09:13:10.762252+0000","last_unstale":"2024-03-04T09:13:16.548090+0000","last_undegraded":"2024-03-04T09:13:16.548090+0000","last_fullsized":"2024-03-04T09:13:16.548090+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:17:02.924550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.046478+0000","last_change":"2024-03-04T09:13:14.805423+0000","last_active":"2024-03-04T09:13:16.046478+0000","last_peered":"2024-03-04T09:13:16.046478+0000","last_clean":"2024-03-04T09:13:16.046478+0000","last_became_active":"2024-03-04T09:13:14.805047+0000","last_became_peered":"2024-03-04T09:13:14.805047+0000","last_unstale":"2024-03-04T09:13:16.046478+0000","last_undegraded":"2024-03-04T09:13:16.046478+0000","last_fullsized":"2024-03-04T09:13:16.046478+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:51:51.804507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"90'4","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:38.025104+0000","last_change":"2024-03-04T09:13:09.736752+0000","last_active":"2024-03-04T09:13:38.025104+0000","last_peered":"2024-03-04T09:13:38.025104+0000","last_clean":"2024-03-04T09:13:38.025104+0000","last_became_active":"2024-03-04T09:13:09.736477+0000","last_became_peered":"2024-03-04T09:13:09.736477+0000","last_unstale":"2024-03-04T09:13:38.025104+0000","last_undegraded":"2024-03-04T09:13:38.025104+0000","last_fullsized":"2024-03-04T09:13:38.025104+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:37:11.270022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.782717+0000","last_change":"2024-03-04T09:13:10.751255+0000","last_active":"2024-03-04T09:13:15.782717+0000","last_peered":"2024-03-04T09:13:15.782717+0000","last_clean":"2024-03-04T09:13:15.782717+0000","last_became_active":"2024-03-04T09:13:10.750891+0000","last_became_peered":"2024-03-04T09:13:10.750891+0000","last_unstale":"2024-03-04T09:13:15.782717+0000","last_undegraded":"2024-03-04T09:13:15.782717+0000","last_fullsized":"2024-03-04T09:13:15.782717+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:29:08.212529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547456+0000","last_change":"2024-03-04T09:13:14.804943+0000","last_active":"2024-03-04T09:13:16.547456+0000","last_peered":"2024-03-04T09:13:16.547456+0000","last_clean":"2024-03-04T09:13:16.547456+0000","last_became_active":"2024-03-04T09:13:14.804528+0000","last_became_peered":"2024-03-04T09:13:14.804528+0000","last_unstale":"2024-03-04T09:13:16.547456+0000","last_undegraded":"2024-03-04T09:13:16.547456+0000","last_fullsized":"2024-03-04T09:13:16.547456+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:23:48.071448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"90'2","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:34.358555+0000","last_change":"2024-03-04T09:13:09.739765+0000","last_active":"2024-03-04T09:13:34.358555+0000","last_peered":"2024-03-04T09:13:34.358555+0000","last_clean":"2024-03-04T09:13:34.358555+0000","last_became_active":"2024-03-04T09:13:09.739163+0000","last_became_peered":"2024-03-04T09:13:09.739163+0000","last_unstale":"2024-03-04T09:13:34.358555+0000","last_undegraded":"2024-03-04T09:13:34.358555+0000","last_fullsized":"2024-03-04T09:13:34.358555+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:30:15.561241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547565+0000","last_change":"2024-03-04T09:13:10.770051+0000","last_active":"2024-03-04T09:13:16.547565+0000","last_peered":"2024-03-04T09:13:16.547565+0000","last_clean":"2024-03-04T09:13:16.547565+0000","last_became_active":"2024-03-04T09:13:10.769709+0000","last_became_peered":"2024-03-04T09:13:10.769709+0000","last_unstale":"2024-03-04T09:13:16.547565+0000","last_undegraded":"2024-03-04T09:13:16.547565+0000","last_fullsized":"2024-03-04T09:13:16.547565+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:42:36.328095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547990+0000","last_change":"2024-03-04T09:13:14.804997+0000","last_active":"2024-03-04T09:13:16.547990+0000","last_peered":"2024-03-04T09:13:16.547990+0000","last_clean":"2024-03-04T09:13:16.547990+0000","last_became_active":"2024-03-04T09:13:14.804631+0000","last_became_peered":"2024-03-04T09:13:14.804631+0000","last_unstale":"2024-03-04T09:13:16.547990+0000","last_undegraded":"2024-03-04T09:13:16.547990+0000","last_fullsized":"2024-03-04T09:13:16.547990+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:15:18.843528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"90'4","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.785176+0000","last_change":"2024-03-04T09:13:09.743900+0000","last_active":"2024-03-04T09:13:15.785176+0000","last_peered":"2024-03-04T09:13:15.785176+0000","last_clean":"2024-03-04T09:13:15.785176+0000","last_became_active":"2024-03-04T09:13:09.743591+0000","last_became_peered":"2024-03-04T09:13:09.743591+0000","last_unstale":"2024-03-04T09:13:15.785176+0000","last_undegraded":"2024-03-04T09:13:15.785176+0000","last_fullsized":"2024-03-04T09:13:15.785176+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:47:31.365014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.782476+0000","last_change":"2024-03-04T09:13:10.754163+0000","last_active":"2024-03-04T09:13:15.782476+0000","last_peered":"2024-03-04T09:13:15.782476+0000","last_clean":"2024-03-04T09:13:15.782476+0000","last_became_active":"2024-03-04T09:13:10.753814+0000","last_became_peered":"2024-03-04T09:13:10.753814+0000","last_unstale":"2024-03-04T09:13:15.782476+0000","last_undegraded":"2024-03-04T09:13:15.782476+0000","last_fullsized":"2024-03-04T09:13:15.782476+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:44:31.771205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.548114+0000","last_change":"2024-03-04T09:13:14.803145+0000","last_active":"2024-03-04T09:13:16.548114+0000","last_peered":"2024-03-04T09:13:16.548114+0000","last_clean":"2024-03-04T09:13:16.548114+0000","last_became_active":"2024-03-04T09:13:14.802695+0000","last_became_peered":"2024-03-04T09:13:14.802695+0000","last_unstale":"2024-03-04T09:13:16.548114+0000","last_undegraded":"2024-03-04T09:13:16.548114+0000","last_fullsized":"2024-03-04T09:13:16.548114+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:43:46.854564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"90'25","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:38.026674+0000","last_change":"2024-03-04T09:13:09.735138+0000","last_active":"2024-03-04T09:13:38.026674+0000","last_peered":"2024-03-04T09:13:38.026674+0000","last_clean":"2024-03-04T09:13:38.026674+0000","last_became_active":"2024-03-04T09:13:09.734566+0000","last_became_peered":"2024-03-04T09:13:09.734566+0000","last_unstale":"2024-03-04T09:13:38.026674+0000","last_undegraded":"2024-03-04T09:13:38.026674+0000","last_fullsized":"2024-03-04T09:13:38.026674+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:37:42.446392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40471,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":41,"num_write":27,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.635992+0000","last_change":"2024-03-04T09:13:10.754584+0000","last_active":"2024-03-04T09:13:16.635992+0000","last_peered":"2024-03-04T09:13:16.635992+0000","last_clean":"2024-03-04T09:13:16.635992+0000","last_became_active":"2024-03-04T09:13:10.754270+0000","last_became_peered":"2024-03-04T09:13:10.754270+0000","last_unstale":"2024-03-04T09:13:16.635992+0000","last_undegraded":"2024-03-04T09:13:16.635992+0000","last_fullsized":"2024-03-04T09:13:16.635992+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:22:26.480337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.785479+0000","last_change":"2024-03-04T09:13:14.797302+0000","last_active":"2024-03-04T09:13:15.785479+0000","last_peered":"2024-03-04T09:13:15.785479+0000","last_clean":"2024-03-04T09:13:15.785479+0000","last_became_active":"2024-03-04T09:13:14.796549+0000","last_became_peered":"2024-03-04T09:13:14.796549+0000","last_unstale":"2024-03-04T09:13:15.785479+0000","last_undegraded":"2024-03-04T09:13:15.785479+0000","last_fullsized":"2024-03-04T09:13:15.785479+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:28:09.499393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"90'6","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:35.366648+0000","last_change":"2024-03-04T09:13:09.737567+0000","last_active":"2024-03-04T09:13:35.366648+0000","last_peered":"2024-03-04T09:13:35.366648+0000","last_clean":"2024-03-04T09:13:35.366648+0000","last_became_active":"2024-03-04T09:13:09.735154+0000","last_became_peered":"2024-03-04T09:13:09.735154+0000","last_unstale":"2024-03-04T09:13:35.366648+0000","last_undegraded":"2024-03-04T09:13:35.366648+0000","last_fullsized":"2024-03-04T09:13:35.366648+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:04:49.719107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.784354+0000","last_change":"2024-03-04T09:13:10.751959+0000","last_active":"2024-03-04T09:13:15.784354+0000","last_peered":"2024-03-04T09:13:15.784354+0000","last_clean":"2024-03-04T09:13:15.784354+0000","last_became_active":"2024-03-04T09:13:10.751638+0000","last_became_peered":"2024-03-04T09:13:10.751638+0000","last_unstale":"2024-03-04T09:13:15.784354+0000","last_undegraded":"2024-03-04T09:13:15.784354+0000","last_fullsized":"2024-03-04T09:13:15.784354+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:52:52.005226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.548292+0000","last_change":"2024-03-04T09:13:14.803490+0000","last_active":"2024-03-04T09:13:16.548292+0000","last_peered":"2024-03-04T09:13:16.548292+0000","last_clean":"2024-03-04T09:13:16.548292+0000","last_became_active":"2024-03-04T09:13:14.803046+0000","last_became_peered":"2024-03-04T09:13:14.803046+0000","last_unstale":"2024-03-04T09:13:16.548292+0000","last_undegraded":"2024-03-04T09:13:16.548292+0000","last_fullsized":"2024-03-04T09:13:16.548292+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:54:48.170806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"90'3","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:34.361655+0000","last_change":"2024-03-04T09:13:09.744437+0000","last_active":"2024-03-04T09:13:34.361655+0000","last_peered":"2024-03-04T09:13:34.361655+0000","last_clean":"2024-03-04T09:13:34.361655+0000","last_became_active":"2024-03-04T09:13:09.743112+0000","last_became_peered":"2024-03-04T09:13:09.743112+0000","last_unstale":"2024-03-04T09:13:34.361655+0000","last_undegraded":"2024-03-04T09:13:34.361655+0000","last_fullsized":"2024-03-04T09:13:34.361655+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:12:16.431869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547754+0000","last_change":"2024-03-04T09:13:10.770817+0000","last_active":"2024-03-04T09:13:16.547754+0000","last_peered":"2024-03-04T09:13:16.547754+0000","last_clean":"2024-03-04T09:13:16.547754+0000","last_became_active":"2024-03-04T09:13:10.770340+0000","last_became_peered":"2024-03-04T09:13:10.770340+0000","last_unstale":"2024-03-04T09:13:16.547754+0000","last_undegraded":"2024-03-04T09:13:16.547754+0000","last_fullsized":"2024-03-04T09:13:16.547754+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:00:53.050111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547596+0000","last_change":"2024-03-04T09:13:14.805982+0000","last_active":"2024-03-04T09:13:16.547596+0000","last_peered":"2024-03-04T09:13:16.547596+0000","last_clean":"2024-03-04T09:13:16.547596+0000","last_became_active":"2024-03-04T09:13:14.805280+0000","last_became_peered":"2024-03-04T09:13:14.805280+0000","last_unstale":"2024-03-04T09:13:16.547596+0000","last_undegraded":"2024-03-04T09:13:16.547596+0000","last_fullsized":"2024-03-04T09:13:16.547596+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:39:23.058890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"90'3","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:35.366438+0000","last_change":"2024-03-04T09:13:09.736144+0000","last_active":"2024-03-04T09:13:35.366438+0000","last_peered":"2024-03-04T09:13:35.366438+0000","last_clean":"2024-03-04T09:13:35.366438+0000","last_became_active":"2024-03-04T09:13:09.735802+0000","last_became_peered":"2024-03-04T09:13:09.735802+0000","last_unstale":"2024-03-04T09:13:35.366438+0000","last_undegraded":"2024-03-04T09:13:35.366438+0000","last_fullsized":"2024-03-04T09:13:35.366438+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:01.935616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547509+0000","last_change":"2024-03-04T09:13:10.754813+0000","last_active":"2024-03-04T09:13:16.547509+0000","last_peered":"2024-03-04T09:13:16.547509+0000","last_clean":"2024-03-04T09:13:16.547509+0000","last_became_active":"2024-03-04T09:13:10.754429+0000","last_became_peered":"2024-03-04T09:13:10.754429+0000","last_unstale":"2024-03-04T09:13:16.547509+0000","last_undegraded":"2024-03-04T09:13:16.547509+0000","last_fullsized":"2024-03-04T09:13:16.547509+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:06:57.885434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.784825+0000","last_change":"2024-03-04T09:13:14.808464+0000","last_active":"2024-03-04T09:13:15.784825+0000","last_peered":"2024-03-04T09:13:15.784825+0000","last_clean":"2024-03-04T09:13:15.784825+0000","last_became_active":"2024-03-04T09:13:14.807967+0000","last_became_peered":"2024-03-04T09:13:14.807967+0000","last_unstale":"2024-03-04T09:13:15.784825+0000","last_undegraded":"2024-03-04T09:13:15.784825+0000","last_fullsized":"2024-03-04T09:13:15.784825+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:05:00.961999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"90'15","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:35.369127+0000","last_change":"2024-03-04T09:13:09.739149+0000","last_active":"2024-03-04T09:13:35.369127+0000","last_peered":"2024-03-04T09:13:35.369127+0000","last_clean":"2024-03-04T09:13:35.369127+0000","last_became_active":"2024-03-04T09:13:09.738823+0000","last_became_peered":"2024-03-04T09:13:09.738823+0000","last_unstale":"2024-03-04T09:13:35.369127+0000","last_undegraded":"2024-03-04T09:13:35.369127+0000","last_fullsized":"2024-03-04T09:13:35.369127+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:33:09.987846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.784683+0000","last_change":"2024-03-04T09:13:10.770355+0000","last_active":"2024-03-04T09:13:15.784683+0000","last_peered":"2024-03-04T09:13:15.784683+0000","last_clean":"2024-03-04T09:13:15.784683+0000","last_became_active":"2024-03-04T09:13:10.770037+0000","last_became_peered":"2024-03-04T09:13:10.770037+0000","last_unstale":"2024-03-04T09:13:15.784683+0000","last_undegraded":"2024-03-04T09:13:15.784683+0000","last_fullsized":"2024-03-04T09:13:15.784683+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:28:59.392418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.784792+0000","last_change":"2024-03-04T09:13:14.797382+0000","last_active":"2024-03-04T09:13:15.784792+0000","last_peered":"2024-03-04T09:13:15.784792+0000","last_clean":"2024-03-04T09:13:15.784792+0000","last_became_active":"2024-03-04T09:13:14.795839+0000","last_became_peered":"2024-03-04T09:13:14.795839+0000","last_unstale":"2024-03-04T09:13:15.784792+0000","last_undegraded":"2024-03-04T09:13:15.784792+0000","last_fullsized":"2024-03-04T09:13:15.784792+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:30.992018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'1","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.636147+0000","last_change":"2024-03-04T09:13:09.740678+0000","last_active":"2024-03-04T09:13:16.636147+0000","last_peered":"2024-03-04T09:13:16.636147+0000","last_clean":"2024-03-04T09:13:16.636147+0000","last_became_active":"2024-03-04T09:13:09.740371+0000","last_became_peered":"2024-03-04T09:13:09.740371+0000","last_unstale":"2024-03-04T09:13:16.636147+0000","last_undegraded":"2024-03-04T09:13:16.636147+0000","last_fullsized":"2024-03-04T09:13:16.636147+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:08:05.098610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.548263+0000","last_change":"2024-03-04T09:13:10.769034+0000","last_active":"2024-03-04T09:13:16.548263+0000","last_peered":"2024-03-04T09:13:16.548263+0000","last_clean":"2024-03-04T09:13:16.548263+0000","last_became_active":"2024-03-04T09:13:10.768700+0000","last_became_peered":"2024-03-04T09:13:10.768700+0000","last_unstale":"2024-03-04T09:13:16.548263+0000","last_undegraded":"2024-03-04T09:13:16.548263+0000","last_fullsized":"2024-03-04T09:13:16.548263+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:34:56.367097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.635926+0000","last_change":"2024-03-04T09:13:14.827541+0000","last_active":"2024-03-04T09:13:16.635926+0000","last_peered":"2024-03-04T09:13:16.635926+0000","last_clean":"2024-03-04T09:13:16.635926+0000","last_became_active":"2024-03-04T09:13:14.827122+0000","last_became_peered":"2024-03-04T09:13:14.827122+0000","last_unstale":"2024-03-04T09:13:16.635926+0000","last_undegraded":"2024-03-04T09:13:16.635926+0000","last_fullsized":"2024-03-04T09:13:16.635926+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:29:09.680052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"90'1","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547657+0000","last_change":"2024-03-04T09:13:09.739307+0000","last_active":"2024-03-04T09:13:16.547657+0000","last_peered":"2024-03-04T09:13:16.547657+0000","last_clean":"2024-03-04T09:13:16.547657+0000","last_became_active":"2024-03-04T09:13:09.739014+0000","last_became_peered":"2024-03-04T09:13:09.739014+0000","last_unstale":"2024-03-04T09:13:16.547657+0000","last_undegraded":"2024-03-04T09:13:16.547657+0000","last_fullsized":"2024-03-04T09:13:16.547657+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:19.128412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.548944+0000","last_change":"2024-03-04T09:13:10.761224+0000","last_active":"2024-03-04T09:13:16.548944+0000","last_peered":"2024-03-04T09:13:16.548944+0000","last_clean":"2024-03-04T09:13:16.548944+0000","last_became_active":"2024-03-04T09:13:10.760861+0000","last_became_peered":"2024-03-04T09:13:10.760861+0000","last_unstale":"2024-03-04T09:13:16.548944+0000","last_undegraded":"2024-03-04T09:13:16.548944+0000","last_fullsized":"2024-03-04T09:13:16.548944+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:58:56.666386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.784819+0000","last_change":"2024-03-04T09:13:14.796490+0000","last_active":"2024-03-04T09:13:15.784819+0000","last_peered":"2024-03-04T09:13:15.784819+0000","last_clean":"2024-03-04T09:13:15.784819+0000","last_became_active":"2024-03-04T09:13:14.796103+0000","last_became_peered":"2024-03-04T09:13:14.796103+0000","last_unstale":"2024-03-04T09:13:15.784819+0000","last_undegraded":"2024-03-04T09:13:15.784819+0000","last_fullsized":"2024-03-04T09:13:15.784819+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:34:05.983201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"90'1","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547617+0000","last_change":"2024-03-04T09:13:09.739500+0000","last_active":"2024-03-04T09:13:16.547617+0000","last_peered":"2024-03-04T09:13:16.547617+0000","last_clean":"2024-03-04T09:13:16.547617+0000","last_became_active":"2024-03-04T09:13:09.739156+0000","last_became_peered":"2024-03-04T09:13:09.739156+0000","last_unstale":"2024-03-04T09:13:16.547617+0000","last_undegraded":"2024-03-04T09:13:16.547617+0000","last_fullsized":"2024-03-04T09:13:16.547617+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:07:05.319066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.548566+0000","last_change":"2024-03-04T09:13:10.762237+0000","last_active":"2024-03-04T09:13:16.548566+0000","last_peered":"2024-03-04T09:13:16.548566+0000","last_clean":"2024-03-04T09:13:16.548566+0000","last_became_active":"2024-03-04T09:13:10.761914+0000","last_became_peered":"2024-03-04T09:13:10.761914+0000","last_unstale":"2024-03-04T09:13:16.548566+0000","last_undegraded":"2024-03-04T09:13:16.548566+0000","last_fullsized":"2024-03-04T09:13:16.548566+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:25:49.156700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.784795+0000","last_change":"2024-03-04T09:13:14.827814+0000","last_active":"2024-03-04T09:13:15.784795+0000","last_peered":"2024-03-04T09:13:15.784795+0000","last_clean":"2024-03-04T09:13:15.784795+0000","last_became_active":"2024-03-04T09:13:14.827411+0000","last_became_peered":"2024-03-04T09:13:14.827411+0000","last_unstale":"2024-03-04T09:13:15.784795+0000","last_undegraded":"2024-03-04T09:13:15.784795+0000","last_fullsized":"2024-03-04T09:13:15.784795+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:23:32.702066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.784794+0000","last_change":"2024-03-04T09:13:10.773292+0000","last_active":"2024-03-04T09:13:15.784794+0000","last_peered":"2024-03-04T09:13:15.784794+0000","last_clean":"2024-03-04T09:13:15.784794+0000","last_became_active":"2024-03-04T09:13:10.772921+0000","last_became_peered":"2024-03-04T09:13:10.772921+0000","last_unstale":"2024-03-04T09:13:15.784794+0000","last_undegraded":"2024-03-04T09:13:15.784794+0000","last_fullsized":"2024-03-04T09:13:15.784794+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:24:41.988400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'4","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:35.368823+0000","last_change":"2024-03-04T09:13:09.727219+0000","last_active":"2024-03-04T09:13:35.368823+0000","last_peered":"2024-03-04T09:13:35.368823+0000","last_clean":"2024-03-04T09:13:35.368823+0000","last_became_active":"2024-03-04T09:13:09.726892+0000","last_became_peered":"2024-03-04T09:13:09.726892+0000","last_unstale":"2024-03-04T09:13:35.368823+0000","last_undegraded":"2024-03-04T09:13:35.368823+0000","last_fullsized":"2024-03-04T09:13:35.368823+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:42:58.059866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547769+0000","last_change":"2024-03-04T09:13:14.804709+0000","last_active":"2024-03-04T09:13:16.547769+0000","last_peered":"2024-03-04T09:13:16.547769+0000","last_clean":"2024-03-04T09:13:16.547769+0000","last_became_active":"2024-03-04T09:13:14.804264+0000","last_became_peered":"2024-03-04T09:13:14.804264+0000","last_unstale":"2024-03-04T09:13:16.547769+0000","last_undegraded":"2024-03-04T09:13:16.547769+0000","last_fullsized":"2024-03-04T09:13:16.547769+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:32:57.714237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.046354+0000","last_change":"2024-03-04T09:13:10.765801+0000","last_active":"2024-03-04T09:13:16.046354+0000","last_peered":"2024-03-04T09:13:16.046354+0000","last_clean":"2024-03-04T09:13:16.046354+0000","last_became_active":"2024-03-04T09:13:10.765398+0000","last_became_peered":"2024-03-04T09:13:10.765398+0000","last_unstale":"2024-03-04T09:13:16.046354+0000","last_undegraded":"2024-03-04T09:13:16.046354+0000","last_fullsized":"2024-03-04T09:13:16.046354+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:54:54.750418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"90'3","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:34.362135+0000","last_change":"2024-03-04T09:13:09.729854+0000","last_active":"2024-03-04T09:13:34.362135+0000","last_peered":"2024-03-04T09:13:34.362135+0000","last_clean":"2024-03-04T09:13:34.362135+0000","last_became_active":"2024-03-04T09:13:09.729512+0000","last_became_peered":"2024-03-04T09:13:09.729512+0000","last_unstale":"2024-03-04T09:13:34.362135+0000","last_undegraded":"2024-03-04T09:13:34.362135+0000","last_fullsized":"2024-03-04T09:13:34.362135+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:24:38.237311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":358,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547370+0000","last_change":"2024-03-04T09:12:00.982045+0000","last_active":"2024-03-04T09:13:16.547370+0000","last_peered":"2024-03-04T09:13:16.547370+0000","last_clean":"2024-03-04T09:13:16.547370+0000","last_became_active":"2024-03-04T09:12:00.981545+0000","last_became_peered":"2024-03-04T09:12:00.981545+0000","last_unstale":"2024-03-04T09:13:16.547370+0000","last_undegraded":"2024-03-04T09:13:16.547370+0000","last_fullsized":"2024-03-04T09:13:16.547370+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:08:36.622880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:08:36.622880+0000","last_clean_scrub_stamp":"2024-03-04T09:08:36.622880+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:44:16.595802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.785193+0000","last_change":"2024-03-04T09:13:14.828364+0000","last_active":"2024-03-04T09:13:15.785193+0000","last_peered":"2024-03-04T09:13:15.785193+0000","last_clean":"2024-03-04T09:13:15.785193+0000","last_became_active":"2024-03-04T09:13:14.827928+0000","last_became_peered":"2024-03-04T09:13:14.827928+0000","last_unstale":"2024-03-04T09:13:15.785193+0000","last_undegraded":"2024-03-04T09:13:15.785193+0000","last_fullsized":"2024-03-04T09:13:15.785193+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:24.071431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.784020+0000","last_change":"2024-03-04T09:13:10.761282+0000","last_active":"2024-03-04T09:13:15.784020+0000","last_peered":"2024-03-04T09:13:15.784020+0000","last_clean":"2024-03-04T09:13:15.784020+0000","last_became_active":"2024-03-04T09:13:10.753614+0000","last_became_peered":"2024-03-04T09:13:10.753614+0000","last_unstale":"2024-03-04T09:13:15.784020+0000","last_undegraded":"2024-03-04T09:13:15.784020+0000","last_fullsized":"2024-03-04T09:13:15.784020+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:00.471478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'3","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:35.366798+0000","last_change":"2024-03-04T09:13:09.739744+0000","last_active":"2024-03-04T09:13:35.366798+0000","last_peered":"2024-03-04T09:13:35.366798+0000","last_clean":"2024-03-04T09:13:35.366798+0000","last_became_active":"2024-03-04T09:13:09.739403+0000","last_became_peered":"2024-03-04T09:13:09.739403+0000","last_unstale":"2024-03-04T09:13:35.366798+0000","last_undegraded":"2024-03-04T09:13:35.366798+0000","last_fullsized":"2024-03-04T09:13:35.366798+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:51:57.056021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547670+0000","last_change":"2024-03-04T09:13:14.797232+0000","last_active":"2024-03-04T09:13:16.547670+0000","last_peered":"2024-03-04T09:13:16.547670+0000","last_clean":"2024-03-04T09:13:16.547670+0000","last_became_active":"2024-03-04T09:13:14.796827+0000","last_became_peered":"2024-03-04T09:13:14.796827+0000","last_unstale":"2024-03-04T09:13:16.547670+0000","last_undegraded":"2024-03-04T09:13:16.547670+0000","last_fullsized":"2024-03-04T09:13:16.547670+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:35:41.206987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"90'1","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.636132+0000","last_change":"2024-03-04T09:13:09.741257+0000","last_active":"2024-03-04T09:13:16.636132+0000","last_peered":"2024-03-04T09:13:16.636132+0000","last_clean":"2024-03-04T09:13:16.636132+0000","last_became_active":"2024-03-04T09:13:09.740559+0000","last_became_peered":"2024-03-04T09:13:09.740559+0000","last_unstale":"2024-03-04T09:13:16.636132+0000","last_undegraded":"2024-03-04T09:13:16.636132+0000","last_fullsized":"2024-03-04T09:13:16.636132+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:39:50.969427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.784661+0000","last_change":"2024-03-04T09:13:10.749685+0000","last_active":"2024-03-04T09:13:15.784661+0000","last_peered":"2024-03-04T09:13:15.784661+0000","last_clean":"2024-03-04T09:13:15.784661+0000","last_became_active":"2024-03-04T09:13:10.749297+0000","last_became_peered":"2024-03-04T09:13:10.749297+0000","last_unstale":"2024-03-04T09:13:15.784661+0000","last_undegraded":"2024-03-04T09:13:15.784661+0000","last_fullsized":"2024-03-04T09:13:15.784661+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:28:17.001946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.046386+0000","last_change":"2024-03-04T09:13:14.827798+0000","last_active":"2024-03-04T09:13:16.046386+0000","last_peered":"2024-03-04T09:13:16.046386+0000","last_clean":"2024-03-04T09:13:16.046386+0000","last_became_active":"2024-03-04T09:13:14.827373+0000","last_became_peered":"2024-03-04T09:13:14.827373+0000","last_unstale":"2024-03-04T09:13:16.046386+0000","last_undegraded":"2024-03-04T09:13:16.046386+0000","last_fullsized":"2024-03-04T09:13:16.046386+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:54:45.560594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'8","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:36.378430+0000","last_change":"2024-03-04T09:13:09.732734+0000","last_active":"2024-03-04T09:13:36.378430+0000","last_peered":"2024-03-04T09:13:36.378430+0000","last_clean":"2024-03-04T09:13:36.378430+0000","last_became_active":"2024-03-04T09:13:09.732418+0000","last_became_peered":"2024-03-04T09:13:09.732418+0000","last_unstale":"2024-03-04T09:13:36.378430+0000","last_undegraded":"2024-03-04T09:13:36.378430+0000","last_fullsized":"2024-03-04T09:13:36.378430+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:58.199821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.046813+0000","last_change":"2024-03-04T09:13:10.759721+0000","last_active":"2024-03-04T09:13:16.046813+0000","last_peered":"2024-03-04T09:13:16.046813+0000","last_clean":"2024-03-04T09:13:16.046813+0000","last_became_active":"2024-03-04T09:13:10.759388+0000","last_became_peered":"2024-03-04T09:13:10.759388+0000","last_unstale":"2024-03-04T09:13:16.046813+0000","last_undegraded":"2024-03-04T09:13:16.046813+0000","last_fullsized":"2024-03-04T09:13:16.046813+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:23:41.865335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547856+0000","last_change":"2024-03-04T09:13:14.788273+0000","last_active":"2024-03-04T09:13:16.547856+0000","last_peered":"2024-03-04T09:13:16.547856+0000","last_clean":"2024-03-04T09:13:16.547856+0000","last_became_active":"2024-03-04T09:13:14.787763+0000","last_became_peered":"2024-03-04T09:13:14.787763+0000","last_unstale":"2024-03-04T09:13:16.547856+0000","last_undegraded":"2024-03-04T09:13:16.547856+0000","last_fullsized":"2024-03-04T09:13:16.547856+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:29:48.247984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"90'4","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:34.361655+0000","last_change":"2024-03-04T09:13:09.745168+0000","last_active":"2024-03-04T09:13:34.361655+0000","last_peered":"2024-03-04T09:13:34.361655+0000","last_clean":"2024-03-04T09:13:34.361655+0000","last_became_active":"2024-03-04T09:13:09.744789+0000","last_became_peered":"2024-03-04T09:13:09.744789+0000","last_unstale":"2024-03-04T09:13:34.361655+0000","last_undegraded":"2024-03-04T09:13:34.361655+0000","last_fullsized":"2024-03-04T09:13:34.361655+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:22:16.428422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547677+0000","last_change":"2024-03-04T09:13:10.770697+0000","last_active":"2024-03-04T09:13:16.547677+0000","last_peered":"2024-03-04T09:13:16.547677+0000","last_clean":"2024-03-04T09:13:16.547677+0000","last_became_active":"2024-03-04T09:13:10.770301+0000","last_became_peered":"2024-03-04T09:13:10.770301+0000","last_unstale":"2024-03-04T09:13:16.547677+0000","last_undegraded":"2024-03-04T09:13:16.547677+0000","last_fullsized":"2024-03-04T09:13:16.547677+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:29:27.520833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547428+0000","last_change":"2024-03-04T09:13:14.828103+0000","last_active":"2024-03-04T09:13:16.547428+0000","last_peered":"2024-03-04T09:13:16.547428+0000","last_clean":"2024-03-04T09:13:16.547428+0000","last_became_active":"2024-03-04T09:13:14.827699+0000","last_became_peered":"2024-03-04T09:13:14.827699+0000","last_unstale":"2024-03-04T09:13:16.547428+0000","last_undegraded":"2024-03-04T09:13:16.547428+0000","last_fullsized":"2024-03-04T09:13:16.547428+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:44:24.215654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:34.358859+0000","last_change":"2024-03-04T09:13:09.737342+0000","last_active":"2024-03-04T09:13:34.358859+0000","last_peered":"2024-03-04T09:13:34.358859+0000","last_clean":"2024-03-04T09:13:34.358859+0000","last_became_active":"2024-03-04T09:13:09.736946+0000","last_became_peered":"2024-03-04T09:13:09.736946+0000","last_unstale":"2024-03-04T09:13:34.358859+0000","last_undegraded":"2024-03-04T09:13:34.358859+0000","last_fullsized":"2024-03-04T09:13:34.358859+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:40:07.419155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.635632+0000","last_change":"2024-03-04T09:13:10.753689+0000","last_active":"2024-03-04T09:13:16.635632+0000","last_peered":"2024-03-04T09:13:16.635632+0000","last_clean":"2024-03-04T09:13:16.635632+0000","last_became_active":"2024-03-04T09:13:10.753352+0000","last_became_peered":"2024-03-04T09:13:10.753352+0000","last_unstale":"2024-03-04T09:13:16.635632+0000","last_undegraded":"2024-03-04T09:13:16.635632+0000","last_fullsized":"2024-03-04T09:13:16.635632+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:57:05.782954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547779+0000","last_change":"2024-03-04T09:13:14.805639+0000","last_active":"2024-03-04T09:13:16.547779+0000","last_peered":"2024-03-04T09:13:16.547779+0000","last_clean":"2024-03-04T09:13:16.547779+0000","last_became_active":"2024-03-04T09:13:14.804764+0000","last_became_peered":"2024-03-04T09:13:14.804764+0000","last_unstale":"2024-03-04T09:13:16.547779+0000","last_undegraded":"2024-03-04T09:13:16.547779+0000","last_fullsized":"2024-03-04T09:13:16.547779+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:31:21.470900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"90'3","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:34.360147+0000","last_change":"2024-03-04T09:13:09.729510+0000","last_active":"2024-03-04T09:13:34.360147+0000","last_peered":"2024-03-04T09:13:34.360147+0000","last_clean":"2024-03-04T09:13:34.360147+0000","last_became_active":"2024-03-04T09:13:09.729100+0000","last_became_peered":"2024-03-04T09:13:09.729100+0000","last_unstale":"2024-03-04T09:13:34.360147+0000","last_undegraded":"2024-03-04T09:13:34.360147+0000","last_fullsized":"2024-03-04T09:13:34.360147+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:00:43.441594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547312+0000","last_change":"2024-03-04T09:13:10.757543+0000","last_active":"2024-03-04T09:13:16.547312+0000","last_peered":"2024-03-04T09:13:16.547312+0000","last_clean":"2024-03-04T09:13:16.547312+0000","last_became_active":"2024-03-04T09:13:10.757205+0000","last_became_peered":"2024-03-04T09:13:10.757205+0000","last_unstale":"2024-03-04T09:13:16.547312+0000","last_undegraded":"2024-03-04T09:13:16.547312+0000","last_fullsized":"2024-03-04T09:13:16.547312+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:49:02.521232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.548142+0000","last_change":"2024-03-04T09:13:14.807608+0000","last_active":"2024-03-04T09:13:16.548142+0000","last_peered":"2024-03-04T09:13:16.548142+0000","last_clean":"2024-03-04T09:13:16.548142+0000","last_became_active":"2024-03-04T09:13:14.807193+0000","last_became_peered":"2024-03-04T09:13:14.807193+0000","last_unstale":"2024-03-04T09:13:16.548142+0000","last_undegraded":"2024-03-04T09:13:16.548142+0000","last_fullsized":"2024-03-04T09:13:16.548142+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:48:33.129309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"90'1","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547634+0000","last_change":"2024-03-04T09:13:09.738539+0000","last_active":"2024-03-04T09:13:16.547634+0000","last_peered":"2024-03-04T09:13:16.547634+0000","last_clean":"2024-03-04T09:13:16.547634+0000","last_became_active":"2024-03-04T09:13:09.738230+0000","last_became_peered":"2024-03-04T09:13:09.738230+0000","last_unstale":"2024-03-04T09:13:16.547634+0000","last_undegraded":"2024-03-04T09:13:16.547634+0000","last_fullsized":"2024-03-04T09:13:16.547634+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:08:56.789510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.046661+0000","last_change":"2024-03-04T09:13:10.766038+0000","last_active":"2024-03-04T09:13:16.046661+0000","last_peered":"2024-03-04T09:13:16.046661+0000","last_clean":"2024-03-04T09:13:16.046661+0000","last_became_active":"2024-03-04T09:13:10.764725+0000","last_became_peered":"2024-03-04T09:13:10.764725+0000","last_unstale":"2024-03-04T09:13:16.046661+0000","last_undegraded":"2024-03-04T09:13:16.046661+0000","last_fullsized":"2024-03-04T09:13:16.046661+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:34:53.027948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.548095+0000","last_change":"2024-03-04T09:13:14.827989+0000","last_active":"2024-03-04T09:13:16.548095+0000","last_peered":"2024-03-04T09:13:16.548095+0000","last_clean":"2024-03-04T09:13:16.548095+0000","last_became_active":"2024-03-04T09:13:14.827601+0000","last_became_peered":"2024-03-04T09:13:14.827601+0000","last_unstale":"2024-03-04T09:13:16.548095+0000","last_undegraded":"2024-03-04T09:13:16.548095+0000","last_fullsized":"2024-03-04T09:13:16.548095+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:41:24.869293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"90'4","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:34.360683+0000","last_change":"2024-03-04T09:13:09.737211+0000","last_active":"2024-03-04T09:13:34.360683+0000","last_peered":"2024-03-04T09:13:34.360683+0000","last_clean":"2024-03-04T09:13:34.360683+0000","last_became_active":"2024-03-04T09:13:09.736899+0000","last_became_peered":"2024-03-04T09:13:09.736899+0000","last_unstale":"2024-03-04T09:13:34.360683+0000","last_undegraded":"2024-03-04T09:13:34.360683+0000","last_fullsized":"2024-03-04T09:13:34.360683+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:59:09.575710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547712+0000","last_change":"2024-03-04T09:13:10.750234+0000","last_active":"2024-03-04T09:13:16.547712+0000","last_peered":"2024-03-04T09:13:16.547712+0000","last_clean":"2024-03-04T09:13:16.547712+0000","last_became_active":"2024-03-04T09:13:10.749868+0000","last_became_peered":"2024-03-04T09:13:10.749868+0000","last_unstale":"2024-03-04T09:13:16.547712+0000","last_undegraded":"2024-03-04T09:13:16.547712+0000","last_fullsized":"2024-03-04T09:13:16.547712+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:14:58.229628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.782314+0000","last_change":"2024-03-04T09:13:14.797360+0000","last_active":"2024-03-04T09:13:15.782314+0000","last_peered":"2024-03-04T09:13:15.782314+0000","last_clean":"2024-03-04T09:13:15.782314+0000","last_became_active":"2024-03-04T09:13:14.796885+0000","last_became_peered":"2024-03-04T09:13:14.796885+0000","last_unstale":"2024-03-04T09:13:15.782314+0000","last_undegraded":"2024-03-04T09:13:15.782314+0000","last_fullsized":"2024-03-04T09:13:15.782314+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:03:36.498833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"90'3","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:35.367870+0000","last_change":"2024-03-04T09:13:09.745299+0000","last_active":"2024-03-04T09:13:35.367870+0000","last_peered":"2024-03-04T09:13:35.367870+0000","last_clean":"2024-03-04T09:13:35.367870+0000","last_became_active":"2024-03-04T09:13:09.745005+0000","last_became_peered":"2024-03-04T09:13:09.745005+0000","last_unstale":"2024-03-04T09:13:35.367870+0000","last_undegraded":"2024-03-04T09:13:35.367870+0000","last_fullsized":"2024-03-04T09:13:35.367870+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:01:49.052431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.548626+0000","last_change":"2024-03-04T09:13:10.764774+0000","last_active":"2024-03-04T09:13:16.548626+0000","last_peered":"2024-03-04T09:13:16.548626+0000","last_clean":"2024-03-04T09:13:16.548626+0000","last_became_active":"2024-03-04T09:13:10.764436+0000","last_became_peered":"2024-03-04T09:13:10.764436+0000","last_unstale":"2024-03-04T09:13:16.548626+0000","last_undegraded":"2024-03-04T09:13:16.548626+0000","last_fullsized":"2024-03-04T09:13:16.548626+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:34:46.343791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547081+0000","last_change":"2024-03-04T09:13:14.809998+0000","last_active":"2024-03-04T09:13:16.547081+0000","last_peered":"2024-03-04T09:13:16.547081+0000","last_clean":"2024-03-04T09:13:16.547081+0000","last_became_active":"2024-03-04T09:13:14.809528+0000","last_became_peered":"2024-03-04T09:13:14.809528+0000","last_unstale":"2024-03-04T09:13:16.547081+0000","last_undegraded":"2024-03-04T09:13:16.547081+0000","last_fullsized":"2024-03-04T09:13:16.547081+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:36:42.404172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"85'1","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.785269+0000","last_change":"2024-03-04T09:13:09.738112+0000","last_active":"2024-03-04T09:13:15.785269+0000","last_peered":"2024-03-04T09:13:15.785269+0000","last_clean":"2024-03-04T09:13:15.785269+0000","last_became_active":"2024-03-04T09:13:09.737798+0000","last_became_peered":"2024-03-04T09:13:09.737798+0000","last_unstale":"2024-03-04T09:13:15.785269+0000","last_undegraded":"2024-03-04T09:13:15.785269+0000","last_fullsized":"2024-03-04T09:13:15.785269+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:04:05.402017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547892+0000","last_change":"2024-03-04T09:13:10.759809+0000","last_active":"2024-03-04T09:13:16.547892+0000","last_peered":"2024-03-04T09:13:16.547892+0000","last_clean":"2024-03-04T09:13:16.547892+0000","last_became_active":"2024-03-04T09:13:10.759439+0000","last_became_peered":"2024-03-04T09:13:10.759439+0000","last_unstale":"2024-03-04T09:13:16.547892+0000","last_undegraded":"2024-03-04T09:13:16.547892+0000","last_fullsized":"2024-03-04T09:13:16.547892+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:15:54.173010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.784412+0000","last_change":"2024-03-04T09:13:14.793488+0000","last_active":"2024-03-04T09:13:15.784412+0000","last_peered":"2024-03-04T09:13:15.784412+0000","last_clean":"2024-03-04T09:13:15.784412+0000","last_became_active":"2024-03-04T09:13:14.792262+0000","last_became_peered":"2024-03-04T09:13:14.792262+0000","last_unstale":"2024-03-04T09:13:15.784412+0000","last_undegraded":"2024-03-04T09:13:15.784412+0000","last_fullsized":"2024-03-04T09:13:15.784412+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:53:00.294874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"85'2","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.784684+0000","last_change":"2024-03-04T09:13:09.729544+0000","last_active":"2024-03-04T09:13:15.784684+0000","last_peered":"2024-03-04T09:13:15.784684+0000","last_clean":"2024-03-04T09:13:15.784684+0000","last_became_active":"2024-03-04T09:13:09.729266+0000","last_became_peered":"2024-03-04T09:13:09.729266+0000","last_unstale":"2024-03-04T09:13:15.784684+0000","last_undegraded":"2024-03-04T09:13:15.784684+0000","last_fullsized":"2024-03-04T09:13:15.784684+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:27.492387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.548428+0000","last_change":"2024-03-04T09:13:10.761494+0000","last_active":"2024-03-04T09:13:16.548428+0000","last_peered":"2024-03-04T09:13:16.548428+0000","last_clean":"2024-03-04T09:13:16.548428+0000","last_became_active":"2024-03-04T09:13:10.760873+0000","last_became_peered":"2024-03-04T09:13:10.760873+0000","last_unstale":"2024-03-04T09:13:16.548428+0000","last_undegraded":"2024-03-04T09:13:16.548428+0000","last_fullsized":"2024-03-04T09:13:16.548428+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:07:25.001910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547387+0000","last_change":"2024-03-04T09:13:10.754079+0000","last_active":"2024-03-04T09:13:16.547387+0000","last_peered":"2024-03-04T09:13:16.547387+0000","last_clean":"2024-03-04T09:13:16.547387+0000","last_became_active":"2024-03-04T09:13:10.753691+0000","last_became_peered":"2024-03-04T09:13:10.753691+0000","last_unstale":"2024-03-04T09:13:16.547387+0000","last_undegraded":"2024-03-04T09:13:16.547387+0000","last_fullsized":"2024-03-04T09:13:16.547387+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:45:23.609172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.548250+0000","last_change":"2024-03-04T09:13:10.754556+0000","last_active":"2024-03-04T09:13:16.548250+0000","last_peered":"2024-03-04T09:13:16.548250+0000","last_clean":"2024-03-04T09:13:16.548250+0000","last_became_active":"2024-03-04T09:13:10.754224+0000","last_became_peered":"2024-03-04T09:13:10.754224+0000","last_unstale":"2024-03-04T09:13:16.548250+0000","last_undegraded":"2024-03-04T09:13:16.548250+0000","last_fullsized":"2024-03-04T09:13:16.548250+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:16:27.092418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547538+0000","last_change":"2024-03-04T09:13:10.753864+0000","last_active":"2024-03-04T09:13:16.547538+0000","last_peered":"2024-03-04T09:13:16.547538+0000","last_clean":"2024-03-04T09:13:16.547538+0000","last_became_active":"2024-03-04T09:13:10.753083+0000","last_became_peered":"2024-03-04T09:13:10.753083+0000","last_unstale":"2024-03-04T09:13:16.547538+0000","last_undegraded":"2024-03-04T09:13:16.547538+0000","last_fullsized":"2024-03-04T09:13:16.547538+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:50:45.119191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.547312+0000","last_change":"2024-03-04T09:13:10.771303+0000","last_active":"2024-03-04T09:13:16.547312+0000","last_peered":"2024-03-04T09:13:16.547312+0000","last_clean":"2024-03-04T09:13:16.547312+0000","last_became_active":"2024-03-04T09:13:10.770950+0000","last_became_peered":"2024-03-04T09:13:10.770950+0000","last_unstale":"2024-03-04T09:13:16.547312+0000","last_undegraded":"2024-03-04T09:13:16.547312+0000","last_fullsized":"2024-03-04T09:13:16.547312+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:48:59.832283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.784553+0000","last_change":"2024-03-04T09:13:10.757277+0000","last_active":"2024-03-04T09:13:15.784553+0000","last_peered":"2024-03-04T09:13:15.784553+0000","last_clean":"2024-03-04T09:13:15.784553+0000","last_became_active":"2024-03-04T09:13:10.756878+0000","last_became_peered":"2024-03-04T09:13:10.756878+0000","last_unstale":"2024-03-04T09:13:15.784553+0000","last_undegraded":"2024-03-04T09:13:15.784553+0000","last_fullsized":"2024-03-04T09:13:15.784553+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:24:58.637505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.548033+0000","last_change":"2024-03-04T09:13:10.759449+0000","last_active":"2024-03-04T09:13:16.548033+0000","last_peered":"2024-03-04T09:13:16.548033+0000","last_clean":"2024-03-04T09:13:16.548033+0000","last_became_active":"2024-03-04T09:13:10.759135+0000","last_became_peered":"2024-03-04T09:13:10.759135+0000","last_unstale":"2024-03-04T09:13:16.548033+0000","last_undegraded":"2024-03-04T09:13:16.548033+0000","last_fullsized":"2024-03-04T09:13:16.548033+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:23.062734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.548347+0000","last_change":"2024-03-04T09:13:10.754694+0000","last_active":"2024-03-04T09:13:16.548347+0000","last_peered":"2024-03-04T09:13:16.548347+0000","last_clean":"2024-03-04T09:13:16.548347+0000","last_became_active":"2024-03-04T09:13:10.754370+0000","last_became_peered":"2024-03-04T09:13:10.754370+0000","last_unstale":"2024-03-04T09:13:16.548347+0000","last_undegraded":"2024-03-04T09:13:16.548347+0000","last_fullsized":"2024-03-04T09:13:16.548347+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:43:22.049974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.046918+0000","last_change":"2024-03-04T09:13:10.769685+0000","last_active":"2024-03-04T09:13:16.046918+0000","last_peered":"2024-03-04T09:13:16.046918+0000","last_clean":"2024-03-04T09:13:16.046918+0000","last_became_active":"2024-03-04T09:13:10.769320+0000","last_became_peered":"2024-03-04T09:13:10.769320+0000","last_unstale":"2024-03-04T09:13:16.046918+0000","last_undegraded":"2024-03-04T09:13:16.046918+0000","last_fullsized":"2024-03-04T09:13:16.046918+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:44:52.989449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.784595+0000","last_change":"2024-03-04T09:13:10.759417+0000","last_active":"2024-03-04T09:13:15.784595+0000","last_peered":"2024-03-04T09:13:15.784595+0000","last_clean":"2024-03-04T09:13:15.784595+0000","last_became_active":"2024-03-04T09:13:10.759025+0000","last_became_peered":"2024-03-04T09:13:10.759025+0000","last_unstale":"2024-03-04T09:13:15.784595+0000","last_undegraded":"2024-03-04T09:13:15.784595+0000","last_fullsized":"2024-03-04T09:13:15.784595+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:54:08.931563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.046666+0000","last_change":"2024-03-04T09:13:10.758917+0000","last_active":"2024-03-04T09:13:16.046666+0000","last_peered":"2024-03-04T09:13:16.046666+0000","last_clean":"2024-03-04T09:13:16.046666+0000","last_became_active":"2024-03-04T09:13:10.758604+0000","last_became_peered":"2024-03-04T09:13:10.758604+0000","last_unstale":"2024-03-04T09:13:16.046666+0000","last_undegraded":"2024-03-04T09:13:16.046666+0000","last_fullsized":"2024-03-04T09:13:16.046666+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:38:51.989174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.782505+0000","last_change":"2024-03-04T09:13:10.759544+0000","last_active":"2024-03-04T09:13:15.782505+0000","last_peered":"2024-03-04T09:13:15.782505+0000","last_clean":"2024-03-04T09:13:15.782505+0000","last_became_active":"2024-03-04T09:13:10.759165+0000","last_became_peered":"2024-03-04T09:13:10.759165+0000","last_unstale":"2024-03-04T09:13:15.782505+0000","last_undegraded":"2024-03-04T09:13:15.782505+0000","last_fullsized":"2024-03-04T09:13:15.782505+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:45:55.441307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:15.784453+0000","last_change":"2024-03-04T09:13:10.758342+0000","last_active":"2024-03-04T09:13:15.784453+0000","last_peered":"2024-03-04T09:13:15.784453+0000","last_clean":"2024-03-04T09:13:15.784453+0000","last_became_active":"2024-03-04T09:13:10.757987+0000","last_became_peered":"2024-03-04T09:13:10.757987+0000","last_unstale":"2024-03-04T09:13:15.784453+0000","last_undegraded":"2024-03-04T09:13:15.784453+0000","last_fullsized":"2024-03-04T09:13:15.784453+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:52:07.029064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-04T09:13:16.548421+0000","last_change":"2024-03-04T09:13:10.768340+0000","last_active":"2024-03-04T09:13:16.548421+0000","last_peered":"2024-03-04T09:13:16.548421+0000","last_clean":"2024-03-04T09:13:16.548421+0000","last_became_active":"2024-03-04T09:13:10.768000+0000","last_became_peered":"2024-03-04T09:13:10.768000+0000","last_unstale":"2024-03-04T09:13:16.548421+0000","last_undegraded":"2024-03-04T09:13:16.548421+0000","last_fullsized":"2024-03-04T09:13:16.548421+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:50:17.564815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":246013,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":44171,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":6,"num_read_kb":43,"num_write":160,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":331776,"data_stored":97221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892350993,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":970752,"data_stored":480266,"data_compressed":14711,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612631,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28084,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717068,"statfs":{"total":95995035648,"available":95966277632,"internally_reserved":0,"allocated":1093632,"data_stored":1095868,"data_compressed":50324,"data_compressed_allocated":65536,"data_compressed_original":630784,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776156,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":995328,"data_stored":481174,"data_compressed":14711,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037793,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32136,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713016,"statfs":{"total":95995035648,"available":95962128384,"internally_reserved":0,"allocated":983040,"data_stored":480892,"data_compressed":14711,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299430,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1036288,"data_stored":1072426,"data_compressed":50324,"data_compressed_allocated":65536,"data_compressed_original":630784,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462955,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":974848,"data_stored":480356,"data_compressed":14711,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":1015808,"data_stored":505159,"data_compressed":14711,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":974848,"data_stored":480356,"data_compressed":14711,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411391,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":995328,"data_stored":484764,"data_compressed":14711,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149753,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32136,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713016,"statfs":{"total":95995035648,"available":95962128384,"internally_reserved":0,"allocated":983040,"data_stored":480460,"data_compressed":14711,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888117,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":974848,"data_stored":480288,"data_compressed":14711,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724591,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1032192,"data_stored":1070816,"data_compressed":50324,"data_compressed_allocated":65536,"data_compressed_original":630784,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33974,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33974,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":42223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":5192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":42598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T09:13:39.418 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-04T09:13:39.419 INFO:tasks.cephadm:Setting up client nodes... 2024-03-04T09:13:39.419 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-03-04T09:13:39.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:39 smithi190 ceph-mon[36341]: from='client.14898 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:13:39.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:39 smithi190 ceph-mon[36341]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:13:39.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:39 smithi190 ceph-mon[36341]: pgmap v303: 129 pgs: 129 active+clean; 620 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5.7 KiB/s wr, 9 op/s 2024-03-04T09:13:39.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:39 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/491018572' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:13:39.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:39 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/2916909059' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:13:39.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:39 smithi102 ceph-mon[36220]: from='client.14898 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:13:39.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:39 smithi102 ceph-mon[36220]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:13:39.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:39 smithi102 ceph-mon[36220]: pgmap v303: 129 pgs: 129 active+clean; 620 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5.7 KiB/s wr, 9 op/s 2024-03-04T09:13:39.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:39 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/491018572' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:13:39.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:39 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/2916909059' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:13:39.694 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:13:39.815 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:39 smithi082 ceph-mon[32880]: from='client.14898 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:13:39.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:39 smithi082 ceph-mon[32880]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:13:39.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:39 smithi082 ceph-mon[32880]: pgmap v303: 129 pgs: 129 active+clean; 620 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5.7 KiB/s wr, 9 op/s 2024-03-04T09:13:39.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:39 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/491018572' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:13:39.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:39 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/2916909059' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:13:40.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:40 smithi190 ceph-mon[36341]: from='client.24700 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T09:13:40.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:40 smithi190 ceph-mon[36341]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T09:13:40.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:40 smithi102 ceph-mon[36220]: from='client.24700 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T09:13:40.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:40 smithi102 ceph-mon[36220]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T09:13:40.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:40 smithi082 ceph-mon[32880]: from='client.24700 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T09:13:40.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:40 smithi082 ceph-mon[32880]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T09:13:41.426 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:41 smithi082 ceph-mon[32880]: pgmap v304: 129 pgs: 129 active+clean; 620 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 6.2 KiB/s wr, 10 op/s 2024-03-04T09:13:41.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.540+0000 7ffa07ebb700 1 -- 172.21.15.82:0/800982768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa001090c0 msgr2=0x7ffa001094e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:41.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.540+0000 7ffa07ebb700 1 --2- 172.21.15.82:0/800982768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa001090c0 0x7ffa001094e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff9f800b0d0 tx=0x7ff9f800b3e0 comp rx=0 tx=0).stop 2024-03-04T09:13:41.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.540+0000 7ffa07ebb700 1 -- 172.21.15.82:0/800982768 shutdown_connections 2024-03-04T09:13:41.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.540+0000 7ffa07ebb700 1 --2- 172.21.15.82:0/800982768 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa00110940 0x7ffa00112d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:41.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.540+0000 7ffa07ebb700 1 --2- 172.21.15.82:0/800982768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa001090c0 0x7ffa001094e0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:41.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.540+0000 7ffa07ebb700 1 --2- 172.21.15.82:0/800982768 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa00109a20 0x7ffa00110400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:41.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.540+0000 7ffa07ebb700 1 -- 172.21.15.82:0/800982768 >> 172.21.15.82:0/800982768 conn(0x7ffa0006f190 msgr2=0x7ffa000715d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:41.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.540+0000 7ffa07ebb700 1 -- 172.21.15.82:0/800982768 shutdown_connections 2024-03-04T09:13:41.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.540+0000 7ffa07ebb700 1 -- 172.21.15.82:0/800982768 wait complete. 2024-03-04T09:13:41.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.541+0000 7ffa07ebb700 1 Processor -- start 2024-03-04T09:13:41.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.541+0000 7ffa07ebb700 1 -- start start 2024-03-04T09:13:41.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.541+0000 7ffa07ebb700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa001090c0 0x7ffa001a0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:41.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.541+0000 7ffa07ebb700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa00109a20 0x7ffa001a0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:41.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.541+0000 7ffa07ebb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa00110940 0x7ffa001a7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:41.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.541+0000 7ffa07ebb700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa001164d0 con 0x7ffa00110940 2024-03-04T09:13:41.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.541+0000 7ffa07ebb700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa00116350 con 0x7ffa001090c0 2024-03-04T09:13:41.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.541+0000 7ffa07ebb700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa00116650 con 0x7ffa00109a20 2024-03-04T09:13:41.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.541+0000 7ffa06458700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa00110940 0x7ffa001a7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:41.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.541+0000 7ffa06458700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa00110940 0x7ffa001a7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43168/0 (socket says 172.21.15.82:43168) 2024-03-04T09:13:41.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.541+0000 7ffa05456700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa00109a20 0x7ffa001a0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:41.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.541+0000 7ffa06458700 1 -- 172.21.15.82:0/1426874822 learned_addr learned my addr 172.21.15.82:0/1426874822 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:41.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.541+0000 7ffa05c57700 1 --2- 172.21.15.82:0/1426874822 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa001090c0 0x7ffa001a0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:41.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.542+0000 7ffa06458700 1 -- 172.21.15.82:0/1426874822 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa00109a20 msgr2=0x7ffa001a0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:41.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.542+0000 7ffa06458700 1 --2- 172.21.15.82:0/1426874822 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa00109a20 0x7ffa001a0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:41.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.542+0000 7ffa06458700 1 -- 172.21.15.82:0/1426874822 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa001090c0 msgr2=0x7ffa001a0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:41.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.542+0000 7ffa06458700 1 --2- 172.21.15.82:0/1426874822 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa001090c0 0x7ffa001a0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:41.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.542+0000 7ffa06458700 1 -- 172.21.15.82:0/1426874822 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa001a8660 con 0x7ffa00110940 2024-03-04T09:13:41.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.542+0000 7ffa05c57700 1 --2- 172.21.15.82:0/1426874822 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa001090c0 0x7ffa001a0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:13:41.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.542+0000 7ffa06458700 1 --2- 172.21.15.82:0/1426874822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa00110940 0x7ffa001a7fc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc00e970 tx=0x7ff9fc00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:41.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.542+0000 7ff9f6ffd700 1 -- 172.21.15.82:0/1426874822 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9fc004a30 con 0x7ffa00110940 2024-03-04T09:13:41.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.542+0000 7ff9f6ffd700 1 -- 172.21.15.82:0/1426874822 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7ff9fc0054f0 con 0x7ffa00110940 2024-03-04T09:13:41.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.542+0000 7ffa07ebb700 1 -- 172.21.15.82:0/1426874822 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa001a8950 con 0x7ffa00110940 2024-03-04T09:13:41.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.542+0000 7ff9f6ffd700 1 -- 172.21.15.82:0/1426874822 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9fc00cdb0 con 0x7ffa00110940 2024-03-04T09:13:41.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.542+0000 7ffa07ebb700 1 -- 172.21.15.82:0/1426874822 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa001a8e90 con 0x7ffa00110940 2024-03-04T09:13:41.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.543+0000 7ffa07ebb700 1 -- 172.21.15.82:0/1426874822 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa000505d0 con 0x7ffa00110940 2024-03-04T09:13:41.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.544+0000 7ff9f6ffd700 1 -- 172.21.15.82:0/1426874822 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 136807+0+0 (secure 0 0 0) 0x7ff9fc005000 con 0x7ffa00110940 2024-03-04T09:13:41.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.545+0000 7ff9f6ffd700 1 --2- 172.21.15.82:0/1426874822 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff9ec0a1f50 0x7ff9ec0a4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:41.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.545+0000 7ffa05c57700 1 --2- 172.21.15.82:0/1426874822 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff9ec0a1f50 0x7ff9ec0a4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:41.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.545+0000 7ff9f6ffd700 1 -- 172.21.15.82:0/1426874822 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8802+0+0 (secure 0 0 0) 0x7ff9fc0ce4c0 con 0x7ffa00110940 2024-03-04T09:13:41.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.545+0000 7ffa05c57700 1 --2- 172.21.15.82:0/1426874822 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff9ec0a1f50 0x7ff9ec0a4410 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff9f8009c60 tx=0x7ff9f800b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:41.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.549+0000 7ff9f6ffd700 1 -- 172.21.15.82:0/1426874822 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7ff9fc09b550 con 0x7ffa00110940 2024-03-04T09:13:41.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:41 smithi190 ceph-mon[36341]: pgmap v304: 129 pgs: 129 active+clean; 620 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 6.2 KiB/s wr, 10 op/s 2024-03-04T09:13:41.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:41 smithi102 ceph-mon[36220]: pgmap v304: 129 pgs: 129 active+clean; 620 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 6.2 KiB/s wr, 10 op/s 2024-03-04T09:13:41.679 INFO:journalctl@ceph.mds.b.smithi102.stdout:Mar 04 09:13:41 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-b[65969]: 2024-03-04T09:13:41.348+0000 7fcae7145700 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-03-04T09:13:41.679 INFO:journalctl@ceph.mds.b.smithi102.stdout:Mar 04 09:13:41 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-b[65969]: 2024-03-04T09:13:41.348+0000 7fcae7145700 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-03-04T09:13:41.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.831+0000 7ffa07ebb700 1 -- 172.21.15.82:0/1426874822 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7ffa001a92f0 con 0x7ffa00110940 2024-03-04T09:13:41.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.833+0000 7ff9f6ffd700 1 -- 172.21.15.82:0/1426874822 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) v1 ==== 170+0+59 (secure 0 0 0) 0x7ff9fc09ae50 con 0x7ffa00110940 2024-03-04T09:13:41.830 INFO:teuthology.orchestra.run.smithi082.stdout:[client.0] 2024-03-04T09:13:41.830 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQDFkOVl11GhMRAAm4DJn9Rx5kWg60nwAUo0Uw== 2024-03-04T09:13:41.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.835+0000 7ffa07ebb700 1 -- 172.21.15.82:0/1426874822 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff9ec0a1f50 msgr2=0x7ff9ec0a4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:41.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.835+0000 7ffa07ebb700 1 --2- 172.21.15.82:0/1426874822 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff9ec0a1f50 0x7ff9ec0a4410 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff9f8009c60 tx=0x7ff9f800b040 comp rx=0 tx=0).stop 2024-03-04T09:13:41.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.835+0000 7ffa07ebb700 1 -- 172.21.15.82:0/1426874822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa00110940 msgr2=0x7ffa001a7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:41.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.835+0000 7ffa07ebb700 1 --2- 172.21.15.82:0/1426874822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa00110940 0x7ffa001a7fc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc00e970 tx=0x7ff9fc00ec80 comp rx=0 tx=0).stop 2024-03-04T09:13:41.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.835+0000 7ffa07ebb700 1 -- 172.21.15.82:0/1426874822 shutdown_connections 2024-03-04T09:13:41.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.835+0000 7ffa07ebb700 1 --2- 172.21.15.82:0/1426874822 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff9ec0a1f50 0x7ff9ec0a4410 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:41.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.835+0000 7ffa07ebb700 1 --2- 172.21.15.82:0/1426874822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa00110940 0x7ffa001a7fc0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:41.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.835+0000 7ffa07ebb700 1 --2- 172.21.15.82:0/1426874822 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa001090c0 0x7ffa001a0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:41.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.835+0000 7ffa07ebb700 1 --2- 172.21.15.82:0/1426874822 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa00109a20 0x7ffa001a0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:41.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.835+0000 7ffa07ebb700 1 -- 172.21.15.82:0/1426874822 >> 172.21.15.82:0/1426874822 conn(0x7ffa0006f190 msgr2=0x7ffa00070d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:41.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.835+0000 7ffa07ebb700 1 -- 172.21.15.82:0/1426874822 shutdown_connections 2024-03-04T09:13:41.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:41.836+0000 7ffa07ebb700 1 -- 172.21.15.82:0/1426874822 wait complete. 2024-03-04T09:13:42.472 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:42 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/1426874822' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-04T09:13:42.472 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:42 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/1426874822' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-04T09:13:42.500 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-03-04T09:13:42.500 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-03-04T09:13:42.500 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-04T09:13:42.545 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-04T09:13:42.546 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-03-04T09:13:42.546 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph mgr dump --format=json 2024-03-04T09:13:42.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:42 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/1426874822' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-04T09:13:42.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:42 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/1426874822' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-04T09:13:42.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:42 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/1426874822' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-04T09:13:42.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:42 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/1426874822' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-04T09:13:42.834 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:13:43.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:43 smithi190 ceph-mon[36341]: pgmap v305: 129 pgs: 129 active+clean; 623 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 7.6 KiB/s wr, 18 op/s 2024-03-04T09:13:43.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:43 smithi102 ceph-mon[36220]: pgmap v305: 129 pgs: 129 active+clean; 623 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 7.6 KiB/s wr, 18 op/s 2024-03-04T09:13:43.744 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:43 smithi082 ceph-mon[32880]: pgmap v305: 129 pgs: 129 active+clean; 623 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 7.6 KiB/s wr, 18 op/s 2024-03-04T09:13:44.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.514+0000 7fef04d0b700 1 -- 172.21.15.82:0/1596633574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef0006a710 msgr2=0x7fef0010ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:44.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.514+0000 7fef04d0b700 1 --2- 172.21.15.82:0/1596633574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef0006a710 0x7fef0010ef50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7feef800b0d0 tx=0x7feef800b3e0 comp rx=0 tx=0).stop 2024-03-04T09:13:44.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.514+0000 7fef04d0b700 1 -- 172.21.15.82:0/1596633574 shutdown_connections 2024-03-04T09:13:44.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.514+0000 7fef04d0b700 1 --2- 172.21.15.82:0/1596633574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef0006a710 0x7fef0010ef50 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:44.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.514+0000 7fef04d0b700 1 --2- 172.21.15.82:0/1596633574 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef00108110 0x7fef001084f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:44.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.514+0000 7fef04d0b700 1 --2- 172.21.15.82:0/1596633574 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef00069d70 0x7fef0006a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:44.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.514+0000 7fef04d0b700 1 -- 172.21.15.82:0/1596633574 >> 172.21.15.82:0/1596633574 conn(0x7fef00077ef0 msgr2=0x7fef00078300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:44.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.514+0000 7fef04d0b700 1 -- 172.21.15.82:0/1596633574 shutdown_connections 2024-03-04T09:13:44.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.514+0000 7fef04d0b700 1 -- 172.21.15.82:0/1596633574 wait complete. 2024-03-04T09:13:44.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.515+0000 7fef04d0b700 1 Processor -- start 2024-03-04T09:13:44.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.515+0000 7fef04d0b700 1 -- start start 2024-03-04T09:13:44.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.515+0000 7fef04d0b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef00069d70 0x7fef001a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:44.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.515+0000 7fef04d0b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef0006a710 0x7fef001a0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:44.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.515+0000 7fef04d0b700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef00108110 0x7fef0019a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:44.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.515+0000 7fef04d0b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef00112360 con 0x7fef0006a710 2024-03-04T09:13:44.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.515+0000 7fef04d0b700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef001121e0 con 0x7fef00108110 2024-03-04T09:13:44.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.515+0000 7fef04d0b700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef001124e0 con 0x7fef00069d70 2024-03-04T09:13:44.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.515+0000 7feef5d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef0006a710 0x7fef001a0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:44.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.515+0000 7feefe59c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef00069d70 0x7fef001a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:44.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.515+0000 7feef5d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef0006a710 0x7fef001a0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43176/0 (socket says 172.21.15.82:43176) 2024-03-04T09:13:44.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.515+0000 7feef5d9b700 1 -- 172.21.15.82:0/833201522 learned_addr learned my addr 172.21.15.82:0/833201522 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:44.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.515+0000 7feefed9d700 1 --2- 172.21.15.82:0/833201522 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef00108110 0x7fef0019a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:44.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.516+0000 7feefe59c700 1 -- 172.21.15.82:0/833201522 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef00108110 msgr2=0x7fef0019a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:44.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.516+0000 7feefe59c700 1 --2- 172.21.15.82:0/833201522 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef00108110 0x7fef0019a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:44.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.516+0000 7feefe59c700 1 -- 172.21.15.82:0/833201522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef0006a710 msgr2=0x7fef001a0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:44.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.516+0000 7feefe59c700 1 --2- 172.21.15.82:0/833201522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef0006a710 0x7fef001a0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:44.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.516+0000 7feefe59c700 1 -- 172.21.15.82:0/833201522 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef0019afd0 con 0x7fef00069d70 2024-03-04T09:13:44.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.516+0000 7feef5d9b700 1 --2- 172.21.15.82:0/833201522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef0006a710 0x7fef001a0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:13:44.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.516+0000 7feefed9d700 1 --2- 172.21.15.82:0/833201522 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef00108110 0x7fef0019a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:13:44.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.516+0000 7feefe59c700 1 --2- 172.21.15.82:0/833201522 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef00069d70 0x7fef001a0670 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7feef000e9f0 tx=0x7feef000ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:44.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.516+0000 7feef7fff700 1 -- 172.21.15.82:0/833201522 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef000c9c0 con 0x7fef00069d70 2024-03-04T09:13:44.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.516+0000 7fef04d0b700 1 -- 172.21.15.82:0/833201522 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef0019b2c0 con 0x7fef00069d70 2024-03-04T09:13:44.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.516+0000 7feef7fff700 1 -- 172.21.15.82:0/833201522 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7feef000cb60 con 0x7fef00069d70 2024-03-04T09:13:44.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.516+0000 7feef7fff700 1 -- 172.21.15.82:0/833201522 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef0018680 con 0x7fef00069d70 2024-03-04T09:13:44.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.516+0000 7fef04d0b700 1 -- 172.21.15.82:0/833201522 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef001a74d0 con 0x7fef00069d70 2024-03-04T09:13:44.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.517+0000 7fef04d0b700 1 -- 172.21.15.82:0/833201522 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef001037c0 con 0x7fef00069d70 2024-03-04T09:13:44.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.518+0000 7feef7fff700 1 -- 172.21.15.82:0/833201522 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 17) v1 ==== 136807+0+0 (secure 0 0 0) 0x7feef0010430 con 0x7fef00069d70 2024-03-04T09:13:44.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.518+0000 7feef7fff700 1 --2- 172.21.15.82:0/833201522 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7feeec0a1ea0 0x7feeec0a4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:44.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.519+0000 7feef5d9b700 1 --2- 172.21.15.82:0/833201522 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7feeec0a1ea0 0x7feeec0a4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:44.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.519+0000 7feef7fff700 1 -- 172.21.15.82:0/833201522 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8802+0+0 (secure 0 0 0) 0x7feef00ce230 con 0x7fef00069d70 2024-03-04T09:13:44.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.519+0000 7feef5d9b700 1 --2- 172.21.15.82:0/833201522 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7feeec0a1ea0 0x7feeec0a4360 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fef00102fe0 tx=0x7feee8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:44.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.528+0000 7feef7fff700 1 -- 172.21.15.82:0/833201522 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7feef009b2c0 con 0x7fef00069d70 2024-03-04T09:13:44.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.782+0000 7fef04d0b700 1 -- 172.21.15.82:0/833201522 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fef001a7700 con 0x7fef00069d70 2024-03-04T09:13:44.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.786+0000 7feef7fff700 1 -- 172.21.15.82:0/833201522 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) v1 ==== 74+0+261469 (secure 0 0 0) 0x7feef009abc0 con 0x7fef00069d70 2024-03-04T09:13:44.787 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:13:44.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.789+0000 7fef04d0b700 1 -- 172.21.15.82:0/833201522 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7feeec0a1ea0 msgr2=0x7feeec0a4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:44.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.789+0000 7fef04d0b700 1 --2- 172.21.15.82:0/833201522 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7feeec0a1ea0 0x7feeec0a4360 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fef00102fe0 tx=0x7feee8009260 comp rx=0 tx=0).stop 2024-03-04T09:13:44.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.789+0000 7fef04d0b700 1 -- 172.21.15.82:0/833201522 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef00069d70 msgr2=0x7fef001a0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:44.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.789+0000 7fef04d0b700 1 --2- 172.21.15.82:0/833201522 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef00069d70 0x7fef001a0670 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7feef000e9f0 tx=0x7feef000ed00 comp rx=0 tx=0).stop 2024-03-04T09:13:44.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.790+0000 7fef04d0b700 1 -- 172.21.15.82:0/833201522 shutdown_connections 2024-03-04T09:13:44.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.790+0000 7fef04d0b700 1 --2- 172.21.15.82:0/833201522 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7feeec0a1ea0 0x7feeec0a4360 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:44.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.790+0000 7fef04d0b700 1 --2- 172.21.15.82:0/833201522 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef00108110 0x7fef0019a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:44.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.790+0000 7fef04d0b700 1 --2- 172.21.15.82:0/833201522 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef00069d70 0x7fef001a0670 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:44.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.790+0000 7fef04d0b700 1 --2- 172.21.15.82:0/833201522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef0006a710 0x7fef001a0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:44.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.790+0000 7fef04d0b700 1 -- 172.21.15.82:0/833201522 >> 172.21.15.82:0/833201522 conn(0x7fef00077ef0 msgr2=0x7fef0010d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:44.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.790+0000 7fef04d0b700 1 -- 172.21.15.82:0/833201522 shutdown_connections 2024-03-04T09:13:44.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:44.790+0000 7fef04d0b700 1 -- 172.21.15.82:0/833201522 wait complete. 2024-03-04T09:13:45.603 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":1278635224},{"type":"v1","addr":"172.21.15.82:6801","nonce":1278635224}]},"active_addr":"172.21.15.82:6801/1278635224","active_change":"2024-03-04T09:06:12.169345+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24106,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24113,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.82:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":566891801}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":2438787300}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":2876711373}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":3558395162}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":3527139232}]}]} 2024-03-04T09:13:45.608 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-03-04T09:13:45.608 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-03-04T09:13:45.608 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph osd dump --format=json 2024-03-04T09:13:45.636 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:45 smithi082 ceph-mon[32880]: pgmap v306: 129 pgs: 129 active+clean; 628 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 8.4 KiB/s wr, 21 op/s 2024-03-04T09:13:45.636 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:45 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/833201522' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-03-04T09:13:45.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:45 smithi190 ceph-mon[36341]: pgmap v306: 129 pgs: 129 active+clean; 628 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 8.4 KiB/s wr, 21 op/s 2024-03-04T09:13:45.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:45 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/833201522' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-03-04T09:13:45.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:45 smithi102 ceph-mon[36220]: pgmap v306: 129 pgs: 129 active+clean; 628 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 8.4 KiB/s wr, 21 op/s 2024-03-04T09:13:45.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:45 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/833201522' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-03-04T09:13:45.853 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:13:47.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:47 smithi190 ceph-mon[36341]: pgmap v307: 129 pgs: 129 active+clean; 628 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 8.4 KiB/s wr, 23 op/s 2024-03-04T09:13:47.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:47 smithi102 ceph-mon[36220]: pgmap v307: 129 pgs: 129 active+clean; 628 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 8.4 KiB/s wr, 23 op/s 2024-03-04T09:13:47.725 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:47 smithi082 ceph-mon[32880]: pgmap v307: 129 pgs: 129 active+clean; 628 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 8.4 KiB/s wr, 23 op/s 2024-03-04T09:13:47.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.728+0000 7fc82b8d4700 1 -- 172.21.15.82:0/4294651544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8241062e0 msgr2=0x7fc82410deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:47.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.728+0000 7fc82b8d4700 1 --2- 172.21.15.82:0/4294651544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8241062e0 0x7fc82410deb0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc814009990 tx=0x7fc814009ca0 comp rx=0 tx=0).stop 2024-03-04T09:13:47.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.728+0000 7fc82b8d4700 1 -- 172.21.15.82:0/4294651544 shutdown_connections 2024-03-04T09:13:47.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.728+0000 7fc82b8d4700 1 --2- 172.21.15.82:0/4294651544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8241062e0 0x7fc82410deb0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:47.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.728+0000 7fc82b8d4700 1 --2- 172.21.15.82:0/4294651544 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc824101250 0x7fc824101630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:47.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.728+0000 7fc82b8d4700 1 --2- 172.21.15.82:0/4294651544 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc824101c00 0x7fc824105c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:47.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.728+0000 7fc82b8d4700 1 -- 172.21.15.82:0/4294651544 >> 172.21.15.82:0/4294651544 conn(0x7fc824076fe0 msgr2=0x7fc8240773f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:47.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.728+0000 7fc82b8d4700 1 -- 172.21.15.82:0/4294651544 shutdown_connections 2024-03-04T09:13:47.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.728+0000 7fc82b8d4700 1 -- 172.21.15.82:0/4294651544 wait complete. 2024-03-04T09:13:47.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.729+0000 7fc82b8d4700 1 Processor -- start 2024-03-04T09:13:47.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.729+0000 7fc82b8d4700 1 -- start start 2024-03-04T09:13:47.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.729+0000 7fc82b8d4700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc824101250 0x7fc82419e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:47.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.729+0000 7fc82b8d4700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc824101c00 0x7fc82419e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:47.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.729+0000 7fc82b8d4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8241062e0 0x7fc8241985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:47.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.729+0000 7fc82b8d4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8241112d0 con 0x7fc8241062e0 2024-03-04T09:13:47.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.729+0000 7fc82b8d4700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc824111150 con 0x7fc824101250 2024-03-04T09:13:47.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.729+0000 7fc82b8d4700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc824111450 con 0x7fc824101c00 2024-03-04T09:13:47.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.729+0000 7fc829e71700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8241062e0 0x7fc8241985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:47.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.729+0000 7fc829670700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc824101250 0x7fc82419e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:47.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.729+0000 7fc829e71700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8241062e0 0x7fc8241985e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35758/0 (socket says 172.21.15.82:35758) 2024-03-04T09:13:47.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.729+0000 7fc829e71700 1 -- 172.21.15.82:0/661120829 learned_addr learned my addr 172.21.15.82:0/661120829 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:47.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.729+0000 7fc829670700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc824101250 0x7fc82419e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.82:43504/0 (socket says 172.21.15.82:43504) 2024-03-04T09:13:47.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.729+0000 7fc828e6f700 1 --2- 172.21.15.82:0/661120829 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc824101c00 0x7fc82419e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:47.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.730+0000 7fc829e71700 1 -- 172.21.15.82:0/661120829 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc824101c00 msgr2=0x7fc82419e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:47.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.730+0000 7fc829e71700 1 --2- 172.21.15.82:0/661120829 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc824101c00 0x7fc82419e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:47.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.730+0000 7fc829e71700 1 -- 172.21.15.82:0/661120829 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc824101250 msgr2=0x7fc82419e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:47.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.730+0000 7fc829e71700 1 --2- 172.21.15.82:0/661120829 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc824101250 0x7fc82419e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:47.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.730+0000 7fc829e71700 1 -- 172.21.15.82:0/661120829 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc824198d40 con 0x7fc8241062e0 2024-03-04T09:13:47.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.730+0000 7fc828e6f700 1 --2- 172.21.15.82:0/661120829 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc824101c00 0x7fc82419e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T09:13:47.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.730+0000 7fc829e71700 1 --2- 172.21.15.82:0/661120829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8241062e0 0x7fc8241985e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc81400b840 tx=0x7fc814005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:47.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.730+0000 7fc8227fc700 1 -- 172.21.15.82:0/661120829 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc814027070 con 0x7fc8241062e0 2024-03-04T09:13:47.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.730+0000 7fc8227fc700 1 -- 172.21.15.82:0/661120829 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fc81400fe00 con 0x7fc8241062e0 2024-03-04T09:13:47.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.730+0000 7fc8227fc700 1 -- 172.21.15.82:0/661120829 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8140173f0 con 0x7fc8241062e0 2024-03-04T09:13:47.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.730+0000 7fc82b8d4700 1 -- 172.21.15.82:0/661120829 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc824198fd0 con 0x7fc8241062e0 2024-03-04T09:13:47.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.730+0000 7fc82b8d4700 1 -- 172.21.15.82:0/661120829 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc824102bd0 con 0x7fc8241062e0 2024-03-04T09:13:47.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.732+0000 7fc82b8d4700 1 -- 172.21.15.82:0/661120829 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8241026e0 con 0x7fc8241062e0 2024-03-04T09:13:47.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.732+0000 7fc8227fc700 1 -- 172.21.15.82:0/661120829 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 136807+0+0 (secure 0 0 0) 0x7fc81402a070 con 0x7fc8241062e0 2024-03-04T09:13:47.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.733+0000 7fc8227fc700 1 --2- 172.21.15.82:0/661120829 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fc80c0a6330 0x7fc80c0a87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:47.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.733+0000 7fc829670700 1 --2- 172.21.15.82:0/661120829 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fc80c0a6330 0x7fc80c0a87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:47.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.733+0000 7fc8227fc700 1 -- 172.21.15.82:0/661120829 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8802+0+0 (secure 0 0 0) 0x7fc8140cee80 con 0x7fc8241062e0 2024-03-04T09:13:47.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.733+0000 7fc829670700 1 --2- 172.21.15.82:0/661120829 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fc80c0a6330 0x7fc80c0a87f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc81c00f540 tx=0x7fc81c00b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:47.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.737+0000 7fc8227fc700 1 -- 172.21.15.82:0/661120829 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fc814013070 con 0x7fc8241062e0 2024-03-04T09:13:47.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.931+0000 7fc82b8d4700 1 -- 172.21.15.82:0/661120829 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc824068d80 con 0x7fc8241062e0 2024-03-04T09:13:47.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.932+0000 7fc8227fc700 1 -- 172.21.15.82:0/661120829 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+24092 (secure 0 0 0) 0x7fc81409bfa0 con 0x7fc8241062e0 2024-03-04T09:13:47.929 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:13:47.929 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":90,"fsid":"2e533fc8-da06-11ee-95c6-87774f69a715","created":"2024-03-04T09:05:16.488249+0000","modified":"2024-03-04T09:13:15.136817+0000","last_up_change":"2024-03-04T09:12:22.308711+0000","last_in_change":"2024-03-04T09:12:02.548212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T09:08:36.508257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T09:13:07.981726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T09:13:09.289799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-04T09:13:13.008516+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"085b5c4b-ede9-4d0d-b994-50c89d991012","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6803","nonce":709655235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6805","nonce":709655235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6809","nonce":709655235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6807","nonce":709655235}]},"public_addr":"172.21.15.82:6803/709655235","cluster_addr":"172.21.15.82:6805/709655235","heartbeat_back_addr":"172.21.15.82:6809/709655235","heartbeat_front_addr":"172.21.15.82:6807/709655235","state":["exists","up"]},{"osd":1,"uuid":"e4dd7079-333e-4bcf-b3af-11fb082a5af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6801","nonce":270721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6803","nonce":270721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6807","nonce":270721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6805","nonce":270721212}]},"public_addr":"172.21.15.102:6801/270721212","cluster_addr":"172.21.15.102:6803/270721212","heartbeat_back_addr":"172.21.15.102:6807/270721212","heartbeat_front_addr":"172.21.15.102:6805/270721212","state":["exists","up"]},{"osd":2,"uuid":"6fed5fd6-dc82-497f-9d69-c10a5e5802da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6801","nonce":946410459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6803","nonce":946410459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6807","nonce":946410459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6805","nonce":946410459}]},"public_addr":"172.21.15.190:6801/946410459","cluster_addr":"172.21.15.190:6803/946410459","heartbeat_back_addr":"172.21.15.190:6807/946410459","heartbeat_front_addr":"172.21.15.190:6805/946410459","state":["exists","up"]},{"osd":3,"uuid":"91ccbdc3-3da6-4d39-8a89-3a7b7bb4adc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6811","nonce":980870924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6813","nonce":980870924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6817","nonce":980870924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6815","nonce":980870924}]},"public_addr":"172.21.15.82:6811/980870924","cluster_addr":"172.21.15.82:6813/980870924","heartbeat_back_addr":"172.21.15.82:6817/980870924","heartbeat_front_addr":"172.21.15.82:6815/980870924","state":["exists","up"]},{"osd":4,"uuid":"dbb9d486-5daa-4819-bbed-04fc76ca473e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6809","nonce":1229627753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6811","nonce":1229627753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6815","nonce":1229627753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6813","nonce":1229627753}]},"public_addr":"172.21.15.102:6809/1229627753","cluster_addr":"172.21.15.102:6811/1229627753","heartbeat_back_addr":"172.21.15.102:6815/1229627753","heartbeat_front_addr":"172.21.15.102:6813/1229627753","state":["exists","up"]},{"osd":5,"uuid":"6b50127b-df2b-4c95-8e53-9d42b40273fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6809","nonce":2171194148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6811","nonce":2171194148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6815","nonce":2171194148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6813","nonce":2171194148}]},"public_addr":"172.21.15.190:6809/2171194148","cluster_addr":"172.21.15.190:6811/2171194148","heartbeat_back_addr":"172.21.15.190:6815/2171194148","heartbeat_front_addr":"172.21.15.190:6813/2171194148","state":["exists","up"]},{"osd":6,"uuid":"e72bebb0-5939-4210-950a-41c25c23c62f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6819","nonce":454436959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6821","nonce":454436959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6825","nonce":454436959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6823","nonce":454436959}]},"public_addr":"172.21.15.82:6819/454436959","cluster_addr":"172.21.15.82:6821/454436959","heartbeat_back_addr":"172.21.15.82:6825/454436959","heartbeat_front_addr":"172.21.15.82:6823/454436959","state":["exists","up"]},{"osd":7,"uuid":"72f83f97-f496-4503-8284-6a7b8f99a6f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6817","nonce":2745057274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6819","nonce":2745057274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6823","nonce":2745057274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6821","nonce":2745057274}]},"public_addr":"172.21.15.102:6817/2745057274","cluster_addr":"172.21.15.102:6819/2745057274","heartbeat_back_addr":"172.21.15.102:6823/2745057274","heartbeat_front_addr":"172.21.15.102:6821/2745057274","state":["exists","up"]},{"osd":8,"uuid":"92c9109d-6ebb-4c50-9944-28cd7b2f9c0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6817","nonce":1679683516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6819","nonce":1679683516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6823","nonce":1679683516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6821","nonce":1679683516}]},"public_addr":"172.21.15.190:6817/1679683516","cluster_addr":"172.21.15.190:6819/1679683516","heartbeat_back_addr":"172.21.15.190:6823/1679683516","heartbeat_front_addr":"172.21.15.190:6821/1679683516","state":["exists","up"]},{"osd":9,"uuid":"a3cfce03-0148-475d-bf55-b8284ae1cad2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6827","nonce":1777272933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6829","nonce":1777272933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6833","nonce":1777272933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6831","nonce":1777272933}]},"public_addr":"172.21.15.82:6827/1777272933","cluster_addr":"172.21.15.82:6829/1777272933","heartbeat_back_addr":"172.21.15.82:6833/1777272933","heartbeat_front_addr":"172.21.15.82:6831/1777272933","state":["exists","up"]},{"osd":10,"uuid":"db156ccf-4396-43cb-b69a-bb9095b94b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6825","nonce":1012784035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6827","nonce":1012784035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6831","nonce":1012784035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6829","nonce":1012784035}]},"public_addr":"172.21.15.102:6825/1012784035","cluster_addr":"172.21.15.102:6827/1012784035","heartbeat_back_addr":"172.21.15.102:6831/1012784035","heartbeat_front_addr":"172.21.15.102:6829/1012784035","state":["exists","up"]},{"osd":11,"uuid":"b4d52576-f5b4-479f-8ff6-8fdba4635ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6825","nonce":144700355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6827","nonce":144700355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6831","nonce":144700355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6829","nonce":144700355}]},"public_addr":"172.21.15.190:6825/144700355","cluster_addr":"172.21.15.190:6827/144700355","heartbeat_back_addr":"172.21.15.190:6831/144700355","heartbeat_front_addr":"172.21.15.190:6829/144700355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:07:47.007772+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:09.944738+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:33.183567+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:58.302023+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:09:23.042488+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:09:47.616009+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:10:13.122887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:10:38.584530+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:03.473453+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:29.847105+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:55.152195+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:12:20.401765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6800/1901539016":"2024-03-05T09:06:12.169231+0000","172.21.15.82:0/1124105204":"2024-03-05T09:06:12.169231+0000","172.21.15.82:6801/1901539016":"2024-03-05T09:06:12.169231+0000","172.21.15.82:0/735262841":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/2402774828":"2024-03-05T09:05:44.913099+0000","172.21.15.82:6801/3291527077":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/1846720385":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/3757201752":"2024-03-05T09:06:12.169231+0000","172.21.15.82:6800/3291527077":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/984630078":"2024-03-05T09:06:12.169231+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T09:13:47.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.935+0000 7fc82b8d4700 1 -- 172.21.15.82:0/661120829 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fc80c0a6330 msgr2=0x7fc80c0a87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:47.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.935+0000 7fc82b8d4700 1 --2- 172.21.15.82:0/661120829 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fc80c0a6330 0x7fc80c0a87f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc81c00f540 tx=0x7fc81c00b040 comp rx=0 tx=0).stop 2024-03-04T09:13:47.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.935+0000 7fc82b8d4700 1 -- 172.21.15.82:0/661120829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8241062e0 msgr2=0x7fc8241985e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:47.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.935+0000 7fc82b8d4700 1 --2- 172.21.15.82:0/661120829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8241062e0 0x7fc8241985e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc81400b840 tx=0x7fc814005ef0 comp rx=0 tx=0).stop 2024-03-04T09:13:47.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.935+0000 7fc82b8d4700 1 -- 172.21.15.82:0/661120829 shutdown_connections 2024-03-04T09:13:47.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.935+0000 7fc82b8d4700 1 --2- 172.21.15.82:0/661120829 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fc80c0a6330 0x7fc80c0a87f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:47.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.935+0000 7fc82b8d4700 1 --2- 172.21.15.82:0/661120829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8241062e0 0x7fc8241985e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:47.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.935+0000 7fc82b8d4700 1 --2- 172.21.15.82:0/661120829 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc824101250 0x7fc82419e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:47.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.935+0000 7fc82b8d4700 1 --2- 172.21.15.82:0/661120829 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc824101c00 0x7fc82419e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:47.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.935+0000 7fc82b8d4700 1 -- 172.21.15.82:0/661120829 >> 172.21.15.82:0/661120829 conn(0x7fc824076fe0 msgr2=0x7fc824104f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:47.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.935+0000 7fc82b8d4700 1 -- 172.21.15.82:0/661120829 shutdown_connections 2024-03-04T09:13:47.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:47.935+0000 7fc82b8d4700 1 -- 172.21.15.82:0/661120829 wait complete. 2024-03-04T09:13:48.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:48 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/661120829' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:13:48.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:48 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/661120829' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:13:48.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:48 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/661120829' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:13:48.744 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-03-04T09:13:48.745 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph osd dump --format=json 2024-03-04T09:13:49.027 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:13:49.409 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:49 smithi082 ceph-mon[32880]: pgmap v308: 129 pgs: 129 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.0 KiB/s wr, 22 op/s 2024-03-04T09:13:49.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:49 smithi190 ceph-mon[36341]: pgmap v308: 129 pgs: 129 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.0 KiB/s wr, 22 op/s 2024-03-04T09:13:49.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:49 smithi102 ceph-mon[36220]: pgmap v308: 129 pgs: 129 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.0 KiB/s wr, 22 op/s 2024-03-04T09:13:50.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.670+0000 7ff2a5256700 1 -- 172.21.15.82:0/883351890 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2a0101c00 msgr2=0x7ff2a0105c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:50.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.670+0000 7ff2a5256700 1 --2- 172.21.15.82:0/883351890 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2a0101c00 0x7ff2a0105c00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff294009990 tx=0x7ff294009ca0 comp rx=0 tx=0).stop 2024-03-04T09:13:50.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.670+0000 7ff2a5256700 1 -- 172.21.15.82:0/883351890 shutdown_connections 2024-03-04T09:13:50.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.670+0000 7ff2a5256700 1 --2- 172.21.15.82:0/883351890 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2a01062e0 0x7ff2a010deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:50.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.670+0000 7ff2a5256700 1 --2- 172.21.15.82:0/883351890 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff2a0101250 0x7ff2a0101630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:50.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.670+0000 7ff2a5256700 1 --2- 172.21.15.82:0/883351890 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2a0101c00 0x7ff2a0105c00 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:50.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.670+0000 7ff2a5256700 1 -- 172.21.15.82:0/883351890 >> 172.21.15.82:0/883351890 conn(0x7ff2a0076fe0 msgr2=0x7ff2a00773f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:50.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.670+0000 7ff2a5256700 1 -- 172.21.15.82:0/883351890 shutdown_connections 2024-03-04T09:13:50.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.670+0000 7ff2a5256700 1 -- 172.21.15.82:0/883351890 wait complete. 2024-03-04T09:13:50.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.671+0000 7ff2a5256700 1 Processor -- start 2024-03-04T09:13:50.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.671+0000 7ff2a5256700 1 -- start start 2024-03-04T09:13:50.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.671+0000 7ff2a5256700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff2a0101250 0x7ff2a019e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:50.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.671+0000 7ff2a5256700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2a0101c00 0x7ff2a019eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:50.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.671+0000 7ff2a5256700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2a01062e0 0x7ff2a01986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:50.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.671+0000 7ff2a5256700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a0111290 con 0x7ff2a0101c00 2024-03-04T09:13:50.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.671+0000 7ff2a5256700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a0111110 con 0x7ff2a0101250 2024-03-04T09:13:50.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.671+0000 7ff2a5256700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a0111410 con 0x7ff2a01062e0 2024-03-04T09:13:50.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.672+0000 7ff29e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2a0101c00 0x7ff2a019eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:50.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.672+0000 7ff29e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2a0101c00 0x7ff2a019eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35764/0 (socket says 172.21.15.82:35764) 2024-03-04T09:13:50.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.672+0000 7ff29e59c700 1 -- 172.21.15.82:0/1882413384 learned_addr learned my addr 172.21.15.82:0/1882413384 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:50.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.672+0000 7ff29ed9d700 1 --2- 172.21.15.82:0/1882413384 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff2a0101250 0x7ff2a019e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:50.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.672+0000 7ff29f59e700 1 --2- 172.21.15.82:0/1882413384 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2a01062e0 0x7ff2a01986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:50.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.672+0000 7ff29ed9d700 1 -- 172.21.15.82:0/1882413384 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2a01062e0 msgr2=0x7ff2a01986b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:50.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.672+0000 7ff29ed9d700 1 --2- 172.21.15.82:0/1882413384 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2a01062e0 0x7ff2a01986b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:50.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.672+0000 7ff29ed9d700 1 -- 172.21.15.82:0/1882413384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2a0101c00 msgr2=0x7ff2a019eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:50.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.672+0000 7ff29ed9d700 1 --2- 172.21.15.82:0/1882413384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2a0101c00 0x7ff2a019eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:50.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.672+0000 7ff29ed9d700 1 -- 172.21.15.82:0/1882413384 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a0198f90 con 0x7ff2a0101250 2024-03-04T09:13:50.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.672+0000 7ff29e59c700 1 --2- 172.21.15.82:0/1882413384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2a0101c00 0x7ff2a019eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:13:50.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.672+0000 7ff29ed9d700 1 --2- 172.21.15.82:0/1882413384 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff2a0101250 0x7ff2a019e5e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff29000e9f0 tx=0x7ff29000ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:50.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.672+0000 7ff287fff700 1 -- 172.21.15.82:0/1882413384 <== mon.2 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29000c9c0 con 0x7ff2a0101250 2024-03-04T09:13:50.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.672+0000 7ff287fff700 1 -- 172.21.15.82:0/1882413384 <== mon.2 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7ff29000cb60 con 0x7ff2a0101250 2024-03-04T09:13:50.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.672+0000 7ff287fff700 1 -- 172.21.15.82:0/1882413384 <== mon.2 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff290018680 con 0x7ff2a0101250 2024-03-04T09:13:50.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.672+0000 7ff2a5256700 1 -- 172.21.15.82:0/1882413384 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2a0199220 con 0x7ff2a0101250 2024-03-04T09:13:50.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.672+0000 7ff2a5256700 1 -- 172.21.15.82:0/1882413384 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2a0102da0 con 0x7ff2a0101250 2024-03-04T09:13:50.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.673+0000 7ff2a5256700 1 -- 172.21.15.82:0/1882413384 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2a01026e0 con 0x7ff2a0101250 2024-03-04T09:13:50.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.674+0000 7ff287fff700 1 -- 172.21.15.82:0/1882413384 <== mon.2 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 17) v1 ==== 136807+0+0 (secure 0 0 0) 0x7ff290010430 con 0x7ff2a0101250 2024-03-04T09:13:50.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.675+0000 7ff287fff700 1 --2- 172.21.15.82:0/1882413384 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff2880a1f20 0x7ff2880a43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:50.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.675+0000 7ff29e59c700 1 --2- 172.21.15.82:0/1882413384 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff2880a1f20 0x7ff2880a43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:50.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.675+0000 7ff287fff700 1 -- 172.21.15.82:0/1882413384 <== mon.2 v2:172.21.15.102:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8802+0+0 (secure 0 0 0) 0x7ff2900ce240 con 0x7ff2a0101250 2024-03-04T09:13:50.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.675+0000 7ff29e59c700 1 --2- 172.21.15.82:0/1882413384 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff2880a1f20 0x7ff2880a43e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff294009750 tx=0x7ff294005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:50.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.683+0000 7ff287fff700 1 -- 172.21.15.82:0/1882413384 <== mon.2 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7ff29009b2d0 con 0x7ff2a0101250 2024-03-04T09:13:50.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.881+0000 7ff2a5256700 1 -- 172.21.15.82:0/1882413384 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2a0199be0 con 0x7ff2a0101250 2024-03-04T09:13:50.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.884+0000 7ff287fff700 1 -- 172.21.15.82:0/1882413384 <== mon.2 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+24092 (secure 0 0 0) 0x7ff29009abd0 con 0x7ff2a0101250 2024-03-04T09:13:50.881 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:13:50.881 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":90,"fsid":"2e533fc8-da06-11ee-95c6-87774f69a715","created":"2024-03-04T09:05:16.488249+0000","modified":"2024-03-04T09:13:15.136817+0000","last_up_change":"2024-03-04T09:12:22.308711+0000","last_in_change":"2024-03-04T09:12:02.548212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T09:08:36.508257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T09:13:07.981726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T09:13:09.289799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-04T09:13:13.008516+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"085b5c4b-ede9-4d0d-b994-50c89d991012","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6803","nonce":709655235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6805","nonce":709655235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6809","nonce":709655235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6807","nonce":709655235}]},"public_addr":"172.21.15.82:6803/709655235","cluster_addr":"172.21.15.82:6805/709655235","heartbeat_back_addr":"172.21.15.82:6809/709655235","heartbeat_front_addr":"172.21.15.82:6807/709655235","state":["exists","up"]},{"osd":1,"uuid":"e4dd7079-333e-4bcf-b3af-11fb082a5af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6801","nonce":270721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6803","nonce":270721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6807","nonce":270721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6805","nonce":270721212}]},"public_addr":"172.21.15.102:6801/270721212","cluster_addr":"172.21.15.102:6803/270721212","heartbeat_back_addr":"172.21.15.102:6807/270721212","heartbeat_front_addr":"172.21.15.102:6805/270721212","state":["exists","up"]},{"osd":2,"uuid":"6fed5fd6-dc82-497f-9d69-c10a5e5802da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6801","nonce":946410459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6803","nonce":946410459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6807","nonce":946410459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6805","nonce":946410459}]},"public_addr":"172.21.15.190:6801/946410459","cluster_addr":"172.21.15.190:6803/946410459","heartbeat_back_addr":"172.21.15.190:6807/946410459","heartbeat_front_addr":"172.21.15.190:6805/946410459","state":["exists","up"]},{"osd":3,"uuid":"91ccbdc3-3da6-4d39-8a89-3a7b7bb4adc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6811","nonce":980870924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6813","nonce":980870924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6817","nonce":980870924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6815","nonce":980870924}]},"public_addr":"172.21.15.82:6811/980870924","cluster_addr":"172.21.15.82:6813/980870924","heartbeat_back_addr":"172.21.15.82:6817/980870924","heartbeat_front_addr":"172.21.15.82:6815/980870924","state":["exists","up"]},{"osd":4,"uuid":"dbb9d486-5daa-4819-bbed-04fc76ca473e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6809","nonce":1229627753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6811","nonce":1229627753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6815","nonce":1229627753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6813","nonce":1229627753}]},"public_addr":"172.21.15.102:6809/1229627753","cluster_addr":"172.21.15.102:6811/1229627753","heartbeat_back_addr":"172.21.15.102:6815/1229627753","heartbeat_front_addr":"172.21.15.102:6813/1229627753","state":["exists","up"]},{"osd":5,"uuid":"6b50127b-df2b-4c95-8e53-9d42b40273fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6809","nonce":2171194148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6811","nonce":2171194148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6815","nonce":2171194148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6813","nonce":2171194148}]},"public_addr":"172.21.15.190:6809/2171194148","cluster_addr":"172.21.15.190:6811/2171194148","heartbeat_back_addr":"172.21.15.190:6815/2171194148","heartbeat_front_addr":"172.21.15.190:6813/2171194148","state":["exists","up"]},{"osd":6,"uuid":"e72bebb0-5939-4210-950a-41c25c23c62f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6819","nonce":454436959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6821","nonce":454436959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6825","nonce":454436959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6823","nonce":454436959}]},"public_addr":"172.21.15.82:6819/454436959","cluster_addr":"172.21.15.82:6821/454436959","heartbeat_back_addr":"172.21.15.82:6825/454436959","heartbeat_front_addr":"172.21.15.82:6823/454436959","state":["exists","up"]},{"osd":7,"uuid":"72f83f97-f496-4503-8284-6a7b8f99a6f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6817","nonce":2745057274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6819","nonce":2745057274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6823","nonce":2745057274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6821","nonce":2745057274}]},"public_addr":"172.21.15.102:6817/2745057274","cluster_addr":"172.21.15.102:6819/2745057274","heartbeat_back_addr":"172.21.15.102:6823/2745057274","heartbeat_front_addr":"172.21.15.102:6821/2745057274","state":["exists","up"]},{"osd":8,"uuid":"92c9109d-6ebb-4c50-9944-28cd7b2f9c0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6817","nonce":1679683516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6819","nonce":1679683516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6823","nonce":1679683516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6821","nonce":1679683516}]},"public_addr":"172.21.15.190:6817/1679683516","cluster_addr":"172.21.15.190:6819/1679683516","heartbeat_back_addr":"172.21.15.190:6823/1679683516","heartbeat_front_addr":"172.21.15.190:6821/1679683516","state":["exists","up"]},{"osd":9,"uuid":"a3cfce03-0148-475d-bf55-b8284ae1cad2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6827","nonce":1777272933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6829","nonce":1777272933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6833","nonce":1777272933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6831","nonce":1777272933}]},"public_addr":"172.21.15.82:6827/1777272933","cluster_addr":"172.21.15.82:6829/1777272933","heartbeat_back_addr":"172.21.15.82:6833/1777272933","heartbeat_front_addr":"172.21.15.82:6831/1777272933","state":["exists","up"]},{"osd":10,"uuid":"db156ccf-4396-43cb-b69a-bb9095b94b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6825","nonce":1012784035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6827","nonce":1012784035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6831","nonce":1012784035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6829","nonce":1012784035}]},"public_addr":"172.21.15.102:6825/1012784035","cluster_addr":"172.21.15.102:6827/1012784035","heartbeat_back_addr":"172.21.15.102:6831/1012784035","heartbeat_front_addr":"172.21.15.102:6829/1012784035","state":["exists","up"]},{"osd":11,"uuid":"b4d52576-f5b4-479f-8ff6-8fdba4635ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6825","nonce":144700355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6827","nonce":144700355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6831","nonce":144700355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6829","nonce":144700355}]},"public_addr":"172.21.15.190:6825/144700355","cluster_addr":"172.21.15.190:6827/144700355","heartbeat_back_addr":"172.21.15.190:6831/144700355","heartbeat_front_addr":"172.21.15.190:6829/144700355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:07:47.007772+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:09.944738+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:33.183567+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:58.302023+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:09:23.042488+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:09:47.616009+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:10:13.122887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:10:38.584530+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:03.473453+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:29.847105+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:55.152195+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:12:20.401765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6800/1901539016":"2024-03-05T09:06:12.169231+0000","172.21.15.82:0/1124105204":"2024-03-05T09:06:12.169231+0000","172.21.15.82:6801/1901539016":"2024-03-05T09:06:12.169231+0000","172.21.15.82:0/735262841":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/2402774828":"2024-03-05T09:05:44.913099+0000","172.21.15.82:6801/3291527077":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/1846720385":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/3757201752":"2024-03-05T09:06:12.169231+0000","172.21.15.82:6800/3291527077":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/984630078":"2024-03-05T09:06:12.169231+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T09:13:50.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.886+0000 7ff2a5256700 1 -- 172.21.15.82:0/1882413384 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff2880a1f20 msgr2=0x7ff2880a43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:50.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.886+0000 7ff2a5256700 1 --2- 172.21.15.82:0/1882413384 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff2880a1f20 0x7ff2880a43e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff294009750 tx=0x7ff294005960 comp rx=0 tx=0).stop 2024-03-04T09:13:50.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.886+0000 7ff2a5256700 1 -- 172.21.15.82:0/1882413384 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff2a0101250 msgr2=0x7ff2a019e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:50.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.886+0000 7ff2a5256700 1 --2- 172.21.15.82:0/1882413384 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff2a0101250 0x7ff2a019e5e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff29000e9f0 tx=0x7ff29000ed00 comp rx=0 tx=0).stop 2024-03-04T09:13:50.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.886+0000 7ff2a5256700 1 -- 172.21.15.82:0/1882413384 shutdown_connections 2024-03-04T09:13:50.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.886+0000 7ff2a5256700 1 --2- 172.21.15.82:0/1882413384 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff2880a1f20 0x7ff2880a43e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:50.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.886+0000 7ff2a5256700 1 --2- 172.21.15.82:0/1882413384 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2a01062e0 0x7ff2a01986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:50.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.886+0000 7ff2a5256700 1 --2- 172.21.15.82:0/1882413384 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff2a0101250 0x7ff2a019e5e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:50.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.886+0000 7ff2a5256700 1 --2- 172.21.15.82:0/1882413384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2a0101c00 0x7ff2a019eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:50.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.886+0000 7ff2a5256700 1 -- 172.21.15.82:0/1882413384 >> 172.21.15.82:0/1882413384 conn(0x7ff2a0076fe0 msgr2=0x7ff2a006aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:50.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.886+0000 7ff2a5256700 1 -- 172.21.15.82:0/1882413384 shutdown_connections 2024-03-04T09:13:50.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:50.886+0000 7ff2a5256700 1 -- 172.21.15.82:0/1882413384 wait complete. 2024-03-04T09:13:51.641 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2024-03-04T09:13:51.642 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2024-03-04T09:13:51.642 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2024-03-04T09:13:51.643 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2024-03-04T09:13:51.643 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2024-03-04T09:13:51.643 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2024-03-04T09:13:51.644 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph tell osd.6 flush_pg_stats 2024-03-04T09:13:51.645 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph tell osd.7 flush_pg_stats 2024-03-04T09:13:51.646 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph tell osd.8 flush_pg_stats 2024-03-04T09:13:51.646 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph tell osd.9 flush_pg_stats 2024-03-04T09:13:51.647 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph tell osd.10 flush_pg_stats 2024-03-04T09:13:51.647 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph tell osd.11 flush_pg_stats 2024-03-04T09:13:51.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:51 smithi190 ceph-mon[36341]: pgmap v309: 129 pgs: 129 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 4.4 KiB/s wr, 17 op/s 2024-03-04T09:13:51.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:51 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/1882413384' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:13:51.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:51 smithi102 ceph-mon[36220]: pgmap v309: 129 pgs: 129 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 4.4 KiB/s wr, 17 op/s 2024-03-04T09:13:51.681 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:51 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/1882413384' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:13:51.690 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:51 smithi082 ceph-mon[32880]: pgmap v309: 129 pgs: 129 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 4.4 KiB/s wr, 17 op/s 2024-03-04T09:13:51.690 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:51 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/1882413384' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:13:52.283 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:13:52.286 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:13:52.296 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:13:53.539 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:53 smithi082 ceph-mon[32880]: pgmap v310: 129 pgs: 129 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.7 KiB/s wr, 17 op/s 2024-03-04T09:13:53.604 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:13:53.607 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:13:53.607 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:13:53.613 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:13:53.613 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:13:53.613 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:13:53.616 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:13:53.616 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:13:53.620 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:13:53.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:53 smithi190 ceph-mon[36341]: pgmap v310: 129 pgs: 129 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.7 KiB/s wr, 17 op/s 2024-03-04T09:13:53.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:53 smithi102 ceph-mon[36220]: pgmap v310: 129 pgs: 129 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.7 KiB/s wr, 17 op/s 2024-03-04T09:13:55.468 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:55 smithi082 ceph-mon[32880]: pgmap v311: 129 pgs: 129 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.3 KiB/s wr, 12 op/s 2024-03-04T09:13:55.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:55 smithi190 ceph-mon[36341]: pgmap v311: 129 pgs: 129 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.3 KiB/s wr, 12 op/s 2024-03-04T09:13:55.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:55 smithi102 ceph-mon[36220]: pgmap v311: 129 pgs: 129 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.3 KiB/s wr, 12 op/s 2024-03-04T09:13:57.528 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:57 smithi082 ceph-mon[32880]: pgmap v312: 129 pgs: 129 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-03-04T09:13:57.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:57 smithi190 ceph-mon[36341]: pgmap v312: 129 pgs: 129 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-03-04T09:13:57.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:57 smithi102 ceph-mon[36220]: pgmap v312: 129 pgs: 129 active+clean; 643 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-03-04T09:13:58.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.363+0000 7fb0c3040700 1 -- 172.21.15.82:0/3221382013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0bc102110 msgr2=0x7fb0bc102590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:58.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.363+0000 7fb0c3040700 1 --2- 172.21.15.82:0/3221382013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0bc102110 0x7fb0bc102590 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb0b00099c0 tx=0x7fb0b0009cd0 comp rx=0 tx=0).stop 2024-03-04T09:13:58.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.363+0000 7fb0c3040700 1 -- 172.21.15.82:0/3221382013 shutdown_connections 2024-03-04T09:13:58.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.363+0000 7fb0c3040700 1 --2- 172.21.15.82:0/3221382013 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb0bc102ad0 0x7fb0bc10ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:58.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.363+0000 7fb0c3040700 1 --2- 172.21.15.82:0/3221382013 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0bc1080f0 0x7fb0bc1084d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:58.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.363+0000 7fb0c3040700 1 --2- 172.21.15.82:0/3221382013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0bc102110 0x7fb0bc102590 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:58.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.363+0000 7fb0c3040700 1 -- 172.21.15.82:0/3221382013 >> 172.21.15.82:0/3221382013 conn(0x7fb0bc0791f0 msgr2=0x7fb0bc079600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:58.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.363+0000 7fb0c3040700 1 -- 172.21.15.82:0/3221382013 shutdown_connections 2024-03-04T09:13:58.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.363+0000 7fb0c3040700 1 -- 172.21.15.82:0/3221382013 wait complete. 2024-03-04T09:13:58.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.364+0000 7fb0c3040700 1 Processor -- start 2024-03-04T09:13:58.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.364+0000 7fb0c3040700 1 -- start start 2024-03-04T09:13:58.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.364+0000 7fb0c3040700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0bc102110 0x7fb0bc19e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:58.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.364+0000 7fb0c3040700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb0bc102ad0 0x7fb0bc19e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:58.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.364+0000 7fb0c3040700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0bc1080f0 0x7fb0bc198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:58.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.364+0000 7fb0c3040700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0bc112390 con 0x7fb0bc102110 2024-03-04T09:13:58.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.364+0000 7fb0c3040700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0bc112210 con 0x7fb0bc1080f0 2024-03-04T09:13:58.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.364+0000 7fb0c3040700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0bc112510 con 0x7fb0bc102ad0 2024-03-04T09:13:58.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.364+0000 7fb0c0ddc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0bc102110 0x7fb0bc19e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:58.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.364+0000 7fb0c0ddc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0bc102110 0x7fb0bc19e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55500/0 (socket says 172.21.15.82:55500) 2024-03-04T09:13:58.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.364+0000 7fb0c0ddc700 1 -- 172.21.15.82:0/622977479 learned_addr learned my addr 172.21.15.82:0/622977479 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:13:58.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.364+0000 7fb0c15dd700 1 --2- 172.21.15.82:0/622977479 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0bc1080f0 0x7fb0bc198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:58.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.365+0000 7fb0bbfff700 1 --2- 172.21.15.82:0/622977479 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb0bc102ad0 0x7fb0bc19e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:58.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.365+0000 7fb0c0ddc700 1 -- 172.21.15.82:0/622977479 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb0bc102ad0 msgr2=0x7fb0bc19e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:58.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.365+0000 7fb0c0ddc700 1 --2- 172.21.15.82:0/622977479 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb0bc102ad0 0x7fb0bc19e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:58.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.365+0000 7fb0c0ddc700 1 -- 172.21.15.82:0/622977479 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0bc1080f0 msgr2=0x7fb0bc198650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:58.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.365+0000 7fb0c0ddc700 1 --2- 172.21.15.82:0/622977479 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0bc1080f0 0x7fb0bc198650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:58.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.365+0000 7fb0c0ddc700 1 -- 172.21.15.82:0/622977479 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0bc198db0 con 0x7fb0bc102110 2024-03-04T09:13:58.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.365+0000 7fb0c15dd700 1 --2- 172.21.15.82:0/622977479 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0bc1080f0 0x7fb0bc198650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:13:58.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.365+0000 7fb0c0ddc700 1 --2- 172.21.15.82:0/622977479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0bc102110 0x7fb0bc19e440 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac00eb30 tx=0x7fb0ac00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:58.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.365+0000 7fb0b9ffb700 1 -- 172.21.15.82:0/622977479 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ac00cbd0 con 0x7fb0bc102110 2024-03-04T09:13:58.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.365+0000 7fb0b9ffb700 1 -- 172.21.15.82:0/622977479 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fb0ac0044f0 con 0x7fb0bc102110 2024-03-04T09:13:58.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.365+0000 7fb0c3040700 1 -- 172.21.15.82:0/622977479 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0bc1990a0 con 0x7fb0bc102110 2024-03-04T09:13:58.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.365+0000 7fb0b9ffb700 1 -- 172.21.15.82:0/622977479 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ac010430 con 0x7fb0bc102110 2024-03-04T09:13:58.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.365+0000 7fb0c3040700 1 -- 172.21.15.82:0/622977479 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0bc1a5310 con 0x7fb0bc102110 2024-03-04T09:13:58.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.366+0000 7fb0c3040700 1 -- 172.21.15.82:0/622977479 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb0bc062810 con 0x7fb0bc102110 2024-03-04T09:13:58.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.367+0000 7fb0b9ffb700 1 -- 172.21.15.82:0/622977479 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 136807+0+0 (secure 0 0 0) 0x7fb0ac003ed0 con 0x7fb0bc102110 2024-03-04T09:13:58.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.368+0000 7fb0b9ffb700 1 --2- 172.21.15.82:0/622977479 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb0a40a1ea0 0x7fb0a40a4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:58.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.368+0000 7fb0bbfff700 1 --2- 172.21.15.82:0/622977479 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb0a40a1ea0 0x7fb0a40a4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:58.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.368+0000 7fb0b9ffb700 1 -- 172.21.15.82:0/622977479 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8802+0+0 (secure 0 0 0) 0x7fb0ac0ce740 con 0x7fb0bc102110 2024-03-04T09:13:58.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.368+0000 7fb0b9ffb700 1 --2- 172.21.15.82:0/622977479 >> [v2:172.21.15.190:6824/144700355,v1:172.21.15.190:6825/144700355] conn(0x7fb0a40acb60 0x7fb0a40aefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:13:58.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.368+0000 7fb0b9ffb700 1 -- 172.21.15.82:0/622977479 --> [v2:172.21.15.190:6824/144700355,v1:172.21.15.190:6825/144700355] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb0ac019e50 con 0x7fb0a40acb60 2024-03-04T09:13:58.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.368+0000 7fb0b9ffb700 1 -- 172.21.15.82:0/622977479 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb0ac0ceb90 con 0x7fb0bc102110 2024-03-04T09:13:58.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.368+0000 7fb0bbfff700 1 --2- 172.21.15.82:0/622977479 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb0a40a1ea0 0x7fb0a40a4360 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc079860 tx=0x7fb0b0005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:58.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.368+0000 7fb0c15dd700 1 --2- 172.21.15.82:0/622977479 >> [v2:172.21.15.190:6824/144700355,v1:172.21.15.190:6825/144700355] conn(0x7fb0a40acb60 0x7fb0a40aefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:13:58.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.369+0000 7fb0c15dd700 1 --2- 172.21.15.82:0/622977479 >> [v2:172.21.15.190:6824/144700355,v1:172.21.15.190:6825/144700355] conn(0x7fb0a40acb60 0x7fb0a40aefa0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:13:58.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.370+0000 7fb0b9ffb700 1 -- 172.21.15.82:0/622977479 <== osd.11 v2:172.21.15.190:6824/144700355 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fb0ac019e50 con 0x7fb0a40acb60 2024-03-04T09:13:58.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.386+0000 7fb0c3040700 1 -- 172.21.15.82:0/622977479 --> [v2:172.21.15.190:6824/144700355,v1:172.21.15.190:6825/144700355] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb0bc062c40 con 0x7fb0a40acb60 2024-03-04T09:13:58.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.386+0000 7fb0b9ffb700 1 -- 172.21.15.82:0/622977479 <== osd.11 v2:172.21.15.190:6824/144700355 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fb0bc062c40 con 0x7fb0a40acb60 2024-03-04T09:13:58.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.386+0000 7fb0c3040700 1 -- 172.21.15.82:0/622977479 >> [v2:172.21.15.190:6824/144700355,v1:172.21.15.190:6825/144700355] conn(0x7fb0a40acb60 msgr2=0x7fb0a40aefa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:58.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.386+0000 7fb0c3040700 1 --2- 172.21.15.82:0/622977479 >> [v2:172.21.15.190:6824/144700355,v1:172.21.15.190:6825/144700355] conn(0x7fb0a40acb60 0x7fb0a40aefa0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:13:58.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.386+0000 7fb0c3040700 1 -- 172.21.15.82:0/622977479 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb0a40a1ea0 msgr2=0x7fb0a40a4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:58.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.386+0000 7fb0c3040700 1 --2- 172.21.15.82:0/622977479 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb0a40a1ea0 0x7fb0a40a4360 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc079860 tx=0x7fb0b0005fb0 comp rx=0 tx=0).stop 2024-03-04T09:13:58.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.386+0000 7fb0c3040700 1 -- 172.21.15.82:0/622977479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0bc102110 msgr2=0x7fb0bc19e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:13:58.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.386+0000 7fb0c3040700 1 --2- 172.21.15.82:0/622977479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0bc102110 0x7fb0bc19e440 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac00eb30 tx=0x7fb0ac00ee40 comp rx=0 tx=0).stop 2024-03-04T09:13:58.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.386+0000 7fb0c15dd700 1 -- 172.21.15.82:0/622977479 reap_dead start 2024-03-04T09:13:58.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.386+0000 7fb0c3040700 1 -- 172.21.15.82:0/622977479 shutdown_connections 2024-03-04T09:13:58.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.386+0000 7fb0c3040700 1 -- 172.21.15.82:0/622977479 >> 172.21.15.82:0/622977479 conn(0x7fb0bc0791f0 msgr2=0x7fb0bc100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:13:58.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.387+0000 7fb0c3040700 1 -- 172.21.15.82:0/622977479 shutdown_connections 2024-03-04T09:13:58.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:13:58.387+0000 7fb0c3040700 1 -- 172.21.15.82:0/622977479 wait complete. 2024-03-04T09:13:59.589 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:13:59 smithi082 ceph-mon[32880]: pgmap v313: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-03-04T09:13:59.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:13:59 smithi190 ceph-mon[36341]: pgmap v313: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-03-04T09:13:59.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:13:59 smithi102 ceph-mon[36220]: pgmap v313: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-03-04T09:14:00.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.214+0000 7fb982914700 1 -- 172.21.15.82:0/652724662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb97c102110 msgr2=0x7fb97c102590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:00.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.214+0000 7fb982914700 1 --2- 172.21.15.82:0/652724662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb97c102110 0x7fb97c102590 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb9640099c0 tx=0x7fb964009cd0 comp rx=0 tx=0).stop 2024-03-04T09:14:00.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.214+0000 7fb982914700 1 -- 172.21.15.82:0/652724662 shutdown_connections 2024-03-04T09:14:00.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.214+0000 7fb982914700 1 --2- 172.21.15.82:0/652724662 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb97c102ad0 0x7fb97c10ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:00.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.214+0000 7fb982914700 1 --2- 172.21.15.82:0/652724662 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb97c1080f0 0x7fb97c1084d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:00.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.214+0000 7fb982914700 1 --2- 172.21.15.82:0/652724662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb97c102110 0x7fb97c102590 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:00.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.214+0000 7fb982914700 1 -- 172.21.15.82:0/652724662 >> 172.21.15.82:0/652724662 conn(0x7fb97c0791f0 msgr2=0x7fb97c079600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:00.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.214+0000 7fb982914700 1 -- 172.21.15.82:0/652724662 shutdown_connections 2024-03-04T09:14:00.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.214+0000 7fb982914700 1 -- 172.21.15.82:0/652724662 wait complete. 2024-03-04T09:14:00.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.215+0000 7fb982914700 1 Processor -- start 2024-03-04T09:14:00.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.215+0000 7fb982914700 1 -- start start 2024-03-04T09:14:00.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.215+0000 7fb982914700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb97c102110 0x7fb97c19e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:00.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.215+0000 7fb982914700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb97c102ad0 0x7fb97c19eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:00.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.215+0000 7fb982914700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb97c1080f0 0x7fb97c198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:00.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.215+0000 7fb982914700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb97c112380 con 0x7fb97c1080f0 2024-03-04T09:14:00.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.215+0000 7fb982914700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb97c112200 con 0x7fb97c102110 2024-03-04T09:14:00.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.215+0000 7fb982914700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb97c112500 con 0x7fb97c102ad0 2024-03-04T09:14:00.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.215+0000 7fb980eb1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb97c1080f0 0x7fb97c198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:00.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.215+0000 7fb97bfff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb97c102110 0x7fb97c19e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:00.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.215+0000 7fb973fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb97c102ad0 0x7fb97c19eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:00.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.215+0000 7fb97bfff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb97c102110 0x7fb97c19e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.82:40552/0 (socket says 172.21.15.82:40552) 2024-03-04T09:14:00.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.215+0000 7fb97bfff700 1 -- 172.21.15.82:0/2054453920 learned_addr learned my addr 172.21.15.82:0/2054453920 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:00.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.216+0000 7fb973fff700 1 -- 172.21.15.82:0/2054453920 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb97c102110 msgr2=0x7fb97c19e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:00.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.216+0000 7fb973fff700 1 --2- 172.21.15.82:0/2054453920 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb97c102110 0x7fb97c19e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:00.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.216+0000 7fb973fff700 1 -- 172.21.15.82:0/2054453920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb97c1080f0 msgr2=0x7fb97c198680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:00.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.216+0000 7fb973fff700 1 --2- 172.21.15.82:0/2054453920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb97c1080f0 0x7fb97c198680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:00.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.216+0000 7fb973fff700 1 -- 172.21.15.82:0/2054453920 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb97c198f60 con 0x7fb97c102ad0 2024-03-04T09:14:00.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.216+0000 7fb980eb1700 1 --2- 172.21.15.82:0/2054453920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb97c1080f0 0x7fb97c198680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:14:00.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.216+0000 7fb973fff700 1 --2- 172.21.15.82:0/2054453920 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb97c102ad0 0x7fb97c19eaf0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb96400b580 tx=0x7fb964003af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:00.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.216+0000 7fb979ffb700 1 -- 172.21.15.82:0/2054453920 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb964009e60 con 0x7fb97c102ad0 2024-03-04T09:14:00.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.216+0000 7fb982914700 1 -- 172.21.15.82:0/2054453920 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb97c1991f0 con 0x7fb97c102ad0 2024-03-04T09:14:00.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.216+0000 7fb979ffb700 1 -- 172.21.15.82:0/2054453920 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fb964005590 con 0x7fb97c102ad0 2024-03-04T09:14:00.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.216+0000 7fb979ffb700 1 -- 172.21.15.82:0/2054453920 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb96400fc90 con 0x7fb97c102ad0 2024-03-04T09:14:00.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.216+0000 7fb982914700 1 -- 172.21.15.82:0/2054453920 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb97c1a5530 con 0x7fb97c102ad0 2024-03-04T09:14:00.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.217+0000 7fb982914700 1 -- 172.21.15.82:0/2054453920 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb97c062810 con 0x7fb97c102ad0 2024-03-04T09:14:00.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.218+0000 7fb979ffb700 1 -- 172.21.15.82:0/2054453920 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 17) v1 ==== 136807+0+0 (secure 0 0 0) 0x7fb96400f460 con 0x7fb97c102ad0 2024-03-04T09:14:00.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.219+0000 7fb979ffb700 1 --2- 172.21.15.82:0/2054453920 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb9680a1ea0 0x7fb9680a4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:00.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.219+0000 7fb97bfff700 1 --2- 172.21.15.82:0/2054453920 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb9680a1ea0 0x7fb9680a4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:00.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.219+0000 7fb979ffb700 1 -- 172.21.15.82:0/2054453920 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8802+0+0 (secure 0 0 0) 0x7fb9640cf110 con 0x7fb97c102ad0 2024-03-04T09:14:00.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.219+0000 7fb979ffb700 1 --2- 172.21.15.82:0/2054453920 >> [v2:172.21.15.82:6802/709655235,v1:172.21.15.82:6803/709655235] conn(0x7fb9680acb60 0x7fb9680aefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:00.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.219+0000 7fb979ffb700 1 -- 172.21.15.82:0/2054453920 --> [v2:172.21.15.82:6802/709655235,v1:172.21.15.82:6803/709655235] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb964001d30 con 0x7fb9680acb60 2024-03-04T09:14:00.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.219+0000 7fb979ffb700 1 -- 172.21.15.82:0/2054453920 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9640cf4c0 con 0x7fb97c102ad0 2024-03-04T09:14:00.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.219+0000 7fb980eb1700 1 --2- 172.21.15.82:0/2054453920 >> [v2:172.21.15.82:6802/709655235,v1:172.21.15.82:6803/709655235] conn(0x7fb9680acb60 0x7fb9680aefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:00.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.219+0000 7fb97bfff700 1 --2- 172.21.15.82:0/2054453920 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb9680a1ea0 0x7fb9680a4360 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb96c009ce0 tx=0x7fb96c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:00.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.220+0000 7fb980eb1700 1 --2- 172.21.15.82:0/2054453920 >> [v2:172.21.15.82:6802/709655235,v1:172.21.15.82:6803/709655235] conn(0x7fb9680acb60 0x7fb9680aefa0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:00.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.220+0000 7fb979ffb700 1 -- 172.21.15.82:0/2054453920 <== osd.0 v2:172.21.15.82:6802/709655235 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fb964001d30 con 0x7fb9680acb60 2024-03-04T09:14:00.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.236+0000 7fb982914700 1 -- 172.21.15.82:0/2054453920 --> [v2:172.21.15.82:6802/709655235,v1:172.21.15.82:6803/709655235] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb97c062c10 con 0x7fb9680acb60 2024-03-04T09:14:00.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.237+0000 7fb979ffb700 1 -- 172.21.15.82:0/2054453920 <== osd.0 v2:172.21.15.82:6802/709655235 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb97c062c10 con 0x7fb9680acb60 2024-03-04T09:14:00.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.237+0000 7fb982914700 1 -- 172.21.15.82:0/2054453920 >> [v2:172.21.15.82:6802/709655235,v1:172.21.15.82:6803/709655235] conn(0x7fb9680acb60 msgr2=0x7fb9680aefa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:00.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.237+0000 7fb982914700 1 --2- 172.21.15.82:0/2054453920 >> [v2:172.21.15.82:6802/709655235,v1:172.21.15.82:6803/709655235] conn(0x7fb9680acb60 0x7fb9680aefa0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:00.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.237+0000 7fb982914700 1 -- 172.21.15.82:0/2054453920 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb9680a1ea0 msgr2=0x7fb9680a4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:00.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.237+0000 7fb982914700 1 --2- 172.21.15.82:0/2054453920 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb9680a1ea0 0x7fb9680a4360 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb96c009ce0 tx=0x7fb96c009260 comp rx=0 tx=0).stop 2024-03-04T09:14:00.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.237+0000 7fb982914700 1 -- 172.21.15.82:0/2054453920 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb97c102ad0 msgr2=0x7fb97c19eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:00.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.237+0000 7fb982914700 1 --2- 172.21.15.82:0/2054453920 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb97c102ad0 0x7fb97c19eaf0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb96400b580 tx=0x7fb964003af0 comp rx=0 tx=0).stop 2024-03-04T09:14:00.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.237+0000 7fb980eb1700 1 -- 172.21.15.82:0/2054453920 reap_dead start 2024-03-04T09:14:00.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.237+0000 7fb982914700 1 -- 172.21.15.82:0/2054453920 shutdown_connections 2024-03-04T09:14:00.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.237+0000 7fb982914700 1 -- 172.21.15.82:0/2054453920 >> 172.21.15.82:0/2054453920 conn(0x7fb97c0791f0 msgr2=0x7fb97c100ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:00.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.237+0000 7fb982914700 1 -- 172.21.15.82:0/2054453920 shutdown_connections 2024-03-04T09:14:00.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:00.237+0000 7fb982914700 1 -- 172.21.15.82:0/2054453920 wait complete. 2024-03-04T09:14:01.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:01 smithi190 ceph-mon[36341]: pgmap v314: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-03-04T09:14:01.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:01 smithi102 ceph-mon[36220]: pgmap v314: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-03-04T09:14:01.739 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:01 smithi082 ceph-mon[32880]: pgmap v314: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-03-04T09:14:03.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:03 smithi082 ceph-mon[32880]: pgmap v315: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 10 op/s 2024-03-04T09:14:03.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:03 smithi190 ceph-mon[36341]: pgmap v315: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 10 op/s 2024-03-04T09:14:03.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:03 smithi102 ceph-mon[36220]: pgmap v315: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 10 op/s 2024-03-04T09:14:04.795 INFO:teuthology.orchestra.run.smithi082.stdout:347892350999 2024-03-04T09:14:04.796 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph osd last-stat-seq osd.11 2024-03-04T09:14:05.618 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:05 smithi082 ceph-mon[32880]: pgmap v316: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 10 op/s 2024-03-04T09:14:05.653 INFO:teuthology.orchestra.run.smithi082.stdout:34359738446 2024-03-04T09:14:05.653 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph osd last-stat-seq osd.0 2024-03-04T09:14:05.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:05 smithi190 ceph-mon[36341]: pgmap v316: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 10 op/s 2024-03-04T09:14:05.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:05 smithi102 ceph-mon[36220]: pgmap v316: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 10 op/s 2024-03-04T09:14:06.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.792+0000 7f38f6827700 1 -- 172.21.15.82:0/2847745070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38f0102140 msgr2=0x7f38f01025a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:06.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.792+0000 7f38f6827700 1 --2- 172.21.15.82:0/2847745070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38f0102140 0x7f38f01025a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f38e0009990 tx=0x7f38e0009ca0 comp rx=0 tx=0).stop 2024-03-04T09:14:06.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.793+0000 7f38f6827700 1 -- 172.21.15.82:0/2847745070 shutdown_connections 2024-03-04T09:14:06.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.793+0000 7f38f6827700 1 --2- 172.21.15.82:0/2847745070 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f38f0102ae0 0x7f38f010ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:06.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.793+0000 7f38f6827700 1 --2- 172.21.15.82:0/2847745070 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f38f0108150 0x7f38f0108530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:06.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.793+0000 7f38f6827700 1 --2- 172.21.15.82:0/2847745070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38f0102140 0x7f38f01025a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:06.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.793+0000 7f38f6827700 1 -- 172.21.15.82:0/2847745070 >> 172.21.15.82:0/2847745070 conn(0x7f38f0079190 msgr2=0x7f38f00795a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:06.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.793+0000 7f38f6827700 1 -- 172.21.15.82:0/2847745070 shutdown_connections 2024-03-04T09:14:06.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.793+0000 7f38f6827700 1 -- 172.21.15.82:0/2847745070 wait complete. 2024-03-04T09:14:06.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.793+0000 7f38f6827700 1 Processor -- start 2024-03-04T09:14:06.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.793+0000 7f38f6827700 1 -- start start 2024-03-04T09:14:06.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.794+0000 7f38f6827700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f38f0102140 0x7f38f019e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:06.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.794+0000 7f38f6827700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38f0102ae0 0x7f38f019eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:06.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.794+0000 7f38f6827700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f38f0108150 0x7f38f01986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:06.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.794+0000 7f38f6827700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f01123a0 con 0x7f38f0102ae0 2024-03-04T09:14:06.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.794+0000 7f38f6827700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f0112220 con 0x7f38f0102140 2024-03-04T09:14:06.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.794+0000 7f38f6827700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f0112520 con 0x7f38f0108150 2024-03-04T09:14:06.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.794+0000 7f38effff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f38f0102140 0x7f38f019e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:06.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.794+0000 7f38ef7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38f0102ae0 0x7f38f019eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:06.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.794+0000 7f38effff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f38f0102140 0x7f38f019e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.82:40754/0 (socket says 172.21.15.82:40754) 2024-03-04T09:14:06.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.794+0000 7f38effff700 1 -- 172.21.15.82:0/1745018636 learned_addr learned my addr 172.21.15.82:0/1745018636 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:06.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.794+0000 7f38f4dc4700 1 --2- 172.21.15.82:0/1745018636 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f38f0108150 0x7f38f01986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:06.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.794+0000 7f38ef7fe700 1 -- 172.21.15.82:0/1745018636 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f38f0108150 msgr2=0x7f38f01986a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:06.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.794+0000 7f38ef7fe700 1 --2- 172.21.15.82:0/1745018636 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f38f0108150 0x7f38f01986a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:06.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.794+0000 7f38ef7fe700 1 -- 172.21.15.82:0/1745018636 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f38f0102140 msgr2=0x7f38f019e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:06.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.794+0000 7f38ef7fe700 1 --2- 172.21.15.82:0/1745018636 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f38f0102140 0x7f38f019e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:06.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.794+0000 7f38ef7fe700 1 -- 172.21.15.82:0/1745018636 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f0198f80 con 0x7f38f0102ae0 2024-03-04T09:14:06.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.794+0000 7f38ef7fe700 1 --2- 172.21.15.82:0/1745018636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38f0102ae0 0x7f38f019eb10 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f38e0006010 tx=0x7f38e0005590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:06.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.794+0000 7f38ed7fa700 1 -- 172.21.15.82:0/1745018636 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e0027070 con 0x7f38f0102ae0 2024-03-04T09:14:06.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.794+0000 7f38f6827700 1 -- 172.21.15.82:0/1745018636 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38f0199210 con 0x7f38f0102ae0 2024-03-04T09:14:06.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.794+0000 7f38ed7fa700 1 -- 172.21.15.82:0/1745018636 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f38e000fdd0 con 0x7f38f0102ae0 2024-03-04T09:14:06.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.794+0000 7f38ed7fa700 1 -- 172.21.15.82:0/1745018636 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e00173f0 con 0x7f38f0102ae0 2024-03-04T09:14:06.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.794+0000 7f38f6827700 1 -- 172.21.15.82:0/1745018636 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38f01a5550 con 0x7f38f0102ae0 2024-03-04T09:14:06.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.795+0000 7f38f6827700 1 -- 172.21.15.82:0/1745018636 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f38f0062790 con 0x7f38f0102ae0 2024-03-04T09:14:06.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.797+0000 7f38ed7fa700 1 -- 172.21.15.82:0/1745018636 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 136807+0+0 (secure 0 0 0) 0x7f38e002a070 con 0x7f38f0102ae0 2024-03-04T09:14:06.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.797+0000 7f38ed7fa700 1 --2- 172.21.15.82:0/1745018636 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f38d80a1ea0 0x7f38d80a4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:06.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.797+0000 7f38effff700 1 --2- 172.21.15.82:0/1745018636 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f38d80a1ea0 0x7f38d80a4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:06.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.797+0000 7f38ed7fa700 1 -- 172.21.15.82:0/1745018636 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8802+0+0 (secure 0 0 0) 0x7f38e00cf0a0 con 0x7f38f0102ae0 2024-03-04T09:14:06.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.797+0000 7f38ed7fa700 1 --2- 172.21.15.82:0/1745018636 >> [v2:172.21.15.190:6808/2171194148,v1:172.21.15.190:6809/2171194148] conn(0x7f38d80acb60 0x7f38d80aefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:06.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.797+0000 7f38ed7fa700 1 -- 172.21.15.82:0/1745018636 --> [v2:172.21.15.190:6808/2171194148,v1:172.21.15.190:6809/2171194148] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f38e0001d30 con 0x7f38d80acb60 2024-03-04T09:14:06.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.797+0000 7f38ed7fa700 1 -- 172.21.15.82:0/1745018636 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) v2 ==== 24+0+0 (secure 0 0 0) 0x7f38e00cf4f0 con 0x7f38f0102ae0 2024-03-04T09:14:06.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.798+0000 7f38effff700 1 --2- 172.21.15.82:0/1745018636 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f38d80a1ea0 0x7f38d80a4360 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f38e4009ce0 tx=0x7f38e4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:06.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.798+0000 7f38f4dc4700 1 --2- 172.21.15.82:0/1745018636 >> [v2:172.21.15.190:6808/2171194148,v1:172.21.15.190:6809/2171194148] conn(0x7f38d80acb60 0x7f38d80aefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:06.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.798+0000 7f38f4dc4700 1 --2- 172.21.15.82:0/1745018636 >> [v2:172.21.15.190:6808/2171194148,v1:172.21.15.190:6809/2171194148] conn(0x7f38d80acb60 0x7f38d80aefa0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:06.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.799+0000 7f38ed7fa700 1 -- 172.21.15.82:0/1745018636 <== osd.5 v2:172.21.15.190:6808/2171194148 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f38e0001d30 con 0x7f38d80acb60 2024-03-04T09:14:06.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.815+0000 7f38f6827700 1 -- 172.21.15.82:0/1745018636 --> [v2:172.21.15.190:6808/2171194148,v1:172.21.15.190:6809/2171194148] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f38f0062b90 con 0x7f38d80acb60 2024-03-04T09:14:06.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.816+0000 7f38ed7fa700 1 -- 172.21.15.82:0/1745018636 <== osd.5 v2:172.21.15.190:6808/2171194148 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f38f0062b90 con 0x7f38d80acb60 2024-03-04T09:14:06.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.816+0000 7f38f6827700 1 -- 172.21.15.82:0/1745018636 >> [v2:172.21.15.190:6808/2171194148,v1:172.21.15.190:6809/2171194148] conn(0x7f38d80acb60 msgr2=0x7f38d80aefa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:06.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.816+0000 7f38f6827700 1 --2- 172.21.15.82:0/1745018636 >> [v2:172.21.15.190:6808/2171194148,v1:172.21.15.190:6809/2171194148] conn(0x7f38d80acb60 0x7f38d80aefa0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:06.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.816+0000 7f38f6827700 1 -- 172.21.15.82:0/1745018636 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f38d80a1ea0 msgr2=0x7f38d80a4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:06.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.816+0000 7f38f6827700 1 --2- 172.21.15.82:0/1745018636 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f38d80a1ea0 0x7f38d80a4360 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f38e4009ce0 tx=0x7f38e4009260 comp rx=0 tx=0).stop 2024-03-04T09:14:06.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.816+0000 7f38f6827700 1 -- 172.21.15.82:0/1745018636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38f0102ae0 msgr2=0x7f38f019eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:06.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.816+0000 7f38f6827700 1 --2- 172.21.15.82:0/1745018636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38f0102ae0 0x7f38f019eb10 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f38e0006010 tx=0x7f38e0005590 comp rx=0 tx=0).stop 2024-03-04T09:14:06.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.816+0000 7f38f4dc4700 1 -- 172.21.15.82:0/1745018636 reap_dead start 2024-03-04T09:14:06.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.816+0000 7f38f6827700 1 -- 172.21.15.82:0/1745018636 shutdown_connections 2024-03-04T09:14:06.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.816+0000 7f38f6827700 1 -- 172.21.15.82:0/1745018636 >> 172.21.15.82:0/1745018636 conn(0x7f38f0079190 msgr2=0x7f38f0100cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:06.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.816+0000 7f38f6827700 1 -- 172.21.15.82:0/1745018636 shutdown_connections 2024-03-04T09:14:06.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.816+0000 7f38f6827700 1 -- 172.21.15.82:0/1745018636 wait complete. 2024-03-04T09:14:07.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:07 smithi082 ceph-mon[32880]: pgmap v317: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 10 op/s 2024-03-04T09:14:07.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:07 smithi190 ceph-mon[36341]: pgmap v317: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 10 op/s 2024-03-04T09:14:07.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:07 smithi102 ceph-mon[36220]: pgmap v317: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 10 op/s 2024-03-04T09:14:07.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.305+0000 7f977a938700 1 -- 172.21.15.82:0/2435313223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9774101610 msgr2=0x7f9774106d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:07.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.305+0000 7f977a938700 1 --2- 172.21.15.82:0/2435313223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9774101610 0x7f9774106d50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f97640099c0 tx=0x7f9764009cd0 comp rx=0 tx=0).stop 2024-03-04T09:14:07.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.305+0000 7f977a938700 1 -- 172.21.15.82:0/2435313223 shutdown_connections 2024-03-04T09:14:07.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.305+0000 7f977a938700 1 --2- 172.21.15.82:0/2435313223 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9774107480 0x7f977410f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:07.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.305+0000 7f977a938700 1 --2- 172.21.15.82:0/2435313223 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9774100c60 0x7f9774101040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:07.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.305+0000 7f977a938700 1 --2- 172.21.15.82:0/2435313223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9774101610 0x7f9774106d50 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:07.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.305+0000 7f977a938700 1 -- 172.21.15.82:0/2435313223 >> 172.21.15.82:0/2435313223 conn(0x7f9774076300 msgr2=0x7f9774076710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:07.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.305+0000 7f977a938700 1 -- 172.21.15.82:0/2435313223 shutdown_connections 2024-03-04T09:14:07.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.305+0000 7f977a938700 1 -- 172.21.15.82:0/2435313223 wait complete. 2024-03-04T09:14:07.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.306+0000 7f977a938700 1 Processor -- start 2024-03-04T09:14:07.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.306+0000 7f977a938700 1 -- start start 2024-03-04T09:14:07.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.306+0000 7f977a938700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9774100c60 0x7f977419e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:07.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.306+0000 7f977a938700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9774101610 0x7f977419eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:07.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.306+0000 7f977a938700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9774107480 0x7f97741986c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:07.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.306+0000 7f977a938700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97741123e0 con 0x7f9774100c60 2024-03-04T09:14:07.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.306+0000 7f977a938700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9774112260 con 0x7f9774101610 2024-03-04T09:14:07.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.306+0000 7f977a938700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9774112560 con 0x7f9774107480 2024-03-04T09:14:07.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.306+0000 7f9773fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9774100c60 0x7f977419e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:07.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.306+0000 7f97737fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9774101610 0x7f977419eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:07.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.306+0000 7f9773fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9774100c60 0x7f977419e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55540/0 (socket says 172.21.15.82:55540) 2024-03-04T09:14:07.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.306+0000 7f9773fff700 1 -- 172.21.15.82:0/2556786298 learned_addr learned my addr 172.21.15.82:0/2556786298 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:07.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.306+0000 7f9778ed5700 1 --2- 172.21.15.82:0/2556786298 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9774107480 0x7f97741986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:07.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.307+0000 7f9773fff700 1 -- 172.21.15.82:0/2556786298 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9774107480 msgr2=0x7f97741986c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:07.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.307+0000 7f9773fff700 1 --2- 172.21.15.82:0/2556786298 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9774107480 0x7f97741986c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:07.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.307+0000 7f9773fff700 1 -- 172.21.15.82:0/2556786298 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9774101610 msgr2=0x7f977419eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:07.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.307+0000 7f9773fff700 1 --2- 172.21.15.82:0/2556786298 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9774101610 0x7f977419eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:07.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.307+0000 7f9773fff700 1 -- 172.21.15.82:0/2556786298 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9774198fa0 con 0x7f9774100c60 2024-03-04T09:14:07.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.307+0000 7f97737fe700 1 --2- 172.21.15.82:0/2556786298 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9774101610 0x7f977419eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:14:07.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.307+0000 7f9773fff700 1 --2- 172.21.15.82:0/2556786298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9774100c60 0x7f977419e5f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f976800e9c0 tx=0x7f976800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:07.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.307+0000 7f97717fa700 1 -- 172.21.15.82:0/2556786298 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976800cbd0 con 0x7f9774100c60 2024-03-04T09:14:07.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.307+0000 7f97717fa700 1 -- 172.21.15.82:0/2556786298 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f976800ee60 con 0x7f9774100c60 2024-03-04T09:14:07.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.307+0000 7f977a938700 1 -- 172.21.15.82:0/2556786298 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9774199290 con 0x7f9774100c60 2024-03-04T09:14:07.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.307+0000 7f97717fa700 1 -- 172.21.15.82:0/2556786298 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97680055f0 con 0x7f9774100c60 2024-03-04T09:14:07.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.307+0000 7f977a938700 1 -- 172.21.15.82:0/2556786298 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97741a5570 con 0x7f9774100c60 2024-03-04T09:14:07.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.308+0000 7f977a938700 1 -- 172.21.15.82:0/2556786298 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9774062850 con 0x7f9774100c60 2024-03-04T09:14:07.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.309+0000 7f97717fa700 1 -- 172.21.15.82:0/2556786298 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 136807+0+0 (secure 0 0 0) 0x7f9768004750 con 0x7f9774100c60 2024-03-04T09:14:07.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.310+0000 7f97717fa700 1 --2- 172.21.15.82:0/2556786298 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f975c0a1ea0 0x7f975c0a4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:07.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.310+0000 7f97737fe700 1 --2- 172.21.15.82:0/2556786298 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f975c0a1ea0 0x7f975c0a4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:07.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.310+0000 7f97717fa700 1 -- 172.21.15.82:0/2556786298 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8802+0+0 (secure 0 0 0) 0x7f97680ce820 con 0x7f9774100c60 2024-03-04T09:14:07.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.310+0000 7f97717fa700 1 --2- 172.21.15.82:0/2556786298 >> [v2:172.21.15.82:6818/454436959,v1:172.21.15.82:6819/454436959] conn(0x7f975c0acb60 0x7f975c0aefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:07.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.310+0000 7f97717fa700 1 -- 172.21.15.82:0/2556786298 --> [v2:172.21.15.82:6818/454436959,v1:172.21.15.82:6819/454436959] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f975c0af670 con 0x7f975c0acb60 2024-03-04T09:14:07.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.310+0000 7f97717fa700 1 -- 172.21.15.82:0/2556786298 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) v2 ==== 24+0+0 (secure 0 0 0) 0x7f97680cec70 con 0x7f9774100c60 2024-03-04T09:14:07.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.310+0000 7f9778ed5700 1 --2- 172.21.15.82:0/2556786298 >> [v2:172.21.15.82:6818/454436959,v1:172.21.15.82:6819/454436959] conn(0x7f975c0acb60 0x7f975c0aefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:07.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.310+0000 7f97737fe700 1 --2- 172.21.15.82:0/2556786298 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f975c0a1ea0 0x7f975c0a4360 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9764009990 tx=0x7f9764005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:07.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.310+0000 7f9778ed5700 1 --2- 172.21.15.82:0/2556786298 >> [v2:172.21.15.82:6818/454436959,v1:172.21.15.82:6819/454436959] conn(0x7f975c0acb60 0x7f975c0aefa0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:07.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.311+0000 7f97717fa700 1 -- 172.21.15.82:0/2556786298 <== osd.6 v2:172.21.15.82:6818/454436959 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f975c0af670 con 0x7f975c0acb60 2024-03-04T09:14:07.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.327+0000 7f977a938700 1 -- 172.21.15.82:0/2556786298 --> [v2:172.21.15.82:6818/454436959,v1:172.21.15.82:6819/454436959] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9774062cd0 con 0x7f975c0acb60 2024-03-04T09:14:07.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.327+0000 7f97717fa700 1 -- 172.21.15.82:0/2556786298 <== osd.6 v2:172.21.15.82:6818/454436959 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f9774062cd0 con 0x7f975c0acb60 2024-03-04T09:14:07.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.327+0000 7f977a938700 1 -- 172.21.15.82:0/2556786298 >> [v2:172.21.15.82:6818/454436959,v1:172.21.15.82:6819/454436959] conn(0x7f975c0acb60 msgr2=0x7f975c0aefa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:07.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.327+0000 7f977a938700 1 --2- 172.21.15.82:0/2556786298 >> [v2:172.21.15.82:6818/454436959,v1:172.21.15.82:6819/454436959] conn(0x7f975c0acb60 0x7f975c0aefa0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:07.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.328+0000 7f977a938700 1 -- 172.21.15.82:0/2556786298 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f975c0a1ea0 msgr2=0x7f975c0a4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:07.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.328+0000 7f977a938700 1 --2- 172.21.15.82:0/2556786298 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f975c0a1ea0 0x7f975c0a4360 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9764009990 tx=0x7f9764005fb0 comp rx=0 tx=0).stop 2024-03-04T09:14:07.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.328+0000 7f977a938700 1 -- 172.21.15.82:0/2556786298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9774100c60 msgr2=0x7f977419e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:07.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.328+0000 7f977a938700 1 --2- 172.21.15.82:0/2556786298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9774100c60 0x7f977419e5f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f976800e9c0 tx=0x7f976800ecd0 comp rx=0 tx=0).stop 2024-03-04T09:14:07.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.328+0000 7f9778ed5700 1 -- 172.21.15.82:0/2556786298 reap_dead start 2024-03-04T09:14:07.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.328+0000 7f977a938700 1 -- 172.21.15.82:0/2556786298 shutdown_connections 2024-03-04T09:14:07.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.328+0000 7f977a938700 1 -- 172.21.15.82:0/2556786298 >> 172.21.15.82:0/2556786298 conn(0x7f9774076300 msgr2=0x7f97741001a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:07.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.328+0000 7f977a938700 1 -- 172.21.15.82:0/2556786298 shutdown_connections 2024-03-04T09:14:07.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:06.328+0000 7f977a938700 1 -- 172.21.15.82:0/2556786298 wait complete. 2024-03-04T09:14:08.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.201+0000 7f7d260cd700 1 -- 172.21.15.82:0/2455943519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d201023a0 msgr2=0x7f7d20102780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:08.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.201+0000 7f7d260cd700 1 --2- 172.21.15.82:0/2455943519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d201023a0 0x7f7d20102780 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7d100099c0 tx=0x7f7d10009cd0 comp rx=0 tx=0).stop 2024-03-04T09:14:08.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.201+0000 7f7d260cd700 1 -- 172.21.15.82:0/2455943519 shutdown_connections 2024-03-04T09:14:08.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.201+0000 7f7d260cd700 1 --2- 172.21.15.82:0/2455943519 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d20107450 0x7f7d2010efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:08.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.201+0000 7f7d260cd700 1 --2- 172.21.15.82:0/2455943519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d201023a0 0x7f7d20102780 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:08.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.201+0000 7f7d260cd700 1 --2- 172.21.15.82:0/2455943519 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7d20102d50 0x7f7d20106d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:08.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.201+0000 7f7d260cd700 1 -- 172.21.15.82:0/2455943519 >> 172.21.15.82:0/2455943519 conn(0x7f7d200791e0 msgr2=0x7f7d200795f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:08.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.201+0000 7f7d260cd700 1 -- 172.21.15.82:0/2455943519 shutdown_connections 2024-03-04T09:14:08.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.201+0000 7f7d260cd700 1 -- 172.21.15.82:0/2455943519 wait complete. 2024-03-04T09:14:08.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.201+0000 7f7d260cd700 1 Processor -- start 2024-03-04T09:14:08.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.202+0000 7f7d260cd700 1 -- start start 2024-03-04T09:14:08.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.202+0000 7f7d260cd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d201023a0 0x7f7d2019e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:08.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.202+0000 7f7d260cd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d20102d50 0x7f7d2019eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:08.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.202+0000 7f7d260cd700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7d20107450 0x7f7d201986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:08.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.202+0000 7f7d260cd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d20112400 con 0x7f7d20102d50 2024-03-04T09:14:08.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.202+0000 7f7d260cd700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d20112280 con 0x7f7d20107450 2024-03-04T09:14:08.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.202+0000 7f7d260cd700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d20112580 con 0x7f7d201023a0 2024-03-04T09:14:08.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.202+0000 7f7d1effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d20102d50 0x7f7d2019eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:08.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.202+0000 7f7d1effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d20102d50 0x7f7d2019eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49670/0 (socket says 172.21.15.82:49670) 2024-03-04T09:14:08.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.202+0000 7f7d1effd700 1 -- 172.21.15.82:0/3650685153 learned_addr learned my addr 172.21.15.82:0/3650685153 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:08.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.202+0000 7f7d1f7fe700 1 --2- 172.21.15.82:0/3650685153 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d201023a0 0x7f7d2019e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:08.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.202+0000 7f7d1ffff700 1 --2- 172.21.15.82:0/3650685153 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7d20107450 0x7f7d201986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:08.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.202+0000 7f7d1effd700 1 -- 172.21.15.82:0/3650685153 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d201023a0 msgr2=0x7f7d2019e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:08.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.202+0000 7f7d1effd700 1 --2- 172.21.15.82:0/3650685153 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d201023a0 0x7f7d2019e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:08.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.202+0000 7f7d1effd700 1 -- 172.21.15.82:0/3650685153 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7d20107450 msgr2=0x7f7d201986a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:08.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.202+0000 7f7d1effd700 1 --2- 172.21.15.82:0/3650685153 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7d20107450 0x7f7d201986a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:08.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.202+0000 7f7d1effd700 1 -- 172.21.15.82:0/3650685153 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d20198f80 con 0x7f7d20102d50 2024-03-04T09:14:08.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.202+0000 7f7d1ffff700 1 --2- 172.21.15.82:0/3650685153 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7d20107450 0x7f7d201986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:14:08.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.202+0000 7f7d1f7fe700 1 --2- 172.21.15.82:0/3650685153 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d201023a0 0x7f7d2019e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:14:08.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.202+0000 7f7d1effd700 1 --2- 172.21.15.82:0/3650685153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d20102d50 0x7f7d2019eb10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7d1400e940 tx=0x7f7d1400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:08.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.203+0000 7f7d1cff9700 1 -- 172.21.15.82:0/3650685153 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1400c9e0 con 0x7f7d20102d50 2024-03-04T09:14:08.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.203+0000 7f7d260cd700 1 -- 172.21.15.82:0/3650685153 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d20199270 con 0x7f7d20102d50 2024-03-04T09:14:08.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.203+0000 7f7d1cff9700 1 -- 172.21.15.82:0/3650685153 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f7d1400cb80 con 0x7f7d20102d50 2024-03-04T09:14:08.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.203+0000 7f7d1cff9700 1 -- 172.21.15.82:0/3650685153 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d14018680 con 0x7f7d20102d50 2024-03-04T09:14:08.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.203+0000 7f7d260cd700 1 -- 172.21.15.82:0/3650685153 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d201a5550 con 0x7f7d20102d50 2024-03-04T09:14:08.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.204+0000 7f7d260cd700 1 -- 172.21.15.82:0/3650685153 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7d200627d0 con 0x7f7d20102d50 2024-03-04T09:14:08.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.205+0000 7f7d1cff9700 1 -- 172.21.15.82:0/3650685153 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 136807+0+0 (secure 0 0 0) 0x7f7d14010430 con 0x7f7d20102d50 2024-03-04T09:14:08.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.205+0000 7f7d1cff9700 1 --2- 172.21.15.82:0/3650685153 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f7d080a1ea0 0x7f7d080a4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:08.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.205+0000 7f7d1f7fe700 1 --2- 172.21.15.82:0/3650685153 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f7d080a1ea0 0x7f7d080a4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:08.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.205+0000 7f7d1cff9700 1 -- 172.21.15.82:0/3650685153 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8802+0+0 (secure 0 0 0) 0x7f7d140ce960 con 0x7f7d20102d50 2024-03-04T09:14:08.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.206+0000 7f7d1cff9700 1 --2- 172.21.15.82:0/3650685153 >> [v2:172.21.15.190:6816/1679683516,v1:172.21.15.190:6817/1679683516] conn(0x7f7d080acae0 0x7f7d080aef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:08.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.206+0000 7f7d1cff9700 1 -- 172.21.15.82:0/3650685153 --> [v2:172.21.15.190:6816/1679683516,v1:172.21.15.190:6817/1679683516] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7d14001d30 con 0x7f7d080acae0 2024-03-04T09:14:08.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.206+0000 7f7d1cff9700 1 -- 172.21.15.82:0/3650685153 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d140cedb0 con 0x7f7d20102d50 2024-03-04T09:14:08.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.206+0000 7f7d1ffff700 1 --2- 172.21.15.82:0/3650685153 >> [v2:172.21.15.190:6816/1679683516,v1:172.21.15.190:6817/1679683516] conn(0x7f7d080acae0 0x7f7d080aef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:08.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.206+0000 7f7d1f7fe700 1 --2- 172.21.15.82:0/3650685153 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f7d080a1ea0 0x7f7d080a4360 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7d10000c00 tx=0x7f7d10005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:08.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.206+0000 7f7d1ffff700 1 --2- 172.21.15.82:0/3650685153 >> [v2:172.21.15.190:6816/1679683516,v1:172.21.15.190:6817/1679683516] conn(0x7f7d080acae0 0x7f7d080aef20 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:08.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.207+0000 7f7d1cff9700 1 -- 172.21.15.82:0/3650685153 <== osd.8 v2:172.21.15.190:6816/1679683516 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f7d14001d30 con 0x7f7d080acae0 2024-03-04T09:14:08.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.223+0000 7f7d260cd700 1 -- 172.21.15.82:0/3650685153 --> [v2:172.21.15.190:6816/1679683516,v1:172.21.15.190:6817/1679683516] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7d20062c00 con 0x7f7d080acae0 2024-03-04T09:14:08.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.224+0000 7f7d1cff9700 1 -- 172.21.15.82:0/3650685153 <== osd.8 v2:172.21.15.190:6816/1679683516 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f7d20062c00 con 0x7f7d080acae0 2024-03-04T09:14:08.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.224+0000 7f7d260cd700 1 -- 172.21.15.82:0/3650685153 >> [v2:172.21.15.190:6816/1679683516,v1:172.21.15.190:6817/1679683516] conn(0x7f7d080acae0 msgr2=0x7f7d080aef20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:08.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.224+0000 7f7d260cd700 1 --2- 172.21.15.82:0/3650685153 >> [v2:172.21.15.190:6816/1679683516,v1:172.21.15.190:6817/1679683516] conn(0x7f7d080acae0 0x7f7d080aef20 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:08.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.224+0000 7f7d260cd700 1 -- 172.21.15.82:0/3650685153 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f7d080a1ea0 msgr2=0x7f7d080a4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:08.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.224+0000 7f7d260cd700 1 --2- 172.21.15.82:0/3650685153 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f7d080a1ea0 0x7f7d080a4360 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7d10000c00 tx=0x7f7d10005fb0 comp rx=0 tx=0).stop 2024-03-04T09:14:08.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.224+0000 7f7d260cd700 1 -- 172.21.15.82:0/3650685153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d20102d50 msgr2=0x7f7d2019eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:08.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.224+0000 7f7d260cd700 1 --2- 172.21.15.82:0/3650685153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d20102d50 0x7f7d2019eb10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7d1400e940 tx=0x7f7d1400ec50 comp rx=0 tx=0).stop 2024-03-04T09:14:08.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.224+0000 7f7d1ffff700 1 -- 172.21.15.82:0/3650685153 reap_dead start 2024-03-04T09:14:08.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.224+0000 7f7d260cd700 1 -- 172.21.15.82:0/3650685153 shutdown_connections 2024-03-04T09:14:08.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.224+0000 7f7d260cd700 1 -- 172.21.15.82:0/3650685153 >> 172.21.15.82:0/3650685153 conn(0x7f7d200791e0 msgr2=0x7f7d20101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:08.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.224+0000 7f7d260cd700 1 -- 172.21.15.82:0/3650685153 shutdown_connections 2024-03-04T09:14:08.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.224+0000 7f7d260cd700 1 -- 172.21.15.82:0/3650685153 wait complete. 2024-03-04T09:14:08.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.863+0000 7f1efa545700 1 -- 172.21.15.82:0/1461989083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ef4101c60 msgr2=0x7f1ef410de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:08.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.863+0000 7f1efa545700 1 --2- 172.21.15.82:0/1461989083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ef4101c60 0x7f1ef410de80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1eec00b0d0 tx=0x7f1eec00b3e0 comp rx=0 tx=0).stop 2024-03-04T09:14:08.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.863+0000 7f1efa545700 1 -- 172.21.15.82:0/1461989083 shutdown_connections 2024-03-04T09:14:08.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.863+0000 7f1efa545700 1 --2- 172.21.15.82:0/1461989083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ef4101c60 0x7f1ef410de80 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:08.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.863+0000 7f1efa545700 1 --2- 172.21.15.82:0/1461989083 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1ef41070f0 0x7f1ef41074d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:08.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.863+0000 7f1efa545700 1 --2- 172.21.15.82:0/1461989083 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ef41012a0 0x7f1ef4101720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:08.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.863+0000 7f1efa545700 1 -- 172.21.15.82:0/1461989083 >> 172.21.15.82:0/1461989083 conn(0x7f1ef4077e80 msgr2=0x7f1ef4078290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:08.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.863+0000 7f1efa545700 1 -- 172.21.15.82:0/1461989083 shutdown_connections 2024-03-04T09:14:08.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.863+0000 7f1efa545700 1 -- 172.21.15.82:0/1461989083 wait complete. 2024-03-04T09:14:08.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.864+0000 7f1efa545700 1 Processor -- start 2024-03-04T09:14:08.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.864+0000 7f1efa545700 1 -- start start 2024-03-04T09:14:08.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.864+0000 7f1efa545700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ef41012a0 0x7f1ef4199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:08.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.864+0000 7f1efa545700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1ef4101c60 0x7f1ef4199bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:08.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.864+0000 7f1efa545700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ef41070f0 0x7f1ef41a46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:08.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.864+0000 7f1efa545700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef4111290 con 0x7f1ef41012a0 2024-03-04T09:14:08.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.864+0000 7f1efa545700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef4111110 con 0x7f1ef41070f0 2024-03-04T09:14:08.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.864+0000 7f1efa545700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef4111410 con 0x7f1ef4101c60 2024-03-04T09:14:08.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.864+0000 7f1ef3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ef41012a0 0x7f1ef4199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:08.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.864+0000 7f1ef3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ef41012a0 0x7f1ef4199670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49694/0 (socket says 172.21.15.82:49694) 2024-03-04T09:14:08.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.864+0000 7f1ef3fff700 1 -- 172.21.15.82:0/1419226592 learned_addr learned my addr 172.21.15.82:0/1419226592 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:08.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.864+0000 7f1ef37fe700 1 --2- 172.21.15.82:0/1419226592 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1ef4101c60 0x7f1ef4199bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:08.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.864+0000 7f1ef8ae2700 1 --2- 172.21.15.82:0/1419226592 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ef41070f0 0x7f1ef41a46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:08.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.865+0000 7f1ef37fe700 1 -- 172.21.15.82:0/1419226592 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ef41070f0 msgr2=0x7f1ef41a46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:08.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.865+0000 7f1ef37fe700 1 --2- 172.21.15.82:0/1419226592 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ef41070f0 0x7f1ef41a46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:08.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.865+0000 7f1ef37fe700 1 -- 172.21.15.82:0/1419226592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ef41012a0 msgr2=0x7f1ef4199670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:08.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.865+0000 7f1ef37fe700 1 --2- 172.21.15.82:0/1419226592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ef41012a0 0x7f1ef4199670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:08.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.865+0000 7f1ef37fe700 1 -- 172.21.15.82:0/1419226592 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef41a4c30 con 0x7f1ef4101c60 2024-03-04T09:14:08.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.865+0000 7f1ef3fff700 1 --2- 172.21.15.82:0/1419226592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ef41012a0 0x7f1ef4199670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:14:08.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.865+0000 7f1ef37fe700 1 --2- 172.21.15.82:0/1419226592 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1ef4101c60 0x7f1ef4199bb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1ee800e9f0 tx=0x7f1ee800ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:08.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.865+0000 7f1ef17fa700 1 -- 172.21.15.82:0/1419226592 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee800cb70 con 0x7f1ef4101c60 2024-03-04T09:14:08.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.865+0000 7f1efa545700 1 -- 172.21.15.82:0/1419226592 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ef41a4e60 con 0x7f1ef4101c60 2024-03-04T09:14:08.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.865+0000 7f1ef17fa700 1 -- 172.21.15.82:0/1419226592 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f1ee800ee90 con 0x7f1ef4101c60 2024-03-04T09:14:08.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.865+0000 7f1ef17fa700 1 -- 172.21.15.82:0/1419226592 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee8003d40 con 0x7f1ef4101c60 2024-03-04T09:14:08.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.865+0000 7f1efa545700 1 -- 172.21.15.82:0/1419226592 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ef41a5310 con 0x7f1ef4101c60 2024-03-04T09:14:08.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.866+0000 7f1edaffd700 1 -- 172.21.15.82:0/1419226592 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1ef4062790 con 0x7f1ef4101c60 2024-03-04T09:14:08.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.868+0000 7f1ef17fa700 1 -- 172.21.15.82:0/1419226592 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 17) v1 ==== 136807+0+0 (secure 0 0 0) 0x7f1ee8003ee0 con 0x7f1ef4101c60 2024-03-04T09:14:08.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.868+0000 7f1ef17fa700 1 --2- 172.21.15.82:0/1419226592 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f1edc0a1ea0 0x7f1edc0a4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:08.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.868+0000 7f1ef3fff700 1 --2- 172.21.15.82:0/1419226592 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f1edc0a1ea0 0x7f1edc0a4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:08.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.868+0000 7f1ef17fa700 1 -- 172.21.15.82:0/1419226592 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8802+0+0 (secure 0 0 0) 0x7f1ee80ce5c0 con 0x7f1ef4101c60 2024-03-04T09:14:08.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.868+0000 7f1ef17fa700 1 --2- 172.21.15.82:0/1419226592 >> [v2:172.21.15.102:6808/1229627753,v1:172.21.15.102:6809/1229627753] conn(0x7f1edc0acb60 0x7f1edc0aefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:08.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.868+0000 7f1ef17fa700 1 -- 172.21.15.82:0/1419226592 --> [v2:172.21.15.102:6808/1229627753,v1:172.21.15.102:6809/1229627753] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1edc0af670 con 0x7f1edc0acb60 2024-03-04T09:14:08.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.868+0000 7f1ef17fa700 1 -- 172.21.15.82:0/1419226592 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1ee80ce970 con 0x7f1ef4101c60 2024-03-04T09:14:08.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.869+0000 7f1ef3fff700 1 --2- 172.21.15.82:0/1419226592 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f1edc0a1ea0 0x7f1edc0a4360 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4011550 tx=0x7f1ee4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:08.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.869+0000 7f1ef8ae2700 1 --2- 172.21.15.82:0/1419226592 >> [v2:172.21.15.102:6808/1229627753,v1:172.21.15.102:6809/1229627753] conn(0x7f1edc0acb60 0x7f1edc0aefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:08.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.869+0000 7f1ef8ae2700 1 --2- 172.21.15.82:0/1419226592 >> [v2:172.21.15.102:6808/1229627753,v1:172.21.15.102:6809/1229627753] conn(0x7f1edc0acb60 0x7f1edc0aefa0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:08.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.870+0000 7f1ef17fa700 1 -- 172.21.15.82:0/1419226592 <== osd.4 v2:172.21.15.102:6808/1229627753 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f1edc0af670 con 0x7f1edc0acb60 2024-03-04T09:14:08.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.886+0000 7f1edaffd700 1 -- 172.21.15.82:0/1419226592 --> [v2:172.21.15.102:6808/1229627753,v1:172.21.15.102:6809/1229627753] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1ef4062c10 con 0x7f1edc0acb60 2024-03-04T09:14:08.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.887+0000 7f1ef17fa700 1 -- 172.21.15.82:0/1419226592 <== osd.4 v2:172.21.15.102:6808/1229627753 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f1ef4062c10 con 0x7f1edc0acb60 2024-03-04T09:14:08.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.887+0000 7f1edaffd700 1 -- 172.21.15.82:0/1419226592 >> [v2:172.21.15.102:6808/1229627753,v1:172.21.15.102:6809/1229627753] conn(0x7f1edc0acb60 msgr2=0x7f1edc0aefa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:08.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.887+0000 7f1edaffd700 1 --2- 172.21.15.82:0/1419226592 >> [v2:172.21.15.102:6808/1229627753,v1:172.21.15.102:6809/1229627753] conn(0x7f1edc0acb60 0x7f1edc0aefa0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:08.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.887+0000 7f1edaffd700 1 -- 172.21.15.82:0/1419226592 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f1edc0a1ea0 msgr2=0x7f1edc0a4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:08.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.887+0000 7f1edaffd700 1 --2- 172.21.15.82:0/1419226592 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f1edc0a1ea0 0x7f1edc0a4360 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4011550 tx=0x7f1ee4009260 comp rx=0 tx=0).stop 2024-03-04T09:14:08.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.887+0000 7f1edaffd700 1 -- 172.21.15.82:0/1419226592 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1ef4101c60 msgr2=0x7f1ef4199bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:08.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.887+0000 7f1edaffd700 1 --2- 172.21.15.82:0/1419226592 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1ef4101c60 0x7f1ef4199bb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1ee800e9f0 tx=0x7f1ee800ed00 comp rx=0 tx=0).stop 2024-03-04T09:14:08.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.887+0000 7f1ef8ae2700 1 -- 172.21.15.82:0/1419226592 reap_dead start 2024-03-04T09:14:08.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.887+0000 7f1edaffd700 1 -- 172.21.15.82:0/1419226592 shutdown_connections 2024-03-04T09:14:08.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.887+0000 7f1edaffd700 1 -- 172.21.15.82:0/1419226592 >> 172.21.15.82:0/1419226592 conn(0x7f1ef4077e80 msgr2=0x7f1ef40fffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:08.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.887+0000 7f1edaffd700 1 -- 172.21.15.82:0/1419226592 shutdown_connections 2024-03-04T09:14:08.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:08.887+0000 7f1edaffd700 1 -- 172.21.15.82:0/1419226592 wait complete. 2024-03-04T09:14:09.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:09 smithi190 ceph-mon[36341]: pgmap v318: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 11 op/s 2024-03-04T09:14:09.675 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:09 smithi082 ceph-mon[32880]: pgmap v318: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 11 op/s 2024-03-04T09:14:09.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:09 smithi102 ceph-mon[36220]: pgmap v318: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 11 op/s 2024-03-04T09:14:10.641 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:10 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:14:10.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.656+0000 7f2c31c88700 1 -- 172.21.15.82:0/3534908764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c2c101960 msgr2=0x7f2c2c10de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:10.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.656+0000 7f2c31c88700 1 --2- 172.21.15.82:0/3534908764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c2c101960 0x7f2c2c10de40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2c24009990 tx=0x7f2c24009ca0 comp rx=0 tx=0).stop 2024-03-04T09:14:10.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.656+0000 7f2c31c88700 1 -- 172.21.15.82:0/3534908764 shutdown_connections 2024-03-04T09:14:10.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.656+0000 7f2c31c88700 1 --2- 172.21.15.82:0/3534908764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c2c101960 0x7f2c2c10de40 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:10.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.656+0000 7f2c31c88700 1 --2- 172.21.15.82:0/3534908764 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c2c107000 0x7f2c2c1073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:10.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.656+0000 7f2c31c88700 1 --2- 172.21.15.82:0/3534908764 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2c2c100fc0 0x7f2c2c101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:10.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.656+0000 7f2c31c88700 1 -- 172.21.15.82:0/3534908764 >> 172.21.15.82:0/3534908764 conn(0x7f2c2c077ef0 msgr2=0x7f2c2c078300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:10.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.656+0000 7f2c31c88700 1 -- 172.21.15.82:0/3534908764 shutdown_connections 2024-03-04T09:14:10.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.656+0000 7f2c31c88700 1 -- 172.21.15.82:0/3534908764 wait complete. 2024-03-04T09:14:10.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.656+0000 7f2c31c88700 1 Processor -- start 2024-03-04T09:14:10.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.656+0000 7f2c31c88700 1 -- start start 2024-03-04T09:14:10.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.657+0000 7f2c31c88700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2c2c100fc0 0x7f2c2c102c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:10.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.657+0000 7f2c31c88700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c2c101960 0x7f2c2c1031b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:10.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.657+0000 7f2c31c88700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c2c107000 0x7f2c2c1036f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:10.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.657+0000 7f2c31c88700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2c111290 con 0x7f2c2c107000 2024-03-04T09:14:10.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.657+0000 7f2c31c88700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2c111110 con 0x7f2c2c101960 2024-03-04T09:14:10.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.657+0000 7f2c31c88700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2c111410 con 0x7f2c2c100fc0 2024-03-04T09:14:10.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.657+0000 7f2c2affd700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c2c101960 0x7f2c2c1031b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:10.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.657+0000 7f2c2b7fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2c2c100fc0 0x7f2c2c102c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:10.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.657+0000 7f2c2bfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c2c107000 0x7f2c2c1036f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:10.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.657+0000 7f2c2affd700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c2c101960 0x7f2c2c1031b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.82:40816/0 (socket says 172.21.15.82:40816) 2024-03-04T09:14:10.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.657+0000 7f2c2affd700 1 -- 172.21.15.82:0/4286835744 learned_addr learned my addr 172.21.15.82:0/4286835744 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:10.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.657+0000 7f2c2affd700 1 -- 172.21.15.82:0/4286835744 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2c2c100fc0 msgr2=0x7f2c2c102c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:10.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.657+0000 7f2c2affd700 1 --2- 172.21.15.82:0/4286835744 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2c2c100fc0 0x7f2c2c102c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:10.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.657+0000 7f2c2affd700 1 -- 172.21.15.82:0/4286835744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c2c107000 msgr2=0x7f2c2c1036f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:10.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.657+0000 7f2c2affd700 1 --2- 172.21.15.82:0/4286835744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c2c107000 0x7f2c2c1036f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:10.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.657+0000 7f2c2affd700 1 -- 172.21.15.82:0/4286835744 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c2c1a6d60 con 0x7f2c2c101960 2024-03-04T09:14:10.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.657+0000 7f2c2bfff700 1 --2- 172.21.15.82:0/4286835744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c2c107000 0x7f2c2c1036f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:14:10.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.657+0000 7f2c2affd700 1 --2- 172.21.15.82:0/4286835744 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c2c101960 0x7f2c2c1031b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2c2000d980 tx=0x7f2c2000dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:10.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.657+0000 7f2c28ff9700 1 -- 172.21.15.82:0/4286835744 <== mon.2 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c20016070 con 0x7f2c2c101960 2024-03-04T09:14:10.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.657+0000 7f2c31c88700 1 -- 172.21.15.82:0/4286835744 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c2c1a6ff0 con 0x7f2c2c101960 2024-03-04T09:14:10.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.658+0000 7f2c28ff9700 1 -- 172.21.15.82:0/4286835744 <== mon.2 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f2c20004d00 con 0x7f2c2c101960 2024-03-04T09:14:10.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.658+0000 7f2c28ff9700 1 -- 172.21.15.82:0/4286835744 <== mon.2 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c200055d0 con 0x7f2c2c101960 2024-03-04T09:14:10.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.658+0000 7f2c31c88700 1 -- 172.21.15.82:0/4286835744 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c2c1a7550 con 0x7f2c2c101960 2024-03-04T09:14:10.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.658+0000 7f2c31c88700 1 -- 172.21.15.82:0/4286835744 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2c2c105020 con 0x7f2c2c101960 2024-03-04T09:14:10.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.660+0000 7f2c28ff9700 1 -- 172.21.15.82:0/4286835744 <== mon.2 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 17) v1 ==== 136807+0+0 (secure 0 0 0) 0x7f2c20004750 con 0x7f2c2c101960 2024-03-04T09:14:10.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.660+0000 7f2c28ff9700 1 --2- 172.21.15.82:0/4286835744 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f2c140a1ea0 0x7f2c140a4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:10.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.661+0000 7f2c2b7fe700 1 --2- 172.21.15.82:0/4286835744 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f2c140a1ea0 0x7f2c140a4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:10.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.661+0000 7f2c28ff9700 1 -- 172.21.15.82:0/4286835744 <== mon.2 v2:172.21.15.102:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8802+0+0 (secure 0 0 0) 0x7f2c200ce5a0 con 0x7f2c2c101960 2024-03-04T09:14:10.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.661+0000 7f2c28ff9700 1 --2- 172.21.15.82:0/4286835744 >> [v2:172.21.15.102:6816/2745057274,v1:172.21.15.102:6817/2745057274] conn(0x7f2c140acb60 0x7f2c140aefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:10.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.661+0000 7f2c28ff9700 1 -- 172.21.15.82:0/4286835744 --> [v2:172.21.15.102:6816/2745057274,v1:172.21.15.102:6817/2745057274] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2c20015ec0 con 0x7f2c140acb60 2024-03-04T09:14:10.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.661+0000 7f2c28ff9700 1 -- 172.21.15.82:0/4286835744 <== mon.2 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c200ce9f0 con 0x7f2c2c101960 2024-03-04T09:14:10.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.661+0000 7f2c2bfff700 1 --2- 172.21.15.82:0/4286835744 >> [v2:172.21.15.102:6816/2745057274,v1:172.21.15.102:6817/2745057274] conn(0x7f2c140acb60 0x7f2c140aefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:10.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.661+0000 7f2c2b7fe700 1 --2- 172.21.15.82:0/4286835744 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f2c140a1ea0 0x7f2c140a4360 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c00f540 tx=0x7f2c1c00b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:10.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.661+0000 7f2c2bfff700 1 --2- 172.21.15.82:0/4286835744 >> [v2:172.21.15.102:6816/2745057274,v1:172.21.15.102:6817/2745057274] conn(0x7f2c140acb60 0x7f2c140aefa0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:10.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.663+0000 7f2c28ff9700 1 -- 172.21.15.82:0/4286835744 <== osd.7 v2:172.21.15.102:6816/2745057274 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f2c20015ec0 con 0x7f2c140acb60 2024-03-04T09:14:10.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:10 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:14:10.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.679+0000 7f2c31c88700 1 -- 172.21.15.82:0/4286835744 --> [v2:172.21.15.102:6816/2745057274,v1:172.21.15.102:6817/2745057274] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2c2c1026b0 con 0x7f2c140acb60 2024-03-04T09:14:10.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.679+0000 7f2c28ff9700 1 -- 172.21.15.82:0/4286835744 <== osd.7 v2:172.21.15.102:6816/2745057274 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f2c2c1026b0 con 0x7f2c140acb60 2024-03-04T09:14:10.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.679+0000 7f2c31c88700 1 -- 172.21.15.82:0/4286835744 >> [v2:172.21.15.102:6816/2745057274,v1:172.21.15.102:6817/2745057274] conn(0x7f2c140acb60 msgr2=0x7f2c140aefa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:10.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.679+0000 7f2c31c88700 1 --2- 172.21.15.82:0/4286835744 >> [v2:172.21.15.102:6816/2745057274,v1:172.21.15.102:6817/2745057274] conn(0x7f2c140acb60 0x7f2c140aefa0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:10.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.679+0000 7f2c31c88700 1 -- 172.21.15.82:0/4286835744 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f2c140a1ea0 msgr2=0x7f2c140a4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:10.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.679+0000 7f2c31c88700 1 --2- 172.21.15.82:0/4286835744 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f2c140a1ea0 0x7f2c140a4360 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c00f540 tx=0x7f2c1c00b040 comp rx=0 tx=0).stop 2024-03-04T09:14:10.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.679+0000 7f2c31c88700 1 -- 172.21.15.82:0/4286835744 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c2c101960 msgr2=0x7f2c2c1031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:10.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.679+0000 7f2c31c88700 1 --2- 172.21.15.82:0/4286835744 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c2c101960 0x7f2c2c1031b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2c2000d980 tx=0x7f2c2000dc90 comp rx=0 tx=0).stop 2024-03-04T09:14:10.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.679+0000 7f2c2bfff700 1 -- 172.21.15.82:0/4286835744 reap_dead start 2024-03-04T09:14:10.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.680+0000 7f2c31c88700 1 -- 172.21.15.82:0/4286835744 shutdown_connections 2024-03-04T09:14:10.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.680+0000 7f2c31c88700 1 -- 172.21.15.82:0/4286835744 >> 172.21.15.82:0/4286835744 conn(0x7f2c2c077ef0 msgr2=0x7f2c2c1002f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:10.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.680+0000 7f2c31c88700 1 -- 172.21.15.82:0/4286835744 shutdown_connections 2024-03-04T09:14:10.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.680+0000 7f2c31c88700 1 -- 172.21.15.82:0/4286835744 wait complete. 2024-03-04T09:14:10.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:10 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:14:10.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.849+0000 7fd49a1bc700 1 -- 172.21.15.82:0/3027445005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd494107000 msgr2=0x7fd4941073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:10.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.849+0000 7fd49a1bc700 1 --2- 172.21.15.82:0/3027445005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd494107000 0x7fd4941073e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd48c009990 tx=0x7fd48c009ca0 comp rx=0 tx=0).stop 2024-03-04T09:14:10.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.849+0000 7fd49a1bc700 1 -- 172.21.15.82:0/3027445005 shutdown_connections 2024-03-04T09:14:10.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.849+0000 7fd49a1bc700 1 --2- 172.21.15.82:0/3027445005 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd494101960 0x7fd49410de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:10.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.849+0000 7fd49a1bc700 1 --2- 172.21.15.82:0/3027445005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd494107000 0x7fd4941073e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:10.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.849+0000 7fd49a1bc700 1 --2- 172.21.15.82:0/3027445005 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd494100fc0 0x7fd494101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:10.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.849+0000 7fd49a1bc700 1 -- 172.21.15.82:0/3027445005 >> 172.21.15.82:0/3027445005 conn(0x7fd494077ef0 msgr2=0x7fd494078300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:10.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.849+0000 7fd49a1bc700 1 -- 172.21.15.82:0/3027445005 shutdown_connections 2024-03-04T09:14:10.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.849+0000 7fd49a1bc700 1 -- 172.21.15.82:0/3027445005 wait complete. 2024-03-04T09:14:10.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.849+0000 7fd49a1bc700 1 Processor -- start 2024-03-04T09:14:10.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.849+0000 7fd49a1bc700 1 -- start start 2024-03-04T09:14:10.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.850+0000 7fd49a1bc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd494100fc0 0x7fd49419d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:10.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.850+0000 7fd49a1bc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd494101960 0x7fd49419d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:10.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.850+0000 7fd49a1bc700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd494107000 0x7fd494197590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:10.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.850+0000 7fd49a1bc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd494111250 con 0x7fd494100fc0 2024-03-04T09:14:10.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.850+0000 7fd49a1bc700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4941110d0 con 0x7fd494107000 2024-03-04T09:14:10.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.850+0000 7fd49a1bc700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4941113d0 con 0x7fd494101960 2024-03-04T09:14:10.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.850+0000 7fd4937fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd494100fc0 0x7fd49419d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:10.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.850+0000 7fd4937fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd494100fc0 0x7fd49419d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49740/0 (socket says 172.21.15.82:49740) 2024-03-04T09:14:10.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.850+0000 7fd4937fe700 1 -- 172.21.15.82:0/207638374 learned_addr learned my addr 172.21.15.82:0/207638374 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:10.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.850+0000 7fd493fff700 1 --2- 172.21.15.82:0/207638374 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd494107000 0x7fd494197590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:10.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.850+0000 7fd492ffd700 1 --2- 172.21.15.82:0/207638374 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd494101960 0x7fd49419d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:10.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.850+0000 7fd4937fe700 1 -- 172.21.15.82:0/207638374 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd494101960 msgr2=0x7fd49419d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:10.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.850+0000 7fd4937fe700 1 --2- 172.21.15.82:0/207638374 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd494101960 0x7fd49419d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:10.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.850+0000 7fd4937fe700 1 -- 172.21.15.82:0/207638374 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd494107000 msgr2=0x7fd494197590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:10.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.850+0000 7fd4937fe700 1 --2- 172.21.15.82:0/207638374 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd494107000 0x7fd494197590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:10.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.850+0000 7fd4937fe700 1 -- 172.21.15.82:0/207638374 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd494197cf0 con 0x7fd494100fc0 2024-03-04T09:14:10.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.850+0000 7fd493fff700 1 --2- 172.21.15.82:0/207638374 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd494107000 0x7fd494197590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:14:10.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.850+0000 7fd492ffd700 1 --2- 172.21.15.82:0/207638374 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd494101960 0x7fd49419d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:14:10.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.850+0000 7fd4937fe700 1 --2- 172.21.15.82:0/207638374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd494100fc0 0x7fd49419d3d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd48c0057c0 tx=0x7fd48c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:10.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.851+0000 7fd490ff9700 1 -- 172.21.15.82:0/207638374 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48c026070 con 0x7fd494100fc0 2024-03-04T09:14:10.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.851+0000 7fd490ff9700 1 -- 172.21.15.82:0/207638374 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fd48c00fb40 con 0x7fd494100fc0 2024-03-04T09:14:10.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.851+0000 7fd49a1bc700 1 -- 172.21.15.82:0/207638374 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd494197f80 con 0x7fd494100fc0 2024-03-04T09:14:10.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.851+0000 7fd49a1bc700 1 -- 172.21.15.82:0/207638374 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4941a42a0 con 0x7fd494100fc0 2024-03-04T09:14:10.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.851+0000 7fd490ff9700 1 -- 172.21.15.82:0/207638374 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48c0173f0 con 0x7fd494100fc0 2024-03-04T09:14:10.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.851+0000 7fd49a1bc700 1 -- 172.21.15.82:0/207638374 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd494062850 con 0x7fd494100fc0 2024-03-04T09:14:10.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.853+0000 7fd490ff9700 1 -- 172.21.15.82:0/207638374 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 136807+0+0 (secure 0 0 0) 0x7fd48c029070 con 0x7fd494100fc0 2024-03-04T09:14:10.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.853+0000 7fd490ff9700 1 --2- 172.21.15.82:0/207638374 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fd47c0a1ea0 0x7fd47c0a4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:10.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.853+0000 7fd492ffd700 1 --2- 172.21.15.82:0/207638374 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fd47c0a1ea0 0x7fd47c0a4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:10.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.853+0000 7fd490ff9700 1 -- 172.21.15.82:0/207638374 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8802+0+0 (secure 0 0 0) 0x7fd48c0ceff0 con 0x7fd494100fc0 2024-03-04T09:14:10.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.853+0000 7fd490ff9700 1 --2- 172.21.15.82:0/207638374 >> [v2:172.21.15.82:6810/980870924,v1:172.21.15.82:6811/980870924] conn(0x7fd47c0acb60 0x7fd47c0aefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:10.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.854+0000 7fd490ff9700 1 -- 172.21.15.82:0/207638374 --> [v2:172.21.15.82:6810/980870924,v1:172.21.15.82:6811/980870924] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd48c01eec0 con 0x7fd47c0acb60 2024-03-04T09:14:10.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.854+0000 7fd490ff9700 1 -- 172.21.15.82:0/207638374 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd48c0cf440 con 0x7fd494100fc0 2024-03-04T09:14:10.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.854+0000 7fd493fff700 1 --2- 172.21.15.82:0/207638374 >> [v2:172.21.15.82:6810/980870924,v1:172.21.15.82:6811/980870924] conn(0x7fd47c0acb60 0x7fd47c0aefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:10.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.854+0000 7fd492ffd700 1 --2- 172.21.15.82:0/207638374 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fd47c0a1ea0 0x7fd47c0a4360 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd4941060f0 tx=0x7fd48800b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:10.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.854+0000 7fd493fff700 1 --2- 172.21.15.82:0/207638374 >> [v2:172.21.15.82:6810/980870924,v1:172.21.15.82:6811/980870924] conn(0x7fd47c0acb60 0x7fd47c0aefa0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:10.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.855+0000 7fd490ff9700 1 -- 172.21.15.82:0/207638374 <== osd.3 v2:172.21.15.82:6810/980870924 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fd48c01eec0 con 0x7fd47c0acb60 2024-03-04T09:14:10.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.871+0000 7fd49a1bc700 1 -- 172.21.15.82:0/207638374 --> [v2:172.21.15.82:6810/980870924,v1:172.21.15.82:6811/980870924] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd494062c50 con 0x7fd47c0acb60 2024-03-04T09:14:10.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.871+0000 7fd490ff9700 1 -- 172.21.15.82:0/207638374 <== osd.3 v2:172.21.15.82:6810/980870924 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fd494062c50 con 0x7fd47c0acb60 2024-03-04T09:14:10.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.871+0000 7fd49a1bc700 1 -- 172.21.15.82:0/207638374 >> [v2:172.21.15.82:6810/980870924,v1:172.21.15.82:6811/980870924] conn(0x7fd47c0acb60 msgr2=0x7fd47c0aefa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:10.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.871+0000 7fd49a1bc700 1 --2- 172.21.15.82:0/207638374 >> [v2:172.21.15.82:6810/980870924,v1:172.21.15.82:6811/980870924] conn(0x7fd47c0acb60 0x7fd47c0aefa0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:10.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.871+0000 7fd49a1bc700 1 -- 172.21.15.82:0/207638374 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fd47c0a1ea0 msgr2=0x7fd47c0a4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:10.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.871+0000 7fd49a1bc700 1 --2- 172.21.15.82:0/207638374 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fd47c0a1ea0 0x7fd47c0a4360 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd4941060f0 tx=0x7fd48800b040 comp rx=0 tx=0).stop 2024-03-04T09:14:10.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.871+0000 7fd49a1bc700 1 -- 172.21.15.82:0/207638374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd494100fc0 msgr2=0x7fd49419d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:10.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.871+0000 7fd49a1bc700 1 --2- 172.21.15.82:0/207638374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd494100fc0 0x7fd49419d3d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd48c0057c0 tx=0x7fd48c0057f0 comp rx=0 tx=0).stop 2024-03-04T09:14:10.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.871+0000 7fd493fff700 1 -- 172.21.15.82:0/207638374 reap_dead start 2024-03-04T09:14:10.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.872+0000 7fd49a1bc700 1 -- 172.21.15.82:0/207638374 shutdown_connections 2024-03-04T09:14:10.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.872+0000 7fd49a1bc700 1 -- 172.21.15.82:0/207638374 >> 172.21.15.82:0/207638374 conn(0x7fd494077ef0 msgr2=0x7fd4940ffdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:10.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.872+0000 7fd49a1bc700 1 -- 172.21.15.82:0/207638374 shutdown_connections 2024-03-04T09:14:10.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:10.872+0000 7fd49a1bc700 1 -- 172.21.15.82:0/207638374 wait complete. 2024-03-04T09:14:11.307 INFO:teuthology.orchestra.run.smithi082.stdout:201863462962 2024-03-04T09:14:11.308 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph osd last-stat-seq osd.6 2024-03-04T09:14:11.535 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:11 smithi082 ceph-mon[32880]: pgmap v319: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:14:11.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:11 smithi190 ceph-mon[36341]: pgmap v319: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:14:11.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:11 smithi102 ceph-mon[36220]: pgmap v319: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:14:11.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.858+0000 7f2fe6314700 1 -- 172.21.15.82:0/61982370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fe0102140 msgr2=0x7f2fe01025c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:11.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.858+0000 7f2fe6314700 1 --2- 172.21.15.82:0/61982370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fe0102140 0x7f2fe01025c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4009990 tx=0x7f2fd4009ca0 comp rx=0 tx=0).stop 2024-03-04T09:14:11.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.858+0000 7f2fe6314700 1 -- 172.21.15.82:0/61982370 shutdown_connections 2024-03-04T09:14:11.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.858+0000 7f2fe6314700 1 --2- 172.21.15.82:0/61982370 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2fe0102b00 0x7f2fe010ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:11.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.858+0000 7f2fe6314700 1 --2- 172.21.15.82:0/61982370 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2fe0108190 0x7f2fe0108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:11.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.858+0000 7f2fe6314700 1 --2- 172.21.15.82:0/61982370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fe0102140 0x7f2fe01025c0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:11.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.858+0000 7f2fe6314700 1 -- 172.21.15.82:0/61982370 >> 172.21.15.82:0/61982370 conn(0x7f2fe0079210 msgr2=0x7f2fe0079620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:11.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.858+0000 7f2fe6314700 1 -- 172.21.15.82:0/61982370 shutdown_connections 2024-03-04T09:14:11.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.858+0000 7f2fe6314700 1 -- 172.21.15.82:0/61982370 wait complete. 2024-03-04T09:14:11.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.859+0000 7f2fe6314700 1 Processor -- start 2024-03-04T09:14:11.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.859+0000 7f2fe6314700 1 -- start start 2024-03-04T09:14:11.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.859+0000 7f2fe6314700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fe0102140 0x7f2fe019e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:11.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.859+0000 7f2fe6314700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2fe0102b00 0x7f2fe019eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:11.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.859+0000 7f2fe6314700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2fe0108190 0x7f2fe01986c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:11.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.859+0000 7f2fe6314700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe01123e0 con 0x7f2fe0102140 2024-03-04T09:14:11.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.859+0000 7f2fe6314700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe0112260 con 0x7f2fe0108190 2024-03-04T09:14:11.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.859+0000 7f2fe6314700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe0112560 con 0x7f2fe0102b00 2024-03-04T09:14:11.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.859+0000 7f2fdffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fe0102140 0x7f2fe019e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:11.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.859+0000 7f2fdffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fe0102140 0x7f2fe019e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49756/0 (socket says 172.21.15.82:49756) 2024-03-04T09:14:11.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.859+0000 7f2fdffff700 1 -- 172.21.15.82:0/4029184315 learned_addr learned my addr 172.21.15.82:0/4029184315 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:11.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.859+0000 7f2fdf7fe700 1 --2- 172.21.15.82:0/4029184315 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2fe0102b00 0x7f2fe019eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:11.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.859+0000 7f2fe48b1700 1 --2- 172.21.15.82:0/4029184315 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2fe0108190 0x7f2fe01986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:11.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.859+0000 7f2fdffff700 1 -- 172.21.15.82:0/4029184315 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2fe0102b00 msgr2=0x7f2fe019eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:11.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.859+0000 7f2fdffff700 1 --2- 172.21.15.82:0/4029184315 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2fe0102b00 0x7f2fe019eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:11.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.859+0000 7f2fdffff700 1 -- 172.21.15.82:0/4029184315 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2fe0108190 msgr2=0x7f2fe01986c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:11.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.859+0000 7f2fdffff700 1 --2- 172.21.15.82:0/4029184315 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2fe0108190 0x7f2fe01986c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:11.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.859+0000 7f2fdffff700 1 -- 172.21.15.82:0/4029184315 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe0198fa0 con 0x7f2fe0102140 2024-03-04T09:14:11.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.860+0000 7f2fdffff700 1 --2- 172.21.15.82:0/4029184315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fe0102140 0x7f2fe019e5a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2fd000e9c0 tx=0x7f2fd000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:11.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.861+0000 7f2fdd7fa700 1 -- 172.21.15.82:0/4029184315 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd000cbd0 con 0x7f2fe0102140 2024-03-04T09:14:11.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.861+0000 7f2fe6314700 1 -- 172.21.15.82:0/4029184315 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fe0199290 con 0x7f2fe0102140 2024-03-04T09:14:11.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.861+0000 7f2fdd7fa700 1 -- 172.21.15.82:0/4029184315 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f2fd000ee60 con 0x7f2fe0102140 2024-03-04T09:14:11.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.861+0000 7f2fdd7fa700 1 -- 172.21.15.82:0/4029184315 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd00055f0 con 0x7f2fe0102140 2024-03-04T09:14:11.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.861+0000 7f2fe6314700 1 -- 172.21.15.82:0/4029184315 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fe01a5520 con 0x7f2fe0102140 2024-03-04T09:14:11.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.862+0000 7f2fe6314700 1 -- 172.21.15.82:0/4029184315 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2fe0062850 con 0x7f2fe0102140 2024-03-04T09:14:11.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.863+0000 7f2fdd7fa700 1 -- 172.21.15.82:0/4029184315 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 136807+0+0 (secure 0 0 0) 0x7f2fd0004750 con 0x7f2fe0102140 2024-03-04T09:14:11.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.864+0000 7f2fdd7fa700 1 --2- 172.21.15.82:0/4029184315 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f2fc80a1ea0 0x7f2fc80a4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:11.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.864+0000 7f2fdf7fe700 1 --2- 172.21.15.82:0/4029184315 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f2fc80a1ea0 0x7f2fc80a4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:11.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.864+0000 7f2fdd7fa700 1 -- 172.21.15.82:0/4029184315 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8802+0+0 (secure 0 0 0) 0x7f2fd00ce9f0 con 0x7f2fe0102140 2024-03-04T09:14:11.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.864+0000 7f2fdd7fa700 1 --2- 172.21.15.82:0/4029184315 >> [v2:172.21.15.82:6826/1777272933,v1:172.21.15.82:6827/1777272933] conn(0x7f2fc80acb60 0x7f2fc80aefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:11.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.864+0000 7f2fdd7fa700 1 -- 172.21.15.82:0/4029184315 --> [v2:172.21.15.82:6826/1777272933,v1:172.21.15.82:6827/1777272933] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2fc80af670 con 0x7f2fc80acb60 2024-03-04T09:14:11.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.864+0000 7f2fdd7fa700 1 -- 172.21.15.82:0/4029184315 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2fd00ceda0 con 0x7f2fe0102140 2024-03-04T09:14:11.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.864+0000 7f2fe48b1700 1 --2- 172.21.15.82:0/4029184315 >> [v2:172.21.15.82:6826/1777272933,v1:172.21.15.82:6827/1777272933] conn(0x7f2fc80acb60 0x7f2fc80aefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:11.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.864+0000 7f2fdf7fe700 1 --2- 172.21.15.82:0/4029184315 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f2fc80a1ea0 0x7f2fc80a4360 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2fd40098e0 tx=0x7f2fd4005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:11.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.864+0000 7f2fe48b1700 1 --2- 172.21.15.82:0/4029184315 >> [v2:172.21.15.82:6826/1777272933,v1:172.21.15.82:6827/1777272933] conn(0x7f2fc80acb60 0x7f2fc80aefa0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:11.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.865+0000 7f2fdd7fa700 1 -- 172.21.15.82:0/4029184315 <== osd.9 v2:172.21.15.82:6826/1777272933 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f2fc80af670 con 0x7f2fc80acb60 2024-03-04T09:14:11.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.881+0000 7f2fe6314700 1 -- 172.21.15.82:0/4029184315 --> [v2:172.21.15.82:6826/1777272933,v1:172.21.15.82:6827/1777272933] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2fe0062c80 con 0x7f2fc80acb60 2024-03-04T09:14:11.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.882+0000 7f2fdd7fa700 1 -- 172.21.15.82:0/4029184315 <== osd.9 v2:172.21.15.82:6826/1777272933 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f2fe0062c80 con 0x7f2fc80acb60 2024-03-04T09:14:11.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.882+0000 7f2fe6314700 1 -- 172.21.15.82:0/4029184315 >> [v2:172.21.15.82:6826/1777272933,v1:172.21.15.82:6827/1777272933] conn(0x7f2fc80acb60 msgr2=0x7f2fc80aefa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:11.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.882+0000 7f2fe6314700 1 --2- 172.21.15.82:0/4029184315 >> [v2:172.21.15.82:6826/1777272933,v1:172.21.15.82:6827/1777272933] conn(0x7f2fc80acb60 0x7f2fc80aefa0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:11.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.882+0000 7f2fe6314700 1 -- 172.21.15.82:0/4029184315 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f2fc80a1ea0 msgr2=0x7f2fc80a4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:11.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.882+0000 7f2fe6314700 1 --2- 172.21.15.82:0/4029184315 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f2fc80a1ea0 0x7f2fc80a4360 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2fd40098e0 tx=0x7f2fd4005960 comp rx=0 tx=0).stop 2024-03-04T09:14:11.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.882+0000 7f2fe6314700 1 -- 172.21.15.82:0/4029184315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fe0102140 msgr2=0x7f2fe019e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:11.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.882+0000 7f2fe6314700 1 --2- 172.21.15.82:0/4029184315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fe0102140 0x7f2fe019e5a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2fd000e9c0 tx=0x7f2fd000ecd0 comp rx=0 tx=0).stop 2024-03-04T09:14:11.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.882+0000 7f2fe48b1700 1 -- 172.21.15.82:0/4029184315 reap_dead start 2024-03-04T09:14:11.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.882+0000 7f2fe6314700 1 -- 172.21.15.82:0/4029184315 shutdown_connections 2024-03-04T09:14:11.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.882+0000 7f2fe6314700 1 -- 172.21.15.82:0/4029184315 >> 172.21.15.82:0/4029184315 conn(0x7f2fe0079210 msgr2=0x7f2fe0100e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:11.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.882+0000 7f2fe6314700 1 -- 172.21.15.82:0/4029184315 shutdown_connections 2024-03-04T09:14:11.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:11.882+0000 7f2fe6314700 1 -- 172.21.15.82:0/4029184315 wait complete. 2024-03-04T09:14:12.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:12 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:14:12.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:12 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:14:12.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:12 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:14:12.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:12 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:14:12.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:12 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-03-04T09:14:12.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:12 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6]}]: dispatch 2024-03-04T09:14:12.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:12 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]: dispatch 2024-03-04T09:14:12.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:12 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2024-03-04T09:14:12.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:12 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2024-03-04T09:14:12.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:12 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-03-04T09:14:12.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:12 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]: dispatch 2024-03-04T09:14:12.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:12 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [5, 8]}]: dispatch 2024-03-04T09:14:12.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:12 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]: dispatch 2024-03-04T09:14:12.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:12 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 10]}]: dispatch 2024-03-04T09:14:12.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:12 smithi082 ceph-mon[32880]: pgmap v320: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-03-04T09:14:12.918 INFO:teuthology.orchestra.run.smithi082.stdout:223338299437 2024-03-04T09:14:12.918 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph osd last-stat-seq osd.7 2024-03-04T09:14:12.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:12 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:14:12.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:12 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:14:12.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:12 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:14:12.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:12 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:14:12.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:12 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-03-04T09:14:12.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:12 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6]}]: dispatch 2024-03-04T09:14:12.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:12 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]: dispatch 2024-03-04T09:14:12.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:12 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2024-03-04T09:14:12.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:12 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2024-03-04T09:14:12.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:12 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-03-04T09:14:12.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:12 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]: dispatch 2024-03-04T09:14:12.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:12 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [5, 8]}]: dispatch 2024-03-04T09:14:12.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:12 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]: dispatch 2024-03-04T09:14:12.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:12 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 10]}]: dispatch 2024-03-04T09:14:12.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:12 smithi190 ceph-mon[36341]: pgmap v320: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-03-04T09:14:12.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:12 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:14:12.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:12 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:14:12.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:12 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:14:12.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:12 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:14:12.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:12 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-03-04T09:14:12.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:12 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6]}]: dispatch 2024-03-04T09:14:12.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:12 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]: dispatch 2024-03-04T09:14:12.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:12 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2024-03-04T09:14:12.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:12 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2024-03-04T09:14:12.930 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:12 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-03-04T09:14:12.930 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:12 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]: dispatch 2024-03-04T09:14:12.930 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:12 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [5, 8]}]: dispatch 2024-03-04T09:14:12.930 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:12 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]: dispatch 2024-03-04T09:14:12.930 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:12 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 10]}]: dispatch 2024-03-04T09:14:12.930 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:12 smithi102 ceph-mon[36220]: pgmap v320: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-03-04T09:14:13.340 INFO:teuthology.orchestra.run.smithi082.stdout:146028888124 2024-03-04T09:14:13.341 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph osd last-stat-seq osd.4 2024-03-04T09:14:13.777 INFO:teuthology.orchestra.run.smithi082.stdout:257698037800 2024-03-04T09:14:13.777 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph osd last-stat-seq osd.8 2024-03-04T09:14:14.170 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:13 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-03-04T09:14:14.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:13 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6]}]': finished 2024-03-04T09:14:14.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:13 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]': finished 2024-03-04T09:14:14.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:13 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-03-04T09:14:14.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:13 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-03-04T09:14:14.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:13 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-03-04T09:14:14.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:13 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-03-04T09:14:14.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:13 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [5, 8]}]': finished 2024-03-04T09:14:14.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:13 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]': finished 2024-03-04T09:14:14.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:13 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 10]}]': finished 2024-03-04T09:14:14.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:13 smithi190 ceph-mon[36341]: osdmap e91: 12 total, 12 up, 12 in 2024-03-04T09:14:14.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:13 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-03-04T09:14:14.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:13 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6]}]': finished 2024-03-04T09:14:14.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:13 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]': finished 2024-03-04T09:14:14.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:13 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-03-04T09:14:14.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:13 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-03-04T09:14:14.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:13 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-03-04T09:14:14.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:13 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-03-04T09:14:14.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:13 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [5, 8]}]': finished 2024-03-04T09:14:14.180 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:13 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]': finished 2024-03-04T09:14:14.180 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:13 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 10]}]': finished 2024-03-04T09:14:14.180 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:13 smithi102 ceph-mon[36220]: osdmap e91: 12 total, 12 up, 12 in 2024-03-04T09:14:14.204 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:13 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-03-04T09:14:14.204 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:13 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6]}]': finished 2024-03-04T09:14:14.204 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:13 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]': finished 2024-03-04T09:14:14.204 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:13 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-03-04T09:14:14.204 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:13 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-03-04T09:14:14.204 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:13 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-03-04T09:14:14.204 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:13 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-03-04T09:14:14.204 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:13 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [5, 8]}]': finished 2024-03-04T09:14:14.204 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:13 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]': finished 2024-03-04T09:14:14.205 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:13 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 10]}]': finished 2024-03-04T09:14:14.205 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:13 smithi082 ceph-mon[32880]: osdmap e91: 12 total, 12 up, 12 in 2024-03-04T09:14:14.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.316+0000 7f01dbbb4700 1 -- 172.21.15.82:0/627329884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01d4102140 msgr2=0x7f01d41025c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:14.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.316+0000 7f01dbbb4700 1 --2- 172.21.15.82:0/627329884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01d4102140 0x7f01d41025c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f01d0009990 tx=0x7f01d0009ca0 comp rx=0 tx=0).stop 2024-03-04T09:14:14.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.316+0000 7f01dbbb4700 1 -- 172.21.15.82:0/627329884 shutdown_connections 2024-03-04T09:14:14.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.316+0000 7f01dbbb4700 1 --2- 172.21.15.82:0/627329884 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f01d4102b00 0x7f01d410ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:14.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.316+0000 7f01dbbb4700 1 --2- 172.21.15.82:0/627329884 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01d4108220 0x7f01d4108600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:14.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.316+0000 7f01dbbb4700 1 --2- 172.21.15.82:0/627329884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01d4102140 0x7f01d41025c0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:14.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.316+0000 7f01dbbb4700 1 -- 172.21.15.82:0/627329884 >> 172.21.15.82:0/627329884 conn(0x7f01d4079180 msgr2=0x7f01d4079590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:14.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.316+0000 7f01dbbb4700 1 -- 172.21.15.82:0/627329884 shutdown_connections 2024-03-04T09:14:14.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.316+0000 7f01dbbb4700 1 -- 172.21.15.82:0/627329884 wait complete. 2024-03-04T09:14:14.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.317+0000 7f01dbbb4700 1 Processor -- start 2024-03-04T09:14:14.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.317+0000 7f01dbbb4700 1 -- start start 2024-03-04T09:14:14.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.317+0000 7f01dbbb4700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01d4102140 0x7f01d419e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:14.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.317+0000 7f01dbbb4700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f01d4102b00 0x7f01d419eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:14.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.317+0000 7f01dbbb4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01d4108220 0x7f01d4198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:14.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.317+0000 7f01dbbb4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d4112390 con 0x7f01d4108220 2024-03-04T09:14:14.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.317+0000 7f01dbbb4700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d4112210 con 0x7f01d4102140 2024-03-04T09:14:14.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.317+0000 7f01dbbb4700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d4112510 con 0x7f01d4102b00 2024-03-04T09:14:14.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.317+0000 7f01da151700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01d4108220 0x7f01d4198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:14.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.317+0000 7f01da151700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01d4108220 0x7f01d4198730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49784/0 (socket says 172.21.15.82:49784) 2024-03-04T09:14:14.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.317+0000 7f01da151700 1 -- 172.21.15.82:0/3315539324 learned_addr learned my addr 172.21.15.82:0/3315539324 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:14.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.317+0000 7f01d914f700 1 --2- 172.21.15.82:0/3315539324 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f01d4102b00 0x7f01d419eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:14.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.317+0000 7f01d9950700 1 --2- 172.21.15.82:0/3315539324 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01d4102140 0x7f01d419e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:14.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.318+0000 7f01da151700 1 -- 172.21.15.82:0/3315539324 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f01d4102b00 msgr2=0x7f01d419eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:14.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.318+0000 7f01da151700 1 --2- 172.21.15.82:0/3315539324 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f01d4102b00 0x7f01d419eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:14.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.318+0000 7f01da151700 1 -- 172.21.15.82:0/3315539324 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01d4102140 msgr2=0x7f01d419e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:14.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.318+0000 7f01da151700 1 --2- 172.21.15.82:0/3315539324 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01d4102140 0x7f01d419e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:14.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.318+0000 7f01da151700 1 -- 172.21.15.82:0/3315539324 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d4199010 con 0x7f01d4108220 2024-03-04T09:14:14.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.318+0000 7f01d9950700 1 --2- 172.21.15.82:0/3315539324 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01d4102140 0x7f01d419e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:14:14.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.318+0000 7f01d914f700 1 --2- 172.21.15.82:0/3315539324 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f01d4102b00 0x7f01d419eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:14:14.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.318+0000 7f01da151700 1 --2- 172.21.15.82:0/3315539324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01d4108220 0x7f01d4198730 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f01cc00ef30 tx=0x7f01cc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:14.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.318+0000 7f01caffd700 1 -- 172.21.15.82:0/3315539324 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01cc0092e0 con 0x7f01d4108220 2024-03-04T09:14:14.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.318+0000 7f01dbbb4700 1 -- 172.21.15.82:0/3315539324 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01d41992a0 con 0x7f01d4108220 2024-03-04T09:14:14.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.318+0000 7f01dbbb4700 1 -- 172.21.15.82:0/3315539324 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01d41a5590 con 0x7f01d4108220 2024-03-04T09:14:14.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.318+0000 7f01caffd700 1 -- 172.21.15.82:0/3315539324 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f01cc004bb0 con 0x7f01d4108220 2024-03-04T09:14:14.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.318+0000 7f01caffd700 1 -- 172.21.15.82:0/3315539324 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01cc00cea0 con 0x7f01d4108220 2024-03-04T09:14:14.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.319+0000 7f01dbbb4700 1 -- 172.21.15.82:0/3315539324 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f01b8001030 con 0x7f01d4108220 2024-03-04T09:14:14.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.320+0000 7f01caffd700 1 -- 172.21.15.82:0/3315539324 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 136807+0+0 (secure 0 0 0) 0x7f01cc01b030 con 0x7f01d4108220 2024-03-04T09:14:14.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.321+0000 7f01caffd700 1 --2- 172.21.15.82:0/3315539324 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f01c00a1f20 0x7f01c00a43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:14.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.321+0000 7f01d9950700 1 --2- 172.21.15.82:0/3315539324 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f01c00a1f20 0x7f01c00a43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:14.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.321+0000 7f01caffd700 1 -- 172.21.15.82:0/3315539324 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9092+0+0 (secure 0 0 0) 0x7f01cc0ce900 con 0x7f01d4108220 2024-03-04T09:14:14.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.321+0000 7f01caffd700 1 --2- 172.21.15.82:0/3315539324 >> [v2:172.21.15.190:6800/946410459,v1:172.21.15.190:6801/946410459] conn(0x7f01c00ad080 0x7f01c00af520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:14.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.321+0000 7f01caffd700 1 -- 172.21.15.82:0/3315539324 --> [v2:172.21.15.190:6800/946410459,v1:172.21.15.190:6801/946410459] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f01cc022e50 con 0x7f01c00ad080 2024-03-04T09:14:14.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.321+0000 7f01caffd700 1 -- 172.21.15.82:0/3315539324 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01cc0ced50 con 0x7f01d4108220 2024-03-04T09:14:14.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.321+0000 7f01d914f700 1 --2- 172.21.15.82:0/3315539324 >> [v2:172.21.15.190:6800/946410459,v1:172.21.15.190:6801/946410459] conn(0x7f01c00ad080 0x7f01c00af520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:14.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.322+0000 7f01d9950700 1 --2- 172.21.15.82:0/3315539324 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f01c00a1f20 0x7f01c00a43e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f01c4009fd0 tx=0x7f01c4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:14.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.322+0000 7f01d914f700 1 --2- 172.21.15.82:0/3315539324 >> [v2:172.21.15.190:6800/946410459,v1:172.21.15.190:6801/946410459] conn(0x7f01c00ad080 0x7f01c00af520 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:14.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.323+0000 7f01caffd700 1 -- 172.21.15.82:0/3315539324 <== osd.2 v2:172.21.15.190:6800/946410459 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f01cc022e50 con 0x7f01c00ad080 2024-03-04T09:14:14.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.341+0000 7f01dbbb4700 1 -- 172.21.15.82:0/3315539324 --> [v2:172.21.15.190:6800/946410459,v1:172.21.15.190:6801/946410459] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f01b8002e60 con 0x7f01c00ad080 2024-03-04T09:14:14.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.341+0000 7f01caffd700 1 -- 172.21.15.82:0/3315539324 <== osd.2 v2:172.21.15.190:6800/946410459 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f01b8002e60 con 0x7f01c00ad080 2024-03-04T09:14:14.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.342+0000 7f01dbbb4700 1 -- 172.21.15.82:0/3315539324 >> [v2:172.21.15.190:6800/946410459,v1:172.21.15.190:6801/946410459] conn(0x7f01c00ad080 msgr2=0x7f01c00af520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:14.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.342+0000 7f01dbbb4700 1 --2- 172.21.15.82:0/3315539324 >> [v2:172.21.15.190:6800/946410459,v1:172.21.15.190:6801/946410459] conn(0x7f01c00ad080 0x7f01c00af520 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:14.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.342+0000 7f01dbbb4700 1 -- 172.21.15.82:0/3315539324 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f01c00a1f20 msgr2=0x7f01c00a43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:14.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.342+0000 7f01dbbb4700 1 --2- 172.21.15.82:0/3315539324 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f01c00a1f20 0x7f01c00a43e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f01c4009fd0 tx=0x7f01c4009260 comp rx=0 tx=0).stop 2024-03-04T09:14:14.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.342+0000 7f01dbbb4700 1 -- 172.21.15.82:0/3315539324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01d4108220 msgr2=0x7f01d4198730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:14.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.342+0000 7f01dbbb4700 1 --2- 172.21.15.82:0/3315539324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01d4108220 0x7f01d4198730 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f01cc00ef30 tx=0x7f01cc00c3a0 comp rx=0 tx=0).stop 2024-03-04T09:14:14.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.342+0000 7f01da151700 1 -- 172.21.15.82:0/3315539324 reap_dead start 2024-03-04T09:14:14.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.342+0000 7f01dbbb4700 1 -- 172.21.15.82:0/3315539324 shutdown_connections 2024-03-04T09:14:14.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.342+0000 7f01dbbb4700 1 -- 172.21.15.82:0/3315539324 >> 172.21.15.82:0/3315539324 conn(0x7f01d4079180 msgr2=0x7f01d4100e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:14.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.342+0000 7f01dbbb4700 1 -- 172.21.15.82:0/3315539324 shutdown_connections 2024-03-04T09:14:14.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.342+0000 7f01dbbb4700 1 -- 172.21.15.82:0/3315539324 wait complete. 2024-03-04T09:14:14.942 INFO:teuthology.orchestra.run.smithi082.stdout:111669149761 2024-03-04T09:14:14.943 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph osd last-stat-seq osd.3 2024-03-04T09:14:15.170 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:14 smithi190 ceph-mon[36341]: osdmap e92: 12 total, 12 up, 12 in 2024-03-04T09:14:15.170 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:14 smithi190 ceph-mon[36341]: pgmap v323: 129 pgs: 1 peering, 128 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 7 op/s 2024-03-04T09:14:15.178 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:14 smithi102 ceph-mon[36220]: osdmap e92: 12 total, 12 up, 12 in 2024-03-04T09:14:15.178 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:14 smithi102 ceph-mon[36220]: pgmap v323: 129 pgs: 1 peering, 128 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 7 op/s 2024-03-04T09:14:15.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:14 smithi082 ceph-mon[32880]: osdmap e92: 12 total, 12 up, 12 in 2024-03-04T09:14:15.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:14 smithi082 ceph-mon[32880]: pgmap v323: 129 pgs: 1 peering, 128 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 7 op/s 2024-03-04T09:14:15.765 INFO:teuthology.orchestra.run.smithi082.stdout:292057776163 2024-03-04T09:14:15.766 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph osd last-stat-seq osd.9 2024-03-04T09:14:16.149 INFO:teuthology.orchestra.run.smithi082.stdout:77309411399 2024-03-04T09:14:16.149 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph osd last-stat-seq osd.2 2024-03-04T09:14:16.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.660+0000 7fdd39511700 1 -- 172.21.15.82:0/2018136145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd34107000 msgr2=0x7fdd341073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:16.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.660+0000 7fdd39511700 1 --2- 172.21.15.82:0/2018136145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd34107000 0x7fdd341073e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fdd24009990 tx=0x7fdd24009ca0 comp rx=0 tx=0).stop 2024-03-04T09:14:16.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.660+0000 7fdd39511700 1 -- 172.21.15.82:0/2018136145 shutdown_connections 2024-03-04T09:14:16.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.660+0000 7fdd39511700 1 --2- 172.21.15.82:0/2018136145 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdd34101960 0x7fdd3410de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:16.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.660+0000 7fdd39511700 1 --2- 172.21.15.82:0/2018136145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd34107000 0x7fdd341073e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:16.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.660+0000 7fdd39511700 1 --2- 172.21.15.82:0/2018136145 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd34100fc0 0x7fdd34101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:16.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.660+0000 7fdd39511700 1 -- 172.21.15.82:0/2018136145 >> 172.21.15.82:0/2018136145 conn(0x7fdd34077ef0 msgr2=0x7fdd34078300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:16.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.660+0000 7fdd39511700 1 -- 172.21.15.82:0/2018136145 shutdown_connections 2024-03-04T09:14:16.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.660+0000 7fdd39511700 1 -- 172.21.15.82:0/2018136145 wait complete. 2024-03-04T09:14:16.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.660+0000 7fdd39511700 1 Processor -- start 2024-03-04T09:14:16.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.661+0000 7fdd39511700 1 -- start start 2024-03-04T09:14:16.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.661+0000 7fdd39511700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdd34100fc0 0x7fdd341a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:16.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.661+0000 7fdd39511700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd34101960 0x7fdd341a0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:16.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.661+0000 7fdd39511700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd34107000 0x7fdd3419a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:16.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.661+0000 7fdd39511700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd34114530 con 0x7fdd34107000 2024-03-04T09:14:16.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.661+0000 7fdd39511700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd341143b0 con 0x7fdd34101960 2024-03-04T09:14:16.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.661+0000 7fdd39511700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd341146b0 con 0x7fdd34100fc0 2024-03-04T09:14:16.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.661+0000 7fdd337fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd34107000 0x7fdd3419a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:16.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.661+0000 7fdd337fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd34107000 0x7fdd3419a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49794/0 (socket says 172.21.15.82:49794) 2024-03-04T09:14:16.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.661+0000 7fdd337fe700 1 -- 172.21.15.82:0/3741104341 learned_addr learned my addr 172.21.15.82:0/3741104341 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:16.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.661+0000 7fdd327fc700 1 --2- 172.21.15.82:0/3741104341 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd34101960 0x7fdd341a0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:16.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.661+0000 7fdd32ffd700 1 --2- 172.21.15.82:0/3741104341 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdd34100fc0 0x7fdd341a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:16.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.661+0000 7fdd337fe700 1 -- 172.21.15.82:0/3741104341 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdd34100fc0 msgr2=0x7fdd341a06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:16.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.661+0000 7fdd337fe700 1 --2- 172.21.15.82:0/3741104341 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdd34100fc0 0x7fdd341a06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:16.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.661+0000 7fdd337fe700 1 -- 172.21.15.82:0/3741104341 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd34101960 msgr2=0x7fdd341a0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:16.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.661+0000 7fdd337fe700 1 --2- 172.21.15.82:0/3741104341 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd34101960 0x7fdd341a0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:16.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.661+0000 7fdd337fe700 1 -- 172.21.15.82:0/3741104341 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd3419afd0 con 0x7fdd34107000 2024-03-04T09:14:16.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.662+0000 7fdd337fe700 1 --2- 172.21.15.82:0/3741104341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd34107000 0x7fdd3419a870 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c00c370 tx=0x7fdd2c00c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:16.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.662+0000 7fdd1bfff700 1 -- 172.21.15.82:0/3741104341 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2c0092e0 con 0x7fdd34107000 2024-03-04T09:14:16.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.662+0000 7fdd39511700 1 -- 172.21.15.82:0/3741104341 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd3419b260 con 0x7fdd34107000 2024-03-04T09:14:16.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.662+0000 7fdd39511700 1 -- 172.21.15.82:0/3741104341 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd341a7580 con 0x7fdd34107000 2024-03-04T09:14:16.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.662+0000 7fdd1bfff700 1 -- 172.21.15.82:0/3741104341 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fdd2c003a00 con 0x7fdd34107000 2024-03-04T09:14:16.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.662+0000 7fdd1bfff700 1 -- 172.21.15.82:0/3741104341 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2c004760 con 0x7fdd34107000 2024-03-04T09:14:16.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.663+0000 7fdd39511700 1 -- 172.21.15.82:0/3741104341 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdd34062850 con 0x7fdd34107000 2024-03-04T09:14:16.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.664+0000 7fdd1bfff700 1 -- 172.21.15.82:0/3741104341 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 136807+0+0 (secure 0 0 0) 0x7fdd2c01a020 con 0x7fdd34107000 2024-03-04T09:14:16.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.664+0000 7fdd1bfff700 1 --2- 172.21.15.82:0/3741104341 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fdd1c0a1e80 0x7fdd1c0a4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:16.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.664+0000 7fdd32ffd700 1 --2- 172.21.15.82:0/3741104341 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fdd1c0a1e80 0x7fdd1c0a4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:16.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.664+0000 7fdd1bfff700 1 -- 172.21.15.82:0/3741104341 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9092+0+0 (secure 0 0 0) 0x7fdd2c0cde80 con 0x7fdd34107000 2024-03-04T09:14:16.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.665+0000 7fdd1bfff700 1 --2- 172.21.15.82:0/3741104341 >> [v2:172.21.15.102:6800/270721212,v1:172.21.15.102:6801/270721212] conn(0x7fdd1c0acfe0 0x7fdd1c0af480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:16.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.665+0000 7fdd1bfff700 1 -- 172.21.15.82:0/3741104341 --> [v2:172.21.15.102:6800/270721212,v1:172.21.15.102:6801/270721212] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdd2c023e50 con 0x7fdd1c0acfe0 2024-03-04T09:14:16.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.665+0000 7fdd1bfff700 1 -- 172.21.15.82:0/3741104341 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd2c0ce2d0 con 0x7fdd34107000 2024-03-04T09:14:16.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.665+0000 7fdd32ffd700 1 --2- 172.21.15.82:0/3741104341 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fdd1c0a1e80 0x7fdd1c0a4340 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fdd3419b9b0 tx=0x7fdd24005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:16.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.665+0000 7fdd327fc700 1 --2- 172.21.15.82:0/3741104341 >> [v2:172.21.15.102:6800/270721212,v1:172.21.15.102:6801/270721212] conn(0x7fdd1c0acfe0 0x7fdd1c0af480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:16.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.665+0000 7fdd327fc700 1 --2- 172.21.15.82:0/3741104341 >> [v2:172.21.15.102:6800/270721212,v1:172.21.15.102:6801/270721212] conn(0x7fdd1c0acfe0 0x7fdd1c0af480 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:16.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.666+0000 7fdd1bfff700 1 -- 172.21.15.82:0/3741104341 <== osd.1 v2:172.21.15.102:6800/270721212 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fdd2c023e50 con 0x7fdd1c0acfe0 2024-03-04T09:14:16.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.682+0000 7fdd39511700 1 -- 172.21.15.82:0/3741104341 --> [v2:172.21.15.102:6800/270721212,v1:172.21.15.102:6801/270721212] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdd34062c50 con 0x7fdd1c0acfe0 2024-03-04T09:14:16.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.682+0000 7fdd1bfff700 1 -- 172.21.15.82:0/3741104341 <== osd.1 v2:172.21.15.102:6800/270721212 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdd34062c50 con 0x7fdd1c0acfe0 2024-03-04T09:14:16.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.683+0000 7fdd39511700 1 -- 172.21.15.82:0/3741104341 >> [v2:172.21.15.102:6800/270721212,v1:172.21.15.102:6801/270721212] conn(0x7fdd1c0acfe0 msgr2=0x7fdd1c0af480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:16.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.683+0000 7fdd39511700 1 --2- 172.21.15.82:0/3741104341 >> [v2:172.21.15.102:6800/270721212,v1:172.21.15.102:6801/270721212] conn(0x7fdd1c0acfe0 0x7fdd1c0af480 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:16.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.683+0000 7fdd39511700 1 -- 172.21.15.82:0/3741104341 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fdd1c0a1e80 msgr2=0x7fdd1c0a4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:16.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.683+0000 7fdd39511700 1 --2- 172.21.15.82:0/3741104341 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fdd1c0a1e80 0x7fdd1c0a4340 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fdd3419b9b0 tx=0x7fdd24005960 comp rx=0 tx=0).stop 2024-03-04T09:14:16.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.683+0000 7fdd39511700 1 -- 172.21.15.82:0/3741104341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd34107000 msgr2=0x7fdd3419a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:16.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.683+0000 7fdd39511700 1 --2- 172.21.15.82:0/3741104341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd34107000 0x7fdd3419a870 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c00c370 tx=0x7fdd2c00c680 comp rx=0 tx=0).stop 2024-03-04T09:14:16.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.683+0000 7fdd337fe700 1 -- 172.21.15.82:0/3741104341 reap_dead start 2024-03-04T09:14:16.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.683+0000 7fdd39511700 1 -- 172.21.15.82:0/3741104341 shutdown_connections 2024-03-04T09:14:16.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.683+0000 7fdd39511700 1 -- 172.21.15.82:0/3741104341 >> 172.21.15.82:0/3741104341 conn(0x7fdd34077ef0 msgr2=0x7fdd340ffe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:16.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.683+0000 7fdd39511700 1 -- 172.21.15.82:0/3741104341 shutdown_connections 2024-03-04T09:14:16.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:14.683+0000 7fdd39511700 1 -- 172.21.15.82:0/3741104341 wait complete. 2024-03-04T09:14:16.863 INFO:teuthology.orchestra.run.smithi082.stdout:55834574924 2024-03-04T09:14:16.864 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph osd last-stat-seq osd.1 2024-03-04T09:14:17.574 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:17 smithi082 ceph-mon[32880]: pgmap v324: 129 pgs: 1 peering, 128 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-03-04T09:14:17.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:17 smithi190 ceph-mon[36341]: pgmap v324: 129 pgs: 1 peering, 128 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-03-04T09:14:17.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:17 smithi102 ceph-mon[36220]: pgmap v324: 129 pgs: 1 peering, 128 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-03-04T09:14:17.768 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:14:17.808 INFO:teuthology.orchestra.run.smithi082.stdout:167503724598 2024-03-04T09:14:17.809 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph osd last-stat-seq osd.5 2024-03-04T09:14:18.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.409+0000 7fa20c741700 1 -- 172.21.15.82:0/2800933845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2041081c0 msgr2=0x7fa2041085a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:18.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.409+0000 7fa20c741700 1 --2- 172.21.15.82:0/2800933845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2041081c0 0x7fa2041085a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa200009990 tx=0x7fa200009ca0 comp rx=0 tx=0).stop 2024-03-04T09:14:18.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.409+0000 7fa20c741700 1 -- 172.21.15.82:0/2800933845 shutdown_connections 2024-03-04T09:14:18.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.409+0000 7fa20c741700 1 --2- 172.21.15.82:0/2800933845 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa204102ad0 0x7fa20410ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:18.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.409+0000 7fa20c741700 1 --2- 172.21.15.82:0/2800933845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2041081c0 0x7fa2041085a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:18.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.409+0000 7fa20c741700 1 --2- 172.21.15.82:0/2800933845 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa204102110 0x7fa204102590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:18.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.409+0000 7fa20c741700 1 -- 172.21.15.82:0/2800933845 >> 172.21.15.82:0/2800933845 conn(0x7fa2040791f0 msgr2=0x7fa204079600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:18.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.409+0000 7fa20c741700 1 -- 172.21.15.82:0/2800933845 shutdown_connections 2024-03-04T09:14:18.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.409+0000 7fa20c741700 1 -- 172.21.15.82:0/2800933845 wait complete. 2024-03-04T09:14:18.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.410+0000 7fa20c741700 1 Processor -- start 2024-03-04T09:14:18.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.410+0000 7fa20c741700 1 -- start start 2024-03-04T09:14:18.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.410+0000 7fa20c741700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa204102110 0x7fa20419e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:18.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.410+0000 7fa20c741700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa204102ad0 0x7fa20419e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:18.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.410+0000 7fa20c741700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2041081c0 0x7fa204198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:18.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.410+0000 7fa20c741700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2041123c0 con 0x7fa204102ad0 2024-03-04T09:14:18.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.410+0000 7fa20c741700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa204112240 con 0x7fa2041081c0 2024-03-04T09:14:18.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.410+0000 7fa20c741700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa204112540 con 0x7fa204102110 2024-03-04T09:14:18.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.411+0000 7fa209cdc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa204102ad0 0x7fa20419e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:18.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.411+0000 7fa20a4dd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa204102110 0x7fa20419e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:18.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.411+0000 7fa209cdc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa204102ad0 0x7fa20419e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49496/0 (socket says 172.21.15.82:49496) 2024-03-04T09:14:18.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.411+0000 7fa20a4dd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa204102110 0x7fa20419e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.82:56136/0 (socket says 172.21.15.82:56136) 2024-03-04T09:14:18.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.411+0000 7fa209cdc700 1 -- 172.21.15.82:0/3907827002 learned_addr learned my addr 172.21.15.82:0/3907827002 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:18.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.411+0000 7fa20acde700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2041081c0 0x7fa204198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:18.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.411+0000 7fa20a4dd700 1 -- 172.21.15.82:0/3907827002 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2041081c0 msgr2=0x7fa204198620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:18.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.411+0000 7fa20a4dd700 1 --2- 172.21.15.82:0/3907827002 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2041081c0 0x7fa204198620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:18.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.411+0000 7fa20a4dd700 1 -- 172.21.15.82:0/3907827002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa204102ad0 msgr2=0x7fa20419e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:18.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.411+0000 7fa20a4dd700 1 --2- 172.21.15.82:0/3907827002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa204102ad0 0x7fa20419e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:18.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.411+0000 7fa20a4dd700 1 -- 172.21.15.82:0/3907827002 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa204198d80 con 0x7fa204102110 2024-03-04T09:14:18.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.411+0000 7fa20a4dd700 1 --2- 172.21.15.82:0/3907827002 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa204102110 0x7fa20419e460 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa200006010 tx=0x7fa200005590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:18.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.411+0000 7fa1fb7fe700 1 -- 172.21.15.82:0/3907827002 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa200027070 con 0x7fa204102110 2024-03-04T09:14:18.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.411+0000 7fa20c741700 1 -- 172.21.15.82:0/3907827002 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa204199010 con 0x7fa204102110 2024-03-04T09:14:18.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.411+0000 7fa1fb7fe700 1 -- 172.21.15.82:0/3907827002 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fa20000fdd0 con 0x7fa204102110 2024-03-04T09:14:18.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.411+0000 7fa1fb7fe700 1 -- 172.21.15.82:0/3907827002 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2000173f0 con 0x7fa204102110 2024-03-04T09:14:18.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.411+0000 7fa20c741700 1 -- 172.21.15.82:0/3907827002 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2041a5330 con 0x7fa204102110 2024-03-04T09:14:18.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.412+0000 7fa20c741700 1 -- 172.21.15.82:0/3907827002 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa2040627d0 con 0x7fa204102110 2024-03-04T09:14:18.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.413+0000 7fa1fb7fe700 1 -- 172.21.15.82:0/3907827002 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 17) v1 ==== 136807+0+0 (secure 0 0 0) 0x7fa20002a070 con 0x7fa204102110 2024-03-04T09:14:18.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.414+0000 7fa1fb7fe700 1 --2- 172.21.15.82:0/3907827002 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fa1f00a1ea0 0x7fa1f00a4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:18.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.414+0000 7fa209cdc700 1 --2- 172.21.15.82:0/3907827002 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fa1f00a1ea0 0x7fa1f00a4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:18.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.414+0000 7fa1fb7fe700 1 -- 172.21.15.82:0/3907827002 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9092+0+0 (secure 0 0 0) 0x7fa2000cf200 con 0x7fa204102110 2024-03-04T09:14:18.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.414+0000 7fa1fb7fe700 1 --2- 172.21.15.82:0/3907827002 >> [v2:172.21.15.102:6824/1012784035,v1:172.21.15.102:6825/1012784035] conn(0x7fa1f00ad000 0x7fa1f00af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:18.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.414+0000 7fa1fb7fe700 1 -- 172.21.15.82:0/3907827002 --> [v2:172.21.15.102:6824/1012784035,v1:172.21.15.102:6825/1012784035] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa20000b0b0 con 0x7fa1f00ad000 2024-03-04T09:14:18.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.414+0000 7fa1fb7fe700 1 -- 172.21.15.82:0/3907827002 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa2000cf5b0 con 0x7fa204102110 2024-03-04T09:14:18.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.414+0000 7fa209cdc700 1 --2- 172.21.15.82:0/3907827002 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fa1f00a1ea0 0x7fa1f00a4360 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4009680 tx=0x7fa1f4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:18.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.414+0000 7fa20acde700 1 --2- 172.21.15.82:0/3907827002 >> [v2:172.21.15.102:6824/1012784035,v1:172.21.15.102:6825/1012784035] conn(0x7fa1f00ad000 0x7fa1f00af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:18.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.415+0000 7fa20acde700 1 --2- 172.21.15.82:0/3907827002 >> [v2:172.21.15.102:6824/1012784035,v1:172.21.15.102:6825/1012784035] conn(0x7fa1f00ad000 0x7fa1f00af4a0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:18.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.416+0000 7fa1fb7fe700 1 -- 172.21.15.82:0/3907827002 <== osd.10 v2:172.21.15.102:6824/1012784035 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fa20000b0b0 con 0x7fa1f00ad000 2024-03-04T09:14:18.427 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:14:18.427 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:14:18.428 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:14:18.429 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:14:18.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.439+0000 7fa20c741700 1 -- 172.21.15.82:0/3907827002 --> [v2:172.21.15.102:6824/1012784035,v1:172.21.15.102:6825/1012784035] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa204062c50 con 0x7fa1f00ad000 2024-03-04T09:14:18.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.439+0000 7fa1fb7fe700 1 -- 172.21.15.82:0/3907827002 <== osd.10 v2:172.21.15.102:6824/1012784035 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fa204062c50 con 0x7fa1f00ad000 2024-03-04T09:14:18.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.440+0000 7fa20c741700 1 -- 172.21.15.82:0/3907827002 >> [v2:172.21.15.102:6824/1012784035,v1:172.21.15.102:6825/1012784035] conn(0x7fa1f00ad000 msgr2=0x7fa1f00af4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:18.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.440+0000 7fa20c741700 1 --2- 172.21.15.82:0/3907827002 >> [v2:172.21.15.102:6824/1012784035,v1:172.21.15.102:6825/1012784035] conn(0x7fa1f00ad000 0x7fa1f00af4a0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:18.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.441+0000 7fa20c741700 1 -- 172.21.15.82:0/3907827002 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fa1f00a1ea0 msgr2=0x7fa1f00a4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:18.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.441+0000 7fa20c741700 1 --2- 172.21.15.82:0/3907827002 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fa1f00a1ea0 0x7fa1f00a4360 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4009680 tx=0x7fa1f4009260 comp rx=0 tx=0).stop 2024-03-04T09:14:18.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.441+0000 7fa20c741700 1 -- 172.21.15.82:0/3907827002 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa204102110 msgr2=0x7fa20419e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:18.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.441+0000 7fa20c741700 1 --2- 172.21.15.82:0/3907827002 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa204102110 0x7fa20419e460 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa200006010 tx=0x7fa200005590 comp rx=0 tx=0).stop 2024-03-04T09:14:18.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.441+0000 7fa20acde700 1 -- 172.21.15.82:0/3907827002 reap_dead start 2024-03-04T09:14:18.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.441+0000 7fa20c741700 1 -- 172.21.15.82:0/3907827002 shutdown_connections 2024-03-04T09:14:18.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.441+0000 7fa20c741700 1 -- 172.21.15.82:0/3907827002 >> 172.21.15.82:0/3907827002 conn(0x7fa2040791f0 msgr2=0x7fa204101010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:18.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.441+0000 7fa20c741700 1 -- 172.21.15.82:0/3907827002 shutdown_connections 2024-03-04T09:14:18.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:18.441+0000 7fa20c741700 1 -- 172.21.15.82:0/3907827002 wait complete. 2024-03-04T09:14:19.637 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:19 smithi082 ceph-mon[32880]: pgmap v325: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s; 7.6 KiB/s, 0 objects/s recovering 2024-03-04T09:14:19.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:19 smithi190 ceph-mon[36341]: pgmap v325: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s; 7.6 KiB/s, 0 objects/s recovering 2024-03-04T09:14:19.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:19 smithi102 ceph-mon[36220]: pgmap v325: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s; 7.6 KiB/s, 0 objects/s recovering 2024-03-04T09:14:20.508 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:14:20.508 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:14:20.509 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:14:20.509 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:14:20.509 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:14:20.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:20.741+0000 7f353e1fd700 1 -- 172.21.15.82:0/2757585912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3538101960 msgr2=0x7f353810de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:20.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:20.741+0000 7f353e1fd700 1 --2- 172.21.15.82:0/2757585912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3538101960 0x7f353810de40 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f353000b0a0 tx=0x7f353000b3b0 comp rx=0 tx=0).stop 2024-03-04T09:14:20.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:20.741+0000 7f353e1fd700 1 -- 172.21.15.82:0/2757585912 shutdown_connections 2024-03-04T09:14:20.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:20.741+0000 7f353e1fd700 1 --2- 172.21.15.82:0/2757585912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3538101960 0x7f353810de40 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:20.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:20.741+0000 7f353e1fd700 1 --2- 172.21.15.82:0/2757585912 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3538107000 0x7f35381073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:20.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:20.741+0000 7f353e1fd700 1 --2- 172.21.15.82:0/2757585912 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3538100fc0 0x7f3538101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:20.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:20.741+0000 7f353e1fd700 1 -- 172.21.15.82:0/2757585912 >> 172.21.15.82:0/2757585912 conn(0x7f3538077ef0 msgr2=0x7f3538078300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:20.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:20.741+0000 7f353e1fd700 1 -- 172.21.15.82:0/2757585912 shutdown_connections 2024-03-04T09:14:20.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:20.741+0000 7f353e1fd700 1 -- 172.21.15.82:0/2757585912 wait complete. 2024-03-04T09:14:20.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:20.742+0000 7f353e1fd700 1 Processor -- start 2024-03-04T09:14:20.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:20.742+0000 7f353e1fd700 1 -- start start 2024-03-04T09:14:20.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:20.742+0000 7f353e1fd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3538100fc0 0x7f3538197780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:20.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:20.742+0000 7f353e1fd700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3538101960 0x7f3538197cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:20.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:20.742+0000 7f353e1fd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3538107000 0x7f353819c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:20.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:20.742+0000 7f353e1fd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3538111250 con 0x7f3538100fc0 2024-03-04T09:14:20.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:20.742+0000 7f353e1fd700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35381110d0 con 0x7f3538101960 2024-03-04T09:14:20.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:20.742+0000 7f353e1fd700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35381113d0 con 0x7f3538107000 2024-03-04T09:14:20.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:20.742+0000 7f35377fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3538100fc0 0x7f3538197780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:20.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:20.742+0000 7f35377fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3538100fc0 0x7f3538197780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49522/0 (socket says 172.21.15.82:49522) 2024-03-04T09:14:20.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:20.742+0000 7f35377fe700 1 -- 172.21.15.82:0/582931480 learned_addr learned my addr 172.21.15.82:0/582931480 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:20.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:20.742+0000 7f352effd700 1 --2- 172.21.15.82:0/582931480 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3538101960 0x7f3538197cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:20.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:20.742+0000 7f3537fff700 1 --2- 172.21.15.82:0/582931480 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3538107000 0x7f353819c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:20.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:20.742+0000 7f35377fe700 1 -- 172.21.15.82:0/582931480 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3538107000 msgr2=0x7f353819c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:20.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:20.742+0000 7f35377fe700 1 --2- 172.21.15.82:0/582931480 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3538107000 0x7f353819c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:20.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:20.742+0000 7f35377fe700 1 -- 172.21.15.82:0/582931480 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3538101960 msgr2=0x7f3538197cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:20.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:20.742+0000 7f35377fe700 1 --2- 172.21.15.82:0/582931480 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3538101960 0x7f3538197cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:20.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:20.742+0000 7f35377fe700 1 -- 172.21.15.82:0/582931480 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f353819c740 con 0x7f3538100fc0 2024-03-04T09:14:20.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:20.743+0000 7f35377fe700 1 --2- 172.21.15.82:0/582931480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3538100fc0 0x7f3538197780 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f352800e9a0 tx=0x7f352800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:20.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:20.743+0000 7f35357fa700 1 -- 172.21.15.82:0/582931480 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352800ca10 con 0x7f3538100fc0 2024-03-04T09:14:20.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:20.743+0000 7f35357fa700 1 -- 172.21.15.82:0/582931480 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f352800cbb0 con 0x7f3538100fc0 2024-03-04T09:14:20.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:20.743+0000 7f353e1fd700 1 -- 172.21.15.82:0/582931480 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f353819ca30 con 0x7f3538100fc0 2024-03-04T09:14:20.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:20.743+0000 7f35357fa700 1 -- 172.21.15.82:0/582931480 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3528018680 con 0x7f3538100fc0 2024-03-04T09:14:20.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:20.743+0000 7f353e1fd700 1 -- 172.21.15.82:0/582931480 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35381a42b0 con 0x7f3538100fc0 2024-03-04T09:14:20.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:20.744+0000 7f353e1fd700 1 -- 172.21.15.82:0/582931480 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3538068d80 con 0x7f3538100fc0 2024-03-04T09:14:20.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:20.745+0000 7f35357fa700 1 -- 172.21.15.82:0/582931480 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 136807+0+0 (secure 0 0 0) 0x7f3528010430 con 0x7f3538100fc0 2024-03-04T09:14:20.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:20.745+0000 7f35357fa700 1 --2- 172.21.15.82:0/582931480 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f35240a1ea0 0x7f35240a4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:20.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:20.745+0000 7f352effd700 1 --2- 172.21.15.82:0/582931480 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f35240a1ea0 0x7f35240a4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:20.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:20.745+0000 7f35357fa700 1 -- 172.21.15.82:0/582931480 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9092+0+0 (secure 0 0 0) 0x7f35280ce320 con 0x7f3538100fc0 2024-03-04T09:14:20.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:20.746+0000 7f352effd700 1 --2- 172.21.15.82:0/582931480 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f35240a1ea0 0x7f35240a4360 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3538078560 tx=0x7f3520009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:20.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:20.750+0000 7f35357fa700 1 -- 172.21.15.82:0/582931480 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f352809b330 con 0x7f3538100fc0 2024-03-04T09:14:20.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:20.964+0000 7f353e1fd700 1 -- 172.21.15.82:0/582931480 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7f353802d9b0 con 0x7f3538100fc0 2024-03-04T09:14:20.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:20.964+0000 7f35357fa700 1 -- 172.21.15.82:0/582931480 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f352809ac30 con 0x7f3538100fc0 2024-03-04T09:14:20.961 INFO:teuthology.orchestra.run.smithi082.stdout:347892351003 2024-03-04T09:14:20.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:20.966+0000 7f353e1fd700 1 -- 172.21.15.82:0/582931480 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f35240a1ea0 msgr2=0x7f35240a4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:20.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:20.966+0000 7f353e1fd700 1 --2- 172.21.15.82:0/582931480 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f35240a1ea0 0x7f35240a4360 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3538078560 tx=0x7f3520009260 comp rx=0 tx=0).stop 2024-03-04T09:14:20.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:20.966+0000 7f353e1fd700 1 -- 172.21.15.82:0/582931480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3538100fc0 msgr2=0x7f3538197780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:20.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:20.966+0000 7f353e1fd700 1 --2- 172.21.15.82:0/582931480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3538100fc0 0x7f3538197780 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f352800e9a0 tx=0x7f352800ecb0 comp rx=0 tx=0).stop 2024-03-04T09:14:20.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:20.966+0000 7f353e1fd700 1 -- 172.21.15.82:0/582931480 shutdown_connections 2024-03-04T09:14:20.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:20.966+0000 7f353e1fd700 1 --2- 172.21.15.82:0/582931480 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f35240a1ea0 0x7f35240a4360 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:20.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:20.966+0000 7f353e1fd700 1 --2- 172.21.15.82:0/582931480 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3538107000 0x7f353819c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:20.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:20.966+0000 7f353e1fd700 1 --2- 172.21.15.82:0/582931480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3538100fc0 0x7f3538197780 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:20.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:20.966+0000 7f353e1fd700 1 --2- 172.21.15.82:0/582931480 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3538101960 0x7f3538197cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:20.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:20.966+0000 7f353e1fd700 1 -- 172.21.15.82:0/582931480 >> 172.21.15.82:0/582931480 conn(0x7f3538077ef0 msgr2=0x7f35380ffc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:20.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:20.966+0000 7f353e1fd700 1 -- 172.21.15.82:0/582931480 shutdown_connections 2024-03-04T09:14:20.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:20.966+0000 7f353e1fd700 1 -- 172.21.15.82:0/582931480 wait complete. 2024-03-04T09:14:21.559 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:21 smithi082 ceph-mon[32880]: pgmap v326: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s; 7.6 KiB/s, 0 objects/s recovering 2024-03-04T09:14:21.559 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:21 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/582931480' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-03-04T09:14:21.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:21 smithi190 ceph-mon[36341]: pgmap v326: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s; 7.6 KiB/s, 0 objects/s recovering 2024-03-04T09:14:21.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:21 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/582931480' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-03-04T09:14:21.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:21 smithi102 ceph-mon[36220]: pgmap v326: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s; 7.6 KiB/s, 0 objects/s recovering 2024-03-04T09:14:21.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:21 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/582931480' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-03-04T09:14:22.849 INFO:tasks.cephadm.ceph_manager.ceph:need seq 347892350999 got 347892351003 for osd.11 2024-03-04T09:14:22.850 DEBUG:teuthology.parallel:result is None 2024-03-04T09:14:23.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:23 smithi082 ceph-mon[32880]: pgmap v327: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s; 6.4 KiB/s, 0 objects/s recovering 2024-03-04T09:14:23.648 INFO:teuthology.orchestra.run.smithi082.stdout:313532612640 2024-03-04T09:14:23.648 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph osd last-stat-seq osd.10 2024-03-04T09:14:23.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:23 smithi190 ceph-mon[36341]: pgmap v327: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s; 6.4 KiB/s, 0 objects/s recovering 2024-03-04T09:14:23.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:23 smithi102 ceph-mon[36220]: pgmap v327: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s; 6.4 KiB/s, 0 objects/s recovering 2024-03-04T09:14:25.528 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:25 smithi082 ceph-mon[32880]: pgmap v328: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s; 5.8 KiB/s, 0 objects/s recovering 2024-03-04T09:14:25.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:25 smithi190 ceph-mon[36341]: pgmap v328: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s; 5.8 KiB/s, 0 objects/s recovering 2024-03-04T09:14:25.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:25 smithi102 ceph-mon[36220]: pgmap v328: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s; 5.8 KiB/s, 0 objects/s recovering 2024-03-04T09:14:27.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:27 smithi190 ceph-mon[36341]: pgmap v329: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 5.0 KiB/s, 0 objects/s recovering 2024-03-04T09:14:27.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:27 smithi102 ceph-mon[36220]: pgmap v329: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 5.0 KiB/s, 0 objects/s recovering 2024-03-04T09:14:27.752 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:27 smithi082 ceph-mon[32880]: pgmap v329: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 5.0 KiB/s, 0 objects/s recovering 2024-03-04T09:14:29.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.522+0000 7ff3ff964700 1 -- 172.21.15.82:0/1815256344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3f8101960 msgr2=0x7ff3f810de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:29.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.522+0000 7ff3ff964700 1 --2- 172.21.15.82:0/1815256344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3f8101960 0x7ff3f810de40 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff3f000b0a0 tx=0x7ff3f000b3b0 comp rx=0 tx=0).stop 2024-03-04T09:14:29.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.522+0000 7ff3ff964700 1 -- 172.21.15.82:0/1815256344 shutdown_connections 2024-03-04T09:14:29.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.522+0000 7ff3ff964700 1 --2- 172.21.15.82:0/1815256344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3f8101960 0x7ff3f810de40 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:29.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.522+0000 7ff3ff964700 1 --2- 172.21.15.82:0/1815256344 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3f8107000 0x7ff3f81073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:29.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.522+0000 7ff3ff964700 1 --2- 172.21.15.82:0/1815256344 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff3f8100fc0 0x7ff3f8101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:29.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.522+0000 7ff3ff964700 1 -- 172.21.15.82:0/1815256344 >> 172.21.15.82:0/1815256344 conn(0x7ff3f8077ef0 msgr2=0x7ff3f8078300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:29.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.522+0000 7ff3ff964700 1 -- 172.21.15.82:0/1815256344 shutdown_connections 2024-03-04T09:14:29.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.522+0000 7ff3ff964700 1 -- 172.21.15.82:0/1815256344 wait complete. 2024-03-04T09:14:29.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.523+0000 7ff3ff964700 1 Processor -- start 2024-03-04T09:14:29.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.523+0000 7ff3ff964700 1 -- start start 2024-03-04T09:14:29.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.523+0000 7ff3ff964700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3f8100fc0 0x7ff3f819e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:29.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.523+0000 7ff3ff964700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff3f8101960 0x7ff3f819eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:29.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.523+0000 7ff3ff964700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3f8107000 0x7ff3f8198690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:29.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.523+0000 7ff3ff964700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f8111250 con 0x7ff3f8107000 2024-03-04T09:14:29.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.523+0000 7ff3ff964700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f81110d0 con 0x7ff3f8100fc0 2024-03-04T09:14:29.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.523+0000 7ff3ff964700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f81113d0 con 0x7ff3f8101960 2024-03-04T09:14:29.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.523+0000 7ff3fd700700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3f8100fc0 0x7ff3f819e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:29.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.523+0000 7ff3fdf01700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3f8107000 0x7ff3f8198690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:29.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.523+0000 7ff3fd700700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3f8100fc0 0x7ff3f819e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.82:37496/0 (socket says 172.21.15.82:37496) 2024-03-04T09:14:29.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.523+0000 7ff3fceff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff3f8101960 0x7ff3f819eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:29.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.523+0000 7ff3fd700700 1 -- 172.21.15.82:0/3023403803 learned_addr learned my addr 172.21.15.82:0/3023403803 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:29.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.523+0000 7ff3fd700700 1 -- 172.21.15.82:0/3023403803 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff3f8101960 msgr2=0x7ff3f819eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:29.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.523+0000 7ff3fd700700 1 --2- 172.21.15.82:0/3023403803 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff3f8101960 0x7ff3f819eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:29.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.523+0000 7ff3fd700700 1 -- 172.21.15.82:0/3023403803 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3f8107000 msgr2=0x7ff3f8198690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:29.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.523+0000 7ff3fd700700 1 --2- 172.21.15.82:0/3023403803 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3f8107000 0x7ff3f8198690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:29.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.524+0000 7ff3fd700700 1 -- 172.21.15.82:0/3023403803 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f8198f70 con 0x7ff3f8100fc0 2024-03-04T09:14:29.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.524+0000 7ff3fdf01700 1 --2- 172.21.15.82:0/3023403803 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3f8107000 0x7ff3f8198690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:14:29.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.524+0000 7ff3fd700700 1 --2- 172.21.15.82:0/3023403803 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3f8100fc0 0x7ff3f819e5c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff3f400eb30 tx=0x7ff3f400ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:29.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.524+0000 7ff3ee7fc700 1 -- 172.21.15.82:0/3023403803 <== mon.2 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f400cbd0 con 0x7ff3f8100fc0 2024-03-04T09:14:29.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.524+0000 7ff3ff964700 1 -- 172.21.15.82:0/3023403803 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3f8199260 con 0x7ff3f8100fc0 2024-03-04T09:14:29.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.524+0000 7ff3ee7fc700 1 -- 172.21.15.82:0/3023403803 <== mon.2 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7ff3f40044f0 con 0x7ff3f8100fc0 2024-03-04T09:14:29.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.524+0000 7ff3ff964700 1 -- 172.21.15.82:0/3023403803 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3f81a5540 con 0x7ff3f8100fc0 2024-03-04T09:14:29.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.525+0000 7ff3ee7fc700 1 -- 172.21.15.82:0/3023403803 <== mon.2 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f4010430 con 0x7ff3f8100fc0 2024-03-04T09:14:29.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.525+0000 7ff3ff964700 1 -- 172.21.15.82:0/3023403803 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3f81026b0 con 0x7ff3f8100fc0 2024-03-04T09:14:29.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.526+0000 7ff3ee7fc700 1 -- 172.21.15.82:0/3023403803 <== mon.2 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 17) v1 ==== 136807+0+0 (secure 0 0 0) 0x7ff3f4003ed0 con 0x7ff3f8100fc0 2024-03-04T09:14:29.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.527+0000 7ff3ee7fc700 1 --2- 172.21.15.82:0/3023403803 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff3e40a1ea0 0x7ff3e40a4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:29.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.527+0000 7ff3ee7fc700 1 -- 172.21.15.82:0/3023403803 <== mon.2 v2:172.21.15.102:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9092+0+0 (secure 0 0 0) 0x7ff3f40ce580 con 0x7ff3f8100fc0 2024-03-04T09:14:29.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.527+0000 7ff3fceff700 1 --2- 172.21.15.82:0/3023403803 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff3e40a1ea0 0x7ff3e40a4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:29.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.527+0000 7ff3fceff700 1 --2- 172.21.15.82:0/3023403803 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff3e40a1ea0 0x7ff3e40a4360 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff3f8199e50 tx=0x7ff3e8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:29.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.535+0000 7ff3ee7fc700 1 -- 172.21.15.82:0/3023403803 <== mon.2 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7ff3f409b490 con 0x7ff3f8100fc0 2024-03-04T09:14:29.617 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:29 smithi082 ceph-mon[32880]: pgmap v330: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s; 5.0 KiB/s, 0 objects/s recovering 2024-03-04T09:14:29.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:29 smithi190 ceph-mon[36341]: pgmap v330: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s; 5.0 KiB/s, 0 objects/s recovering 2024-03-04T09:14:29.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:29 smithi102 ceph-mon[36220]: pgmap v330: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s; 5.0 KiB/s, 0 objects/s recovering 2024-03-04T09:14:29.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.737+0000 7ff3ff964700 1 -- 172.21.15.82:0/3023403803 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff3f81a5710 con 0x7ff3f8100fc0 2024-03-04T09:14:29.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.737+0000 7ff3ee7fc700 1 -- 172.21.15.82:0/3023403803 <== mon.2 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff3f400cd70 con 0x7ff3f8100fc0 2024-03-04T09:14:29.734 INFO:teuthology.orchestra.run.smithi082.stdout:77309411402 2024-03-04T09:14:29.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.739+0000 7ff3ff964700 1 -- 172.21.15.82:0/3023403803 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff3e40a1ea0 msgr2=0x7ff3e40a4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:29.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.739+0000 7ff3ff964700 1 --2- 172.21.15.82:0/3023403803 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff3e40a1ea0 0x7ff3e40a4360 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff3f8199e50 tx=0x7ff3e8009260 comp rx=0 tx=0).stop 2024-03-04T09:14:29.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.739+0000 7ff3ff964700 1 -- 172.21.15.82:0/3023403803 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3f8100fc0 msgr2=0x7ff3f819e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:29.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.739+0000 7ff3ff964700 1 --2- 172.21.15.82:0/3023403803 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3f8100fc0 0x7ff3f819e5c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff3f400eb30 tx=0x7ff3f400ee40 comp rx=0 tx=0).stop 2024-03-04T09:14:29.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.740+0000 7ff3ff964700 1 -- 172.21.15.82:0/3023403803 shutdown_connections 2024-03-04T09:14:29.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.740+0000 7ff3ff964700 1 --2- 172.21.15.82:0/3023403803 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff3e40a1ea0 0x7ff3e40a4360 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:29.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.740+0000 7ff3ff964700 1 --2- 172.21.15.82:0/3023403803 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3f8107000 0x7ff3f8198690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:29.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.740+0000 7ff3ff964700 1 --2- 172.21.15.82:0/3023403803 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3f8100fc0 0x7ff3f819e5c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:29.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.740+0000 7ff3ff964700 1 --2- 172.21.15.82:0/3023403803 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff3f8101960 0x7ff3f819eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:29.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.740+0000 7ff3ff964700 1 -- 172.21.15.82:0/3023403803 >> 172.21.15.82:0/3023403803 conn(0x7ff3f8077ef0 msgr2=0x7ff3f8105210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:29.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.740+0000 7ff3ff964700 1 -- 172.21.15.82:0/3023403803 shutdown_connections 2024-03-04T09:14:29.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:29.740+0000 7ff3ff964700 1 -- 172.21.15.82:0/3023403803 wait complete. 2024-03-04T09:14:30.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:30 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/3023403803' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-03-04T09:14:30.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:30.622+0000 7f12a447a700 1 -- 172.21.15.82:0/1678708234 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f129c1080f0 msgr2=0x7f129c1084d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:30.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:30.622+0000 7f12a447a700 1 --2- 172.21.15.82:0/1678708234 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f129c1080f0 0x7f129c1084d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f12980099c0 tx=0x7f1298009cd0 comp rx=0 tx=0).stop 2024-03-04T09:14:30.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:30.623+0000 7f12a447a700 1 -- 172.21.15.82:0/1678708234 shutdown_connections 2024-03-04T09:14:30.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:30.623+0000 7f12a447a700 1 --2- 172.21.15.82:0/1678708234 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f129c102ad0 0x7f129c10ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:30.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:30.623+0000 7f12a447a700 1 --2- 172.21.15.82:0/1678708234 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f129c1080f0 0x7f129c1084d0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:30.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:30.623+0000 7f12a447a700 1 --2- 172.21.15.82:0/1678708234 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f129c102110 0x7f129c102590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:30.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:30.623+0000 7f12a447a700 1 -- 172.21.15.82:0/1678708234 >> 172.21.15.82:0/1678708234 conn(0x7f129c0791f0 msgr2=0x7f129c079600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:30.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:30.623+0000 7f12a447a700 1 -- 172.21.15.82:0/1678708234 shutdown_connections 2024-03-04T09:14:30.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:30.623+0000 7f12a447a700 1 -- 172.21.15.82:0/1678708234 wait complete. 2024-03-04T09:14:30.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:30.623+0000 7f12a447a700 1 Processor -- start 2024-03-04T09:14:30.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:30.623+0000 7f12a447a700 1 -- start start 2024-03-04T09:14:30.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:30.623+0000 7f12a447a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f129c102110 0x7f129c198750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:30.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:30.623+0000 7f12a447a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f129c102ad0 0x7f129c198c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:30.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:30.623+0000 7f12a447a700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f129c1080f0 0x7f129c19d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:30.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:30.623+0000 7f12a447a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f129c112360 con 0x7f129c102110 2024-03-04T09:14:30.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:30.623+0000 7f12a447a700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f129c1121e0 con 0x7f129c1080f0 2024-03-04T09:14:30.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:30.623+0000 7f12a447a700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f129c1124e0 con 0x7f129c102ad0 2024-03-04T09:14:30.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:30.624+0000 7f12a2216700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f129c102110 0x7f129c198750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:30.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:30.624+0000 7f12a1a15700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f129c102ad0 0x7f129c198c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:30.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:30.624+0000 7f12a2216700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f129c102110 0x7f129c198750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34736/0 (socket says 172.21.15.82:34736) 2024-03-04T09:14:30.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:30.624+0000 7f12a2216700 1 -- 172.21.15.82:0/1575797683 learned_addr learned my addr 172.21.15.82:0/1575797683 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:30.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:30.624+0000 7f12a2a17700 1 --2- 172.21.15.82:0/1575797683 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f129c1080f0 0x7f129c19d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:30.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:30.624+0000 7f12a2216700 1 -- 172.21.15.82:0/1575797683 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f129c102ad0 msgr2=0x7f129c198c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:30.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:30.624+0000 7f12a2216700 1 --2- 172.21.15.82:0/1575797683 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f129c102ad0 0x7f129c198c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:30.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:30.624+0000 7f12a2216700 1 -- 172.21.15.82:0/1575797683 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f129c1080f0 msgr2=0x7f129c19d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:30.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:30.624+0000 7f12a2216700 1 --2- 172.21.15.82:0/1575797683 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f129c1080f0 0x7f129c19d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:30.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:30.624+0000 7f12a2216700 1 -- 172.21.15.82:0/1575797683 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f129c19d760 con 0x7f129c102110 2024-03-04T09:14:30.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:30.624+0000 7f12a2216700 1 --2- 172.21.15.82:0/1575797683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f129c102110 0x7f129c198750 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1298006010 tx=0x7f1298003af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:30.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:30.624+0000 7f12937fe700 1 -- 172.21.15.82:0/1575797683 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1298009e60 con 0x7f129c102110 2024-03-04T09:14:30.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:30.624+0000 7f12937fe700 1 -- 172.21.15.82:0/1575797683 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f1298005590 con 0x7f129c102110 2024-03-04T09:14:30.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:30.624+0000 7f12a447a700 1 -- 172.21.15.82:0/1575797683 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f129c19d9f0 con 0x7f129c102110 2024-03-04T09:14:30.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:30.624+0000 7f12937fe700 1 -- 172.21.15.82:0/1575797683 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129800fde0 con 0x7f129c102110 2024-03-04T09:14:30.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:30.624+0000 7f12a447a700 1 -- 172.21.15.82:0/1575797683 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f129c1a52d0 con 0x7f129c102110 2024-03-04T09:14:30.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:30.625+0000 7f12a447a700 1 -- 172.21.15.82:0/1575797683 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f129c068d80 con 0x7f129c102110 2024-03-04T09:14:30.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:30.627+0000 7f12937fe700 1 -- 172.21.15.82:0/1575797683 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 136807+0+0 (secure 0 0 0) 0x7f129800f580 con 0x7f129c102110 2024-03-04T09:14:30.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:30.627+0000 7f12937fe700 1 --2- 172.21.15.82:0/1575797683 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f12880a1ea0 0x7f12880a4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:30.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:30.628+0000 7f12a1a15700 1 --2- 172.21.15.82:0/1575797683 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f12880a1ea0 0x7f12880a4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:30.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:30.628+0000 7f12937fe700 1 -- 172.21.15.82:0/1575797683 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9092+0+0 (secure 0 0 0) 0x7f12980cf060 con 0x7f129c102110 2024-03-04T09:14:30.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:30.628+0000 7f12a1a15700 1 --2- 172.21.15.82:0/1575797683 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f12880a1ea0 0x7f12880a4360 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f129c079780 tx=0x7f128c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:30.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:30.631+0000 7f12937fe700 1 -- 172.21.15.82:0/1575797683 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f1298013070 con 0x7f129c102110 2024-03-04T09:14:30.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:30 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/3023403803' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-03-04T09:14:30.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:30 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/3023403803' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-03-04T09:14:30.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:30.831+0000 7f12a447a700 1 -- 172.21.15.82:0/1575797683 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f129c02d9b0 con 0x7f129c102110 2024-03-04T09:14:30.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:30.832+0000 7f12937fe700 1 -- 172.21.15.82:0/1575797683 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f129809c060 con 0x7f129c102110 2024-03-04T09:14:30.829 INFO:teuthology.orchestra.run.smithi082.stdout:34359738452 2024-03-04T09:14:30.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:30.834+0000 7f12a447a700 1 -- 172.21.15.82:0/1575797683 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f12880a1ea0 msgr2=0x7f12880a4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:30.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:30.834+0000 7f12a447a700 1 --2- 172.21.15.82:0/1575797683 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f12880a1ea0 0x7f12880a4360 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f129c079780 tx=0x7f128c009260 comp rx=0 tx=0).stop 2024-03-04T09:14:30.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:30.834+0000 7f12a447a700 1 -- 172.21.15.82:0/1575797683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f129c102110 msgr2=0x7f129c198750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:30.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:30.834+0000 7f12a447a700 1 --2- 172.21.15.82:0/1575797683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f129c102110 0x7f129c198750 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1298006010 tx=0x7f1298003af0 comp rx=0 tx=0).stop 2024-03-04T09:14:30.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:30.834+0000 7f12a447a700 1 -- 172.21.15.82:0/1575797683 shutdown_connections 2024-03-04T09:14:30.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:30.834+0000 7f12a447a700 1 --2- 172.21.15.82:0/1575797683 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f12880a1ea0 0x7f12880a4360 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:30.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:30.834+0000 7f12a447a700 1 --2- 172.21.15.82:0/1575797683 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f129c1080f0 0x7f129c19d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:30.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:30.834+0000 7f12a447a700 1 --2- 172.21.15.82:0/1575797683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f129c102110 0x7f129c198750 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:30.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:30.834+0000 7f12a447a700 1 --2- 172.21.15.82:0/1575797683 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f129c102ad0 0x7f129c198c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:30.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:30.834+0000 7f12a447a700 1 -- 172.21.15.82:0/1575797683 >> 172.21.15.82:0/1575797683 conn(0x7f129c0791f0 msgr2=0x7f129c100cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:30.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:30.834+0000 7f12a447a700 1 -- 172.21.15.82:0/1575797683 shutdown_connections 2024-03-04T09:14:30.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:30.834+0000 7f12a447a700 1 -- 172.21.15.82:0/1575797683 wait complete. 2024-03-04T09:14:31.464 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:14:31.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:31 smithi190 ceph-mon[36341]: pgmap v331: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:14:31.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:31 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/1575797683' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-03-04T09:14:31.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:31 smithi102 ceph-mon[36220]: pgmap v331: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:14:31.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:31 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/1575797683' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-03-04T09:14:31.747 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:31 smithi082 ceph-mon[32880]: pgmap v331: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:14:31.747 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:31 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/1575797683' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-03-04T09:14:32.081 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411399 got 77309411402 for osd.2 2024-03-04T09:14:32.081 DEBUG:teuthology.parallel:result is None 2024-03-04T09:14:33.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:33.034+0000 7fcca07ca700 1 -- 172.21.15.82:0/1690511648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc98107000 msgr2=0x7fcc981073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:33.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:33.034+0000 7fcca07ca700 1 --2- 172.21.15.82:0/1690511648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc98107000 0x7fcc981073e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fcc94009990 tx=0x7fcc94009ca0 comp rx=0 tx=0).stop 2024-03-04T09:14:33.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:33.034+0000 7fcca07ca700 1 -- 172.21.15.82:0/1690511648 shutdown_connections 2024-03-04T09:14:33.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:33.034+0000 7fcca07ca700 1 --2- 172.21.15.82:0/1690511648 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc98101960 0x7fcc9810de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:33.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:33.034+0000 7fcca07ca700 1 --2- 172.21.15.82:0/1690511648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc98107000 0x7fcc981073e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:33.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:33.034+0000 7fcca07ca700 1 --2- 172.21.15.82:0/1690511648 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc98100fc0 0x7fcc98101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:33.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:33.034+0000 7fcca07ca700 1 -- 172.21.15.82:0/1690511648 >> 172.21.15.82:0/1690511648 conn(0x7fcc98077ef0 msgr2=0x7fcc98078300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:33.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:33.034+0000 7fcca07ca700 1 -- 172.21.15.82:0/1690511648 shutdown_connections 2024-03-04T09:14:33.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:33.034+0000 7fcca07ca700 1 -- 172.21.15.82:0/1690511648 wait complete. 2024-03-04T09:14:33.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:33.034+0000 7fcca07ca700 1 Processor -- start 2024-03-04T09:14:33.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:33.035+0000 7fcca07ca700 1 -- start start 2024-03-04T09:14:33.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:33.035+0000 7fcca07ca700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc98100fc0 0x7fcc98197740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:33.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:33.035+0000 7fcca07ca700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc98101960 0x7fcc98197c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:33.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:33.035+0000 7fcca07ca700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc98107000 0x7fcc9819c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:33.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:33.035+0000 7fcca07ca700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc98111250 con 0x7fcc98100fc0 2024-03-04T09:14:33.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:33.035+0000 7fcca07ca700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc981110d0 con 0x7fcc98107000 2024-03-04T09:14:33.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:33.035+0000 7fcca07ca700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc981113d0 con 0x7fcc98101960 2024-03-04T09:14:33.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:33.035+0000 7fcc9e566700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc98100fc0 0x7fcc98197740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:33.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:33.035+0000 7fcc9e566700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc98100fc0 0x7fcc98197740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34766/0 (socket says 172.21.15.82:34766) 2024-03-04T09:14:33.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:33.035+0000 7fcc9e566700 1 -- 172.21.15.82:0/3567074924 learned_addr learned my addr 172.21.15.82:0/3567074924 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:33.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:33.035+0000 7fcc9dd65700 1 --2- 172.21.15.82:0/3567074924 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc98101960 0x7fcc98197c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:33.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:33.035+0000 7fcc9ed67700 1 --2- 172.21.15.82:0/3567074924 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc98107000 0x7fcc9819c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:33.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:33.035+0000 7fcc9e566700 1 -- 172.21.15.82:0/3567074924 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc98101960 msgr2=0x7fcc98197c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:33.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:33.035+0000 7fcc9e566700 1 --2- 172.21.15.82:0/3567074924 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc98101960 0x7fcc98197c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:33.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:33.035+0000 7fcc9e566700 1 -- 172.21.15.82:0/3567074924 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc98107000 msgr2=0x7fcc9819c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:33.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:33.035+0000 7fcc9e566700 1 --2- 172.21.15.82:0/3567074924 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc98107000 0x7fcc9819c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:33.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:33.035+0000 7fcc9e566700 1 -- 172.21.15.82:0/3567074924 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc9819c750 con 0x7fcc98100fc0 2024-03-04T09:14:33.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:33.035+0000 7fcc9e566700 1 --2- 172.21.15.82:0/3567074924 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc98100fc0 0x7fcc98197740 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fcc9400b840 tx=0x7fcc94005590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:33.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:33.036+0000 7fcc8f7fe700 1 -- 172.21.15.82:0/3567074924 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc94029070 con 0x7fcc98100fc0 2024-03-04T09:14:33.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:33.036+0000 7fcca07ca700 1 -- 172.21.15.82:0/3567074924 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc9819c9e0 con 0x7fcc98100fc0 2024-03-04T09:14:33.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:33.036+0000 7fcc8f7fe700 1 -- 172.21.15.82:0/3567074924 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fcc94024470 con 0x7fcc98100fc0 2024-03-04T09:14:33.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:33.036+0000 7fcc8f7fe700 1 -- 172.21.15.82:0/3567074924 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9400f6c0 con 0x7fcc98100fc0 2024-03-04T09:14:33.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:33.036+0000 7fcca07ca700 1 -- 172.21.15.82:0/3567074924 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc98069d70 con 0x7fcc98100fc0 2024-03-04T09:14:33.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:33.037+0000 7fcca07ca700 1 -- 172.21.15.82:0/3567074924 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc98068d80 con 0x7fcc98100fc0 2024-03-04T09:14:33.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:33.038+0000 7fcc8f7fe700 1 -- 172.21.15.82:0/3567074924 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 136807+0+0 (secure 0 0 0) 0x7fcc9402c070 con 0x7fcc98100fc0 2024-03-04T09:14:33.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:33.038+0000 7fcc8f7fe700 1 --2- 172.21.15.82:0/3567074924 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fcc840a1ea0 0x7fcc840a4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:33.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:33.038+0000 7fcc9dd65700 1 --2- 172.21.15.82:0/3567074924 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fcc840a1ea0 0x7fcc840a4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:33.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:33.038+0000 7fcc8f7fe700 1 -- 172.21.15.82:0/3567074924 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9092+0+0 (secure 0 0 0) 0x7fcc940d1340 con 0x7fcc98100fc0 2024-03-04T09:14:33.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:33.039+0000 7fcc9dd65700 1 --2- 172.21.15.82:0/3567074924 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fcc840a1ea0 0x7fcc840a4360 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fcc98078630 tx=0x7fcc88009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:33.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:33.042+0000 7fcc8f7fe700 1 -- 172.21.15.82:0/3567074924 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fcc94013070 con 0x7fcc98100fc0 2024-03-04T09:14:33.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:33.243+0000 7fcca07ca700 1 -- 172.21.15.82:0/3567074924 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7fcc9806a860 con 0x7fcc98100fc0 2024-03-04T09:14:33.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:33.243+0000 7fcc8f7fe700 1 -- 172.21.15.82:0/3567074924 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcc9409e460 con 0x7fcc98100fc0 2024-03-04T09:14:33.240 INFO:teuthology.orchestra.run.smithi082.stdout:257698037805 2024-03-04T09:14:33.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:33.245+0000 7fcca07ca700 1 -- 172.21.15.82:0/3567074924 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fcc840a1ea0 msgr2=0x7fcc840a4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:33.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:33.245+0000 7fcca07ca700 1 --2- 172.21.15.82:0/3567074924 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fcc840a1ea0 0x7fcc840a4360 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fcc98078630 tx=0x7fcc88009260 comp rx=0 tx=0).stop 2024-03-04T09:14:33.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:33.245+0000 7fcca07ca700 1 -- 172.21.15.82:0/3567074924 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc98100fc0 msgr2=0x7fcc98197740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:33.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:33.245+0000 7fcca07ca700 1 --2- 172.21.15.82:0/3567074924 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc98100fc0 0x7fcc98197740 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fcc9400b840 tx=0x7fcc94005590 comp rx=0 tx=0).stop 2024-03-04T09:14:33.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:33.245+0000 7fcca07ca700 1 -- 172.21.15.82:0/3567074924 shutdown_connections 2024-03-04T09:14:33.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:33.245+0000 7fcca07ca700 1 --2- 172.21.15.82:0/3567074924 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fcc840a1ea0 0x7fcc840a4360 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:33.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:33.245+0000 7fcca07ca700 1 --2- 172.21.15.82:0/3567074924 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc98107000 0x7fcc9819c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:33.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:33.245+0000 7fcca07ca700 1 --2- 172.21.15.82:0/3567074924 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc98100fc0 0x7fcc98197740 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:33.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:33.245+0000 7fcca07ca700 1 --2- 172.21.15.82:0/3567074924 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc98101960 0x7fcc98197c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:33.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:33.245+0000 7fcca07ca700 1 -- 172.21.15.82:0/3567074924 >> 172.21.15.82:0/3567074924 conn(0x7fcc98077ef0 msgr2=0x7fcc980ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:33.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:33.245+0000 7fcca07ca700 1 -- 172.21.15.82:0/3567074924 shutdown_connections 2024-03-04T09:14:33.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:33.245+0000 7fcca07ca700 1 -- 172.21.15.82:0/3567074924 wait complete. 2024-03-04T09:14:33.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:33 smithi190 ceph-mon[36341]: pgmap v332: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-03-04T09:14:33.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:33 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/2889525252' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-03-04T09:14:33.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:33 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/3567074924' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-03-04T09:14:33.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:33 smithi102 ceph-mon[36220]: pgmap v332: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-03-04T09:14:33.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:33 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/2889525252' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-03-04T09:14:33.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:33 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/3567074924' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-03-04T09:14:33.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:33 smithi082 ceph-mon[32880]: pgmap v332: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-03-04T09:14:33.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:33 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/2889525252' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-03-04T09:14:33.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:33 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/3567074924' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-03-04T09:14:34.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:34.184+0000 7f44f7cb2700 1 -- 172.21.15.82:0/2854106412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44f0101960 msgr2=0x7f44f010de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:34.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:34.184+0000 7f44f7cb2700 1 --2- 172.21.15.82:0/2854106412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44f0101960 0x7f44f010de40 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f44e8009990 tx=0x7f44e8009ca0 comp rx=0 tx=0).stop 2024-03-04T09:14:34.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:34.184+0000 7f44f7cb2700 1 -- 172.21.15.82:0/2854106412 shutdown_connections 2024-03-04T09:14:34.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:34.184+0000 7f44f7cb2700 1 --2- 172.21.15.82:0/2854106412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44f0101960 0x7f44f010de40 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:34.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:34.184+0000 7f44f7cb2700 1 --2- 172.21.15.82:0/2854106412 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44f0107000 0x7f44f01073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:34.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:34.184+0000 7f44f7cb2700 1 --2- 172.21.15.82:0/2854106412 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44f0100fc0 0x7f44f0101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:34.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:34.184+0000 7f44f7cb2700 1 -- 172.21.15.82:0/2854106412 >> 172.21.15.82:0/2854106412 conn(0x7f44f0077ef0 msgr2=0x7f44f0078300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:34.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:34.184+0000 7f44f7cb2700 1 -- 172.21.15.82:0/2854106412 shutdown_connections 2024-03-04T09:14:34.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:34.184+0000 7f44f7cb2700 1 -- 172.21.15.82:0/2854106412 wait complete. 2024-03-04T09:14:34.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:34.185+0000 7f44f7cb2700 1 Processor -- start 2024-03-04T09:14:34.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:34.185+0000 7f44f7cb2700 1 -- start start 2024-03-04T09:14:34.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:34.185+0000 7f44f7cb2700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44f0100fc0 0x7f44f01a06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:34.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:34.185+0000 7f44f7cb2700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44f0101960 0x7f44f01a0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:34.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:34.185+0000 7f44f7cb2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44f0107000 0x7f44f019a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:34.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:34.185+0000 7f44f7cb2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f0111250 con 0x7f44f0107000 2024-03-04T09:14:34.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:34.185+0000 7f44f7cb2700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f01110d0 con 0x7f44f0100fc0 2024-03-04T09:14:34.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:34.185+0000 7f44f7cb2700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f01113d0 con 0x7f44f0101960 2024-03-04T09:14:34.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:34.185+0000 7f44f624f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44f0107000 0x7f44f019a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:34.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:34.185+0000 7f44f624f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44f0107000 0x7f44f019a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34780/0 (socket says 172.21.15.82:34780) 2024-03-04T09:14:34.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:34.185+0000 7f44f624f700 1 -- 172.21.15.82:0/944239407 learned_addr learned my addr 172.21.15.82:0/944239407 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:34.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:34.185+0000 7f44f524d700 1 --2- 172.21.15.82:0/944239407 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44f0101960 0x7f44f01a0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:34.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:34.185+0000 7f44f5a4e700 1 --2- 172.21.15.82:0/944239407 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44f0100fc0 0x7f44f01a06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:34.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:34.185+0000 7f44f624f700 1 -- 172.21.15.82:0/944239407 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44f0101960 msgr2=0x7f44f01a0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:34.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:34.185+0000 7f44f624f700 1 --2- 172.21.15.82:0/944239407 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44f0101960 0x7f44f01a0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:34.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:34.185+0000 7f44f624f700 1 -- 172.21.15.82:0/944239407 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44f0100fc0 msgr2=0x7f44f01a06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:34.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:34.185+0000 7f44f624f700 1 --2- 172.21.15.82:0/944239407 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44f0100fc0 0x7f44f01a06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:34.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:34.185+0000 7f44f624f700 1 -- 172.21.15.82:0/944239407 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f019b020 con 0x7f44f0107000 2024-03-04T09:14:34.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:34.185+0000 7f44f624f700 1 --2- 172.21.15.82:0/944239407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44f0107000 0x7f44f019a840 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f44e800b840 tx=0x7f44e8005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:34.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:34.185+0000 7f44eeffd700 1 -- 172.21.15.82:0/944239407 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e8027070 con 0x7f44f0107000 2024-03-04T09:14:34.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:34.186+0000 7f44eeffd700 1 -- 172.21.15.82:0/944239407 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f44e800fd00 con 0x7f44f0107000 2024-03-04T09:14:34.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:34.186+0000 7f44f7cb2700 1 -- 172.21.15.82:0/944239407 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44f019b2b0 con 0x7f44f0107000 2024-03-04T09:14:34.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:34.186+0000 7f44eeffd700 1 -- 172.21.15.82:0/944239407 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e80173f0 con 0x7f44f0107000 2024-03-04T09:14:34.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:34.186+0000 7f44f7cb2700 1 -- 172.21.15.82:0/944239407 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44f01a7520 con 0x7f44f0107000 2024-03-04T09:14:34.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:34.186+0000 7f44f7cb2700 1 -- 172.21.15.82:0/944239407 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44f01026b0 con 0x7f44f0107000 2024-03-04T09:14:34.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:34.188+0000 7f44eeffd700 1 -- 172.21.15.82:0/944239407 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 136807+0+0 (secure 0 0 0) 0x7f44e802a070 con 0x7f44f0107000 2024-03-04T09:14:34.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:34.189+0000 7f44eeffd700 1 --2- 172.21.15.82:0/944239407 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f44d80a1f20 0x7f44d80a43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:34.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:34.189+0000 7f44f5a4e700 1 --2- 172.21.15.82:0/944239407 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f44d80a1f20 0x7f44d80a43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:34.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:34.189+0000 7f44eeffd700 1 -- 172.21.15.82:0/944239407 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9092+0+0 (secure 0 0 0) 0x7f44e80ceed0 con 0x7f44f0107000 2024-03-04T09:14:34.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:34.189+0000 7f44f5a4e700 1 --2- 172.21.15.82:0/944239407 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f44d80a1f20 0x7f44d80a43e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f44e0009be0 tx=0x7f44e0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:34.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:34.192+0000 7f44eeffd700 1 -- 172.21.15.82:0/944239407 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f44e8013070 con 0x7f44f0107000 2024-03-04T09:14:34.324 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738446 got 34359738452 for osd.0 2024-03-04T09:14:34.325 DEBUG:teuthology.parallel:result is None 2024-03-04T09:14:34.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:34.409+0000 7f44f7cb2700 1 -- 172.21.15.82:0/944239407 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f44f01a76f0 con 0x7f44f0107000 2024-03-04T09:14:34.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:34.409+0000 7f44eeffd700 1 -- 172.21.15.82:0/944239407 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f44e809bfe0 con 0x7f44f0107000 2024-03-04T09:14:34.406 INFO:teuthology.orchestra.run.smithi082.stdout:146028888129 2024-03-04T09:14:34.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:34.411+0000 7f44f7cb2700 1 -- 172.21.15.82:0/944239407 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f44d80a1f20 msgr2=0x7f44d80a43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:34.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:34.411+0000 7f44f7cb2700 1 --2- 172.21.15.82:0/944239407 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f44d80a1f20 0x7f44d80a43e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f44e0009be0 tx=0x7f44e0009260 comp rx=0 tx=0).stop 2024-03-04T09:14:34.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:34.411+0000 7f44f7cb2700 1 -- 172.21.15.82:0/944239407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44f0107000 msgr2=0x7f44f019a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:34.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:34.411+0000 7f44f7cb2700 1 --2- 172.21.15.82:0/944239407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44f0107000 0x7f44f019a840 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f44e800b840 tx=0x7f44e8005ef0 comp rx=0 tx=0).stop 2024-03-04T09:14:34.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:34.411+0000 7f44f7cb2700 1 -- 172.21.15.82:0/944239407 shutdown_connections 2024-03-04T09:14:34.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:34.411+0000 7f44f7cb2700 1 --2- 172.21.15.82:0/944239407 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f44d80a1f20 0x7f44d80a43e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:34.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:34.411+0000 7f44f7cb2700 1 --2- 172.21.15.82:0/944239407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44f0107000 0x7f44f019a840 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:34.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:34.411+0000 7f44f7cb2700 1 --2- 172.21.15.82:0/944239407 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44f0100fc0 0x7f44f01a06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:34.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:34.411+0000 7f44f7cb2700 1 --2- 172.21.15.82:0/944239407 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44f0101960 0x7f44f01a0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:34.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:34.411+0000 7f44f7cb2700 1 -- 172.21.15.82:0/944239407 >> 172.21.15.82:0/944239407 conn(0x7f44f0077ef0 msgr2=0x7f44f0069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:34.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:34.411+0000 7f44f7cb2700 1 -- 172.21.15.82:0/944239407 shutdown_connections 2024-03-04T09:14:34.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:34.411+0000 7f44f7cb2700 1 -- 172.21.15.82:0/944239407 wait complete. 2024-03-04T09:14:35.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.287+0000 7f911e595700 1 -- 172.21.15.82:0/1255460642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9118101070 msgr2=0x7f911810efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:35.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.287+0000 7f911e595700 1 --2- 172.21.15.82:0/1255460642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9118101070 0x7f911810efd0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f911000b0a0 tx=0x7f911000b3b0 comp rx=0 tx=0).stop 2024-03-04T09:14:35.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.287+0000 7f911e595700 1 -- 172.21.15.82:0/1255460642 shutdown_connections 2024-03-04T09:14:35.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.287+0000 7f911e595700 1 --2- 172.21.15.82:0/1255460642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9118101070 0x7f911810efd0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:35.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.287+0000 7f911e595700 1 --2- 172.21.15.82:0/1255460642 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9118107130 0x7f9118107510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:35.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.287+0000 7f911e595700 1 --2- 172.21.15.82:0/1255460642 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91181006b0 0x7f9118100b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:35.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.287+0000 7f911e595700 1 -- 172.21.15.82:0/1255460642 >> 172.21.15.82:0/1255460642 conn(0x7f91180775c0 msgr2=0x7f91180fe9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:35.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.287+0000 7f911e595700 1 -- 172.21.15.82:0/1255460642 shutdown_connections 2024-03-04T09:14:35.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.287+0000 7f911e595700 1 -- 172.21.15.82:0/1255460642 wait complete. 2024-03-04T09:14:35.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.288+0000 7f911e595700 1 Processor -- start 2024-03-04T09:14:35.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.288+0000 7f911e595700 1 -- start start 2024-03-04T09:14:35.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.288+0000 7f911e595700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91181006b0 0x7f911819e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:35.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.288+0000 7f911e595700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9118101070 0x7f911819eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:35.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.288+0000 7f911e595700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9118107130 0x7f9118198740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:35.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.288+0000 7f911e595700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9118112540 con 0x7f91181006b0 2024-03-04T09:14:35.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.288+0000 7f911e595700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91181123c0 con 0x7f9118101070 2024-03-04T09:14:35.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.288+0000 7f911e595700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91181126c0 con 0x7f9118107130 2024-03-04T09:14:35.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.288+0000 7f9117fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91181006b0 0x7f911819e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:35.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.288+0000 7f9117fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91181006b0 0x7f911819e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34746/0 (socket says 172.21.15.82:34746) 2024-03-04T09:14:35.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.288+0000 7f9117fff700 1 -- 172.21.15.82:0/2889525252 learned_addr learned my addr 172.21.15.82:0/2889525252 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:35.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.288+0000 7f91177fe700 1 --2- 172.21.15.82:0/2889525252 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9118101070 0x7f911819eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:35.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.288+0000 7f911cb32700 1 --2- 172.21.15.82:0/2889525252 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9118107130 0x7f9118198740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:35.305 INFO:teuthology.orchestra.run.smithi082.stdout:292057776167 2024-03-04T09:14:35.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.289+0000 7f9117fff700 1 -- 172.21.15.82:0/2889525252 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9118107130 msgr2=0x7f9118198740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:35.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.289+0000 7f9117fff700 1 --2- 172.21.15.82:0/2889525252 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9118107130 0x7f9118198740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:35.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.289+0000 7f9117fff700 1 -- 172.21.15.82:0/2889525252 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9118101070 msgr2=0x7f911819eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:35.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.289+0000 7f9117fff700 1 --2- 172.21.15.82:0/2889525252 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9118101070 0x7f911819eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:35.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.289+0000 7f9117fff700 1 -- 172.21.15.82:0/2889525252 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9118199020 con 0x7f91181006b0 2024-03-04T09:14:35.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.289+0000 7f91177fe700 1 --2- 172.21.15.82:0/2889525252 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9118101070 0x7f911819eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:14:35.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.289+0000 7f9117fff700 1 --2- 172.21.15.82:0/2889525252 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91181006b0 0x7f911819e620 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f910800e9c0 tx=0x7f910800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:35.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.289+0000 7f91157fa700 1 -- 172.21.15.82:0/2889525252 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910800cbd0 con 0x7f91181006b0 2024-03-04T09:14:35.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.289+0000 7f911e595700 1 -- 172.21.15.82:0/2889525252 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9118199310 con 0x7f91181006b0 2024-03-04T09:14:35.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.289+0000 7f91157fa700 1 -- 172.21.15.82:0/2889525252 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f910800ee60 con 0x7f91181006b0 2024-03-04T09:14:35.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.289+0000 7f91157fa700 1 -- 172.21.15.82:0/2889525252 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91080055f0 con 0x7f91181006b0 2024-03-04T09:14:35.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.289+0000 7f911e595700 1 -- 172.21.15.82:0/2889525252 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91181a55a0 con 0x7f91181006b0 2024-03-04T09:14:35.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.290+0000 7f911e595700 1 -- 172.21.15.82:0/2889525252 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91181039d0 con 0x7f91181006b0 2024-03-04T09:14:35.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.291+0000 7f91157fa700 1 -- 172.21.15.82:0/2889525252 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 136807+0+0 (secure 0 0 0) 0x7f9108004750 con 0x7f91181006b0 2024-03-04T09:14:35.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.292+0000 7f91157fa700 1 --2- 172.21.15.82:0/2889525252 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f91000a1ea0 0x7f91000a4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:35.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.292+0000 7f91157fa700 1 -- 172.21.15.82:0/2889525252 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9092+0+0 (secure 0 0 0) 0x7f91080ce500 con 0x7f91181006b0 2024-03-04T09:14:35.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.292+0000 7f91177fe700 1 --2- 172.21.15.82:0/2889525252 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f91000a1ea0 0x7f91000a4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:35.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.293+0000 7f91177fe700 1 --2- 172.21.15.82:0/2889525252 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f91000a1ea0 0x7f91000a4360 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9118199eb0 tx=0x7f910c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:35.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.299+0000 7f91157fa700 1 -- 172.21.15.82:0/2889525252 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f910809b470 con 0x7f91181006b0 2024-03-04T09:14:35.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.507+0000 7f911e595700 1 -- 172.21.15.82:0/2889525252 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7f9118199c20 con 0x7f91181006b0 2024-03-04T09:14:35.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.508+0000 7f91157fa700 1 -- 172.21.15.82:0/2889525252 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f910809ad70 con 0x7f91181006b0 2024-03-04T09:14:35.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.510+0000 7f911e595700 1 -- 172.21.15.82:0/2889525252 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f91000a1ea0 msgr2=0x7f91000a4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:35.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.510+0000 7f911e595700 1 --2- 172.21.15.82:0/2889525252 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f91000a1ea0 0x7f91000a4360 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9118199eb0 tx=0x7f910c009260 comp rx=0 tx=0).stop 2024-03-04T09:14:35.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.510+0000 7f911e595700 1 -- 172.21.15.82:0/2889525252 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91181006b0 msgr2=0x7f911819e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:35.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.510+0000 7f911e595700 1 --2- 172.21.15.82:0/2889525252 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91181006b0 0x7f911819e620 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f910800e9c0 tx=0x7f910800ecd0 comp rx=0 tx=0).stop 2024-03-04T09:14:35.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.510+0000 7f911e595700 1 -- 172.21.15.82:0/2889525252 shutdown_connections 2024-03-04T09:14:35.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.510+0000 7f911e595700 1 --2- 172.21.15.82:0/2889525252 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f91000a1ea0 0x7f91000a4360 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:35.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.510+0000 7f911e595700 1 --2- 172.21.15.82:0/2889525252 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9118107130 0x7f9118198740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:35.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.510+0000 7f911e595700 1 --2- 172.21.15.82:0/2889525252 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91181006b0 0x7f911819e620 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:35.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.510+0000 7f911e595700 1 --2- 172.21.15.82:0/2889525252 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9118101070 0x7f911819eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:35.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.510+0000 7f911e595700 1 -- 172.21.15.82:0/2889525252 >> 172.21.15.82:0/2889525252 conn(0x7f91180775c0 msgr2=0x7f91181050c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:35.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.510+0000 7f911e595700 1 -- 172.21.15.82:0/2889525252 shutdown_connections 2024-03-04T09:14:35.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:32.510+0000 7f911e595700 1 -- 172.21.15.82:0/2889525252 wait complete. 2024-03-04T09:14:35.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:35 smithi082 ceph-mon[32880]: pgmap v333: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-03-04T09:14:35.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:35 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/944239407' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-03-04T09:14:35.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:35 smithi190 ceph-mon[36341]: pgmap v333: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-03-04T09:14:35.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:35 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/944239407' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-03-04T09:14:35.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:35 smithi102 ceph-mon[36220]: pgmap v333: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-03-04T09:14:35.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:35 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/944239407' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-03-04T09:14:35.922 INFO:tasks.cephadm.ceph_manager.ceph:need seq 292057776163 got 292057776167 for osd.9 2024-03-04T09:14:35.923 DEBUG:teuthology.parallel:result is None 2024-03-04T09:14:37.122 INFO:tasks.cephadm.ceph_manager.ceph:need seq 257698037800 got 257698037805 for osd.8 2024-03-04T09:14:37.123 DEBUG:teuthology.parallel:result is None 2024-03-04T09:14:37.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:37.307+0000 7fb443382700 1 -- 172.21.15.82:0/3634518076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb43c106370 msgr2=0x7fb43c10df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:37.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:37.307+0000 7fb443382700 1 --2- 172.21.15.82:0/3634518076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb43c106370 0x7fb43c10df40 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb43400b0d0 tx=0x7fb43400b3e0 comp rx=0 tx=0).stop 2024-03-04T09:14:37.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:37.307+0000 7fb443382700 1 -- 172.21.15.82:0/3634518076 shutdown_connections 2024-03-04T09:14:37.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:37.307+0000 7fb443382700 1 --2- 172.21.15.82:0/3634518076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb43c106370 0x7fb43c10df40 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:37.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:37.307+0000 7fb443382700 1 --2- 172.21.15.82:0/3634518076 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb43c101290 0x7fb43c101670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:37.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:37.307+0000 7fb443382700 1 --2- 172.21.15.82:0/3634518076 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb43c101c40 0x7fb43c105c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:37.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:37.307+0000 7fb443382700 1 -- 172.21.15.82:0/3634518076 >> 172.21.15.82:0/3634518076 conn(0x7fb43c0780f0 msgr2=0x7fb43c078500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:37.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:37.307+0000 7fb443382700 1 -- 172.21.15.82:0/3634518076 shutdown_connections 2024-03-04T09:14:37.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:37.307+0000 7fb443382700 1 -- 172.21.15.82:0/3634518076 wait complete. 2024-03-04T09:14:37.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:37.308+0000 7fb443382700 1 Processor -- start 2024-03-04T09:14:37.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:37.308+0000 7fb443382700 1 -- start start 2024-03-04T09:14:37.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:37.308+0000 7fb443382700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb43c101290 0x7fb43c102d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:37.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:37.308+0000 7fb443382700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb43c101c40 0x7fb43c103270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:37.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:37.308+0000 7fb443382700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb43c106370 0x7fb43c1037b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:37.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:37.308+0000 7fb443382700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c111370 con 0x7fb43c101c40 2024-03-04T09:14:37.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:37.308+0000 7fb443382700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c1111f0 con 0x7fb43c101290 2024-03-04T09:14:37.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:37.308+0000 7fb443382700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c1114f0 con 0x7fb43c106370 2024-03-04T09:14:37.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:37.308+0000 7fb44091d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb43c101c40 0x7fb43c103270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:37.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:37.308+0000 7fb44091d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb43c101c40 0x7fb43c103270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51252/0 (socket says 172.21.15.82:51252) 2024-03-04T09:14:37.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:37.308+0000 7fb44091d700 1 -- 172.21.15.82:0/1133857883 learned_addr learned my addr 172.21.15.82:0/1133857883 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:37.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:37.308+0000 7fb44111e700 1 --2- 172.21.15.82:0/1133857883 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb43c101290 0x7fb43c102d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:37.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:37.308+0000 7fb44191f700 1 --2- 172.21.15.82:0/1133857883 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb43c106370 0x7fb43c1037b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:37.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:37.309+0000 7fb44091d700 1 -- 172.21.15.82:0/1133857883 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb43c106370 msgr2=0x7fb43c1037b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:37.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:37.309+0000 7fb44091d700 1 --2- 172.21.15.82:0/1133857883 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb43c106370 0x7fb43c1037b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:37.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:37.309+0000 7fb44091d700 1 -- 172.21.15.82:0/1133857883 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb43c101290 msgr2=0x7fb43c102d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:37.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:37.309+0000 7fb44091d700 1 --2- 172.21.15.82:0/1133857883 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb43c101290 0x7fb43c102d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:37.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:37.309+0000 7fb44091d700 1 -- 172.21.15.82:0/1133857883 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb43c1a6e10 con 0x7fb43c101c40 2024-03-04T09:14:37.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:37.309+0000 7fb44091d700 1 --2- 172.21.15.82:0/1133857883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb43c101c40 0x7fb43c103270 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb42c00e970 tx=0x7fb42c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:37.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:37.309+0000 7fb4327fc700 1 -- 172.21.15.82:0/1133857883 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42c004a30 con 0x7fb43c101c40 2024-03-04T09:14:37.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:37.309+0000 7fb443382700 1 -- 172.21.15.82:0/1133857883 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb43c1a7100 con 0x7fb43c101c40 2024-03-04T09:14:37.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:37.309+0000 7fb4327fc700 1 -- 172.21.15.82:0/1133857883 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fb42c00ccb0 con 0x7fb43c101c40 2024-03-04T09:14:37.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:37.309+0000 7fb4327fc700 1 -- 172.21.15.82:0/1133857883 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42c005680 con 0x7fb43c101c40 2024-03-04T09:14:37.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:37.309+0000 7fb443382700 1 -- 172.21.15.82:0/1133857883 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb43c1a7690 con 0x7fb43c101c40 2024-03-04T09:14:37.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:37.310+0000 7fb443382700 1 -- 172.21.15.82:0/1133857883 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb43c068d80 con 0x7fb43c101c40 2024-03-04T09:14:37.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:37.311+0000 7fb4327fc700 1 -- 172.21.15.82:0/1133857883 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 136807+0+0 (secure 0 0 0) 0x7fb42c00c7e0 con 0x7fb43c101c40 2024-03-04T09:14:37.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:37.312+0000 7fb4327fc700 1 --2- 172.21.15.82:0/1133857883 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb4280a1ea0 0x7fb4280a4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:37.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:37.312+0000 7fb44111e700 1 --2- 172.21.15.82:0/1133857883 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb4280a1ea0 0x7fb4280a4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:37.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:37.312+0000 7fb4327fc700 1 -- 172.21.15.82:0/1133857883 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9092+0+0 (secure 0 0 0) 0x7fb42c0ce300 con 0x7fb43c101c40 2024-03-04T09:14:37.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:37.312+0000 7fb44111e700 1 --2- 172.21.15.82:0/1133857883 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb4280a1ea0 0x7fb4280a4360 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb438009c60 tx=0x7fb438009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:37.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:37.316+0000 7fb4327fc700 1 -- 172.21.15.82:0/1133857883 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fb42c00cad0 con 0x7fb43c101c40 2024-03-04T09:14:37.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:37.516+0000 7fb443382700 1 -- 172.21.15.82:0/1133857883 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb43c104260 con 0x7fb43c101c40 2024-03-04T09:14:37.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:37.517+0000 7fb4327fc700 1 -- 172.21.15.82:0/1133857883 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb42c09b310 con 0x7fb43c101c40 2024-03-04T09:14:37.514 INFO:teuthology.orchestra.run.smithi082.stdout:55834574928 2024-03-04T09:14:37.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:37.519+0000 7fb443382700 1 -- 172.21.15.82:0/1133857883 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb4280a1ea0 msgr2=0x7fb4280a4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:37.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:37.519+0000 7fb443382700 1 --2- 172.21.15.82:0/1133857883 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb4280a1ea0 0x7fb4280a4360 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb438009c60 tx=0x7fb438009260 comp rx=0 tx=0).stop 2024-03-04T09:14:37.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:37.519+0000 7fb443382700 1 -- 172.21.15.82:0/1133857883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb43c101c40 msgr2=0x7fb43c103270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:37.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:37.519+0000 7fb443382700 1 --2- 172.21.15.82:0/1133857883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb43c101c40 0x7fb43c103270 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb42c00e970 tx=0x7fb42c00ec80 comp rx=0 tx=0).stop 2024-03-04T09:14:37.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:37.519+0000 7fb443382700 1 -- 172.21.15.82:0/1133857883 shutdown_connections 2024-03-04T09:14:37.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:37.519+0000 7fb443382700 1 --2- 172.21.15.82:0/1133857883 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb4280a1ea0 0x7fb4280a4360 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:37.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:37.519+0000 7fb443382700 1 --2- 172.21.15.82:0/1133857883 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb43c106370 0x7fb43c1037b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:37.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:37.519+0000 7fb443382700 1 --2- 172.21.15.82:0/1133857883 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb43c101290 0x7fb43c102d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:37.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:37.519+0000 7fb443382700 1 --2- 172.21.15.82:0/1133857883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb43c101c40 0x7fb43c103270 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:37.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:37.519+0000 7fb443382700 1 -- 172.21.15.82:0/1133857883 >> 172.21.15.82:0/1133857883 conn(0x7fb43c0780f0 msgr2=0x7fb43c06aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:37.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:37.519+0000 7fb443382700 1 -- 172.21.15.82:0/1133857883 shutdown_connections 2024-03-04T09:14:37.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:37.519+0000 7fb443382700 1 -- 172.21.15.82:0/1133857883 wait complete. 2024-03-04T09:14:37.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:37 smithi190 ceph-mon[36341]: pgmap v334: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-03-04T09:14:37.678 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:37 smithi082 ceph-mon[32880]: pgmap v334: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-03-04T09:14:37.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:37 smithi102 ceph-mon[36220]: pgmap v334: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-03-04T09:14:37.705 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888124 got 146028888129 for osd.4 2024-03-04T09:14:37.705 DEBUG:teuthology.parallel:result is None 2024-03-04T09:14:38.138 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:14:38.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.354+0000 7f2686786700 1 -- 172.21.15.82:0/3576794179 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2680102d50 msgr2=0x7f2680106d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:38.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.354+0000 7f2686786700 1 --2- 172.21.15.82:0/3576794179 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2680102d50 0x7f2680106d20 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f26740099c0 tx=0x7f2674009cd0 comp rx=0 tx=0).stop 2024-03-04T09:14:38.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.354+0000 7f2686786700 1 -- 172.21.15.82:0/3576794179 shutdown_connections 2024-03-04T09:14:38.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.354+0000 7f2686786700 1 --2- 172.21.15.82:0/3576794179 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2680107450 0x7f268010efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:38.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.354+0000 7f2686786700 1 --2- 172.21.15.82:0/3576794179 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26801023a0 0x7f2680102780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:38.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.354+0000 7f2686786700 1 --2- 172.21.15.82:0/3576794179 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2680102d50 0x7f2680106d20 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:38.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.354+0000 7f2686786700 1 -- 172.21.15.82:0/3576794179 >> 172.21.15.82:0/3576794179 conn(0x7f26800791e0 msgr2=0x7f26800795f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:38.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.354+0000 7f2686786700 1 -- 172.21.15.82:0/3576794179 shutdown_connections 2024-03-04T09:14:38.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.354+0000 7f2686786700 1 -- 172.21.15.82:0/3576794179 wait complete. 2024-03-04T09:14:38.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.354+0000 7f2686786700 1 Processor -- start 2024-03-04T09:14:38.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.354+0000 7f2686786700 1 -- start start 2024-03-04T09:14:38.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.355+0000 7f2686786700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26801023a0 0x7f268019e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:38.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.355+0000 7f2686786700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2680102d50 0x7f268019ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:38.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.355+0000 7f2686786700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2680107450 0x7f26801986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:38.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.355+0000 7f2686786700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2680112390 con 0x7f2680107450 2024-03-04T09:14:38.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.355+0000 7f2686786700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2680112210 con 0x7f2680102d50 2024-03-04T09:14:38.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.355+0000 7f2686786700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2680112510 con 0x7f26801023a0 2024-03-04T09:14:38.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.355+0000 7f2684d23700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2680107450 0x7f26801986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:38.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.355+0000 7f267ffff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26801023a0 0x7f268019e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:38.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.355+0000 7f267f7fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2680102d50 0x7f268019ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:38.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.355+0000 7f2684d23700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2680107450 0x7f26801986b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51272/0 (socket says 172.21.15.82:51272) 2024-03-04T09:14:38.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.355+0000 7f267f7fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2680102d50 0x7f268019ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.82:39586/0 (socket says 172.21.15.82:39586) 2024-03-04T09:14:38.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.355+0000 7f2684d23700 1 -- 172.21.15.82:0/2107434117 learned_addr learned my addr 172.21.15.82:0/2107434117 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:38.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.355+0000 7f267ffff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26801023a0 0x7f268019e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.82:58966/0 (socket says 172.21.15.82:58966) 2024-03-04T09:14:38.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.355+0000 7f267ffff700 1 -- 172.21.15.82:0/2107434117 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2680102d50 msgr2=0x7f268019ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:38.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.355+0000 7f267ffff700 1 --2- 172.21.15.82:0/2107434117 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2680102d50 0x7f268019ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:38.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.355+0000 7f267ffff700 1 -- 172.21.15.82:0/2107434117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2680107450 msgr2=0x7f26801986b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:38.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.355+0000 7f267ffff700 1 --2- 172.21.15.82:0/2107434117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2680107450 0x7f26801986b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:38.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.355+0000 7f267ffff700 1 -- 172.21.15.82:0/2107434117 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2680198f90 con 0x7f26801023a0 2024-03-04T09:14:38.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.355+0000 7f2684d23700 1 --2- 172.21.15.82:0/2107434117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2680107450 0x7f26801986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:14:38.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.356+0000 7f267ffff700 1 --2- 172.21.15.82:0/2107434117 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26801023a0 0x7f268019e590 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f267000e9f0 tx=0x7f267000ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:38.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.356+0000 7f267d7fa700 1 -- 172.21.15.82:0/2107434117 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267000c9c0 con 0x7f26801023a0 2024-03-04T09:14:38.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.356+0000 7f2686786700 1 -- 172.21.15.82:0/2107434117 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2680199280 con 0x7f26801023a0 2024-03-04T09:14:38.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.356+0000 7f267d7fa700 1 -- 172.21.15.82:0/2107434117 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f267000cb60 con 0x7f26801023a0 2024-03-04T09:14:38.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.356+0000 7f267d7fa700 1 -- 172.21.15.82:0/2107434117 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2670018680 con 0x7f26801023a0 2024-03-04T09:14:38.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.356+0000 7f2686786700 1 -- 172.21.15.82:0/2107434117 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26801a5510 con 0x7f26801023a0 2024-03-04T09:14:38.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.357+0000 7f2686786700 1 -- 172.21.15.82:0/2107434117 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f268010a600 con 0x7f26801023a0 2024-03-04T09:14:38.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.358+0000 7f267d7fa700 1 -- 172.21.15.82:0/2107434117 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 17) v1 ==== 136807+0+0 (secure 0 0 0) 0x7f2670010430 con 0x7f26801023a0 2024-03-04T09:14:38.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.358+0000 7f267d7fa700 1 --2- 172.21.15.82:0/2107434117 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f26680a1ea0 0x7f26680a4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:38.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.359+0000 7f267f7fe700 1 --2- 172.21.15.82:0/2107434117 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f26680a1ea0 0x7f26680a4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:38.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.359+0000 7f267d7fa700 1 -- 172.21.15.82:0/2107434117 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9092+0+0 (secure 0 0 0) 0x7f26700ce3c0 con 0x7f26801023a0 2024-03-04T09:14:38.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.359+0000 7f267f7fe700 1 --2- 172.21.15.82:0/2107434117 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f26680a1ea0 0x7f26680a4360 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2674009990 tx=0x7f2674005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:38.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.363+0000 7f267d7fa700 1 -- 172.21.15.82:0/2107434117 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f267009b2d0 con 0x7f26801023a0 2024-03-04T09:14:38.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.563+0000 7f2686786700 1 -- 172.21.15.82:0/2107434117 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2680199b90 con 0x7f26801023a0 2024-03-04T09:14:38.560 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:38 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/1133857883' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-03-04T09:14:38.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.563+0000 7f267d7fa700 1 -- 172.21.15.82:0/2107434117 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f267009abd0 con 0x7f26801023a0 2024-03-04T09:14:38.560 INFO:teuthology.orchestra.run.smithi082.stdout:111669149766 2024-03-04T09:14:38.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.565+0000 7f2686786700 1 -- 172.21.15.82:0/2107434117 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f26680a1ea0 msgr2=0x7f26680a4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:38.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.565+0000 7f2686786700 1 --2- 172.21.15.82:0/2107434117 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f26680a1ea0 0x7f26680a4360 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2674009990 tx=0x7f2674005fb0 comp rx=0 tx=0).stop 2024-03-04T09:14:38.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.565+0000 7f2686786700 1 -- 172.21.15.82:0/2107434117 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26801023a0 msgr2=0x7f268019e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:38.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.565+0000 7f2686786700 1 --2- 172.21.15.82:0/2107434117 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26801023a0 0x7f268019e590 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f267000e9f0 tx=0x7f267000ed00 comp rx=0 tx=0).stop 2024-03-04T09:14:38.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.565+0000 7f2686786700 1 -- 172.21.15.82:0/2107434117 shutdown_connections 2024-03-04T09:14:38.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.565+0000 7f2686786700 1 --2- 172.21.15.82:0/2107434117 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f26680a1ea0 0x7f26680a4360 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:38.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.565+0000 7f2686786700 1 --2- 172.21.15.82:0/2107434117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2680107450 0x7f26801986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:38.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.566+0000 7f2686786700 1 --2- 172.21.15.82:0/2107434117 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26801023a0 0x7f268019e590 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:38.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.566+0000 7f2686786700 1 --2- 172.21.15.82:0/2107434117 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2680102d50 0x7f268019ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:38.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.566+0000 7f2686786700 1 -- 172.21.15.82:0/2107434117 >> 172.21.15.82:0/2107434117 conn(0x7f26800791e0 msgr2=0x7f2680108580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:38.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.566+0000 7f2686786700 1 -- 172.21.15.82:0/2107434117 shutdown_connections 2024-03-04T09:14:38.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:38.566+0000 7f2686786700 1 -- 172.21.15.82:0/2107434117 wait complete. 2024-03-04T09:14:38.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:38 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/1133857883' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-03-04T09:14:38.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:38 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/1133857883' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-03-04T09:14:39.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:39 smithi082 ceph-mon[32880]: pgmap v335: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-03-04T09:14:39.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:39 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/2107434117' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-03-04T09:14:39.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:39 smithi190 ceph-mon[36341]: pgmap v335: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-03-04T09:14:39.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:39 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/2107434117' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-03-04T09:14:39.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:39 smithi102 ceph-mon[36220]: pgmap v335: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-03-04T09:14:39.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:39 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/2107434117' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-03-04T09:14:40.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.310+0000 7fee85476700 1 -- 172.21.15.82:0/3839155778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee80107130 msgr2=0x7fee80107510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:40.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.310+0000 7fee85476700 1 --2- 172.21.15.82:0/3839155778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee80107130 0x7fee80107510 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fee70009990 tx=0x7fee70009ca0 comp rx=0 tx=0).stop 2024-03-04T09:14:40.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.310+0000 7fee85476700 1 -- 172.21.15.82:0/3839155778 shutdown_connections 2024-03-04T09:14:40.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.310+0000 7fee85476700 1 --2- 172.21.15.82:0/3839155778 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee80101070 0x7fee8010efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:40.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.310+0000 7fee85476700 1 --2- 172.21.15.82:0/3839155778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee80107130 0x7fee80107510 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:40.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.310+0000 7fee85476700 1 --2- 172.21.15.82:0/3839155778 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee801006b0 0x7fee80100b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:40.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.310+0000 7fee85476700 1 -- 172.21.15.82:0/3839155778 >> 172.21.15.82:0/3839155778 conn(0x7fee800775c0 msgr2=0x7fee800fe9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:40.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.310+0000 7fee85476700 1 -- 172.21.15.82:0/3839155778 shutdown_connections 2024-03-04T09:14:40.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.310+0000 7fee85476700 1 -- 172.21.15.82:0/3839155778 wait complete. 2024-03-04T09:14:40.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.311+0000 7fee85476700 1 Processor -- start 2024-03-04T09:14:40.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.311+0000 7fee85476700 1 -- start start 2024-03-04T09:14:40.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.311+0000 7fee85476700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee801006b0 0x7fee8019e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:40.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.311+0000 7fee85476700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee80101070 0x7fee8019eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:40.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.311+0000 7fee85476700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee80107130 0x7fee80198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:40.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.311+0000 7fee85476700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee801124f0 con 0x7fee80107130 2024-03-04T09:14:40.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.311+0000 7fee85476700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee80112370 con 0x7fee801006b0 2024-03-04T09:14:40.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.311+0000 7fee85476700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee80112670 con 0x7fee80101070 2024-03-04T09:14:40.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.311+0000 7fee7f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee80107130 0x7fee80198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:40.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.311+0000 7fee7f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee80107130 0x7fee80198830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51288/0 (socket says 172.21.15.82:51288) 2024-03-04T09:14:40.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.311+0000 7fee7f7fe700 1 -- 172.21.15.82:0/699644796 learned_addr learned my addr 172.21.15.82:0/699644796 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:40.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.311+0000 7fee7effd700 1 --2- 172.21.15.82:0/699644796 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee801006b0 0x7fee8019e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:40.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.311+0000 7fee767fc700 1 --2- 172.21.15.82:0/699644796 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee80101070 0x7fee8019eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:40.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.311+0000 7fee7f7fe700 1 -- 172.21.15.82:0/699644796 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee80101070 msgr2=0x7fee8019eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:40.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.311+0000 7fee7f7fe700 1 --2- 172.21.15.82:0/699644796 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee80101070 0x7fee8019eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:40.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.312+0000 7fee7f7fe700 1 -- 172.21.15.82:0/699644796 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee801006b0 msgr2=0x7fee8019e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:40.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.312+0000 7fee7f7fe700 1 --2- 172.21.15.82:0/699644796 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee801006b0 0x7fee8019e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:40.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.312+0000 7fee7f7fe700 1 -- 172.21.15.82:0/699644796 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee80199010 con 0x7fee80107130 2024-03-04T09:14:40.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.312+0000 7fee7effd700 1 --2- 172.21.15.82:0/699644796 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee801006b0 0x7fee8019e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:14:40.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.312+0000 7fee7f7fe700 1 --2- 172.21.15.82:0/699644796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee80107130 0x7fee80198830 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fee7800ef90 tx=0x7fee7800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:40.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.312+0000 7fee7cff9700 1 -- 172.21.15.82:0/699644796 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee780092e0 con 0x7fee80107130 2024-03-04T09:14:40.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.312+0000 7fee7cff9700 1 -- 172.21.15.82:0/699644796 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fee78004bb0 con 0x7fee80107130 2024-03-04T09:14:40.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.312+0000 7fee7cff9700 1 -- 172.21.15.82:0/699644796 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7800ce60 con 0x7fee80107130 2024-03-04T09:14:40.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.312+0000 7fee85476700 1 -- 172.21.15.82:0/699644796 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee801992a0 con 0x7fee80107130 2024-03-04T09:14:40.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.312+0000 7fee85476700 1 -- 172.21.15.82:0/699644796 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee801a5470 con 0x7fee80107130 2024-03-04T09:14:40.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.313+0000 7fee85476700 1 -- 172.21.15.82:0/699644796 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee8010a700 con 0x7fee80107130 2024-03-04T09:14:40.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.314+0000 7fee7cff9700 1 -- 172.21.15.82:0/699644796 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 136807+0+0 (secure 0 0 0) 0x7fee7801b030 con 0x7fee80107130 2024-03-04T09:14:40.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.315+0000 7fee7cff9700 1 --2- 172.21.15.82:0/699644796 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fee6c0a1ea0 0x7fee6c0a4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:40.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.315+0000 7fee7effd700 1 --2- 172.21.15.82:0/699644796 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fee6c0a1ea0 0x7fee6c0a4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:40.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.315+0000 7fee7cff9700 1 -- 172.21.15.82:0/699644796 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9092+0+0 (secure 0 0 0) 0x7fee780cde10 con 0x7fee80107130 2024-03-04T09:14:40.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.315+0000 7fee7effd700 1 --2- 172.21.15.82:0/699644796 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fee6c0a1ea0 0x7fee6c0a4360 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fee700098e0 tx=0x7fee70005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:40.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.319+0000 7fee7cff9700 1 -- 172.21.15.82:0/699644796 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fee78022020 con 0x7fee80107130 2024-03-04T09:14:40.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.517+0000 7fee85476700 1 -- 172.21.15.82:0/699644796 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fee80199cc0 con 0x7fee80107130 2024-03-04T09:14:40.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.517+0000 7fee7cff9700 1 -- 172.21.15.82:0/699644796 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fee78010040 con 0x7fee80107130 2024-03-04T09:14:40.514 INFO:teuthology.orchestra.run.smithi082.stdout:223338299443 2024-03-04T09:14:40.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.519+0000 7fee85476700 1 -- 172.21.15.82:0/699644796 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fee6c0a1ea0 msgr2=0x7fee6c0a4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:40.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.519+0000 7fee85476700 1 --2- 172.21.15.82:0/699644796 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fee6c0a1ea0 0x7fee6c0a4360 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fee700098e0 tx=0x7fee70005960 comp rx=0 tx=0).stop 2024-03-04T09:14:40.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.519+0000 7fee85476700 1 -- 172.21.15.82:0/699644796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee80107130 msgr2=0x7fee80198830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:40.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.519+0000 7fee85476700 1 --2- 172.21.15.82:0/699644796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee80107130 0x7fee80198830 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fee7800ef90 tx=0x7fee7800c3a0 comp rx=0 tx=0).stop 2024-03-04T09:14:40.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.519+0000 7fee85476700 1 -- 172.21.15.82:0/699644796 shutdown_connections 2024-03-04T09:14:40.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.519+0000 7fee85476700 1 --2- 172.21.15.82:0/699644796 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fee6c0a1ea0 0x7fee6c0a4360 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:40.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.519+0000 7fee85476700 1 --2- 172.21.15.82:0/699644796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee80107130 0x7fee80198830 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:40.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.519+0000 7fee85476700 1 --2- 172.21.15.82:0/699644796 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee801006b0 0x7fee8019e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:40.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.519+0000 7fee85476700 1 --2- 172.21.15.82:0/699644796 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee80101070 0x7fee8019eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:40.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.520+0000 7fee85476700 1 -- 172.21.15.82:0/699644796 >> 172.21.15.82:0/699644796 conn(0x7fee800775c0 msgr2=0x7fee801051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:40.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.520+0000 7fee85476700 1 -- 172.21.15.82:0/699644796 shutdown_connections 2024-03-04T09:14:40.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:40.520+0000 7fee85476700 1 -- 172.21.15.82:0/699644796 wait complete. 2024-03-04T09:14:41.161 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574924 got 55834574928 for osd.1 2024-03-04T09:14:41.161 DEBUG:teuthology.parallel:result is None 2024-03-04T09:14:41.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:41 smithi082 ceph-mon[32880]: pgmap v336: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:14:41.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:41 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/699644796' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-03-04T09:14:41.599 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149761 got 111669149766 for osd.3 2024-03-04T09:14:41.599 DEBUG:teuthology.parallel:result is None 2024-03-04T09:14:41.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:41 smithi190 ceph-mon[36341]: pgmap v336: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:14:41.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:41 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/699644796' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-03-04T09:14:41.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:41 smithi102 ceph-mon[36220]: pgmap v336: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:14:41.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:41 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/699644796' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-03-04T09:14:42.502 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299437 got 223338299443 for osd.7 2024-03-04T09:14:42.502 DEBUG:teuthology.parallel:result is None 2024-03-04T09:14:42.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:42.714+0000 7ffb6a59c700 1 -- 172.21.15.82:0/1189533073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb64101960 msgr2=0x7ffb6410de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:42.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:42.714+0000 7ffb6a59c700 1 --2- 172.21.15.82:0/1189533073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb64101960 0x7ffb6410de40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c00b0a0 tx=0x7ffb5c00b3b0 comp rx=0 tx=0).stop 2024-03-04T09:14:42.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:42.714+0000 7ffb6a59c700 1 -- 172.21.15.82:0/1189533073 shutdown_connections 2024-03-04T09:14:42.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:42.714+0000 7ffb6a59c700 1 --2- 172.21.15.82:0/1189533073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb64101960 0x7ffb6410de40 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:42.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:42.714+0000 7ffb6a59c700 1 --2- 172.21.15.82:0/1189533073 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb64107000 0x7ffb641073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:42.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:42.714+0000 7ffb6a59c700 1 --2- 172.21.15.82:0/1189533073 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb64100fc0 0x7ffb64101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:42.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:42.714+0000 7ffb6a59c700 1 -- 172.21.15.82:0/1189533073 >> 172.21.15.82:0/1189533073 conn(0x7ffb64077ef0 msgr2=0x7ffb64078300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:42.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:42.714+0000 7ffb6a59c700 1 -- 172.21.15.82:0/1189533073 shutdown_connections 2024-03-04T09:14:42.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:42.714+0000 7ffb6a59c700 1 -- 172.21.15.82:0/1189533073 wait complete. 2024-03-04T09:14:42.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:42.715+0000 7ffb6a59c700 1 Processor -- start 2024-03-04T09:14:42.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:42.715+0000 7ffb6a59c700 1 -- start start 2024-03-04T09:14:42.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:42.715+0000 7ffb6a59c700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb64100fc0 0x7ffb641a06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:42.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:42.715+0000 7ffb6a59c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb64101960 0x7ffb641a0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:42.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:42.715+0000 7ffb6a59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb64107000 0x7ffb6419a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:42.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:42.715+0000 7ffb6a59c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb64111250 con 0x7ffb64107000 2024-03-04T09:14:42.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:42.715+0000 7ffb6a59c700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb641110d0 con 0x7ffb64100fc0 2024-03-04T09:14:42.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:42.715+0000 7ffb6a59c700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb641113d0 con 0x7ffb64101960 2024-03-04T09:14:42.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:42.715+0000 7ffb68b39700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb64107000 0x7ffb6419a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:42.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:42.715+0000 7ffb68b39700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb64107000 0x7ffb6419a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51304/0 (socket says 172.21.15.82:51304) 2024-03-04T09:14:42.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:42.715+0000 7ffb68b39700 1 -- 172.21.15.82:0/2951936052 learned_addr learned my addr 172.21.15.82:0/2951936052 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:42.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:42.715+0000 7ffb63fff700 1 --2- 172.21.15.82:0/2951936052 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb64100fc0 0x7ffb641a06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:42.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:42.715+0000 7ffb637fe700 1 --2- 172.21.15.82:0/2951936052 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb64101960 0x7ffb641a0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:42.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:42.715+0000 7ffb68b39700 1 -- 172.21.15.82:0/2951936052 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb64101960 msgr2=0x7ffb641a0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:42.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:42.715+0000 7ffb68b39700 1 --2- 172.21.15.82:0/2951936052 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb64101960 0x7ffb641a0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:42.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:42.715+0000 7ffb68b39700 1 -- 172.21.15.82:0/2951936052 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb64100fc0 msgr2=0x7ffb641a06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:42.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:42.715+0000 7ffb68b39700 1 --2- 172.21.15.82:0/2951936052 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb64100fc0 0x7ffb641a06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:42.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:42.716+0000 7ffb68b39700 1 -- 172.21.15.82:0/2951936052 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb6419b020 con 0x7ffb64107000 2024-03-04T09:14:42.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:42.716+0000 7ffb68b39700 1 --2- 172.21.15.82:0/2951936052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb64107000 0x7ffb6419a840 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c006070 tx=0x7ffb5c004ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:42.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:42.716+0000 7ffb617fa700 1 -- 172.21.15.82:0/2951936052 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c021070 con 0x7ffb64107000 2024-03-04T09:14:42.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:42.716+0000 7ffb6a59c700 1 -- 172.21.15.82:0/2951936052 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb6419b2b0 con 0x7ffb64107000 2024-03-04T09:14:42.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:42.716+0000 7ffb617fa700 1 -- 172.21.15.82:0/2951936052 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7ffb5c007e50 con 0x7ffb64107000 2024-03-04T09:14:42.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:42.716+0000 7ffb617fa700 1 -- 172.21.15.82:0/2951936052 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c004700 con 0x7ffb64107000 2024-03-04T09:14:42.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:42.716+0000 7ffb6a59c700 1 -- 172.21.15.82:0/2951936052 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb641a7520 con 0x7ffb64107000 2024-03-04T09:14:42.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:42.717+0000 7ffb6a59c700 1 -- 172.21.15.82:0/2951936052 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb641026b0 con 0x7ffb64107000 2024-03-04T09:14:42.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:42.718+0000 7ffb617fa700 1 -- 172.21.15.82:0/2951936052 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 136807+0+0 (secure 0 0 0) 0x7ffb5c003d70 con 0x7ffb64107000 2024-03-04T09:14:42.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:42.718+0000 7ffb617fa700 1 --2- 172.21.15.82:0/2951936052 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ffb4c0a1ea0 0x7ffb4c0a4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:42.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:42.719+0000 7ffb63fff700 1 --2- 172.21.15.82:0/2951936052 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ffb4c0a1ea0 0x7ffb4c0a4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:42.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:42.719+0000 7ffb617fa700 1 -- 172.21.15.82:0/2951936052 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9092+0+0 (secure 0 0 0) 0x7ffb5c0cf1b0 con 0x7ffb64107000 2024-03-04T09:14:42.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:42.719+0000 7ffb63fff700 1 --2- 172.21.15.82:0/2951936052 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ffb4c0a1ea0 0x7ffb4c0a4360 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ffb58009be0 tx=0x7ffb58009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:42.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:42.723+0000 7ffb617fa700 1 -- 172.21.15.82:0/2951936052 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7ffb5c09c1b0 con 0x7ffb64107000 2024-03-04T09:14:42.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:42.929+0000 7ffb6a59c700 1 -- 172.21.15.82:0/2951936052 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7ffb641a76f0 con 0x7ffb64107000 2024-03-04T09:14:42.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:42.929+0000 7ffb617fa700 1 -- 172.21.15.82:0/2951936052 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffb5c09bab0 con 0x7ffb64107000 2024-03-04T09:14:42.925 INFO:teuthology.orchestra.run.smithi082.stdout:201863462969 2024-03-04T09:14:42.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:42.931+0000 7ffb6a59c700 1 -- 172.21.15.82:0/2951936052 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ffb4c0a1ea0 msgr2=0x7ffb4c0a4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:42.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:42.931+0000 7ffb6a59c700 1 --2- 172.21.15.82:0/2951936052 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ffb4c0a1ea0 0x7ffb4c0a4360 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ffb58009be0 tx=0x7ffb58009260 comp rx=0 tx=0).stop 2024-03-04T09:14:42.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:42.931+0000 7ffb6a59c700 1 -- 172.21.15.82:0/2951936052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb64107000 msgr2=0x7ffb6419a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:42.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:42.931+0000 7ffb6a59c700 1 --2- 172.21.15.82:0/2951936052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb64107000 0x7ffb6419a840 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c006070 tx=0x7ffb5c004ce0 comp rx=0 tx=0).stop 2024-03-04T09:14:42.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:42.931+0000 7ffb6a59c700 1 -- 172.21.15.82:0/2951936052 shutdown_connections 2024-03-04T09:14:42.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:42.931+0000 7ffb6a59c700 1 --2- 172.21.15.82:0/2951936052 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ffb4c0a1ea0 0x7ffb4c0a4360 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:42.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:42.931+0000 7ffb6a59c700 1 --2- 172.21.15.82:0/2951936052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb64107000 0x7ffb6419a840 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:42.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:42.931+0000 7ffb6a59c700 1 --2- 172.21.15.82:0/2951936052 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb64100fc0 0x7ffb641a06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:42.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:42.931+0000 7ffb6a59c700 1 --2- 172.21.15.82:0/2951936052 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb64101960 0x7ffb641a0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:42.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:42.931+0000 7ffb6a59c700 1 -- 172.21.15.82:0/2951936052 >> 172.21.15.82:0/2951936052 conn(0x7ffb64077ef0 msgr2=0x7ffb64069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:42.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:42.931+0000 7ffb6a59c700 1 -- 172.21.15.82:0/2951936052 shutdown_connections 2024-03-04T09:14:42.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:42.931+0000 7ffb6a59c700 1 -- 172.21.15.82:0/2951936052 wait complete. 2024-03-04T09:14:43.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.366+0000 7f534941d700 1 -- 172.21.15.82:0/2709042768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53441081e0 msgr2=0x7f53441085c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:43.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.366+0000 7f534941d700 1 --2- 172.21.15.82:0/2709042768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53441081e0 0x7f53441085c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5334009990 tx=0x7f5334009ca0 comp rx=0 tx=0).stop 2024-03-04T09:14:43.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.366+0000 7f534941d700 1 -- 172.21.15.82:0/2709042768 shutdown_connections 2024-03-04T09:14:43.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.366+0000 7f534941d700 1 --2- 172.21.15.82:0/2709042768 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5344102b30 0x7f534410ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:43.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.366+0000 7f534941d700 1 --2- 172.21.15.82:0/2709042768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53441081e0 0x7f53441085c0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:43.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.366+0000 7f534941d700 1 --2- 172.21.15.82:0/2709042768 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5344102170 0x7f53441025f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:43.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.366+0000 7f534941d700 1 -- 172.21.15.82:0/2709042768 >> 172.21.15.82:0/2709042768 conn(0x7f5344079190 msgr2=0x7f53440795a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:43.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.366+0000 7f534941d700 1 -- 172.21.15.82:0/2709042768 shutdown_connections 2024-03-04T09:14:43.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.366+0000 7f534941d700 1 -- 172.21.15.82:0/2709042768 wait complete. 2024-03-04T09:14:43.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.367+0000 7f534941d700 1 Processor -- start 2024-03-04T09:14:43.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.367+0000 7f534941d700 1 -- start start 2024-03-04T09:14:43.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.367+0000 7f534941d700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5344102170 0x7f534419e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:43.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.367+0000 7f534941d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5344102b30 0x7f534419eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:43.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.367+0000 7f534941d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f53441081e0 0x7f5344198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:43.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.367+0000 7f534941d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5344112450 con 0x7f5344102b30 2024-03-04T09:14:43.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.367+0000 7f534941d700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53441122d0 con 0x7f5344102170 2024-03-04T09:14:43.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.367+0000 7f534941d700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53441125d0 con 0x7f53441081e0 2024-03-04T09:14:43.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.367+0000 7f53427fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5344102b30 0x7f534419eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:43.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.367+0000 7f53427fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5344102b30 0x7f534419eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51316/0 (socket says 172.21.15.82:51316) 2024-03-04T09:14:43.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.367+0000 7f5342ffd700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5344102170 0x7f534419e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:43.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.367+0000 7f53427fc700 1 -- 172.21.15.82:0/4244050767 learned_addr learned my addr 172.21.15.82:0/4244050767 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:43.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.367+0000 7f53437fe700 1 --2- 172.21.15.82:0/4244050767 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f53441081e0 0x7f5344198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:43.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.368+0000 7f5342ffd700 1 -- 172.21.15.82:0/4244050767 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f53441081e0 msgr2=0x7f5344198650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:43.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.368+0000 7f5342ffd700 1 --2- 172.21.15.82:0/4244050767 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f53441081e0 0x7f5344198650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:43.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.368+0000 7f5342ffd700 1 -- 172.21.15.82:0/4244050767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5344102b30 msgr2=0x7f534419eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:43.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.368+0000 7f5342ffd700 1 --2- 172.21.15.82:0/4244050767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5344102b30 0x7f534419eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:43.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.368+0000 7f5342ffd700 1 -- 172.21.15.82:0/4244050767 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5344198f30 con 0x7f5344102170 2024-03-04T09:14:43.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.368+0000 7f53427fc700 1 --2- 172.21.15.82:0/4244050767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5344102b30 0x7f534419eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:14:43.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.368+0000 7f5342ffd700 1 --2- 172.21.15.82:0/4244050767 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5344102170 0x7f534419e580 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5334006010 tx=0x7f5334005590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:43.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.368+0000 7f532bfff700 1 -- 172.21.15.82:0/4244050767 <== mon.2 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5334027070 con 0x7f5344102170 2024-03-04T09:14:43.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.368+0000 7f534941d700 1 -- 172.21.15.82:0/4244050767 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53441991c0 con 0x7f5344102170 2024-03-04T09:14:43.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.368+0000 7f532bfff700 1 -- 172.21.15.82:0/4244050767 <== mon.2 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f533400fdd0 con 0x7f5344102170 2024-03-04T09:14:43.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.368+0000 7f532bfff700 1 -- 172.21.15.82:0/4244050767 <== mon.2 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53340173f0 con 0x7f5344102170 2024-03-04T09:14:43.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.368+0000 7f534941d700 1 -- 172.21.15.82:0/4244050767 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53441a5330 con 0x7f5344102170 2024-03-04T09:14:43.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.369+0000 7f534941d700 1 -- 172.21.15.82:0/4244050767 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5344103800 con 0x7f5344102170 2024-03-04T09:14:43.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.370+0000 7f532bfff700 1 -- 172.21.15.82:0/4244050767 <== mon.2 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 17) v1 ==== 136807+0+0 (secure 0 0 0) 0x7f533402a070 con 0x7f5344102170 2024-03-04T09:14:43.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.371+0000 7f532bfff700 1 --2- 172.21.15.82:0/4244050767 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f532c0a1ea0 0x7f532c0a4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:43.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.371+0000 7f53427fc700 1 --2- 172.21.15.82:0/4244050767 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f532c0a1ea0 0x7f532c0a4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:43.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.371+0000 7f532bfff700 1 -- 172.21.15.82:0/4244050767 <== mon.2 v2:172.21.15.102:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9092+0+0 (secure 0 0 0) 0x7f53340cf130 con 0x7f5344102170 2024-03-04T09:14:43.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.371+0000 7f53427fc700 1 --2- 172.21.15.82:0/4244050767 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f532c0a1ea0 0x7f532c0a4360 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5344199e10 tx=0x7f5338009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:43.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.374+0000 7f532bfff700 1 -- 172.21.15.82:0/4244050767 <== mon.2 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f5334013070 con 0x7f5344102170 2024-03-04T09:14:43.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.397+0000 7f532bfff700 1 -- 172.21.15.82:0/4244050767 <== mon.2 v2:172.21.15.102:3300/0 7 ==== mgrmap(e 18) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f5334009d10 con 0x7f5344102170 2024-03-04T09:14:43.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.583+0000 7f534941d700 1 -- 172.21.15.82:0/4244050767 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f534402d9b0 con 0x7f5344102170 2024-03-04T09:14:43.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.583+0000 7f532bfff700 1 -- 172.21.15.82:0/4244050767 <== mon.2 v2:172.21.15.102:3300/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5334094cb0 con 0x7f5344102170 2024-03-04T09:14:43.580 INFO:teuthology.orchestra.run.smithi082.stdout:167503724605 2024-03-04T09:14:43.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.585+0000 7f534941d700 1 -- 172.21.15.82:0/4244050767 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f532c0a1ea0 msgr2=0x7f532c0a4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:43.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.585+0000 7f534941d700 1 --2- 172.21.15.82:0/4244050767 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f532c0a1ea0 0x7f532c0a4360 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5344199e10 tx=0x7f5338009260 comp rx=0 tx=0).stop 2024-03-04T09:14:43.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.585+0000 7f534941d700 1 -- 172.21.15.82:0/4244050767 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5344102170 msgr2=0x7f534419e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:43.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.585+0000 7f534941d700 1 --2- 172.21.15.82:0/4244050767 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5344102170 0x7f534419e580 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5334006010 tx=0x7f5334005590 comp rx=0 tx=0).stop 2024-03-04T09:14:43.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.585+0000 7f534941d700 1 -- 172.21.15.82:0/4244050767 shutdown_connections 2024-03-04T09:14:43.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.585+0000 7f534941d700 1 --2- 172.21.15.82:0/4244050767 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f532c0a1ea0 0x7f532c0a4360 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:43.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.585+0000 7f534941d700 1 --2- 172.21.15.82:0/4244050767 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f53441081e0 0x7f5344198650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:43.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.585+0000 7f534941d700 1 --2- 172.21.15.82:0/4244050767 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5344102170 0x7f534419e580 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:43.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.585+0000 7f534941d700 1 --2- 172.21.15.82:0/4244050767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5344102b30 0x7f534419eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:43.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.585+0000 7f534941d700 1 -- 172.21.15.82:0/4244050767 >> 172.21.15.82:0/4244050767 conn(0x7f5344079190 msgr2=0x7f5344100d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:43.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.586+0000 7f534941d700 1 -- 172.21.15.82:0/4244050767 shutdown_connections 2024-03-04T09:14:43.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:43.586+0000 7f534941d700 1 -- 172.21.15.82:0/4244050767 wait complete. 2024-03-04T09:14:43.601 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:43 smithi082 ceph-mon[32880]: pgmap v337: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-03-04T09:14:43.601 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:43 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/2951936052' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-03-04T09:14:43.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:43 smithi190 ceph-mon[36341]: pgmap v337: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-03-04T09:14:43.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:43 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/2951936052' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-03-04T09:14:43.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:43 smithi102 ceph-mon[36220]: pgmap v337: 129 pgs: 129 active+clean; 644 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-03-04T09:14:43.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:43 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/2951936052' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-03-04T09:14:44.275 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724598 got 167503724605 for osd.5 2024-03-04T09:14:44.276 DEBUG:teuthology.parallel:result is None 2024-03-04T09:14:44.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.459+0000 7f8b799ad700 1 -- 172.21.15.82:0/465197376 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b74107130 msgr2=0x7f8b74107510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:44.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.459+0000 7f8b799ad700 1 --2- 172.21.15.82:0/465197376 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b74107130 0x7f8b74107510 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8b68009990 tx=0x7f8b68009ca0 comp rx=0 tx=0).stop 2024-03-04T09:14:44.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.459+0000 7f8b799ad700 1 -- 172.21.15.82:0/465197376 shutdown_connections 2024-03-04T09:14:44.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.459+0000 7f8b799ad700 1 --2- 172.21.15.82:0/465197376 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b74101070 0x7f8b7410efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:44.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.459+0000 7f8b799ad700 1 --2- 172.21.15.82:0/465197376 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b74107130 0x7f8b74107510 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:44.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.459+0000 7f8b799ad700 1 --2- 172.21.15.82:0/465197376 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b741006b0 0x7f8b74100b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:44.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.459+0000 7f8b799ad700 1 -- 172.21.15.82:0/465197376 >> 172.21.15.82:0/465197376 conn(0x7f8b740775c0 msgr2=0x7f8b740fe9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:44.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.459+0000 7f8b799ad700 1 -- 172.21.15.82:0/465197376 shutdown_connections 2024-03-04T09:14:44.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.459+0000 7f8b799ad700 1 -- 172.21.15.82:0/465197376 wait complete. 2024-03-04T09:14:44.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.459+0000 7f8b799ad700 1 Processor -- start 2024-03-04T09:14:44.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.460+0000 7f8b799ad700 1 -- start start 2024-03-04T09:14:44.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.460+0000 7f8b799ad700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b741006b0 0x7f8b74101890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:44.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.460+0000 7f8b799ad700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b74101070 0x7f8b74101dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:44.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.460+0000 7f8b799ad700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b74107130 0x7f8b74102310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:44.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.460+0000 7f8b799ad700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b741124f0 con 0x7f8b741006b0 2024-03-04T09:14:44.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.460+0000 7f8b799ad700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b74112370 con 0x7f8b74101070 2024-03-04T09:14:44.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.460+0000 7f8b799ad700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b74112670 con 0x7f8b74107130 2024-03-04T09:14:44.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.460+0000 7f8b72ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b741006b0 0x7f8b74101890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:44.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.460+0000 7f8b72ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b741006b0 0x7f8b74101890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51338/0 (socket says 172.21.15.82:51338) 2024-03-04T09:14:44.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.460+0000 7f8b72ffd700 1 -- 172.21.15.82:0/2955616358 learned_addr learned my addr 172.21.15.82:0/2955616358 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:44.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.460+0000 7f8b727fc700 1 --2- 172.21.15.82:0/2955616358 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b74101070 0x7f8b74101dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:44.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.460+0000 7f8b737fe700 1 --2- 172.21.15.82:0/2955616358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b74107130 0x7f8b74102310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:44.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.460+0000 7f8b727fc700 1 -- 172.21.15.82:0/2955616358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b74107130 msgr2=0x7f8b74102310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:44.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.460+0000 7f8b727fc700 1 --2- 172.21.15.82:0/2955616358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b74107130 0x7f8b74102310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:44.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.460+0000 7f8b727fc700 1 -- 172.21.15.82:0/2955616358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b741006b0 msgr2=0x7f8b74101890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:44.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.460+0000 7f8b727fc700 1 --2- 172.21.15.82:0/2955616358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b741006b0 0x7f8b74101890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:44.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.460+0000 7f8b727fc700 1 -- 172.21.15.82:0/2955616358 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b741a6eb0 con 0x7f8b74101070 2024-03-04T09:14:44.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.460+0000 7f8b72ffd700 1 --2- 172.21.15.82:0/2955616358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b741006b0 0x7f8b74101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:14:44.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.461+0000 7f8b727fc700 1 --2- 172.21.15.82:0/2955616358 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b74101070 0x7f8b74101dd0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8b6400e9f0 tx=0x7f8b6400ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:44.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.461+0000 7f8b789ab700 1 -- 172.21.15.82:0/2955616358 <== mon.2 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6400c9c0 con 0x7f8b74101070 2024-03-04T09:14:44.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.461+0000 7f8b789ab700 1 -- 172.21.15.82:0/2955616358 <== mon.2 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f8b6400cb60 con 0x7f8b74101070 2024-03-04T09:14:44.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.461+0000 7f8b799ad700 1 -- 172.21.15.82:0/2955616358 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b741a71a0 con 0x7f8b74101070 2024-03-04T09:14:44.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.461+0000 7f8b789ab700 1 -- 172.21.15.82:0/2955616358 <== mon.2 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b64018680 con 0x7f8b74101070 2024-03-04T09:14:44.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.461+0000 7f8b799ad700 1 -- 172.21.15.82:0/2955616358 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b741a7730 con 0x7f8b74101070 2024-03-04T09:14:44.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.462+0000 7f8b799ad700 1 -- 172.21.15.82:0/2955616358 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b7410a700 con 0x7f8b74101070 2024-03-04T09:14:44.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.464+0000 7f8b789ab700 1 -- 172.21.15.82:0/2955616358 <== mon.2 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 18) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f8b64010430 con 0x7f8b74101070 2024-03-04T09:14:44.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.464+0000 7f8b789ab700 1 --2- 172.21.15.82:0/2955616358 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f8b5c0a1e90 0x7f8b5c0a4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:44.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.464+0000 7f8b72ffd700 1 --2- 172.21.15.82:0/2955616358 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f8b5c0a1e90 0x7f8b5c0a4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:44.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.464+0000 7f8b789ab700 1 -- 172.21.15.82:0/2955616358 <== mon.2 v2:172.21.15.102:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9092+0+0 (secure 0 0 0) 0x7f8b640ce1b0 con 0x7f8b74101070 2024-03-04T09:14:44.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.465+0000 7f8b72ffd700 1 --2- 172.21.15.82:0/2955616358 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f8b5c0a1e90 0x7f8b5c0a4350 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8b68006010 tx=0x7f8b68009570 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:44.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.471+0000 7f8b789ab700 1 -- 172.21.15.82:0/2955616358 <== mon.2 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f8b6409b280 con 0x7f8b74101070 2024-03-04T09:14:44.564 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:44 smithi082 ceph-mon[32880]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-03-04T09:14:44.564 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:44 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/4244050767' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-03-04T09:14:44.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:44 smithi190 ceph-mon[36341]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-03-04T09:14:44.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:44 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/4244050767' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-03-04T09:14:44.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:44 smithi102 ceph-mon[36220]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-03-04T09:14:44.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:44 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/4244050767' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-03-04T09:14:44.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.692+0000 7f8b799ad700 1 -- 172.21.15.82:0/2955616358 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7f8b74102d20 con 0x7f8b74101070 2024-03-04T09:14:44.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.692+0000 7f8b789ab700 1 -- 172.21.15.82:0/2955616358 <== mon.2 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f8b6409ab80 con 0x7f8b74101070 2024-03-04T09:14:44.689 INFO:teuthology.orchestra.run.smithi082.stdout:313532612645 2024-03-04T09:14:44.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.695+0000 7f8b799ad700 1 -- 172.21.15.82:0/2955616358 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f8b5c0a1e90 msgr2=0x7f8b5c0a4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:44.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.695+0000 7f8b799ad700 1 --2- 172.21.15.82:0/2955616358 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f8b5c0a1e90 0x7f8b5c0a4350 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8b68006010 tx=0x7f8b68009570 comp rx=0 tx=0).stop 2024-03-04T09:14:44.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.695+0000 7f8b799ad700 1 -- 172.21.15.82:0/2955616358 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b74101070 msgr2=0x7f8b74101dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:44.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.695+0000 7f8b799ad700 1 --2- 172.21.15.82:0/2955616358 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b74101070 0x7f8b74101dd0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8b6400e9f0 tx=0x7f8b6400ed00 comp rx=0 tx=0).stop 2024-03-04T09:14:44.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.695+0000 7f8b799ad700 1 -- 172.21.15.82:0/2955616358 shutdown_connections 2024-03-04T09:14:44.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.695+0000 7f8b799ad700 1 --2- 172.21.15.82:0/2955616358 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f8b5c0a1e90 0x7f8b5c0a4350 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:44.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.695+0000 7f8b799ad700 1 --2- 172.21.15.82:0/2955616358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b74107130 0x7f8b74102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:44.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.695+0000 7f8b799ad700 1 --2- 172.21.15.82:0/2955616358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b741006b0 0x7f8b74101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:44.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.695+0000 7f8b799ad700 1 --2- 172.21.15.82:0/2955616358 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b74101070 0x7f8b74101dd0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:44.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.695+0000 7f8b799ad700 1 -- 172.21.15.82:0/2955616358 >> 172.21.15.82:0/2955616358 conn(0x7f8b740775c0 msgr2=0x7f8b741051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:44.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.695+0000 7f8b799ad700 1 -- 172.21.15.82:0/2955616358 shutdown_connections 2024-03-04T09:14:44.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:44.695+0000 7f8b799ad700 1 -- 172.21.15.82:0/2955616358 wait complete. 2024-03-04T09:14:45.041 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462962 got 201863462969 for osd.6 2024-03-04T09:14:45.041 DEBUG:teuthology.parallel:result is None 2024-03-04T09:14:45.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:45 smithi190 ceph-mon[36341]: pgmap v338: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 10 op/s 2024-03-04T09:14:45.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:45 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/2955616358' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-03-04T09:14:45.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:45 smithi102 ceph-mon[36220]: pgmap v338: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 10 op/s 2024-03-04T09:14:45.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:45 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/2955616358' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-03-04T09:14:45.690 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:45 smithi082 ceph-mon[32880]: pgmap v338: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 10 op/s 2024-03-04T09:14:45.690 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:45 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/2955616358' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-03-04T09:14:45.717 INFO:tasks.cephadm.ceph_manager.ceph:need seq 313532612640 got 313532612645 for osd.10 2024-03-04T09:14:45.717 DEBUG:teuthology.parallel:result is None 2024-03-04T09:14:45.717 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-03-04T09:14:45.718 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph pg dump --format=json 2024-03-04T09:14:45.972 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:14:47.127 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:46 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:14:47.127 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:46 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:14:47.127 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:46 smithi082 ceph-mon[32880]: pgmap v339: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-03-04T09:14:47.127 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:46 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:14:47.128 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:46 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:14:47.128 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:46 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:14:47.170 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:46 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:14:47.170 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:46 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:14:47.170 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:46 smithi190 ceph-mon[36341]: pgmap v339: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-03-04T09:14:47.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:46 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:14:47.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:46 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:14:47.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:46 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:14:47.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:46 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:14:47.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:46 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:14:47.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:46 smithi102 ceph-mon[36220]: pgmap v339: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-03-04T09:14:47.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:46 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:14:47.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:46 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:14:47.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:46 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' 2024-03-04T09:14:47.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.621+0000 7ff057501700 1 -- 172.21.15.82:0/2798027885 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0501080f0 msgr2=0x7ff0501084d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:47.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.621+0000 7ff057501700 1 --2- 172.21.15.82:0/2798027885 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0501080f0 0x7ff0501084d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff048009fc0 tx=0x7ff04800b330 comp rx=0 tx=0).stop 2024-03-04T09:14:47.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.621+0000 7ff057501700 1 -- 172.21.15.82:0/2798027885 shutdown_connections 2024-03-04T09:14:47.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.621+0000 7ff057501700 1 --2- 172.21.15.82:0/2798027885 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff050102ad0 0x7ff05010ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:47.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.621+0000 7ff057501700 1 --2- 172.21.15.82:0/2798027885 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0501080f0 0x7ff0501084d0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:47.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.621+0000 7ff057501700 1 --2- 172.21.15.82:0/2798027885 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff050102110 0x7ff050102590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:47.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.621+0000 7ff057501700 1 -- 172.21.15.82:0/2798027885 >> 172.21.15.82:0/2798027885 conn(0x7ff0500791f0 msgr2=0x7ff050079600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:47.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.621+0000 7ff057501700 1 -- 172.21.15.82:0/2798027885 shutdown_connections 2024-03-04T09:14:47.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.621+0000 7ff057501700 1 -- 172.21.15.82:0/2798027885 wait complete. 2024-03-04T09:14:47.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.622+0000 7ff057501700 1 Processor -- start 2024-03-04T09:14:47.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.622+0000 7ff057501700 1 -- start start 2024-03-04T09:14:47.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.622+0000 7ff057501700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff050102110 0x7ff0500743c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:47.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.622+0000 7ff057501700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff050102ad0 0x7ff050074900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:47.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.622+0000 7ff057501700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0501080f0 0x7ff050074e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:47.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.622+0000 7ff057501700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff050112390 con 0x7ff050102ad0 2024-03-04T09:14:47.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.622+0000 7ff057501700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff050112210 con 0x7ff050102110 2024-03-04T09:14:47.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.622+0000 7ff057501700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff050112510 con 0x7ff0501080f0 2024-03-04T09:14:47.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.622+0000 7ff054a9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff050102ad0 0x7ff050074900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:47.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.622+0000 7ff054a9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff050102ad0 0x7ff050074900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49574/0 (socket says 172.21.15.82:49574) 2024-03-04T09:14:47.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.622+0000 7ff05529d700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff050102110 0x7ff0500743c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:47.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.622+0000 7ff054a9c700 1 -- 172.21.15.82:0/1922777419 learned_addr learned my addr 172.21.15.82:0/1922777419 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:47.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.622+0000 7ff055a9e700 1 --2- 172.21.15.82:0/1922777419 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0501080f0 0x7ff050074e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:47.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.622+0000 7ff054a9c700 1 -- 172.21.15.82:0/1922777419 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0501080f0 msgr2=0x7ff050074e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:47.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.622+0000 7ff054a9c700 1 --2- 172.21.15.82:0/1922777419 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0501080f0 0x7ff050074e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:47.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.622+0000 7ff054a9c700 1 -- 172.21.15.82:0/1922777419 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff050102110 msgr2=0x7ff0500743c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:47.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.622+0000 7ff054a9c700 1 --2- 172.21.15.82:0/1922777419 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff050102110 0x7ff0500743c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:47.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.622+0000 7ff054a9c700 1 -- 172.21.15.82:0/1922777419 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0501a6cf0 con 0x7ff050102ad0 2024-03-04T09:14:47.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.622+0000 7ff05529d700 1 --2- 172.21.15.82:0/1922777419 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff050102110 0x7ff0500743c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:14:47.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.622+0000 7ff054a9c700 1 --2- 172.21.15.82:0/1922777419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff050102ad0 0x7ff050074900 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff04000e9a0 tx=0x7ff04000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:47.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.623+0000 7ff0467fc700 1 -- 172.21.15.82:0/1922777419 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04000c9c0 con 0x7ff050102ad0 2024-03-04T09:14:47.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.623+0000 7ff057501700 1 -- 172.21.15.82:0/1922777419 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0501a6fe0 con 0x7ff050102ad0 2024-03-04T09:14:47.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.623+0000 7ff0467fc700 1 -- 172.21.15.82:0/1922777419 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7ff04000cb60 con 0x7ff050102ad0 2024-03-04T09:14:47.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.623+0000 7ff0467fc700 1 -- 172.21.15.82:0/1922777419 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff040018680 con 0x7ff050102ad0 2024-03-04T09:14:47.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.623+0000 7ff057501700 1 -- 172.21.15.82:0/1922777419 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0501a7490 con 0x7ff050102ad0 2024-03-04T09:14:47.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.624+0000 7ff057501700 1 -- 172.21.15.82:0/1922777419 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff050068d80 con 0x7ff050102ad0 2024-03-04T09:14:47.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.625+0000 7ff0467fc700 1 -- 172.21.15.82:0/1922777419 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 136756+0+0 (secure 0 0 0) 0x7ff040010430 con 0x7ff050102ad0 2024-03-04T09:14:47.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.625+0000 7ff0467fc700 1 --2- 172.21.15.82:0/1922777419 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff03c0a1e10 0x7ff03c0a42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:47.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.625+0000 7ff05529d700 1 --2- 172.21.15.82:0/1922777419 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff03c0a1e10 0x7ff03c0a42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:47.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.626+0000 7ff0467fc700 1 -- 172.21.15.82:0/1922777419 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9092+0+0 (secure 0 0 0) 0x7ff0400ce520 con 0x7ff050102ad0 2024-03-04T09:14:47.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.626+0000 7ff05529d700 1 --2- 172.21.15.82:0/1922777419 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff03c0a1e10 0x7ff03c0a42d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff048000f80 tx=0x7ff0480060c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:47.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.629+0000 7ff0467fc700 1 -- 172.21.15.82:0/1922777419 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7ff04009b5f0 con 0x7ff050102ad0 2024-03-04T09:14:47.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.818+0000 7ff057501700 1 -- 172.21.15.82:0/1922777419 --> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff05002da20 con 0x7ff03c0a1e10 2024-03-04T09:14:47.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.828+0000 7ff0467fc700 1 -- 172.21.15.82:0/1922777419 <== mgr.14152 v2:172.21.15.82:6800/1278635224 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+340941 (secure 0 0 0) 0x7ff05002da20 con 0x7ff03c0a1e10 2024-03-04T09:14:47.829 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:14:47.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.831+0000 7ff057501700 1 -- 172.21.15.82:0/1922777419 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff03c0a1e10 msgr2=0x7ff03c0a42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:47.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.831+0000 7ff057501700 1 --2- 172.21.15.82:0/1922777419 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff03c0a1e10 0x7ff03c0a42d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff048000f80 tx=0x7ff0480060c0 comp rx=0 tx=0).stop 2024-03-04T09:14:47.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.831+0000 7ff057501700 1 -- 172.21.15.82:0/1922777419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff050102ad0 msgr2=0x7ff050074900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:47.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.831+0000 7ff057501700 1 --2- 172.21.15.82:0/1922777419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff050102ad0 0x7ff050074900 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff04000e9a0 tx=0x7ff04000ecb0 comp rx=0 tx=0).stop 2024-03-04T09:14:47.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.831+0000 7ff057501700 1 -- 172.21.15.82:0/1922777419 shutdown_connections 2024-03-04T09:14:47.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.831+0000 7ff057501700 1 --2- 172.21.15.82:0/1922777419 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff03c0a1e10 0x7ff03c0a42d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:47.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.831+0000 7ff057501700 1 --2- 172.21.15.82:0/1922777419 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0501080f0 0x7ff050074e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:47.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.831+0000 7ff057501700 1 --2- 172.21.15.82:0/1922777419 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff050102110 0x7ff0500743c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:47.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.831+0000 7ff057501700 1 --2- 172.21.15.82:0/1922777419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff050102ad0 0x7ff050074900 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:47.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.831+0000 7ff057501700 1 -- 172.21.15.82:0/1922777419 >> 172.21.15.82:0/1922777419 conn(0x7ff0500791f0 msgr2=0x7ff050100cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:47.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.831+0000 7ff057501700 1 -- 172.21.15.82:0/1922777419 shutdown_connections 2024-03-04T09:14:47.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:47.831+0000 7ff057501700 1 -- 172.21.15.82:0/1922777419 wait complete. 2024-03-04T09:14:47.833 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-03-04T09:14:48.665 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":339,"stamp":"2024-03-04T09:14:46.276322+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659580,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":822,"num_read_kb":538,"num_write":429,"num_write_kb":3083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1242628,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":794,"ondisk_log_size":794,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":357352,"kb_used_data":12340,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124584472,"statfs":{"total":1151940427776,"available":1151574499328,"internally_reserved":0,"allocated":12636160,"data_stored":8000723,"data_compressed":368319,"data_compressed_allocated":499712,"data_compressed_original":2531328,"omap_allocated":19142,"internal_metadata":353154362},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,11,14,4,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":390,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":57,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003293"},"pg_stats":[{"pgid":"3.3f","version":"92'8","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.289752+0000","last_change":"2024-03-04T09:13:10.759614+0000","last_active":"2024-03-04T09:14:42.289752+0000","last_peered":"2024-03-04T09:14:42.289752+0000","last_clean":"2024-03-04T09:14:42.289752+0000","last_became_active":"2024-03-04T09:13:10.759313+0000","last_became_peered":"2024-03-04T09:13:10.759313+0000","last_unstale":"2024-03-04T09:14:42.289752+0000","last_undegraded":"2024-03-04T09:14:42.289752+0000","last_fullsized":"2024-03-04T09:14:42.289752+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:08:15.568079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"92'4","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.291777+0000","last_change":"2024-03-04T09:13:10.754367+0000","last_active":"2024-03-04T09:14:42.291777+0000","last_peered":"2024-03-04T09:14:42.291777+0000","last_clean":"2024-03-04T09:14:42.291777+0000","last_became_active":"2024-03-04T09:13:10.753984+0000","last_became_peered":"2024-03-04T09:13:10.753984+0000","last_unstale":"2024-03-04T09:14:42.291777+0000","last_undegraded":"2024-03-04T09:14:42.291777+0000","last_fullsized":"2024-03-04T09:14:42.291777+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:14:29.000334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"92'7","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.300332+0000","last_change":"2024-03-04T09:13:10.754951+0000","last_active":"2024-03-04T09:14:42.300332+0000","last_peered":"2024-03-04T09:14:42.300332+0000","last_clean":"2024-03-04T09:14:42.300332+0000","last_became_active":"2024-03-04T09:13:10.753579+0000","last_became_peered":"2024-03-04T09:13:10.753579+0000","last_unstale":"2024-03-04T09:14:42.300332+0000","last_undegraded":"2024-03-04T09:14:42.300332+0000","last_fullsized":"2024-03-04T09:14:42.300332+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:58.949790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"92'8","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.283527+0000","last_change":"2024-03-04T09:13:10.763372+0000","last_active":"2024-03-04T09:14:42.283527+0000","last_peered":"2024-03-04T09:14:42.283527+0000","last_clean":"2024-03-04T09:14:42.283527+0000","last_became_active":"2024-03-04T09:13:10.762664+0000","last_became_peered":"2024-03-04T09:13:10.762664+0000","last_unstale":"2024-03-04T09:14:42.283527+0000","last_undegraded":"2024-03-04T09:14:42.283527+0000","last_fullsized":"2024-03-04T09:14:42.283527+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:44:58.854969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"92'4","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.278371+0000","last_change":"2024-03-04T09:13:10.750348+0000","last_active":"2024-03-04T09:14:42.278371+0000","last_peered":"2024-03-04T09:14:42.278371+0000","last_clean":"2024-03-04T09:14:42.278371+0000","last_became_active":"2024-03-04T09:13:10.749997+0000","last_became_peered":"2024-03-04T09:13:10.749997+0000","last_unstale":"2024-03-04T09:14:42.278371+0000","last_undegraded":"2024-03-04T09:14:42.278371+0000","last_fullsized":"2024-03-04T09:14:42.278371+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:40.701906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"92'6","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.289990+0000","last_change":"2024-03-04T09:13:10.760385+0000","last_active":"2024-03-04T09:14:42.289990+0000","last_peered":"2024-03-04T09:14:42.289990+0000","last_clean":"2024-03-04T09:14:42.289990+0000","last_became_active":"2024-03-04T09:13:10.758679+0000","last_became_peered":"2024-03-04T09:13:10.758679+0000","last_unstale":"2024-03-04T09:14:42.289990+0000","last_undegraded":"2024-03-04T09:14:42.289990+0000","last_fullsized":"2024-03-04T09:14:42.289990+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:42:53.692190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.869219+0000","last_change":"2024-03-04T09:13:10.765288+0000","last_active":"2024-03-04T09:14:13.869219+0000","last_peered":"2024-03-04T09:14:13.869219+0000","last_clean":"2024-03-04T09:14:13.869219+0000","last_became_active":"2024-03-04T09:13:10.763295+0000","last_became_peered":"2024-03-04T09:13:10.763295+0000","last_unstale":"2024-03-04T09:14:13.869219+0000","last_undegraded":"2024-03-04T09:14:13.869219+0000","last_fullsized":"2024-03-04T09:14:13.869219+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:57:09.795996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"92'9","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.296059+0000","last_change":"2024-03-04T09:13:10.766450+0000","last_active":"2024-03-04T09:14:42.296059+0000","last_peered":"2024-03-04T09:14:42.296059+0000","last_clean":"2024-03-04T09:14:42.296059+0000","last_became_active":"2024-03-04T09:13:10.764686+0000","last_became_peered":"2024-03-04T09:13:10.764686+0000","last_unstale":"2024-03-04T09:14:42.296059+0000","last_undegraded":"2024-03-04T09:14:42.296059+0000","last_fullsized":"2024-03-04T09:14:42.296059+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:09:35.938741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"92'11","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.298850+0000","last_change":"2024-03-04T09:13:10.755868+0000","last_active":"2024-03-04T09:14:42.298850+0000","last_peered":"2024-03-04T09:14:42.298850+0000","last_clean":"2024-03-04T09:14:42.298850+0000","last_became_active":"2024-03-04T09:13:10.755543+0000","last_became_peered":"2024-03-04T09:13:10.755543+0000","last_unstale":"2024-03-04T09:14:42.298850+0000","last_undegraded":"2024-03-04T09:14:42.298850+0000","last_fullsized":"2024-03-04T09:14:42.298850+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:50.255712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"92'16","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.293092+0000","last_change":"2024-03-04T09:13:10.763599+0000","last_active":"2024-03-04T09:14:42.293092+0000","last_peered":"2024-03-04T09:14:42.293092+0000","last_clean":"2024-03-04T09:14:42.293092+0000","last_became_active":"2024-03-04T09:13:10.763281+0000","last_became_peered":"2024-03-04T09:13:10.763281+0000","last_unstale":"2024-03-04T09:14:42.293092+0000","last_undegraded":"2024-03-04T09:14:42.293092+0000","last_fullsized":"2024-03-04T09:14:42.293092+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:55:00.941408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.871184+0000","last_change":"2024-03-04T09:13:10.763605+0000","last_active":"2024-03-04T09:14:13.871184+0000","last_peered":"2024-03-04T09:14:13.871184+0000","last_clean":"2024-03-04T09:14:13.871184+0000","last_became_active":"2024-03-04T09:13:10.763291+0000","last_became_peered":"2024-03-04T09:13:10.763291+0000","last_unstale":"2024-03-04T09:14:13.871184+0000","last_undegraded":"2024-03-04T09:14:13.871184+0000","last_fullsized":"2024-03-04T09:14:13.871184+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:59:55.256414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"92'7","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.287648+0000","last_change":"2024-03-04T09:14:13.874499+0000","last_active":"2024-03-04T09:14:42.287648+0000","last_peered":"2024-03-04T09:14:42.287648+0000","last_clean":"2024-03-04T09:14:42.287648+0000","last_became_active":"2024-03-04T09:14:13.874131+0000","last_became_peered":"2024-03-04T09:14:13.874131+0000","last_unstale":"2024-03-04T09:14:42.287648+0000","last_undegraded":"2024-03-04T09:14:42.287648+0000","last_fullsized":"2024-03-04T09:14:42.287648+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:19:05.657932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"92'10","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.283654+0000","last_change":"2024-03-04T09:14:13.872979+0000","last_active":"2024-03-04T09:14:42.283654+0000","last_peered":"2024-03-04T09:14:42.283654+0000","last_clean":"2024-03-04T09:14:42.283654+0000","last_became_active":"2024-03-04T09:14:13.872626+0000","last_became_peered":"2024-03-04T09:14:13.872626+0000","last_unstale":"2024-03-04T09:14:42.283654+0000","last_undegraded":"2024-03-04T09:14:42.283654+0000","last_fullsized":"2024-03-04T09:14:42.283654+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:14:56.951110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"92'7","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.291349+0000","last_change":"2024-03-04T09:13:10.758250+0000","last_active":"2024-03-04T09:14:42.291349+0000","last_peered":"2024-03-04T09:14:42.291349+0000","last_clean":"2024-03-04T09:14:42.291349+0000","last_became_active":"2024-03-04T09:13:10.756245+0000","last_became_peered":"2024-03-04T09:13:10.756245+0000","last_unstale":"2024-03-04T09:14:42.291349+0000","last_undegraded":"2024-03-04T09:14:42.291349+0000","last_fullsized":"2024-03-04T09:14:42.291349+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:57:29.303193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"92'7","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.285199+0000","last_change":"2024-03-04T09:14:13.875639+0000","last_active":"2024-03-04T09:14:42.285199+0000","last_peered":"2024-03-04T09:14:42.285199+0000","last_clean":"2024-03-04T09:14:42.285199+0000","last_became_active":"2024-03-04T09:14:13.874827+0000","last_became_peered":"2024-03-04T09:14:13.874827+0000","last_unstale":"2024-03-04T09:14:42.285199+0000","last_undegraded":"2024-03-04T09:14:42.285199+0000","last_fullsized":"2024-03-04T09:14:42.285199+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:32:12.510018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"92'9","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.300843+0000","last_change":"2024-03-04T09:13:10.757374+0000","last_active":"2024-03-04T09:14:42.300843+0000","last_peered":"2024-03-04T09:14:42.300843+0000","last_clean":"2024-03-04T09:14:42.300843+0000","last_became_active":"2024-03-04T09:13:10.757056+0000","last_became_peered":"2024-03-04T09:13:10.757056+0000","last_unstale":"2024-03-04T09:14:42.300843+0000","last_undegraded":"2024-03-04T09:14:42.300843+0000","last_fullsized":"2024-03-04T09:14:42.300843+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:42:28.258326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"92'8","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.296987+0000","last_change":"2024-03-04T09:13:10.762375+0000","last_active":"2024-03-04T09:14:42.296987+0000","last_peered":"2024-03-04T09:14:42.296987+0000","last_clean":"2024-03-04T09:14:42.296987+0000","last_became_active":"2024-03-04T09:13:10.761813+0000","last_became_peered":"2024-03-04T09:13:10.761813+0000","last_unstale":"2024-03-04T09:14:42.296987+0000","last_undegraded":"2024-03-04T09:14:42.296987+0000","last_fullsized":"2024-03-04T09:14:42.296987+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:16:55.448189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"92'10","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.295254+0000","last_change":"2024-03-04T09:13:10.755239+0000","last_active":"2024-03-04T09:14:42.295254+0000","last_peered":"2024-03-04T09:14:42.295254+0000","last_clean":"2024-03-04T09:14:42.295254+0000","last_became_active":"2024-03-04T09:13:10.754863+0000","last_became_peered":"2024-03-04T09:13:10.754863+0000","last_unstale":"2024-03-04T09:14:42.295254+0000","last_undegraded":"2024-03-04T09:14:42.295254+0000","last_fullsized":"2024-03-04T09:14:42.295254+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:39:22.385097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"92'7","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.290669+0000","last_change":"2024-03-04T09:13:10.757899+0000","last_active":"2024-03-04T09:14:42.290669+0000","last_peered":"2024-03-04T09:14:42.290669+0000","last_clean":"2024-03-04T09:14:42.290669+0000","last_became_active":"2024-03-04T09:13:10.756155+0000","last_became_peered":"2024-03-04T09:13:10.756155+0000","last_unstale":"2024-03-04T09:14:42.290669+0000","last_undegraded":"2024-03-04T09:14:42.290669+0000","last_fullsized":"2024-03-04T09:14:42.290669+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:24:08.750137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:14.058241+0000","last_change":"2024-03-04T09:14:14.058241+0000","last_active":"2024-03-04T09:14:14.058241+0000","last_peered":"2024-03-04T09:14:14.058241+0000","last_clean":"2024-03-04T09:14:14.058241+0000","last_became_active":"2024-03-04T09:14:14.057708+0000","last_became_peered":"2024-03-04T09:14:14.057708+0000","last_unstale":"2024-03-04T09:14:14.058241+0000","last_undegraded":"2024-03-04T09:14:14.058241+0000","last_fullsized":"2024-03-04T09:14:14.058241+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:56:39.988467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,10,0],"acting":[2,3,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"90'13","reported_seq":106,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:41.094575+0000","last_change":"2024-03-04T09:13:09.732569+0000","last_active":"2024-03-04T09:14:41.094575+0000","last_peered":"2024-03-04T09:14:41.094575+0000","last_clean":"2024-03-04T09:14:41.094575+0000","last_became_active":"2024-03-04T09:13:09.732257+0000","last_became_peered":"2024-03-04T09:13:09.732257+0000","last_unstale":"2024-03-04T09:14:41.094575+0000","last_undegraded":"2024-03-04T09:14:41.094575+0000","last_fullsized":"2024-03-04T09:14:41.094575+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:11:32.462839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":66,"num_read_kb":66,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"92'5","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.289313+0000","last_change":"2024-03-04T09:13:10.758073+0000","last_active":"2024-03-04T09:14:42.289313+0000","last_peered":"2024-03-04T09:14:42.289313+0000","last_clean":"2024-03-04T09:14:42.289313+0000","last_became_active":"2024-03-04T09:13:10.757560+0000","last_became_peered":"2024-03-04T09:13:10.757560+0000","last_unstale":"2024-03-04T09:14:42.289313+0000","last_undegraded":"2024-03-04T09:14:42.289313+0000","last_fullsized":"2024-03-04T09:14:42.289313+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:21:15.482038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:14.067197+0000","last_change":"2024-03-04T09:13:14.803540+0000","last_active":"2024-03-04T09:14:14.067197+0000","last_peered":"2024-03-04T09:14:14.067197+0000","last_clean":"2024-03-04T09:14:14.067197+0000","last_became_active":"2024-03-04T09:13:14.803135+0000","last_became_peered":"2024-03-04T09:13:14.803135+0000","last_unstale":"2024-03-04T09:14:14.067197+0000","last_undegraded":"2024-03-04T09:14:14.067197+0000","last_fullsized":"2024-03-04T09:14:14.067197+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:21:28.193838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"90'2","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:14.057342+0000","last_change":"2024-03-04T09:13:09.737492+0000","last_active":"2024-03-04T09:14:14.057342+0000","last_peered":"2024-03-04T09:14:14.057342+0000","last_clean":"2024-03-04T09:14:14.057342+0000","last_became_active":"2024-03-04T09:13:09.736976+0000","last_became_peered":"2024-03-04T09:13:09.736976+0000","last_unstale":"2024-03-04T09:14:14.057342+0000","last_undegraded":"2024-03-04T09:14:14.057342+0000","last_fullsized":"2024-03-04T09:14:14.057342+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:40:53.757520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"92'6","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.296794+0000","last_change":"2024-03-04T09:13:10.758838+0000","last_active":"2024-03-04T09:14:42.296794+0000","last_peered":"2024-03-04T09:14:42.296794+0000","last_clean":"2024-03-04T09:14:42.296794+0000","last_became_active":"2024-03-04T09:13:10.758476+0000","last_became_peered":"2024-03-04T09:13:10.758476+0000","last_unstale":"2024-03-04T09:14:42.296794+0000","last_undegraded":"2024-03-04T09:14:42.296794+0000","last_fullsized":"2024-03-04T09:14:42.296794+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:22:29.762608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:14.067267+0000","last_change":"2024-03-04T09:13:14.806054+0000","last_active":"2024-03-04T09:14:14.067267+0000","last_peered":"2024-03-04T09:14:14.067267+0000","last_clean":"2024-03-04T09:14:14.067267+0000","last_became_active":"2024-03-04T09:13:14.805613+0000","last_became_peered":"2024-03-04T09:13:14.805613+0000","last_unstale":"2024-03-04T09:14:14.067267+0000","last_undegraded":"2024-03-04T09:14:14.067267+0000","last_fullsized":"2024-03-04T09:14:14.067267+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:07:49.657530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"90'12","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.866241+0000","last_change":"2024-03-04T09:13:09.741515+0000","last_active":"2024-03-04T09:14:13.866241+0000","last_peered":"2024-03-04T09:14:13.866241+0000","last_clean":"2024-03-04T09:14:13.866241+0000","last_became_active":"2024-03-04T09:13:09.740967+0000","last_became_peered":"2024-03-04T09:13:09.740967+0000","last_unstale":"2024-03-04T09:14:13.866241+0000","last_undegraded":"2024-03-04T09:14:13.866241+0000","last_fullsized":"2024-03-04T09:14:13.866241+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:56.280060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"92'9","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.299505+0000","last_change":"2024-03-04T09:13:10.751915+0000","last_active":"2024-03-04T09:14:42.299505+0000","last_peered":"2024-03-04T09:14:42.299505+0000","last_clean":"2024-03-04T09:14:42.299505+0000","last_became_active":"2024-03-04T09:13:10.751616+0000","last_became_peered":"2024-03-04T09:13:10.751616+0000","last_unstale":"2024-03-04T09:14:42.299505+0000","last_undegraded":"2024-03-04T09:14:42.299505+0000","last_fullsized":"2024-03-04T09:14:42.299505+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:35:08.099035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:14.067262+0000","last_change":"2024-03-04T09:13:14.798372+0000","last_active":"2024-03-04T09:14:14.067262+0000","last_peered":"2024-03-04T09:14:14.067262+0000","last_clean":"2024-03-04T09:14:14.067262+0000","last_became_active":"2024-03-04T09:13:14.798020+0000","last_became_peered":"2024-03-04T09:13:14.798020+0000","last_unstale":"2024-03-04T09:14:14.067262+0000","last_undegraded":"2024-03-04T09:14:14.067262+0000","last_fullsized":"2024-03-04T09:14:14.067262+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:43:41.153520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"90'5","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.866763+0000","last_change":"2024-03-04T09:13:09.739187+0000","last_active":"2024-03-04T09:14:13.866763+0000","last_peered":"2024-03-04T09:14:13.866763+0000","last_clean":"2024-03-04T09:14:13.866763+0000","last_became_active":"2024-03-04T09:13:09.738753+0000","last_became_peered":"2024-03-04T09:13:09.738753+0000","last_unstale":"2024-03-04T09:14:13.866763+0000","last_undegraded":"2024-03-04T09:14:13.866763+0000","last_fullsized":"2024-03-04T09:14:13.866763+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:29:06.512779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"92'15","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.300823+0000","last_change":"2024-03-04T09:13:10.768484+0000","last_active":"2024-03-04T09:14:42.300823+0000","last_peered":"2024-03-04T09:14:42.300823+0000","last_clean":"2024-03-04T09:14:42.300823+0000","last_became_active":"2024-03-04T09:13:10.768153+0000","last_became_peered":"2024-03-04T09:13:10.768153+0000","last_unstale":"2024-03-04T09:14:42.300823+0000","last_undegraded":"2024-03-04T09:14:42.300823+0000","last_fullsized":"2024-03-04T09:14:42.300823+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:54:28.804596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.869429+0000","last_change":"2024-03-04T09:13:14.796639+0000","last_active":"2024-03-04T09:14:13.869429+0000","last_peered":"2024-03-04T09:14:13.869429+0000","last_clean":"2024-03-04T09:14:13.869429+0000","last_became_active":"2024-03-04T09:13:14.796128+0000","last_became_peered":"2024-03-04T09:13:14.796128+0000","last_unstale":"2024-03-04T09:14:13.869429+0000","last_undegraded":"2024-03-04T09:14:13.869429+0000","last_fullsized":"2024-03-04T09:14:13.869429+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:31:53.013126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'5","reported_seq":101,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:43.093398+0000","last_change":"2024-03-04T09:13:09.741381+0000","last_active":"2024-03-04T09:14:43.093398+0000","last_peered":"2024-03-04T09:14:43.093398+0000","last_clean":"2024-03-04T09:14:43.093398+0000","last_became_active":"2024-03-04T09:13:09.741032+0000","last_became_peered":"2024-03-04T09:13:09.741032+0000","last_unstale":"2024-03-04T09:14:43.093398+0000","last_undegraded":"2024-03-04T09:14:43.093398+0000","last_fullsized":"2024-03-04T09:14:43.093398+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:36:12.430867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":69,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"92'7","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.282614+0000","last_change":"2024-03-04T09:13:10.756778+0000","last_active":"2024-03-04T09:14:42.282614+0000","last_peered":"2024-03-04T09:14:42.282614+0000","last_clean":"2024-03-04T09:14:42.282614+0000","last_became_active":"2024-03-04T09:13:10.755405+0000","last_became_peered":"2024-03-04T09:13:10.755405+0000","last_unstale":"2024-03-04T09:14:42.282614+0000","last_undegraded":"2024-03-04T09:14:42.282614+0000","last_fullsized":"2024-03-04T09:14:42.282614+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:13:47.425603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.869646+0000","last_change":"2024-03-04T09:13:14.803737+0000","last_active":"2024-03-04T09:14:13.869646+0000","last_peered":"2024-03-04T09:14:13.869646+0000","last_clean":"2024-03-04T09:14:13.869646+0000","last_became_active":"2024-03-04T09:13:14.803261+0000","last_became_peered":"2024-03-04T09:13:14.803261+0000","last_unstale":"2024-03-04T09:14:13.869646+0000","last_undegraded":"2024-03-04T09:14:13.869646+0000","last_fullsized":"2024-03-04T09:14:13.869646+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:41:03.717797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"90'7","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.866999+0000","last_change":"2024-03-04T09:13:09.732193+0000","last_active":"2024-03-04T09:14:13.866999+0000","last_peered":"2024-03-04T09:14:13.866999+0000","last_clean":"2024-03-04T09:14:13.866999+0000","last_became_active":"2024-03-04T09:13:09.731791+0000","last_became_peered":"2024-03-04T09:13:09.731791+0000","last_unstale":"2024-03-04T09:14:13.866999+0000","last_undegraded":"2024-03-04T09:14:13.866999+0000","last_fullsized":"2024-03-04T09:14:13.866999+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:29.685931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"92'8","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.299324+0000","last_change":"2024-03-04T09:13:10.771291+0000","last_active":"2024-03-04T09:14:42.299324+0000","last_peered":"2024-03-04T09:14:42.299324+0000","last_clean":"2024-03-04T09:14:42.299324+0000","last_became_active":"2024-03-04T09:13:10.770978+0000","last_became_peered":"2024-03-04T09:13:10.770978+0000","last_unstale":"2024-03-04T09:14:42.299324+0000","last_undegraded":"2024-03-04T09:14:42.299324+0000","last_fullsized":"2024-03-04T09:14:42.299324+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:21:54.121918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.867043+0000","last_change":"2024-03-04T09:13:14.806788+0000","last_active":"2024-03-04T09:14:13.867043+0000","last_peered":"2024-03-04T09:14:13.867043+0000","last_clean":"2024-03-04T09:14:13.867043+0000","last_became_active":"2024-03-04T09:13:14.806379+0000","last_became_peered":"2024-03-04T09:13:14.806379+0000","last_unstale":"2024-03-04T09:14:13.867043+0000","last_undegraded":"2024-03-04T09:14:13.867043+0000","last_fullsized":"2024-03-04T09:14:13.867043+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:27:42.780954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"90'3","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.870584+0000","last_change":"2024-03-04T09:13:09.736299+0000","last_active":"2024-03-04T09:14:13.870584+0000","last_peered":"2024-03-04T09:14:13.870584+0000","last_clean":"2024-03-04T09:14:13.870584+0000","last_became_active":"2024-03-04T09:13:09.735917+0000","last_became_peered":"2024-03-04T09:13:09.735917+0000","last_unstale":"2024-03-04T09:14:13.870584+0000","last_undegraded":"2024-03-04T09:14:13.870584+0000","last_fullsized":"2024-03-04T09:14:13.870584+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:14:22.130089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"92'8","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.289350+0000","last_change":"2024-03-04T09:13:10.761135+0000","last_active":"2024-03-04T09:14:42.289350+0000","last_peered":"2024-03-04T09:14:42.289350+0000","last_clean":"2024-03-04T09:14:42.289350+0000","last_became_active":"2024-03-04T09:13:10.760819+0000","last_became_peered":"2024-03-04T09:13:10.760819+0000","last_unstale":"2024-03-04T09:14:42.289350+0000","last_undegraded":"2024-03-04T09:14:42.289350+0000","last_fullsized":"2024-03-04T09:14:42.289350+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:27:30.315659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.870560+0000","last_change":"2024-03-04T09:13:14.799057+0000","last_active":"2024-03-04T09:14:13.870560+0000","last_peered":"2024-03-04T09:14:13.870560+0000","last_clean":"2024-03-04T09:14:13.870560+0000","last_became_active":"2024-03-04T09:13:14.798670+0000","last_became_peered":"2024-03-04T09:13:14.798670+0000","last_unstale":"2024-03-04T09:14:13.870560+0000","last_undegraded":"2024-03-04T09:14:13.870560+0000","last_fullsized":"2024-03-04T09:14:13.870560+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:16:01.777432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"90'3","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.870389+0000","last_change":"2024-03-04T09:13:09.744045+0000","last_active":"2024-03-04T09:14:13.870389+0000","last_peered":"2024-03-04T09:14:13.870389+0000","last_clean":"2024-03-04T09:14:13.870389+0000","last_became_active":"2024-03-04T09:13:09.741411+0000","last_became_peered":"2024-03-04T09:13:09.741411+0000","last_unstale":"2024-03-04T09:14:13.870389+0000","last_undegraded":"2024-03-04T09:14:13.870389+0000","last_fullsized":"2024-03-04T09:14:13.870389+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:44:22.647120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"92'11","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.291458+0000","last_change":"2024-03-04T09:13:10.762598+0000","last_active":"2024-03-04T09:14:42.291458+0000","last_peered":"2024-03-04T09:14:42.291458+0000","last_clean":"2024-03-04T09:14:42.291458+0000","last_became_active":"2024-03-04T09:13:10.762252+0000","last_became_peered":"2024-03-04T09:13:10.762252+0000","last_unstale":"2024-03-04T09:14:42.291458+0000","last_undegraded":"2024-03-04T09:14:42.291458+0000","last_fullsized":"2024-03-04T09:14:42.291458+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:17:02.924550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:14.056872+0000","last_change":"2024-03-04T09:13:14.805423+0000","last_active":"2024-03-04T09:14:14.056872+0000","last_peered":"2024-03-04T09:14:14.056872+0000","last_clean":"2024-03-04T09:14:14.056872+0000","last_became_active":"2024-03-04T09:13:14.805047+0000","last_became_peered":"2024-03-04T09:13:14.805047+0000","last_unstale":"2024-03-04T09:14:14.056872+0000","last_undegraded":"2024-03-04T09:14:14.056872+0000","last_fullsized":"2024-03-04T09:14:14.056872+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:51:51.804507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"90'4","reported_seq":163,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:43.092956+0000","last_change":"2024-03-04T09:13:09.736752+0000","last_active":"2024-03-04T09:14:43.092956+0000","last_peered":"2024-03-04T09:14:43.092956+0000","last_clean":"2024-03-04T09:14:43.092956+0000","last_became_active":"2024-03-04T09:13:09.736477+0000","last_became_peered":"2024-03-04T09:13:09.736477+0000","last_unstale":"2024-03-04T09:14:43.092956+0000","last_undegraded":"2024-03-04T09:14:43.092956+0000","last_fullsized":"2024-03-04T09:14:43.092956+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:37:11.270022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":132,"num_read_kb":132,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"92'10","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.296523+0000","last_change":"2024-03-04T09:13:10.751255+0000","last_active":"2024-03-04T09:14:42.296523+0000","last_peered":"2024-03-04T09:14:42.296523+0000","last_clean":"2024-03-04T09:14:42.296523+0000","last_became_active":"2024-03-04T09:13:10.750891+0000","last_became_peered":"2024-03-04T09:13:10.750891+0000","last_unstale":"2024-03-04T09:14:42.296523+0000","last_undegraded":"2024-03-04T09:14:42.296523+0000","last_fullsized":"2024-03-04T09:14:42.296523+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:29:08.212529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:14.069820+0000","last_change":"2024-03-04T09:14:14.069365+0000","last_active":"2024-03-04T09:14:14.069820+0000","last_peered":"2024-03-04T09:14:14.069820+0000","last_clean":"2024-03-04T09:14:14.069820+0000","last_became_active":"2024-03-04T09:14:14.068717+0000","last_became_peered":"2024-03-04T09:14:14.068717+0000","last_unstale":"2024-03-04T09:14:14.069820+0000","last_undegraded":"2024-03-04T09:14:14.069820+0000","last_fullsized":"2024-03-04T09:14:14.069820+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:25:26.751362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.16","version":"90'4","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.871236+0000","last_change":"2024-03-04T09:13:09.739765+0000","last_active":"2024-03-04T09:14:13.871236+0000","last_peered":"2024-03-04T09:14:13.871236+0000","last_clean":"2024-03-04T09:14:13.871236+0000","last_became_active":"2024-03-04T09:13:09.739163+0000","last_became_peered":"2024-03-04T09:13:09.739163+0000","last_unstale":"2024-03-04T09:14:13.871236+0000","last_undegraded":"2024-03-04T09:14:13.871236+0000","last_fullsized":"2024-03-04T09:14:13.871236+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:30:15.561241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"92'9","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.292428+0000","last_change":"2024-03-04T09:13:10.770051+0000","last_active":"2024-03-04T09:14:42.292428+0000","last_peered":"2024-03-04T09:14:42.292428+0000","last_clean":"2024-03-04T09:14:42.292428+0000","last_became_active":"2024-03-04T09:13:10.769709+0000","last_became_peered":"2024-03-04T09:13:10.769709+0000","last_unstale":"2024-03-04T09:14:42.292428+0000","last_undegraded":"2024-03-04T09:14:42.292428+0000","last_fullsized":"2024-03-04T09:14:42.292428+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:42:36.328095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:14.067547+0000","last_change":"2024-03-04T09:13:14.804997+0000","last_active":"2024-03-04T09:14:14.067547+0000","last_peered":"2024-03-04T09:14:14.067547+0000","last_clean":"2024-03-04T09:14:14.067547+0000","last_became_active":"2024-03-04T09:13:14.804631+0000","last_became_peered":"2024-03-04T09:13:14.804631+0000","last_unstale":"2024-03-04T09:14:14.067547+0000","last_undegraded":"2024-03-04T09:14:14.067547+0000","last_fullsized":"2024-03-04T09:14:14.067547+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:15:18.843528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"90'5","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.870931+0000","last_change":"2024-03-04T09:13:09.743900+0000","last_active":"2024-03-04T09:14:13.870931+0000","last_peered":"2024-03-04T09:14:13.870931+0000","last_clean":"2024-03-04T09:14:13.870931+0000","last_became_active":"2024-03-04T09:13:09.743591+0000","last_became_peered":"2024-03-04T09:13:09.743591+0000","last_unstale":"2024-03-04T09:14:13.870931+0000","last_undegraded":"2024-03-04T09:14:13.870931+0000","last_fullsized":"2024-03-04T09:14:13.870931+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:47:31.365014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"92'11","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.299158+0000","last_change":"2024-03-04T09:13:10.754163+0000","last_active":"2024-03-04T09:14:42.299158+0000","last_peered":"2024-03-04T09:14:42.299158+0000","last_clean":"2024-03-04T09:14:42.299158+0000","last_became_active":"2024-03-04T09:13:10.753814+0000","last_became_peered":"2024-03-04T09:13:10.753814+0000","last_unstale":"2024-03-04T09:14:42.299158+0000","last_undegraded":"2024-03-04T09:14:42.299158+0000","last_fullsized":"2024-03-04T09:14:42.299158+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:44:31.771205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.869035+0000","last_change":"2024-03-04T09:13:14.803145+0000","last_active":"2024-03-04T09:14:13.869035+0000","last_peered":"2024-03-04T09:14:13.869035+0000","last_clean":"2024-03-04T09:14:13.869035+0000","last_became_active":"2024-03-04T09:13:14.802695+0000","last_became_peered":"2024-03-04T09:13:14.802695+0000","last_unstale":"2024-03-04T09:14:13.869035+0000","last_undegraded":"2024-03-04T09:14:13.869035+0000","last_fullsized":"2024-03-04T09:14:13.869035+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:43:46.854564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"92'36","reported_seq":219,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:43.096970+0000","last_change":"2024-03-04T09:14:14.075796+0000","last_active":"2024-03-04T09:14:43.096970+0000","last_peered":"2024-03-04T09:14:43.096970+0000","last_clean":"2024-03-04T09:14:43.096970+0000","last_became_active":"2024-03-04T09:14:14.069192+0000","last_became_peered":"2024-03-04T09:14:14.069192+0000","last_unstale":"2024-03-04T09:14:43.096970+0000","last_undegraded":"2024-03-04T09:14:43.096970+0000","last_fullsized":"2024-03-04T09:14:43.096970+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:54:57.097871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62024,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":38,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":61775,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"92'6","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.269130+0000","last_change":"2024-03-04T09:13:10.754584+0000","last_active":"2024-03-04T09:14:42.269130+0000","last_peered":"2024-03-04T09:14:42.269130+0000","last_clean":"2024-03-04T09:14:42.269130+0000","last_became_active":"2024-03-04T09:13:10.754270+0000","last_became_peered":"2024-03-04T09:13:10.754270+0000","last_unstale":"2024-03-04T09:14:42.269130+0000","last_undegraded":"2024-03-04T09:14:42.269130+0000","last_fullsized":"2024-03-04T09:14:42.269130+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:22:26.480337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.871301+0000","last_change":"2024-03-04T09:13:14.797302+0000","last_active":"2024-03-04T09:14:13.871301+0000","last_peered":"2024-03-04T09:14:13.871301+0000","last_clean":"2024-03-04T09:14:13.871301+0000","last_became_active":"2024-03-04T09:13:14.796549+0000","last_became_peered":"2024-03-04T09:13:14.796549+0000","last_unstale":"2024-03-04T09:14:13.871301+0000","last_undegraded":"2024-03-04T09:14:13.871301+0000","last_fullsized":"2024-03-04T09:14:13.871301+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:28:09.499393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"90'9","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.869724+0000","last_change":"2024-03-04T09:13:09.737567+0000","last_active":"2024-03-04T09:14:13.869724+0000","last_peered":"2024-03-04T09:14:13.869724+0000","last_clean":"2024-03-04T09:14:13.869724+0000","last_became_active":"2024-03-04T09:13:09.735154+0000","last_became_peered":"2024-03-04T09:13:09.735154+0000","last_unstale":"2024-03-04T09:14:13.869724+0000","last_undegraded":"2024-03-04T09:14:13.869724+0000","last_fullsized":"2024-03-04T09:14:13.869724+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:04:49.719107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"92'9","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.298579+0000","last_change":"2024-03-04T09:13:10.751959+0000","last_active":"2024-03-04T09:14:42.298579+0000","last_peered":"2024-03-04T09:14:42.298579+0000","last_clean":"2024-03-04T09:14:42.298579+0000","last_became_active":"2024-03-04T09:13:10.751638+0000","last_became_peered":"2024-03-04T09:13:10.751638+0000","last_unstale":"2024-03-04T09:14:42.298579+0000","last_undegraded":"2024-03-04T09:14:42.298579+0000","last_fullsized":"2024-03-04T09:14:42.298579+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:52:52.005226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.867194+0000","last_change":"2024-03-04T09:13:14.803490+0000","last_active":"2024-03-04T09:14:13.867194+0000","last_peered":"2024-03-04T09:14:13.867194+0000","last_clean":"2024-03-04T09:14:13.867194+0000","last_became_active":"2024-03-04T09:13:14.803046+0000","last_became_peered":"2024-03-04T09:13:14.803046+0000","last_unstale":"2024-03-04T09:14:13.867194+0000","last_undegraded":"2024-03-04T09:14:13.867194+0000","last_fullsized":"2024-03-04T09:14:13.867194+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:54:48.170806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"90'5","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.870832+0000","last_change":"2024-03-04T09:13:09.744437+0000","last_active":"2024-03-04T09:14:13.870832+0000","last_peered":"2024-03-04T09:14:13.870832+0000","last_clean":"2024-03-04T09:14:13.870832+0000","last_became_active":"2024-03-04T09:13:09.743112+0000","last_became_peered":"2024-03-04T09:13:09.743112+0000","last_unstale":"2024-03-04T09:14:13.870832+0000","last_undegraded":"2024-03-04T09:14:13.870832+0000","last_fullsized":"2024-03-04T09:14:13.870832+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:12:16.431869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.870510+0000","last_change":"2024-03-04T09:13:10.770817+0000","last_active":"2024-03-04T09:14:13.870510+0000","last_peered":"2024-03-04T09:14:13.870510+0000","last_clean":"2024-03-04T09:14:13.870510+0000","last_became_active":"2024-03-04T09:13:10.770340+0000","last_became_peered":"2024-03-04T09:13:10.770340+0000","last_unstale":"2024-03-04T09:14:13.870510+0000","last_undegraded":"2024-03-04T09:14:13.870510+0000","last_fullsized":"2024-03-04T09:14:13.870510+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:00:53.050111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.869749+0000","last_change":"2024-03-04T09:13:14.805982+0000","last_active":"2024-03-04T09:14:13.869749+0000","last_peered":"2024-03-04T09:14:13.869749+0000","last_clean":"2024-03-04T09:14:13.869749+0000","last_became_active":"2024-03-04T09:13:14.805280+0000","last_became_peered":"2024-03-04T09:13:14.805280+0000","last_unstale":"2024-03-04T09:14:13.869749+0000","last_undegraded":"2024-03-04T09:14:13.869749+0000","last_fullsized":"2024-03-04T09:14:13.869749+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:39:23.058890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"92'7","reported_seq":105,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:44.099151+0000","last_change":"2024-03-04T09:13:09.736144+0000","last_active":"2024-03-04T09:14:44.099151+0000","last_peered":"2024-03-04T09:14:44.099151+0000","last_clean":"2024-03-04T09:14:44.099151+0000","last_became_active":"2024-03-04T09:13:09.735802+0000","last_became_peered":"2024-03-04T09:13:09.735802+0000","last_unstale":"2024-03-04T09:14:44.099151+0000","last_undegraded":"2024-03-04T09:14:44.099151+0000","last_fullsized":"2024-03-04T09:14:44.099151+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:01.935616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":4,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.869742+0000","last_change":"2024-03-04T09:13:10.754813+0000","last_active":"2024-03-04T09:14:13.869742+0000","last_peered":"2024-03-04T09:14:13.869742+0000","last_clean":"2024-03-04T09:14:13.869742+0000","last_became_active":"2024-03-04T09:13:10.754429+0000","last_became_peered":"2024-03-04T09:13:10.754429+0000","last_unstale":"2024-03-04T09:14:13.869742+0000","last_undegraded":"2024-03-04T09:14:13.869742+0000","last_fullsized":"2024-03-04T09:14:13.869742+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:06:57.885434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.871248+0000","last_change":"2024-03-04T09:13:14.808464+0000","last_active":"2024-03-04T09:14:13.871248+0000","last_peered":"2024-03-04T09:14:13.871248+0000","last_clean":"2024-03-04T09:14:13.871248+0000","last_became_active":"2024-03-04T09:13:14.807967+0000","last_became_peered":"2024-03-04T09:13:14.807967+0000","last_unstale":"2024-03-04T09:14:13.871248+0000","last_undegraded":"2024-03-04T09:14:13.871248+0000","last_fullsized":"2024-03-04T09:14:13.871248+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:05:00.961999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"90'17","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.866546+0000","last_change":"2024-03-04T09:13:09.739149+0000","last_active":"2024-03-04T09:14:13.866546+0000","last_peered":"2024-03-04T09:14:13.866546+0000","last_clean":"2024-03-04T09:14:13.866546+0000","last_became_active":"2024-03-04T09:13:09.738823+0000","last_became_peered":"2024-03-04T09:13:09.738823+0000","last_unstale":"2024-03-04T09:14:13.866546+0000","last_undegraded":"2024-03-04T09:14:13.866546+0000","last_fullsized":"2024-03-04T09:14:13.866546+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:33:09.987846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"92'6","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.296967+0000","last_change":"2024-03-04T09:14:13.873239+0000","last_active":"2024-03-04T09:14:42.296967+0000","last_peered":"2024-03-04T09:14:42.296967+0000","last_clean":"2024-03-04T09:14:42.296967+0000","last_became_active":"2024-03-04T09:14:13.872905+0000","last_became_peered":"2024-03-04T09:14:13.872905+0000","last_unstale":"2024-03-04T09:14:42.296967+0000","last_undegraded":"2024-03-04T09:14:42.296967+0000","last_fullsized":"2024-03-04T09:14:42.296967+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:18:00.167359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.871262+0000","last_change":"2024-03-04T09:13:14.797382+0000","last_active":"2024-03-04T09:14:13.871262+0000","last_peered":"2024-03-04T09:14:13.871262+0000","last_clean":"2024-03-04T09:14:13.871262+0000","last_became_active":"2024-03-04T09:13:14.795839+0000","last_became_peered":"2024-03-04T09:13:14.795839+0000","last_unstale":"2024-03-04T09:14:13.871262+0000","last_undegraded":"2024-03-04T09:14:13.871262+0000","last_fullsized":"2024-03-04T09:14:13.871262+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:30.992018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"90'2","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.866596+0000","last_change":"2024-03-04T09:13:09.740678+0000","last_active":"2024-03-04T09:14:13.866596+0000","last_peered":"2024-03-04T09:14:13.866596+0000","last_clean":"2024-03-04T09:14:13.866596+0000","last_became_active":"2024-03-04T09:13:09.740371+0000","last_became_peered":"2024-03-04T09:13:09.740371+0000","last_unstale":"2024-03-04T09:14:13.866596+0000","last_undegraded":"2024-03-04T09:14:13.866596+0000","last_fullsized":"2024-03-04T09:14:13.866596+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:08:05.098610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"92'5","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.295364+0000","last_change":"2024-03-04T09:13:10.769034+0000","last_active":"2024-03-04T09:14:42.295364+0000","last_peered":"2024-03-04T09:14:42.295364+0000","last_clean":"2024-03-04T09:14:42.295364+0000","last_became_active":"2024-03-04T09:13:10.768700+0000","last_became_peered":"2024-03-04T09:13:10.768700+0000","last_unstale":"2024-03-04T09:14:42.295364+0000","last_undegraded":"2024-03-04T09:14:42.295364+0000","last_fullsized":"2024-03-04T09:14:42.295364+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:34:56.367097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.873167+0000","last_change":"2024-03-04T09:14:13.873167+0000","last_active":"2024-03-04T09:14:13.873167+0000","last_peered":"2024-03-04T09:14:13.873167+0000","last_clean":"2024-03-04T09:14:13.873167+0000","last_became_active":"2024-03-04T09:14:13.872736+0000","last_became_peered":"2024-03-04T09:14:13.872736+0000","last_unstale":"2024-03-04T09:14:13.873167+0000","last_undegraded":"2024-03-04T09:14:13.873167+0000","last_fullsized":"2024-03-04T09:14:13.873167+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:37:31.806930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"90'1","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.869266+0000","last_change":"2024-03-04T09:13:09.739307+0000","last_active":"2024-03-04T09:14:13.869266+0000","last_peered":"2024-03-04T09:14:13.869266+0000","last_clean":"2024-03-04T09:14:13.869266+0000","last_became_active":"2024-03-04T09:13:09.739014+0000","last_became_peered":"2024-03-04T09:13:09.739014+0000","last_unstale":"2024-03-04T09:14:13.869266+0000","last_undegraded":"2024-03-04T09:14:13.869266+0000","last_fullsized":"2024-03-04T09:14:13.869266+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:19.128412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"92'4","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.287378+0000","last_change":"2024-03-04T09:13:10.761224+0000","last_active":"2024-03-04T09:14:42.287378+0000","last_peered":"2024-03-04T09:14:42.287378+0000","last_clean":"2024-03-04T09:14:42.287378+0000","last_became_active":"2024-03-04T09:13:10.760861+0000","last_became_peered":"2024-03-04T09:13:10.760861+0000","last_unstale":"2024-03-04T09:14:42.287378+0000","last_undegraded":"2024-03-04T09:14:42.287378+0000","last_fullsized":"2024-03-04T09:14:42.287378+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:58:56.666386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.871322+0000","last_change":"2024-03-04T09:13:14.796490+0000","last_active":"2024-03-04T09:14:13.871322+0000","last_peered":"2024-03-04T09:14:13.871322+0000","last_clean":"2024-03-04T09:14:13.871322+0000","last_became_active":"2024-03-04T09:13:14.796103+0000","last_became_peered":"2024-03-04T09:13:14.796103+0000","last_unstale":"2024-03-04T09:14:13.871322+0000","last_undegraded":"2024-03-04T09:14:13.871322+0000","last_fullsized":"2024-03-04T09:14:13.871322+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:34:05.983201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"90'5","reported_seq":97,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:40.094060+0000","last_change":"2024-03-04T09:13:09.739500+0000","last_active":"2024-03-04T09:14:40.094060+0000","last_peered":"2024-03-04T09:14:40.094060+0000","last_clean":"2024-03-04T09:14:40.094060+0000","last_became_active":"2024-03-04T09:13:09.739156+0000","last_became_peered":"2024-03-04T09:13:09.739156+0000","last_unstale":"2024-03-04T09:14:40.094060+0000","last_undegraded":"2024-03-04T09:14:40.094060+0000","last_fullsized":"2024-03-04T09:14:40.094060+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:07:05.319066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":65,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"92'7","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.290613+0000","last_change":"2024-03-04T09:13:10.762237+0000","last_active":"2024-03-04T09:14:42.290613+0000","last_peered":"2024-03-04T09:14:42.290613+0000","last_clean":"2024-03-04T09:14:42.290613+0000","last_became_active":"2024-03-04T09:13:10.761914+0000","last_became_peered":"2024-03-04T09:13:10.761914+0000","last_unstale":"2024-03-04T09:14:42.290613+0000","last_undegraded":"2024-03-04T09:14:42.290613+0000","last_fullsized":"2024-03-04T09:14:42.290613+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:25:49.156700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.870787+0000","last_change":"2024-03-04T09:13:14.827814+0000","last_active":"2024-03-04T09:14:13.870787+0000","last_peered":"2024-03-04T09:14:13.870787+0000","last_clean":"2024-03-04T09:14:13.870787+0000","last_became_active":"2024-03-04T09:13:14.827411+0000","last_became_peered":"2024-03-04T09:13:14.827411+0000","last_unstale":"2024-03-04T09:14:13.870787+0000","last_undegraded":"2024-03-04T09:14:13.870787+0000","last_fullsized":"2024-03-04T09:14:13.870787+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:23:32.702066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"92'8","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.296195+0000","last_change":"2024-03-04T09:13:10.773292+0000","last_active":"2024-03-04T09:14:42.296195+0000","last_peered":"2024-03-04T09:14:42.296195+0000","last_clean":"2024-03-04T09:14:42.296195+0000","last_became_active":"2024-03-04T09:13:10.772921+0000","last_became_peered":"2024-03-04T09:13:10.772921+0000","last_unstale":"2024-03-04T09:14:42.296195+0000","last_undegraded":"2024-03-04T09:14:42.296195+0000","last_fullsized":"2024-03-04T09:14:42.296195+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:24:41.988400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"92'6","reported_seq":103,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:45.099656+0000","last_change":"2024-03-04T09:13:09.727219+0000","last_active":"2024-03-04T09:14:45.099656+0000","last_peered":"2024-03-04T09:14:45.099656+0000","last_clean":"2024-03-04T09:14:45.099656+0000","last_became_active":"2024-03-04T09:13:09.726892+0000","last_became_peered":"2024-03-04T09:13:09.726892+0000","last_unstale":"2024-03-04T09:14:45.099656+0000","last_undegraded":"2024-03-04T09:14:45.099656+0000","last_fullsized":"2024-03-04T09:14:45.099656+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:42:58.059866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":70,"num_read_kb":70,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"90'1","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.878506+0000","last_change":"2024-03-04T09:14:13.878506+0000","last_active":"2024-03-04T09:14:13.878506+0000","last_peered":"2024-03-04T09:14:13.878506+0000","last_clean":"2024-03-04T09:14:13.878506+0000","last_became_active":"2024-03-04T09:14:13.874539+0000","last_became_peered":"2024-03-04T09:14:13.874539+0000","last_unstale":"2024-03-04T09:14:13.878506+0000","last_undegraded":"2024-03-04T09:14:13.878506+0000","last_fullsized":"2024-03-04T09:14:13.878506+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:37:59.151566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,11,9],"acting":[7,8,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"92'8","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.294959+0000","last_change":"2024-03-04T09:13:10.765801+0000","last_active":"2024-03-04T09:14:42.294959+0000","last_peered":"2024-03-04T09:14:42.294959+0000","last_clean":"2024-03-04T09:14:42.294959+0000","last_became_active":"2024-03-04T09:13:10.765398+0000","last_became_peered":"2024-03-04T09:13:10.765398+0000","last_unstale":"2024-03-04T09:14:42.294959+0000","last_undegraded":"2024-03-04T09:14:42.294959+0000","last_fullsized":"2024-03-04T09:14:42.294959+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:54:54.750418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"90'6","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:14.067433+0000","last_change":"2024-03-04T09:13:09.729854+0000","last_active":"2024-03-04T09:14:14.067433+0000","last_peered":"2024-03-04T09:14:14.067433+0000","last_clean":"2024-03-04T09:14:14.067433+0000","last_became_active":"2024-03-04T09:13:09.729512+0000","last_became_peered":"2024-03-04T09:13:09.729512+0000","last_unstale":"2024-03-04T09:14:14.067433+0000","last_undegraded":"2024-03-04T09:14:14.067433+0000","last_fullsized":"2024-03-04T09:14:14.067433+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:24:38.237311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":362,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.869532+0000","last_change":"2024-03-04T09:12:00.982045+0000","last_active":"2024-03-04T09:14:13.869532+0000","last_peered":"2024-03-04T09:14:13.869532+0000","last_clean":"2024-03-04T09:14:13.869532+0000","last_became_active":"2024-03-04T09:12:00.981545+0000","last_became_peered":"2024-03-04T09:12:00.981545+0000","last_unstale":"2024-03-04T09:14:13.869532+0000","last_undegraded":"2024-03-04T09:14:13.869532+0000","last_fullsized":"2024-03-04T09:14:13.869532+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:08:36.622880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:08:36.622880+0000","last_clean_scrub_stamp":"2024-03-04T09:08:36.622880+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:44:16.595802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.870586+0000","last_change":"2024-03-04T09:13:14.828364+0000","last_active":"2024-03-04T09:14:13.870586+0000","last_peered":"2024-03-04T09:14:13.870586+0000","last_clean":"2024-03-04T09:14:13.870586+0000","last_became_active":"2024-03-04T09:13:14.827928+0000","last_became_peered":"2024-03-04T09:13:14.827928+0000","last_unstale":"2024-03-04T09:14:13.870586+0000","last_undegraded":"2024-03-04T09:14:13.870586+0000","last_fullsized":"2024-03-04T09:14:13.870586+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:24.071431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"92'5","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.284027+0000","last_change":"2024-03-04T09:13:10.761282+0000","last_active":"2024-03-04T09:14:42.284027+0000","last_peered":"2024-03-04T09:14:42.284027+0000","last_clean":"2024-03-04T09:14:42.284027+0000","last_became_active":"2024-03-04T09:13:10.753614+0000","last_became_peered":"2024-03-04T09:13:10.753614+0000","last_unstale":"2024-03-04T09:14:42.284027+0000","last_undegraded":"2024-03-04T09:14:42.284027+0000","last_fullsized":"2024-03-04T09:14:42.284027+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:00.471478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'4","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.869631+0000","last_change":"2024-03-04T09:13:09.739744+0000","last_active":"2024-03-04T09:14:13.869631+0000","last_peered":"2024-03-04T09:14:13.869631+0000","last_clean":"2024-03-04T09:14:13.869631+0000","last_became_active":"2024-03-04T09:13:09.739403+0000","last_became_peered":"2024-03-04T09:13:09.739403+0000","last_unstale":"2024-03-04T09:14:13.869631+0000","last_undegraded":"2024-03-04T09:14:13.869631+0000","last_fullsized":"2024-03-04T09:14:13.869631+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:51:57.056021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.867051+0000","last_change":"2024-03-04T09:13:14.797232+0000","last_active":"2024-03-04T09:14:13.867051+0000","last_peered":"2024-03-04T09:14:13.867051+0000","last_clean":"2024-03-04T09:14:13.867051+0000","last_became_active":"2024-03-04T09:13:14.796827+0000","last_became_peered":"2024-03-04T09:13:14.796827+0000","last_unstale":"2024-03-04T09:14:13.867051+0000","last_undegraded":"2024-03-04T09:14:13.867051+0000","last_fullsized":"2024-03-04T09:14:13.867051+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:35:41.206987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"90'4","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.866401+0000","last_change":"2024-03-04T09:13:09.741257+0000","last_active":"2024-03-04T09:14:13.866401+0000","last_peered":"2024-03-04T09:14:13.866401+0000","last_clean":"2024-03-04T09:14:13.866401+0000","last_became_active":"2024-03-04T09:13:09.740559+0000","last_became_peered":"2024-03-04T09:13:09.740559+0000","last_unstale":"2024-03-04T09:14:13.866401+0000","last_undegraded":"2024-03-04T09:14:13.866401+0000","last_fullsized":"2024-03-04T09:14:13.866401+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:39:50.969427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"92'9","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.281521+0000","last_change":"2024-03-04T09:13:10.749685+0000","last_active":"2024-03-04T09:14:42.281521+0000","last_peered":"2024-03-04T09:14:42.281521+0000","last_clean":"2024-03-04T09:14:42.281521+0000","last_became_active":"2024-03-04T09:13:10.749297+0000","last_became_peered":"2024-03-04T09:13:10.749297+0000","last_unstale":"2024-03-04T09:14:42.281521+0000","last_undegraded":"2024-03-04T09:14:42.281521+0000","last_fullsized":"2024-03-04T09:14:42.281521+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:28:17.001946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:14.056813+0000","last_change":"2024-03-04T09:13:14.827798+0000","last_active":"2024-03-04T09:14:14.056813+0000","last_peered":"2024-03-04T09:14:14.056813+0000","last_clean":"2024-03-04T09:14:14.056813+0000","last_became_active":"2024-03-04T09:13:14.827373+0000","last_became_peered":"2024-03-04T09:13:14.827373+0000","last_unstale":"2024-03-04T09:14:14.056813+0000","last_undegraded":"2024-03-04T09:14:14.056813+0000","last_fullsized":"2024-03-04T09:14:14.056813+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:54:45.560594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'13","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.869271+0000","last_change":"2024-03-04T09:13:09.732734+0000","last_active":"2024-03-04T09:14:13.869271+0000","last_peered":"2024-03-04T09:14:13.869271+0000","last_clean":"2024-03-04T09:14:13.869271+0000","last_became_active":"2024-03-04T09:13:09.732418+0000","last_became_peered":"2024-03-04T09:13:09.732418+0000","last_unstale":"2024-03-04T09:14:13.869271+0000","last_undegraded":"2024-03-04T09:14:13.869271+0000","last_fullsized":"2024-03-04T09:14:13.869271+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:58.199821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"92'5","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.294219+0000","last_change":"2024-03-04T09:13:10.759721+0000","last_active":"2024-03-04T09:14:42.294219+0000","last_peered":"2024-03-04T09:14:42.294219+0000","last_clean":"2024-03-04T09:14:42.294219+0000","last_became_active":"2024-03-04T09:13:10.759388+0000","last_became_peered":"2024-03-04T09:13:10.759388+0000","last_unstale":"2024-03-04T09:14:42.294219+0000","last_undegraded":"2024-03-04T09:14:42.294219+0000","last_fullsized":"2024-03-04T09:14:42.294219+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:23:41.865335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.869868+0000","last_change":"2024-03-04T09:13:14.788273+0000","last_active":"2024-03-04T09:14:13.869868+0000","last_peered":"2024-03-04T09:14:13.869868+0000","last_clean":"2024-03-04T09:14:13.869868+0000","last_became_active":"2024-03-04T09:13:14.787763+0000","last_became_peered":"2024-03-04T09:13:14.787763+0000","last_unstale":"2024-03-04T09:14:13.869868+0000","last_undegraded":"2024-03-04T09:14:13.869868+0000","last_fullsized":"2024-03-04T09:14:13.869868+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:29:48.247984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"90'7","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:14.067717+0000","last_change":"2024-03-04T09:13:09.745168+0000","last_active":"2024-03-04T09:14:14.067717+0000","last_peered":"2024-03-04T09:14:14.067717+0000","last_clean":"2024-03-04T09:14:14.067717+0000","last_became_active":"2024-03-04T09:13:09.744789+0000","last_became_peered":"2024-03-04T09:13:09.744789+0000","last_unstale":"2024-03-04T09:14:14.067717+0000","last_undegraded":"2024-03-04T09:14:14.067717+0000","last_fullsized":"2024-03-04T09:14:14.067717+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:22:16.428422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"92'7","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.292541+0000","last_change":"2024-03-04T09:13:10.770697+0000","last_active":"2024-03-04T09:14:42.292541+0000","last_peered":"2024-03-04T09:14:42.292541+0000","last_clean":"2024-03-04T09:14:42.292541+0000","last_became_active":"2024-03-04T09:13:10.770301+0000","last_became_peered":"2024-03-04T09:13:10.770301+0000","last_unstale":"2024-03-04T09:14:42.292541+0000","last_undegraded":"2024-03-04T09:14:42.292541+0000","last_fullsized":"2024-03-04T09:14:42.292541+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:29:27.520833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:14.067347+0000","last_change":"2024-03-04T09:13:14.828103+0000","last_active":"2024-03-04T09:14:14.067347+0000","last_peered":"2024-03-04T09:14:14.067347+0000","last_clean":"2024-03-04T09:14:14.067347+0000","last_became_active":"2024-03-04T09:13:14.827699+0000","last_became_peered":"2024-03-04T09:13:14.827699+0000","last_unstale":"2024-03-04T09:14:14.067347+0000","last_undegraded":"2024-03-04T09:14:14.067347+0000","last_fullsized":"2024-03-04T09:14:14.067347+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:44:24.215654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.869339+0000","last_change":"2024-03-04T09:13:09.737342+0000","last_active":"2024-03-04T09:14:13.869339+0000","last_peered":"2024-03-04T09:14:13.869339+0000","last_clean":"2024-03-04T09:14:13.869339+0000","last_became_active":"2024-03-04T09:13:09.736946+0000","last_became_peered":"2024-03-04T09:13:09.736946+0000","last_unstale":"2024-03-04T09:14:13.869339+0000","last_undegraded":"2024-03-04T09:14:13.869339+0000","last_fullsized":"2024-03-04T09:14:13.869339+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:40:07.419155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"92'2","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.251153+0000","last_change":"2024-03-04T09:13:10.753689+0000","last_active":"2024-03-04T09:14:42.251153+0000","last_peered":"2024-03-04T09:14:42.251153+0000","last_clean":"2024-03-04T09:14:42.251153+0000","last_became_active":"2024-03-04T09:13:10.753352+0000","last_became_peered":"2024-03-04T09:13:10.753352+0000","last_unstale":"2024-03-04T09:14:42.251153+0000","last_undegraded":"2024-03-04T09:14:42.251153+0000","last_fullsized":"2024-03-04T09:14:42.251153+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:57:05.782954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.869651+0000","last_change":"2024-03-04T09:13:14.805639+0000","last_active":"2024-03-04T09:14:13.869651+0000","last_peered":"2024-03-04T09:14:13.869651+0000","last_clean":"2024-03-04T09:14:13.869651+0000","last_became_active":"2024-03-04T09:13:14.804764+0000","last_became_peered":"2024-03-04T09:13:14.804764+0000","last_unstale":"2024-03-04T09:14:13.869651+0000","last_undegraded":"2024-03-04T09:14:13.869651+0000","last_fullsized":"2024-03-04T09:14:13.869651+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:31:21.470900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"90'7","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:14.056999+0000","last_change":"2024-03-04T09:13:09.729510+0000","last_active":"2024-03-04T09:14:14.056999+0000","last_peered":"2024-03-04T09:14:14.056999+0000","last_clean":"2024-03-04T09:14:14.056999+0000","last_became_active":"2024-03-04T09:13:09.729100+0000","last_became_peered":"2024-03-04T09:13:09.729100+0000","last_unstale":"2024-03-04T09:14:14.056999+0000","last_undegraded":"2024-03-04T09:14:14.056999+0000","last_fullsized":"2024-03-04T09:14:14.056999+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:00:43.441594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"92'9","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.291423+0000","last_change":"2024-03-04T09:13:10.757543+0000","last_active":"2024-03-04T09:14:42.291423+0000","last_peered":"2024-03-04T09:14:42.291423+0000","last_clean":"2024-03-04T09:14:42.291423+0000","last_became_active":"2024-03-04T09:13:10.757205+0000","last_became_peered":"2024-03-04T09:13:10.757205+0000","last_unstale":"2024-03-04T09:14:42.291423+0000","last_undegraded":"2024-03-04T09:14:42.291423+0000","last_fullsized":"2024-03-04T09:14:42.291423+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:49:02.521232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"90'1","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:14.068192+0000","last_change":"2024-03-04T09:13:14.807608+0000","last_active":"2024-03-04T09:14:14.068192+0000","last_peered":"2024-03-04T09:14:14.068192+0000","last_clean":"2024-03-04T09:14:14.068192+0000","last_became_active":"2024-03-04T09:13:14.807193+0000","last_became_peered":"2024-03-04T09:13:14.807193+0000","last_unstale":"2024-03-04T09:14:14.068192+0000","last_undegraded":"2024-03-04T09:14:14.068192+0000","last_fullsized":"2024-03-04T09:14:14.068192+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:48:33.129309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"90'3","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.869490+0000","last_change":"2024-03-04T09:13:09.738539+0000","last_active":"2024-03-04T09:14:13.869490+0000","last_peered":"2024-03-04T09:14:13.869490+0000","last_clean":"2024-03-04T09:14:13.869490+0000","last_became_active":"2024-03-04T09:13:09.738230+0000","last_became_peered":"2024-03-04T09:13:09.738230+0000","last_unstale":"2024-03-04T09:14:13.869490+0000","last_undegraded":"2024-03-04T09:14:13.869490+0000","last_fullsized":"2024-03-04T09:14:13.869490+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:08:56.789510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"92'8","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.286579+0000","last_change":"2024-03-04T09:13:10.766038+0000","last_active":"2024-03-04T09:14:42.286579+0000","last_peered":"2024-03-04T09:14:42.286579+0000","last_clean":"2024-03-04T09:14:42.286579+0000","last_became_active":"2024-03-04T09:13:10.764725+0000","last_became_peered":"2024-03-04T09:13:10.764725+0000","last_unstale":"2024-03-04T09:14:42.286579+0000","last_undegraded":"2024-03-04T09:14:42.286579+0000","last_fullsized":"2024-03-04T09:14:42.286579+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:34:53.027948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:14.067350+0000","last_change":"2024-03-04T09:13:14.827989+0000","last_active":"2024-03-04T09:14:14.067350+0000","last_peered":"2024-03-04T09:14:14.067350+0000","last_clean":"2024-03-04T09:14:14.067350+0000","last_became_active":"2024-03-04T09:13:14.827601+0000","last_became_peered":"2024-03-04T09:13:14.827601+0000","last_unstale":"2024-03-04T09:14:14.067350+0000","last_undegraded":"2024-03-04T09:14:14.067350+0000","last_fullsized":"2024-03-04T09:14:14.067350+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:41:24.869293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"90'4","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.866305+0000","last_change":"2024-03-04T09:13:09.737211+0000","last_active":"2024-03-04T09:14:13.866305+0000","last_peered":"2024-03-04T09:14:13.866305+0000","last_clean":"2024-03-04T09:14:13.866305+0000","last_became_active":"2024-03-04T09:13:09.736899+0000","last_became_peered":"2024-03-04T09:13:09.736899+0000","last_unstale":"2024-03-04T09:14:13.866305+0000","last_undegraded":"2024-03-04T09:14:13.866305+0000","last_fullsized":"2024-03-04T09:14:13.866305+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:59:09.575710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.870304+0000","last_change":"2024-03-04T09:13:10.750234+0000","last_active":"2024-03-04T09:14:13.870304+0000","last_peered":"2024-03-04T09:14:13.870304+0000","last_clean":"2024-03-04T09:14:13.870304+0000","last_became_active":"2024-03-04T09:13:10.749868+0000","last_became_peered":"2024-03-04T09:13:10.749868+0000","last_unstale":"2024-03-04T09:14:13.870304+0000","last_undegraded":"2024-03-04T09:14:13.870304+0000","last_fullsized":"2024-03-04T09:14:13.870304+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:14:58.229628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.870668+0000","last_change":"2024-03-04T09:13:14.797360+0000","last_active":"2024-03-04T09:14:13.870668+0000","last_peered":"2024-03-04T09:14:13.870668+0000","last_clean":"2024-03-04T09:14:13.870668+0000","last_became_active":"2024-03-04T09:13:14.796885+0000","last_became_peered":"2024-03-04T09:13:14.796885+0000","last_unstale":"2024-03-04T09:14:13.870668+0000","last_undegraded":"2024-03-04T09:14:13.870668+0000","last_fullsized":"2024-03-04T09:14:13.870668+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:03:36.498833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"90'5","reported_seq":102,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:44.098430+0000","last_change":"2024-03-04T09:13:09.745299+0000","last_active":"2024-03-04T09:14:44.098430+0000","last_peered":"2024-03-04T09:14:44.098430+0000","last_clean":"2024-03-04T09:14:44.098430+0000","last_became_active":"2024-03-04T09:13:09.745005+0000","last_became_peered":"2024-03-04T09:13:09.745005+0000","last_unstale":"2024-03-04T09:14:44.098430+0000","last_undegraded":"2024-03-04T09:14:44.098430+0000","last_fullsized":"2024-03-04T09:14:44.098430+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:01:49.052431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":70,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.871247+0000","last_change":"2024-03-04T09:13:10.764774+0000","last_active":"2024-03-04T09:14:13.871247+0000","last_peered":"2024-03-04T09:14:13.871247+0000","last_clean":"2024-03-04T09:14:13.871247+0000","last_became_active":"2024-03-04T09:13:10.764436+0000","last_became_peered":"2024-03-04T09:13:10.764436+0000","last_unstale":"2024-03-04T09:14:13.871247+0000","last_undegraded":"2024-03-04T09:14:13.871247+0000","last_fullsized":"2024-03-04T09:14:13.871247+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:34:46.343791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.869592+0000","last_change":"2024-03-04T09:13:14.809998+0000","last_active":"2024-03-04T09:14:13.869592+0000","last_peered":"2024-03-04T09:14:13.869592+0000","last_clean":"2024-03-04T09:14:13.869592+0000","last_became_active":"2024-03-04T09:13:14.809528+0000","last_became_peered":"2024-03-04T09:13:14.809528+0000","last_unstale":"2024-03-04T09:14:13.869592+0000","last_undegraded":"2024-03-04T09:14:13.869592+0000","last_fullsized":"2024-03-04T09:14:13.869592+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:36:42.404172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"90'3","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.871131+0000","last_change":"2024-03-04T09:13:09.738112+0000","last_active":"2024-03-04T09:14:13.871131+0000","last_peered":"2024-03-04T09:14:13.871131+0000","last_clean":"2024-03-04T09:14:13.871131+0000","last_became_active":"2024-03-04T09:13:09.737798+0000","last_became_peered":"2024-03-04T09:13:09.737798+0000","last_unstale":"2024-03-04T09:14:13.871131+0000","last_undegraded":"2024-03-04T09:14:13.871131+0000","last_fullsized":"2024-03-04T09:14:13.871131+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:04:05.402017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.870563+0000","last_change":"2024-03-04T09:13:10.759809+0000","last_active":"2024-03-04T09:14:13.870563+0000","last_peered":"2024-03-04T09:14:13.870563+0000","last_clean":"2024-03-04T09:14:13.870563+0000","last_became_active":"2024-03-04T09:13:10.759439+0000","last_became_peered":"2024-03-04T09:13:10.759439+0000","last_unstale":"2024-03-04T09:14:13.870563+0000","last_undegraded":"2024-03-04T09:14:13.870563+0000","last_fullsized":"2024-03-04T09:14:13.870563+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:15:54.173010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.870131+0000","last_change":"2024-03-04T09:13:14.793488+0000","last_active":"2024-03-04T09:14:13.870131+0000","last_peered":"2024-03-04T09:14:13.870131+0000","last_clean":"2024-03-04T09:14:13.870131+0000","last_became_active":"2024-03-04T09:13:14.792262+0000","last_became_peered":"2024-03-04T09:13:14.792262+0000","last_unstale":"2024-03-04T09:14:13.870131+0000","last_undegraded":"2024-03-04T09:14:13.870131+0000","last_fullsized":"2024-03-04T09:14:13.870131+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:53:00.294874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"90'5","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.871217+0000","last_change":"2024-03-04T09:13:09.729544+0000","last_active":"2024-03-04T09:14:13.871217+0000","last_peered":"2024-03-04T09:14:13.871217+0000","last_clean":"2024-03-04T09:14:13.871217+0000","last_became_active":"2024-03-04T09:13:09.729266+0000","last_became_peered":"2024-03-04T09:13:09.729266+0000","last_unstale":"2024-03-04T09:14:13.871217+0000","last_undegraded":"2024-03-04T09:14:13.871217+0000","last_fullsized":"2024-03-04T09:14:13.871217+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:27.492387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.871331+0000","last_change":"2024-03-04T09:13:10.761494+0000","last_active":"2024-03-04T09:14:13.871331+0000","last_peered":"2024-03-04T09:14:13.871331+0000","last_clean":"2024-03-04T09:14:13.871331+0000","last_became_active":"2024-03-04T09:13:10.760873+0000","last_became_peered":"2024-03-04T09:13:10.760873+0000","last_unstale":"2024-03-04T09:14:13.871331+0000","last_undegraded":"2024-03-04T09:14:13.871331+0000","last_fullsized":"2024-03-04T09:14:13.871331+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:07:25.001910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"92'9","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.297657+0000","last_change":"2024-03-04T09:13:10.754079+0000","last_active":"2024-03-04T09:14:42.297657+0000","last_peered":"2024-03-04T09:14:42.297657+0000","last_clean":"2024-03-04T09:14:42.297657+0000","last_became_active":"2024-03-04T09:13:10.753691+0000","last_became_peered":"2024-03-04T09:13:10.753691+0000","last_unstale":"2024-03-04T09:14:42.297657+0000","last_undegraded":"2024-03-04T09:14:42.297657+0000","last_fullsized":"2024-03-04T09:14:42.297657+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:45:23.609172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"92'12","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.296599+0000","last_change":"2024-03-04T09:13:10.754556+0000","last_active":"2024-03-04T09:14:42.296599+0000","last_peered":"2024-03-04T09:14:42.296599+0000","last_clean":"2024-03-04T09:14:42.296599+0000","last_became_active":"2024-03-04T09:13:10.754224+0000","last_became_peered":"2024-03-04T09:13:10.754224+0000","last_unstale":"2024-03-04T09:14:42.296599+0000","last_undegraded":"2024-03-04T09:14:42.296599+0000","last_fullsized":"2024-03-04T09:14:42.296599+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:16:27.092418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"92'8","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.290034+0000","last_change":"2024-03-04T09:13:10.753864+0000","last_active":"2024-03-04T09:14:42.290034+0000","last_peered":"2024-03-04T09:14:42.290034+0000","last_clean":"2024-03-04T09:14:42.290034+0000","last_became_active":"2024-03-04T09:13:10.753083+0000","last_became_peered":"2024-03-04T09:13:10.753083+0000","last_unstale":"2024-03-04T09:14:42.290034+0000","last_undegraded":"2024-03-04T09:14:42.290034+0000","last_fullsized":"2024-03-04T09:14:42.290034+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:50:45.119191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"92'7","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.292362+0000","last_change":"2024-03-04T09:13:10.771303+0000","last_active":"2024-03-04T09:14:42.292362+0000","last_peered":"2024-03-04T09:14:42.292362+0000","last_clean":"2024-03-04T09:14:42.292362+0000","last_became_active":"2024-03-04T09:13:10.770950+0000","last_became_peered":"2024-03-04T09:13:10.770950+0000","last_unstale":"2024-03-04T09:14:42.292362+0000","last_undegraded":"2024-03-04T09:14:42.292362+0000","last_fullsized":"2024-03-04T09:14:42.292362+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:48:59.832283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"92'4","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.280992+0000","last_change":"2024-03-04T09:13:10.757277+0000","last_active":"2024-03-04T09:14:42.280992+0000","last_peered":"2024-03-04T09:14:42.280992+0000","last_clean":"2024-03-04T09:14:42.280992+0000","last_became_active":"2024-03-04T09:13:10.756878+0000","last_became_peered":"2024-03-04T09:13:10.756878+0000","last_unstale":"2024-03-04T09:14:42.280992+0000","last_undegraded":"2024-03-04T09:14:42.280992+0000","last_fullsized":"2024-03-04T09:14:42.280992+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:24:58.637505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"92'6","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.295550+0000","last_change":"2024-03-04T09:13:10.759449+0000","last_active":"2024-03-04T09:14:42.295550+0000","last_peered":"2024-03-04T09:14:42.295550+0000","last_clean":"2024-03-04T09:14:42.295550+0000","last_became_active":"2024-03-04T09:13:10.759135+0000","last_became_peered":"2024-03-04T09:13:10.759135+0000","last_unstale":"2024-03-04T09:14:42.295550+0000","last_undegraded":"2024-03-04T09:14:42.295550+0000","last_fullsized":"2024-03-04T09:14:42.295550+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:23.062734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"92'15","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.295172+0000","last_change":"2024-03-04T09:13:10.754694+0000","last_active":"2024-03-04T09:14:42.295172+0000","last_peered":"2024-03-04T09:14:42.295172+0000","last_clean":"2024-03-04T09:14:42.295172+0000","last_became_active":"2024-03-04T09:13:10.754370+0000","last_became_peered":"2024-03-04T09:13:10.754370+0000","last_unstale":"2024-03-04T09:14:42.295172+0000","last_undegraded":"2024-03-04T09:14:42.295172+0000","last_fullsized":"2024-03-04T09:14:42.295172+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:43:22.049974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"92'2","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.284355+0000","last_change":"2024-03-04T09:14:14.068925+0000","last_active":"2024-03-04T09:14:42.284355+0000","last_peered":"2024-03-04T09:14:42.284355+0000","last_clean":"2024-03-04T09:14:42.284355+0000","last_became_active":"2024-03-04T09:14:14.068597+0000","last_became_peered":"2024-03-04T09:14:14.068597+0000","last_unstale":"2024-03-04T09:14:42.284355+0000","last_undegraded":"2024-03-04T09:14:42.284355+0000","last_fullsized":"2024-03-04T09:14:42.284355+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:17:30.419425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"92'6","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.296315+0000","last_change":"2024-03-04T09:13:10.759417+0000","last_active":"2024-03-04T09:14:42.296315+0000","last_peered":"2024-03-04T09:14:42.296315+0000","last_clean":"2024-03-04T09:14:42.296315+0000","last_became_active":"2024-03-04T09:13:10.759025+0000","last_became_peered":"2024-03-04T09:13:10.759025+0000","last_unstale":"2024-03-04T09:14:42.296315+0000","last_undegraded":"2024-03-04T09:14:42.296315+0000","last_fullsized":"2024-03-04T09:14:42.296315+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:54:08.931563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"92'8","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.290491+0000","last_change":"2024-03-04T09:13:10.758917+0000","last_active":"2024-03-04T09:14:42.290491+0000","last_peered":"2024-03-04T09:14:42.290491+0000","last_clean":"2024-03-04T09:14:42.290491+0000","last_became_active":"2024-03-04T09:13:10.758604+0000","last_became_peered":"2024-03-04T09:13:10.758604+0000","last_unstale":"2024-03-04T09:14:42.290491+0000","last_undegraded":"2024-03-04T09:14:42.290491+0000","last_fullsized":"2024-03-04T09:14:42.290491+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:38:51.989174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"92'10","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.300827+0000","last_change":"2024-03-04T09:13:10.759544+0000","last_active":"2024-03-04T09:14:42.300827+0000","last_peered":"2024-03-04T09:14:42.300827+0000","last_clean":"2024-03-04T09:14:42.300827+0000","last_became_active":"2024-03-04T09:13:10.759165+0000","last_became_peered":"2024-03-04T09:13:10.759165+0000","last_unstale":"2024-03-04T09:14:42.300827+0000","last_undegraded":"2024-03-04T09:14:42.300827+0000","last_fullsized":"2024-03-04T09:14:42.300827+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:45:55.441307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"92'11","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.300901+0000","last_change":"2024-03-04T09:13:10.758342+0000","last_active":"2024-03-04T09:14:42.300901+0000","last_peered":"2024-03-04T09:14:42.300901+0000","last_clean":"2024-03-04T09:14:42.300901+0000","last_became_active":"2024-03-04T09:13:10.757987+0000","last_became_peered":"2024-03-04T09:13:10.757987+0000","last_unstale":"2024-03-04T09:14:42.300901+0000","last_undegraded":"2024-03-04T09:14:42.300901+0000","last_fullsized":"2024-03-04T09:14:42.300901+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:52:07.029064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"92'8","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.292708+0000","last_change":"2024-03-04T09:13:10.768340+0000","last_active":"2024-03-04T09:14:42.292708+0000","last_peered":"2024-03-04T09:14:42.292708+0000","last_clean":"2024-03-04T09:14:42.292708+0000","last_became_active":"2024-03-04T09:13:10.768000+0000","last_became_peered":"2024-03-04T09:13:10.768000+0000","last_unstale":"2024-03-04T09:14:42.292708+0000","last_undegraded":"2024-03-04T09:14:42.292708+0000","last_fullsized":"2024-03-04T09:14:42.292708+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:50:17.564815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":441,"ondisk_log_size":441,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":246013,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68978,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":686,"num_read_kb":419,"num_write":246,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":61775,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":512000,"data_stored":206793,"data_compressed":13140,"data_compressed_allocated":20480,"data_compressed_original":73728,"omap_allocated":0,"internal_metadata":0},"log_size":214,"ondisk_log_size":214,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351008,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1011712,"data_stored":504492,"data_compressed":20695,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612645,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28152,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717000,"statfs":{"total":95995035648,"available":95966208000,"internally_reserved":0,"allocated":1155072,"data_stored":1153474,"data_compressed":57939,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776170,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32196,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712956,"statfs":{"total":95995035648,"available":95962066944,"internally_reserved":0,"allocated":1040384,"data_stored":508518,"data_compressed":20695,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037808,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1036288,"data_stored":508896,"data_compressed":20695,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299444,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28084,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717068,"statfs":{"total":95995035648,"available":95966277632,"internally_reserved":0,"allocated":1085440,"data_stored":1101297,"data_compressed":56308,"data_compressed_allocated":73728,"data_compressed_original":647168,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462970,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1011712,"data_stored":499926,"data_compressed":20695,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36384,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708768,"statfs":{"total":95995035648,"available":95957778432,"internally_reserved":0,"allocated":1073152,"data_stored":562980,"data_compressed":22326,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738455,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1036288,"data_stored":501382,"data_compressed":20695,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411406,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1028096,"data_stored":501176,"data_compressed":20695,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149768,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32176,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712976,"statfs":{"total":95995035648,"available":95962087424,"internally_reserved":0,"allocated":1024000,"data_stored":499634,"data_compressed":20695,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888132,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1044480,"data_stored":566556,"data_compressed":30573,"data_compressed_allocated":40960,"data_compressed_original":114688,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724606,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28080,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717072,"statfs":{"total":95995035648,"available":95966281728,"internally_reserved":0,"allocated":1089536,"data_stored":1092392,"data_compressed":56308,"data_compressed_allocated":73728,"data_compressed_original":647168,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,11,14,4,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33974,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33974,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":63776,"data_compressed":1631,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":63256,"data_compressed":9878,"data_compressed_allocated":12288,"data_compressed_original":57344,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":64292,"data_compressed":1631,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T09:14:48.671 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph pg dump --format=json 2024-03-04T09:14:48.915 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:14:49.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:49 smithi190 ceph-mon[36341]: from='client.15102 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T09:14:49.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:49 smithi190 ceph-mon[36341]: pgmap v340: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-03-04T09:14:49.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:49 smithi102 ceph-mon[36220]: from='client.15102 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T09:14:49.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:49 smithi102 ceph-mon[36220]: pgmap v340: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-03-04T09:14:49.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:49 smithi082 ceph-mon[32880]: from='client.15102 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T09:14:49.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:49 smithi082 ceph-mon[32880]: pgmap v340: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-03-04T09:14:50.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:50.797+0000 7f218948d700 1 -- 172.21.15.82:0/1237860535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2184102110 msgr2=0x7f2184102590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:50.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:50.797+0000 7f218948d700 1 --2- 172.21.15.82:0/1237860535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2184102110 0x7f2184102590 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f216c0099c0 tx=0x7f216c009cd0 comp rx=0 tx=0).stop 2024-03-04T09:14:50.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:50.797+0000 7f218948d700 1 -- 172.21.15.82:0/1237860535 shutdown_connections 2024-03-04T09:14:50.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:50.797+0000 7f218948d700 1 --2- 172.21.15.82:0/1237860535 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2184102ad0 0x7f218410ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:50.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:50.797+0000 7f218948d700 1 --2- 172.21.15.82:0/1237860535 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f21841080f0 0x7f21841084d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:50.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:50.797+0000 7f218948d700 1 --2- 172.21.15.82:0/1237860535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2184102110 0x7f2184102590 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:50.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:50.797+0000 7f218948d700 1 -- 172.21.15.82:0/1237860535 >> 172.21.15.82:0/1237860535 conn(0x7f21840791f0 msgr2=0x7f2184079600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:50.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:50.797+0000 7f218948d700 1 -- 172.21.15.82:0/1237860535 shutdown_connections 2024-03-04T09:14:50.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:50.797+0000 7f218948d700 1 -- 172.21.15.82:0/1237860535 wait complete. 2024-03-04T09:14:50.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:50.798+0000 7f218948d700 1 Processor -- start 2024-03-04T09:14:50.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:50.798+0000 7f218948d700 1 -- start start 2024-03-04T09:14:50.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:50.798+0000 7f218948d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2184102110 0x7f21840743c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:50.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:50.798+0000 7f218948d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2184102ad0 0x7f2184074900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:50.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:50.798+0000 7f218948d700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f21841080f0 0x7f2184074e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:50.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:50.798+0000 7f218948d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2184112390 con 0x7f2184102ad0 2024-03-04T09:14:50.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:50.798+0000 7f218948d700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2184112210 con 0x7f21841080f0 2024-03-04T09:14:50.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:50.798+0000 7f218948d700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2184112510 con 0x7f2184102110 2024-03-04T09:14:50.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:50.798+0000 7f217a7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2184102ad0 0x7f2184074900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:50.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:50.798+0000 7f2182ffd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2184102110 0x7f21840743c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:50.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:50.798+0000 7f21837fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f21841080f0 0x7f2184074e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:50.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:50.798+0000 7f217a7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2184102ad0 0x7f2184074900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49582/0 (socket says 172.21.15.82:49582) 2024-03-04T09:14:50.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:50.798+0000 7f2182ffd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2184102110 0x7f21840743c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.82:40166/0 (socket says 172.21.15.82:40166) 2024-03-04T09:14:50.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:50.798+0000 7f217a7fc700 1 -- 172.21.15.82:0/245618956 learned_addr learned my addr 172.21.15.82:0/245618956 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:50.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:50.798+0000 7f21837fe700 1 -- 172.21.15.82:0/245618956 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2184102110 msgr2=0x7f21840743c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:50.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:50.798+0000 7f21837fe700 1 --2- 172.21.15.82:0/245618956 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2184102110 0x7f21840743c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:50.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:50.798+0000 7f21837fe700 1 -- 172.21.15.82:0/245618956 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2184102ad0 msgr2=0x7f2184074900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:50.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:50.798+0000 7f21837fe700 1 --2- 172.21.15.82:0/245618956 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2184102ad0 0x7f2184074900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:50.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:50.798+0000 7f21837fe700 1 -- 172.21.15.82:0/245618956 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21841a6d20 con 0x7f21841080f0 2024-03-04T09:14:50.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:50.799+0000 7f21837fe700 1 --2- 172.21.15.82:0/245618956 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f21841080f0 0x7f2184074e40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f217c00efc0 tx=0x7f217c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:50.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:50.799+0000 7f2180ff9700 1 -- 172.21.15.82:0/245618956 <== mon.2 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217c0092e0 con 0x7f21841080f0 2024-03-04T09:14:50.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:50.799+0000 7f2180ff9700 1 -- 172.21.15.82:0/245618956 <== mon.2 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f217c004bb0 con 0x7f21841080f0 2024-03-04T09:14:50.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:50.799+0000 7f218948d700 1 -- 172.21.15.82:0/245618956 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21841a6fb0 con 0x7f21841080f0 2024-03-04T09:14:50.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:50.799+0000 7f2180ff9700 1 -- 172.21.15.82:0/245618956 <== mon.2 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217c004280 con 0x7f21841080f0 2024-03-04T09:14:50.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:50.799+0000 7f218948d700 1 -- 172.21.15.82:0/245618956 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21841a7460 con 0x7f21841080f0 2024-03-04T09:14:50.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:50.800+0000 7f218948d700 1 -- 172.21.15.82:0/245618956 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2164005330 con 0x7f21841080f0 2024-03-04T09:14:50.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:50.801+0000 7f2180ff9700 1 -- 172.21.15.82:0/245618956 <== mon.2 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 18) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f217c01b030 con 0x7f21841080f0 2024-03-04T09:14:50.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:50.801+0000 7f2180ff9700 1 --2- 172.21.15.82:0/245618956 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f21700a1e10 0x7f21700a42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:50.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:50.802+0000 7f2182ffd700 1 --2- 172.21.15.82:0/245618956 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f21700a1e10 0x7f21700a42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:50.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:50.802+0000 7f2180ff9700 1 -- 172.21.15.82:0/245618956 <== mon.2 v2:172.21.15.102:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9092+0+0 (secure 0 0 0) 0x7f217c0cdbd0 con 0x7f21841080f0 2024-03-04T09:14:50.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:50.802+0000 7f2182ffd700 1 --2- 172.21.15.82:0/245618956 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f21700a1e10 0x7f21700a42d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2174009be0 tx=0x7f2174009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:50.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:50.805+0000 7f2180ff9700 1 -- 172.21.15.82:0/245618956 <== mon.2 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f217c022020 con 0x7f21841080f0 2024-03-04T09:14:50.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:50.996+0000 7f218948d700 1 -- 172.21.15.82:0/245618956 --> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2164000bc0 con 0x7f21700a1e10 2024-03-04T09:14:51.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:51.005+0000 7f2180ff9700 1 -- 172.21.15.82:0/245618956 <== mgr.14152 v2:172.21.15.82:6800/1278635224 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+340873 (secure 0 0 0) 0x7f2164000bc0 con 0x7f21700a1e10 2024-03-04T09:14:51.006 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:14:51.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:51.009+0000 7f218948d700 1 -- 172.21.15.82:0/245618956 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f21700a1e10 msgr2=0x7f21700a42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:51.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:51.009+0000 7f218948d700 1 --2- 172.21.15.82:0/245618956 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f21700a1e10 0x7f21700a42d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2174009be0 tx=0x7f2174009260 comp rx=0 tx=0).stop 2024-03-04T09:14:51.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:51.009+0000 7f218948d700 1 -- 172.21.15.82:0/245618956 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f21841080f0 msgr2=0x7f2184074e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:51.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:51.009+0000 7f218948d700 1 --2- 172.21.15.82:0/245618956 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f21841080f0 0x7f2184074e40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f217c00efc0 tx=0x7f217c00c3a0 comp rx=0 tx=0).stop 2024-03-04T09:14:51.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:51.009+0000 7f218948d700 1 -- 172.21.15.82:0/245618956 shutdown_connections 2024-03-04T09:14:51.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:51.009+0000 7f218948d700 1 --2- 172.21.15.82:0/245618956 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f21700a1e10 0x7f21700a42d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:51.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:51.009+0000 7f218948d700 1 --2- 172.21.15.82:0/245618956 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f21841080f0 0x7f2184074e40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:51.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:51.009+0000 7f218948d700 1 --2- 172.21.15.82:0/245618956 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2184102110 0x7f21840743c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:51.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:51.009+0000 7f218948d700 1 --2- 172.21.15.82:0/245618956 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2184102ad0 0x7f2184074900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:51.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:51.009+0000 7f218948d700 1 -- 172.21.15.82:0/245618956 >> 172.21.15.82:0/245618956 conn(0x7f21840791f0 msgr2=0x7f2184100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:51.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:51.009+0000 7f218948d700 1 -- 172.21.15.82:0/245618956 shutdown_connections 2024-03-04T09:14:51.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:51.009+0000 7f218948d700 1 -- 172.21.15.82:0/245618956 wait complete. 2024-03-04T09:14:51.009 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-03-04T09:14:51.389 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:51 smithi082 ceph-mon[32880]: pgmap v341: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 9 op/s 2024-03-04T09:14:51.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:51 smithi190 ceph-mon[36341]: pgmap v341: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 9 op/s 2024-03-04T09:14:51.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:51 smithi102 ceph-mon[36220]: pgmap v341: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 9 op/s 2024-03-04T09:14:51.848 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":341,"stamp":"2024-03-04T09:14:50.277593+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659580,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":857,"num_read_kb":558,"num_write":431,"num_write_kb":3083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1242628,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":854,"ondisk_log_size":854,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":357332,"kb_used_data":12340,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124584492,"statfs":{"total":1151940427776,"available":1151574519808,"internally_reserved":0,"allocated":12636160,"data_stored":8001254,"data_compressed":368319,"data_compressed_allocated":499712,"data_compressed_original":2531328,"omap_allocated":19142,"internal_metadata":353154362},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":390,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":52,"num_write":7,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003551"},"pg_stats":[{"pgid":"3.3f","version":"92'8","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.289752+0000","last_change":"2024-03-04T09:13:10.759614+0000","last_active":"2024-03-04T09:14:42.289752+0000","last_peered":"2024-03-04T09:14:42.289752+0000","last_clean":"2024-03-04T09:14:42.289752+0000","last_became_active":"2024-03-04T09:13:10.759313+0000","last_became_peered":"2024-03-04T09:13:10.759313+0000","last_unstale":"2024-03-04T09:14:42.289752+0000","last_undegraded":"2024-03-04T09:14:42.289752+0000","last_fullsized":"2024-03-04T09:14:42.289752+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:08:15.568079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"92'4","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.291777+0000","last_change":"2024-03-04T09:13:10.754367+0000","last_active":"2024-03-04T09:14:42.291777+0000","last_peered":"2024-03-04T09:14:42.291777+0000","last_clean":"2024-03-04T09:14:42.291777+0000","last_became_active":"2024-03-04T09:13:10.753984+0000","last_became_peered":"2024-03-04T09:13:10.753984+0000","last_unstale":"2024-03-04T09:14:42.291777+0000","last_undegraded":"2024-03-04T09:14:42.291777+0000","last_fullsized":"2024-03-04T09:14:42.291777+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:14:29.000334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"92'7","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.300332+0000","last_change":"2024-03-04T09:13:10.754951+0000","last_active":"2024-03-04T09:14:42.300332+0000","last_peered":"2024-03-04T09:14:42.300332+0000","last_clean":"2024-03-04T09:14:42.300332+0000","last_became_active":"2024-03-04T09:13:10.753579+0000","last_became_peered":"2024-03-04T09:13:10.753579+0000","last_unstale":"2024-03-04T09:14:42.300332+0000","last_undegraded":"2024-03-04T09:14:42.300332+0000","last_fullsized":"2024-03-04T09:14:42.300332+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:58.949790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"92'8","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.283527+0000","last_change":"2024-03-04T09:13:10.763372+0000","last_active":"2024-03-04T09:14:42.283527+0000","last_peered":"2024-03-04T09:14:42.283527+0000","last_clean":"2024-03-04T09:14:42.283527+0000","last_became_active":"2024-03-04T09:13:10.762664+0000","last_became_peered":"2024-03-04T09:13:10.762664+0000","last_unstale":"2024-03-04T09:14:42.283527+0000","last_undegraded":"2024-03-04T09:14:42.283527+0000","last_fullsized":"2024-03-04T09:14:42.283527+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:44:58.854969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"92'4","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.278371+0000","last_change":"2024-03-04T09:13:10.750348+0000","last_active":"2024-03-04T09:14:42.278371+0000","last_peered":"2024-03-04T09:14:42.278371+0000","last_clean":"2024-03-04T09:14:42.278371+0000","last_became_active":"2024-03-04T09:13:10.749997+0000","last_became_peered":"2024-03-04T09:13:10.749997+0000","last_unstale":"2024-03-04T09:14:42.278371+0000","last_undegraded":"2024-03-04T09:14:42.278371+0000","last_fullsized":"2024-03-04T09:14:42.278371+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:40.701906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"92'6","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.289990+0000","last_change":"2024-03-04T09:13:10.760385+0000","last_active":"2024-03-04T09:14:42.289990+0000","last_peered":"2024-03-04T09:14:42.289990+0000","last_clean":"2024-03-04T09:14:42.289990+0000","last_became_active":"2024-03-04T09:13:10.758679+0000","last_became_peered":"2024-03-04T09:13:10.758679+0000","last_unstale":"2024-03-04T09:14:42.289990+0000","last_undegraded":"2024-03-04T09:14:42.289990+0000","last_fullsized":"2024-03-04T09:14:42.289990+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:42:53.692190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"92'5","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.294024+0000","last_change":"2024-03-04T09:13:10.765288+0000","last_active":"2024-03-04T09:14:42.294024+0000","last_peered":"2024-03-04T09:14:42.294024+0000","last_clean":"2024-03-04T09:14:42.294024+0000","last_became_active":"2024-03-04T09:13:10.763295+0000","last_became_peered":"2024-03-04T09:13:10.763295+0000","last_unstale":"2024-03-04T09:14:42.294024+0000","last_undegraded":"2024-03-04T09:14:42.294024+0000","last_fullsized":"2024-03-04T09:14:42.294024+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:57:09.795996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"92'9","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.296059+0000","last_change":"2024-03-04T09:13:10.766450+0000","last_active":"2024-03-04T09:14:42.296059+0000","last_peered":"2024-03-04T09:14:42.296059+0000","last_clean":"2024-03-04T09:14:42.296059+0000","last_became_active":"2024-03-04T09:13:10.764686+0000","last_became_peered":"2024-03-04T09:13:10.764686+0000","last_unstale":"2024-03-04T09:14:42.296059+0000","last_undegraded":"2024-03-04T09:14:42.296059+0000","last_fullsized":"2024-03-04T09:14:42.296059+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:09:35.938741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"92'11","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.298850+0000","last_change":"2024-03-04T09:13:10.755868+0000","last_active":"2024-03-04T09:14:42.298850+0000","last_peered":"2024-03-04T09:14:42.298850+0000","last_clean":"2024-03-04T09:14:42.298850+0000","last_became_active":"2024-03-04T09:13:10.755543+0000","last_became_peered":"2024-03-04T09:13:10.755543+0000","last_unstale":"2024-03-04T09:14:42.298850+0000","last_undegraded":"2024-03-04T09:14:42.298850+0000","last_fullsized":"2024-03-04T09:14:42.298850+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:02:50.255712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"92'16","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.293092+0000","last_change":"2024-03-04T09:13:10.763599+0000","last_active":"2024-03-04T09:14:42.293092+0000","last_peered":"2024-03-04T09:14:42.293092+0000","last_clean":"2024-03-04T09:14:42.293092+0000","last_became_active":"2024-03-04T09:13:10.763281+0000","last_became_peered":"2024-03-04T09:13:10.763281+0000","last_unstale":"2024-03-04T09:14:42.293092+0000","last_undegraded":"2024-03-04T09:14:42.293092+0000","last_fullsized":"2024-03-04T09:14:42.293092+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:55:00.941408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"92'6","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.300774+0000","last_change":"2024-03-04T09:13:10.763605+0000","last_active":"2024-03-04T09:14:42.300774+0000","last_peered":"2024-03-04T09:14:42.300774+0000","last_clean":"2024-03-04T09:14:42.300774+0000","last_became_active":"2024-03-04T09:13:10.763291+0000","last_became_peered":"2024-03-04T09:13:10.763291+0000","last_unstale":"2024-03-04T09:14:42.300774+0000","last_undegraded":"2024-03-04T09:14:42.300774+0000","last_fullsized":"2024-03-04T09:14:42.300774+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:59:55.256414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"92'7","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.287648+0000","last_change":"2024-03-04T09:14:13.874499+0000","last_active":"2024-03-04T09:14:42.287648+0000","last_peered":"2024-03-04T09:14:42.287648+0000","last_clean":"2024-03-04T09:14:42.287648+0000","last_became_active":"2024-03-04T09:14:13.874131+0000","last_became_peered":"2024-03-04T09:14:13.874131+0000","last_unstale":"2024-03-04T09:14:42.287648+0000","last_undegraded":"2024-03-04T09:14:42.287648+0000","last_fullsized":"2024-03-04T09:14:42.287648+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:19:05.657932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"92'10","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.283654+0000","last_change":"2024-03-04T09:14:13.872979+0000","last_active":"2024-03-04T09:14:42.283654+0000","last_peered":"2024-03-04T09:14:42.283654+0000","last_clean":"2024-03-04T09:14:42.283654+0000","last_became_active":"2024-03-04T09:14:13.872626+0000","last_became_peered":"2024-03-04T09:14:13.872626+0000","last_unstale":"2024-03-04T09:14:42.283654+0000","last_undegraded":"2024-03-04T09:14:42.283654+0000","last_fullsized":"2024-03-04T09:14:42.283654+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:14:56.951110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"92'7","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.291349+0000","last_change":"2024-03-04T09:13:10.758250+0000","last_active":"2024-03-04T09:14:42.291349+0000","last_peered":"2024-03-04T09:14:42.291349+0000","last_clean":"2024-03-04T09:14:42.291349+0000","last_became_active":"2024-03-04T09:13:10.756245+0000","last_became_peered":"2024-03-04T09:13:10.756245+0000","last_unstale":"2024-03-04T09:14:42.291349+0000","last_undegraded":"2024-03-04T09:14:42.291349+0000","last_fullsized":"2024-03-04T09:14:42.291349+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:57:29.303193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"92'7","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.285199+0000","last_change":"2024-03-04T09:14:13.875639+0000","last_active":"2024-03-04T09:14:42.285199+0000","last_peered":"2024-03-04T09:14:42.285199+0000","last_clean":"2024-03-04T09:14:42.285199+0000","last_became_active":"2024-03-04T09:14:13.874827+0000","last_became_peered":"2024-03-04T09:14:13.874827+0000","last_unstale":"2024-03-04T09:14:42.285199+0000","last_undegraded":"2024-03-04T09:14:42.285199+0000","last_fullsized":"2024-03-04T09:14:42.285199+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:32:12.510018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"92'9","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.300843+0000","last_change":"2024-03-04T09:13:10.757374+0000","last_active":"2024-03-04T09:14:42.300843+0000","last_peered":"2024-03-04T09:14:42.300843+0000","last_clean":"2024-03-04T09:14:42.300843+0000","last_became_active":"2024-03-04T09:13:10.757056+0000","last_became_peered":"2024-03-04T09:13:10.757056+0000","last_unstale":"2024-03-04T09:14:42.300843+0000","last_undegraded":"2024-03-04T09:14:42.300843+0000","last_fullsized":"2024-03-04T09:14:42.300843+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:42:28.258326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"92'8","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.296987+0000","last_change":"2024-03-04T09:13:10.762375+0000","last_active":"2024-03-04T09:14:42.296987+0000","last_peered":"2024-03-04T09:14:42.296987+0000","last_clean":"2024-03-04T09:14:42.296987+0000","last_became_active":"2024-03-04T09:13:10.761813+0000","last_became_peered":"2024-03-04T09:13:10.761813+0000","last_unstale":"2024-03-04T09:14:42.296987+0000","last_undegraded":"2024-03-04T09:14:42.296987+0000","last_fullsized":"2024-03-04T09:14:42.296987+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:16:55.448189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"92'10","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.295254+0000","last_change":"2024-03-04T09:13:10.755239+0000","last_active":"2024-03-04T09:14:42.295254+0000","last_peered":"2024-03-04T09:14:42.295254+0000","last_clean":"2024-03-04T09:14:42.295254+0000","last_became_active":"2024-03-04T09:13:10.754863+0000","last_became_peered":"2024-03-04T09:13:10.754863+0000","last_unstale":"2024-03-04T09:14:42.295254+0000","last_undegraded":"2024-03-04T09:14:42.295254+0000","last_fullsized":"2024-03-04T09:14:42.295254+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:39:22.385097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"92'7","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.290669+0000","last_change":"2024-03-04T09:13:10.757899+0000","last_active":"2024-03-04T09:14:42.290669+0000","last_peered":"2024-03-04T09:14:42.290669+0000","last_clean":"2024-03-04T09:14:42.290669+0000","last_became_active":"2024-03-04T09:13:10.756155+0000","last_became_peered":"2024-03-04T09:13:10.756155+0000","last_unstale":"2024-03-04T09:14:42.290669+0000","last_undegraded":"2024-03-04T09:14:42.290669+0000","last_fullsized":"2024-03-04T09:14:42.290669+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:24:08.750137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:14.058241+0000","last_change":"2024-03-04T09:14:14.058241+0000","last_active":"2024-03-04T09:14:14.058241+0000","last_peered":"2024-03-04T09:14:14.058241+0000","last_clean":"2024-03-04T09:14:14.058241+0000","last_became_active":"2024-03-04T09:14:14.057708+0000","last_became_peered":"2024-03-04T09:14:14.057708+0000","last_unstale":"2024-03-04T09:14:14.058241+0000","last_undegraded":"2024-03-04T09:14:14.058241+0000","last_fullsized":"2024-03-04T09:14:14.058241+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:56:39.988467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,10,0],"acting":[2,3,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"90'13","reported_seq":111,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:46.100146+0000","last_change":"2024-03-04T09:13:09.732569+0000","last_active":"2024-03-04T09:14:46.100146+0000","last_peered":"2024-03-04T09:14:46.100146+0000","last_clean":"2024-03-04T09:14:46.100146+0000","last_became_active":"2024-03-04T09:13:09.732257+0000","last_became_peered":"2024-03-04T09:13:09.732257+0000","last_unstale":"2024-03-04T09:14:46.100146+0000","last_undegraded":"2024-03-04T09:14:46.100146+0000","last_fullsized":"2024-03-04T09:14:46.100146+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:11:32.462839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":71,"num_read_kb":71,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"92'5","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.289313+0000","last_change":"2024-03-04T09:13:10.758073+0000","last_active":"2024-03-04T09:14:42.289313+0000","last_peered":"2024-03-04T09:14:42.289313+0000","last_clean":"2024-03-04T09:14:42.289313+0000","last_became_active":"2024-03-04T09:13:10.757560+0000","last_became_peered":"2024-03-04T09:13:10.757560+0000","last_unstale":"2024-03-04T09:14:42.289313+0000","last_undegraded":"2024-03-04T09:14:42.289313+0000","last_fullsized":"2024-03-04T09:14:42.289313+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:21:15.482038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:14.067197+0000","last_change":"2024-03-04T09:13:14.803540+0000","last_active":"2024-03-04T09:14:14.067197+0000","last_peered":"2024-03-04T09:14:14.067197+0000","last_clean":"2024-03-04T09:14:14.067197+0000","last_became_active":"2024-03-04T09:13:14.803135+0000","last_became_peered":"2024-03-04T09:13:14.803135+0000","last_unstale":"2024-03-04T09:14:14.067197+0000","last_undegraded":"2024-03-04T09:14:14.067197+0000","last_fullsized":"2024-03-04T09:14:14.067197+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:21:28.193838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"90'2","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:14.057342+0000","last_change":"2024-03-04T09:13:09.737492+0000","last_active":"2024-03-04T09:14:14.057342+0000","last_peered":"2024-03-04T09:14:14.057342+0000","last_clean":"2024-03-04T09:14:14.057342+0000","last_became_active":"2024-03-04T09:13:09.736976+0000","last_became_peered":"2024-03-04T09:13:09.736976+0000","last_unstale":"2024-03-04T09:14:14.057342+0000","last_undegraded":"2024-03-04T09:14:14.057342+0000","last_fullsized":"2024-03-04T09:14:14.057342+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:40:53.757520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"92'6","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.296794+0000","last_change":"2024-03-04T09:13:10.758838+0000","last_active":"2024-03-04T09:14:42.296794+0000","last_peered":"2024-03-04T09:14:42.296794+0000","last_clean":"2024-03-04T09:14:42.296794+0000","last_became_active":"2024-03-04T09:13:10.758476+0000","last_became_peered":"2024-03-04T09:13:10.758476+0000","last_unstale":"2024-03-04T09:14:42.296794+0000","last_undegraded":"2024-03-04T09:14:42.296794+0000","last_fullsized":"2024-03-04T09:14:42.296794+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:22:29.762608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:14.067267+0000","last_change":"2024-03-04T09:13:14.806054+0000","last_active":"2024-03-04T09:14:14.067267+0000","last_peered":"2024-03-04T09:14:14.067267+0000","last_clean":"2024-03-04T09:14:14.067267+0000","last_became_active":"2024-03-04T09:13:14.805613+0000","last_became_peered":"2024-03-04T09:13:14.805613+0000","last_unstale":"2024-03-04T09:14:14.067267+0000","last_undegraded":"2024-03-04T09:14:14.067267+0000","last_fullsized":"2024-03-04T09:14:14.067267+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:07:49.657530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"90'12","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.866241+0000","last_change":"2024-03-04T09:13:09.741515+0000","last_active":"2024-03-04T09:14:13.866241+0000","last_peered":"2024-03-04T09:14:13.866241+0000","last_clean":"2024-03-04T09:14:13.866241+0000","last_became_active":"2024-03-04T09:13:09.740967+0000","last_became_peered":"2024-03-04T09:13:09.740967+0000","last_unstale":"2024-03-04T09:14:13.866241+0000","last_undegraded":"2024-03-04T09:14:13.866241+0000","last_fullsized":"2024-03-04T09:14:13.866241+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:26:56.280060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"92'9","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.299505+0000","last_change":"2024-03-04T09:13:10.751915+0000","last_active":"2024-03-04T09:14:42.299505+0000","last_peered":"2024-03-04T09:14:42.299505+0000","last_clean":"2024-03-04T09:14:42.299505+0000","last_became_active":"2024-03-04T09:13:10.751616+0000","last_became_peered":"2024-03-04T09:13:10.751616+0000","last_unstale":"2024-03-04T09:14:42.299505+0000","last_undegraded":"2024-03-04T09:14:42.299505+0000","last_fullsized":"2024-03-04T09:14:42.299505+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:35:08.099035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:14.067262+0000","last_change":"2024-03-04T09:13:14.798372+0000","last_active":"2024-03-04T09:14:14.067262+0000","last_peered":"2024-03-04T09:14:14.067262+0000","last_clean":"2024-03-04T09:14:14.067262+0000","last_became_active":"2024-03-04T09:13:14.798020+0000","last_became_peered":"2024-03-04T09:13:14.798020+0000","last_unstale":"2024-03-04T09:14:14.067262+0000","last_undegraded":"2024-03-04T09:14:14.067262+0000","last_fullsized":"2024-03-04T09:14:14.067262+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:43:41.153520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"90'5","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.866763+0000","last_change":"2024-03-04T09:13:09.739187+0000","last_active":"2024-03-04T09:14:13.866763+0000","last_peered":"2024-03-04T09:14:13.866763+0000","last_clean":"2024-03-04T09:14:13.866763+0000","last_became_active":"2024-03-04T09:13:09.738753+0000","last_became_peered":"2024-03-04T09:13:09.738753+0000","last_unstale":"2024-03-04T09:14:13.866763+0000","last_undegraded":"2024-03-04T09:14:13.866763+0000","last_fullsized":"2024-03-04T09:14:13.866763+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:29:06.512779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"92'15","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.300823+0000","last_change":"2024-03-04T09:13:10.768484+0000","last_active":"2024-03-04T09:14:42.300823+0000","last_peered":"2024-03-04T09:14:42.300823+0000","last_clean":"2024-03-04T09:14:42.300823+0000","last_became_active":"2024-03-04T09:13:10.768153+0000","last_became_peered":"2024-03-04T09:13:10.768153+0000","last_unstale":"2024-03-04T09:14:42.300823+0000","last_undegraded":"2024-03-04T09:14:42.300823+0000","last_fullsized":"2024-03-04T09:14:42.300823+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:54:28.804596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.869429+0000","last_change":"2024-03-04T09:13:14.796639+0000","last_active":"2024-03-04T09:14:13.869429+0000","last_peered":"2024-03-04T09:14:13.869429+0000","last_clean":"2024-03-04T09:14:13.869429+0000","last_became_active":"2024-03-04T09:13:14.796128+0000","last_became_peered":"2024-03-04T09:13:14.796128+0000","last_unstale":"2024-03-04T09:14:13.869429+0000","last_undegraded":"2024-03-04T09:14:13.869429+0000","last_fullsized":"2024-03-04T09:14:13.869429+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:31:53.013126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'5","reported_seq":106,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:48.098509+0000","last_change":"2024-03-04T09:13:09.741381+0000","last_active":"2024-03-04T09:14:48.098509+0000","last_peered":"2024-03-04T09:14:48.098509+0000","last_clean":"2024-03-04T09:14:48.098509+0000","last_became_active":"2024-03-04T09:13:09.741032+0000","last_became_peered":"2024-03-04T09:13:09.741032+0000","last_unstale":"2024-03-04T09:14:48.098509+0000","last_undegraded":"2024-03-04T09:14:48.098509+0000","last_fullsized":"2024-03-04T09:14:48.098509+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:36:12.430867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":74,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"92'7","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.282614+0000","last_change":"2024-03-04T09:13:10.756778+0000","last_active":"2024-03-04T09:14:42.282614+0000","last_peered":"2024-03-04T09:14:42.282614+0000","last_clean":"2024-03-04T09:14:42.282614+0000","last_became_active":"2024-03-04T09:13:10.755405+0000","last_became_peered":"2024-03-04T09:13:10.755405+0000","last_unstale":"2024-03-04T09:14:42.282614+0000","last_undegraded":"2024-03-04T09:14:42.282614+0000","last_fullsized":"2024-03-04T09:14:42.282614+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:13:47.425603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.869646+0000","last_change":"2024-03-04T09:13:14.803737+0000","last_active":"2024-03-04T09:14:13.869646+0000","last_peered":"2024-03-04T09:14:13.869646+0000","last_clean":"2024-03-04T09:14:13.869646+0000","last_became_active":"2024-03-04T09:13:14.803261+0000","last_became_peered":"2024-03-04T09:13:14.803261+0000","last_unstale":"2024-03-04T09:14:13.869646+0000","last_undegraded":"2024-03-04T09:14:13.869646+0000","last_fullsized":"2024-03-04T09:14:13.869646+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:41:03.717797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"90'7","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.866999+0000","last_change":"2024-03-04T09:13:09.732193+0000","last_active":"2024-03-04T09:14:13.866999+0000","last_peered":"2024-03-04T09:14:13.866999+0000","last_clean":"2024-03-04T09:14:13.866999+0000","last_became_active":"2024-03-04T09:13:09.731791+0000","last_became_peered":"2024-03-04T09:13:09.731791+0000","last_unstale":"2024-03-04T09:14:13.866999+0000","last_undegraded":"2024-03-04T09:14:13.866999+0000","last_fullsized":"2024-03-04T09:14:13.866999+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:48:29.685931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"92'8","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.299324+0000","last_change":"2024-03-04T09:13:10.771291+0000","last_active":"2024-03-04T09:14:42.299324+0000","last_peered":"2024-03-04T09:14:42.299324+0000","last_clean":"2024-03-04T09:14:42.299324+0000","last_became_active":"2024-03-04T09:13:10.770978+0000","last_became_peered":"2024-03-04T09:13:10.770978+0000","last_unstale":"2024-03-04T09:14:42.299324+0000","last_undegraded":"2024-03-04T09:14:42.299324+0000","last_fullsized":"2024-03-04T09:14:42.299324+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:21:54.121918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.867043+0000","last_change":"2024-03-04T09:13:14.806788+0000","last_active":"2024-03-04T09:14:13.867043+0000","last_peered":"2024-03-04T09:14:13.867043+0000","last_clean":"2024-03-04T09:14:13.867043+0000","last_became_active":"2024-03-04T09:13:14.806379+0000","last_became_peered":"2024-03-04T09:13:14.806379+0000","last_unstale":"2024-03-04T09:14:13.867043+0000","last_undegraded":"2024-03-04T09:14:13.867043+0000","last_fullsized":"2024-03-04T09:14:13.867043+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:27:42.780954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"90'3","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.870584+0000","last_change":"2024-03-04T09:13:09.736299+0000","last_active":"2024-03-04T09:14:13.870584+0000","last_peered":"2024-03-04T09:14:13.870584+0000","last_clean":"2024-03-04T09:14:13.870584+0000","last_became_active":"2024-03-04T09:13:09.735917+0000","last_became_peered":"2024-03-04T09:13:09.735917+0000","last_unstale":"2024-03-04T09:14:13.870584+0000","last_undegraded":"2024-03-04T09:14:13.870584+0000","last_fullsized":"2024-03-04T09:14:13.870584+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:14:22.130089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"92'8","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.289350+0000","last_change":"2024-03-04T09:13:10.761135+0000","last_active":"2024-03-04T09:14:42.289350+0000","last_peered":"2024-03-04T09:14:42.289350+0000","last_clean":"2024-03-04T09:14:42.289350+0000","last_became_active":"2024-03-04T09:13:10.760819+0000","last_became_peered":"2024-03-04T09:13:10.760819+0000","last_unstale":"2024-03-04T09:14:42.289350+0000","last_undegraded":"2024-03-04T09:14:42.289350+0000","last_fullsized":"2024-03-04T09:14:42.289350+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:27:30.315659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.870560+0000","last_change":"2024-03-04T09:13:14.799057+0000","last_active":"2024-03-04T09:14:13.870560+0000","last_peered":"2024-03-04T09:14:13.870560+0000","last_clean":"2024-03-04T09:14:13.870560+0000","last_became_active":"2024-03-04T09:13:14.798670+0000","last_became_peered":"2024-03-04T09:13:14.798670+0000","last_unstale":"2024-03-04T09:14:13.870560+0000","last_undegraded":"2024-03-04T09:14:13.870560+0000","last_fullsized":"2024-03-04T09:14:13.870560+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:16:01.777432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"90'3","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.870389+0000","last_change":"2024-03-04T09:13:09.744045+0000","last_active":"2024-03-04T09:14:13.870389+0000","last_peered":"2024-03-04T09:14:13.870389+0000","last_clean":"2024-03-04T09:14:13.870389+0000","last_became_active":"2024-03-04T09:13:09.741411+0000","last_became_peered":"2024-03-04T09:13:09.741411+0000","last_unstale":"2024-03-04T09:14:13.870389+0000","last_undegraded":"2024-03-04T09:14:13.870389+0000","last_fullsized":"2024-03-04T09:14:13.870389+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:44:22.647120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"92'11","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.291458+0000","last_change":"2024-03-04T09:13:10.762598+0000","last_active":"2024-03-04T09:14:42.291458+0000","last_peered":"2024-03-04T09:14:42.291458+0000","last_clean":"2024-03-04T09:14:42.291458+0000","last_became_active":"2024-03-04T09:13:10.762252+0000","last_became_peered":"2024-03-04T09:13:10.762252+0000","last_unstale":"2024-03-04T09:14:42.291458+0000","last_undegraded":"2024-03-04T09:14:42.291458+0000","last_fullsized":"2024-03-04T09:14:42.291458+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:17:02.924550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:14.056872+0000","last_change":"2024-03-04T09:13:14.805423+0000","last_active":"2024-03-04T09:14:14.056872+0000","last_peered":"2024-03-04T09:14:14.056872+0000","last_clean":"2024-03-04T09:14:14.056872+0000","last_became_active":"2024-03-04T09:13:14.805047+0000","last_became_peered":"2024-03-04T09:13:14.805047+0000","last_unstale":"2024-03-04T09:14:14.056872+0000","last_undegraded":"2024-03-04T09:14:14.056872+0000","last_fullsized":"2024-03-04T09:14:14.056872+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:51:51.804507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"90'4","reported_seq":173,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:48.098154+0000","last_change":"2024-03-04T09:13:09.736752+0000","last_active":"2024-03-04T09:14:48.098154+0000","last_peered":"2024-03-04T09:14:48.098154+0000","last_clean":"2024-03-04T09:14:48.098154+0000","last_became_active":"2024-03-04T09:13:09.736477+0000","last_became_peered":"2024-03-04T09:13:09.736477+0000","last_unstale":"2024-03-04T09:14:48.098154+0000","last_undegraded":"2024-03-04T09:14:48.098154+0000","last_fullsized":"2024-03-04T09:14:48.098154+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:37:11.270022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":142,"num_read_kb":142,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"92'10","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.296523+0000","last_change":"2024-03-04T09:13:10.751255+0000","last_active":"2024-03-04T09:14:42.296523+0000","last_peered":"2024-03-04T09:14:42.296523+0000","last_clean":"2024-03-04T09:14:42.296523+0000","last_became_active":"2024-03-04T09:13:10.750891+0000","last_became_peered":"2024-03-04T09:13:10.750891+0000","last_unstale":"2024-03-04T09:14:42.296523+0000","last_undegraded":"2024-03-04T09:14:42.296523+0000","last_fullsized":"2024-03-04T09:14:42.296523+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:29:08.212529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:14.069820+0000","last_change":"2024-03-04T09:14:14.069365+0000","last_active":"2024-03-04T09:14:14.069820+0000","last_peered":"2024-03-04T09:14:14.069820+0000","last_clean":"2024-03-04T09:14:14.069820+0000","last_became_active":"2024-03-04T09:14:14.068717+0000","last_became_peered":"2024-03-04T09:14:14.068717+0000","last_unstale":"2024-03-04T09:14:14.069820+0000","last_undegraded":"2024-03-04T09:14:14.069820+0000","last_fullsized":"2024-03-04T09:14:14.069820+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:25:26.751362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.16","version":"90'4","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.871236+0000","last_change":"2024-03-04T09:13:09.739765+0000","last_active":"2024-03-04T09:14:13.871236+0000","last_peered":"2024-03-04T09:14:13.871236+0000","last_clean":"2024-03-04T09:14:13.871236+0000","last_became_active":"2024-03-04T09:13:09.739163+0000","last_became_peered":"2024-03-04T09:13:09.739163+0000","last_unstale":"2024-03-04T09:14:13.871236+0000","last_undegraded":"2024-03-04T09:14:13.871236+0000","last_fullsized":"2024-03-04T09:14:13.871236+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:30:15.561241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"92'9","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.292428+0000","last_change":"2024-03-04T09:13:10.770051+0000","last_active":"2024-03-04T09:14:42.292428+0000","last_peered":"2024-03-04T09:14:42.292428+0000","last_clean":"2024-03-04T09:14:42.292428+0000","last_became_active":"2024-03-04T09:13:10.769709+0000","last_became_peered":"2024-03-04T09:13:10.769709+0000","last_unstale":"2024-03-04T09:14:42.292428+0000","last_undegraded":"2024-03-04T09:14:42.292428+0000","last_fullsized":"2024-03-04T09:14:42.292428+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:42:36.328095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:14.067547+0000","last_change":"2024-03-04T09:13:14.804997+0000","last_active":"2024-03-04T09:14:14.067547+0000","last_peered":"2024-03-04T09:14:14.067547+0000","last_clean":"2024-03-04T09:14:14.067547+0000","last_became_active":"2024-03-04T09:13:14.804631+0000","last_became_peered":"2024-03-04T09:13:14.804631+0000","last_unstale":"2024-03-04T09:14:14.067547+0000","last_undegraded":"2024-03-04T09:14:14.067547+0000","last_fullsized":"2024-03-04T09:14:14.067547+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:15:18.843528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"90'5","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.870931+0000","last_change":"2024-03-04T09:13:09.743900+0000","last_active":"2024-03-04T09:14:13.870931+0000","last_peered":"2024-03-04T09:14:13.870931+0000","last_clean":"2024-03-04T09:14:13.870931+0000","last_became_active":"2024-03-04T09:13:09.743591+0000","last_became_peered":"2024-03-04T09:13:09.743591+0000","last_unstale":"2024-03-04T09:14:13.870931+0000","last_undegraded":"2024-03-04T09:14:13.870931+0000","last_fullsized":"2024-03-04T09:14:13.870931+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:47:31.365014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"92'11","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.299158+0000","last_change":"2024-03-04T09:13:10.754163+0000","last_active":"2024-03-04T09:14:42.299158+0000","last_peered":"2024-03-04T09:14:42.299158+0000","last_clean":"2024-03-04T09:14:42.299158+0000","last_became_active":"2024-03-04T09:13:10.753814+0000","last_became_peered":"2024-03-04T09:13:10.753814+0000","last_unstale":"2024-03-04T09:14:42.299158+0000","last_undegraded":"2024-03-04T09:14:42.299158+0000","last_fullsized":"2024-03-04T09:14:42.299158+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:44:31.771205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.869035+0000","last_change":"2024-03-04T09:13:14.803145+0000","last_active":"2024-03-04T09:14:13.869035+0000","last_peered":"2024-03-04T09:14:13.869035+0000","last_clean":"2024-03-04T09:14:13.869035+0000","last_became_active":"2024-03-04T09:13:14.802695+0000","last_became_peered":"2024-03-04T09:13:14.802695+0000","last_unstale":"2024-03-04T09:14:13.869035+0000","last_undegraded":"2024-03-04T09:14:13.869035+0000","last_fullsized":"2024-03-04T09:14:13.869035+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:43:46.854564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"92'36","reported_seq":229,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:48.101560+0000","last_change":"2024-03-04T09:14:14.075796+0000","last_active":"2024-03-04T09:14:48.101560+0000","last_peered":"2024-03-04T09:14:48.101560+0000","last_clean":"2024-03-04T09:14:48.101560+0000","last_became_active":"2024-03-04T09:14:14.069192+0000","last_became_peered":"2024-03-04T09:14:14.069192+0000","last_unstale":"2024-03-04T09:14:48.101560+0000","last_undegraded":"2024-03-04T09:14:48.101560+0000","last_fullsized":"2024-03-04T09:14:48.101560+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:54:57.097871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62024,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":132,"num_read_kb":127,"num_write":38,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":61775,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"92'6","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.269130+0000","last_change":"2024-03-04T09:13:10.754584+0000","last_active":"2024-03-04T09:14:42.269130+0000","last_peered":"2024-03-04T09:14:42.269130+0000","last_clean":"2024-03-04T09:14:42.269130+0000","last_became_active":"2024-03-04T09:13:10.754270+0000","last_became_peered":"2024-03-04T09:13:10.754270+0000","last_unstale":"2024-03-04T09:14:42.269130+0000","last_undegraded":"2024-03-04T09:14:42.269130+0000","last_fullsized":"2024-03-04T09:14:42.269130+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:22:26.480337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.871301+0000","last_change":"2024-03-04T09:13:14.797302+0000","last_active":"2024-03-04T09:14:13.871301+0000","last_peered":"2024-03-04T09:14:13.871301+0000","last_clean":"2024-03-04T09:14:13.871301+0000","last_became_active":"2024-03-04T09:13:14.796549+0000","last_became_peered":"2024-03-04T09:13:14.796549+0000","last_unstale":"2024-03-04T09:14:13.871301+0000","last_undegraded":"2024-03-04T09:14:13.871301+0000","last_fullsized":"2024-03-04T09:14:13.871301+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:28:09.499393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"90'9","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.869724+0000","last_change":"2024-03-04T09:13:09.737567+0000","last_active":"2024-03-04T09:14:13.869724+0000","last_peered":"2024-03-04T09:14:13.869724+0000","last_clean":"2024-03-04T09:14:13.869724+0000","last_became_active":"2024-03-04T09:13:09.735154+0000","last_became_peered":"2024-03-04T09:13:09.735154+0000","last_unstale":"2024-03-04T09:14:13.869724+0000","last_undegraded":"2024-03-04T09:14:13.869724+0000","last_fullsized":"2024-03-04T09:14:13.869724+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:04:49.719107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"92'9","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.298579+0000","last_change":"2024-03-04T09:13:10.751959+0000","last_active":"2024-03-04T09:14:42.298579+0000","last_peered":"2024-03-04T09:14:42.298579+0000","last_clean":"2024-03-04T09:14:42.298579+0000","last_became_active":"2024-03-04T09:13:10.751638+0000","last_became_peered":"2024-03-04T09:13:10.751638+0000","last_unstale":"2024-03-04T09:14:42.298579+0000","last_undegraded":"2024-03-04T09:14:42.298579+0000","last_fullsized":"2024-03-04T09:14:42.298579+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:52:52.005226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.867194+0000","last_change":"2024-03-04T09:13:14.803490+0000","last_active":"2024-03-04T09:14:13.867194+0000","last_peered":"2024-03-04T09:14:13.867194+0000","last_clean":"2024-03-04T09:14:13.867194+0000","last_became_active":"2024-03-04T09:13:14.803046+0000","last_became_peered":"2024-03-04T09:13:14.803046+0000","last_unstale":"2024-03-04T09:14:13.867194+0000","last_undegraded":"2024-03-04T09:14:13.867194+0000","last_fullsized":"2024-03-04T09:14:13.867194+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:54:48.170806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"90'5","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.870832+0000","last_change":"2024-03-04T09:13:09.744437+0000","last_active":"2024-03-04T09:14:13.870832+0000","last_peered":"2024-03-04T09:14:13.870832+0000","last_clean":"2024-03-04T09:14:13.870832+0000","last_became_active":"2024-03-04T09:13:09.743112+0000","last_became_peered":"2024-03-04T09:13:09.743112+0000","last_unstale":"2024-03-04T09:14:13.870832+0000","last_undegraded":"2024-03-04T09:14:13.870832+0000","last_fullsized":"2024-03-04T09:14:13.870832+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:12:16.431869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"92'15","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.301579+0000","last_change":"2024-03-04T09:13:10.770817+0000","last_active":"2024-03-04T09:14:42.301579+0000","last_peered":"2024-03-04T09:14:42.301579+0000","last_clean":"2024-03-04T09:14:42.301579+0000","last_became_active":"2024-03-04T09:13:10.770340+0000","last_became_peered":"2024-03-04T09:13:10.770340+0000","last_unstale":"2024-03-04T09:14:42.301579+0000","last_undegraded":"2024-03-04T09:14:42.301579+0000","last_fullsized":"2024-03-04T09:14:42.301579+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:00:53.050111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.869749+0000","last_change":"2024-03-04T09:13:14.805982+0000","last_active":"2024-03-04T09:14:13.869749+0000","last_peered":"2024-03-04T09:14:13.869749+0000","last_clean":"2024-03-04T09:14:13.869749+0000","last_became_active":"2024-03-04T09:13:14.805280+0000","last_became_peered":"2024-03-04T09:13:14.805280+0000","last_unstale":"2024-03-04T09:14:13.869749+0000","last_undegraded":"2024-03-04T09:14:13.869749+0000","last_fullsized":"2024-03-04T09:14:13.869749+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:39:23.058890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"92'7","reported_seq":105,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:44.099151+0000","last_change":"2024-03-04T09:13:09.736144+0000","last_active":"2024-03-04T09:14:44.099151+0000","last_peered":"2024-03-04T09:14:44.099151+0000","last_clean":"2024-03-04T09:14:44.099151+0000","last_became_active":"2024-03-04T09:13:09.735802+0000","last_became_peered":"2024-03-04T09:13:09.735802+0000","last_unstale":"2024-03-04T09:14:44.099151+0000","last_undegraded":"2024-03-04T09:14:44.099151+0000","last_fullsized":"2024-03-04T09:14:44.099151+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:04:01.935616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":4,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"92'6","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.298369+0000","last_change":"2024-03-04T09:13:10.754813+0000","last_active":"2024-03-04T09:14:42.298369+0000","last_peered":"2024-03-04T09:14:42.298369+0000","last_clean":"2024-03-04T09:14:42.298369+0000","last_became_active":"2024-03-04T09:13:10.754429+0000","last_became_peered":"2024-03-04T09:13:10.754429+0000","last_unstale":"2024-03-04T09:14:42.298369+0000","last_undegraded":"2024-03-04T09:14:42.298369+0000","last_fullsized":"2024-03-04T09:14:42.298369+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:06:57.885434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.871248+0000","last_change":"2024-03-04T09:13:14.808464+0000","last_active":"2024-03-04T09:14:13.871248+0000","last_peered":"2024-03-04T09:14:13.871248+0000","last_clean":"2024-03-04T09:14:13.871248+0000","last_became_active":"2024-03-04T09:13:14.807967+0000","last_became_peered":"2024-03-04T09:13:14.807967+0000","last_unstale":"2024-03-04T09:14:13.871248+0000","last_undegraded":"2024-03-04T09:14:13.871248+0000","last_fullsized":"2024-03-04T09:14:13.871248+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:05:00.961999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"90'17","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.866546+0000","last_change":"2024-03-04T09:13:09.739149+0000","last_active":"2024-03-04T09:14:13.866546+0000","last_peered":"2024-03-04T09:14:13.866546+0000","last_clean":"2024-03-04T09:14:13.866546+0000","last_became_active":"2024-03-04T09:13:09.738823+0000","last_became_peered":"2024-03-04T09:13:09.738823+0000","last_unstale":"2024-03-04T09:14:13.866546+0000","last_undegraded":"2024-03-04T09:14:13.866546+0000","last_fullsized":"2024-03-04T09:14:13.866546+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:33:09.987846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"92'6","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.296967+0000","last_change":"2024-03-04T09:14:13.873239+0000","last_active":"2024-03-04T09:14:42.296967+0000","last_peered":"2024-03-04T09:14:42.296967+0000","last_clean":"2024-03-04T09:14:42.296967+0000","last_became_active":"2024-03-04T09:14:13.872905+0000","last_became_peered":"2024-03-04T09:14:13.872905+0000","last_unstale":"2024-03-04T09:14:42.296967+0000","last_undegraded":"2024-03-04T09:14:42.296967+0000","last_fullsized":"2024-03-04T09:14:42.296967+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:18:00.167359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.871262+0000","last_change":"2024-03-04T09:13:14.797382+0000","last_active":"2024-03-04T09:14:13.871262+0000","last_peered":"2024-03-04T09:14:13.871262+0000","last_clean":"2024-03-04T09:14:13.871262+0000","last_became_active":"2024-03-04T09:13:14.795839+0000","last_became_peered":"2024-03-04T09:13:14.795839+0000","last_unstale":"2024-03-04T09:14:13.871262+0000","last_undegraded":"2024-03-04T09:14:13.871262+0000","last_fullsized":"2024-03-04T09:14:13.871262+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:30.992018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"90'2","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.866596+0000","last_change":"2024-03-04T09:13:09.740678+0000","last_active":"2024-03-04T09:14:13.866596+0000","last_peered":"2024-03-04T09:14:13.866596+0000","last_clean":"2024-03-04T09:14:13.866596+0000","last_became_active":"2024-03-04T09:13:09.740371+0000","last_became_peered":"2024-03-04T09:13:09.740371+0000","last_unstale":"2024-03-04T09:14:13.866596+0000","last_undegraded":"2024-03-04T09:14:13.866596+0000","last_fullsized":"2024-03-04T09:14:13.866596+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:08:05.098610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"92'5","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.295364+0000","last_change":"2024-03-04T09:13:10.769034+0000","last_active":"2024-03-04T09:14:42.295364+0000","last_peered":"2024-03-04T09:14:42.295364+0000","last_clean":"2024-03-04T09:14:42.295364+0000","last_became_active":"2024-03-04T09:13:10.768700+0000","last_became_peered":"2024-03-04T09:13:10.768700+0000","last_unstale":"2024-03-04T09:14:42.295364+0000","last_undegraded":"2024-03-04T09:14:42.295364+0000","last_fullsized":"2024-03-04T09:14:42.295364+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:34:56.367097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.873167+0000","last_change":"2024-03-04T09:14:13.873167+0000","last_active":"2024-03-04T09:14:13.873167+0000","last_peered":"2024-03-04T09:14:13.873167+0000","last_clean":"2024-03-04T09:14:13.873167+0000","last_became_active":"2024-03-04T09:14:13.872736+0000","last_became_peered":"2024-03-04T09:14:13.872736+0000","last_unstale":"2024-03-04T09:14:13.873167+0000","last_undegraded":"2024-03-04T09:14:13.873167+0000","last_fullsized":"2024-03-04T09:14:13.873167+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:37:31.806930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"90'1","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.869266+0000","last_change":"2024-03-04T09:13:09.739307+0000","last_active":"2024-03-04T09:14:13.869266+0000","last_peered":"2024-03-04T09:14:13.869266+0000","last_clean":"2024-03-04T09:14:13.869266+0000","last_became_active":"2024-03-04T09:13:09.739014+0000","last_became_peered":"2024-03-04T09:13:09.739014+0000","last_unstale":"2024-03-04T09:14:13.869266+0000","last_undegraded":"2024-03-04T09:14:13.869266+0000","last_fullsized":"2024-03-04T09:14:13.869266+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:19.128412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"92'4","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.287378+0000","last_change":"2024-03-04T09:13:10.761224+0000","last_active":"2024-03-04T09:14:42.287378+0000","last_peered":"2024-03-04T09:14:42.287378+0000","last_clean":"2024-03-04T09:14:42.287378+0000","last_became_active":"2024-03-04T09:13:10.760861+0000","last_became_peered":"2024-03-04T09:13:10.760861+0000","last_unstale":"2024-03-04T09:14:42.287378+0000","last_undegraded":"2024-03-04T09:14:42.287378+0000","last_fullsized":"2024-03-04T09:14:42.287378+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:58:56.666386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.871322+0000","last_change":"2024-03-04T09:13:14.796490+0000","last_active":"2024-03-04T09:14:13.871322+0000","last_peered":"2024-03-04T09:14:13.871322+0000","last_clean":"2024-03-04T09:14:13.871322+0000","last_became_active":"2024-03-04T09:13:14.796103+0000","last_became_peered":"2024-03-04T09:13:14.796103+0000","last_unstale":"2024-03-04T09:14:13.871322+0000","last_undegraded":"2024-03-04T09:14:13.871322+0000","last_fullsized":"2024-03-04T09:14:13.871322+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:34:05.983201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"90'5","reported_seq":102,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:45.099559+0000","last_change":"2024-03-04T09:13:09.739500+0000","last_active":"2024-03-04T09:14:45.099559+0000","last_peered":"2024-03-04T09:14:45.099559+0000","last_clean":"2024-03-04T09:14:45.099559+0000","last_became_active":"2024-03-04T09:13:09.739156+0000","last_became_peered":"2024-03-04T09:13:09.739156+0000","last_unstale":"2024-03-04T09:14:45.099559+0000","last_undegraded":"2024-03-04T09:14:45.099559+0000","last_fullsized":"2024-03-04T09:14:45.099559+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:07:05.319066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":70,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"92'7","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.290613+0000","last_change":"2024-03-04T09:13:10.762237+0000","last_active":"2024-03-04T09:14:42.290613+0000","last_peered":"2024-03-04T09:14:42.290613+0000","last_clean":"2024-03-04T09:14:42.290613+0000","last_became_active":"2024-03-04T09:13:10.761914+0000","last_became_peered":"2024-03-04T09:13:10.761914+0000","last_unstale":"2024-03-04T09:14:42.290613+0000","last_undegraded":"2024-03-04T09:14:42.290613+0000","last_fullsized":"2024-03-04T09:14:42.290613+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:25:49.156700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.870787+0000","last_change":"2024-03-04T09:13:14.827814+0000","last_active":"2024-03-04T09:14:13.870787+0000","last_peered":"2024-03-04T09:14:13.870787+0000","last_clean":"2024-03-04T09:14:13.870787+0000","last_became_active":"2024-03-04T09:13:14.827411+0000","last_became_peered":"2024-03-04T09:13:14.827411+0000","last_unstale":"2024-03-04T09:14:13.870787+0000","last_undegraded":"2024-03-04T09:14:13.870787+0000","last_fullsized":"2024-03-04T09:14:13.870787+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:23:32.702066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"92'8","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.296195+0000","last_change":"2024-03-04T09:13:10.773292+0000","last_active":"2024-03-04T09:14:42.296195+0000","last_peered":"2024-03-04T09:14:42.296195+0000","last_clean":"2024-03-04T09:14:42.296195+0000","last_became_active":"2024-03-04T09:13:10.772921+0000","last_became_peered":"2024-03-04T09:13:10.772921+0000","last_unstale":"2024-03-04T09:14:42.296195+0000","last_undegraded":"2024-03-04T09:14:42.296195+0000","last_fullsized":"2024-03-04T09:14:42.296195+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:24:41.988400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"92'6","reported_seq":103,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:45.099656+0000","last_change":"2024-03-04T09:13:09.727219+0000","last_active":"2024-03-04T09:14:45.099656+0000","last_peered":"2024-03-04T09:14:45.099656+0000","last_clean":"2024-03-04T09:14:45.099656+0000","last_became_active":"2024-03-04T09:13:09.726892+0000","last_became_peered":"2024-03-04T09:13:09.726892+0000","last_unstale":"2024-03-04T09:14:45.099656+0000","last_undegraded":"2024-03-04T09:14:45.099656+0000","last_fullsized":"2024-03-04T09:14:45.099656+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:42:58.059866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":70,"num_read_kb":70,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"90'1","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.878506+0000","last_change":"2024-03-04T09:14:13.878506+0000","last_active":"2024-03-04T09:14:13.878506+0000","last_peered":"2024-03-04T09:14:13.878506+0000","last_clean":"2024-03-04T09:14:13.878506+0000","last_became_active":"2024-03-04T09:14:13.874539+0000","last_became_peered":"2024-03-04T09:14:13.874539+0000","last_unstale":"2024-03-04T09:14:13.878506+0000","last_undegraded":"2024-03-04T09:14:13.878506+0000","last_fullsized":"2024-03-04T09:14:13.878506+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:37:59.151566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,11,9],"acting":[7,8,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"92'8","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.294959+0000","last_change":"2024-03-04T09:13:10.765801+0000","last_active":"2024-03-04T09:14:42.294959+0000","last_peered":"2024-03-04T09:14:42.294959+0000","last_clean":"2024-03-04T09:14:42.294959+0000","last_became_active":"2024-03-04T09:13:10.765398+0000","last_became_peered":"2024-03-04T09:13:10.765398+0000","last_unstale":"2024-03-04T09:14:42.294959+0000","last_undegraded":"2024-03-04T09:14:42.294959+0000","last_fullsized":"2024-03-04T09:14:42.294959+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:54:54.750418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"90'6","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:14.067433+0000","last_change":"2024-03-04T09:13:09.729854+0000","last_active":"2024-03-04T09:14:14.067433+0000","last_peered":"2024-03-04T09:14:14.067433+0000","last_clean":"2024-03-04T09:14:14.067433+0000","last_became_active":"2024-03-04T09:13:09.729512+0000","last_became_peered":"2024-03-04T09:13:09.729512+0000","last_unstale":"2024-03-04T09:14:14.067433+0000","last_undegraded":"2024-03-04T09:14:14.067433+0000","last_fullsized":"2024-03-04T09:14:14.067433+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:24:38.237311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":363,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.869577+0000","last_change":"2024-03-04T09:12:00.982045+0000","last_active":"2024-03-04T09:14:13.869577+0000","last_peered":"2024-03-04T09:14:13.869577+0000","last_clean":"2024-03-04T09:14:13.869577+0000","last_became_active":"2024-03-04T09:12:00.981545+0000","last_became_peered":"2024-03-04T09:12:00.981545+0000","last_unstale":"2024-03-04T09:14:13.869577+0000","last_undegraded":"2024-03-04T09:14:13.869577+0000","last_fullsized":"2024-03-04T09:14:13.869577+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:08:36.622880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:08:36.622880+0000","last_clean_scrub_stamp":"2024-03-04T09:08:36.622880+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:44:16.595802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.870586+0000","last_change":"2024-03-04T09:13:14.828364+0000","last_active":"2024-03-04T09:14:13.870586+0000","last_peered":"2024-03-04T09:14:13.870586+0000","last_clean":"2024-03-04T09:14:13.870586+0000","last_became_active":"2024-03-04T09:13:14.827928+0000","last_became_peered":"2024-03-04T09:13:14.827928+0000","last_unstale":"2024-03-04T09:14:13.870586+0000","last_undegraded":"2024-03-04T09:14:13.870586+0000","last_fullsized":"2024-03-04T09:14:13.870586+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:27:24.071431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"92'5","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.284027+0000","last_change":"2024-03-04T09:13:10.761282+0000","last_active":"2024-03-04T09:14:42.284027+0000","last_peered":"2024-03-04T09:14:42.284027+0000","last_clean":"2024-03-04T09:14:42.284027+0000","last_became_active":"2024-03-04T09:13:10.753614+0000","last_became_peered":"2024-03-04T09:13:10.753614+0000","last_unstale":"2024-03-04T09:14:42.284027+0000","last_undegraded":"2024-03-04T09:14:42.284027+0000","last_fullsized":"2024-03-04T09:14:42.284027+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:00.471478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'4","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.869631+0000","last_change":"2024-03-04T09:13:09.739744+0000","last_active":"2024-03-04T09:14:13.869631+0000","last_peered":"2024-03-04T09:14:13.869631+0000","last_clean":"2024-03-04T09:14:13.869631+0000","last_became_active":"2024-03-04T09:13:09.739403+0000","last_became_peered":"2024-03-04T09:13:09.739403+0000","last_unstale":"2024-03-04T09:14:13.869631+0000","last_undegraded":"2024-03-04T09:14:13.869631+0000","last_fullsized":"2024-03-04T09:14:13.869631+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:51:57.056021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.867051+0000","last_change":"2024-03-04T09:13:14.797232+0000","last_active":"2024-03-04T09:14:13.867051+0000","last_peered":"2024-03-04T09:14:13.867051+0000","last_clean":"2024-03-04T09:14:13.867051+0000","last_became_active":"2024-03-04T09:13:14.796827+0000","last_became_peered":"2024-03-04T09:13:14.796827+0000","last_unstale":"2024-03-04T09:14:13.867051+0000","last_undegraded":"2024-03-04T09:14:13.867051+0000","last_fullsized":"2024-03-04T09:14:13.867051+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:35:41.206987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"90'4","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.866401+0000","last_change":"2024-03-04T09:13:09.741257+0000","last_active":"2024-03-04T09:14:13.866401+0000","last_peered":"2024-03-04T09:14:13.866401+0000","last_clean":"2024-03-04T09:14:13.866401+0000","last_became_active":"2024-03-04T09:13:09.740559+0000","last_became_peered":"2024-03-04T09:13:09.740559+0000","last_unstale":"2024-03-04T09:14:13.866401+0000","last_undegraded":"2024-03-04T09:14:13.866401+0000","last_fullsized":"2024-03-04T09:14:13.866401+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:39:50.969427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"92'9","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.281521+0000","last_change":"2024-03-04T09:13:10.749685+0000","last_active":"2024-03-04T09:14:42.281521+0000","last_peered":"2024-03-04T09:14:42.281521+0000","last_clean":"2024-03-04T09:14:42.281521+0000","last_became_active":"2024-03-04T09:13:10.749297+0000","last_became_peered":"2024-03-04T09:13:10.749297+0000","last_unstale":"2024-03-04T09:14:42.281521+0000","last_undegraded":"2024-03-04T09:14:42.281521+0000","last_fullsized":"2024-03-04T09:14:42.281521+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:28:17.001946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:14.056813+0000","last_change":"2024-03-04T09:13:14.827798+0000","last_active":"2024-03-04T09:14:14.056813+0000","last_peered":"2024-03-04T09:14:14.056813+0000","last_clean":"2024-03-04T09:14:14.056813+0000","last_became_active":"2024-03-04T09:13:14.827373+0000","last_became_peered":"2024-03-04T09:13:14.827373+0000","last_unstale":"2024-03-04T09:14:14.056813+0000","last_undegraded":"2024-03-04T09:14:14.056813+0000","last_fullsized":"2024-03-04T09:14:14.056813+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:54:45.560594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"92'14","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.869408+0000","last_change":"2024-03-04T09:13:09.732734+0000","last_active":"2024-03-04T09:14:13.869408+0000","last_peered":"2024-03-04T09:14:13.869408+0000","last_clean":"2024-03-04T09:14:13.869408+0000","last_became_active":"2024-03-04T09:13:09.732418+0000","last_became_peered":"2024-03-04T09:13:09.732418+0000","last_unstale":"2024-03-04T09:14:13.869408+0000","last_undegraded":"2024-03-04T09:14:13.869408+0000","last_fullsized":"2024-03-04T09:14:13.869408+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:57:58.199821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"92'5","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.294219+0000","last_change":"2024-03-04T09:13:10.759721+0000","last_active":"2024-03-04T09:14:42.294219+0000","last_peered":"2024-03-04T09:14:42.294219+0000","last_clean":"2024-03-04T09:14:42.294219+0000","last_became_active":"2024-03-04T09:13:10.759388+0000","last_became_peered":"2024-03-04T09:13:10.759388+0000","last_unstale":"2024-03-04T09:14:42.294219+0000","last_undegraded":"2024-03-04T09:14:42.294219+0000","last_fullsized":"2024-03-04T09:14:42.294219+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:23:41.865335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.869868+0000","last_change":"2024-03-04T09:13:14.788273+0000","last_active":"2024-03-04T09:14:13.869868+0000","last_peered":"2024-03-04T09:14:13.869868+0000","last_clean":"2024-03-04T09:14:13.869868+0000","last_became_active":"2024-03-04T09:13:14.787763+0000","last_became_peered":"2024-03-04T09:13:14.787763+0000","last_unstale":"2024-03-04T09:14:13.869868+0000","last_undegraded":"2024-03-04T09:14:13.869868+0000","last_fullsized":"2024-03-04T09:14:13.869868+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:29:48.247984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"90'7","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:14.067717+0000","last_change":"2024-03-04T09:13:09.745168+0000","last_active":"2024-03-04T09:14:14.067717+0000","last_peered":"2024-03-04T09:14:14.067717+0000","last_clean":"2024-03-04T09:14:14.067717+0000","last_became_active":"2024-03-04T09:13:09.744789+0000","last_became_peered":"2024-03-04T09:13:09.744789+0000","last_unstale":"2024-03-04T09:14:14.067717+0000","last_undegraded":"2024-03-04T09:14:14.067717+0000","last_fullsized":"2024-03-04T09:14:14.067717+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:22:16.428422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"92'7","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.292541+0000","last_change":"2024-03-04T09:13:10.770697+0000","last_active":"2024-03-04T09:14:42.292541+0000","last_peered":"2024-03-04T09:14:42.292541+0000","last_clean":"2024-03-04T09:14:42.292541+0000","last_became_active":"2024-03-04T09:13:10.770301+0000","last_became_peered":"2024-03-04T09:13:10.770301+0000","last_unstale":"2024-03-04T09:14:42.292541+0000","last_undegraded":"2024-03-04T09:14:42.292541+0000","last_fullsized":"2024-03-04T09:14:42.292541+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:29:27.520833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:14.067347+0000","last_change":"2024-03-04T09:13:14.828103+0000","last_active":"2024-03-04T09:14:14.067347+0000","last_peered":"2024-03-04T09:14:14.067347+0000","last_clean":"2024-03-04T09:14:14.067347+0000","last_became_active":"2024-03-04T09:13:14.827699+0000","last_became_peered":"2024-03-04T09:13:14.827699+0000","last_unstale":"2024-03-04T09:14:14.067347+0000","last_undegraded":"2024-03-04T09:14:14.067347+0000","last_fullsized":"2024-03-04T09:14:14.067347+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:44:24.215654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.869339+0000","last_change":"2024-03-04T09:13:09.737342+0000","last_active":"2024-03-04T09:14:13.869339+0000","last_peered":"2024-03-04T09:14:13.869339+0000","last_clean":"2024-03-04T09:14:13.869339+0000","last_became_active":"2024-03-04T09:13:09.736946+0000","last_became_peered":"2024-03-04T09:13:09.736946+0000","last_unstale":"2024-03-04T09:14:13.869339+0000","last_undegraded":"2024-03-04T09:14:13.869339+0000","last_fullsized":"2024-03-04T09:14:13.869339+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:40:07.419155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"92'2","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.251153+0000","last_change":"2024-03-04T09:13:10.753689+0000","last_active":"2024-03-04T09:14:42.251153+0000","last_peered":"2024-03-04T09:14:42.251153+0000","last_clean":"2024-03-04T09:14:42.251153+0000","last_became_active":"2024-03-04T09:13:10.753352+0000","last_became_peered":"2024-03-04T09:13:10.753352+0000","last_unstale":"2024-03-04T09:14:42.251153+0000","last_undegraded":"2024-03-04T09:14:42.251153+0000","last_fullsized":"2024-03-04T09:14:42.251153+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:57:05.782954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.869651+0000","last_change":"2024-03-04T09:13:14.805639+0000","last_active":"2024-03-04T09:14:13.869651+0000","last_peered":"2024-03-04T09:14:13.869651+0000","last_clean":"2024-03-04T09:14:13.869651+0000","last_became_active":"2024-03-04T09:13:14.804764+0000","last_became_peered":"2024-03-04T09:13:14.804764+0000","last_unstale":"2024-03-04T09:14:13.869651+0000","last_undegraded":"2024-03-04T09:14:13.869651+0000","last_fullsized":"2024-03-04T09:14:13.869651+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:31:21.470900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"90'7","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:14.056999+0000","last_change":"2024-03-04T09:13:09.729510+0000","last_active":"2024-03-04T09:14:14.056999+0000","last_peered":"2024-03-04T09:14:14.056999+0000","last_clean":"2024-03-04T09:14:14.056999+0000","last_became_active":"2024-03-04T09:13:09.729100+0000","last_became_peered":"2024-03-04T09:13:09.729100+0000","last_unstale":"2024-03-04T09:14:14.056999+0000","last_undegraded":"2024-03-04T09:14:14.056999+0000","last_fullsized":"2024-03-04T09:14:14.056999+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:00:43.441594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"92'9","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.291423+0000","last_change":"2024-03-04T09:13:10.757543+0000","last_active":"2024-03-04T09:14:42.291423+0000","last_peered":"2024-03-04T09:14:42.291423+0000","last_clean":"2024-03-04T09:14:42.291423+0000","last_became_active":"2024-03-04T09:13:10.757205+0000","last_became_peered":"2024-03-04T09:13:10.757205+0000","last_unstale":"2024-03-04T09:14:42.291423+0000","last_undegraded":"2024-03-04T09:14:42.291423+0000","last_fullsized":"2024-03-04T09:14:42.291423+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:49:02.521232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"90'1","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:14.068192+0000","last_change":"2024-03-04T09:13:14.807608+0000","last_active":"2024-03-04T09:14:14.068192+0000","last_peered":"2024-03-04T09:14:14.068192+0000","last_clean":"2024-03-04T09:14:14.068192+0000","last_became_active":"2024-03-04T09:13:14.807193+0000","last_became_peered":"2024-03-04T09:13:14.807193+0000","last_unstale":"2024-03-04T09:14:14.068192+0000","last_undegraded":"2024-03-04T09:14:14.068192+0000","last_fullsized":"2024-03-04T09:14:14.068192+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:48:33.129309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"90'3","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.869490+0000","last_change":"2024-03-04T09:13:09.738539+0000","last_active":"2024-03-04T09:14:13.869490+0000","last_peered":"2024-03-04T09:14:13.869490+0000","last_clean":"2024-03-04T09:14:13.869490+0000","last_became_active":"2024-03-04T09:13:09.738230+0000","last_became_peered":"2024-03-04T09:13:09.738230+0000","last_unstale":"2024-03-04T09:14:13.869490+0000","last_undegraded":"2024-03-04T09:14:13.869490+0000","last_fullsized":"2024-03-04T09:14:13.869490+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:08:56.789510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"92'8","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.286579+0000","last_change":"2024-03-04T09:13:10.766038+0000","last_active":"2024-03-04T09:14:42.286579+0000","last_peered":"2024-03-04T09:14:42.286579+0000","last_clean":"2024-03-04T09:14:42.286579+0000","last_became_active":"2024-03-04T09:13:10.764725+0000","last_became_peered":"2024-03-04T09:13:10.764725+0000","last_unstale":"2024-03-04T09:14:42.286579+0000","last_undegraded":"2024-03-04T09:14:42.286579+0000","last_fullsized":"2024-03-04T09:14:42.286579+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:34:53.027948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:14.067350+0000","last_change":"2024-03-04T09:13:14.827989+0000","last_active":"2024-03-04T09:14:14.067350+0000","last_peered":"2024-03-04T09:14:14.067350+0000","last_clean":"2024-03-04T09:14:14.067350+0000","last_became_active":"2024-03-04T09:13:14.827601+0000","last_became_peered":"2024-03-04T09:13:14.827601+0000","last_unstale":"2024-03-04T09:14:14.067350+0000","last_undegraded":"2024-03-04T09:14:14.067350+0000","last_fullsized":"2024-03-04T09:14:14.067350+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:41:24.869293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"90'4","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.866305+0000","last_change":"2024-03-04T09:13:09.737211+0000","last_active":"2024-03-04T09:14:13.866305+0000","last_peered":"2024-03-04T09:14:13.866305+0000","last_clean":"2024-03-04T09:14:13.866305+0000","last_became_active":"2024-03-04T09:13:09.736899+0000","last_became_peered":"2024-03-04T09:13:09.736899+0000","last_unstale":"2024-03-04T09:14:13.866305+0000","last_undegraded":"2024-03-04T09:14:13.866305+0000","last_fullsized":"2024-03-04T09:14:13.866305+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:59:09.575710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"92'5","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.300948+0000","last_change":"2024-03-04T09:13:10.750234+0000","last_active":"2024-03-04T09:14:42.300948+0000","last_peered":"2024-03-04T09:14:42.300948+0000","last_clean":"2024-03-04T09:14:42.300948+0000","last_became_active":"2024-03-04T09:13:10.749868+0000","last_became_peered":"2024-03-04T09:13:10.749868+0000","last_unstale":"2024-03-04T09:14:42.300948+0000","last_undegraded":"2024-03-04T09:14:42.300948+0000","last_fullsized":"2024-03-04T09:14:42.300948+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:14:58.229628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.870668+0000","last_change":"2024-03-04T09:13:14.797360+0000","last_active":"2024-03-04T09:14:13.870668+0000","last_peered":"2024-03-04T09:14:13.870668+0000","last_clean":"2024-03-04T09:14:13.870668+0000","last_became_active":"2024-03-04T09:13:14.796885+0000","last_became_peered":"2024-03-04T09:13:14.796885+0000","last_unstale":"2024-03-04T09:14:13.870668+0000","last_undegraded":"2024-03-04T09:14:13.870668+0000","last_fullsized":"2024-03-04T09:14:13.870668+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:03:36.498833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"90'5","reported_seq":102,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:44.098430+0000","last_change":"2024-03-04T09:13:09.745299+0000","last_active":"2024-03-04T09:14:44.098430+0000","last_peered":"2024-03-04T09:14:44.098430+0000","last_clean":"2024-03-04T09:14:44.098430+0000","last_became_active":"2024-03-04T09:13:09.745005+0000","last_became_peered":"2024-03-04T09:13:09.745005+0000","last_unstale":"2024-03-04T09:14:44.098430+0000","last_undegraded":"2024-03-04T09:14:44.098430+0000","last_fullsized":"2024-03-04T09:14:44.098430+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:01:49.052431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":70,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"92'7","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.301071+0000","last_change":"2024-03-04T09:13:10.764774+0000","last_active":"2024-03-04T09:14:42.301071+0000","last_peered":"2024-03-04T09:14:42.301071+0000","last_clean":"2024-03-04T09:14:42.301071+0000","last_became_active":"2024-03-04T09:13:10.764436+0000","last_became_peered":"2024-03-04T09:13:10.764436+0000","last_unstale":"2024-03-04T09:14:42.301071+0000","last_undegraded":"2024-03-04T09:14:42.301071+0000","last_fullsized":"2024-03-04T09:14:42.301071+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:34:46.343791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.869592+0000","last_change":"2024-03-04T09:13:14.809998+0000","last_active":"2024-03-04T09:14:13.869592+0000","last_peered":"2024-03-04T09:14:13.869592+0000","last_clean":"2024-03-04T09:14:13.869592+0000","last_became_active":"2024-03-04T09:13:14.809528+0000","last_became_peered":"2024-03-04T09:13:14.809528+0000","last_unstale":"2024-03-04T09:14:13.869592+0000","last_undegraded":"2024-03-04T09:14:13.869592+0000","last_fullsized":"2024-03-04T09:14:13.869592+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:36:42.404172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"90'3","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.871131+0000","last_change":"2024-03-04T09:13:09.738112+0000","last_active":"2024-03-04T09:14:13.871131+0000","last_peered":"2024-03-04T09:14:13.871131+0000","last_clean":"2024-03-04T09:14:13.871131+0000","last_became_active":"2024-03-04T09:13:09.737798+0000","last_became_peered":"2024-03-04T09:13:09.737798+0000","last_unstale":"2024-03-04T09:14:13.871131+0000","last_undegraded":"2024-03-04T09:14:13.871131+0000","last_fullsized":"2024-03-04T09:14:13.871131+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T11:04:05.402017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"92'6","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.292547+0000","last_change":"2024-03-04T09:13:10.759809+0000","last_active":"2024-03-04T09:14:42.292547+0000","last_peered":"2024-03-04T09:14:42.292547+0000","last_clean":"2024-03-04T09:14:42.292547+0000","last_became_active":"2024-03-04T09:13:10.759439+0000","last_became_peered":"2024-03-04T09:13:10.759439+0000","last_unstale":"2024-03-04T09:14:42.292547+0000","last_undegraded":"2024-03-04T09:14:42.292547+0000","last_fullsized":"2024-03-04T09:14:42.292547+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:15:54.173010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.870131+0000","last_change":"2024-03-04T09:13:14.793488+0000","last_active":"2024-03-04T09:14:13.870131+0000","last_peered":"2024-03-04T09:14:13.870131+0000","last_clean":"2024-03-04T09:14:13.870131+0000","last_became_active":"2024-03-04T09:13:14.792262+0000","last_became_peered":"2024-03-04T09:13:14.792262+0000","last_unstale":"2024-03-04T09:14:13.870131+0000","last_undegraded":"2024-03-04T09:14:13.870131+0000","last_fullsized":"2024-03-04T09:14:13.870131+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:13.771061+0000","last_clean_scrub_stamp":"2024-03-04T09:13:13.771061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:53:00.294874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"90'5","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:13.871217+0000","last_change":"2024-03-04T09:13:09.729544+0000","last_active":"2024-03-04T09:14:13.871217+0000","last_peered":"2024-03-04T09:14:13.871217+0000","last_clean":"2024-03-04T09:14:13.871217+0000","last_became_active":"2024-03-04T09:13:09.729266+0000","last_became_peered":"2024-03-04T09:13:09.729266+0000","last_unstale":"2024-03-04T09:14:13.871217+0000","last_undegraded":"2024-03-04T09:14:13.871217+0000","last_fullsized":"2024-03-04T09:14:13.871217+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:08.711788+0000","last_clean_scrub_stamp":"2024-03-04T09:13:08.711788+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:06:27.492387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"92'9","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.298341+0000","last_change":"2024-03-04T09:13:10.761494+0000","last_active":"2024-03-04T09:14:42.298341+0000","last_peered":"2024-03-04T09:14:42.298341+0000","last_clean":"2024-03-04T09:14:42.298341+0000","last_became_active":"2024-03-04T09:13:10.760873+0000","last_became_peered":"2024-03-04T09:13:10.760873+0000","last_unstale":"2024-03-04T09:14:42.298341+0000","last_undegraded":"2024-03-04T09:14:42.298341+0000","last_fullsized":"2024-03-04T09:14:42.298341+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:07:25.001910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"92'9","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.297657+0000","last_change":"2024-03-04T09:13:10.754079+0000","last_active":"2024-03-04T09:14:42.297657+0000","last_peered":"2024-03-04T09:14:42.297657+0000","last_clean":"2024-03-04T09:14:42.297657+0000","last_became_active":"2024-03-04T09:13:10.753691+0000","last_became_peered":"2024-03-04T09:13:10.753691+0000","last_unstale":"2024-03-04T09:14:42.297657+0000","last_undegraded":"2024-03-04T09:14:42.297657+0000","last_fullsized":"2024-03-04T09:14:42.297657+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:45:23.609172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"92'12","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.296599+0000","last_change":"2024-03-04T09:13:10.754556+0000","last_active":"2024-03-04T09:14:42.296599+0000","last_peered":"2024-03-04T09:14:42.296599+0000","last_clean":"2024-03-04T09:14:42.296599+0000","last_became_active":"2024-03-04T09:13:10.754224+0000","last_became_peered":"2024-03-04T09:13:10.754224+0000","last_unstale":"2024-03-04T09:14:42.296599+0000","last_undegraded":"2024-03-04T09:14:42.296599+0000","last_fullsized":"2024-03-04T09:14:42.296599+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:16:27.092418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"92'8","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.290034+0000","last_change":"2024-03-04T09:13:10.753864+0000","last_active":"2024-03-04T09:14:42.290034+0000","last_peered":"2024-03-04T09:14:42.290034+0000","last_clean":"2024-03-04T09:14:42.290034+0000","last_became_active":"2024-03-04T09:13:10.753083+0000","last_became_peered":"2024-03-04T09:13:10.753083+0000","last_unstale":"2024-03-04T09:14:42.290034+0000","last_undegraded":"2024-03-04T09:14:42.290034+0000","last_fullsized":"2024-03-04T09:14:42.290034+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:50:45.119191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"92'7","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.292362+0000","last_change":"2024-03-04T09:13:10.771303+0000","last_active":"2024-03-04T09:14:42.292362+0000","last_peered":"2024-03-04T09:14:42.292362+0000","last_clean":"2024-03-04T09:14:42.292362+0000","last_became_active":"2024-03-04T09:13:10.770950+0000","last_became_peered":"2024-03-04T09:13:10.770950+0000","last_unstale":"2024-03-04T09:14:42.292362+0000","last_undegraded":"2024-03-04T09:14:42.292362+0000","last_fullsized":"2024-03-04T09:14:42.292362+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:48:59.832283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"92'4","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.280992+0000","last_change":"2024-03-04T09:13:10.757277+0000","last_active":"2024-03-04T09:14:42.280992+0000","last_peered":"2024-03-04T09:14:42.280992+0000","last_clean":"2024-03-04T09:14:42.280992+0000","last_became_active":"2024-03-04T09:13:10.756878+0000","last_became_peered":"2024-03-04T09:13:10.756878+0000","last_unstale":"2024-03-04T09:14:42.280992+0000","last_undegraded":"2024-03-04T09:14:42.280992+0000","last_fullsized":"2024-03-04T09:14:42.280992+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:24:58.637505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"92'6","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.295550+0000","last_change":"2024-03-04T09:13:10.759449+0000","last_active":"2024-03-04T09:14:42.295550+0000","last_peered":"2024-03-04T09:14:42.295550+0000","last_clean":"2024-03-04T09:14:42.295550+0000","last_became_active":"2024-03-04T09:13:10.759135+0000","last_became_peered":"2024-03-04T09:13:10.759135+0000","last_unstale":"2024-03-04T09:14:42.295550+0000","last_undegraded":"2024-03-04T09:14:42.295550+0000","last_fullsized":"2024-03-04T09:14:42.295550+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:08:23.062734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"92'15","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.295172+0000","last_change":"2024-03-04T09:13:10.754694+0000","last_active":"2024-03-04T09:14:42.295172+0000","last_peered":"2024-03-04T09:14:42.295172+0000","last_clean":"2024-03-04T09:14:42.295172+0000","last_became_active":"2024-03-04T09:13:10.754370+0000","last_became_peered":"2024-03-04T09:13:10.754370+0000","last_unstale":"2024-03-04T09:14:42.295172+0000","last_undegraded":"2024-03-04T09:14:42.295172+0000","last_fullsized":"2024-03-04T09:14:42.295172+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:43:22.049974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"92'2","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.284355+0000","last_change":"2024-03-04T09:14:14.068925+0000","last_active":"2024-03-04T09:14:42.284355+0000","last_peered":"2024-03-04T09:14:42.284355+0000","last_clean":"2024-03-04T09:14:42.284355+0000","last_became_active":"2024-03-04T09:14:14.068597+0000","last_became_peered":"2024-03-04T09:14:14.068597+0000","last_unstale":"2024-03-04T09:14:42.284355+0000","last_undegraded":"2024-03-04T09:14:42.284355+0000","last_fullsized":"2024-03-04T09:14:42.284355+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:17:30.419425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"92'6","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.296315+0000","last_change":"2024-03-04T09:13:10.759417+0000","last_active":"2024-03-04T09:14:42.296315+0000","last_peered":"2024-03-04T09:14:42.296315+0000","last_clean":"2024-03-04T09:14:42.296315+0000","last_became_active":"2024-03-04T09:13:10.759025+0000","last_became_peered":"2024-03-04T09:13:10.759025+0000","last_unstale":"2024-03-04T09:14:42.296315+0000","last_undegraded":"2024-03-04T09:14:42.296315+0000","last_fullsized":"2024-03-04T09:14:42.296315+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:54:08.931563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"92'8","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.290491+0000","last_change":"2024-03-04T09:13:10.758917+0000","last_active":"2024-03-04T09:14:42.290491+0000","last_peered":"2024-03-04T09:14:42.290491+0000","last_clean":"2024-03-04T09:14:42.290491+0000","last_became_active":"2024-03-04T09:13:10.758604+0000","last_became_peered":"2024-03-04T09:13:10.758604+0000","last_unstale":"2024-03-04T09:14:42.290491+0000","last_undegraded":"2024-03-04T09:14:42.290491+0000","last_fullsized":"2024-03-04T09:14:42.290491+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:38:51.989174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"92'10","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.300827+0000","last_change":"2024-03-04T09:13:10.759544+0000","last_active":"2024-03-04T09:14:42.300827+0000","last_peered":"2024-03-04T09:14:42.300827+0000","last_clean":"2024-03-04T09:14:42.300827+0000","last_became_active":"2024-03-04T09:13:10.759165+0000","last_became_peered":"2024-03-04T09:13:10.759165+0000","last_unstale":"2024-03-04T09:14:42.300827+0000","last_undegraded":"2024-03-04T09:14:42.300827+0000","last_fullsized":"2024-03-04T09:14:42.300827+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T10:45:55.441307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"92'11","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.300901+0000","last_change":"2024-03-04T09:13:10.758342+0000","last_active":"2024-03-04T09:14:42.300901+0000","last_peered":"2024-03-04T09:14:42.300901+0000","last_clean":"2024-03-04T09:14:42.300901+0000","last_became_active":"2024-03-04T09:13:10.757987+0000","last_became_peered":"2024-03-04T09:13:10.757987+0000","last_unstale":"2024-03-04T09:14:42.300901+0000","last_undegraded":"2024-03-04T09:14:42.300901+0000","last_fullsized":"2024-03-04T09:14:42.300901+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T09:52:07.029064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"92'8","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-03-04T09:14:42.292708+0000","last_change":"2024-03-04T09:13:10.768340+0000","last_active":"2024-03-04T09:14:42.292708+0000","last_peered":"2024-03-04T09:14:42.292708+0000","last_clean":"2024-03-04T09:14:42.292708+0000","last_became_active":"2024-03-04T09:13:10.768000+0000","last_became_peered":"2024-03-04T09:13:10.768000+0000","last_unstale":"2024-03-04T09:14:42.292708+0000","last_undegraded":"2024-03-04T09:14:42.292708+0000","last_fullsized":"2024-03-04T09:14:42.292708+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T09:13:09.719411+0000","last_clean_scrub_stamp":"2024-03-04T09:13:09.719411+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:50:17.564815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":246013,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68978,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":721,"num_read_kb":439,"num_write":248,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":61775,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":512000,"data_stored":206934,"data_compressed":13140,"data_compressed_allocated":20480,"data_compressed_original":73728,"omap_allocated":0,"internal_metadata":0},"log_size":215,"ondisk_log_size":215,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351009,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1011712,"data_stored":504492,"data_compressed":20695,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612646,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28144,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717008,"statfs":{"total":95995035648,"available":95966216192,"internally_reserved":0,"allocated":1155072,"data_stored":1153864,"data_compressed":57939,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776171,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32192,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712960,"statfs":{"total":95995035648,"available":95962071040,"internally_reserved":0,"allocated":1040384,"data_stored":508518,"data_compressed":20695,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037808,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1036288,"data_stored":508896,"data_compressed":20695,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299445,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28076,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717076,"statfs":{"total":95995035648,"available":95966285824,"internally_reserved":0,"allocated":1085440,"data_stored":1101438,"data_compressed":56308,"data_compressed_allocated":73728,"data_compressed_original":647168,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462970,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1011712,"data_stored":499926,"data_compressed":20695,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36384,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708768,"statfs":{"total":95995035648,"available":95957778432,"internally_reserved":0,"allocated":1073152,"data_stored":562980,"data_compressed":22326,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1036288,"data_stored":501382,"data_compressed":20695,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411406,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1028096,"data_stored":501176,"data_compressed":20695,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149768,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32176,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712976,"statfs":{"total":95995035648,"available":95962087424,"internally_reserved":0,"allocated":1024000,"data_stored":499634,"data_compressed":20695,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888132,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1044480,"data_stored":566556,"data_compressed":30573,"data_compressed_allocated":40960,"data_compressed_original":114688,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724607,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28080,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717072,"statfs":{"total":95995035648,"available":95966281728,"internally_reserved":0,"allocated":1089536,"data_stored":1092392,"data_compressed":56308,"data_compressed_allocated":73728,"data_compressed_original":647168,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33974,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33974,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35613,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":63776,"data_compressed":1631,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":63256,"data_compressed":9878,"data_compressed_allocated":12288,"data_compressed_original":57344,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":64292,"data_compressed":1631,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T09:14:51.853 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-03-04T09:14:51.853 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-04T09:14:51.854 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-03-04T09:14:51.854 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph health --format=json 2024-03-04T09:14:52.095 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:14:52.549 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:52 smithi082 ceph-mon[32880]: from='client.24935 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T09:14:52.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:52 smithi190 ceph-mon[36341]: from='client.24935 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T09:14:52.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:52 smithi102 ceph-mon[36220]: from='client.24935 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-04T09:14:53.651 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:53 smithi082 ceph-mon[32880]: pgmap v342: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-03-04T09:14:53.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:53 smithi190 ceph-mon[36341]: pgmap v342: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-03-04T09:14:53.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:53 smithi102 ceph-mon[36220]: pgmap v342: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-03-04T09:14:53.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:53.902+0000 7f119c324700 1 -- 172.21.15.82:0/2601912505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1194107000 msgr2=0x7f11941073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:53.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:53.902+0000 7f119c324700 1 --2- 172.21.15.82:0/2601912505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1194107000 0x7f11941073e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f118c00b0a0 tx=0x7f118c00b3b0 comp rx=0 tx=0).stop 2024-03-04T09:14:53.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:53.902+0000 7f119c324700 1 -- 172.21.15.82:0/2601912505 shutdown_connections 2024-03-04T09:14:53.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:53.902+0000 7f119c324700 1 --2- 172.21.15.82:0/2601912505 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1194101960 0x7f119410de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:53.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:53.902+0000 7f119c324700 1 --2- 172.21.15.82:0/2601912505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1194107000 0x7f11941073e0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:53.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:53.902+0000 7f119c324700 1 --2- 172.21.15.82:0/2601912505 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1194100fc0 0x7f1194101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:53.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:53.902+0000 7f119c324700 1 -- 172.21.15.82:0/2601912505 >> 172.21.15.82:0/2601912505 conn(0x7f1194077ef0 msgr2=0x7f1194078300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:53.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:53.902+0000 7f119c324700 1 -- 172.21.15.82:0/2601912505 shutdown_connections 2024-03-04T09:14:53.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:53.902+0000 7f119c324700 1 -- 172.21.15.82:0/2601912505 wait complete. 2024-03-04T09:14:53.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:53.903+0000 7f119c324700 1 Processor -- start 2024-03-04T09:14:53.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:53.903+0000 7f119c324700 1 -- start start 2024-03-04T09:14:53.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:53.903+0000 7f119c324700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1194100fc0 0x7f11941996b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:53.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:53.903+0000 7f119c324700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1194101960 0x7f1194199bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:53.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:53.903+0000 7f119c324700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1194107000 0x7f11941a4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:53.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:53.903+0000 7f119c324700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1194111230 con 0x7f1194100fc0 2024-03-04T09:14:53.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:53.903+0000 7f119c324700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11941110b0 con 0x7f1194101960 2024-03-04T09:14:53.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:53.903+0000 7f119c324700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11941113b0 con 0x7f1194107000 2024-03-04T09:14:53.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:53.903+0000 7f119a0c0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1194100fc0 0x7f11941996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:53.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:53.903+0000 7f119a0c0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1194100fc0 0x7f11941996b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49596/0 (socket says 172.21.15.82:49596) 2024-03-04T09:14:53.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:53.903+0000 7f119a0c0700 1 -- 172.21.15.82:0/852540362 learned_addr learned my addr 172.21.15.82:0/852540362 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:53.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:53.903+0000 7f11998bf700 1 --2- 172.21.15.82:0/852540362 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1194101960 0x7f1194199bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:53.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:53.903+0000 7f119a8c1700 1 --2- 172.21.15.82:0/852540362 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1194107000 0x7f11941a4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:53.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:53.903+0000 7f119a0c0700 1 -- 172.21.15.82:0/852540362 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1194107000 msgr2=0x7f11941a4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:53.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:53.903+0000 7f119a0c0700 1 --2- 172.21.15.82:0/852540362 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1194107000 0x7f11941a4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:53.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:53.903+0000 7f119a0c0700 1 -- 172.21.15.82:0/852540362 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1194101960 msgr2=0x7f1194199bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:53.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:53.903+0000 7f119a0c0700 1 --2- 172.21.15.82:0/852540362 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1194101960 0x7f1194199bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:53.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:53.903+0000 7f119a0c0700 1 -- 172.21.15.82:0/852540362 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11941a4c70 con 0x7f1194100fc0 2024-03-04T09:14:53.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:53.903+0000 7f11998bf700 1 --2- 172.21.15.82:0/852540362 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1194101960 0x7f1194199bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:14:53.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:53.904+0000 7f119a0c0700 1 --2- 172.21.15.82:0/852540362 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1194100fc0 0x7f11941996b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f118c00b070 tx=0x7f118c004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:53.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:53.904+0000 7f118b7fe700 1 -- 172.21.15.82:0/852540362 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118c021070 con 0x7f1194100fc0 2024-03-04T09:14:53.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:53.904+0000 7f118b7fe700 1 -- 172.21.15.82:0/852540362 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f118c007e50 con 0x7f1194100fc0 2024-03-04T09:14:53.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:53.904+0000 7f118b7fe700 1 -- 172.21.15.82:0/852540362 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118c0047e0 con 0x7f1194100fc0 2024-03-04T09:14:53.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:53.904+0000 7f119c324700 1 -- 172.21.15.82:0/852540362 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11941a4e40 con 0x7f1194100fc0 2024-03-04T09:14:53.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:53.904+0000 7f119c324700 1 -- 172.21.15.82:0/852540362 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11941a5240 con 0x7f1194100fc0 2024-03-04T09:14:53.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:53.905+0000 7f119c324700 1 -- 172.21.15.82:0/852540362 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1194068d80 con 0x7f1194100fc0 2024-03-04T09:14:53.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:53.906+0000 7f118b7fe700 1 -- 172.21.15.82:0/852540362 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f118c003c00 con 0x7f1194100fc0 2024-03-04T09:14:53.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:53.907+0000 7f118b7fe700 1 --2- 172.21.15.82:0/852540362 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f11800a1e90 0x7f11800a4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:53.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:53.907+0000 7f11998bf700 1 --2- 172.21.15.82:0/852540362 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f11800a1e90 0x7f11800a4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:53.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:53.907+0000 7f118b7fe700 1 -- 172.21.15.82:0/852540362 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9092+0+0 (secure 0 0 0) 0x7f118c00f020 con 0x7f1194100fc0 2024-03-04T09:14:53.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:53.907+0000 7f11998bf700 1 --2- 172.21.15.82:0/852540362 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f11800a1e90 0x7f11800a4350 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f11940785d0 tx=0x7f11840073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:53.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:53.910+0000 7f118b7fe700 1 -- 172.21.15.82:0/852540362 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f118c02a030 con 0x7f1194100fc0 2024-03-04T09:14:54.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:54.150+0000 7f119c324700 1 -- 172.21.15.82:0/852540362 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f119402db70 con 0x7f1194100fc0 2024-03-04T09:14:54.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:54.151+0000 7f118b7fe700 1 -- 172.21.15.82:0/852540362 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f118c09cb40 con 0x7f1194100fc0 2024-03-04T09:14:54.148 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:14:54.148 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-04T09:14:54.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:54.153+0000 7f119c324700 1 -- 172.21.15.82:0/852540362 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f11800a1e90 msgr2=0x7f11800a4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:54.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:54.153+0000 7f119c324700 1 --2- 172.21.15.82:0/852540362 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f11800a1e90 0x7f11800a4350 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f11940785d0 tx=0x7f11840073d0 comp rx=0 tx=0).stop 2024-03-04T09:14:54.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:54.153+0000 7f119c324700 1 -- 172.21.15.82:0/852540362 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1194100fc0 msgr2=0x7f11941996b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:54.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:54.153+0000 7f119c324700 1 --2- 172.21.15.82:0/852540362 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1194100fc0 0x7f11941996b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f118c00b070 tx=0x7f118c004d00 comp rx=0 tx=0).stop 2024-03-04T09:14:54.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:54.153+0000 7f119c324700 1 -- 172.21.15.82:0/852540362 shutdown_connections 2024-03-04T09:14:54.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:54.153+0000 7f119c324700 1 --2- 172.21.15.82:0/852540362 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f11800a1e90 0x7f11800a4350 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:54.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:54.153+0000 7f119c324700 1 --2- 172.21.15.82:0/852540362 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1194107000 0x7f11941a4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:54.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:54.153+0000 7f119c324700 1 --2- 172.21.15.82:0/852540362 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1194100fc0 0x7f11941996b0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:54.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:54.153+0000 7f119c324700 1 --2- 172.21.15.82:0/852540362 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1194101960 0x7f1194199bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:54.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:54.153+0000 7f119c324700 1 -- 172.21.15.82:0/852540362 >> 172.21.15.82:0/852540362 conn(0x7f1194077ef0 msgr2=0x7f11940ffdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:54.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:54.153+0000 7f119c324700 1 -- 172.21.15.82:0/852540362 shutdown_connections 2024-03-04T09:14:54.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:54.153+0000 7f119c324700 1 -- 172.21.15.82:0/852540362 wait complete. 2024-03-04T09:14:54.518 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:54 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/852540362' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-03-04T09:14:54.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:54 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/852540362' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-03-04T09:14:54.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:54 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/852540362' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-03-04T09:14:54.854 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-03-04T09:14:54.855 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T09:14:54.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:54.964+0000 7f3e3c3ac640 1 -- 172.21.15.82:0/1503013348 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e341020c0 msgr2=0x7f3e34108950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:54.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:54.964+0000 7f3e3c3ac640 1 --2- 172.21.15.82:0/1503013348 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e341020c0 0x7f3e34108950 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c009ca0 tx=0x7f3e2c02c0f0 comp rx=0 tx=0).stop 2024-03-04T09:14:54.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:54.964+0000 7f3e3c3ac640 1 -- 172.21.15.82:0/1503013348 shutdown_connections 2024-03-04T09:14:54.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:54.964+0000 7f3e3c3ac640 1 --2- 172.21.15.82:0/1503013348 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e341020c0 0x7f3e34108950 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:54.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:54.964+0000 7f3e3c3ac640 1 --2- 172.21.15.82:0/1503013348 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e34101700 0x7f3e34101b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:54.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:54.964+0000 7f3e3c3ac640 1 --2- 172.21.15.82:0/1503013348 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e34100510 0x7f3e34100930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:54.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:54.964+0000 7f3e3c3ac640 1 -- 172.21.15.82:0/1503013348 >> 172.21.15.82:0/1503013348 conn(0x7f3e340fba80 msgr2=0x7f3e340fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:54.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:54.964+0000 7f3e3c3ac640 1 -- 172.21.15.82:0/1503013348 shutdown_connections 2024-03-04T09:14:54.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:54.964+0000 7f3e3c3ac640 1 -- 172.21.15.82:0/1503013348 wait complete. 2024-03-04T09:14:54.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:54.964+0000 7f3e3c3ac640 1 Processor -- start 2024-03-04T09:14:54.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:54.964+0000 7f3e3c3ac640 1 -- start start 2024-03-04T09:14:54.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:54.965+0000 7f3e3c3ac640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e34100510 0x7f3e341978a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:54.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:54.965+0000 7f3e3c3ac640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e34101700 0x7f3e34197de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:54.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:54.965+0000 7f3e3c3ac640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e341020c0 0x7f3e3419ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:54.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:54.965+0000 7f3e3c3ac640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3410c170 con 0x7f3e341020c0 2024-03-04T09:14:54.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:54.965+0000 7f3e3c3ac640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3410bff0 con 0x7f3e34101700 2024-03-04T09:14:54.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:54.965+0000 7f3e3c3ac640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3410c2f0 con 0x7f3e34100510 2024-03-04T09:14:54.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:54.965+0000 7f3e3a949640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e341020c0 0x7f3e3419ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:54.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:54.965+0000 7f3e3a949640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e341020c0 0x7f3e3419ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49604/0 (socket says 172.21.15.82:49604) 2024-03-04T09:14:54.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:54.965+0000 7f3e3a949640 1 -- 172.21.15.82:0/2171045611 learned_addr learned my addr 172.21.15.82:0/2171045611 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:54.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:54.965+0000 7f3e39947640 1 --2- 172.21.15.82:0/2171045611 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e34101700 0x7f3e34197de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:54.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:54.965+0000 7f3e3a148640 1 --2- 172.21.15.82:0/2171045611 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e34100510 0x7f3e341978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:54.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:54.965+0000 7f3e3a949640 1 -- 172.21.15.82:0/2171045611 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e34100510 msgr2=0x7f3e341978a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:54.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:54.965+0000 7f3e3a949640 1 --2- 172.21.15.82:0/2171045611 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e34100510 0x7f3e341978a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:54.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:54.965+0000 7f3e3a949640 1 -- 172.21.15.82:0/2171045611 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e34101700 msgr2=0x7f3e34197de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:54.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:54.965+0000 7f3e3a949640 1 --2- 172.21.15.82:0/2171045611 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e34101700 0x7f3e34197de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:54.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:54.965+0000 7f3e3a949640 1 -- 172.21.15.82:0/2171045611 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e3419f4c0 con 0x7f3e341020c0 2024-03-04T09:14:54.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:54.965+0000 7f3e3a949640 1 --2- 172.21.15.82:0/2171045611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e341020c0 0x7f3e3419ee50 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c02c630 tx=0x7f3e2c032980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:54.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:54.965+0000 7f3e2b7fe640 1 -- 172.21.15.82:0/2171045611 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c039050 con 0x7f3e341020c0 2024-03-04T09:14:54.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:54.965+0000 7f3e3c3ac640 1 -- 172.21.15.82:0/2171045611 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e3419f750 con 0x7f3e341020c0 2024-03-04T09:14:54.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:54.965+0000 7f3e2b7fe640 1 -- 172.21.15.82:0/2171045611 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f3e2c03a040 con 0x7f3e341020c0 2024-03-04T09:14:54.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:54.965+0000 7f3e2b7fe640 1 -- 172.21.15.82:0/2171045611 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c004850 con 0x7f3e341020c0 2024-03-04T09:14:54.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:54.965+0000 7f3e3c3ac640 1 -- 172.21.15.82:0/2171045611 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e3419fc40 con 0x7f3e341020c0 2024-03-04T09:14:54.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:54.966+0000 7f3e3c3ac640 1 -- 172.21.15.82:0/2171045611 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e3419fea0 con 0x7f3e341020c0 2024-03-04T09:14:54.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:54.967+0000 7f3e2b7fe640 1 -- 172.21.15.82:0/2171045611 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f3e2c004040 con 0x7f3e341020c0 2024-03-04T09:14:54.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:54.968+0000 7f3e2b7fe640 1 --2- 172.21.15.82:0/2171045611 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f3e200a1f20 0x7f3e200a43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:54.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:54.968+0000 7f3e3a148640 1 --2- 172.21.15.82:0/2171045611 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f3e200a1f20 0x7f3e200a43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:54.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:54.968+0000 7f3e2b7fe640 1 -- 172.21.15.82:0/2171045611 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9092+0+0 (secure 0 0 0) 0x7f3e2c0f1640 con 0x7f3e341020c0 2024-03-04T09:14:54.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:54.968+0000 7f3e3a148640 1 --2- 172.21.15.82:0/2171045611 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f3e200a1f20 0x7f3e200a43e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3e34101560 tx=0x7f3e24005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:54.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:54.971+0000 7f3e2b7fe640 1 -- 172.21.15.82:0/2171045611 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f3e2c004330 con 0x7f3e341020c0 2024-03-04T09:14:55.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.151+0000 7f3e3c3ac640 1 -- 172.21.15.82:0/2171045611 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3e341a0190 con 0x7f3e341020c0 2024-03-04T09:14:55.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.153+0000 7f3e2b7fe640 1 -- 172.21.15.82:0/2171045611 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+24563 (secure 0 0 0) 0x7f3e2c0be710 con 0x7f3e341020c0 2024-03-04T09:14:55.150 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:14:55.150 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":92,"fsid":"2e533fc8-da06-11ee-95c6-87774f69a715","created":"2024-03-04T09:05:16.488249+0000","modified":"2024-03-04T09:14:13.863336+0000","last_up_change":"2024-03-04T09:12:22.308711+0000","last_in_change":"2024-03-04T09:12:02.548212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T09:08:36.508257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T09:13:07.981726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T09:13:09.289799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-04T09:13:13.008516+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"085b5c4b-ede9-4d0d-b994-50c89d991012","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6803","nonce":709655235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6805","nonce":709655235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6809","nonce":709655235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6807","nonce":709655235}]},"public_addr":"172.21.15.82:6803/709655235","cluster_addr":"172.21.15.82:6805/709655235","heartbeat_back_addr":"172.21.15.82:6809/709655235","heartbeat_front_addr":"172.21.15.82:6807/709655235","state":["exists","up"]},{"osd":1,"uuid":"e4dd7079-333e-4bcf-b3af-11fb082a5af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6801","nonce":270721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6803","nonce":270721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6807","nonce":270721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6805","nonce":270721212}]},"public_addr":"172.21.15.102:6801/270721212","cluster_addr":"172.21.15.102:6803/270721212","heartbeat_back_addr":"172.21.15.102:6807/270721212","heartbeat_front_addr":"172.21.15.102:6805/270721212","state":["exists","up"]},{"osd":2,"uuid":"6fed5fd6-dc82-497f-9d69-c10a5e5802da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6801","nonce":946410459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6803","nonce":946410459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6807","nonce":946410459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6805","nonce":946410459}]},"public_addr":"172.21.15.190:6801/946410459","cluster_addr":"172.21.15.190:6803/946410459","heartbeat_back_addr":"172.21.15.190:6807/946410459","heartbeat_front_addr":"172.21.15.190:6805/946410459","state":["exists","up"]},{"osd":3,"uuid":"91ccbdc3-3da6-4d39-8a89-3a7b7bb4adc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6811","nonce":980870924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6813","nonce":980870924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6817","nonce":980870924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6815","nonce":980870924}]},"public_addr":"172.21.15.82:6811/980870924","cluster_addr":"172.21.15.82:6813/980870924","heartbeat_back_addr":"172.21.15.82:6817/980870924","heartbeat_front_addr":"172.21.15.82:6815/980870924","state":["exists","up"]},{"osd":4,"uuid":"dbb9d486-5daa-4819-bbed-04fc76ca473e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6809","nonce":1229627753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6811","nonce":1229627753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6815","nonce":1229627753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6813","nonce":1229627753}]},"public_addr":"172.21.15.102:6809/1229627753","cluster_addr":"172.21.15.102:6811/1229627753","heartbeat_back_addr":"172.21.15.102:6815/1229627753","heartbeat_front_addr":"172.21.15.102:6813/1229627753","state":["exists","up"]},{"osd":5,"uuid":"6b50127b-df2b-4c95-8e53-9d42b40273fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6809","nonce":2171194148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6811","nonce":2171194148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6815","nonce":2171194148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6813","nonce":2171194148}]},"public_addr":"172.21.15.190:6809/2171194148","cluster_addr":"172.21.15.190:6811/2171194148","heartbeat_back_addr":"172.21.15.190:6815/2171194148","heartbeat_front_addr":"172.21.15.190:6813/2171194148","state":["exists","up"]},{"osd":6,"uuid":"e72bebb0-5939-4210-950a-41c25c23c62f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6819","nonce":454436959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6821","nonce":454436959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6825","nonce":454436959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6823","nonce":454436959}]},"public_addr":"172.21.15.82:6819/454436959","cluster_addr":"172.21.15.82:6821/454436959","heartbeat_back_addr":"172.21.15.82:6825/454436959","heartbeat_front_addr":"172.21.15.82:6823/454436959","state":["exists","up"]},{"osd":7,"uuid":"72f83f97-f496-4503-8284-6a7b8f99a6f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6817","nonce":2745057274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6819","nonce":2745057274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6823","nonce":2745057274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6821","nonce":2745057274}]},"public_addr":"172.21.15.102:6817/2745057274","cluster_addr":"172.21.15.102:6819/2745057274","heartbeat_back_addr":"172.21.15.102:6823/2745057274","heartbeat_front_addr":"172.21.15.102:6821/2745057274","state":["exists","up"]},{"osd":8,"uuid":"92c9109d-6ebb-4c50-9944-28cd7b2f9c0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6817","nonce":1679683516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6819","nonce":1679683516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6823","nonce":1679683516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6821","nonce":1679683516}]},"public_addr":"172.21.15.190:6817/1679683516","cluster_addr":"172.21.15.190:6819/1679683516","heartbeat_back_addr":"172.21.15.190:6823/1679683516","heartbeat_front_addr":"172.21.15.190:6821/1679683516","state":["exists","up"]},{"osd":9,"uuid":"a3cfce03-0148-475d-bf55-b8284ae1cad2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6827","nonce":1777272933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6829","nonce":1777272933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6833","nonce":1777272933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6831","nonce":1777272933}]},"public_addr":"172.21.15.82:6827/1777272933","cluster_addr":"172.21.15.82:6829/1777272933","heartbeat_back_addr":"172.21.15.82:6833/1777272933","heartbeat_front_addr":"172.21.15.82:6831/1777272933","state":["exists","up"]},{"osd":10,"uuid":"db156ccf-4396-43cb-b69a-bb9095b94b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6825","nonce":1012784035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6827","nonce":1012784035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6831","nonce":1012784035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6829","nonce":1012784035}]},"public_addr":"172.21.15.102:6825/1012784035","cluster_addr":"172.21.15.102:6827/1012784035","heartbeat_back_addr":"172.21.15.102:6831/1012784035","heartbeat_front_addr":"172.21.15.102:6829/1012784035","state":["exists","up"]},{"osd":11,"uuid":"b4d52576-f5b4-479f-8ff6-8fdba4635ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6825","nonce":144700355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6827","nonce":144700355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6831","nonce":144700355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6829","nonce":144700355}]},"public_addr":"172.21.15.190:6825/144700355","cluster_addr":"172.21.15.190:6827/144700355","heartbeat_back_addr":"172.21.15.190:6831/144700355","heartbeat_front_addr":"172.21.15.190:6829/144700355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:07:47.007772+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:09.944738+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:33.183567+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:58.302023+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:09:23.042488+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:09:47.616009+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:10:13.122887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:10:38.584530+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:03.473453+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:29.847105+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:55.152195+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:12:20.401765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6800/1901539016":"2024-03-05T09:06:12.169231+0000","172.21.15.82:0/1124105204":"2024-03-05T09:06:12.169231+0000","172.21.15.82:6801/1901539016":"2024-03-05T09:06:12.169231+0000","172.21.15.82:0/735262841":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/2402774828":"2024-03-05T09:05:44.913099+0000","172.21.15.82:6801/3291527077":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/1846720385":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/3757201752":"2024-03-05T09:06:12.169231+0000","172.21.15.82:6800/3291527077":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/984630078":"2024-03-05T09:06:12.169231+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T09:14:55.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.155+0000 7f3e3c3ac640 1 -- 172.21.15.82:0/2171045611 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f3e200a1f20 msgr2=0x7f3e200a43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:55.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.155+0000 7f3e3c3ac640 1 --2- 172.21.15.82:0/2171045611 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f3e200a1f20 0x7f3e200a43e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3e34101560 tx=0x7f3e24005f90 comp rx=0 tx=0).stop 2024-03-04T09:14:55.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.155+0000 7f3e3c3ac640 1 -- 172.21.15.82:0/2171045611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e341020c0 msgr2=0x7f3e3419ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:55.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.155+0000 7f3e3c3ac640 1 --2- 172.21.15.82:0/2171045611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e341020c0 0x7f3e3419ee50 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c02c630 tx=0x7f3e2c032980 comp rx=0 tx=0).stop 2024-03-04T09:14:55.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.155+0000 7f3e3c3ac640 1 -- 172.21.15.82:0/2171045611 shutdown_connections 2024-03-04T09:14:55.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.155+0000 7f3e3c3ac640 1 --2- 172.21.15.82:0/2171045611 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f3e200a1f20 0x7f3e200a43e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:55.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.155+0000 7f3e3c3ac640 1 --2- 172.21.15.82:0/2171045611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e341020c0 0x7f3e3419ee50 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:55.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.155+0000 7f3e3c3ac640 1 --2- 172.21.15.82:0/2171045611 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e34101700 0x7f3e34197de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:55.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.155+0000 7f3e3c3ac640 1 --2- 172.21.15.82:0/2171045611 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e34100510 0x7f3e341978a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:55.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.155+0000 7f3e3c3ac640 1 -- 172.21.15.82:0/2171045611 >> 172.21.15.82:0/2171045611 conn(0x7f3e340fba80 msgr2=0x7f3e34069c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:55.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.155+0000 7f3e3c3ac640 1 -- 172.21.15.82:0/2171045611 shutdown_connections 2024-03-04T09:14:55.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.155+0000 7f3e3c3ac640 1 -- 172.21.15.82:0/2171045611 wait complete. 2024-03-04T09:14:55.164 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T09:08:36.508257+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-04T09:13:07.981726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-04T09:13:09.289799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-04T09:13:13.008516+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-04T09:14:55.164 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-04T09:14:55.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.272+0000 7fed40c9d640 1 -- 172.21.15.82:0/3850372926 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed3c107330 msgr2=0x7fed3c109720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:55.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.272+0000 7fed40c9d640 1 --2- 172.21.15.82:0/3850372926 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed3c107330 0x7fed3c109720 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fed34009ca0 tx=0x7fed3402c0f0 comp rx=0 tx=0).stop 2024-03-04T09:14:55.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.272+0000 7fed40c9d640 1 -- 172.21.15.82:0/3850372926 shutdown_connections 2024-03-04T09:14:55.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.272+0000 7fed40c9d640 1 --2- 172.21.15.82:0/3850372926 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed3c107330 0x7fed3c109720 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:55.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.272+0000 7fed40c9d640 1 --2- 172.21.15.82:0/3850372926 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed3c104a00 0x7fed3c106df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:55.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.272+0000 7fed40c9d640 1 --2- 172.21.15.82:0/3850372926 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed3c1020d0 0x7fed3c1044c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:55.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.272+0000 7fed40c9d640 1 -- 172.21.15.82:0/3850372926 >> 172.21.15.82:0/3850372926 conn(0x7fed3c0fba80 msgr2=0x7fed3c0fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:55.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.272+0000 7fed40c9d640 1 -- 172.21.15.82:0/3850372926 shutdown_connections 2024-03-04T09:14:55.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.272+0000 7fed40c9d640 1 -- 172.21.15.82:0/3850372926 wait complete. 2024-03-04T09:14:55.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.273+0000 7fed40c9d640 1 Processor -- start 2024-03-04T09:14:55.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.273+0000 7fed40c9d640 1 -- start start 2024-03-04T09:14:55.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.273+0000 7fed40c9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed3c1020d0 0x7fed3c1978a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:55.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.273+0000 7fed40c9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed3c104a00 0x7fed3c197de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:55.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.273+0000 7fed40c9d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed3c107330 0x7fed3c19ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:55.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.273+0000 7fed40c9d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed3c10d250 con 0x7fed3c1020d0 2024-03-04T09:14:55.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.273+0000 7fed40c9d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed3c10d0d0 con 0x7fed3c104a00 2024-03-04T09:14:55.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.273+0000 7fed40c9d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed3c10d3d0 con 0x7fed3c107330 2024-03-04T09:14:55.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.273+0000 7fed3a59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed3c1020d0 0x7fed3c1978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:55.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.273+0000 7fed3a59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed3c1020d0 0x7fed3c1978a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49626/0 (socket says 172.21.15.82:49626) 2024-03-04T09:14:55.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.273+0000 7fed3a59c640 1 -- 172.21.15.82:0/1137077077 learned_addr learned my addr 172.21.15.82:0/1137077077 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:55.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.273+0000 7fed3ad9d640 1 --2- 172.21.15.82:0/1137077077 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed3c107330 0x7fed3c19ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:55.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.273+0000 7fed33fff640 1 --2- 172.21.15.82:0/1137077077 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed3c104a00 0x7fed3c197de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:55.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.273+0000 7fed3a59c640 1 -- 172.21.15.82:0/1137077077 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed3c107330 msgr2=0x7fed3c19ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:55.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.273+0000 7fed3a59c640 1 --2- 172.21.15.82:0/1137077077 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed3c107330 0x7fed3c19ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:55.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.273+0000 7fed3a59c640 1 -- 172.21.15.82:0/1137077077 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed3c104a00 msgr2=0x7fed3c197de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:55.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.273+0000 7fed3a59c640 1 --2- 172.21.15.82:0/1137077077 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed3c104a00 0x7fed3c197de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:55.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.273+0000 7fed3a59c640 1 -- 172.21.15.82:0/1137077077 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed3c19f4c0 con 0x7fed3c1020d0 2024-03-04T09:14:55.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.274+0000 7fed3a59c640 1 --2- 172.21.15.82:0/1137077077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed3c1020d0 0x7fed3c1978a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fed2c00e9f0 tx=0x7fed2c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:55.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.274+0000 7fed337fe640 1 -- 172.21.15.82:0/1137077077 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2c00cd80 con 0x7fed3c1020d0 2024-03-04T09:14:55.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.274+0000 7fed337fe640 1 -- 172.21.15.82:0/1137077077 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fed2c010900 con 0x7fed3c1020d0 2024-03-04T09:14:55.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.274+0000 7fed40c9d640 1 -- 172.21.15.82:0/1137077077 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed3c19f7b0 con 0x7fed3c1020d0 2024-03-04T09:14:55.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.274+0000 7fed337fe640 1 -- 172.21.15.82:0/1137077077 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2c0189e0 con 0x7fed3c1020d0 2024-03-04T09:14:55.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.274+0000 7fed40c9d640 1 -- 172.21.15.82:0/1137077077 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed3c19fd00 con 0x7fed3c1020d0 2024-03-04T09:14:55.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.275+0000 7fed40c9d640 1 -- 172.21.15.82:0/1137077077 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed3c0fd570 con 0x7fed3c1020d0 2024-03-04T09:14:55.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.276+0000 7fed337fe640 1 -- 172.21.15.82:0/1137077077 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 136756+0+0 (secure 0 0 0) 0x7fed2c010ab0 con 0x7fed3c1020d0 2024-03-04T09:14:55.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.276+0000 7fed337fe640 1 --2- 172.21.15.82:0/1137077077 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fed280a1d80 0x7fed280a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:55.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.277+0000 7fed33fff640 1 --2- 172.21.15.82:0/1137077077 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fed280a1d80 0x7fed280a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:55.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.277+0000 7fed337fe640 1 -- 172.21.15.82:0/1137077077 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9092+0+0 (secure 0 0 0) 0x7fed2c0ce400 con 0x7fed3c1020d0 2024-03-04T09:14:55.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.277+0000 7fed33fff640 1 --2- 172.21.15.82:0/1137077077 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fed280a1d80 0x7fed280a4240 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fed240095f0 tx=0x7fed24005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:55.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.281+0000 7fed337fe640 1 -- 172.21.15.82:0/1137077077 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fed2c09ae80 con 0x7fed3c1020d0 2024-03-04T09:14:55.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.455+0000 7fed40c9d640 1 -- 172.21.15.82:0/1137077077 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fed3c0621d0 con 0x7fed3c1020d0 2024-03-04T09:14:55.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.456+0000 7fed337fe640 1 -- 172.21.15.82:0/1137077077 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) v1 ==== 93+0+10 (secure 0 0 0) 0x7fed2c09ef20 con 0x7fed3c1020d0 2024-03-04T09:14:55.452 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-03-04T09:14:55.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.458+0000 7fed40c9d640 1 -- 172.21.15.82:0/1137077077 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fed280a1d80 msgr2=0x7fed280a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:55.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.458+0000 7fed40c9d640 1 --2- 172.21.15.82:0/1137077077 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fed280a1d80 0x7fed280a4240 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fed240095f0 tx=0x7fed24005f90 comp rx=0 tx=0).stop 2024-03-04T09:14:55.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.458+0000 7fed40c9d640 1 -- 172.21.15.82:0/1137077077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed3c1020d0 msgr2=0x7fed3c1978a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:55.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.458+0000 7fed40c9d640 1 --2- 172.21.15.82:0/1137077077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed3c1020d0 0x7fed3c1978a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fed2c00e9f0 tx=0x7fed2c00eeb0 comp rx=0 tx=0).stop 2024-03-04T09:14:55.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.458+0000 7fed40c9d640 1 -- 172.21.15.82:0/1137077077 shutdown_connections 2024-03-04T09:14:55.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.458+0000 7fed40c9d640 1 --2- 172.21.15.82:0/1137077077 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fed280a1d80 0x7fed280a4240 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:55.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.458+0000 7fed40c9d640 1 --2- 172.21.15.82:0/1137077077 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed3c107330 0x7fed3c19ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:55.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.458+0000 7fed40c9d640 1 --2- 172.21.15.82:0/1137077077 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed3c104a00 0x7fed3c197de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:55.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.458+0000 7fed40c9d640 1 --2- 172.21.15.82:0/1137077077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed3c1020d0 0x7fed3c1978a0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:55.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.458+0000 7fed40c9d640 1 -- 172.21.15.82:0/1137077077 >> 172.21.15.82:0/1137077077 conn(0x7fed3c0fba80 msgr2=0x7fed3c102a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:55.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.458+0000 7fed40c9d640 1 -- 172.21.15.82:0/1137077077 shutdown_connections 2024-03-04T09:14:55.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.458+0000 7fed40c9d640 1 -- 172.21.15.82:0/1137077077 wait complete. 2024-03-04T09:14:55.464 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:55 smithi082 ceph-mon[32880]: pgmap v343: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-03-04T09:14:55.464 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:55 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/2171045611' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:14:55.465 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-04T09:14:55.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.576+0000 7f3d97cdf640 1 -- 172.21.15.82:0/3801680781 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d90107370 msgr2=0x7f3d90109760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:55.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.576+0000 7f3d97cdf640 1 --2- 172.21.15.82:0/3801680781 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d90107370 0x7f3d90109760 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f3d88009ca0 tx=0x7f3d8802c0f0 comp rx=0 tx=0).stop 2024-03-04T09:14:55.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.576+0000 7f3d97cdf640 1 -- 172.21.15.82:0/3801680781 shutdown_connections 2024-03-04T09:14:55.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.576+0000 7f3d97cdf640 1 --2- 172.21.15.82:0/3801680781 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d90107370 0x7f3d90109760 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:55.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.576+0000 7f3d97cdf640 1 --2- 172.21.15.82:0/3801680781 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d90104a40 0x7f3d90106e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:55.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.576+0000 7f3d97cdf640 1 --2- 172.21.15.82:0/3801680781 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d90102110 0x7f3d90104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:55.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.576+0000 7f3d97cdf640 1 -- 172.21.15.82:0/3801680781 >> 172.21.15.82:0/3801680781 conn(0x7f3d900fba60 msgr2=0x7f3d900fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:55.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.576+0000 7f3d97cdf640 1 -- 172.21.15.82:0/3801680781 shutdown_connections 2024-03-04T09:14:55.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.576+0000 7f3d97cdf640 1 -- 172.21.15.82:0/3801680781 wait complete. 2024-03-04T09:14:55.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.576+0000 7f3d97cdf640 1 Processor -- start 2024-03-04T09:14:55.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.576+0000 7f3d97cdf640 1 -- start start 2024-03-04T09:14:55.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.577+0000 7f3d97cdf640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d90102110 0x7f3d90197910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:55.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.577+0000 7f3d97cdf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d90104a40 0x7f3d90197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:55.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.577+0000 7f3d97cdf640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d90107370 0x7f3d9019eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:55.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.577+0000 7f3d97cdf640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9010d240 con 0x7f3d90107370 2024-03-04T09:14:55.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.577+0000 7f3d97cdf640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9010d0c0 con 0x7f3d90104a40 2024-03-04T09:14:55.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.577+0000 7f3d97cdf640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9010d3c0 con 0x7f3d90102110 2024-03-04T09:14:55.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.577+0000 7f3d9627c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d90107370 0x7f3d9019eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:55.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.577+0000 7f3d9527a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d90104a40 0x7f3d90197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:55.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.577+0000 7f3d95a7b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d90102110 0x7f3d90197910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:55.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.577+0000 7f3d9527a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d90104a40 0x7f3d90197e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.82:58330/0 (socket says 172.21.15.82:58330) 2024-03-04T09:14:55.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.577+0000 7f3d9627c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d90107370 0x7f3d9019eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49640/0 (socket says 172.21.15.82:49640) 2024-03-04T09:14:55.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.577+0000 7f3d9527a640 1 -- 172.21.15.82:0/2407185942 learned_addr learned my addr 172.21.15.82:0/2407185942 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:55.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.577+0000 7f3d9527a640 1 -- 172.21.15.82:0/2407185942 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d90102110 msgr2=0x7f3d90197910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:55.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.577+0000 7f3d9527a640 1 --2- 172.21.15.82:0/2407185942 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d90102110 0x7f3d90197910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:55.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.577+0000 7f3d9527a640 1 -- 172.21.15.82:0/2407185942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d90107370 msgr2=0x7f3d9019eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:55.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.577+0000 7f3d9527a640 1 --2- 172.21.15.82:0/2407185942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d90107370 0x7f3d9019eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:55.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.577+0000 7f3d9527a640 1 -- 172.21.15.82:0/2407185942 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d9019f530 con 0x7f3d90104a40 2024-03-04T09:14:55.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.577+0000 7f3d9627c640 1 --2- 172.21.15.82:0/2407185942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d90107370 0x7f3d9019eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:14:55.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.577+0000 7f3d95a7b640 1 --2- 172.21.15.82:0/2407185942 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d90102110 0x7f3d90197910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:14:55.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.577+0000 7f3d9527a640 1 --2- 172.21.15.82:0/2407185942 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d90104a40 0x7f3d90197e50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c00e9c0 tx=0x7f3d8c00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:55.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.577+0000 7f3d82ffd640 1 -- 172.21.15.82:0/2407185942 <== mon.2 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c00cd80 con 0x7f3d90104a40 2024-03-04T09:14:55.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.578+0000 7f3d82ffd640 1 -- 172.21.15.82:0/2407185942 <== mon.2 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f3d8c0054f0 con 0x7f3d90104a40 2024-03-04T09:14:55.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.578+0000 7f3d82ffd640 1 -- 172.21.15.82:0/2407185942 <== mon.2 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c010690 con 0x7f3d90104a40 2024-03-04T09:14:55.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.578+0000 7f3d97cdf640 1 -- 172.21.15.82:0/2407185942 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d9019f820 con 0x7f3d90104a40 2024-03-04T09:14:55.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.578+0000 7f3d97cdf640 1 -- 172.21.15.82:0/2407185942 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d9019fdc0 con 0x7f3d90104a40 2024-03-04T09:14:55.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.579+0000 7f3d97cdf640 1 -- 172.21.15.82:0/2407185942 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d900fd550 con 0x7f3d90104a40 2024-03-04T09:14:55.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.579+0000 7f3d82ffd640 1 -- 172.21.15.82:0/2407185942 <== mon.2 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 18) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f3d8c004e10 con 0x7f3d90104a40 2024-03-04T09:14:55.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.580+0000 7f3d82ffd640 1 --2- 172.21.15.82:0/2407185942 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f3d7c0a1e00 0x7f3d7c0a42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:55.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.580+0000 7f3d82ffd640 1 -- 172.21.15.82:0/2407185942 <== mon.2 v2:172.21.15.102:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9092+0+0 (secure 0 0 0) 0x7f3d8c0ce410 con 0x7f3d90104a40 2024-03-04T09:14:55.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.580+0000 7f3d95a7b640 1 --2- 172.21.15.82:0/2407185942 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f3d7c0a1e00 0x7f3d7c0a42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:55.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.580+0000 7f3d95a7b640 1 --2- 172.21.15.82:0/2407185942 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f3d7c0a1e00 0x7f3d7c0a42c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3d84009fc0 tx=0x7f3d84005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:55.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.585+0000 7f3d82ffd640 1 -- 172.21.15.82:0/2407185942 <== mon.2 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f3d8c09b4e0 con 0x7f3d90104a40 2024-03-04T09:14:55.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:55 smithi190 ceph-mon[36341]: pgmap v343: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-03-04T09:14:55.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:55 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/2171045611' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:14:55.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:55 smithi102 ceph-mon[36220]: pgmap v343: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-03-04T09:14:55.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:55 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/2171045611' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:14:55.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.761+0000 7f3d97cdf640 1 -- 172.21.15.82:0/2407185942 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3d900621d0 con 0x7f3d90104a40 2024-03-04T09:14:55.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.762+0000 7f3d82ffd640 1 -- 172.21.15.82:0/2407185942 <== mon.2 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v92) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3d8c09ade0 con 0x7f3d90104a40 2024-03-04T09:14:55.759 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-03-04T09:14:55.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.764+0000 7f3d97cdf640 1 -- 172.21.15.82:0/2407185942 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f3d7c0a1e00 msgr2=0x7f3d7c0a42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:55.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.764+0000 7f3d97cdf640 1 --2- 172.21.15.82:0/2407185942 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f3d7c0a1e00 0x7f3d7c0a42c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3d84009fc0 tx=0x7f3d84005f90 comp rx=0 tx=0).stop 2024-03-04T09:14:55.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.764+0000 7f3d97cdf640 1 -- 172.21.15.82:0/2407185942 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d90104a40 msgr2=0x7f3d90197e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:55.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.764+0000 7f3d97cdf640 1 --2- 172.21.15.82:0/2407185942 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d90104a40 0x7f3d90197e50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c00e9c0 tx=0x7f3d8c00ee80 comp rx=0 tx=0).stop 2024-03-04T09:14:55.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.764+0000 7f3d97cdf640 1 -- 172.21.15.82:0/2407185942 shutdown_connections 2024-03-04T09:14:55.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.764+0000 7f3d97cdf640 1 --2- 172.21.15.82:0/2407185942 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f3d7c0a1e00 0x7f3d7c0a42c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:55.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.764+0000 7f3d97cdf640 1 --2- 172.21.15.82:0/2407185942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d90107370 0x7f3d9019eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:55.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.764+0000 7f3d97cdf640 1 --2- 172.21.15.82:0/2407185942 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d90104a40 0x7f3d90197e50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:55.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.764+0000 7f3d97cdf640 1 --2- 172.21.15.82:0/2407185942 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d90102110 0x7f3d90197910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:55.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.764+0000 7f3d97cdf640 1 -- 172.21.15.82:0/2407185942 >> 172.21.15.82:0/2407185942 conn(0x7f3d900fba60 msgr2=0x7f3d901029d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:55.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.764+0000 7f3d97cdf640 1 -- 172.21.15.82:0/2407185942 shutdown_connections 2024-03-04T09:14:55.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.764+0000 7f3d97cdf640 1 -- 172.21.15.82:0/2407185942 wait complete. 2024-03-04T09:14:55.772 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-04T09:14:55.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.880+0000 7f7ee5f9a640 1 -- 172.21.15.82:0/1239057574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ee01027d0 msgr2=0x7f7ee0102c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:55.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.880+0000 7f7ee5f9a640 1 --2- 172.21.15.82:0/1239057574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ee01027d0 0x7f7ee0102c50 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4009900 tx=0x7f7ed402bc30 comp rx=0 tx=0).stop 2024-03-04T09:14:55.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.880+0000 7f7ee5f9a640 1 -- 172.21.15.82:0/1239057574 shutdown_connections 2024-03-04T09:14:55.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.880+0000 7f7ee5f9a640 1 --2- 172.21.15.82:0/1239057574 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ee0103190 0x7f7ee0109a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:55.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.880+0000 7f7ee5f9a640 1 --2- 172.21.15.82:0/1239057574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ee01027d0 0x7f7ee0102c50 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:55.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.880+0000 7f7ee5f9a640 1 --2- 172.21.15.82:0/1239057574 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ee01015e0 0x7f7ee0101a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:55.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.880+0000 7f7ee5f9a640 1 -- 172.21.15.82:0/1239057574 >> 172.21.15.82:0/1239057574 conn(0x7f7ee00fcb70 msgr2=0x7f7ee00fef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:55.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.880+0000 7f7ee5f9a640 1 -- 172.21.15.82:0/1239057574 shutdown_connections 2024-03-04T09:14:55.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.880+0000 7f7ee5f9a640 1 -- 172.21.15.82:0/1239057574 wait complete. 2024-03-04T09:14:55.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.881+0000 7f7ee5f9a640 1 Processor -- start 2024-03-04T09:14:55.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.881+0000 7f7ee5f9a640 1 -- start start 2024-03-04T09:14:55.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.881+0000 7f7ee5f9a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ee01015e0 0x7f7ee0197910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:55.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.881+0000 7f7ee5f9a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ee01027d0 0x7f7ee0197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:55.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.881+0000 7f7ee5f9a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ee0103190 0x7f7ee019eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:55.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.881+0000 7f7ee5f9a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee010d290 con 0x7f7ee01015e0 2024-03-04T09:14:55.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.881+0000 7f7ee5f9a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee010d110 con 0x7f7ee01027d0 2024-03-04T09:14:55.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.881+0000 7f7ee5f9a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee010d410 con 0x7f7ee0103190 2024-03-04T09:14:55.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.881+0000 7f7edf7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ee01015e0 0x7f7ee0197910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:55.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.881+0000 7f7edf7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ee01015e0 0x7f7ee0197910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49656/0 (socket says 172.21.15.82:49656) 2024-03-04T09:14:55.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.881+0000 7f7edf7fe640 1 -- 172.21.15.82:0/1350917448 learned_addr learned my addr 172.21.15.82:0/1350917448 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:55.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.881+0000 7f7edeffd640 1 --2- 172.21.15.82:0/1350917448 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ee01027d0 0x7f7ee0197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:55.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.881+0000 7f7edffff640 1 --2- 172.21.15.82:0/1350917448 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ee0103190 0x7f7ee019eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:55.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.881+0000 7f7edf7fe640 1 -- 172.21.15.82:0/1350917448 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ee0103190 msgr2=0x7f7ee019eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:55.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.881+0000 7f7edf7fe640 1 --2- 172.21.15.82:0/1350917448 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ee0103190 0x7f7ee019eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:55.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.881+0000 7f7edf7fe640 1 -- 172.21.15.82:0/1350917448 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ee01027d0 msgr2=0x7f7ee0197e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:55.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.881+0000 7f7edf7fe640 1 --2- 172.21.15.82:0/1350917448 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ee01027d0 0x7f7ee0197e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:55.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.881+0000 7f7edf7fe640 1 -- 172.21.15.82:0/1350917448 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee019f530 con 0x7f7ee01015e0 2024-03-04T09:14:55.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.881+0000 7f7edffff640 1 --2- 172.21.15.82:0/1350917448 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ee0103190 0x7f7ee019eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T09:14:55.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.882+0000 7f7edf7fe640 1 --2- 172.21.15.82:0/1350917448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ee01015e0 0x7f7ee0197910 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7ed000e9c0 tx=0x7f7ed000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:55.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.882+0000 7f7edcff9640 1 -- 172.21.15.82:0/1350917448 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed000cd80 con 0x7f7ee01015e0 2024-03-04T09:14:55.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.882+0000 7f7edcff9640 1 -- 172.21.15.82:0/1350917448 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f7ed00035f0 con 0x7f7ee01015e0 2024-03-04T09:14:55.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.882+0000 7f7ee5f9a640 1 -- 172.21.15.82:0/1350917448 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ee019f820 con 0x7f7ee01015e0 2024-03-04T09:14:55.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.882+0000 7f7edcff9640 1 -- 172.21.15.82:0/1350917448 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed0010690 con 0x7f7ee01015e0 2024-03-04T09:14:55.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.882+0000 7f7ee5f9a640 1 -- 172.21.15.82:0/1350917448 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ee019fcf0 con 0x7f7ee01015e0 2024-03-04T09:14:55.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.883+0000 7f7ee5f9a640 1 -- 172.21.15.82:0/1350917448 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ee0108980 con 0x7f7ee01015e0 2024-03-04T09:14:55.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.884+0000 7f7edcff9640 1 -- 172.21.15.82:0/1350917448 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f7ed00037a0 con 0x7f7ee01015e0 2024-03-04T09:14:55.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.884+0000 7f7edcff9640 1 --2- 172.21.15.82:0/1350917448 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f7ec80a1d80 0x7f7ec80a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:55.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.884+0000 7f7edeffd640 1 --2- 172.21.15.82:0/1350917448 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f7ec80a1d80 0x7f7ec80a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:55.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.884+0000 7f7edcff9640 1 -- 172.21.15.82:0/1350917448 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9092+0+0 (secure 0 0 0) 0x7f7ed00ce570 con 0x7f7ee01015e0 2024-03-04T09:14:55.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.885+0000 7f7edeffd640 1 --2- 172.21.15.82:0/1350917448 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f7ec80a1d80 0x7f7ec80a4240 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4000c00 tx=0x7f7ed402c820 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:55.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:55.888+0000 7f7edcff9640 1 -- 172.21.15.82:0/1350917448 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f7ed009b640 con 0x7f7ee01015e0 2024-03-04T09:14:56.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.063+0000 7f7ee5f9a640 1 -- 172.21.15.82:0/1350917448 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7ee00621d0 con 0x7f7ee01015e0 2024-03-04T09:14:56.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.063+0000 7f7edcff9640 1 -- 172.21.15.82:0/1350917448 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v92) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7ed009af40 con 0x7f7ee01015e0 2024-03-04T09:14:56.060 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2024-03-04T09:14:56.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.065+0000 7f7ee5f9a640 1 -- 172.21.15.82:0/1350917448 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f7ec80a1d80 msgr2=0x7f7ec80a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:56.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.065+0000 7f7ee5f9a640 1 --2- 172.21.15.82:0/1350917448 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f7ec80a1d80 0x7f7ec80a4240 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4000c00 tx=0x7f7ed402c820 comp rx=0 tx=0).stop 2024-03-04T09:14:56.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.065+0000 7f7ee5f9a640 1 -- 172.21.15.82:0/1350917448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ee01015e0 msgr2=0x7f7ee0197910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:56.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.065+0000 7f7ee5f9a640 1 --2- 172.21.15.82:0/1350917448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ee01015e0 0x7f7ee0197910 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7ed000e9c0 tx=0x7f7ed000ee80 comp rx=0 tx=0).stop 2024-03-04T09:14:56.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.065+0000 7f7ee5f9a640 1 -- 172.21.15.82:0/1350917448 shutdown_connections 2024-03-04T09:14:56.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.065+0000 7f7ee5f9a640 1 --2- 172.21.15.82:0/1350917448 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f7ec80a1d80 0x7f7ec80a4240 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:56.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.065+0000 7f7ee5f9a640 1 --2- 172.21.15.82:0/1350917448 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ee0103190 0x7f7ee019eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:56.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.065+0000 7f7ee5f9a640 1 --2- 172.21.15.82:0/1350917448 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ee01027d0 0x7f7ee0197e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:56.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.065+0000 7f7ee5f9a640 1 --2- 172.21.15.82:0/1350917448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ee01015e0 0x7f7ee0197910 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:56.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.065+0000 7f7ee5f9a640 1 -- 172.21.15.82:0/1350917448 >> 172.21.15.82:0/1350917448 conn(0x7f7ee00fcb70 msgr2=0x7f7ee0105b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:56.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.065+0000 7f7ee5f9a640 1 -- 172.21.15.82:0/1350917448 shutdown_connections 2024-03-04T09:14:56.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.065+0000 7f7ee5f9a640 1 -- 172.21.15.82:0/1350917448 wait complete. 2024-03-04T09:14:56.073 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-04T09:14:56.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.182+0000 7fde695c7640 1 -- 172.21.15.82:0/4244773023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde64103190 msgr2=0x7fde64109a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:56.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.182+0000 7fde695c7640 1 --2- 172.21.15.82:0/4244773023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde64103190 0x7fde64109a20 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fde5c009900 tx=0x7fde5c02bc30 comp rx=0 tx=0).stop 2024-03-04T09:14:56.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.182+0000 7fde695c7640 1 -- 172.21.15.82:0/4244773023 shutdown_connections 2024-03-04T09:14:56.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.182+0000 7fde695c7640 1 --2- 172.21.15.82:0/4244773023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde64103190 0x7fde64109a20 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:56.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.182+0000 7fde695c7640 1 --2- 172.21.15.82:0/4244773023 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde641027d0 0x7fde64102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:56.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.182+0000 7fde695c7640 1 --2- 172.21.15.82:0/4244773023 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fde641015e0 0x7fde64101a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:56.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.182+0000 7fde695c7640 1 -- 172.21.15.82:0/4244773023 >> 172.21.15.82:0/4244773023 conn(0x7fde640fcb70 msgr2=0x7fde640fef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:56.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.182+0000 7fde695c7640 1 -- 172.21.15.82:0/4244773023 shutdown_connections 2024-03-04T09:14:56.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.182+0000 7fde695c7640 1 -- 172.21.15.82:0/4244773023 wait complete. 2024-03-04T09:14:56.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.182+0000 7fde695c7640 1 Processor -- start 2024-03-04T09:14:56.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.182+0000 7fde695c7640 1 -- start start 2024-03-04T09:14:56.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.182+0000 7fde695c7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fde641015e0 0x7fde641978b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:56.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.182+0000 7fde695c7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde641027d0 0x7fde64197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:56.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.182+0000 7fde695c7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde64103190 0x7fde6419ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:56.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.182+0000 7fde695c7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde6410d240 con 0x7fde64103190 2024-03-04T09:14:56.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.183+0000 7fde695c7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde6410d0c0 con 0x7fde641015e0 2024-03-04T09:14:56.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.183+0000 7fde695c7640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde6410d3c0 con 0x7fde641027d0 2024-03-04T09:14:56.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.183+0000 7fde637fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde64103190 0x7fde6419ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:56.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.183+0000 7fde637fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde64103190 0x7fde6419ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49672/0 (socket says 172.21.15.82:49672) 2024-03-04T09:14:56.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.183+0000 7fde637fe640 1 -- 172.21.15.82:0/3578306693 learned_addr learned my addr 172.21.15.82:0/3578306693 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:56.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.183+0000 7fde627fc640 1 --2- 172.21.15.82:0/3578306693 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde641027d0 0x7fde64197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:56.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.183+0000 7fde62ffd640 1 --2- 172.21.15.82:0/3578306693 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fde641015e0 0x7fde641978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:56.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.183+0000 7fde637fe640 1 -- 172.21.15.82:0/3578306693 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde641027d0 msgr2=0x7fde64197df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:56.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.183+0000 7fde637fe640 1 --2- 172.21.15.82:0/3578306693 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde641027d0 0x7fde64197df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:56.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.183+0000 7fde637fe640 1 -- 172.21.15.82:0/3578306693 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fde641015e0 msgr2=0x7fde641978b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:56.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.183+0000 7fde637fe640 1 --2- 172.21.15.82:0/3578306693 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fde641015e0 0x7fde641978b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:56.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.183+0000 7fde637fe640 1 -- 172.21.15.82:0/3578306693 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde6419f4d0 con 0x7fde64103190 2024-03-04T09:14:56.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.183+0000 7fde637fe640 1 --2- 172.21.15.82:0/3578306693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde64103190 0x7fde6419ee60 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fde5c036040 tx=0x7fde5c005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:56.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.183+0000 7fde4bfff640 1 -- 172.21.15.82:0/3578306693 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5c043020 con 0x7fde64103190 2024-03-04T09:14:56.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.183+0000 7fde4bfff640 1 -- 172.21.15.82:0/3578306693 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fde5c004250 con 0x7fde64103190 2024-03-04T09:14:56.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.183+0000 7fde695c7640 1 -- 172.21.15.82:0/3578306693 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde6419f760 con 0x7fde64103190 2024-03-04T09:14:56.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.183+0000 7fde4bfff640 1 -- 172.21.15.82:0/3578306693 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5c003af0 con 0x7fde64103190 2024-03-04T09:14:56.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.183+0000 7fde695c7640 1 -- 172.21.15.82:0/3578306693 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde6419fcb0 con 0x7fde64103190 2024-03-04T09:14:56.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.184+0000 7fde695c7640 1 -- 172.21.15.82:0/3578306693 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde64108900 con 0x7fde64103190 2024-03-04T09:14:56.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.185+0000 7fde4bfff640 1 -- 172.21.15.82:0/3578306693 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 136756+0+0 (secure 0 0 0) 0x7fde5c046020 con 0x7fde64103190 2024-03-04T09:14:56.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.186+0000 7fde4bfff640 1 --2- 172.21.15.82:0/3578306693 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fde4c0a1d80 0x7fde4c0a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:56.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.186+0000 7fde4bfff640 1 -- 172.21.15.82:0/3578306693 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9092+0+0 (secure 0 0 0) 0x7fde5c0f0310 con 0x7fde64103190 2024-03-04T09:14:56.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.186+0000 7fde62ffd640 1 --2- 172.21.15.82:0/3578306693 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fde4c0a1d80 0x7fde4c0a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:56.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.186+0000 7fde62ffd640 1 --2- 172.21.15.82:0/3578306693 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fde4c0a1d80 0x7fde4c0a4240 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fde540099a0 tx=0x7fde54009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:56.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.189+0000 7fde4bfff640 1 -- 172.21.15.82:0/3578306693 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fde5c04d070 con 0x7fde64103190 2024-03-04T09:14:56.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.368+0000 7fde695c7640 1 -- 172.21.15.82:0/3578306693 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fde6402cff0 con 0x7fde64103190 2024-03-04T09:14:56.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.369+0000 7fde4bfff640 1 -- 172.21.15.82:0/3578306693 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v92) v1 ==== 103+0+11 (secure 0 0 0) 0x7fde5c0bd480 con 0x7fde64103190 2024-03-04T09:14:56.365 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-03-04T09:14:56.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.371+0000 7fde695c7640 1 -- 172.21.15.82:0/3578306693 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fde4c0a1d80 msgr2=0x7fde4c0a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:56.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.371+0000 7fde695c7640 1 --2- 172.21.15.82:0/3578306693 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fde4c0a1d80 0x7fde4c0a4240 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fde540099a0 tx=0x7fde54009500 comp rx=0 tx=0).stop 2024-03-04T09:14:56.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.371+0000 7fde695c7640 1 -- 172.21.15.82:0/3578306693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde64103190 msgr2=0x7fde6419ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:56.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.371+0000 7fde695c7640 1 --2- 172.21.15.82:0/3578306693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde64103190 0x7fde6419ee60 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fde5c036040 tx=0x7fde5c005d50 comp rx=0 tx=0).stop 2024-03-04T09:14:56.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.371+0000 7fde695c7640 1 -- 172.21.15.82:0/3578306693 shutdown_connections 2024-03-04T09:14:56.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.371+0000 7fde695c7640 1 --2- 172.21.15.82:0/3578306693 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fde4c0a1d80 0x7fde4c0a4240 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:56.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.371+0000 7fde695c7640 1 --2- 172.21.15.82:0/3578306693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde64103190 0x7fde6419ee60 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:56.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.371+0000 7fde695c7640 1 --2- 172.21.15.82:0/3578306693 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde641027d0 0x7fde64197df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:56.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.371+0000 7fde695c7640 1 --2- 172.21.15.82:0/3578306693 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fde641015e0 0x7fde641978b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:56.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.371+0000 7fde695c7640 1 -- 172.21.15.82:0/3578306693 >> 172.21.15.82:0/3578306693 conn(0x7fde640fcb70 msgr2=0x7fde64105ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:56.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.371+0000 7fde695c7640 1 -- 172.21.15.82:0/3578306693 shutdown_connections 2024-03-04T09:14:56.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.371+0000 7fde695c7640 1 -- 172.21.15.82:0/3578306693 wait complete. 2024-03-04T09:14:56.379 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T09:14:56.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.485+0000 7f48c8377640 1 -- 172.21.15.82:0/393270357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48c00ffc80 msgr2=0x7f48c01000a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:56.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.485+0000 7f48c8377640 1 --2- 172.21.15.82:0/393270357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48c00ffc80 0x7f48c01000a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f48bc009900 tx=0x7f48bc02bc30 comp rx=0 tx=0).stop 2024-03-04T09:14:56.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.485+0000 7f48c8377640 1 -- 172.21.15.82:0/393270357 shutdown_connections 2024-03-04T09:14:56.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.485+0000 7f48c8377640 1 --2- 172.21.15.82:0/393270357 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f48c0101830 0x7f48c01080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:56.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.485+0000 7f48c8377640 1 --2- 172.21.15.82:0/393270357 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48c0100e70 0x7f48c01012f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:56.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.485+0000 7f48c8377640 1 --2- 172.21.15.82:0/393270357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48c00ffc80 0x7f48c01000a0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:56.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.485+0000 7f48c8377640 1 -- 172.21.15.82:0/393270357 >> 172.21.15.82:0/393270357 conn(0x7f48c00fb1f0 msgr2=0x7f48c00fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:56.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.485+0000 7f48c8377640 1 -- 172.21.15.82:0/393270357 shutdown_connections 2024-03-04T09:14:56.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.485+0000 7f48c8377640 1 -- 172.21.15.82:0/393270357 wait complete. 2024-03-04T09:14:56.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.485+0000 7f48c8377640 1 Processor -- start 2024-03-04T09:14:56.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.485+0000 7f48c8377640 1 -- start start 2024-03-04T09:14:56.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.486+0000 7f48c8377640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f48c00ffc80 0x7f48c01978e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:56.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.486+0000 7f48c8377640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48c0100e70 0x7f48c0197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:56.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.486+0000 7f48c8377640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48c0101830 0x7f48c019ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:56.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.486+0000 7f48c8377640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c010d270 con 0x7f48c0100e70 2024-03-04T09:14:56.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.486+0000 7f48c8377640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c010d0f0 con 0x7f48c0101830 2024-03-04T09:14:56.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.486+0000 7f48c8377640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c010d3f0 con 0x7f48c00ffc80 2024-03-04T09:14:56.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.486+0000 7f48c5912640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48c0100e70 0x7f48c0197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:56.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.486+0000 7f48c5912640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48c0100e70 0x7f48c0197e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33744/0 (socket says 172.21.15.82:33744) 2024-03-04T09:14:56.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.486+0000 7f48c5912640 1 -- 172.21.15.82:0/70253065 learned_addr learned my addr 172.21.15.82:0/70253065 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:56.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.486+0000 7f48c6113640 1 --2- 172.21.15.82:0/70253065 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f48c00ffc80 0x7f48c01978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:56.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.486+0000 7f48c6914640 1 --2- 172.21.15.82:0/70253065 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48c0101830 0x7f48c019ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:56.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.486+0000 7f48c5912640 1 -- 172.21.15.82:0/70253065 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f48c00ffc80 msgr2=0x7f48c01978e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:56.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.486+0000 7f48c5912640 1 --2- 172.21.15.82:0/70253065 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f48c00ffc80 0x7f48c01978e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:56.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.486+0000 7f48c5912640 1 -- 172.21.15.82:0/70253065 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48c0101830 msgr2=0x7f48c019ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:56.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.486+0000 7f48c5912640 1 --2- 172.21.15.82:0/70253065 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48c0101830 0x7f48c019ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:56.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.486+0000 7f48c5912640 1 -- 172.21.15.82:0/70253065 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c019f500 con 0x7f48c0100e70 2024-03-04T09:14:56.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.486+0000 7f48c5912640 1 --2- 172.21.15.82:0/70253065 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48c0100e70 0x7f48c0197e20 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f48b400e9f0 tx=0x7f48b400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:56.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.486+0000 7f48b37fe640 1 -- 172.21.15.82:0/70253065 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b400cd80 con 0x7f48c0100e70 2024-03-04T09:14:56.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.486+0000 7f48c8377640 1 -- 172.21.15.82:0/70253065 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48c019f7f0 con 0x7f48c0100e70 2024-03-04T09:14:56.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.486+0000 7f48b37fe640 1 -- 172.21.15.82:0/70253065 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f48b4010900 con 0x7f48c0100e70 2024-03-04T09:14:56.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.486+0000 7f48b37fe640 1 -- 172.21.15.82:0/70253065 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b40189e0 con 0x7f48c0100e70 2024-03-04T09:14:56.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.486+0000 7f48c8377640 1 -- 172.21.15.82:0/70253065 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48c019fd90 con 0x7f48c0100e70 2024-03-04T09:14:56.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.487+0000 7f48c8377640 1 -- 172.21.15.82:0/70253065 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48c0106fa0 con 0x7f48c0100e70 2024-03-04T09:14:56.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.489+0000 7f48b37fe640 1 -- 172.21.15.82:0/70253065 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f48b4010ab0 con 0x7f48c0100e70 2024-03-04T09:14:56.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.489+0000 7f48b37fe640 1 --2- 172.21.15.82:0/70253065 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f48ac0a1d80 0x7f48ac0a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:56.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.489+0000 7f48c6113640 1 --2- 172.21.15.82:0/70253065 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f48ac0a1d80 0x7f48ac0a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:56.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.489+0000 7f48b37fe640 1 -- 172.21.15.82:0/70253065 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9092+0+0 (secure 0 0 0) 0x7f48b40ce380 con 0x7f48c0100e70 2024-03-04T09:14:56.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.490+0000 7f48c6113640 1 --2- 172.21.15.82:0/70253065 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f48ac0a1d80 0x7f48ac0a4240 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f48bc000c00 tx=0x7f48bc005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:56.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.493+0000 7f48b37fe640 1 -- 172.21.15.82:0/70253065 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f48b409ae40 con 0x7f48c0100e70 2024-03-04T09:14:56.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:56 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/1137077077' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-04T09:14:56.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:56 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/2407185942' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-04T09:14:56.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:56 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/1350917448' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-04T09:14:56.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:56 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/1137077077' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-04T09:14:56.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:56 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/2407185942' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-04T09:14:56.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:56 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/1350917448' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-04T09:14:56.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.704+0000 7f48c8377640 1 -- 172.21.15.82:0/70253065 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f48c002d1f0 con 0x7f48c0100e70 2024-03-04T09:14:56.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.704+0000 7f48b37fe640 1 -- 172.21.15.82:0/70253065 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11462 (secure 0 0 0) 0x7f48b409eee0 con 0x7f48c0100e70 2024-03-04T09:14:56.701 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:14:56.701 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3123844705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3123844705},{"type":"v1","addr":"172.21.15.82:6835","nonce":3123844705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2620634252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2620634252},{"type":"v1","addr":"172.21.15.82:6837","nonce":2620634252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-04T09:13:10.076732+0000","modified":"2024-03-04T09:13:38.017758+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24476,"mds_1":24469,"mds_2":24451,"mds_3":24449,"mds_4":24439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14613":{"gid":14613,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/1240838024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1240838024},{"type":"v1","addr":"172.21.15.82:6839","nonce":1240838024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14625":{"gid":14625,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/213594267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":213594267},{"type":"v1","addr":"172.21.15.82:6841","nonce":213594267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24398":{"gid":24398,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/1142302200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":1142302200},{"type":"v1","addr":"172.21.15.102:6833","nonce":1142302200}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24403":{"gid":24403,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6833/3023382814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":3023382814},{"type":"v1","addr":"172.21.15.190:6833","nonce":3023382814}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24422":{"gid":24422,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6835/2134310473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":2134310473},{"type":"v1","addr":"172.21.15.102:6835","nonce":2134310473}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24439":{"gid":24439,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":14,"addr":"172.21.15.190:6835/3183532624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3183532624},{"type":"v1","addr":"172.21.15.190:6835","nonce":3183532624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24449":{"gid":24449,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":12,"addr":"172.21.15.102:6837/1210579527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1210579527},{"type":"v1","addr":"172.21.15.102:6837","nonce":1210579527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24451":{"gid":24451,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.190:6837/1198639527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":1198639527},{"type":"v1","addr":"172.21.15.190:6837","nonce":1198639527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.190:6839/878555510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":878555510},{"type":"v1","addr":"172.21.15.190:6839","nonce":878555510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6839/35424130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":35424130},{"type":"v1","addr":"172.21.15.102:6839","nonce":35424130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24449,24439,24451,24476,24469]},"id":1}]} 2024-03-04T09:14:56.701 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 27 2024-03-04T09:14:56.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.707+0000 7f48c8377640 1 -- 172.21.15.82:0/70253065 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f48ac0a1d80 msgr2=0x7f48ac0a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:56.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.707+0000 7f48c8377640 1 --2- 172.21.15.82:0/70253065 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f48ac0a1d80 0x7f48ac0a4240 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f48bc000c00 tx=0x7f48bc005fd0 comp rx=0 tx=0).stop 2024-03-04T09:14:56.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.707+0000 7f48c8377640 1 -- 172.21.15.82:0/70253065 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48c0100e70 msgr2=0x7f48c0197e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:56.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.707+0000 7f48c8377640 1 --2- 172.21.15.82:0/70253065 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48c0100e70 0x7f48c0197e20 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f48b400e9f0 tx=0x7f48b400eeb0 comp rx=0 tx=0).stop 2024-03-04T09:14:56.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.707+0000 7f48c8377640 1 -- 172.21.15.82:0/70253065 shutdown_connections 2024-03-04T09:14:56.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.707+0000 7f48c8377640 1 --2- 172.21.15.82:0/70253065 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f48ac0a1d80 0x7f48ac0a4240 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:56.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.707+0000 7f48c8377640 1 --2- 172.21.15.82:0/70253065 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48c0101830 0x7f48c019ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:56.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.707+0000 7f48c8377640 1 --2- 172.21.15.82:0/70253065 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48c0100e70 0x7f48c0197e20 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:56.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.707+0000 7f48c8377640 1 --2- 172.21.15.82:0/70253065 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f48c00ffc80 0x7f48c01978e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:56.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.707+0000 7f48c8377640 1 -- 172.21.15.82:0/70253065 >> 172.21.15.82:0/70253065 conn(0x7f48c00fb1f0 msgr2=0x7f48c0104170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:56.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.707+0000 7f48c8377640 1 -- 172.21.15.82:0/70253065 shutdown_connections 2024-03-04T09:14:56.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.707+0000 7f48c8377640 1 -- 172.21.15.82:0/70253065 wait complete. 2024-03-04T09:14:56.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:56 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/1137077077' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-04T09:14:56.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:56 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/2407185942' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-04T09:14:56.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:56 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/1350917448' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-04T09:14:56.715 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T09:14:56.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.819+0000 7fa7147d7640 1 -- 172.21.15.82:0/2838760731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa70c1004f0 msgr2=0x7fa70c100910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:56.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.819+0000 7fa7147d7640 1 --2- 172.21.15.82:0/2838760731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa70c1004f0 0x7fa70c100910 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc009900 tx=0x7fa6fc02bc30 comp rx=0 tx=0).stop 2024-03-04T09:14:56.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.820+0000 7fa7147d7640 1 -- 172.21.15.82:0/2838760731 shutdown_connections 2024-03-04T09:14:56.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.820+0000 7fa7147d7640 1 --2- 172.21.15.82:0/2838760731 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa70c1020a0 0x7fa70c108930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:56.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.820+0000 7fa7147d7640 1 --2- 172.21.15.82:0/2838760731 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa70c1016e0 0x7fa70c101b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:56.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.820+0000 7fa7147d7640 1 --2- 172.21.15.82:0/2838760731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa70c1004f0 0x7fa70c100910 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:56.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.820+0000 7fa7147d7640 1 -- 172.21.15.82:0/2838760731 >> 172.21.15.82:0/2838760731 conn(0x7fa70c0fba60 msgr2=0x7fa70c0fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:56.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.820+0000 7fa7147d7640 1 -- 172.21.15.82:0/2838760731 shutdown_connections 2024-03-04T09:14:56.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.820+0000 7fa7147d7640 1 -- 172.21.15.82:0/2838760731 wait complete. 2024-03-04T09:14:56.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.820+0000 7fa7147d7640 1 Processor -- start 2024-03-04T09:14:56.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.820+0000 7fa7147d7640 1 -- start start 2024-03-04T09:14:56.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.820+0000 7fa7147d7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa70c1004f0 0x7fa70c197920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:56.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.820+0000 7fa7147d7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa70c1016e0 0x7fa70c197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:56.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.820+0000 7fa7147d7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa70c1020a0 0x7fa70c19eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:56.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.820+0000 7fa7147d7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70c10d260 con 0x7fa70c1004f0 2024-03-04T09:14:56.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.820+0000 7fa7147d7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70c10d0e0 con 0x7fa70c1020a0 2024-03-04T09:14:56.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.820+0000 7fa7147d7640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70c10d3e0 con 0x7fa70c1016e0 2024-03-04T09:14:56.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.820+0000 7fa712573640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa70c1004f0 0x7fa70c197920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:56.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.821+0000 7fa712573640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa70c1004f0 0x7fa70c197920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33752/0 (socket says 172.21.15.82:33752) 2024-03-04T09:14:56.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.821+0000 7fa712573640 1 -- 172.21.15.82:0/3205389493 learned_addr learned my addr 172.21.15.82:0/3205389493 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:56.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.821+0000 7fa711d72640 1 --2- 172.21.15.82:0/3205389493 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa70c1016e0 0x7fa70c197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:56.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.821+0000 7fa712d74640 1 --2- 172.21.15.82:0/3205389493 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa70c1020a0 0x7fa70c19eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:56.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.821+0000 7fa712573640 1 -- 172.21.15.82:0/3205389493 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa70c1016e0 msgr2=0x7fa70c197e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:56.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.821+0000 7fa712573640 1 --2- 172.21.15.82:0/3205389493 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa70c1016e0 0x7fa70c197e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:56.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.821+0000 7fa712573640 1 -- 172.21.15.82:0/3205389493 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa70c1020a0 msgr2=0x7fa70c19eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:56.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.821+0000 7fa712573640 1 --2- 172.21.15.82:0/3205389493 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa70c1020a0 0x7fa70c19eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:56.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.821+0000 7fa712573640 1 -- 172.21.15.82:0/3205389493 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa70c19f540 con 0x7fa70c1004f0 2024-03-04T09:14:56.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.821+0000 7fa712573640 1 --2- 172.21.15.82:0/3205389493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa70c1004f0 0x7fa70c197920 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc005ab0 tx=0x7fa6fc005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:56.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.821+0000 7fa7037fe640 1 -- 172.21.15.82:0/3205389493 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6fc043020 con 0x7fa70c1004f0 2024-03-04T09:14:56.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.821+0000 7fa7037fe640 1 -- 172.21.15.82:0/3205389493 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fa6fc0054b0 con 0x7fa70c1004f0 2024-03-04T09:14:56.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.821+0000 7fa7147d7640 1 -- 172.21.15.82:0/3205389493 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa70c19f7d0 con 0x7fa70c1004f0 2024-03-04T09:14:56.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.821+0000 7fa7037fe640 1 -- 172.21.15.82:0/3205389493 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6fc003bb0 con 0x7fa70c1004f0 2024-03-04T09:14:56.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.821+0000 7fa7147d7640 1 -- 172.21.15.82:0/3205389493 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa70c19fd20 con 0x7fa70c1004f0 2024-03-04T09:14:56.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.822+0000 7fa7147d7640 1 -- 172.21.15.82:0/3205389493 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa70c107810 con 0x7fa70c1004f0 2024-03-04T09:14:56.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.823+0000 7fa7037fe640 1 -- 172.21.15.82:0/3205389493 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 136756+0+0 (secure 0 0 0) 0x7fa6fc046020 con 0x7fa70c1004f0 2024-03-04T09:14:56.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.824+0000 7fa7037fe640 1 --2- 172.21.15.82:0/3205389493 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fa6f80a1d80 0x7fa6f80a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:56.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.824+0000 7fa711d72640 1 --2- 172.21.15.82:0/3205389493 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fa6f80a1d80 0x7fa6f80a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:56.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.824+0000 7fa7037fe640 1 -- 172.21.15.82:0/3205389493 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9092+0+0 (secure 0 0 0) 0x7fa6fc0f0440 con 0x7fa70c1004f0 2024-03-04T09:14:56.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.824+0000 7fa711d72640 1 --2- 172.21.15.82:0/3205389493 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fa6f80a1d80 0x7fa6f80a4240 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa70c198e30 tx=0x7fa708005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:56.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:56.827+0000 7fa7037fe640 1 -- 172.21.15.82:0/3205389493 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fa6fc04d070 con 0x7fa70c1004f0 2024-03-04T09:14:56.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.002+0000 7fa7147d7640 1 -- 172.21.15.82:0/3205389493 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa70c02d1c0 con 0x7fa70c1004f0 2024-03-04T09:14:57.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.004+0000 7fa7037fe640 1 -- 172.21.15.82:0/3205389493 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+24563 (secure 0 0 0) 0x7fa6fc0bd510 con 0x7fa70c1004f0 2024-03-04T09:14:57.001 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:14:57.001 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":92,"fsid":"2e533fc8-da06-11ee-95c6-87774f69a715","created":"2024-03-04T09:05:16.488249+0000","modified":"2024-03-04T09:14:13.863336+0000","last_up_change":"2024-03-04T09:12:22.308711+0000","last_in_change":"2024-03-04T09:12:02.548212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T09:08:36.508257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T09:13:07.981726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T09:13:09.289799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-04T09:13:13.008516+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"085b5c4b-ede9-4d0d-b994-50c89d991012","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6803","nonce":709655235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6805","nonce":709655235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6809","nonce":709655235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6807","nonce":709655235}]},"public_addr":"172.21.15.82:6803/709655235","cluster_addr":"172.21.15.82:6805/709655235","heartbeat_back_addr":"172.21.15.82:6809/709655235","heartbeat_front_addr":"172.21.15.82:6807/709655235","state":["exists","up"]},{"osd":1,"uuid":"e4dd7079-333e-4bcf-b3af-11fb082a5af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6801","nonce":270721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6803","nonce":270721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6807","nonce":270721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6805","nonce":270721212}]},"public_addr":"172.21.15.102:6801/270721212","cluster_addr":"172.21.15.102:6803/270721212","heartbeat_back_addr":"172.21.15.102:6807/270721212","heartbeat_front_addr":"172.21.15.102:6805/270721212","state":["exists","up"]},{"osd":2,"uuid":"6fed5fd6-dc82-497f-9d69-c10a5e5802da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6801","nonce":946410459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6803","nonce":946410459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6807","nonce":946410459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6805","nonce":946410459}]},"public_addr":"172.21.15.190:6801/946410459","cluster_addr":"172.21.15.190:6803/946410459","heartbeat_back_addr":"172.21.15.190:6807/946410459","heartbeat_front_addr":"172.21.15.190:6805/946410459","state":["exists","up"]},{"osd":3,"uuid":"91ccbdc3-3da6-4d39-8a89-3a7b7bb4adc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6811","nonce":980870924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6813","nonce":980870924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6817","nonce":980870924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6815","nonce":980870924}]},"public_addr":"172.21.15.82:6811/980870924","cluster_addr":"172.21.15.82:6813/980870924","heartbeat_back_addr":"172.21.15.82:6817/980870924","heartbeat_front_addr":"172.21.15.82:6815/980870924","state":["exists","up"]},{"osd":4,"uuid":"dbb9d486-5daa-4819-bbed-04fc76ca473e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6809","nonce":1229627753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6811","nonce":1229627753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6815","nonce":1229627753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6813","nonce":1229627753}]},"public_addr":"172.21.15.102:6809/1229627753","cluster_addr":"172.21.15.102:6811/1229627753","heartbeat_back_addr":"172.21.15.102:6815/1229627753","heartbeat_front_addr":"172.21.15.102:6813/1229627753","state":["exists","up"]},{"osd":5,"uuid":"6b50127b-df2b-4c95-8e53-9d42b40273fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6809","nonce":2171194148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6811","nonce":2171194148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6815","nonce":2171194148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6813","nonce":2171194148}]},"public_addr":"172.21.15.190:6809/2171194148","cluster_addr":"172.21.15.190:6811/2171194148","heartbeat_back_addr":"172.21.15.190:6815/2171194148","heartbeat_front_addr":"172.21.15.190:6813/2171194148","state":["exists","up"]},{"osd":6,"uuid":"e72bebb0-5939-4210-950a-41c25c23c62f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6819","nonce":454436959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6821","nonce":454436959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6825","nonce":454436959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6823","nonce":454436959}]},"public_addr":"172.21.15.82:6819/454436959","cluster_addr":"172.21.15.82:6821/454436959","heartbeat_back_addr":"172.21.15.82:6825/454436959","heartbeat_front_addr":"172.21.15.82:6823/454436959","state":["exists","up"]},{"osd":7,"uuid":"72f83f97-f496-4503-8284-6a7b8f99a6f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6817","nonce":2745057274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6819","nonce":2745057274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6823","nonce":2745057274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6821","nonce":2745057274}]},"public_addr":"172.21.15.102:6817/2745057274","cluster_addr":"172.21.15.102:6819/2745057274","heartbeat_back_addr":"172.21.15.102:6823/2745057274","heartbeat_front_addr":"172.21.15.102:6821/2745057274","state":["exists","up"]},{"osd":8,"uuid":"92c9109d-6ebb-4c50-9944-28cd7b2f9c0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6817","nonce":1679683516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6819","nonce":1679683516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6823","nonce":1679683516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6821","nonce":1679683516}]},"public_addr":"172.21.15.190:6817/1679683516","cluster_addr":"172.21.15.190:6819/1679683516","heartbeat_back_addr":"172.21.15.190:6823/1679683516","heartbeat_front_addr":"172.21.15.190:6821/1679683516","state":["exists","up"]},{"osd":9,"uuid":"a3cfce03-0148-475d-bf55-b8284ae1cad2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6827","nonce":1777272933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6829","nonce":1777272933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6833","nonce":1777272933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6831","nonce":1777272933}]},"public_addr":"172.21.15.82:6827/1777272933","cluster_addr":"172.21.15.82:6829/1777272933","heartbeat_back_addr":"172.21.15.82:6833/1777272933","heartbeat_front_addr":"172.21.15.82:6831/1777272933","state":["exists","up"]},{"osd":10,"uuid":"db156ccf-4396-43cb-b69a-bb9095b94b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6825","nonce":1012784035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6827","nonce":1012784035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6831","nonce":1012784035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6829","nonce":1012784035}]},"public_addr":"172.21.15.102:6825/1012784035","cluster_addr":"172.21.15.102:6827/1012784035","heartbeat_back_addr":"172.21.15.102:6831/1012784035","heartbeat_front_addr":"172.21.15.102:6829/1012784035","state":["exists","up"]},{"osd":11,"uuid":"b4d52576-f5b4-479f-8ff6-8fdba4635ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6825","nonce":144700355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6827","nonce":144700355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6831","nonce":144700355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6829","nonce":144700355}]},"public_addr":"172.21.15.190:6825/144700355","cluster_addr":"172.21.15.190:6827/144700355","heartbeat_back_addr":"172.21.15.190:6831/144700355","heartbeat_front_addr":"172.21.15.190:6829/144700355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:07:47.007772+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:09.944738+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:33.183567+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:58.302023+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:09:23.042488+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:09:47.616009+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:10:13.122887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:10:38.584530+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:03.473453+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:29.847105+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:55.152195+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:12:20.401765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6800/1901539016":"2024-03-05T09:06:12.169231+0000","172.21.15.82:0/1124105204":"2024-03-05T09:06:12.169231+0000","172.21.15.82:6801/1901539016":"2024-03-05T09:06:12.169231+0000","172.21.15.82:0/735262841":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/2402774828":"2024-03-05T09:05:44.913099+0000","172.21.15.82:6801/3291527077":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/1846720385":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/3757201752":"2024-03-05T09:06:12.169231+0000","172.21.15.82:6800/3291527077":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/984630078":"2024-03-05T09:06:12.169231+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T09:14:57.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.006+0000 7fa7147d7640 1 -- 172.21.15.82:0/3205389493 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fa6f80a1d80 msgr2=0x7fa6f80a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:57.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.006+0000 7fa7147d7640 1 --2- 172.21.15.82:0/3205389493 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fa6f80a1d80 0x7fa6f80a4240 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa70c198e30 tx=0x7fa708005f90 comp rx=0 tx=0).stop 2024-03-04T09:14:57.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.006+0000 7fa7147d7640 1 -- 172.21.15.82:0/3205389493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa70c1004f0 msgr2=0x7fa70c197920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:57.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.006+0000 7fa7147d7640 1 --2- 172.21.15.82:0/3205389493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa70c1004f0 0x7fa70c197920 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc005ab0 tx=0x7fa6fc005de0 comp rx=0 tx=0).stop 2024-03-04T09:14:57.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.006+0000 7fa7147d7640 1 -- 172.21.15.82:0/3205389493 shutdown_connections 2024-03-04T09:14:57.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.006+0000 7fa7147d7640 1 --2- 172.21.15.82:0/3205389493 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fa6f80a1d80 0x7fa6f80a4240 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:57.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.006+0000 7fa7147d7640 1 --2- 172.21.15.82:0/3205389493 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa70c1020a0 0x7fa70c19eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:57.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.006+0000 7fa7147d7640 1 --2- 172.21.15.82:0/3205389493 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa70c1016e0 0x7fa70c197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:57.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.006+0000 7fa7147d7640 1 --2- 172.21.15.82:0/3205389493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa70c1004f0 0x7fa70c197920 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:57.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.006+0000 7fa7147d7640 1 -- 172.21.15.82:0/3205389493 >> 172.21.15.82:0/3205389493 conn(0x7fa70c0fba60 msgr2=0x7fa70c1049e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:57.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.006+0000 7fa7147d7640 1 -- 172.21.15.82:0/3205389493 shutdown_connections 2024-03-04T09:14:57.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.006+0000 7fa7147d7640 1 -- 172.21.15.82:0/3205389493 wait complete. 2024-03-04T09:14:57.014 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T09:08:36.508257+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-04T09:13:07.981726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-04T09:13:09.289799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-04T09:13:13.008516+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-04T09:14:57.015 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-04T09:14:57.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.122+0000 7f7ee8288640 1 -- 172.21.15.82:0/1859982327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ee0102080 msgr2=0x7f7ee0108910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:57.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.122+0000 7f7ee8288640 1 --2- 172.21.15.82:0/1859982327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ee0102080 0x7f7ee0108910 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8009900 tx=0x7f7ed802bc30 comp rx=0 tx=0).stop 2024-03-04T09:14:57.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.122+0000 7f7ee8288640 1 -- 172.21.15.82:0/1859982327 shutdown_connections 2024-03-04T09:14:57.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.122+0000 7f7ee8288640 1 --2- 172.21.15.82:0/1859982327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ee0102080 0x7f7ee0108910 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:57.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.122+0000 7f7ee8288640 1 --2- 172.21.15.82:0/1859982327 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ee01016c0 0x7f7ee0101b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:57.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.122+0000 7f7ee8288640 1 --2- 172.21.15.82:0/1859982327 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ee01004d0 0x7f7ee01008f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:57.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.122+0000 7f7ee8288640 1 -- 172.21.15.82:0/1859982327 >> 172.21.15.82:0/1859982327 conn(0x7f7ee00fba60 msgr2=0x7f7ee00fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:57.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.122+0000 7f7ee8288640 1 -- 172.21.15.82:0/1859982327 shutdown_connections 2024-03-04T09:14:57.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.122+0000 7f7ee8288640 1 -- 172.21.15.82:0/1859982327 wait complete. 2024-03-04T09:14:57.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.123+0000 7f7ee8288640 1 Processor -- start 2024-03-04T09:14:57.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.123+0000 7f7ee8288640 1 -- start start 2024-03-04T09:14:57.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.123+0000 7f7ee8288640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ee01004d0 0x7f7ee01978d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:57.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.123+0000 7f7ee8288640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ee01016c0 0x7f7ee0197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:57.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.123+0000 7f7ee8288640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ee0102080 0x7f7ee019ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:57.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.123+0000 7f7ee8288640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee010d240 con 0x7f7ee01016c0 2024-03-04T09:14:57.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.123+0000 7f7ee8288640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee010d0c0 con 0x7f7ee0102080 2024-03-04T09:14:57.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.123+0000 7f7ee8288640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee010d3c0 con 0x7f7ee01004d0 2024-03-04T09:14:57.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.123+0000 7f7ee5823640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ee01016c0 0x7f7ee0197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:57.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.123+0000 7f7ee6024640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ee01004d0 0x7f7ee01978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:57.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.123+0000 7f7ee5823640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ee01016c0 0x7f7ee0197e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33770/0 (socket says 172.21.15.82:33770) 2024-03-04T09:14:57.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.123+0000 7f7ee5823640 1 -- 172.21.15.82:0/4158109716 learned_addr learned my addr 172.21.15.82:0/4158109716 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:57.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.123+0000 7f7ee6825640 1 --2- 172.21.15.82:0/4158109716 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ee0102080 0x7f7ee019ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:57.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.124+0000 7f7ee5823640 1 -- 172.21.15.82:0/4158109716 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ee01004d0 msgr2=0x7f7ee01978d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:57.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.124+0000 7f7ee5823640 1 --2- 172.21.15.82:0/4158109716 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ee01004d0 0x7f7ee01978d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:57.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.124+0000 7f7ee5823640 1 -- 172.21.15.82:0/4158109716 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ee0102080 msgr2=0x7f7ee019ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:57.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.124+0000 7f7ee5823640 1 --2- 172.21.15.82:0/4158109716 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ee0102080 0x7f7ee019ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:57.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.124+0000 7f7ee5823640 1 -- 172.21.15.82:0/4158109716 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee019f4f0 con 0x7f7ee01016c0 2024-03-04T09:14:57.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.124+0000 7f7ee5823640 1 --2- 172.21.15.82:0/4158109716 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ee01016c0 0x7f7ee0197e10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7ed400ea60 tx=0x7f7ed400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:57.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.124+0000 7f7edf7fe640 1 -- 172.21.15.82:0/4158109716 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed400cde0 con 0x7f7ee01016c0 2024-03-04T09:14:57.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.124+0000 7f7ee8288640 1 -- 172.21.15.82:0/4158109716 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ee019f7e0 con 0x7f7ee01016c0 2024-03-04T09:14:57.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.124+0000 7f7edf7fe640 1 -- 172.21.15.82:0/4158109716 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f7ed40035f0 con 0x7f7ee01016c0 2024-03-04T09:14:57.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.124+0000 7f7ee8288640 1 -- 172.21.15.82:0/4158109716 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ee019fd80 con 0x7f7ee01016c0 2024-03-04T09:14:57.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.124+0000 7f7edf7fe640 1 -- 172.21.15.82:0/4158109716 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed4005220 con 0x7f7ee01016c0 2024-03-04T09:14:57.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.125+0000 7f7ee8288640 1 -- 172.21.15.82:0/4158109716 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ee0107890 con 0x7f7ee01016c0 2024-03-04T09:14:57.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.127+0000 7f7edf7fe640 1 -- 172.21.15.82:0/4158109716 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f7ed40037a0 con 0x7f7ee01016c0 2024-03-04T09:14:57.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.127+0000 7f7edf7fe640 1 --2- 172.21.15.82:0/4158109716 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f7ec80a1d80 0x7f7ec80a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:57.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.127+0000 7f7ee6024640 1 --2- 172.21.15.82:0/4158109716 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f7ec80a1d80 0x7f7ec80a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:57.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.127+0000 7f7edf7fe640 1 -- 172.21.15.82:0/4158109716 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9092+0+0 (secure 0 0 0) 0x7f7ed40ce7a0 con 0x7f7ee01016c0 2024-03-04T09:14:57.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.128+0000 7f7ee6024640 1 --2- 172.21.15.82:0/4158109716 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f7ec80a1d80 0x7f7ec80a4240 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7ee0101520 tx=0x7f7ed0009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:57.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.131+0000 7f7edf7fe640 1 -- 172.21.15.82:0/4158109716 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f7ed409b870 con 0x7f7ee01016c0 2024-03-04T09:14:57.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.304+0000 7f7ee8288640 1 -- 172.21.15.82:0/4158109716 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7ee002d180 con 0x7f7ee01016c0 2024-03-04T09:14:57.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.304+0000 7f7edf7fe640 1 -- 172.21.15.82:0/4158109716 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7ed409b170 con 0x7f7ee01016c0 2024-03-04T09:14:57.301 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-03-04T09:14:57.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.306+0000 7f7ee8288640 1 -- 172.21.15.82:0/4158109716 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f7ec80a1d80 msgr2=0x7f7ec80a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:57.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.306+0000 7f7ee8288640 1 --2- 172.21.15.82:0/4158109716 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f7ec80a1d80 0x7f7ec80a4240 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7ee0101520 tx=0x7f7ed0009500 comp rx=0 tx=0).stop 2024-03-04T09:14:57.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.306+0000 7f7ee8288640 1 -- 172.21.15.82:0/4158109716 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ee01016c0 msgr2=0x7f7ee0197e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:57.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.306+0000 7f7ee8288640 1 --2- 172.21.15.82:0/4158109716 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ee01016c0 0x7f7ee0197e10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7ed400ea60 tx=0x7f7ed400ef20 comp rx=0 tx=0).stop 2024-03-04T09:14:57.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.307+0000 7f7ee8288640 1 -- 172.21.15.82:0/4158109716 shutdown_connections 2024-03-04T09:14:57.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.307+0000 7f7ee8288640 1 --2- 172.21.15.82:0/4158109716 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f7ec80a1d80 0x7f7ec80a4240 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:57.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.307+0000 7f7ee8288640 1 --2- 172.21.15.82:0/4158109716 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ee0102080 0x7f7ee019ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:57.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.307+0000 7f7ee8288640 1 --2- 172.21.15.82:0/4158109716 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ee01016c0 0x7f7ee0197e10 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:57.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.307+0000 7f7ee8288640 1 --2- 172.21.15.82:0/4158109716 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ee01004d0 0x7f7ee01978d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:57.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.307+0000 7f7ee8288640 1 -- 172.21.15.82:0/4158109716 >> 172.21.15.82:0/4158109716 conn(0x7f7ee00fba60 msgr2=0x7f7ee0104a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:57.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.307+0000 7f7ee8288640 1 -- 172.21.15.82:0/4158109716 shutdown_connections 2024-03-04T09:14:57.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.307+0000 7f7ee8288640 1 -- 172.21.15.82:0/4158109716 wait complete. 2024-03-04T09:14:57.314 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-04T09:14:57.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.423+0000 7f350bee0640 1 -- 172.21.15.82:0/2571103915 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35041016e0 msgr2=0x7f3504101b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:57.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.423+0000 7f350bee0640 1 --2- 172.21.15.82:0/2571103915 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35041016e0 0x7f3504101b60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f34f4009860 tx=0x7f34f402bb70 comp rx=0 tx=0).stop 2024-03-04T09:14:57.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.423+0000 7f350bee0640 1 -- 172.21.15.82:0/2571103915 shutdown_connections 2024-03-04T09:14:57.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.423+0000 7f350bee0640 1 --2- 172.21.15.82:0/2571103915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35041020a0 0x7f3504108930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:57.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.423+0000 7f350bee0640 1 --2- 172.21.15.82:0/2571103915 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35041016e0 0x7f3504101b60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:57.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.423+0000 7f350bee0640 1 --2- 172.21.15.82:0/2571103915 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35041004f0 0x7f3504100910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:57.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.423+0000 7f350bee0640 1 -- 172.21.15.82:0/2571103915 >> 172.21.15.82:0/2571103915 conn(0x7f35040fba80 msgr2=0x7f35040fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:57.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.423+0000 7f350bee0640 1 -- 172.21.15.82:0/2571103915 shutdown_connections 2024-03-04T09:14:57.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.423+0000 7f350bee0640 1 -- 172.21.15.82:0/2571103915 wait complete. 2024-03-04T09:14:57.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.424+0000 7f350bee0640 1 Processor -- start 2024-03-04T09:14:57.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.424+0000 7f350bee0640 1 -- start start 2024-03-04T09:14:57.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.424+0000 7f350bee0640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35041004f0 0x7f3504197930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:57.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.424+0000 7f350bee0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35041016e0 0x7f3504197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:57.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.424+0000 7f350bee0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35041020a0 0x7f350419eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:57.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.424+0000 7f350bee0640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f350410c100 con 0x7f35041016e0 2024-03-04T09:14:57.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.424+0000 7f350bee0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f350410bf80 con 0x7f35041020a0 2024-03-04T09:14:57.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.424+0000 7f350bee0640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f350410c280 con 0x7f35041004f0 2024-03-04T09:14:57.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.424+0000 7f350947b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35041016e0 0x7f3504197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:57.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.424+0000 7f350947b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35041016e0 0x7f3504197e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33784/0 (socket says 172.21.15.82:33784) 2024-03-04T09:14:57.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.424+0000 7f350947b640 1 -- 172.21.15.82:0/3391468703 learned_addr learned my addr 172.21.15.82:0/3391468703 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:57.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.424+0000 7f3509c7c640 1 --2- 172.21.15.82:0/3391468703 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35041004f0 0x7f3504197930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:57.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.424+0000 7f350a47d640 1 --2- 172.21.15.82:0/3391468703 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35041020a0 0x7f350419eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:57.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.424+0000 7f350947b640 1 -- 172.21.15.82:0/3391468703 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35041004f0 msgr2=0x7f3504197930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:57.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.424+0000 7f350947b640 1 --2- 172.21.15.82:0/3391468703 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35041004f0 0x7f3504197930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:57.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.424+0000 7f350947b640 1 -- 172.21.15.82:0/3391468703 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35041020a0 msgr2=0x7f350419eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:57.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.424+0000 7f350947b640 1 --2- 172.21.15.82:0/3391468703 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35041020a0 0x7f350419eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:57.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.424+0000 7f350947b640 1 -- 172.21.15.82:0/3391468703 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f350419f550 con 0x7f35041016e0 2024-03-04T09:14:57.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.424+0000 7f350947b640 1 --2- 172.21.15.82:0/3391468703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35041016e0 0x7f3504197e70 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f34f4009980 tx=0x7f34f4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:57.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.425+0000 7f34faffd640 1 -- 172.21.15.82:0/3391468703 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f4039050 con 0x7f35041016e0 2024-03-04T09:14:57.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.425+0000 7f350bee0640 1 -- 172.21.15.82:0/3391468703 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f350419f7e0 con 0x7f35041016e0 2024-03-04T09:14:57.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.425+0000 7f34faffd640 1 -- 172.21.15.82:0/3391468703 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f34f4045070 con 0x7f35041016e0 2024-03-04T09:14:57.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.425+0000 7f350bee0640 1 -- 172.21.15.82:0/3391468703 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f350419fd20 con 0x7f35041016e0 2024-03-04T09:14:57.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.425+0000 7f34faffd640 1 -- 172.21.15.82:0/3391468703 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f4040650 con 0x7f35041016e0 2024-03-04T09:14:57.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.426+0000 7f350bee0640 1 -- 172.21.15.82:0/3391468703 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f350419ff80 con 0x7f35041016e0 2024-03-04T09:14:57.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.427+0000 7f34faffd640 1 -- 172.21.15.82:0/3391468703 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f34f4003880 con 0x7f35041016e0 2024-03-04T09:14:57.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.427+0000 7f34faffd640 1 --2- 172.21.15.82:0/3391468703 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f34f00a1d80 0x7f34f00a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:57.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.427+0000 7f3509c7c640 1 --2- 172.21.15.82:0/3391468703 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f34f00a1d80 0x7f34f00a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:57.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.428+0000 7f34faffd640 1 -- 172.21.15.82:0/3391468703 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9092+0+0 (secure 0 0 0) 0x7f34f40f0180 con 0x7f35041016e0 2024-03-04T09:14:57.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.428+0000 7f3509c7c640 1 --2- 172.21.15.82:0/3391468703 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f34f00a1d80 0x7f34f00a4240 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3504101540 tx=0x7f3500005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:57.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.432+0000 7f34faffd640 1 -- 172.21.15.82:0/3391468703 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f34f40bd250 con 0x7f35041016e0 2024-03-04T09:14:57.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:57 smithi082 ceph-mon[32880]: pgmap v344: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 10 op/s 2024-03-04T09:14:57.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:57 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/3578306693' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-04T09:14:57.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:57 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/70253065' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:14:57.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:57 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/3205389493' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:14:57.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:57 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/4158109716' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-04T09:14:57.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.605+0000 7f350bee0640 1 -- 172.21.15.82:0/3391468703 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f35041a0150 con 0x7f35041016e0 2024-03-04T09:14:57.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.606+0000 7f34faffd640 1 -- 172.21.15.82:0/3391468703 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v92) v1 ==== 104+0+11 (secure 0 0 0) 0x7f34f40bcb50 con 0x7f35041016e0 2024-03-04T09:14:57.603 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-03-04T09:14:57.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.608+0000 7f350bee0640 1 -- 172.21.15.82:0/3391468703 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f34f00a1d80 msgr2=0x7f34f00a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:57.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.608+0000 7f350bee0640 1 --2- 172.21.15.82:0/3391468703 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f34f00a1d80 0x7f34f00a4240 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3504101540 tx=0x7f3500005f90 comp rx=0 tx=0).stop 2024-03-04T09:14:57.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.608+0000 7f350bee0640 1 -- 172.21.15.82:0/3391468703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35041016e0 msgr2=0x7f3504197e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:57.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.608+0000 7f350bee0640 1 --2- 172.21.15.82:0/3391468703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35041016e0 0x7f3504197e70 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f34f4009980 tx=0x7f34f4004270 comp rx=0 tx=0).stop 2024-03-04T09:14:57.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.608+0000 7f350bee0640 1 -- 172.21.15.82:0/3391468703 shutdown_connections 2024-03-04T09:14:57.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.608+0000 7f350bee0640 1 --2- 172.21.15.82:0/3391468703 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f34f00a1d80 0x7f34f00a4240 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:57.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.608+0000 7f350bee0640 1 --2- 172.21.15.82:0/3391468703 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35041020a0 0x7f350419eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:57.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.608+0000 7f350bee0640 1 --2- 172.21.15.82:0/3391468703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35041016e0 0x7f3504197e70 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:57.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.608+0000 7f350bee0640 1 --2- 172.21.15.82:0/3391468703 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35041004f0 0x7f3504197930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:57.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.608+0000 7f350bee0640 1 -- 172.21.15.82:0/3391468703 >> 172.21.15.82:0/3391468703 conn(0x7f35040fba80 msgr2=0x7f3504069b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:57.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.608+0000 7f350bee0640 1 -- 172.21.15.82:0/3391468703 shutdown_connections 2024-03-04T09:14:57.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.608+0000 7f350bee0640 1 -- 172.21.15.82:0/3391468703 wait complete. 2024-03-04T09:14:57.616 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-04T09:14:57.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:57 smithi190 ceph-mon[36341]: pgmap v344: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 10 op/s 2024-03-04T09:14:57.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:57 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/3578306693' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-04T09:14:57.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:57 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/70253065' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:14:57.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:57 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/3205389493' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:14:57.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:57 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/4158109716' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-04T09:14:57.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:57 smithi102 ceph-mon[36220]: pgmap v344: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 10 op/s 2024-03-04T09:14:57.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:57 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/3578306693' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-04T09:14:57.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:57 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/70253065' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:14:57.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:57 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/3205389493' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:14:57.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:57 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/4158109716' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-04T09:14:57.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.724+0000 7fadabf5e640 1 -- 172.21.15.82:0/2067983230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fada41072d0 msgr2=0x7fada4109720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:57.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.724+0000 7fadabf5e640 1 --2- 172.21.15.82:0/2067983230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fada41072d0 0x7fada4109720 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fad9c009ca0 tx=0x7fad9c02c0f0 comp rx=0 tx=0).stop 2024-03-04T09:14:57.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.724+0000 7fadabf5e640 1 -- 172.21.15.82:0/2067983230 shutdown_connections 2024-03-04T09:14:57.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.724+0000 7fadabf5e640 1 --2- 172.21.15.82:0/2067983230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fada41072d0 0x7fada4109720 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:57.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.724+0000 7fadabf5e640 1 --2- 172.21.15.82:0/2067983230 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fada41049a0 0x7fada4106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:57.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.724+0000 7fadabf5e640 1 --2- 172.21.15.82:0/2067983230 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fada4102070 0x7fada4104460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:57.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.724+0000 7fadabf5e640 1 -- 172.21.15.82:0/2067983230 >> 172.21.15.82:0/2067983230 conn(0x7fada40fba80 msgr2=0x7fada40fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:57.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.724+0000 7fadabf5e640 1 -- 172.21.15.82:0/2067983230 shutdown_connections 2024-03-04T09:14:57.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.724+0000 7fadabf5e640 1 -- 172.21.15.82:0/2067983230 wait complete. 2024-03-04T09:14:57.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.725+0000 7fadabf5e640 1 Processor -- start 2024-03-04T09:14:57.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.725+0000 7fadabf5e640 1 -- start start 2024-03-04T09:14:57.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.725+0000 7fadabf5e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fada4102070 0x7fada4197890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:57.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.725+0000 7fadabf5e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fada41049a0 0x7fada4197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:57.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.725+0000 7fadabf5e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fada41072d0 0x7fada419ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:57.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.725+0000 7fadabf5e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada410d250 con 0x7fada4102070 2024-03-04T09:14:57.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.725+0000 7fadabf5e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada410d0d0 con 0x7fada41072d0 2024-03-04T09:14:57.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.725+0000 7fadabf5e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada410d3d0 con 0x7fada41049a0 2024-03-04T09:14:57.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.725+0000 7fada9cfa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fada4102070 0x7fada4197890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:57.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.725+0000 7fada9cfa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fada4102070 0x7fada4197890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33810/0 (socket says 172.21.15.82:33810) 2024-03-04T09:14:57.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.725+0000 7fada9cfa640 1 -- 172.21.15.82:0/996423128 learned_addr learned my addr 172.21.15.82:0/996423128 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:57.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.725+0000 7fada94f9640 1 --2- 172.21.15.82:0/996423128 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fada41049a0 0x7fada4197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:57.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.725+0000 7fadaa4fb640 1 --2- 172.21.15.82:0/996423128 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fada41072d0 0x7fada419ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:57.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.725+0000 7fada9cfa640 1 -- 172.21.15.82:0/996423128 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fada41049a0 msgr2=0x7fada4197dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:57.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.725+0000 7fada9cfa640 1 --2- 172.21.15.82:0/996423128 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fada41049a0 0x7fada4197dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:57.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.725+0000 7fada9cfa640 1 -- 172.21.15.82:0/996423128 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fada41072d0 msgr2=0x7fada419ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:57.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.725+0000 7fada9cfa640 1 --2- 172.21.15.82:0/996423128 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fada41072d0 0x7fada419ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:57.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.725+0000 7fada9cfa640 1 -- 172.21.15.82:0/996423128 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada419f4b0 con 0x7fada4102070 2024-03-04T09:14:57.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.725+0000 7fada9cfa640 1 --2- 172.21.15.82:0/996423128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fada4102070 0x7fada4197890 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fada000ea60 tx=0x7fada000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:57.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.725+0000 7fad9affd640 1 -- 172.21.15.82:0/996423128 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada000cde0 con 0x7fada4102070 2024-03-04T09:14:57.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.726+0000 7fadabf5e640 1 -- 172.21.15.82:0/996423128 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fada419f7a0 con 0x7fada4102070 2024-03-04T09:14:57.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.726+0000 7fad9affd640 1 -- 172.21.15.82:0/996423128 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fada00035f0 con 0x7fada4102070 2024-03-04T09:14:57.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.726+0000 7fad9affd640 1 -- 172.21.15.82:0/996423128 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada0010690 con 0x7fada4102070 2024-03-04T09:14:57.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.726+0000 7fadabf5e640 1 -- 172.21.15.82:0/996423128 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fada419fcf0 con 0x7fada4102070 2024-03-04T09:14:57.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.727+0000 7fadabf5e640 1 -- 172.21.15.82:0/996423128 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fada40fd570 con 0x7fada4102070 2024-03-04T09:14:57.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.728+0000 7fad9affd640 1 -- 172.21.15.82:0/996423128 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 136756+0+0 (secure 0 0 0) 0x7fada00037a0 con 0x7fada4102070 2024-03-04T09:14:57.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.729+0000 7fad9affd640 1 --2- 172.21.15.82:0/996423128 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fad900a1d80 0x7fad900a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:57.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.729+0000 7fada94f9640 1 --2- 172.21.15.82:0/996423128 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fad900a1d80 0x7fad900a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:57.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.729+0000 7fad9affd640 1 -- 172.21.15.82:0/996423128 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9092+0+0 (secure 0 0 0) 0x7fada00ce4d0 con 0x7fada4102070 2024-03-04T09:14:57.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.729+0000 7fada94f9640 1 --2- 172.21.15.82:0/996423128 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fad900a1d80 0x7fad900a4240 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fada4198da0 tx=0x7fad94005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:57.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.732+0000 7fad9affd640 1 -- 172.21.15.82:0/996423128 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fada009b630 con 0x7fada4102070 2024-03-04T09:14:57.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.906+0000 7fadabf5e640 1 -- 172.21.15.82:0/996423128 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fada40621d0 con 0x7fada4102070 2024-03-04T09:14:57.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.906+0000 7fad9affd640 1 -- 172.21.15.82:0/996423128 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v92) v1 ==== 100+0+11 (secure 0 0 0) 0x7fada009af30 con 0x7fada4102070 2024-03-04T09:14:57.903 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2024-03-04T09:14:57.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.908+0000 7fadabf5e640 1 -- 172.21.15.82:0/996423128 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fad900a1d80 msgr2=0x7fad900a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:57.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.908+0000 7fadabf5e640 1 --2- 172.21.15.82:0/996423128 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fad900a1d80 0x7fad900a4240 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fada4198da0 tx=0x7fad94005f90 comp rx=0 tx=0).stop 2024-03-04T09:14:57.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.908+0000 7fadabf5e640 1 -- 172.21.15.82:0/996423128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fada4102070 msgr2=0x7fada4197890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:57.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.908+0000 7fadabf5e640 1 --2- 172.21.15.82:0/996423128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fada4102070 0x7fada4197890 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fada000ea60 tx=0x7fada000ef20 comp rx=0 tx=0).stop 2024-03-04T09:14:57.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.908+0000 7fadabf5e640 1 -- 172.21.15.82:0/996423128 shutdown_connections 2024-03-04T09:14:57.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.908+0000 7fadabf5e640 1 --2- 172.21.15.82:0/996423128 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fad900a1d80 0x7fad900a4240 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:57.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.908+0000 7fadabf5e640 1 --2- 172.21.15.82:0/996423128 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fada41072d0 0x7fada419ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:57.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.908+0000 7fadabf5e640 1 --2- 172.21.15.82:0/996423128 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fada41049a0 0x7fada4197dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:57.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.908+0000 7fadabf5e640 1 --2- 172.21.15.82:0/996423128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fada4102070 0x7fada4197890 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:57.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.908+0000 7fadabf5e640 1 -- 172.21.15.82:0/996423128 >> 172.21.15.82:0/996423128 conn(0x7fada40fba80 msgr2=0x7fada4102930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:57.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.909+0000 7fadabf5e640 1 -- 172.21.15.82:0/996423128 shutdown_connections 2024-03-04T09:14:57.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:57.909+0000 7fadabf5e640 1 -- 172.21.15.82:0/996423128 wait complete. 2024-03-04T09:14:57.916 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-04T09:14:58.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.025+0000 7f869af0c640 1 -- 172.21.15.82:0/2457245132 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8694101600 msgr2=0x7f8694101a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:58.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.025+0000 7f869af0c640 1 --2- 172.21.15.82:0/2457245132 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8694101600 0x7f8694101a20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8688009900 tx=0x7f868802bc30 comp rx=0 tx=0).stop 2024-03-04T09:14:58.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.025+0000 7f869af0c640 1 -- 172.21.15.82:0/2457245132 shutdown_connections 2024-03-04T09:14:58.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.025+0000 7f869af0c640 1 --2- 172.21.15.82:0/2457245132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86941031b0 0x7f8694109a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:58.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.025+0000 7f869af0c640 1 --2- 172.21.15.82:0/2457245132 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86941027f0 0x7f8694102c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:58.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.025+0000 7f869af0c640 1 --2- 172.21.15.82:0/2457245132 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8694101600 0x7f8694101a20 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:58.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.025+0000 7f869af0c640 1 -- 172.21.15.82:0/2457245132 >> 172.21.15.82:0/2457245132 conn(0x7f86940fcb70 msgr2=0x7f86940fefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:58.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.025+0000 7f869af0c640 1 -- 172.21.15.82:0/2457245132 shutdown_connections 2024-03-04T09:14:58.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.025+0000 7f869af0c640 1 -- 172.21.15.82:0/2457245132 wait complete. 2024-03-04T09:14:58.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.025+0000 7f869af0c640 1 Processor -- start 2024-03-04T09:14:58.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.025+0000 7f869af0c640 1 -- start start 2024-03-04T09:14:58.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.025+0000 7f869af0c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8694101600 0x7f8694197930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:58.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.025+0000 7f869af0c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86941027f0 0x7f8694197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:58.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.025+0000 7f869af0c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86941031b0 0x7f869419eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:58.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.025+0000 7f869af0c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f869410d260 con 0x7f86941027f0 2024-03-04T09:14:58.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.025+0000 7f869af0c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f869410d0e0 con 0x7f86941031b0 2024-03-04T09:14:58.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.025+0000 7f869af0c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f869410d3e0 con 0x7f8694101600 2024-03-04T09:14:58.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.025+0000 7f8693fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86941027f0 0x7f8694197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:58.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.025+0000 7f8693fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86941027f0 0x7f8694197e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33838/0 (socket says 172.21.15.82:33838) 2024-03-04T09:14:58.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.025+0000 7f8693fff640 1 -- 172.21.15.82:0/880942860 learned_addr learned my addr 172.21.15.82:0/880942860 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:58.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.025+0000 7f8698ca8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8694101600 0x7f8694197930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:58.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.026+0000 7f86994a9640 1 --2- 172.21.15.82:0/880942860 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86941031b0 0x7f869419eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:58.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.026+0000 7f8693fff640 1 -- 172.21.15.82:0/880942860 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8694101600 msgr2=0x7f8694197930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:58.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.026+0000 7f8693fff640 1 --2- 172.21.15.82:0/880942860 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8694101600 0x7f8694197930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:58.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.026+0000 7f8693fff640 1 -- 172.21.15.82:0/880942860 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86941031b0 msgr2=0x7f869419eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:58.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.026+0000 7f8693fff640 1 --2- 172.21.15.82:0/880942860 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86941031b0 0x7f869419eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:58.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.026+0000 7f8693fff640 1 -- 172.21.15.82:0/880942860 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f869419f550 con 0x7f86941027f0 2024-03-04T09:14:58.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.026+0000 7f8693fff640 1 --2- 172.21.15.82:0/880942860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86941027f0 0x7f8694197e70 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f868000e9f0 tx=0x7f868000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:58.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.026+0000 7f8691ffb640 1 -- 172.21.15.82:0/880942860 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868000cd80 con 0x7f86941027f0 2024-03-04T09:14:58.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.026+0000 7f869af0c640 1 -- 172.21.15.82:0/880942860 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f869419f840 con 0x7f86941027f0 2024-03-04T09:14:58.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.026+0000 7f8691ffb640 1 -- 172.21.15.82:0/880942860 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f86800054f0 con 0x7f86941027f0 2024-03-04T09:14:58.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.026+0000 7f8691ffb640 1 -- 172.21.15.82:0/880942860 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8680010690 con 0x7f86941027f0 2024-03-04T09:14:58.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.026+0000 7f869af0c640 1 -- 172.21.15.82:0/880942860 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f869419fd90 con 0x7f86941027f0 2024-03-04T09:14:58.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.027+0000 7f869af0c640 1 -- 172.21.15.82:0/880942860 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86941089c0 con 0x7f86941027f0 2024-03-04T09:14:58.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.028+0000 7f8691ffb640 1 -- 172.21.15.82:0/880942860 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f8680004f20 con 0x7f86941027f0 2024-03-04T09:14:58.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.029+0000 7f8691ffb640 1 --2- 172.21.15.82:0/880942860 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f86840a1d80 0x7f86840a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:58.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.029+0000 7f8698ca8640 1 --2- 172.21.15.82:0/880942860 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f86840a1d80 0x7f86840a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:58.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.029+0000 7f8691ffb640 1 -- 172.21.15.82:0/880942860 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9092+0+0 (secure 0 0 0) 0x7f86800ce4f0 con 0x7f86941027f0 2024-03-04T09:14:58.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.029+0000 7f8698ca8640 1 --2- 172.21.15.82:0/880942860 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f86840a1d80 0x7f86840a4240 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8688000c00 tx=0x7f8688005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:58.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.033+0000 7f8691ffb640 1 -- 172.21.15.82:0/880942860 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f868009b5c0 con 0x7f86941027f0 2024-03-04T09:14:58.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.207+0000 7f869af0c640 1 -- 172.21.15.82:0/880942860 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f86940621d0 con 0x7f86941027f0 2024-03-04T09:14:58.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.208+0000 7f8691ffb640 1 -- 172.21.15.82:0/880942860 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v92) v1 ==== 103+0+11 (secure 0 0 0) 0x7f868009aec0 con 0x7f86941027f0 2024-03-04T09:14:58.205 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-03-04T09:14:58.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.210+0000 7f869af0c640 1 -- 172.21.15.82:0/880942860 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f86840a1d80 msgr2=0x7f86840a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:58.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.210+0000 7f869af0c640 1 --2- 172.21.15.82:0/880942860 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f86840a1d80 0x7f86840a4240 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8688000c00 tx=0x7f8688005fd0 comp rx=0 tx=0).stop 2024-03-04T09:14:58.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.210+0000 7f869af0c640 1 -- 172.21.15.82:0/880942860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86941027f0 msgr2=0x7f8694197e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:58.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.210+0000 7f869af0c640 1 --2- 172.21.15.82:0/880942860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86941027f0 0x7f8694197e70 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f868000e9f0 tx=0x7f868000edf0 comp rx=0 tx=0).stop 2024-03-04T09:14:58.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.210+0000 7f869af0c640 1 -- 172.21.15.82:0/880942860 shutdown_connections 2024-03-04T09:14:58.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.210+0000 7f869af0c640 1 --2- 172.21.15.82:0/880942860 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f86840a1d80 0x7f86840a4240 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:58.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.210+0000 7f869af0c640 1 --2- 172.21.15.82:0/880942860 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86941031b0 0x7f869419eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:58.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.210+0000 7f869af0c640 1 --2- 172.21.15.82:0/880942860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86941027f0 0x7f8694197e70 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:58.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.210+0000 7f869af0c640 1 --2- 172.21.15.82:0/880942860 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8694101600 0x7f8694197930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:58.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.210+0000 7f869af0c640 1 -- 172.21.15.82:0/880942860 >> 172.21.15.82:0/880942860 conn(0x7f86940fcb70 msgr2=0x7f8694105b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:58.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.210+0000 7f869af0c640 1 -- 172.21.15.82:0/880942860 shutdown_connections 2024-03-04T09:14:58.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.210+0000 7f869af0c640 1 -- 172.21.15.82:0/880942860 wait complete. 2024-03-04T09:14:58.218 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T09:14:58.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.323+0000 7f6188519640 1 -- 172.21.15.82:0/1318474151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61801004f0 msgr2=0x7f6180100910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:58.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.323+0000 7f6188519640 1 --2- 172.21.15.82:0/1318474151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61801004f0 0x7f6180100910 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f617c009900 tx=0x7f617c02bc30 comp rx=0 tx=0).stop 2024-03-04T09:14:58.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.324+0000 7f6188519640 1 -- 172.21.15.82:0/1318474151 shutdown_connections 2024-03-04T09:14:58.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.324+0000 7f6188519640 1 --2- 172.21.15.82:0/1318474151 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f61801020a0 0x7f6180108930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:58.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.324+0000 7f6188519640 1 --2- 172.21.15.82:0/1318474151 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61801016e0 0x7f6180101b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:58.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.324+0000 7f6188519640 1 --2- 172.21.15.82:0/1318474151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61801004f0 0x7f6180100910 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:58.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.324+0000 7f6188519640 1 -- 172.21.15.82:0/1318474151 >> 172.21.15.82:0/1318474151 conn(0x7f61800fba60 msgr2=0x7f61800fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:58.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.324+0000 7f6188519640 1 -- 172.21.15.82:0/1318474151 shutdown_connections 2024-03-04T09:14:58.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.324+0000 7f6188519640 1 -- 172.21.15.82:0/1318474151 wait complete. 2024-03-04T09:14:58.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.324+0000 7f6188519640 1 Processor -- start 2024-03-04T09:14:58.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.324+0000 7f6188519640 1 -- start start 2024-03-04T09:14:58.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.324+0000 7f6188519640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61801004f0 0x7f6180197900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:58.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.324+0000 7f6188519640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61801016e0 0x7f6180197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:58.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.324+0000 7f6188519640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f61801020a0 0x7f618019eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:58.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.324+0000 7f6188519640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f618010d260 con 0x7f61801004f0 2024-03-04T09:14:58.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.324+0000 7f6188519640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f618010d0e0 con 0x7f61801016e0 2024-03-04T09:14:58.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.324+0000 7f6188519640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f618010d3e0 con 0x7f61801020a0 2024-03-04T09:14:58.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.324+0000 7f61862b5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61801004f0 0x7f6180197900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:58.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.324+0000 7f61862b5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61801004f0 0x7f6180197900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33858/0 (socket says 172.21.15.82:33858) 2024-03-04T09:14:58.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.324+0000 7f61862b5640 1 -- 172.21.15.82:0/3650621009 learned_addr learned my addr 172.21.15.82:0/3650621009 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:58.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.324+0000 7f6185ab4640 1 --2- 172.21.15.82:0/3650621009 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61801016e0 0x7f6180197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:58.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.324+0000 7f6186ab6640 1 --2- 172.21.15.82:0/3650621009 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f61801020a0 0x7f618019eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:58.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.325+0000 7f61862b5640 1 -- 172.21.15.82:0/3650621009 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f61801020a0 msgr2=0x7f618019eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:58.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.325+0000 7f61862b5640 1 --2- 172.21.15.82:0/3650621009 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f61801020a0 0x7f618019eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:58.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.325+0000 7f61862b5640 1 -- 172.21.15.82:0/3650621009 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61801016e0 msgr2=0x7f6180197e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:58.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.325+0000 7f61862b5640 1 --2- 172.21.15.82:0/3650621009 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61801016e0 0x7f6180197e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:58.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.325+0000 7f61862b5640 1 -- 172.21.15.82:0/3650621009 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f618019f520 con 0x7f61801004f0 2024-03-04T09:14:58.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.325+0000 7f61862b5640 1 --2- 172.21.15.82:0/3650621009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61801004f0 0x7f6180197900 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f617c005ab0 tx=0x7f617c005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:58.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.325+0000 7f61737fe640 1 -- 172.21.15.82:0/3650621009 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617c043020 con 0x7f61801004f0 2024-03-04T09:14:58.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.325+0000 7f61737fe640 1 -- 172.21.15.82:0/3650621009 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f617c0054b0 con 0x7f61801004f0 2024-03-04T09:14:58.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.325+0000 7f6188519640 1 -- 172.21.15.82:0/3650621009 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f618019f7b0 con 0x7f61801004f0 2024-03-04T09:14:58.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.325+0000 7f61737fe640 1 -- 172.21.15.82:0/3650621009 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617c003bb0 con 0x7f61801004f0 2024-03-04T09:14:58.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.325+0000 7f6188519640 1 -- 172.21.15.82:0/3650621009 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f618019fd00 con 0x7f61801004f0 2024-03-04T09:14:58.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.326+0000 7f6188519640 1 -- 172.21.15.82:0/3650621009 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6180107810 con 0x7f61801004f0 2024-03-04T09:14:58.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.327+0000 7f61737fe640 1 -- 172.21.15.82:0/3650621009 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f617c046020 con 0x7f61801004f0 2024-03-04T09:14:58.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.328+0000 7f61737fe640 1 --2- 172.21.15.82:0/3650621009 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f616c0a1d80 0x7f616c0a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:58.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.328+0000 7f6185ab4640 1 --2- 172.21.15.82:0/3650621009 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f616c0a1d80 0x7f616c0a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:58.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.328+0000 7f61737fe640 1 -- 172.21.15.82:0/3650621009 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9092+0+0 (secure 0 0 0) 0x7f617c0f0450 con 0x7f61801004f0 2024-03-04T09:14:58.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.328+0000 7f6185ab4640 1 --2- 172.21.15.82:0/3650621009 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f616c0a1d80 0x7f616c0a4240 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6180198e10 tx=0x7f6174005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:58.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.331+0000 7f61737fe640 1 -- 172.21.15.82:0/3650621009 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f617c0bd520 con 0x7f61801004f0 2024-03-04T09:14:58.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.544+0000 7f6188519640 1 -- 172.21.15.82:0/3650621009 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f618002cff0 con 0x7f61801004f0 2024-03-04T09:14:58.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.545+0000 7f61737fe640 1 -- 172.21.15.82:0/3650621009 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11462 (secure 0 0 0) 0x7f617c0bce20 con 0x7f61801004f0 2024-03-04T09:14:58.542 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:14:58.542 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3123844705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3123844705},{"type":"v1","addr":"172.21.15.82:6835","nonce":3123844705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2620634252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2620634252},{"type":"v1","addr":"172.21.15.82:6837","nonce":2620634252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-04T09:13:10.076732+0000","modified":"2024-03-04T09:13:38.017758+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24476,"mds_1":24469,"mds_2":24451,"mds_3":24449,"mds_4":24439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14613":{"gid":14613,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/1240838024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1240838024},{"type":"v1","addr":"172.21.15.82:6839","nonce":1240838024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14625":{"gid":14625,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/213594267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":213594267},{"type":"v1","addr":"172.21.15.82:6841","nonce":213594267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24398":{"gid":24398,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/1142302200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":1142302200},{"type":"v1","addr":"172.21.15.102:6833","nonce":1142302200}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24403":{"gid":24403,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6833/3023382814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":3023382814},{"type":"v1","addr":"172.21.15.190:6833","nonce":3023382814}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24422":{"gid":24422,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6835/2134310473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":2134310473},{"type":"v1","addr":"172.21.15.102:6835","nonce":2134310473}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24439":{"gid":24439,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":14,"addr":"172.21.15.190:6835/3183532624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3183532624},{"type":"v1","addr":"172.21.15.190:6835","nonce":3183532624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24449":{"gid":24449,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":12,"addr":"172.21.15.102:6837/1210579527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1210579527},{"type":"v1","addr":"172.21.15.102:6837","nonce":1210579527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24451":{"gid":24451,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.190:6837/1198639527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":1198639527},{"type":"v1","addr":"172.21.15.190:6837","nonce":1198639527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.190:6839/878555510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":878555510},{"type":"v1","addr":"172.21.15.190:6839","nonce":878555510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6839/35424130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":35424130},{"type":"v1","addr":"172.21.15.102:6839","nonce":35424130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24449,24439,24451,24476,24469]},"id":1}]} 2024-03-04T09:14:58.542 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 27 2024-03-04T09:14:58.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.547+0000 7f6188519640 1 -- 172.21.15.82:0/3650621009 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f616c0a1d80 msgr2=0x7f616c0a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:58.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.547+0000 7f6188519640 1 --2- 172.21.15.82:0/3650621009 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f616c0a1d80 0x7f616c0a4240 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6180198e10 tx=0x7f6174005f90 comp rx=0 tx=0).stop 2024-03-04T09:14:58.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.547+0000 7f6188519640 1 -- 172.21.15.82:0/3650621009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61801004f0 msgr2=0x7f6180197900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:58.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.547+0000 7f6188519640 1 --2- 172.21.15.82:0/3650621009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61801004f0 0x7f6180197900 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f617c005ab0 tx=0x7f617c005de0 comp rx=0 tx=0).stop 2024-03-04T09:14:58.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.547+0000 7f6188519640 1 -- 172.21.15.82:0/3650621009 shutdown_connections 2024-03-04T09:14:58.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.547+0000 7f6188519640 1 --2- 172.21.15.82:0/3650621009 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f616c0a1d80 0x7f616c0a4240 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:58.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.547+0000 7f6188519640 1 --2- 172.21.15.82:0/3650621009 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f61801020a0 0x7f618019eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:58.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.547+0000 7f6188519640 1 --2- 172.21.15.82:0/3650621009 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61801016e0 0x7f6180197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:58.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.547+0000 7f6188519640 1 --2- 172.21.15.82:0/3650621009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61801004f0 0x7f6180197900 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:58.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.547+0000 7f6188519640 1 -- 172.21.15.82:0/3650621009 >> 172.21.15.82:0/3650621009 conn(0x7f61800fba60 msgr2=0x7f61801049e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:58.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.547+0000 7f6188519640 1 -- 172.21.15.82:0/3650621009 shutdown_connections 2024-03-04T09:14:58.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.547+0000 7f6188519640 1 -- 172.21.15.82:0/3650621009 wait complete. 2024-03-04T09:14:58.554 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:58 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/3391468703' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-04T09:14:58.554 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:58 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/996423128' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-04T09:14:58.554 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:58 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/880942860' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-04T09:14:58.555 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T09:14:58.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.660+0000 7fbbc5822640 1 -- 172.21.15.82:0/3899556353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbbc01020a0 msgr2=0x7fbbc0108930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:58.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.660+0000 7fbbc5822640 1 --2- 172.21.15.82:0/3899556353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbbc01020a0 0x7fbbc0108930 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fbbb8009ca0 tx=0x7fbbb802c0f0 comp rx=0 tx=0).stop 2024-03-04T09:14:58.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.660+0000 7fbbc5822640 1 -- 172.21.15.82:0/3899556353 shutdown_connections 2024-03-04T09:14:58.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.660+0000 7fbbc5822640 1 --2- 172.21.15.82:0/3899556353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbbc01020a0 0x7fbbc0108930 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:58.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.660+0000 7fbbc5822640 1 --2- 172.21.15.82:0/3899556353 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbbc01016e0 0x7fbbc0101b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:58.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.660+0000 7fbbc5822640 1 --2- 172.21.15.82:0/3899556353 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbbc01004f0 0x7fbbc0100910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:58.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.660+0000 7fbbc5822640 1 -- 172.21.15.82:0/3899556353 >> 172.21.15.82:0/3899556353 conn(0x7fbbc00fba60 msgr2=0x7fbbc00fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:58.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.660+0000 7fbbc5822640 1 -- 172.21.15.82:0/3899556353 shutdown_connections 2024-03-04T09:14:58.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.660+0000 7fbbc5822640 1 -- 172.21.15.82:0/3899556353 wait complete. 2024-03-04T09:14:58.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.661+0000 7fbbc5822640 1 Processor -- start 2024-03-04T09:14:58.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.661+0000 7fbbc5822640 1 -- start start 2024-03-04T09:14:58.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.661+0000 7fbbc5822640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbbc01004f0 0x7fbbc0104550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:58.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.661+0000 7fbbc5822640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbbc01016e0 0x7fbbc0102b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:58.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.661+0000 7fbbc5822640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbbc01020a0 0x7fbbc01030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:58.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.661+0000 7fbbc5822640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc010c150 con 0x7fbbc01004f0 2024-03-04T09:14:58.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.661+0000 7fbbc5822640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc010bfd0 con 0x7fbbc01016e0 2024-03-04T09:14:58.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.661+0000 7fbbc5822640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc010c2d0 con 0x7fbbc01020a0 2024-03-04T09:14:58.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.661+0000 7fbbbeffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbbc01004f0 0x7fbbc0104550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:58.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.661+0000 7fbbbeffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbbc01004f0 0x7fbbc0104550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33866/0 (socket says 172.21.15.82:33866) 2024-03-04T09:14:58.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.661+0000 7fbbbeffd640 1 -- 172.21.15.82:0/1033822579 learned_addr learned my addr 172.21.15.82:0/1033822579 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:58.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.661+0000 7fbbbe7fc640 1 --2- 172.21.15.82:0/1033822579 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbbc01016e0 0x7fbbc0102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:58.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.662+0000 7fbbbf7fe640 1 --2- 172.21.15.82:0/1033822579 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbbc01020a0 0x7fbbc01030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:58.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.662+0000 7fbbbeffd640 1 -- 172.21.15.82:0/1033822579 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbbc01020a0 msgr2=0x7fbbc01030d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:58.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.662+0000 7fbbbeffd640 1 --2- 172.21.15.82:0/1033822579 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbbc01020a0 0x7fbbc01030d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:58.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.662+0000 7fbbbeffd640 1 -- 172.21.15.82:0/1033822579 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbbc01016e0 msgr2=0x7fbbc0102b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:58.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.662+0000 7fbbbeffd640 1 --2- 172.21.15.82:0/1033822579 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbbc01016e0 0x7fbbc0102b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:58.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.662+0000 7fbbbeffd640 1 -- 172.21.15.82:0/1033822579 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc0103960 con 0x7fbbc01004f0 2024-03-04T09:14:58.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.662+0000 7fbbbeffd640 1 --2- 172.21.15.82:0/1033822579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbbc01004f0 0x7fbbc0104550 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fbbb000e9c0 tx=0x7fbbb000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:58.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.662+0000 7fbbc4820640 1 -- 172.21.15.82:0/1033822579 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb000cd80 con 0x7fbbc01004f0 2024-03-04T09:14:58.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.662+0000 7fbbc4820640 1 -- 172.21.15.82:0/1033822579 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fbbb00035f0 con 0x7fbbc01004f0 2024-03-04T09:14:58.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.662+0000 7fbbc5822640 1 -- 172.21.15.82:0/1033822579 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbc01a19f0 con 0x7fbbc01004f0 2024-03-04T09:14:58.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.662+0000 7fbbc4820640 1 -- 172.21.15.82:0/1033822579 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb0010690 con 0x7fbbc01004f0 2024-03-04T09:14:58.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.662+0000 7fbbc5822640 1 -- 172.21.15.82:0/1033822579 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbc01a1ef0 con 0x7fbbc01004f0 2024-03-04T09:14:58.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.663+0000 7fbbc5822640 1 -- 172.21.15.82:0/1033822579 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbc01a2180 con 0x7fbbc01004f0 2024-03-04T09:14:58.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.664+0000 7fbbc4820640 1 -- 172.21.15.82:0/1033822579 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 136756+0+0 (secure 0 0 0) 0x7fbbb00037a0 con 0x7fbbc01004f0 2024-03-04T09:14:58.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.665+0000 7fbbc4820640 1 --2- 172.21.15.82:0/1033822579 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fbbac0a1d80 0x7fbbac0a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:58.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.665+0000 7fbbc4820640 1 -- 172.21.15.82:0/1033822579 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9092+0+0 (secure 0 0 0) 0x7fbbb00ce500 con 0x7fbbc01004f0 2024-03-04T09:14:58.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.665+0000 7fbbbe7fc640 1 --2- 172.21.15.82:0/1033822579 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fbbac0a1d80 0x7fbbac0a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:58.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.665+0000 7fbbbe7fc640 1 --2- 172.21.15.82:0/1033822579 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fbbac0a1d80 0x7fbbac0a4240 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbbc01042c0 tx=0x7fbba8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:58.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.669+0000 7fbbc4820640 1 -- 172.21.15.82:0/1033822579 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fbbb009b5d0 con 0x7fbbc01004f0 2024-03-04T09:14:58.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:58 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/3391468703' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-04T09:14:58.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:58 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/996423128' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-04T09:14:58.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:58 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/880942860' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-04T09:14:58.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:58 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/3391468703' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-04T09:14:58.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:58 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/996423128' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-04T09:14:58.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:58 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/880942860' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-04T09:14:58.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.847+0000 7fbbc5822640 1 -- 172.21.15.82:0/1033822579 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbbc01a2350 con 0x7fbbc01004f0 2024-03-04T09:14:58.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.848+0000 7fbbc4820640 1 -- 172.21.15.82:0/1033822579 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+24563 (secure 0 0 0) 0x7fbbb009aed0 con 0x7fbbc01004f0 2024-03-04T09:14:58.845 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:14:58.845 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":92,"fsid":"2e533fc8-da06-11ee-95c6-87774f69a715","created":"2024-03-04T09:05:16.488249+0000","modified":"2024-03-04T09:14:13.863336+0000","last_up_change":"2024-03-04T09:12:22.308711+0000","last_in_change":"2024-03-04T09:12:02.548212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T09:08:36.508257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T09:13:07.981726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T09:13:09.289799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-04T09:13:13.008516+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"085b5c4b-ede9-4d0d-b994-50c89d991012","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6803","nonce":709655235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6805","nonce":709655235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6809","nonce":709655235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6807","nonce":709655235}]},"public_addr":"172.21.15.82:6803/709655235","cluster_addr":"172.21.15.82:6805/709655235","heartbeat_back_addr":"172.21.15.82:6809/709655235","heartbeat_front_addr":"172.21.15.82:6807/709655235","state":["exists","up"]},{"osd":1,"uuid":"e4dd7079-333e-4bcf-b3af-11fb082a5af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6801","nonce":270721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6803","nonce":270721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6807","nonce":270721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6805","nonce":270721212}]},"public_addr":"172.21.15.102:6801/270721212","cluster_addr":"172.21.15.102:6803/270721212","heartbeat_back_addr":"172.21.15.102:6807/270721212","heartbeat_front_addr":"172.21.15.102:6805/270721212","state":["exists","up"]},{"osd":2,"uuid":"6fed5fd6-dc82-497f-9d69-c10a5e5802da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6801","nonce":946410459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6803","nonce":946410459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6807","nonce":946410459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6805","nonce":946410459}]},"public_addr":"172.21.15.190:6801/946410459","cluster_addr":"172.21.15.190:6803/946410459","heartbeat_back_addr":"172.21.15.190:6807/946410459","heartbeat_front_addr":"172.21.15.190:6805/946410459","state":["exists","up"]},{"osd":3,"uuid":"91ccbdc3-3da6-4d39-8a89-3a7b7bb4adc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6811","nonce":980870924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6813","nonce":980870924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6817","nonce":980870924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6815","nonce":980870924}]},"public_addr":"172.21.15.82:6811/980870924","cluster_addr":"172.21.15.82:6813/980870924","heartbeat_back_addr":"172.21.15.82:6817/980870924","heartbeat_front_addr":"172.21.15.82:6815/980870924","state":["exists","up"]},{"osd":4,"uuid":"dbb9d486-5daa-4819-bbed-04fc76ca473e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6809","nonce":1229627753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6811","nonce":1229627753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6815","nonce":1229627753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6813","nonce":1229627753}]},"public_addr":"172.21.15.102:6809/1229627753","cluster_addr":"172.21.15.102:6811/1229627753","heartbeat_back_addr":"172.21.15.102:6815/1229627753","heartbeat_front_addr":"172.21.15.102:6813/1229627753","state":["exists","up"]},{"osd":5,"uuid":"6b50127b-df2b-4c95-8e53-9d42b40273fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6809","nonce":2171194148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6811","nonce":2171194148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6815","nonce":2171194148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6813","nonce":2171194148}]},"public_addr":"172.21.15.190:6809/2171194148","cluster_addr":"172.21.15.190:6811/2171194148","heartbeat_back_addr":"172.21.15.190:6815/2171194148","heartbeat_front_addr":"172.21.15.190:6813/2171194148","state":["exists","up"]},{"osd":6,"uuid":"e72bebb0-5939-4210-950a-41c25c23c62f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6819","nonce":454436959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6821","nonce":454436959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6825","nonce":454436959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6823","nonce":454436959}]},"public_addr":"172.21.15.82:6819/454436959","cluster_addr":"172.21.15.82:6821/454436959","heartbeat_back_addr":"172.21.15.82:6825/454436959","heartbeat_front_addr":"172.21.15.82:6823/454436959","state":["exists","up"]},{"osd":7,"uuid":"72f83f97-f496-4503-8284-6a7b8f99a6f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6817","nonce":2745057274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6819","nonce":2745057274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6823","nonce":2745057274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6821","nonce":2745057274}]},"public_addr":"172.21.15.102:6817/2745057274","cluster_addr":"172.21.15.102:6819/2745057274","heartbeat_back_addr":"172.21.15.102:6823/2745057274","heartbeat_front_addr":"172.21.15.102:6821/2745057274","state":["exists","up"]},{"osd":8,"uuid":"92c9109d-6ebb-4c50-9944-28cd7b2f9c0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6817","nonce":1679683516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6819","nonce":1679683516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6823","nonce":1679683516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6821","nonce":1679683516}]},"public_addr":"172.21.15.190:6817/1679683516","cluster_addr":"172.21.15.190:6819/1679683516","heartbeat_back_addr":"172.21.15.190:6823/1679683516","heartbeat_front_addr":"172.21.15.190:6821/1679683516","state":["exists","up"]},{"osd":9,"uuid":"a3cfce03-0148-475d-bf55-b8284ae1cad2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6827","nonce":1777272933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6829","nonce":1777272933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6833","nonce":1777272933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6831","nonce":1777272933}]},"public_addr":"172.21.15.82:6827/1777272933","cluster_addr":"172.21.15.82:6829/1777272933","heartbeat_back_addr":"172.21.15.82:6833/1777272933","heartbeat_front_addr":"172.21.15.82:6831/1777272933","state":["exists","up"]},{"osd":10,"uuid":"db156ccf-4396-43cb-b69a-bb9095b94b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6825","nonce":1012784035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6827","nonce":1012784035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6831","nonce":1012784035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6829","nonce":1012784035}]},"public_addr":"172.21.15.102:6825/1012784035","cluster_addr":"172.21.15.102:6827/1012784035","heartbeat_back_addr":"172.21.15.102:6831/1012784035","heartbeat_front_addr":"172.21.15.102:6829/1012784035","state":["exists","up"]},{"osd":11,"uuid":"b4d52576-f5b4-479f-8ff6-8fdba4635ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6825","nonce":144700355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6827","nonce":144700355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6831","nonce":144700355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6829","nonce":144700355}]},"public_addr":"172.21.15.190:6825/144700355","cluster_addr":"172.21.15.190:6827/144700355","heartbeat_back_addr":"172.21.15.190:6831/144700355","heartbeat_front_addr":"172.21.15.190:6829/144700355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:07:47.007772+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:09.944738+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:33.183567+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:58.302023+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:09:23.042488+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:09:47.616009+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:10:13.122887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:10:38.584530+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:03.473453+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:29.847105+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:55.152195+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:12:20.401765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6800/1901539016":"2024-03-05T09:06:12.169231+0000","172.21.15.82:0/1124105204":"2024-03-05T09:06:12.169231+0000","172.21.15.82:6801/1901539016":"2024-03-05T09:06:12.169231+0000","172.21.15.82:0/735262841":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/2402774828":"2024-03-05T09:05:44.913099+0000","172.21.15.82:6801/3291527077":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/1846720385":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/3757201752":"2024-03-05T09:06:12.169231+0000","172.21.15.82:6800/3291527077":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/984630078":"2024-03-05T09:06:12.169231+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T09:14:58.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.850+0000 7fbbc5822640 1 -- 172.21.15.82:0/1033822579 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fbbac0a1d80 msgr2=0x7fbbac0a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:58.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.850+0000 7fbbc5822640 1 --2- 172.21.15.82:0/1033822579 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fbbac0a1d80 0x7fbbac0a4240 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbbc01042c0 tx=0x7fbba8005f90 comp rx=0 tx=0).stop 2024-03-04T09:14:58.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.850+0000 7fbbc5822640 1 -- 172.21.15.82:0/1033822579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbbc01004f0 msgr2=0x7fbbc0104550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:58.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.850+0000 7fbbc5822640 1 --2- 172.21.15.82:0/1033822579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbbc01004f0 0x7fbbc0104550 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fbbb000e9c0 tx=0x7fbbb000ee80 comp rx=0 tx=0).stop 2024-03-04T09:14:58.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.850+0000 7fbbc5822640 1 -- 172.21.15.82:0/1033822579 shutdown_connections 2024-03-04T09:14:58.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.850+0000 7fbbc5822640 1 --2- 172.21.15.82:0/1033822579 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fbbac0a1d80 0x7fbbac0a4240 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:58.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.851+0000 7fbbc5822640 1 --2- 172.21.15.82:0/1033822579 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbbc01020a0 0x7fbbc01030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:58.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.851+0000 7fbbc5822640 1 --2- 172.21.15.82:0/1033822579 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbbc01016e0 0x7fbbc0102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:58.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.851+0000 7fbbc5822640 1 --2- 172.21.15.82:0/1033822579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbbc01004f0 0x7fbbc0104550 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:58.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.851+0000 7fbbc5822640 1 -- 172.21.15.82:0/1033822579 >> 172.21.15.82:0/1033822579 conn(0x7fbbc00fba60 msgr2=0x7fbbc0068730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:58.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.851+0000 7fbbc5822640 1 -- 172.21.15.82:0/1033822579 shutdown_connections 2024-03-04T09:14:58.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.851+0000 7fbbc5822640 1 -- 172.21.15.82:0/1033822579 wait complete. 2024-03-04T09:14:58.860 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T09:14:58.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.969+0000 7fdf6f476640 1 -- 172.21.15.82:0/2583191668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf681007c0 msgr2=0x7fdf68100c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:58.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.969+0000 7fdf6f476640 1 --2- 172.21.15.82:0/2583191668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf681007c0 0x7fdf68100c20 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fdf58009900 tx=0x7fdf5802bc30 comp rx=0 tx=0).stop 2024-03-04T09:14:58.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.969+0000 7fdf6f476640 1 -- 172.21.15.82:0/2583191668 shutdown_connections 2024-03-04T09:14:58.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.969+0000 7fdf6f476640 1 --2- 172.21.15.82:0/2583191668 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf68101160 0x7fdf681015e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:58.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.969+0000 7fdf6f476640 1 --2- 172.21.15.82:0/2583191668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf681007c0 0x7fdf68100c20 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:58.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.969+0000 7fdf6f476640 1 --2- 172.21.15.82:0/2583191668 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdf680ffe60 0x7fdf68100280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:58.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.969+0000 7fdf6f476640 1 -- 172.21.15.82:0/2583191668 >> 172.21.15.82:0/2583191668 conn(0x7fdf680fba60 msgr2=0x7fdf680fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:58.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.970+0000 7fdf6f476640 1 -- 172.21.15.82:0/2583191668 shutdown_connections 2024-03-04T09:14:58.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.970+0000 7fdf6f476640 1 -- 172.21.15.82:0/2583191668 wait complete. 2024-03-04T09:14:58.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.970+0000 7fdf6f476640 1 Processor -- start 2024-03-04T09:14:58.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.970+0000 7fdf6f476640 1 -- start start 2024-03-04T09:14:58.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.970+0000 7fdf6f476640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf680ffe60 0x7fdf68199ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:58.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.970+0000 7fdf6f476640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf681007c0 0x7fdf6819a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:58.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.970+0000 7fdf6f476640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdf68101160 0x7fdf681a1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:58.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.970+0000 7fdf6f476640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6810f460 con 0x7fdf680ffe60 2024-03-04T09:14:58.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.970+0000 7fdf6f476640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6810f2e0 con 0x7fdf68101160 2024-03-04T09:14:58.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.970+0000 7fdf6f476640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6810f5e0 con 0x7fdf681007c0 2024-03-04T09:14:58.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.970+0000 7fdf6d212640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf680ffe60 0x7fdf68199ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:58.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.970+0000 7fdf6d212640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf680ffe60 0x7fdf68199ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33874/0 (socket says 172.21.15.82:33874) 2024-03-04T09:14:58.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.970+0000 7fdf6d212640 1 -- 172.21.15.82:0/3878471014 learned_addr learned my addr 172.21.15.82:0/3878471014 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:58.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.970+0000 7fdf6ca11640 1 --2- 172.21.15.82:0/3878471014 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf681007c0 0x7fdf6819a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:58.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.970+0000 7fdf6da13640 1 --2- 172.21.15.82:0/3878471014 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdf68101160 0x7fdf681a1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:58.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.971+0000 7fdf6d212640 1 -- 172.21.15.82:0/3878471014 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf681007c0 msgr2=0x7fdf6819a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:58.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.971+0000 7fdf6d212640 1 --2- 172.21.15.82:0/3878471014 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf681007c0 0x7fdf6819a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:58.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.971+0000 7fdf6d212640 1 -- 172.21.15.82:0/3878471014 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdf68101160 msgr2=0x7fdf681a1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:58.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.971+0000 7fdf6d212640 1 --2- 172.21.15.82:0/3878471014 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdf68101160 0x7fdf681a1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:58.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.971+0000 7fdf6d212640 1 -- 172.21.15.82:0/3878471014 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf681a16e0 con 0x7fdf680ffe60 2024-03-04T09:14:58.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.971+0000 7fdf6d212640 1 --2- 172.21.15.82:0/3878471014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf680ffe60 0x7fdf68199ac0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fdf6400ebc0 tx=0x7fdf6400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:58.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.971+0000 7fdf5e7fc640 1 -- 172.21.15.82:0/3878471014 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf64010630 con 0x7fdf680ffe60 2024-03-04T09:14:58.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.971+0000 7fdf5e7fc640 1 -- 172.21.15.82:0/3878471014 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fdf64010ca0 con 0x7fdf680ffe60 2024-03-04T09:14:58.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.971+0000 7fdf6f476640 1 -- 172.21.15.82:0/3878471014 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf681a19d0 con 0x7fdf680ffe60 2024-03-04T09:14:58.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.971+0000 7fdf5e7fc640 1 -- 172.21.15.82:0/3878471014 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf64018c00 con 0x7fdf680ffe60 2024-03-04T09:14:58.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.971+0000 7fdf6f476640 1 -- 172.21.15.82:0/3878471014 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf681a1f40 con 0x7fdf680ffe60 2024-03-04T09:14:58.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.972+0000 7fdf6f476640 1 -- 172.21.15.82:0/3878471014 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf6810ad60 con 0x7fdf680ffe60 2024-03-04T09:14:58.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.973+0000 7fdf5e7fc640 1 -- 172.21.15.82:0/3878471014 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 136756+0+0 (secure 0 0 0) 0x7fdf640107d0 con 0x7fdf680ffe60 2024-03-04T09:14:58.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.974+0000 7fdf5e7fc640 1 --2- 172.21.15.82:0/3878471014 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fdf540a1e00 0x7fdf540a42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:58.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.974+0000 7fdf6ca11640 1 --2- 172.21.15.82:0/3878471014 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fdf540a1e00 0x7fdf540a42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:58.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.974+0000 7fdf5e7fc640 1 -- 172.21.15.82:0/3878471014 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9092+0+0 (secure 0 0 0) 0x7fdf640ce6a0 con 0x7fdf680ffe60 2024-03-04T09:14:58.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.974+0000 7fdf6ca11640 1 --2- 172.21.15.82:0/3878471014 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fdf540a1e00 0x7fdf540a42c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fdf58005ab0 tx=0x7fdf58005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:58.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:58.978+0000 7fdf5e7fc640 1 -- 172.21.15.82:0/3878471014 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fdf64010ac0 con 0x7fdf680ffe60 2024-03-04T09:14:59.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.187+0000 7fdf6f476640 1 -- 172.21.15.82:0/3878471014 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdf68062200 con 0x7fdf680ffe60 2024-03-04T09:14:59.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.188+0000 7fdf5e7fc640 1 -- 172.21.15.82:0/3878471014 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11462 (secure 0 0 0) 0x7fdf6409b120 con 0x7fdf680ffe60 2024-03-04T09:14:59.184 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:14:59.184 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3123844705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3123844705},{"type":"v1","addr":"172.21.15.82:6835","nonce":3123844705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2620634252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2620634252},{"type":"v1","addr":"172.21.15.82:6837","nonce":2620634252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-04T09:13:10.076732+0000","modified":"2024-03-04T09:13:38.017758+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24476,"mds_1":24469,"mds_2":24451,"mds_3":24449,"mds_4":24439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14613":{"gid":14613,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/1240838024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1240838024},{"type":"v1","addr":"172.21.15.82:6839","nonce":1240838024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14625":{"gid":14625,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/213594267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":213594267},{"type":"v1","addr":"172.21.15.82:6841","nonce":213594267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24398":{"gid":24398,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/1142302200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":1142302200},{"type":"v1","addr":"172.21.15.102:6833","nonce":1142302200}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24403":{"gid":24403,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6833/3023382814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":3023382814},{"type":"v1","addr":"172.21.15.190:6833","nonce":3023382814}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24422":{"gid":24422,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6835/2134310473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":2134310473},{"type":"v1","addr":"172.21.15.102:6835","nonce":2134310473}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24439":{"gid":24439,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":14,"addr":"172.21.15.190:6835/3183532624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3183532624},{"type":"v1","addr":"172.21.15.190:6835","nonce":3183532624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24449":{"gid":24449,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":12,"addr":"172.21.15.102:6837/1210579527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1210579527},{"type":"v1","addr":"172.21.15.102:6837","nonce":1210579527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24451":{"gid":24451,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.190:6837/1198639527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":1198639527},{"type":"v1","addr":"172.21.15.190:6837","nonce":1198639527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.190:6839/878555510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":878555510},{"type":"v1","addr":"172.21.15.190:6839","nonce":878555510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6839/35424130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":35424130},{"type":"v1","addr":"172.21.15.102:6839","nonce":35424130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24449,24439,24451,24476,24469]},"id":1}]} 2024-03-04T09:14:59.185 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 27 2024-03-04T09:14:59.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.189+0000 7fdf6f476640 1 -- 172.21.15.82:0/3878471014 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fdf540a1e00 msgr2=0x7fdf540a42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:59.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.190+0000 7fdf6f476640 1 --2- 172.21.15.82:0/3878471014 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fdf540a1e00 0x7fdf540a42c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fdf58005ab0 tx=0x7fdf58005fd0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.190+0000 7fdf6f476640 1 -- 172.21.15.82:0/3878471014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf680ffe60 msgr2=0x7fdf68199ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:59.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.190+0000 7fdf6f476640 1 --2- 172.21.15.82:0/3878471014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf680ffe60 0x7fdf68199ac0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fdf6400ebc0 tx=0x7fdf6400c6a0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.190+0000 7fdf6f476640 1 -- 172.21.15.82:0/3878471014 shutdown_connections 2024-03-04T09:14:59.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.190+0000 7fdf6f476640 1 --2- 172.21.15.82:0/3878471014 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fdf540a1e00 0x7fdf540a42c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.190+0000 7fdf6f476640 1 --2- 172.21.15.82:0/3878471014 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdf68101160 0x7fdf681a1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.190+0000 7fdf6f476640 1 --2- 172.21.15.82:0/3878471014 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf681007c0 0x7fdf6819a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.190+0000 7fdf6f476640 1 --2- 172.21.15.82:0/3878471014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf680ffe60 0x7fdf68199ac0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.190+0000 7fdf6f476640 1 -- 172.21.15.82:0/3878471014 >> 172.21.15.82:0/3878471014 conn(0x7fdf680fba60 msgr2=0x7fdf680fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:59.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.190+0000 7fdf6f476640 1 -- 172.21.15.82:0/3878471014 shutdown_connections 2024-03-04T09:14:59.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.190+0000 7fdf6f476640 1 -- 172.21.15.82:0/3878471014 wait complete. 2024-03-04T09:14:59.198 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-03-04T09:13:10.076732+0000', 'modified': '2024-03-04T09:13:38.017758+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24476, 'mds_1': 24469, 'mds_2': 24451, 'mds_3': 24449, 'mds_4': 24439}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14613': {'gid': 14613, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.82:6839/1240838024', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6838', 'nonce': 1240838024}, {'type': 'v1', 'addr': '172.21.15.82:6839', 'nonce': 1240838024}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_14625': {'gid': 14625, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.82:6841/213594267', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6840', 'nonce': 213594267}, {'type': 'v1', 'addr': '172.21.15.82:6841', 'nonce': 213594267}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24398': {'gid': 24398, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.102:6833/1142302200', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6832', 'nonce': 1142302200}, {'type': 'v1', 'addr': '172.21.15.102:6833', 'nonce': 1142302200}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24403': {'gid': 24403, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.190:6833/3023382814', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.190:6832', 'nonce': 3023382814}, {'type': 'v1', 'addr': '172.21.15.190:6833', 'nonce': 3023382814}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24422': {'gid': 24422, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.102:6835/2134310473', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6834', 'nonce': 2134310473}, {'type': 'v1', 'addr': '172.21.15.102:6835', 'nonce': 2134310473}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24439': {'gid': 24439, 'name': 'f', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.190:6835/3183532624', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.190:6834', 'nonce': 3183532624}, {'type': 'v1', 'addr': '172.21.15.190:6835', 'nonce': 3183532624}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24449': {'gid': 24449, 'name': 'h', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.102:6837/1210579527', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6836', 'nonce': 1210579527}, {'type': 'v1', 'addr': '172.21.15.102:6837', 'nonce': 1210579527}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24451': {'gid': 24451, 'name': 'c', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.190:6837/1198639527', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.190:6836', 'nonce': 1198639527}, {'type': 'v1', 'addr': '172.21.15.190:6837', 'nonce': 1198639527}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24469': {'gid': 24469, 'name': 'i', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.190:6839/878555510', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.190:6838', 'nonce': 878555510}, {'type': 'v1', 'addr': '172.21.15.190:6839', 'nonce': 878555510}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24476': {'gid': 24476, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.102:6839/35424130', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6838', 'nonce': 35424130}, {'type': 'v1', 'addr': '172.21.15.102:6839', 'nonce': 35424130}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24476, 'qdb_cluster': [24449, 24439, 24451, 24476, 24469]} 2024-03-04T09:14:59.198 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-03-04T09:14:59.198 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-03-04T09:14:59.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.307+0000 7ff7f9c88640 1 -- 172.21.15.82:0/2491657804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7f41004d0 msgr2=0x7ff7f41008f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:59.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.307+0000 7ff7f9c88640 1 --2- 172.21.15.82:0/2491657804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7f41004d0 0x7ff7f41008f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc009900 tx=0x7ff7dc02bc30 comp rx=0 tx=0).stop 2024-03-04T09:14:59.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.307+0000 7ff7f9c88640 1 -- 172.21.15.82:0/2491657804 shutdown_connections 2024-03-04T09:14:59.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.307+0000 7ff7f9c88640 1 --2- 172.21.15.82:0/2491657804 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7f4102080 0x7ff7f4108910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.307+0000 7ff7f9c88640 1 --2- 172.21.15.82:0/2491657804 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff7f41016c0 0x7ff7f4101b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.307+0000 7ff7f9c88640 1 --2- 172.21.15.82:0/2491657804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7f41004d0 0x7ff7f41008f0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.307+0000 7ff7f9c88640 1 -- 172.21.15.82:0/2491657804 >> 172.21.15.82:0/2491657804 conn(0x7ff7f40fba60 msgr2=0x7ff7f40fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:59.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.307+0000 7ff7f9c88640 1 -- 172.21.15.82:0/2491657804 shutdown_connections 2024-03-04T09:14:59.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.307+0000 7ff7f9c88640 1 -- 172.21.15.82:0/2491657804 wait complete. 2024-03-04T09:14:59.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.308+0000 7ff7f9c88640 1 Processor -- start 2024-03-04T09:14:59.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.308+0000 7ff7f9c88640 1 -- start start 2024-03-04T09:14:59.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.308+0000 7ff7f9c88640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff7f41004d0 0x7ff7f4196860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.308+0000 7ff7f9c88640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7f41016c0 0x7ff7f4196da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.308+0000 7ff7f9c88640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7f4102080 0x7ff7f419de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.308+0000 7ff7f9c88640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f410c130 con 0x7ff7f41016c0 2024-03-04T09:14:59.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.308+0000 7ff7f9c88640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f410bfb0 con 0x7ff7f4102080 2024-03-04T09:14:59.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.308+0000 7ff7f9c88640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f410c2b0 con 0x7ff7f41004d0 2024-03-04T09:14:59.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.308+0000 7ff7f2ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7f41016c0 0x7ff7f4196da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.308+0000 7ff7f2ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7f41016c0 0x7ff7f4196da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33886/0 (socket says 172.21.15.82:33886) 2024-03-04T09:14:59.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.308+0000 7ff7f2ffd640 1 -- 172.21.15.82:0/180778497 learned_addr learned my addr 172.21.15.82:0/180778497 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:59.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.308+0000 7ff7f3fff640 1 --2- 172.21.15.82:0/180778497 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7f4102080 0x7ff7f419de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.308+0000 7ff7f37fe640 1 --2- 172.21.15.82:0/180778497 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff7f41004d0 0x7ff7f4196860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.309+0000 7ff7f2ffd640 1 -- 172.21.15.82:0/180778497 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff7f41004d0 msgr2=0x7ff7f4196860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:59.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.309+0000 7ff7f2ffd640 1 --2- 172.21.15.82:0/180778497 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff7f41004d0 0x7ff7f4196860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.309+0000 7ff7f2ffd640 1 -- 172.21.15.82:0/180778497 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7f4102080 msgr2=0x7ff7f419de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:59.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.309+0000 7ff7f2ffd640 1 --2- 172.21.15.82:0/180778497 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7f4102080 0x7ff7f419de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.309+0000 7ff7f2ffd640 1 -- 172.21.15.82:0/180778497 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f419e480 con 0x7ff7f41016c0 2024-03-04T09:14:59.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.309+0000 7ff7f3fff640 1 --2- 172.21.15.82:0/180778497 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7f4102080 0x7ff7f419de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:14:59.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.309+0000 7ff7f2ffd640 1 --2- 172.21.15.82:0/180778497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7f41016c0 0x7ff7f4196da0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff7e400e9f0 tx=0x7ff7e400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:59.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.309+0000 7ff7f0ff9640 1 -- 172.21.15.82:0/180778497 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e400cd80 con 0x7ff7f41016c0 2024-03-04T09:14:59.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.309+0000 7ff7f9c88640 1 -- 172.21.15.82:0/180778497 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7f419e770 con 0x7ff7f41016c0 2024-03-04T09:14:59.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.309+0000 7ff7f0ff9640 1 -- 172.21.15.82:0/180778497 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7ff7e40054f0 con 0x7ff7f41016c0 2024-03-04T09:14:59.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.309+0000 7ff7f0ff9640 1 -- 172.21.15.82:0/180778497 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e4010690 con 0x7ff7f41016c0 2024-03-04T09:14:59.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.309+0000 7ff7f9c88640 1 -- 172.21.15.82:0/180778497 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7f419ec70 con 0x7ff7f41016c0 2024-03-04T09:14:59.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.311+0000 7ff7f0ff9640 1 -- 172.21.15.82:0/180778497 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 136756+0+0 (secure 0 0 0) 0x7ff7e4004f20 con 0x7ff7f41016c0 2024-03-04T09:14:59.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.312+0000 7ff7fc87b740 1 Processor -- start 2024-03-04T09:14:59.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.312+0000 7ff7fc87b740 1 -- start start 2024-03-04T09:14:59.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.312+0000 7ff7fc87b740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55824bbfd7b0 0x55824bbfdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.312+0000 7ff7fc87b740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55824bbfe980 0x55824bbfee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.312+0000 7ff7fc87b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55824bbff340 0x55824bc05bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.312+0000 7ff7fc87b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55824bb626b0 con 0x55824bbff340 2024-03-04T09:14:59.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.312+0000 7ff7fc87b740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x55824bb0ba60 con 0x55824bbfe980 2024-03-04T09:14:59.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.312+0000 7ff7fc87b740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55824bb5e750 con 0x55824bbfd7b0 2024-03-04T09:14:59.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.312+0000 7ff7f2ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55824bbff340 0x55824bc05bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.312+0000 7ff7f3fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55824bbfd7b0 0x55824bbfdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.312+0000 7ff7f3fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55824bbfd7b0 0x55824bbfdbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.82:49176/0 (socket says 172.21.15.82:49176) 2024-03-04T09:14:59.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.312+0000 7ff7f37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55824bbfe980 0x55824bbfee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.312+0000 7ff7f3fff640 1 -- 172.21.15.82:0/3340025416 learned_addr learned my addr 172.21.15.82:0/3340025416 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:59.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.312+0000 7ff7f0ff9640 1 --2- 172.21.15.82:0/180778497 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff7e00a3f90 0x7ff7e00a6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.312+0000 7ff7f37fe640 1 -- 172.21.15.82:0/3340025416 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55824bbfd7b0 msgr2=0x55824bbfdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:14:59.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.312+0000 7ff7f3fff640 1 --2- 172.21.15.82:0/180778497 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff7e00a3f90 0x7ff7e00a6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.312+0000 7ff7f37fe640 1 --2- 172.21.15.82:0/3340025416 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55824bbfd7b0 0x55824bbfdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.312+0000 7ff7f0ff9640 1 -- 172.21.15.82:0/180778497 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9092+0+0 (secure 0 0 0) 0x7ff7e40ce4f0 con 0x7ff7f41016c0 2024-03-04T09:14:59.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.312+0000 7ff7f37fe640 1 -- 172.21.15.82:0/3340025416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55824bbff340 msgr2=0x55824bc05bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:14:59.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.312+0000 7ff7f37fe640 1 --2- 172.21.15.82:0/3340025416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55824bbff340 0x55824bc05bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.312+0000 7ff7f37fe640 1 -- 172.21.15.82:0/3340025416 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55824bb29f30 con 0x55824bbfe980 2024-03-04T09:14:59.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.313+0000 7ff7f37fe640 1 --2- 172.21.15.82:0/3340025416 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55824bbfe980 0x55824bbfee00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc02c170 tx=0x7ff7dc009560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecc155c5decae239 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:59.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.313+0000 7ff7f3fff640 1 --2- 172.21.15.82:0/180778497 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff7e00a3f90 0x7ff7e00a6450 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x55824bbfe880 tx=0x7ff7ec004ab0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:59.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.313+0000 7ff7e9ffb640 1 -- 172.21.15.82:0/3340025416 <== mon.2 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc02c920 con 0x55824bbfe980 2024-03-04T09:14:59.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.313+0000 7ff7e9ffb640 1 -- 172.21.15.82:0/3340025416 <== mon.2 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7ff7dc02cac0 con 0x55824bbfe980 2024-03-04T09:14:59.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.313+0000 7ff7e9ffb640 1 -- 172.21.15.82:0/3340025416 <== mon.2 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc0046c0 con 0x55824bbfe980 2024-03-04T09:14:59.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.313+0000 7ff7fc87b740 1 -- 172.21.15.82:0/3340025416 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55824bbfe980 msgr2=0x55824bbfee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:59.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.313+0000 7ff7fc87b740 1 --2- 172.21.15.82:0/3340025416 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55824bbfe980 0x55824bbfee00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc02c170 tx=0x7ff7dc009560 comp rx=0 tx=0).stop 2024-03-04T09:14:59.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.313+0000 7ff7fc87b740 1 -- 172.21.15.82:0/3340025416 shutdown_connections 2024-03-04T09:14:59.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.313+0000 7ff7fc87b740 1 --2- 172.21.15.82:0/3340025416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55824bbff340 0x55824bc05bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.313+0000 7ff7fc87b740 1 --2- 172.21.15.82:0/3340025416 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55824bbfe980 0x55824bbfee00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.313+0000 7ff7fc87b740 1 --2- 172.21.15.82:0/3340025416 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55824bbfd7b0 0x55824bbfdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.313+0000 7ff7fc87b740 1 -- 172.21.15.82:0/3340025416 >> 172.21.15.82:0/3340025416 conn(0x55824bbf8ba0 msgr2=0x55824bbf8fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:59.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.313+0000 7ff7fc87b740 1 -- 172.21.15.82:0/3340025416 shutdown_connections 2024-03-04T09:14:59.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.314+0000 7ff7fc87b740 1 -- 172.21.15.82:0/3340025416 wait complete. 2024-03-04T09:14:59.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.314+0000 7ff7fc87b740 1 -- start start 2024-03-04T09:14:59.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.314+0000 7ff7fc87b740 1 Processor -- start 2024-03-04T09:14:59.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.314+0000 7ff7fc87b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55824bbfd7b0 0x55824bc07ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.314+0000 7ff7fc87b740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55824bbfe980 0x55824bc081e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.314+0000 7ff7fc87b740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55824bbff340 0x55824bc0f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.314+0000 7ff7fc87b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55824bc062f0 con 0x55824bbfd7b0 2024-03-04T09:14:59.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.314+0000 7ff7fc87b740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x55824bb1eea0 con 0x55824bbfe980 2024-03-04T09:14:59.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.314+0000 7ff7fc87b740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55824bc06470 con 0x55824bbff340 2024-03-04T09:14:59.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.314+0000 7ff7fc87b740 10 client.0 _ll_register_callbacks cb 0x55824bb1e870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-04T09:14:59.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.314+0000 7ff7f37fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55824bbfd7b0 0x55824bc07ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.314+0000 7ff7f37fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55824bbfd7b0 0x55824bc07ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33900/0 (socket says 172.21.15.82:33900) 2024-03-04T09:14:59.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.314+0000 7ff7f37fe640 1 -- 172.21.15.82:0/3283536914 learned_addr learned my addr 172.21.15.82:0/3283536914 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:59.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.314+0000 7ff7f2ffd640 1 --2- 172.21.15.82:0/3283536914 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55824bbfe980 0x55824bc081e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.314+0000 7ff7f3fff640 1 --2- 172.21.15.82:0/3283536914 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55824bbff340 0x55824bc0f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.315+0000 7ff7f3fff640 1 -- 172.21.15.82:0/3283536914 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55824bbfe980 msgr2=0x55824bc081e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:14:59.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.315+0000 7ff7f3fff640 1 --2- 172.21.15.82:0/3283536914 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55824bbfe980 0x55824bc081e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.315+0000 7ff7f3fff640 1 -- 172.21.15.82:0/3283536914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55824bbfd7b0 msgr2=0x55824bc07ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:14:59.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.315+0000 7ff7f3fff640 1 --2- 172.21.15.82:0/3283536914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55824bbfd7b0 0x55824bc07ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.315+0000 7ff7f3fff640 1 -- 172.21.15.82:0/3283536914 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55824bb1f270 con 0x55824bbff340 2024-03-04T09:14:59.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.315+0000 7ff7f2ffd640 1 --2- 172.21.15.82:0/3283536914 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55824bbfe980 0x55824bc081e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:14:59.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.315+0000 7ff7f3fff640 1 --2- 172.21.15.82:0/3283536914 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55824bbff340 0x55824bc0f220 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec005c40 tx=0x7ff7ec004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ac19030e8be76ea server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:59.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.315+0000 7ff7d2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.190:3300/0 2024-03-04T09:14:59.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.315+0000 7ff7d2ffd640 1 -- 172.21.15.82:0/3283536914 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ec026020 con 0x55824bbff340 2024-03-04T09:14:59.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.315+0000 7ff7fc87b740 1 -- 172.21.15.82:0/3283536914 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff7dc02cac0 con 0x55824bbff340 2024-03-04T09:14:59.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.315+0000 7ff7d2ffd640 1 -- 172.21.15.82:0/3283536914 <== mon.1 v2:172.21.15.190:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9092+0+0 (secure 0 0 0) 0x7ff7ec0223f0 con 0x55824bbff340 2024-03-04T09:14:59.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.315+0000 7ff7d2ffd640 1 -- 172.21.15.82:0/3283536914 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff7ec0225f0 con 0x55824bbff340 2024-03-04T09:14:59.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.315+0000 7ff7fc87b740 10 client.24988 fetch_fsmap learned FSMap version 27 2024-03-04T09:14:59.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.315+0000 7ff7fc87b740 1 -- 172.21.15.82:0/3283536914 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55824b8772d0 con 0x55824bbff340 2024-03-04T09:14:59.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.315+0000 7ff7d2ffd640 1 -- 172.21.15.82:0/3283536914 <== mon.1 v2:172.21.15.190:3300/0 4 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7ff7dc02cac0 con 0x55824bbff340 2024-03-04T09:14:59.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.316+0000 7ff7d2ffd640 1 -- 172.21.15.82:0/3283536914 <== mon.1 v2:172.21.15.190:3300/0 5 ==== fsmap(e 27) v1 ==== 7942+0+0 (secure 0 0 0) 0x7ff7ec02a8d0 con 0x55824bbff340 2024-03-04T09:14:59.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.316+0000 7ff7fc87b740 10 client.24988 fetch_fsmap finished waiting for FSMap version 27 2024-03-04T09:14:59.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.316+0000 7ff7fc87b740 10 client.24988 resolve_mds: resolved name 'f' to daemon mds.f 2024-03-04T09:14:59.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.316+0000 7ff7fc87b740 20 client.24988 populate_metadata read hostname 'smithi082' 2024-03-04T09:14:59.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.316+0000 7ff7fc87b740 1 --2- 172.21.15.82:0/3283536914 >> [v2:172.21.15.190:6834/3183532624,v1:172.21.15.190:6835/3183532624] conn(0x55824bc148c0 0x55824bc13950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.316+0000 7ff7fc87b740 4 client.24988 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-04T09:14:59.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.316+0000 7ff7fc87b740 1 -- 172.21.15.82:0/3283536914 --> [v2:172.21.15.190:6834/3183532624,v1:172.21.15.190:6835/3183532624] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55824bb6fbf0 con 0x55824bc148c0 2024-03-04T09:14:59.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.316+0000 7ff7f37fe640 1 --2- 172.21.15.82:0/3283536914 >> [v2:172.21.15.190:6834/3183532624,v1:172.21.15.190:6835/3183532624] conn(0x55824bc148c0 0x55824bc13950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.316+0000 7ff7d2ffd640 10 client.24988 ms_handle_connect on v2:172.21.15.190:6834/3183532624 2024-03-04T09:14:59.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.316+0000 7ff7f37fe640 1 --2- 172.21.15.82:0/3283536914 >> [v2:172.21.15.190:6834/3183532624,v1:172.21.15.190:6835/3183532624] conn(0x55824bc148c0 0x55824bc13950 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a7a7199f786cbfc4 server_cookie=98e7b321c3a69637 in_seq=0 out_seq=0 2024-03-04T09:14:59.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.317+0000 7ff7d2ffd640 1 -- 172.21.15.82:0/3283536914 <== mds.4 v2:172.21.15.190:6834/3183532624 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55824bb6fbf0 con 0x55824bc148c0 2024-03-04T09:14:59.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.317+0000 7ff7d2ffd640 10 client.24988 handle_command_reply: tid=0 2024-03-04T09:14:59.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.317+0000 7ff7fc87b740 1 client.24988 shutdown 2024-03-04T09:14:59.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.318+0000 7ff7fc87b740 1 -- 172.21.15.82:0/3283536914 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55824bbff340 msgr2=0x55824bc0f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:59.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.318+0000 7ff7fc87b740 1 --2- 172.21.15.82:0/3283536914 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55824bbff340 0x55824bc0f220 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec005c40 tx=0x7ff7ec004a40 comp rx=0 tx=0).stop 2024-03-04T09:14:59.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.318+0000 7ff7fc87b740 1 -- 172.21.15.82:0/3283536914 shutdown_connections 2024-03-04T09:14:59.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.318+0000 7ff7fc87b740 1 --2- 172.21.15.82:0/3283536914 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55824bbff340 0x55824bc0f220 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.318+0000 7ff7fc87b740 1 --2- 172.21.15.82:0/3283536914 >> [v2:172.21.15.190:6834/3183532624,v1:172.21.15.190:6835/3183532624] conn(0x55824bc148c0 0x55824bc13950 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.318+0000 7ff7fc87b740 1 --2- 172.21.15.82:0/3283536914 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55824bbfe980 0x55824bc081e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.318+0000 7ff7fc87b740 1 --2- 172.21.15.82:0/3283536914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55824bbfd7b0 0x55824bc07ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.318+0000 7ff7d2ffd640 0 client.24988 ms_handle_reset on v2:172.21.15.190:6834/3183532624 2024-03-04T09:14:59.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.318+0000 7ff7fc87b740 1 -- 172.21.15.82:0/3283536914 >> 172.21.15.82:0/3283536914 conn(0x55824bbf8ba0 msgr2=0x55824bbf7da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:59.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.318+0000 7ff7fc87b740 1 -- 172.21.15.82:0/3283536914 shutdown_connections 2024-03-04T09:14:59.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.318+0000 7ff7fc87b740 1 -- 172.21.15.82:0/3283536914 wait complete. 2024-03-04T09:14:59.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.318+0000 7ff7fc87b740 20 client.24988 trim_cache size 0 max 16384 2024-03-04T09:14:59.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.334+0000 7ff7fc87b740 1 Processor -- start 2024-03-04T09:14:59.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.334+0000 7ff7fc87b740 1 -- start start 2024-03-04T09:14:59.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.334+0000 7ff7fc87b740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55824bbfd7b0 0x55824bc01980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.334+0000 7ff7fc87b740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55824bbfe980 0x55824bc0f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.334+0000 7ff7fc87b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55824bbff340 0x55824bc07ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.334+0000 7ff7fc87b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55824bc140e0 con 0x55824bbff340 2024-03-04T09:14:59.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.334+0000 7ff7fc87b740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x55824bc14740 con 0x55824bbfe980 2024-03-04T09:14:59.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.334+0000 7ff7fc87b740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55824bc14da0 con 0x55824bbfd7b0 2024-03-04T09:14:59.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.334+0000 7ff7f3fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55824bbff340 0x55824bc07ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.334+0000 7ff7f37fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55824bbfd7b0 0x55824bc01980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.334+0000 7ff7f3fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55824bbff340 0x55824bc07ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33906/0 (socket says 172.21.15.82:33906) 2024-03-04T09:14:59.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.335+0000 7ff7f2ffd640 1 --2- 172.21.15.82:0/1664281026 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55824bbfe980 0x55824bc0f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.334+0000 7ff7f3fff640 1 -- 172.21.15.82:0/1664281026 learned_addr learned my addr 172.21.15.82:0/1664281026 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:59.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.335+0000 7ff7f37fe640 1 -- 172.21.15.82:0/1664281026 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55824bbfe980 msgr2=0x55824bc0f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:14:59.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.335+0000 7ff7f37fe640 1 --2- 172.21.15.82:0/1664281026 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55824bbfe980 0x55824bc0f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.335+0000 7ff7f37fe640 1 -- 172.21.15.82:0/1664281026 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55824bbff340 msgr2=0x55824bc07ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:14:59.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.335+0000 7ff7f37fe640 1 --2- 172.21.15.82:0/1664281026 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55824bbff340 0x55824bc07ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.335+0000 7ff7f37fe640 1 -- 172.21.15.82:0/1664281026 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55824b9416b0 con 0x55824bbfd7b0 2024-03-04T09:14:59.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.335+0000 7ff7f37fe640 1 --2- 172.21.15.82:0/1664281026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55824bbfd7b0 0x55824bc01980 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x55824bc162b0 tx=0x7ff7dc02e040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26ebcaba68e6b4a2 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:59.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.335+0000 7ff7e97fa640 1 -- 172.21.15.82:0/1664281026 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc005d50 con 0x55824bbfd7b0 2024-03-04T09:14:59.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.335+0000 7ff7e97fa640 1 -- 172.21.15.82:0/1664281026 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7ff7dc02cc60 con 0x55824bbfd7b0 2024-03-04T09:14:59.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.335+0000 7ff7e97fa640 1 -- 172.21.15.82:0/1664281026 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc041800 con 0x55824bbfd7b0 2024-03-04T09:14:59.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.336+0000 7ff7fc87b740 1 -- 172.21.15.82:0/1664281026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55824bbfd7b0 msgr2=0x55824bc01980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:59.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.336+0000 7ff7fc87b740 1 --2- 172.21.15.82:0/1664281026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55824bbfd7b0 0x55824bc01980 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x55824bc162b0 tx=0x7ff7dc02e040 comp rx=0 tx=0).stop 2024-03-04T09:14:59.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.336+0000 7ff7fc87b740 1 -- 172.21.15.82:0/1664281026 shutdown_connections 2024-03-04T09:14:59.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.336+0000 7ff7fc87b740 1 --2- 172.21.15.82:0/1664281026 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55824bbff340 0x55824bc07ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.336+0000 7ff7fc87b740 1 --2- 172.21.15.82:0/1664281026 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55824bbfe980 0x55824bc0f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.336+0000 7ff7fc87b740 1 --2- 172.21.15.82:0/1664281026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55824bbfd7b0 0x55824bc01980 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.336+0000 7ff7fc87b740 1 -- 172.21.15.82:0/1664281026 >> 172.21.15.82:0/1664281026 conn(0x55824bbf8ba0 msgr2=0x55824bbf8f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:59.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.336+0000 7ff7fc87b740 1 -- 172.21.15.82:0/1664281026 shutdown_connections 2024-03-04T09:14:59.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.336+0000 7ff7fc87b740 1 -- 172.21.15.82:0/1664281026 wait complete. 2024-03-04T09:14:59.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.336+0000 7ff7fc87b740 1 -- start start 2024-03-04T09:14:59.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.336+0000 7ff7fc87b740 1 Processor -- start 2024-03-04T09:14:59.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.337+0000 7ff7fc87b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55824bbfd7b0 0x55824bc09480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.337+0000 7ff7fc87b740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55824bbfe980 0x55824bc099c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.337+0000 7ff7fc87b740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55824bbff340 0x55824bc0e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.337+0000 7ff7fc87b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55824bc15a60 con 0x55824bbfd7b0 2024-03-04T09:14:59.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.337+0000 7ff7fc87b740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x55824bc15400 con 0x55824bbfe980 2024-03-04T09:14:59.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.337+0000 7ff7fc87b740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55824bc160c0 con 0x55824bbff340 2024-03-04T09:14:59.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.337+0000 7ff7fc87b740 10 client.0 _ll_register_callbacks cb 0x7ff7ec004930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-04T09:14:59.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.337+0000 7ff7f37fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55824bbfd7b0 0x55824bc09480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.337+0000 7ff7f2ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55824bbfe980 0x55824bc099c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.337+0000 7ff7f37fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55824bbfd7b0 0x55824bc09480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33916/0 (socket says 172.21.15.82:33916) 2024-03-04T09:14:59.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.337+0000 7ff7f37fe640 1 -- 172.21.15.82:0/2878011503 learned_addr learned my addr 172.21.15.82:0/2878011503 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:59.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.337+0000 7ff7f3fff640 1 --2- 172.21.15.82:0/2878011503 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55824bbff340 0x55824bc0e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.337+0000 7ff7f37fe640 1 -- 172.21.15.82:0/2878011503 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55824bbff340 msgr2=0x55824bc0e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:14:59.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.337+0000 7ff7f37fe640 1 --2- 172.21.15.82:0/2878011503 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55824bbff340 0x55824bc0e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.337+0000 7ff7f37fe640 1 -- 172.21.15.82:0/2878011503 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55824bbfe980 msgr2=0x55824bc099c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:14:59.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.337+0000 7ff7f37fe640 1 --2- 172.21.15.82:0/2878011503 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55824bbfe980 0x55824bc099c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.337+0000 7ff7f37fe640 1 -- 172.21.15.82:0/2878011503 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55824bc0efe0 con 0x55824bbfd7b0 2024-03-04T09:14:59.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.337+0000 7ff7f2ffd640 1 --2- 172.21.15.82:0/2878011503 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55824bbfe980 0x55824bc099c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:14:59.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.337+0000 7ff7f3fff640 1 --2- 172.21.15.82:0/2878011503 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55824bbff340 0x55824bc0e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:14:59.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.337+0000 7ff7f37fe640 1 --2- 172.21.15.82:0/2878011503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55824bbfd7b0 0x55824bc09480 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc006010 tx=0x7ff7dc005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dc4b76784b7bd13 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:59.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.337+0000 7ff7d2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-04T09:14:59.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.337+0000 7ff7d2ffd640 1 -- 172.21.15.82:0/2878011503 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc05b070 con 0x55824bbfd7b0 2024-03-04T09:14:59.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.337+0000 7ff7fc87b740 1 -- 172.21.15.82:0/2878011503 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff7dc02cc60 con 0x55824bbfd7b0 2024-03-04T09:14:59.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.337+0000 7ff7d2ffd640 1 -- 172.21.15.82:0/2878011503 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9092+0+0 (secure 0 0 0) 0x7ff7dc057690 con 0x55824bbfd7b0 2024-03-04T09:14:59.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.338+0000 7ff7d2ffd640 1 -- 172.21.15.82:0/2878011503 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff7dc067050 con 0x55824bbfd7b0 2024-03-04T09:14:59.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.338+0000 7ff7fc87b740 10 client.15216 fetch_fsmap learned FSMap version 27 2024-03-04T09:14:59.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.338+0000 7ff7fc87b740 1 -- 172.21.15.82:0/2878011503 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55824bc70420 con 0x55824bbfd7b0 2024-03-04T09:14:59.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.338+0000 7ff7d2ffd640 1 -- 172.21.15.82:0/2878011503 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7ff7dc02cc60 con 0x55824bbfd7b0 2024-03-04T09:14:59.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.338+0000 7ff7d2ffd640 1 -- 172.21.15.82:0/2878011503 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 27) v1 ==== 7942+0+0 (secure 0 0 0) 0x7ff7dc041cb0 con 0x55824bbfd7b0 2024-03-04T09:14:59.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.338+0000 7ff7fc87b740 10 client.15216 fetch_fsmap finished waiting for FSMap version 27 2024-03-04T09:14:59.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.338+0000 7ff7fc87b740 10 client.15216 resolve_mds: resolved name 'f' to daemon mds.f 2024-03-04T09:14:59.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.338+0000 7ff7fc87b740 20 client.15216 populate_metadata read hostname 'smithi082' 2024-03-04T09:14:59.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.338+0000 7ff7fc87b740 1 --2- 172.21.15.82:0/2878011503 >> [v2:172.21.15.190:6834/3183532624,v1:172.21.15.190:6835/3183532624] conn(0x55824bc74470 0x55824bc705f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.338+0000 7ff7fc87b740 4 client.15216 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-04T09:14:59.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.338+0000 7ff7fc87b740 1 -- 172.21.15.82:0/2878011503 --> [v2:172.21.15.190:6834/3183532624,v1:172.21.15.190:6835/3183532624] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55824bb69f40 con 0x55824bc74470 2024-03-04T09:14:59.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.338+0000 7ff7f2ffd640 1 --2- 172.21.15.82:0/2878011503 >> [v2:172.21.15.190:6834/3183532624,v1:172.21.15.190:6835/3183532624] conn(0x55824bc74470 0x55824bc705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.339+0000 7ff7f2ffd640 1 --2- 172.21.15.82:0/2878011503 >> [v2:172.21.15.190:6834/3183532624,v1:172.21.15.190:6835/3183532624] conn(0x55824bc74470 0x55824bc705f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ae5eef4bfbe7d005 server_cookie=9c1bbcde51acdf7d in_seq=0 out_seq=0 2024-03-04T09:14:59.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.339+0000 7ff7d2ffd640 10 client.15216 ms_handle_connect on v2:172.21.15.190:6834/3183532624 2024-03-04T09:14:59.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.339+0000 7ff7d2ffd640 1 -- 172.21.15.82:0/2878011503 <== mds.4 v2:172.21.15.190:6834/3183532624 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55824bb69f40 con 0x55824bc74470 2024-03-04T09:14:59.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.339+0000 7ff7d2ffd640 10 client.15216 handle_command_reply: tid=0 2024-03-04T09:14:59.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.339+0000 7ff7fc87b740 1 client.15216 shutdown 2024-03-04T09:14:59.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.339+0000 7ff7fc87b740 1 -- 172.21.15.82:0/2878011503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55824bbfd7b0 msgr2=0x55824bc09480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:59.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.339+0000 7ff7fc87b740 1 --2- 172.21.15.82:0/2878011503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55824bbfd7b0 0x55824bc09480 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc006010 tx=0x7ff7dc005740 comp rx=0 tx=0).stop 2024-03-04T09:14:59.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.339+0000 7ff7fc87b740 1 -- 172.21.15.82:0/2878011503 shutdown_connections 2024-03-04T09:14:59.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.339+0000 7ff7fc87b740 1 --2- 172.21.15.82:0/2878011503 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55824bbff340 0x55824bc0e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.339+0000 7ff7fc87b740 1 --2- 172.21.15.82:0/2878011503 >> [v2:172.21.15.190:6834/3183532624,v1:172.21.15.190:6835/3183532624] conn(0x55824bc74470 0x55824bc705f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.339+0000 7ff7fc87b740 1 --2- 172.21.15.82:0/2878011503 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55824bbfe980 0x55824bc099c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.339+0000 7ff7d2ffd640 0 client.15216 ms_handle_reset on v2:172.21.15.190:6834/3183532624 2024-03-04T09:14:59.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.339+0000 7ff7fc87b740 1 --2- 172.21.15.82:0/2878011503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55824bbfd7b0 0x55824bc09480 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.339+0000 7ff7fc87b740 1 -- 172.21.15.82:0/2878011503 >> 172.21.15.82:0/2878011503 conn(0x55824bbf8ba0 msgr2=0x55824bc07ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:59.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.339+0000 7ff7fc87b740 1 -- 172.21.15.82:0/2878011503 shutdown_connections 2024-03-04T09:14:59.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.339+0000 7ff7fc87b740 1 -- 172.21.15.82:0/2878011503 wait complete. 2024-03-04T09:14:59.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.339+0000 7ff7fc87b740 20 client.15216 trim_cache size 0 max 16384 2024-03-04T09:14:59.343 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-04T09:14:59.344 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "2e533fc8-da06-11ee-95c6-87774f69a715", 2024-03-04T09:14:59.344 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 4, 2024-03-04T09:14:59.344 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24439, 2024-03-04T09:14:59.344 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-03-04T09:14:59.344 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-03-04T09:14:59.344 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-03-04T09:14:59.344 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 81.963932720000003, 2024-03-04T09:14:59.344 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 27, 2024-03-04T09:14:59.344 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 92, 2024-03-04T09:14:59.344 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 90, 2024-03-04T09:14:59.344 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 130.89324587600001 2024-03-04T09:14:59.344 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-04T09:14:59.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.340+0000 7ff7f9c88640 1 -- 172.21.15.82:0/180778497 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff7e00a3f90 msgr2=0x7ff7e00a6450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:59.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.340+0000 7ff7f9c88640 1 --2- 172.21.15.82:0/180778497 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff7e00a3f90 0x7ff7e00a6450 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x55824bbfe880 tx=0x7ff7ec004ab0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.340+0000 7ff7f9c88640 1 -- 172.21.15.82:0/180778497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7f41016c0 msgr2=0x7ff7f4196da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:59.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.340+0000 7ff7f9c88640 1 --2- 172.21.15.82:0/180778497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7f41016c0 0x7ff7f4196da0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff7e400e9f0 tx=0x7ff7e400edf0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.340+0000 7ff7f9c88640 1 -- 172.21.15.82:0/180778497 shutdown_connections 2024-03-04T09:14:59.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.340+0000 7ff7f9c88640 1 --2- 172.21.15.82:0/180778497 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff7e00a3f90 0x7ff7e00a6450 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.340+0000 7ff7f9c88640 1 --2- 172.21.15.82:0/180778497 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7f4102080 0x7ff7f419de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.340+0000 7ff7f9c88640 1 --2- 172.21.15.82:0/180778497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7f41016c0 0x7ff7f4196da0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.340+0000 7ff7f9c88640 1 --2- 172.21.15.82:0/180778497 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff7f41004d0 0x7ff7f4196860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.340+0000 7ff7f9c88640 1 -- 172.21.15.82:0/180778497 >> 172.21.15.82:0/180778497 conn(0x7ff7f40fba60 msgr2=0x7ff7f4104a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:59.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.340+0000 7ff7f9c88640 1 -- 172.21.15.82:0/180778497 shutdown_connections 2024-03-04T09:14:59.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.340+0000 7ff7f9c88640 1 -- 172.21.15.82:0/180778497 wait complete. 2024-03-04T09:14:59.347 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2024-03-04T09:14:59.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.457+0000 7f91e7b77640 1 -- 172.21.15.82:0/2230848130 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91e01004d0 msgr2=0x7f91e01008f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:59.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.457+0000 7f91e7b77640 1 --2- 172.21.15.82:0/2230848130 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91e01004d0 0x7f91e01008f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f91d0009900 tx=0x7f91d002bc30 comp rx=0 tx=0).stop 2024-03-04T09:14:59.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.457+0000 7f91e7b77640 1 -- 172.21.15.82:0/2230848130 shutdown_connections 2024-03-04T09:14:59.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.457+0000 7f91e7b77640 1 --2- 172.21.15.82:0/2230848130 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91e0102080 0x7f91e0108910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.457+0000 7f91e7b77640 1 --2- 172.21.15.82:0/2230848130 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91e01016c0 0x7f91e0101b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.457+0000 7f91e7b77640 1 --2- 172.21.15.82:0/2230848130 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91e01004d0 0x7f91e01008f0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.457+0000 7f91e7b77640 1 -- 172.21.15.82:0/2230848130 >> 172.21.15.82:0/2230848130 conn(0x7f91e00fba60 msgr2=0x7f91e00fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:59.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.457+0000 7f91e7b77640 1 -- 172.21.15.82:0/2230848130 shutdown_connections 2024-03-04T09:14:59.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.457+0000 7f91e7b77640 1 -- 172.21.15.82:0/2230848130 wait complete. 2024-03-04T09:14:59.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.458+0000 7f91e7b77640 1 Processor -- start 2024-03-04T09:14:59.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.458+0000 7f91e7b77640 1 -- start start 2024-03-04T09:14:59.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.458+0000 7f91e7b77640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91e01004d0 0x7f91e0197970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.458+0000 7f91e7b77640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91e01016c0 0x7f91e0197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.458+0000 7f91e7b77640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91e0102080 0x7f91e019ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.458+0000 7f91e7b77640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e010c120 con 0x7f91e01016c0 2024-03-04T09:14:59.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.458+0000 7f91e7b77640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e010bfa0 con 0x7f91e01004d0 2024-03-04T09:14:59.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.458+0000 7f91e7b77640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e010c2a0 con 0x7f91e0102080 2024-03-04T09:14:59.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.458+0000 7f91e5112640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91e01016c0 0x7f91e0197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.458+0000 7f91e5112640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91e01016c0 0x7f91e0197eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33944/0 (socket says 172.21.15.82:33944) 2024-03-04T09:14:59.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.458+0000 7f91e5112640 1 -- 172.21.15.82:0/957271196 learned_addr learned my addr 172.21.15.82:0/957271196 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:59.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.458+0000 7f91e5913640 1 --2- 172.21.15.82:0/957271196 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91e01004d0 0x7f91e0197970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.458+0000 7f91e6114640 1 --2- 172.21.15.82:0/957271196 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91e0102080 0x7f91e019ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.458+0000 7f91e5112640 1 -- 172.21.15.82:0/957271196 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91e0102080 msgr2=0x7f91e019ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:59.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.458+0000 7f91e5112640 1 --2- 172.21.15.82:0/957271196 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91e0102080 0x7f91e019ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.458+0000 7f91e5112640 1 -- 172.21.15.82:0/957271196 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91e01004d0 msgr2=0x7f91e0197970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:59.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.458+0000 7f91e5112640 1 --2- 172.21.15.82:0/957271196 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91e01004d0 0x7f91e0197970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.458+0000 7f91e5112640 1 -- 172.21.15.82:0/957271196 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e019f590 con 0x7f91e01016c0 2024-03-04T09:14:59.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.459+0000 7f91e5112640 1 --2- 172.21.15.82:0/957271196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91e01016c0 0x7f91e0197eb0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f91dc00e9f0 tx=0x7f91dc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:59.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.459+0000 7f91d6ffd640 1 -- 172.21.15.82:0/957271196 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91dc00ccc0 con 0x7f91e01016c0 2024-03-04T09:14:59.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.459+0000 7f91d6ffd640 1 -- 172.21.15.82:0/957271196 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f91dc010900 con 0x7f91e01016c0 2024-03-04T09:14:59.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.459+0000 7f91e7b77640 1 -- 172.21.15.82:0/957271196 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91e019f880 con 0x7f91e01016c0 2024-03-04T09:14:59.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.459+0000 7f91d6ffd640 1 -- 172.21.15.82:0/957271196 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91dc0188a0 con 0x7f91e01016c0 2024-03-04T09:14:59.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.459+0000 7f91e7b77640 1 -- 172.21.15.82:0/957271196 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91e019fdd0 con 0x7f91e01016c0 2024-03-04T09:14:59.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.461+0000 7f91d6ffd640 1 -- 172.21.15.82:0/957271196 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f91dc010ab0 con 0x7f91e01016c0 2024-03-04T09:14:59.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.461+0000 7f91ea837740 1 Processor -- start 2024-03-04T09:14:59.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.461+0000 7f91ea837740 1 -- start start 2024-03-04T09:14:59.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.462+0000 7f91ea837740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55704aa9d7b0 0x55704aa9dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.462+0000 7f91ea837740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55704aa9e980 0x55704aa9ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.462+0000 7f91ea837740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55704aa9f340 0x55704aaa5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.462+0000 7f91ea837740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55704aa026b0 con 0x55704aa9d7b0 2024-03-04T09:14:59.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.462+0000 7f91ea837740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x55704a9aba60 con 0x55704aa9e980 2024-03-04T09:14:59.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.462+0000 7f91ea837740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55704a9fe750 con 0x55704aa9f340 2024-03-04T09:14:59.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.462+0000 7f91e6114640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55704aa9d7b0 0x55704aa9dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.462+0000 7f91e5913640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55704aa9e980 0x55704aa9ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.462+0000 7f91e5913640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55704aa9e980 0x55704aa9ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.82:56056/0 (socket says 172.21.15.82:56056) 2024-03-04T09:14:59.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.462+0000 7f91e6114640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55704aa9d7b0 0x55704aa9dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33952/0 (socket says 172.21.15.82:33952) 2024-03-04T09:14:59.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.462+0000 7f91e5913640 1 -- 172.21.15.82:0/1654649253 learned_addr learned my addr 172.21.15.82:0/1654649253 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:59.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.462+0000 7f91e5112640 1 --2- 172.21.15.82:0/1654649253 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55704aa9f340 0x55704aaa5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.462+0000 7f91e5913640 1 -- 172.21.15.82:0/1654649253 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55704aa9f340 msgr2=0x55704aaa5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:14:59.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.462+0000 7f91e5913640 1 --2- 172.21.15.82:0/1654649253 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55704aa9f340 0x55704aaa5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.462+0000 7f91e5913640 1 -- 172.21.15.82:0/1654649253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55704aa9d7b0 msgr2=0x55704aa9dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:14:59.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.462+0000 7f91e5913640 1 --2- 172.21.15.82:0/1654649253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55704aa9d7b0 0x55704aa9dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.462+0000 7f91e5913640 1 -- 172.21.15.82:0/1654649253 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55704a9c9f30 con 0x55704aa9e980 2024-03-04T09:14:59.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.462+0000 7f91e6114640 1 --2- 172.21.15.82:0/1654649253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55704aa9d7b0 0x55704aa9dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:14:59.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.462+0000 7f91d6ffd640 1 --2- 172.21.15.82:0/957271196 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f91cc0a1d80 0x7f91cc0a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.462+0000 7f91e5913640 1 --2- 172.21.15.82:0/1654649253 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55704aa9e980 0x55704aa9ee00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f91d0005ab0 tx=0x7f91d0009560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f72965d9a13ae36 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:59.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.463+0000 7f91e6114640 1 --2- 172.21.15.82:0/957271196 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f91cc0a1d80 0x7f91cc0a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.463+0000 7f91cbfff640 1 -- 172.21.15.82:0/1654649253 <== mon.2 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d002c920 con 0x55704aa9e980 2024-03-04T09:14:59.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.463+0000 7f91d6ffd640 1 -- 172.21.15.82:0/957271196 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9092+0+0 (secure 0 0 0) 0x7f91dc0ce4e0 con 0x7f91e01016c0 2024-03-04T09:14:59.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.463+0000 7f91cbfff640 1 -- 172.21.15.82:0/1654649253 <== mon.2 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f91d002cac0 con 0x55704aa9e980 2024-03-04T09:14:59.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.463+0000 7f91cbfff640 1 -- 172.21.15.82:0/1654649253 <== mon.2 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d0004920 con 0x55704aa9e980 2024-03-04T09:14:59.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.463+0000 7f91ea837740 1 -- 172.21.15.82:0/1654649253 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55704aa9e980 msgr2=0x55704aa9ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:59.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.463+0000 7f91e6114640 1 --2- 172.21.15.82:0/957271196 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f91cc0a1d80 0x7f91cc0a4240 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x55704aa9e880 tx=0x7f91d8009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:59.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.463+0000 7f91ea837740 1 --2- 172.21.15.82:0/1654649253 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55704aa9e980 0x55704aa9ee00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f91d0005ab0 tx=0x7f91d0009560 comp rx=0 tx=0).stop 2024-03-04T09:14:59.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.463+0000 7f91ea837740 1 -- 172.21.15.82:0/1654649253 shutdown_connections 2024-03-04T09:14:59.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.463+0000 7f91ea837740 1 --2- 172.21.15.82:0/1654649253 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55704aa9f340 0x55704aaa5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.463+0000 7f91ea837740 1 --2- 172.21.15.82:0/1654649253 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55704aa9e980 0x55704aa9ee00 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.463+0000 7f91ea837740 1 --2- 172.21.15.82:0/1654649253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55704aa9d7b0 0x55704aa9dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.463+0000 7f91ea837740 1 -- 172.21.15.82:0/1654649253 >> 172.21.15.82:0/1654649253 conn(0x55704aa98ba0 msgr2=0x55704aa98fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:59.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.464+0000 7f91ea837740 1 -- 172.21.15.82:0/1654649253 shutdown_connections 2024-03-04T09:14:59.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.464+0000 7f91ea837740 1 -- 172.21.15.82:0/1654649253 wait complete. 2024-03-04T09:14:59.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.464+0000 7f91ea837740 1 -- start start 2024-03-04T09:14:59.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.464+0000 7f91ea837740 1 Processor -- start 2024-03-04T09:14:59.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.464+0000 7f91ea837740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55704aa9d7b0 0x55704aaa7c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.464+0000 7f91ea837740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55704aa9e980 0x55704aaa81b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.464+0000 7f91ea837740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55704aa9f340 0x55704aaaf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.464+0000 7f91ea837740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55704aaa62f0 con 0x55704aa9e980 2024-03-04T09:14:59.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.464+0000 7f91ea837740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x55704a9beea0 con 0x55704aa9f340 2024-03-04T09:14:59.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.464+0000 7f91ea837740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55704aaa6470 con 0x55704aa9d7b0 2024-03-04T09:14:59.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.464+0000 7f91ea837740 10 client.0 _ll_register_callbacks cb 0x55704a9be870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-04T09:14:59.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.464+0000 7f91e5112640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55704aa9e980 0x55704aaa81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.464+0000 7f91e5112640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55704aa9e980 0x55704aaa81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33954/0 (socket says 172.21.15.82:33954) 2024-03-04T09:14:59.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.465+0000 7f91e6114640 1 --2- 172.21.15.82:0/2528083747 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55704aa9f340 0x55704aaaf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.465+0000 7f91e5112640 1 -- 172.21.15.82:0/2528083747 learned_addr learned my addr 172.21.15.82:0/2528083747 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:59.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.465+0000 7f91e5913640 1 --2- 172.21.15.82:0/2528083747 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55704aa9d7b0 0x55704aaa7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.465+0000 7f91e5112640 1 -- 172.21.15.82:0/2528083747 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55704aa9d7b0 msgr2=0x55704aaa7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:14:59.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.465+0000 7f91e5112640 1 --2- 172.21.15.82:0/2528083747 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55704aa9d7b0 0x55704aaa7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.465+0000 7f91e5112640 1 -- 172.21.15.82:0/2528083747 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55704aa9f340 msgr2=0x55704aaaf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:14:59.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.465+0000 7f91e5112640 1 --2- 172.21.15.82:0/2528083747 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55704aa9f340 0x55704aaaf1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.465+0000 7f91e5112640 1 -- 172.21.15.82:0/2528083747 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55704a9bf270 con 0x55704aa9e980 2024-03-04T09:14:59.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.465+0000 7f91e6114640 1 --2- 172.21.15.82:0/2528083747 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55704aa9f340 0x55704aaaf1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:14:59.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.465+0000 7f91e5913640 1 --2- 172.21.15.82:0/2528083747 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55704aa9d7b0 0x55704aaa7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:14:59.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.465+0000 7f91e5112640 1 --2- 172.21.15.82:0/2528083747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55704aa9e980 0x55704aaa81b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f91dc097820 tx=0x7f91dc010f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5e70f2ed1933ef5 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:59.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.465+0000 7f91c97fa640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-04T09:14:59.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.465+0000 7f91c97fa640 1 -- 172.21.15.82:0/2528083747 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91dc09a7b0 con 0x55704aa9e980 2024-03-04T09:14:59.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.465+0000 7f91c97fa640 1 -- 172.21.15.82:0/2528083747 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9092+0+0 (secure 0 0 0) 0x7f91dc0ce1e0 con 0x55704aa9e980 2024-03-04T09:14:59.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.465+0000 7f91ea837740 1 -- 172.21.15.82:0/2528083747 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f91d002cac0 con 0x55704aa9e980 2024-03-04T09:14:59.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.465+0000 7f91c97fa640 1 -- 172.21.15.82:0/2528083747 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f91dc09b550 con 0x55704aa9e980 2024-03-04T09:14:59.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.465+0000 7f91ea837740 10 client.15228 fetch_fsmap learned FSMap version 27 2024-03-04T09:14:59.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.465+0000 7f91ea837740 1 -- 172.21.15.82:0/2528083747 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55704a7172d0 con 0x55704aa9e980 2024-03-04T09:14:59.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.465+0000 7f91c97fa640 1 -- 172.21.15.82:0/2528083747 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f91d002cac0 con 0x55704aa9e980 2024-03-04T09:14:59.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.466+0000 7f91c97fa640 1 -- 172.21.15.82:0/2528083747 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 27) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f91dc010430 con 0x55704aa9e980 2024-03-04T09:14:59.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.466+0000 7f91ea837740 10 client.15228 fetch_fsmap finished waiting for FSMap version 27 2024-03-04T09:14:59.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.466+0000 7f91ea837740 10 client.15228 resolve_mds: resolved name 'h' to daemon mds.h 2024-03-04T09:14:59.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.466+0000 7f91ea837740 20 client.15228 populate_metadata read hostname 'smithi082' 2024-03-04T09:14:59.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.466+0000 7f91ea837740 1 --2- 172.21.15.82:0/2528083747 >> [v2:172.21.15.102:6836/1210579527,v1:172.21.15.102:6837/1210579527] conn(0x55704aab47c0 0x55704aab3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.466+0000 7f91ea837740 4 client.15228 mds_command: new command op to 24449 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-04T09:14:59.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.466+0000 7f91ea837740 1 -- 172.21.15.82:0/2528083747 --> [v2:172.21.15.102:6836/1210579527,v1:172.21.15.102:6837/1210579527] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55704aa0fbf0 con 0x55704aab47c0 2024-03-04T09:14:59.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.466+0000 7f91e5913640 1 --2- 172.21.15.82:0/2528083747 >> [v2:172.21.15.102:6836/1210579527,v1:172.21.15.102:6837/1210579527] conn(0x55704aab47c0 0x55704aab3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.466+0000 7f91e5913640 1 --2- 172.21.15.82:0/2528083747 >> [v2:172.21.15.102:6836/1210579527,v1:172.21.15.102:6837/1210579527] conn(0x55704aab47c0 0x55704aab3860 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a742d5368c6f3e03 server_cookie=87bbda845d214ea in_seq=0 out_seq=0 2024-03-04T09:14:59.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.466+0000 7f91c97fa640 10 client.15228 ms_handle_connect on v2:172.21.15.102:6836/1210579527 2024-03-04T09:14:59.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.467+0000 7f91c97fa640 1 -- 172.21.15.82:0/2528083747 <== mds.3 v2:172.21.15.102:6836/1210579527 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55704aa0fbf0 con 0x55704aab47c0 2024-03-04T09:14:59.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.467+0000 7f91c97fa640 10 client.15228 handle_command_reply: tid=0 2024-03-04T09:14:59.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.467+0000 7f91ea837740 1 client.15228 shutdown 2024-03-04T09:14:59.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.467+0000 7f91ea837740 1 -- 172.21.15.82:0/2528083747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55704aa9e980 msgr2=0x55704aaa81b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:59.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.467+0000 7f91ea837740 1 --2- 172.21.15.82:0/2528083747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55704aa9e980 0x55704aaa81b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f91dc097820 tx=0x7f91dc010f50 comp rx=0 tx=0).stop 2024-03-04T09:14:59.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.467+0000 7f91ea837740 1 -- 172.21.15.82:0/2528083747 shutdown_connections 2024-03-04T09:14:59.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.467+0000 7f91ea837740 1 --2- 172.21.15.82:0/2528083747 >> [v2:172.21.15.102:6836/1210579527,v1:172.21.15.102:6837/1210579527] conn(0x55704aab47c0 0x55704aab3860 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.467+0000 7f91ea837740 1 --2- 172.21.15.82:0/2528083747 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55704aa9f340 0x55704aaaf1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.467+0000 7f91c97fa640 0 client.15228 ms_handle_reset on v2:172.21.15.102:6836/1210579527 2024-03-04T09:14:59.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.467+0000 7f91ea837740 1 --2- 172.21.15.82:0/2528083747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55704aa9e980 0x55704aaa81b0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.467+0000 7f91ea837740 1 --2- 172.21.15.82:0/2528083747 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55704aa9d7b0 0x55704aaa7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.467+0000 7f91ea837740 1 -- 172.21.15.82:0/2528083747 >> 172.21.15.82:0/2528083747 conn(0x55704aa98ba0 msgr2=0x55704aa97da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:59.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.467+0000 7f91ea837740 1 -- 172.21.15.82:0/2528083747 shutdown_connections 2024-03-04T09:14:59.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.467+0000 7f91ea837740 1 -- 172.21.15.82:0/2528083747 wait complete. 2024-03-04T09:14:59.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.467+0000 7f91ea837740 20 client.15228 trim_cache size 0 max 16384 2024-03-04T09:14:59.478 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:59 smithi082 ceph-mon[32880]: pgmap v345: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-04T09:14:59.479 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:59 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/3650621009' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:14:59.479 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:59 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/1033822579' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:14:59.479 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:14:59 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/3878471014' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:14:59.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.484+0000 7f91ea837740 1 Processor -- start 2024-03-04T09:14:59.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.484+0000 7f91ea837740 1 -- start start 2024-03-04T09:14:59.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.484+0000 7f91ea837740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55704aa9d7b0 0x55704aaa7c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.484+0000 7f91ea837740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55704aa9e980 0x55704aaaf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.484+0000 7f91ea837740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55704aa9f340 0x55704aaa81b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.484+0000 7f91ea837740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55704aab3fe0 con 0x55704aa9e980 2024-03-04T09:14:59.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.484+0000 7f91ea837740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x55704aab4640 con 0x55704aa9f340 2024-03-04T09:14:59.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.484+0000 7f91ea837740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55704aab4ca0 con 0x55704aa9d7b0 2024-03-04T09:14:59.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.485+0000 7f91e5112640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55704aa9e980 0x55704aaaf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.485+0000 7f91e6114640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55704aa9f340 0x55704aaa81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.485+0000 7f91e5913640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55704aa9d7b0 0x55704aaa7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.485+0000 7f91e5112640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55704aa9e980 0x55704aaaf1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33962/0 (socket says 172.21.15.82:33962) 2024-03-04T09:14:59.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.485+0000 7f91e6114640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55704aa9f340 0x55704aaa81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.82:56070/0 (socket says 172.21.15.82:56070) 2024-03-04T09:14:59.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.485+0000 7f91e5112640 1 -- 172.21.15.82:0/1881847064 learned_addr learned my addr 172.21.15.82:0/1881847064 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:59.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.485+0000 7f91e5913640 1 -- 172.21.15.82:0/1881847064 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55704aa9f340 msgr2=0x55704aaa81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:14:59.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.485+0000 7f91e5913640 1 --2- 172.21.15.82:0/1881847064 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55704aa9f340 0x55704aaa81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.485+0000 7f91e5913640 1 -- 172.21.15.82:0/1881847064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55704aa9e980 msgr2=0x55704aaaf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:14:59.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.485+0000 7f91e5913640 1 --2- 172.21.15.82:0/1881847064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55704aa9e980 0x55704aaaf1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.485+0000 7f91e5913640 1 -- 172.21.15.82:0/1881847064 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55704a7e16b0 con 0x55704aa9d7b0 2024-03-04T09:14:59.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.485+0000 7f91e5913640 1 --2- 172.21.15.82:0/1881847064 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55704aa9d7b0 0x55704aaa7c70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f91d002c170 tx=0x7f91d0000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfc8fa57083699d5 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:59.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.485+0000 7f91cb7fe640 1 -- 172.21.15.82:0/1881847064 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d002ca40 con 0x55704aa9d7b0 2024-03-04T09:14:59.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.485+0000 7f91cb7fe640 1 -- 172.21.15.82:0/1881847064 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f91d0050020 con 0x55704aa9d7b0 2024-03-04T09:14:59.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.485+0000 7f91cb7fe640 1 -- 172.21.15.82:0/1881847064 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d0051d00 con 0x55704aa9d7b0 2024-03-04T09:14:59.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.486+0000 7f91ea837740 1 -- 172.21.15.82:0/1881847064 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55704aa9d7b0 msgr2=0x55704aaa7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:59.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.486+0000 7f91ea837740 1 --2- 172.21.15.82:0/1881847064 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55704aa9d7b0 0x55704aaa7c70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f91d002c170 tx=0x7f91d0000bc0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.486+0000 7f91ea837740 1 -- 172.21.15.82:0/1881847064 shutdown_connections 2024-03-04T09:14:59.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.486+0000 7f91ea837740 1 --2- 172.21.15.82:0/1881847064 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55704aa9f340 0x55704aaa81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.486+0000 7f91ea837740 1 --2- 172.21.15.82:0/1881847064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55704aa9e980 0x55704aaaf1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.486+0000 7f91ea837740 1 --2- 172.21.15.82:0/1881847064 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55704aa9d7b0 0x55704aaa7c70 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.486+0000 7f91ea837740 1 -- 172.21.15.82:0/1881847064 >> 172.21.15.82:0/1881847064 conn(0x55704aa98ba0 msgr2=0x55704aaa24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:59.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.486+0000 7f91ea837740 1 -- 172.21.15.82:0/1881847064 shutdown_connections 2024-03-04T09:14:59.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.486+0000 7f91ea837740 1 -- 172.21.15.82:0/1881847064 wait complete. 2024-03-04T09:14:59.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.486+0000 7f91ea837740 1 -- start start 2024-03-04T09:14:59.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.486+0000 7f91ea837740 1 Processor -- start 2024-03-04T09:14:59.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.487+0000 7f91ea837740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55704aa9d7b0 0x55704aaab340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.487+0000 7f91ea837740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55704aa9e980 0x55704aaab880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.487+0000 7f91ea837740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55704aa9f340 0x55704aaae520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.487+0000 7f91ea837740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55704aab5960 con 0x55704aa9d7b0 2024-03-04T09:14:59.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.487+0000 7f91ea837740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x55704aab5300 con 0x55704aa9e980 2024-03-04T09:14:59.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.487+0000 7f91ea837740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55704aab5fc0 con 0x55704aa9f340 2024-03-04T09:14:59.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.487+0000 7f91ea837740 10 client.0 _ll_register_callbacks cb 0x7f91dc009700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-04T09:14:59.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.487+0000 7f91e5913640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55704aa9d7b0 0x55704aaab340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.487+0000 7f91e5112640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55704aa9e980 0x55704aaab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.487+0000 7f91e5913640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55704aa9d7b0 0x55704aaab340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33972/0 (socket says 172.21.15.82:33972) 2024-03-04T09:14:59.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.487+0000 7f91e5913640 1 -- 172.21.15.82:0/3873714275 learned_addr learned my addr 172.21.15.82:0/3873714275 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:59.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.487+0000 7f91e6114640 1 --2- 172.21.15.82:0/3873714275 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55704aa9f340 0x55704aaae520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.487+0000 7f91e5913640 1 -- 172.21.15.82:0/3873714275 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55704aa9f340 msgr2=0x55704aaae520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:14:59.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.487+0000 7f91e5913640 1 --2- 172.21.15.82:0/3873714275 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55704aa9f340 0x55704aaae520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.487+0000 7f91e5913640 1 -- 172.21.15.82:0/3873714275 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55704aa9e980 msgr2=0x55704aaab880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:14:59.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.487+0000 7f91e5913640 1 --2- 172.21.15.82:0/3873714275 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55704aa9e980 0x55704aaab880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.487+0000 7f91e5913640 1 -- 172.21.15.82:0/3873714275 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55704aaaeb60 con 0x55704aa9d7b0 2024-03-04T09:14:59.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.487+0000 7f91e5112640 1 --2- 172.21.15.82:0/3873714275 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55704aa9e980 0x55704aaab880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:14:59.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.487+0000 7f91e5913640 1 --2- 172.21.15.82:0/3873714275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55704aa9d7b0 0x55704aaab340 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f91d00518f0 tx=0x7f91d0005e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27614ff32e0b20ef server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:59.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.487+0000 7f91c97fa640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-04T09:14:59.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.487+0000 7f91c97fa640 1 -- 172.21.15.82:0/3873714275 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d0051ca0 con 0x55704aa9d7b0 2024-03-04T09:14:59.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.487+0000 7f91c97fa640 1 -- 172.21.15.82:0/3873714275 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9092+0+0 (secure 0 0 0) 0x7f91d0004040 con 0x55704aa9d7b0 2024-03-04T09:14:59.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.487+0000 7f91ea837740 1 -- 172.21.15.82:0/3873714275 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f91d0050020 con 0x55704aa9d7b0 2024-03-04T09:14:59.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.488+0000 7f91c97fa640 1 -- 172.21.15.82:0/3873714275 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f91d0063050 con 0x55704aa9d7b0 2024-03-04T09:14:59.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.488+0000 7f91ea837740 10 client.15234 fetch_fsmap learned FSMap version 27 2024-03-04T09:14:59.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.488+0000 7f91ea837740 1 -- 172.21.15.82:0/3873714275 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55704ab0ff60 con 0x55704aa9d7b0 2024-03-04T09:14:59.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.488+0000 7f91c97fa640 1 -- 172.21.15.82:0/3873714275 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f91d0050020 con 0x55704aa9d7b0 2024-03-04T09:14:59.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.488+0000 7f91c97fa640 1 -- 172.21.15.82:0/3873714275 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 27) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f91d0004260 con 0x55704aa9d7b0 2024-03-04T09:14:59.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.488+0000 7f91ea837740 10 client.15234 fetch_fsmap finished waiting for FSMap version 27 2024-03-04T09:14:59.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.488+0000 7f91ea837740 10 client.15234 resolve_mds: resolved name 'h' to daemon mds.h 2024-03-04T09:14:59.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.488+0000 7f91ea837740 20 client.15234 populate_metadata read hostname 'smithi082' 2024-03-04T09:14:59.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.488+0000 7f91ea837740 1 --2- 172.21.15.82:0/3873714275 >> [v2:172.21.15.102:6836/1210579527,v1:172.21.15.102:6837/1210579527] conn(0x55704ab11ab0 0x55704ab10130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.488+0000 7f91ea837740 4 client.15234 mds_command: new command op to 24449 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-04T09:14:59.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.488+0000 7f91ea837740 1 -- 172.21.15.82:0/3873714275 --> [v2:172.21.15.102:6836/1210579527,v1:172.21.15.102:6837/1210579527] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55704aa09f40 con 0x55704ab11ab0 2024-03-04T09:14:59.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.488+0000 7f91e5112640 1 --2- 172.21.15.82:0/3873714275 >> [v2:172.21.15.102:6836/1210579527,v1:172.21.15.102:6837/1210579527] conn(0x55704ab11ab0 0x55704ab10130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.489+0000 7f91e5112640 1 --2- 172.21.15.82:0/3873714275 >> [v2:172.21.15.102:6836/1210579527,v1:172.21.15.102:6837/1210579527] conn(0x55704ab11ab0 0x55704ab10130 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=166413252eba11f6 server_cookie=5e2d746dfbb958ff in_seq=0 out_seq=0 2024-03-04T09:14:59.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.489+0000 7f91c97fa640 10 client.15234 ms_handle_connect on v2:172.21.15.102:6836/1210579527 2024-03-04T09:14:59.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.489+0000 7f91c97fa640 1 -- 172.21.15.82:0/3873714275 <== mds.3 v2:172.21.15.102:6836/1210579527 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55704aa09f40 con 0x55704ab11ab0 2024-03-04T09:14:59.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.489+0000 7f91c97fa640 10 client.15234 handle_command_reply: tid=0 2024-03-04T09:14:59.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.489+0000 7f91ea837740 1 client.15234 shutdown 2024-03-04T09:14:59.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.489+0000 7f91ea837740 1 -- 172.21.15.82:0/3873714275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55704aa9d7b0 msgr2=0x55704aaab340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:59.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.489+0000 7f91ea837740 1 --2- 172.21.15.82:0/3873714275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55704aa9d7b0 0x55704aaab340 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f91d00518f0 tx=0x7f91d0005e10 comp rx=0 tx=0).stop 2024-03-04T09:14:59.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.489+0000 7f91ea837740 1 -- 172.21.15.82:0/3873714275 shutdown_connections 2024-03-04T09:14:59.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.489+0000 7f91ea837740 1 --2- 172.21.15.82:0/3873714275 >> [v2:172.21.15.102:6836/1210579527,v1:172.21.15.102:6837/1210579527] conn(0x55704ab11ab0 0x55704ab10130 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.489+0000 7f91ea837740 1 --2- 172.21.15.82:0/3873714275 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55704aa9f340 0x55704aaae520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.489+0000 7f91c97fa640 0 client.15234 ms_handle_reset on v2:172.21.15.102:6836/1210579527 2024-03-04T09:14:59.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.489+0000 7f91ea837740 1 --2- 172.21.15.82:0/3873714275 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55704aa9e980 0x55704aaab880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.489+0000 7f91ea837740 1 --2- 172.21.15.82:0/3873714275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55704aa9d7b0 0x55704aaab340 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.489+0000 7f91ea837740 1 -- 172.21.15.82:0/3873714275 >> 172.21.15.82:0/3873714275 conn(0x55704aa98ba0 msgr2=0x55704aaa7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:59.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.489+0000 7f91ea837740 1 -- 172.21.15.82:0/3873714275 shutdown_connections 2024-03-04T09:14:59.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.489+0000 7f91ea837740 1 -- 172.21.15.82:0/3873714275 wait complete. 2024-03-04T09:14:59.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.489+0000 7f91ea837740 20 client.15234 trim_cache size 0 max 16384 2024-03-04T09:14:59.495 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-04T09:14:59.495 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "2e533fc8-da06-11ee-95c6-87774f69a715", 2024-03-04T09:14:59.495 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 3, 2024-03-04T09:14:59.495 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24449, 2024-03-04T09:14:59.495 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-03-04T09:14:59.495 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-03-04T09:14:59.495 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-03-04T09:14:59.495 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 83.120695420999994, 2024-03-04T09:14:59.495 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 27, 2024-03-04T09:14:59.495 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 92, 2024-03-04T09:14:59.495 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 90, 2024-03-04T09:14:59.495 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 125.432474713 2024-03-04T09:14:59.496 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-04T09:14:59.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.490+0000 7f91e7b77640 1 -- 172.21.15.82:0/957271196 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f91cc0a1d80 msgr2=0x7f91cc0a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:59.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.490+0000 7f91e7b77640 1 --2- 172.21.15.82:0/957271196 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f91cc0a1d80 0x7f91cc0a4240 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x55704aa9e880 tx=0x7f91d8009500 comp rx=0 tx=0).stop 2024-03-04T09:14:59.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.490+0000 7f91e7b77640 1 -- 172.21.15.82:0/957271196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91e01016c0 msgr2=0x7f91e0197eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:59.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.490+0000 7f91e7b77640 1 --2- 172.21.15.82:0/957271196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91e01016c0 0x7f91e0197eb0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f91dc00e9f0 tx=0x7f91dc00edf0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.490+0000 7f91e7b77640 1 -- 172.21.15.82:0/957271196 shutdown_connections 2024-03-04T09:14:59.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.490+0000 7f91e7b77640 1 --2- 172.21.15.82:0/957271196 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f91cc0a1d80 0x7f91cc0a4240 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.490+0000 7f91e7b77640 1 --2- 172.21.15.82:0/957271196 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91e0102080 0x7f91e019ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.490+0000 7f91e7b77640 1 --2- 172.21.15.82:0/957271196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91e01016c0 0x7f91e0197eb0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.490+0000 7f91e7b77640 1 --2- 172.21.15.82:0/957271196 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91e01004d0 0x7f91e0197970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.490+0000 7f91e7b77640 1 -- 172.21.15.82:0/957271196 >> 172.21.15.82:0/957271196 conn(0x7f91e00fba60 msgr2=0x7f91e00fc110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:59.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.490+0000 7f91e7b77640 1 -- 172.21.15.82:0/957271196 shutdown_connections 2024-03-04T09:14:59.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.490+0000 7f91e7b77640 1 -- 172.21.15.82:0/957271196 wait complete. 2024-03-04T09:14:59.498 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-03-04T09:14:59.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.608+0000 7fef6c2df640 1 -- 172.21.15.82:0/899983659 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef64100820 msgr2=0x7fef64100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:59.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.608+0000 7fef6c2df640 1 --2- 172.21.15.82:0/899983659 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef64100820 0x7fef64100c80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fef54009900 tx=0x7fef5402bcd0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.608+0000 7fef6c2df640 1 -- 172.21.15.82:0/899983659 shutdown_connections 2024-03-04T09:14:59.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.608+0000 7fef6c2df640 1 --2- 172.21.15.82:0/899983659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef641011c0 0x7fef64101640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.608+0000 7fef6c2df640 1 --2- 172.21.15.82:0/899983659 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef64100820 0x7fef64100c80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.608+0000 7fef6c2df640 1 --2- 172.21.15.82:0/899983659 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef640ffec0 0x7fef641002e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.608+0000 7fef6c2df640 1 -- 172.21.15.82:0/899983659 >> 172.21.15.82:0/899983659 conn(0x7fef640fba60 msgr2=0x7fef640fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:59.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.608+0000 7fef6c2df640 1 -- 172.21.15.82:0/899983659 shutdown_connections 2024-03-04T09:14:59.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.608+0000 7fef6c2df640 1 -- 172.21.15.82:0/899983659 wait complete. 2024-03-04T09:14:59.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.609+0000 7fef6c2df640 1 Processor -- start 2024-03-04T09:14:59.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.609+0000 7fef6c2df640 1 -- start start 2024-03-04T09:14:59.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.609+0000 7fef6c2df640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef640ffec0 0x7fef64199b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.609+0000 7fef6c2df640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef64100820 0x7fef6419a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.609+0000 7fef6c2df640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef641011c0 0x7fef641a10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.609+0000 7fef6c2df640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6410f430 con 0x7fef64100820 2024-03-04T09:14:59.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.609+0000 7fef6c2df640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6410f2b0 con 0x7fef641011c0 2024-03-04T09:14:59.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.609+0000 7fef6c2df640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6410f5b0 con 0x7fef640ffec0 2024-03-04T09:14:59.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.609+0000 7fef6987a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef64100820 0x7fef6419a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.609+0000 7fef6a07b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef640ffec0 0x7fef64199b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.609+0000 7fef6987a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef64100820 0x7fef6419a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33988/0 (socket says 172.21.15.82:33988) 2024-03-04T09:14:59.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.609+0000 7fef6987a640 1 -- 172.21.15.82:0/633250168 learned_addr learned my addr 172.21.15.82:0/633250168 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:59.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.609+0000 7fef6a87c640 1 --2- 172.21.15.82:0/633250168 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef641011c0 0x7fef641a10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.609+0000 7fef6987a640 1 -- 172.21.15.82:0/633250168 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef640ffec0 msgr2=0x7fef64199b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:59.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.609+0000 7fef6987a640 1 --2- 172.21.15.82:0/633250168 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef640ffec0 0x7fef64199b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.609+0000 7fef6987a640 1 -- 172.21.15.82:0/633250168 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef641011c0 msgr2=0x7fef641a10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:59.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.609+0000 7fef6987a640 1 --2- 172.21.15.82:0/633250168 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef641011c0 0x7fef641a10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.609+0000 7fef6987a640 1 -- 172.21.15.82:0/633250168 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef641a1730 con 0x7fef64100820 2024-03-04T09:14:59.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.610+0000 7fef6987a640 1 --2- 172.21.15.82:0/633250168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef64100820 0x7fef6419a050 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fef54009230 tx=0x7fef54005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:59.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.610+0000 7fef5b7fe640 1 -- 172.21.15.82:0/633250168 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef54043020 con 0x7fef64100820 2024-03-04T09:14:59.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.610+0000 7fef6c2df640 1 -- 172.21.15.82:0/633250168 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef641a19c0 con 0x7fef64100820 2024-03-04T09:14:59.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.610+0000 7fef5b7fe640 1 -- 172.21.15.82:0/633250168 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fef540053f0 con 0x7fef64100820 2024-03-04T09:14:59.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.610+0000 7fef5b7fe640 1 -- 172.21.15.82:0/633250168 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef54003ac0 con 0x7fef64100820 2024-03-04T09:14:59.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.610+0000 7fef6c2df640 1 -- 172.21.15.82:0/633250168 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef641a1f60 con 0x7fef64100820 2024-03-04T09:14:59.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.613+0000 7fef6ef9e740 1 Processor -- start 2024-03-04T09:14:59.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.613+0000 7fef6ef9e740 1 -- start start 2024-03-04T09:14:59.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.613+0000 7fef6ef9e740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5561ad2cd7b0 0x5561ad2cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.613+0000 7fef6ef9e740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5561ad2ce980 0x5561ad2cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.613+0000 7fef6ef9e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561ad2cf340 0x5561ad2d5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.613+0000 7fef6ef9e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561ad2326b0 con 0x5561ad2cf340 2024-03-04T09:14:59.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.613+0000 7fef6ef9e740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561ad1dba60 con 0x5561ad2ce980 2024-03-04T09:14:59.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.613+0000 7fef6ef9e740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561ad22e750 con 0x5561ad2cd7b0 2024-03-04T09:14:59.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.613+0000 7fef6a87c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5561ad2cd7b0 0x5561ad2cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.613+0000 7fef6a87c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5561ad2cd7b0 0x5561ad2cdbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.82:49288/0 (socket says 172.21.15.82:49288) 2024-03-04T09:14:59.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.613+0000 7fef6a87c640 1 -- 172.21.15.82:0/4228425718 learned_addr learned my addr 172.21.15.82:0/4228425718 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:59.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.613+0000 7fef6a07b640 1 --2- 172.21.15.82:0/4228425718 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5561ad2ce980 0x5561ad2cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.613+0000 7fef6a07b640 1 -- 172.21.15.82:0/4228425718 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5561ad2cd7b0 msgr2=0x5561ad2cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:14:59.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.613+0000 7fef6a07b640 1 --2- 172.21.15.82:0/4228425718 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5561ad2cd7b0 0x5561ad2cdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.613+0000 7fef5b7fe640 1 -- 172.21.15.82:0/633250168 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 136756+0+0 (secure 0 0 0) 0x7fef54046020 con 0x7fef64100820 2024-03-04T09:14:59.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.613+0000 7fef6a07b640 1 -- 172.21.15.82:0/4228425718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561ad2cf340 msgr2=0x5561ad2d5bd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-04T09:14:59.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.613+0000 7fef6a07b640 1 --2- 172.21.15.82:0/4228425718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561ad2cf340 0x5561ad2d5bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.613+0000 7fef6a07b640 1 -- 172.21.15.82:0/4228425718 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561ad1f9f30 con 0x5561ad2ce980 2024-03-04T09:14:59.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.613+0000 7fef6a87c640 1 --2- 172.21.15.82:0/4228425718 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5561ad2cd7b0 0x5561ad2cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:14:59.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.614+0000 7fef6a07b640 1 --2- 172.21.15.82:0/4228425718 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5561ad2ce980 0x5561ad2cee00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fef60009c20 tx=0x7fef60011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1537831d8a5cc12 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:59.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.614+0000 7fef58bfe640 1 -- 172.21.15.82:0/4228425718 <== mon.2 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef60004050 con 0x5561ad2ce980 2024-03-04T09:14:59.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.614+0000 7fef58bfe640 1 -- 172.21.15.82:0/4228425718 <== mon.2 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fef600054f0 con 0x5561ad2ce980 2024-03-04T09:14:59.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.614+0000 7fef58bfe640 1 -- 172.21.15.82:0/4228425718 <== mon.2 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef60004d60 con 0x5561ad2ce980 2024-03-04T09:14:59.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.614+0000 7fef5b7fe640 1 --2- 172.21.15.82:0/633250168 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fef500a1d80 0x7fef500a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.614+0000 7fef6a87c640 1 --2- 172.21.15.82:0/633250168 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fef500a1d80 0x7fef500a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.614+0000 7fef5b7fe640 1 -- 172.21.15.82:0/633250168 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9092+0+0 (secure 0 0 0) 0x7fef540f0220 con 0x7fef64100820 2024-03-04T09:14:59.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.615+0000 7fef6ef9e740 1 -- 172.21.15.82:0/4228425718 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5561ad2ce980 msgr2=0x5561ad2cee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:59.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.615+0000 7fef6ef9e740 1 --2- 172.21.15.82:0/4228425718 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5561ad2ce980 0x5561ad2cee00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fef60009c20 tx=0x7fef60011810 comp rx=0 tx=0).stop 2024-03-04T09:14:59.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.615+0000 7fef6ef9e740 1 -- 172.21.15.82:0/4228425718 shutdown_connections 2024-03-04T09:14:59.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.615+0000 7fef6ef9e740 1 --2- 172.21.15.82:0/4228425718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561ad2cf340 0x5561ad2d5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.615+0000 7fef6ef9e740 1 --2- 172.21.15.82:0/4228425718 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5561ad2ce980 0x5561ad2cee00 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.615+0000 7fef6ef9e740 1 --2- 172.21.15.82:0/4228425718 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5561ad2cd7b0 0x5561ad2cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.615+0000 7fef6ef9e740 1 -- 172.21.15.82:0/4228425718 >> 172.21.15.82:0/4228425718 conn(0x5561ad2c8ba0 msgr2=0x5561ad2c8fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:59.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.615+0000 7fef6a87c640 1 --2- 172.21.15.82:0/633250168 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fef500a1d80 0x7fef500a4240 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x5561ad2ce880 tx=0x7fef5c009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:59.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.615+0000 7fef6ef9e740 1 -- 172.21.15.82:0/4228425718 shutdown_connections 2024-03-04T09:14:59.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.615+0000 7fef6ef9e740 1 -- 172.21.15.82:0/4228425718 wait complete. 2024-03-04T09:14:59.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.615+0000 7fef6ef9e740 1 -- start start 2024-03-04T09:14:59.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.615+0000 7fef6ef9e740 1 Processor -- start 2024-03-04T09:14:59.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.615+0000 7fef6ef9e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561ad2cd7b0 0x5561ad2d7d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.615+0000 7fef6ef9e740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5561ad2ce980 0x5561ad2d8270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.616+0000 7fef6ef9e740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5561ad2cf340 0x5561ad2df2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.616+0000 7fef6ef9e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561ad2d6350 con 0x5561ad2cd7b0 2024-03-04T09:14:59.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.616+0000 7fef6ef9e740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561ad1eeea0 con 0x5561ad2ce980 2024-03-04T09:14:59.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.616+0000 7fef6ef9e740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561ad2d64d0 con 0x5561ad2cf340 2024-03-04T09:14:59.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.616+0000 7fef6a07b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561ad2cd7b0 0x5561ad2d7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.616+0000 7fef6ef9e740 10 client.0 _ll_register_callbacks cb 0x5561ad1ee870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-04T09:14:59.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.616+0000 7fef6987a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5561ad2ce980 0x5561ad2d8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.616+0000 7fef6a87c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5561ad2cf340 0x5561ad2df2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.616+0000 7fef6987a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5561ad2ce980 0x5561ad2d8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.82:56120/0 (socket says 172.21.15.82:56120) 2024-03-04T09:14:59.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.616+0000 7fef6a87c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5561ad2cf340 0x5561ad2df2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.82:49290/0 (socket says 172.21.15.82:49290) 2024-03-04T09:14:59.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.616+0000 7fef6a07b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561ad2cd7b0 0x5561ad2d7d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34000/0 (socket says 172.21.15.82:34000) 2024-03-04T09:14:59.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.616+0000 7fef6987a640 1 -- 172.21.15.82:0/2403657405 learned_addr learned my addr 172.21.15.82:0/2403657405 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:59.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.616+0000 7fef6987a640 1 -- 172.21.15.82:0/2403657405 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5561ad2cf340 msgr2=0x5561ad2df2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:14:59.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.616+0000 7fef6987a640 1 --2- 172.21.15.82:0/2403657405 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5561ad2cf340 0x5561ad2df2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.616+0000 7fef6987a640 1 -- 172.21.15.82:0/2403657405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561ad2cd7b0 msgr2=0x5561ad2d7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:14:59.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.616+0000 7fef6987a640 1 --2- 172.21.15.82:0/2403657405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561ad2cd7b0 0x5561ad2d7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.616+0000 7fef6987a640 1 -- 172.21.15.82:0/2403657405 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5561ad1ef270 con 0x5561ad2ce980 2024-03-04T09:14:59.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.616+0000 7fef6987a640 1 --2- 172.21.15.82:0/2403657405 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5561ad2ce980 0x5561ad2d8270 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fef540bc8f0 tx=0x7fef540bc550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5236a264b8e5fb20 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:59.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.616+0000 7fef4dffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-03-04T09:14:59.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.616+0000 7fef4dffb640 1 -- 172.21.15.82:0/2403657405 <== mon.2 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef54004350 con 0x5561ad2ce980 2024-03-04T09:14:59.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.616+0000 7fef6ef9e740 1 -- 172.21.15.82:0/2403657405 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fef600054f0 con 0x5561ad2ce980 2024-03-04T09:14:59.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.616+0000 7fef4dffb640 1 -- 172.21.15.82:0/2403657405 <== mon.2 v2:172.21.15.102:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9092+0+0 (secure 0 0 0) 0x7fef54003c60 con 0x5561ad2ce980 2024-03-04T09:14:59.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.616+0000 7fef4dffb640 1 -- 172.21.15.82:0/2403657405 <== mon.2 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef54003e60 con 0x5561ad2ce980 2024-03-04T09:14:59.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.617+0000 7fef6ef9e740 10 client.25073 fetch_fsmap learned FSMap version 27 2024-03-04T09:14:59.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.617+0000 7fef6ef9e740 1 -- 172.21.15.82:0/2403657405 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5561acf472d0 con 0x5561ad2ce980 2024-03-04T09:14:59.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.617+0000 7fef4dffb640 1 -- 172.21.15.82:0/2403657405 <== mon.2 v2:172.21.15.102:3300/0 4 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fef600054f0 con 0x5561ad2ce980 2024-03-04T09:14:59.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.617+0000 7fef4dffb640 1 -- 172.21.15.82:0/2403657405 <== mon.2 v2:172.21.15.102:3300/0 5 ==== fsmap(e 27) v1 ==== 7942+0+0 (secure 0 0 0) 0x7fef54004f20 con 0x5561ad2ce980 2024-03-04T09:14:59.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.617+0000 7fef6ef9e740 10 client.25073 fetch_fsmap finished waiting for FSMap version 27 2024-03-04T09:14:59.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.617+0000 7fef6ef9e740 10 client.25073 resolve_mds: resolved name 'c' to daemon mds.c 2024-03-04T09:14:59.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.617+0000 7fef6ef9e740 20 client.25073 populate_metadata read hostname 'smithi082' 2024-03-04T09:14:59.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.617+0000 7fef6ef9e740 1 --2- 172.21.15.82:0/2403657405 >> [v2:172.21.15.190:6836/1198639527,v1:172.21.15.190:6837/1198639527] conn(0x5561ad2e4750 0x5561ad2e37a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.617+0000 7fef6ef9e740 4 client.25073 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-04T09:14:59.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.617+0000 7fef6ef9e740 1 -- 172.21.15.82:0/2403657405 --> [v2:172.21.15.190:6836/1198639527,v1:172.21.15.190:6837/1198639527] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5561ad23fbf0 con 0x5561ad2e4750 2024-03-04T09:14:59.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.617+0000 7fef6a07b640 1 --2- 172.21.15.82:0/2403657405 >> [v2:172.21.15.190:6836/1198639527,v1:172.21.15.190:6837/1198639527] conn(0x5561ad2e4750 0x5561ad2e37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.618+0000 7fef4dffb640 10 client.25073 ms_handle_connect on v2:172.21.15.190:6836/1198639527 2024-03-04T09:14:59.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.618+0000 7fef6a07b640 1 --2- 172.21.15.82:0/2403657405 >> [v2:172.21.15.190:6836/1198639527,v1:172.21.15.190:6837/1198639527] conn(0x5561ad2e4750 0x5561ad2e37a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e435144920bcf452 server_cookie=40c20b1603c4bf62 in_seq=0 out_seq=0 2024-03-04T09:14:59.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.618+0000 7fef4dffb640 1 -- 172.21.15.82:0/2403657405 <== mds.2 v2:172.21.15.190:6836/1198639527 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x5561ad23fbf0 con 0x5561ad2e4750 2024-03-04T09:14:59.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.618+0000 7fef4dffb640 10 client.25073 handle_command_reply: tid=0 2024-03-04T09:14:59.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.618+0000 7fef6ef9e740 1 client.25073 shutdown 2024-03-04T09:14:59.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.618+0000 7fef6ef9e740 1 -- 172.21.15.82:0/2403657405 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5561ad2ce980 msgr2=0x5561ad2d8270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:59.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.618+0000 7fef6ef9e740 1 --2- 172.21.15.82:0/2403657405 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5561ad2ce980 0x5561ad2d8270 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fef540bc8f0 tx=0x7fef540bc550 comp rx=0 tx=0).stop 2024-03-04T09:14:59.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.618+0000 7fef6ef9e740 1 -- 172.21.15.82:0/2403657405 shutdown_connections 2024-03-04T09:14:59.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.618+0000 7fef6ef9e740 1 --2- 172.21.15.82:0/2403657405 >> [v2:172.21.15.190:6836/1198639527,v1:172.21.15.190:6837/1198639527] conn(0x5561ad2e4750 0x5561ad2e37a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.618+0000 7fef6ef9e740 1 --2- 172.21.15.82:0/2403657405 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5561ad2cf340 0x5561ad2df2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.618+0000 7fef4dffb640 0 client.25073 ms_handle_reset on v2:172.21.15.190:6836/1198639527 2024-03-04T09:14:59.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.618+0000 7fef6ef9e740 1 --2- 172.21.15.82:0/2403657405 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5561ad2ce980 0x5561ad2d8270 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.618+0000 7fef6ef9e740 1 --2- 172.21.15.82:0/2403657405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561ad2cd7b0 0x5561ad2d7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.618+0000 7fef6ef9e740 1 -- 172.21.15.82:0/2403657405 >> 172.21.15.82:0/2403657405 conn(0x5561ad2c8ba0 msgr2=0x5561ad2c7da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:59.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.618+0000 7fef6ef9e740 1 -- 172.21.15.82:0/2403657405 shutdown_connections 2024-03-04T09:14:59.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.618+0000 7fef6ef9e740 1 -- 172.21.15.82:0/2403657405 wait complete. 2024-03-04T09:14:59.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.619+0000 7fef6ef9e740 20 client.25073 trim_cache size 0 max 16384 2024-03-04T09:14:59.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.635+0000 7fef6ef9e740 1 Processor -- start 2024-03-04T09:14:59.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.635+0000 7fef6ef9e740 1 -- start start 2024-03-04T09:14:59.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.635+0000 7fef6ef9e740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5561ad2cd7b0 0x5561ad2d1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.635+0000 7fef6ef9e740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5561ad2ce980 0x5561ad2df270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.635+0000 7fef6ef9e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561ad2cf340 0x5561ad2d2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.635+0000 7fef6ef9e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561ad2e3f70 con 0x5561ad2cf340 2024-03-04T09:14:59.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.635+0000 7fef6ef9e740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561ad2e45d0 con 0x5561ad2ce980 2024-03-04T09:14:59.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.635+0000 7fef6ef9e740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561ad2e4c30 con 0x5561ad2cd7b0 2024-03-04T09:14:59.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.636+0000 7fef6a07b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5561ad2cd7b0 0x5561ad2d1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.636+0000 7fef6a87c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561ad2cf340 0x5561ad2d2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.636+0000 7fef6987a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5561ad2ce980 0x5561ad2df270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.636+0000 7fef6a07b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5561ad2cd7b0 0x5561ad2d1980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.82:49296/0 (socket says 172.21.15.82:49296) 2024-03-04T09:14:59.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.636+0000 7fef6a07b640 1 -- 172.21.15.82:0/3044853800 learned_addr learned my addr 172.21.15.82:0/3044853800 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:59.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.636+0000 7fef6a07b640 1 -- 172.21.15.82:0/3044853800 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5561ad2ce980 msgr2=0x5561ad2df270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:14:59.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.636+0000 7fef6a07b640 1 --2- 172.21.15.82:0/3044853800 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5561ad2ce980 0x5561ad2df270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.636+0000 7fef6a07b640 1 -- 172.21.15.82:0/3044853800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561ad2cf340 msgr2=0x5561ad2d2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:14:59.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.636+0000 7fef6a07b640 1 --2- 172.21.15.82:0/3044853800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561ad2cf340 0x5561ad2d2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.636+0000 7fef6a07b640 1 -- 172.21.15.82:0/3044853800 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561ad0116b0 con 0x5561ad2cd7b0 2024-03-04T09:14:59.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.636+0000 7fef6a87c640 1 --2- 172.21.15.82:0/3044853800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561ad2cf340 0x5561ad2d2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:14:59.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.636+0000 7fef6987a640 1 --2- 172.21.15.82:0/3044853800 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5561ad2ce980 0x5561ad2df270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:14:59.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.636+0000 7fef6a07b640 1 --2- 172.21.15.82:0/3044853800 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5561ad2cd7b0 0x5561ad2d1980 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fef60009fd0 tx=0x7fef60005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e918b4f905cf89b server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:59.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.636+0000 7fef4ffff640 1 -- 172.21.15.82:0/3044853800 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef60033070 con 0x5561ad2cd7b0 2024-03-04T09:14:59.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.636+0000 7fef4ffff640 1 -- 172.21.15.82:0/3044853800 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fef6002ea70 con 0x5561ad2cd7b0 2024-03-04T09:14:59.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.636+0000 7fef4ffff640 1 -- 172.21.15.82:0/3044853800 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef600037f0 con 0x5561ad2cd7b0 2024-03-04T09:14:59.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.637+0000 7fef6ef9e740 1 -- 172.21.15.82:0/3044853800 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5561ad2cd7b0 msgr2=0x5561ad2d1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:59.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.637+0000 7fef6ef9e740 1 --2- 172.21.15.82:0/3044853800 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5561ad2cd7b0 0x5561ad2d1980 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fef60009fd0 tx=0x7fef60005f90 comp rx=0 tx=0).stop 2024-03-04T09:14:59.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.637+0000 7fef6ef9e740 1 -- 172.21.15.82:0/3044853800 shutdown_connections 2024-03-04T09:14:59.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.637+0000 7fef6ef9e740 1 --2- 172.21.15.82:0/3044853800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561ad2cf340 0x5561ad2d2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.637+0000 7fef6ef9e740 1 --2- 172.21.15.82:0/3044853800 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5561ad2ce980 0x5561ad2df270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.637+0000 7fef6ef9e740 1 --2- 172.21.15.82:0/3044853800 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5561ad2cd7b0 0x5561ad2d1980 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.637+0000 7fef6ef9e740 1 -- 172.21.15.82:0/3044853800 >> 172.21.15.82:0/3044853800 conn(0x5561ad2c8ba0 msgr2=0x5561ad2c8f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:59.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.637+0000 7fef6ef9e740 1 -- 172.21.15.82:0/3044853800 shutdown_connections 2024-03-04T09:14:59.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.637+0000 7fef6ef9e740 1 -- 172.21.15.82:0/3044853800 wait complete. 2024-03-04T09:14:59.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.637+0000 7fef6ef9e740 1 -- start start 2024-03-04T09:14:59.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.637+0000 7fef6ef9e740 1 Processor -- start 2024-03-04T09:14:59.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.638+0000 7fef6ef9e740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5561ad2cd7b0 0x5561ad2d9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.638+0000 7fef6ef9e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561ad2ce980 0x5561ad2df1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.638+0000 7fef6ef9e740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5561ad2cf340 0x5561ad2da200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.638+0000 7fef6ef9e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561ad2e58f0 con 0x5561ad2ce980 2024-03-04T09:14:59.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.638+0000 7fef6ef9e740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561ad2e5290 con 0x5561ad2cf340 2024-03-04T09:14:59.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.638+0000 7fef6ef9e740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561ad2e5f50 con 0x5561ad2cd7b0 2024-03-04T09:14:59.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.638+0000 7fef6ef9e740 10 client.0 _ll_register_callbacks cb 0x7fef540bc9c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-04T09:14:59.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.638+0000 7fef6987a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561ad2ce980 0x5561ad2df1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.638+0000 7fef6987a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561ad2ce980 0x5561ad2df1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34012/0 (socket says 172.21.15.82:34012) 2024-03-04T09:14:59.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.638+0000 7fef6987a640 1 -- 172.21.15.82:0/2784285581 learned_addr learned my addr 172.21.15.82:0/2784285581 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:59.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.638+0000 7fef6a87c640 1 --2- 172.21.15.82:0/2784285581 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5561ad2cf340 0x5561ad2da200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.638+0000 7fef6a07b640 1 --2- 172.21.15.82:0/2784285581 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5561ad2cd7b0 0x5561ad2d9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.638+0000 7fef6987a640 1 -- 172.21.15.82:0/2784285581 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5561ad2cd7b0 msgr2=0x5561ad2d9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:14:59.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.638+0000 7fef6987a640 1 --2- 172.21.15.82:0/2784285581 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5561ad2cd7b0 0x5561ad2d9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.638+0000 7fef6987a640 1 -- 172.21.15.82:0/2784285581 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5561ad2cf340 msgr2=0x5561ad2da200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:14:59.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.638+0000 7fef6987a640 1 --2- 172.21.15.82:0/2784285581 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5561ad2cf340 0x5561ad2da200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.638+0000 7fef6987a640 1 -- 172.21.15.82:0/2784285581 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5561ad33f7b0 con 0x5561ad2ce980 2024-03-04T09:14:59.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.638+0000 7fef6987a640 1 --2- 172.21.15.82:0/2784285581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561ad2ce980 0x5561ad2df1e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fef54004300 tx=0x7fef540b8f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45bb512382abece3 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:59.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.638+0000 7fef4dffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-04T09:14:59.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.638+0000 7fef4dffb640 1 -- 172.21.15.82:0/2784285581 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef540bd2f0 con 0x5561ad2ce980 2024-03-04T09:14:59.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.638+0000 7fef4dffb640 1 -- 172.21.15.82:0/2784285581 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9092+0+0 (secure 0 0 0) 0x7fef54004ea0 con 0x5561ad2ce980 2024-03-04T09:14:59.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.638+0000 7fef6ef9e740 1 -- 172.21.15.82:0/2784285581 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fef6002ea70 con 0x5561ad2ce980 2024-03-04T09:14:59.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.638+0000 7fef4dffb640 1 -- 172.21.15.82:0/2784285581 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef540bcbf0 con 0x5561ad2ce980 2024-03-04T09:14:59.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.638+0000 7fef6ef9e740 10 client.15249 fetch_fsmap learned FSMap version 27 2024-03-04T09:14:59.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.639+0000 7fef6ef9e740 1 -- 172.21.15.82:0/2784285581 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5561ad340a30 con 0x5561ad2ce980 2024-03-04T09:14:59.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.639+0000 7fef4dffb640 1 -- 172.21.15.82:0/2784285581 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fef6002ea70 con 0x5561ad2ce980 2024-03-04T09:14:59.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.639+0000 7fef4dffb640 1 -- 172.21.15.82:0/2784285581 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 27) v1 ==== 7942+0+0 (secure 0 0 0) 0x7fef540c1c60 con 0x5561ad2ce980 2024-03-04T09:14:59.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.639+0000 7fef6ef9e740 10 client.15249 fetch_fsmap finished waiting for FSMap version 27 2024-03-04T09:14:59.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.639+0000 7fef6ef9e740 10 client.15249 resolve_mds: resolved name 'c' to daemon mds.c 2024-03-04T09:14:59.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.639+0000 7fef6ef9e740 20 client.15249 populate_metadata read hostname 'smithi082' 2024-03-04T09:14:59.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.639+0000 7fef6ef9e740 1 --2- 172.21.15.82:0/2784285581 >> [v2:172.21.15.190:6836/1198639527,v1:172.21.15.190:6837/1198639527] conn(0x5561ad344d00 0x5561ad340a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.639+0000 7fef6ef9e740 4 client.15249 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-04T09:14:59.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.639+0000 7fef6ef9e740 1 -- 172.21.15.82:0/2784285581 --> [v2:172.21.15.190:6836/1198639527,v1:172.21.15.190:6837/1198639527] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5561ad239f40 con 0x5561ad344d00 2024-03-04T09:14:59.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.639+0000 7fef6a07b640 1 --2- 172.21.15.82:0/2784285581 >> [v2:172.21.15.190:6836/1198639527,v1:172.21.15.190:6837/1198639527] conn(0x5561ad344d00 0x5561ad340a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.639+0000 7fef6a07b640 1 --2- 172.21.15.82:0/2784285581 >> [v2:172.21.15.190:6836/1198639527,v1:172.21.15.190:6837/1198639527] conn(0x5561ad344d00 0x5561ad340a30 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bff101804f7202b8 server_cookie=ba90072ea151ed25 in_seq=0 out_seq=0 2024-03-04T09:14:59.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.639+0000 7fef4dffb640 10 client.15249 ms_handle_connect on v2:172.21.15.190:6836/1198639527 2024-03-04T09:14:59.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.640+0000 7fef4dffb640 1 -- 172.21.15.82:0/2784285581 <== mds.2 v2:172.21.15.190:6836/1198639527 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x5561ad239f40 con 0x5561ad344d00 2024-03-04T09:14:59.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.640+0000 7fef4dffb640 10 client.15249 handle_command_reply: tid=0 2024-03-04T09:14:59.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.640+0000 7fef6ef9e740 1 client.15249 shutdown 2024-03-04T09:14:59.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.640+0000 7fef6ef9e740 1 -- 172.21.15.82:0/2784285581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561ad2ce980 msgr2=0x5561ad2df1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:59.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.640+0000 7fef6ef9e740 1 --2- 172.21.15.82:0/2784285581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561ad2ce980 0x5561ad2df1e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fef54004300 tx=0x7fef540b8f60 comp rx=0 tx=0).stop 2024-03-04T09:14:59.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.640+0000 7fef6ef9e740 1 -- 172.21.15.82:0/2784285581 shutdown_connections 2024-03-04T09:14:59.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.640+0000 7fef6ef9e740 1 --2- 172.21.15.82:0/2784285581 >> [v2:172.21.15.190:6836/1198639527,v1:172.21.15.190:6837/1198639527] conn(0x5561ad344d00 0x5561ad340a30 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.640+0000 7fef6ef9e740 1 --2- 172.21.15.82:0/2784285581 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5561ad2cf340 0x5561ad2da200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.640+0000 7fef6ef9e740 1 --2- 172.21.15.82:0/2784285581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561ad2ce980 0x5561ad2df1e0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.640+0000 7fef4dffb640 0 client.15249 ms_handle_reset on v2:172.21.15.190:6836/1198639527 2024-03-04T09:14:59.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.640+0000 7fef6ef9e740 1 --2- 172.21.15.82:0/2784285581 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5561ad2cd7b0 0x5561ad2d9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.640+0000 7fef6ef9e740 1 -- 172.21.15.82:0/2784285581 >> 172.21.15.82:0/2784285581 conn(0x5561ad2c8ba0 msgr2=0x5561ad2d2530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:59.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.640+0000 7fef6ef9e740 1 -- 172.21.15.82:0/2784285581 shutdown_connections 2024-03-04T09:14:59.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.640+0000 7fef6ef9e740 1 -- 172.21.15.82:0/2784285581 wait complete. 2024-03-04T09:14:59.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.640+0000 7fef6ef9e740 20 client.15249 trim_cache size 0 max 16384 2024-03-04T09:14:59.645 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-04T09:14:59.645 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "2e533fc8-da06-11ee-95c6-87774f69a715", 2024-03-04T09:14:59.645 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 2, 2024-03-04T09:14:59.645 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24451, 2024-03-04T09:14:59.645 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-03-04T09:14:59.645 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-03-04T09:14:59.645 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-03-04T09:14:59.645 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 84.283261922999998, 2024-03-04T09:14:59.646 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 27, 2024-03-04T09:14:59.646 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 92, 2024-03-04T09:14:59.646 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 90, 2024-03-04T09:14:59.646 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 128.45477291200001 2024-03-04T09:14:59.646 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-04T09:14:59.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.640+0000 7fef6c2df640 1 -- 172.21.15.82:0/633250168 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fef500a1d80 msgr2=0x7fef500a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:59.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.640+0000 7fef6c2df640 1 --2- 172.21.15.82:0/633250168 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fef500a1d80 0x7fef500a4240 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x5561ad2ce880 tx=0x7fef5c009500 comp rx=0 tx=0).stop 2024-03-04T09:14:59.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.640+0000 7fef6c2df640 1 -- 172.21.15.82:0/633250168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef64100820 msgr2=0x7fef6419a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:59.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.640+0000 7fef6c2df640 1 --2- 172.21.15.82:0/633250168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef64100820 0x7fef6419a050 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fef54009230 tx=0x7fef54005dd0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.640+0000 7fef6c2df640 1 -- 172.21.15.82:0/633250168 shutdown_connections 2024-03-04T09:14:59.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.640+0000 7fef6c2df640 1 --2- 172.21.15.82:0/633250168 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fef500a1d80 0x7fef500a4240 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.640+0000 7fef6c2df640 1 --2- 172.21.15.82:0/633250168 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef641011c0 0x7fef641a10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.640+0000 7fef6c2df640 1 --2- 172.21.15.82:0/633250168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef64100820 0x7fef6419a050 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.640+0000 7fef6c2df640 1 --2- 172.21.15.82:0/633250168 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef640ffec0 0x7fef64199b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.640+0000 7fef6c2df640 1 -- 172.21.15.82:0/633250168 >> 172.21.15.82:0/633250168 conn(0x7fef640fba60 msgr2=0x7fef640fd200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:59.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.641+0000 7fef6c2df640 1 -- 172.21.15.82:0/633250168 shutdown_connections 2024-03-04T09:14:59.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.641+0000 7fef6c2df640 1 -- 172.21.15.82:0/633250168 wait complete. 2024-03-04T09:14:59.649 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-03-04T09:14:59.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:59 smithi190 ceph-mon[36341]: pgmap v345: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-04T09:14:59.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:59 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/3650621009' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:14:59.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:59 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/1033822579' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:14:59.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:14:59 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/3878471014' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:14:59.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:59 smithi102 ceph-mon[36220]: pgmap v345: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-04T09:14:59.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:59 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/3650621009' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:14:59.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:59 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/1033822579' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:14:59.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:14:59 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/3878471014' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:14:59.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.758+0000 7fb801a15640 1 -- 172.21.15.82:0/52417172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7fc102080 msgr2=0x7fb7fc108910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:59.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.758+0000 7fb801a15640 1 --2- 172.21.15.82:0/52417172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7fc102080 0x7fb7fc108910 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4009ca0 tx=0x7fb7f402c0f0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.758+0000 7fb801a15640 1 -- 172.21.15.82:0/52417172 shutdown_connections 2024-03-04T09:14:59.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.758+0000 7fb801a15640 1 --2- 172.21.15.82:0/52417172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7fc102080 0x7fb7fc108910 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.758+0000 7fb801a15640 1 --2- 172.21.15.82:0/52417172 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb7fc1016c0 0x7fb7fc101b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.758+0000 7fb801a15640 1 --2- 172.21.15.82:0/52417172 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb7fc1004d0 0x7fb7fc1008f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.758+0000 7fb801a15640 1 -- 172.21.15.82:0/52417172 >> 172.21.15.82:0/52417172 conn(0x7fb7fc0fba60 msgr2=0x7fb7fc0fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:59.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.759+0000 7fb801a15640 1 -- 172.21.15.82:0/52417172 shutdown_connections 2024-03-04T09:14:59.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.759+0000 7fb801a15640 1 -- 172.21.15.82:0/52417172 wait complete. 2024-03-04T09:14:59.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.759+0000 7fb801a15640 1 Processor -- start 2024-03-04T09:14:59.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.759+0000 7fb801a15640 1 -- start start 2024-03-04T09:14:59.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.759+0000 7fb801a15640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb7fc1004d0 0x7fb7fc1967d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.759+0000 7fb801a15640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb7fc1016c0 0x7fb7fc196d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.759+0000 7fb801a15640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7fc102080 0x7fb7fc19dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.759+0000 7fb801a15640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc10c130 con 0x7fb7fc102080 2024-03-04T09:14:59.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.759+0000 7fb801a15640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc10bfb0 con 0x7fb7fc1004d0 2024-03-04T09:14:59.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.759+0000 7fb801a15640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc10c2b0 con 0x7fb7fc1016c0 2024-03-04T09:14:59.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.760+0000 7fb7fb7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7fc102080 0x7fb7fc19dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.760+0000 7fb7fa7fc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb7fc1016c0 0x7fb7fc196d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.760+0000 7fb7faffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb7fc1004d0 0x7fb7fc1967d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.760+0000 7fb7fa7fc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb7fc1016c0 0x7fb7fc196d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.82:49308/0 (socket says 172.21.15.82:49308) 2024-03-04T09:14:59.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.760+0000 7fb7fa7fc640 1 -- 172.21.15.82:0/2871539071 learned_addr learned my addr 172.21.15.82:0/2871539071 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:59.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.760+0000 7fb7fb7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7fc102080 0x7fb7fc19dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34024/0 (socket says 172.21.15.82:34024) 2024-03-04T09:14:59.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.760+0000 7fb7fa7fc640 1 -- 172.21.15.82:0/2871539071 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb7fc1004d0 msgr2=0x7fb7fc1967d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:59.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.760+0000 7fb7fa7fc640 1 --2- 172.21.15.82:0/2871539071 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb7fc1004d0 0x7fb7fc1967d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.760+0000 7fb7fa7fc640 1 -- 172.21.15.82:0/2871539071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7fc102080 msgr2=0x7fb7fc19dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:59.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.760+0000 7fb7fa7fc640 1 --2- 172.21.15.82:0/2871539071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7fc102080 0x7fb7fc19dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.760+0000 7fb7fa7fc640 1 -- 172.21.15.82:0/2871539071 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7fc19e3f0 con 0x7fb7fc1016c0 2024-03-04T09:14:59.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.760+0000 7fb7fa7fc640 1 --2- 172.21.15.82:0/2871539071 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb7fc1016c0 0x7fb7fc196d10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb7f000eb00 tx=0x7fb7f000ef00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:59.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.760+0000 7fb800a13640 1 -- 172.21.15.82:0/2871539071 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f000bc30 con 0x7fb7fc1016c0 2024-03-04T09:14:59.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.760+0000 7fb801a15640 1 -- 172.21.15.82:0/2871539071 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7fc068790 con 0x7fb7fc1016c0 2024-03-04T09:14:59.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.760+0000 7fb800a13640 1 -- 172.21.15.82:0/2871539071 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fb7f000bdd0 con 0x7fb7fc1016c0 2024-03-04T09:14:59.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.760+0000 7fb800a13640 1 -- 172.21.15.82:0/2871539071 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f0017410 con 0x7fb7fc1016c0 2024-03-04T09:14:59.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.760+0000 7fb801a15640 1 -- 172.21.15.82:0/2871539071 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7fc068c90 con 0x7fb7fc1016c0 2024-03-04T09:14:59.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.762+0000 7fb800a13640 1 -- 172.21.15.82:0/2871539071 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 18) v1 ==== 136756+0+0 (secure 0 0 0) 0x7fb7f0005000 con 0x7fb7fc1016c0 2024-03-04T09:14:59.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.763+0000 7fb804600740 1 Processor -- start 2024-03-04T09:14:59.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.763+0000 7fb804600740 1 -- start start 2024-03-04T09:14:59.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.763+0000 7fb804600740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a9f58137b0 0x55a9f5813bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.763+0000 7fb804600740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a9f5814980 0x55a9f5814e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.763+0000 7fb804600740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9f5815340 0x55a9f581bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.763+0000 7fb804600740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9f57786b0 con 0x55a9f5814980 2024-03-04T09:14:59.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.763+0000 7fb804600740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9f5721a60 con 0x55a9f58137b0 2024-03-04T09:14:59.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.763+0000 7fb804600740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9f5774750 con 0x55a9f5815340 2024-03-04T09:14:59.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.763+0000 7fb7faffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a9f5814980 0x55a9f5814e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.763+0000 7fb7faffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a9f5814980 0x55a9f5814e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34030/0 (socket says 172.21.15.82:34030) 2024-03-04T09:14:59.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.763+0000 7fb7faffd640 1 -- 172.21.15.82:0/3807415018 learned_addr learned my addr 172.21.15.82:0/3807415018 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:59.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.763+0000 7fb7fa7fc640 1 --2- 172.21.15.82:0/3807415018 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9f5815340 0x55a9f581bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.763+0000 7fb7fb7fe640 1 --2- 172.21.15.82:0/3807415018 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a9f58137b0 0x55a9f5813bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.763+0000 7fb800a13640 1 --2- 172.21.15.82:0/2871539071 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb7e40a1d80 0x7fb7e40a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.763+0000 7fb7faffd640 1 -- 172.21.15.82:0/3807415018 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9f5815340 msgr2=0x55a9f581bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:14:59.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.763+0000 7fb7fb7fe640 1 --2- 172.21.15.82:0/2871539071 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb7e40a1d80 0x7fb7e40a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.763+0000 7fb7faffd640 1 --2- 172.21.15.82:0/3807415018 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9f5815340 0x55a9f581bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.763+0000 7fb7faffd640 1 -- 172.21.15.82:0/3807415018 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a9f58137b0 msgr2=0x55a9f5813bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:14:59.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.763+0000 7fb7faffd640 1 --2- 172.21.15.82:0/3807415018 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a9f58137b0 0x55a9f5813bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.763+0000 7fb7faffd640 1 -- 172.21.15.82:0/3807415018 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a9f573ff30 con 0x55a9f5814980 2024-03-04T09:14:59.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.763+0000 7fb800a13640 1 -- 172.21.15.82:0/2871539071 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9092+0+0 (secure 0 0 0) 0x7fb7f00cf9d0 con 0x7fb7fc1016c0 2024-03-04T09:14:59.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.763+0000 7fb7faffd640 1 --2- 172.21.15.82:0/3807415018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a9f5814980 0x55a9f5814e00 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec009ca0 tx=0x7fb7ec011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=531addfb455d390b server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:59.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.764+0000 7fb7e1ffb640 1 -- 172.21.15.82:0/3807415018 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec004220 con 0x55a9f5814980 2024-03-04T09:14:59.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.764+0000 7fb7e1ffb640 1 -- 172.21.15.82:0/3807415018 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fb7ec0043c0 con 0x55a9f5814980 2024-03-04T09:14:59.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.764+0000 7fb7fb7fe640 1 --2- 172.21.15.82:0/2871539071 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb7e40a1d80 0x7fb7e40a4240 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4005e30 tx=0x7fb7f402c0f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:59.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.764+0000 7fb7e1ffb640 1 -- 172.21.15.82:0/3807415018 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec0198b0 con 0x55a9f5814980 2024-03-04T09:14:59.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.764+0000 7fb804600740 1 -- 172.21.15.82:0/3807415018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a9f5814980 msgr2=0x55a9f5814e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:59.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.764+0000 7fb804600740 1 --2- 172.21.15.82:0/3807415018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a9f5814980 0x55a9f5814e00 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec009ca0 tx=0x7fb7ec011810 comp rx=0 tx=0).stop 2024-03-04T09:14:59.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.764+0000 7fb804600740 1 -- 172.21.15.82:0/3807415018 shutdown_connections 2024-03-04T09:14:59.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.764+0000 7fb804600740 1 --2- 172.21.15.82:0/3807415018 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9f5815340 0x55a9f581bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.764+0000 7fb804600740 1 --2- 172.21.15.82:0/3807415018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a9f5814980 0x55a9f5814e00 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.764+0000 7fb804600740 1 --2- 172.21.15.82:0/3807415018 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a9f58137b0 0x55a9f5813bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.764+0000 7fb804600740 1 -- 172.21.15.82:0/3807415018 >> 172.21.15.82:0/3807415018 conn(0x55a9f580eba0 msgr2=0x55a9f580efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:59.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.764+0000 7fb804600740 1 -- 172.21.15.82:0/3807415018 shutdown_connections 2024-03-04T09:14:59.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.764+0000 7fb804600740 1 -- 172.21.15.82:0/3807415018 wait complete. 2024-03-04T09:14:59.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.765+0000 7fb804600740 1 -- start start 2024-03-04T09:14:59.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.765+0000 7fb804600740 1 Processor -- start 2024-03-04T09:14:59.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.765+0000 7fb804600740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a9f58137b0 0x55a9f581dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.765+0000 7fb804600740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a9f5814980 0x55a9f581e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.765+0000 7fb804600740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9f5815340 0x55a9f5825220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.765+0000 7fb804600740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9f581c350 con 0x55a9f58137b0 2024-03-04T09:14:59.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.765+0000 7fb804600740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9f5734ea0 con 0x55a9f5814980 2024-03-04T09:14:59.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.765+0000 7fb804600740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9f581c4d0 con 0x55a9f5815340 2024-03-04T09:14:59.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.765+0000 7fb804600740 10 client.0 _ll_register_callbacks cb 0x55a9f5734870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-04T09:14:59.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.766+0000 7fb7faffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a9f58137b0 0x55a9f581dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.766+0000 7fb7faffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a9f58137b0 0x55a9f581dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34034/0 (socket says 172.21.15.82:34034) 2024-03-04T09:14:59.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.766+0000 7fb7faffd640 1 -- 172.21.15.82:0/3207894278 learned_addr learned my addr 172.21.15.82:0/3207894278 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:59.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.766+0000 7fb7fb7fe640 1 --2- 172.21.15.82:0/3207894278 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9f5815340 0x55a9f5825220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.766+0000 7fb7fa7fc640 1 --2- 172.21.15.82:0/3207894278 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a9f5814980 0x55a9f581e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.766+0000 7fb7faffd640 1 -- 172.21.15.82:0/3207894278 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9f5815340 msgr2=0x55a9f5825220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:14:59.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.766+0000 7fb7faffd640 1 --2- 172.21.15.82:0/3207894278 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9f5815340 0x55a9f5825220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.766+0000 7fb7faffd640 1 -- 172.21.15.82:0/3207894278 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a9f5814980 msgr2=0x55a9f581e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:14:59.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.766+0000 7fb7faffd640 1 --2- 172.21.15.82:0/3207894278 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a9f5814980 0x55a9f581e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.766+0000 7fb7faffd640 1 -- 172.21.15.82:0/3207894278 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a9f5735270 con 0x55a9f58137b0 2024-03-04T09:14:59.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.766+0000 7fb7fa7fc640 1 --2- 172.21.15.82:0/3207894278 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a9f5814980 0x55a9f581e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:14:59.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.766+0000 7fb7faffd640 1 --2- 172.21.15.82:0/3207894278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a9f58137b0 0x55a9f581dca0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec009c70 tx=0x7fb7ec003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce2aa0e2e8aa0e95 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:59.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.766+0000 7fb7daffd640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-04T09:14:59.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.766+0000 7fb7daffd640 1 -- 172.21.15.82:0/3207894278 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec028070 con 0x55a9f58137b0 2024-03-04T09:14:59.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.766+0000 7fb7daffd640 1 -- 172.21.15.82:0/3207894278 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9092+0+0 (secure 0 0 0) 0x7fb7ec003800 con 0x55a9f58137b0 2024-03-04T09:14:59.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.766+0000 7fb804600740 1 -- 172.21.15.82:0/3207894278 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb7ec0043c0 con 0x55a9f58137b0 2024-03-04T09:14:59.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.766+0000 7fb7daffd640 1 -- 172.21.15.82:0/3207894278 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb7ec034050 con 0x55a9f58137b0 2024-03-04T09:14:59.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.766+0000 7fb804600740 10 client.15261 fetch_fsmap learned FSMap version 27 2024-03-04T09:14:59.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.766+0000 7fb804600740 1 -- 172.21.15.82:0/3207894278 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55a9f548d2d0 con 0x55a9f58137b0 2024-03-04T09:14:59.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.767+0000 7fb7daffd640 1 -- 172.21.15.82:0/3207894278 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fb7ec0043c0 con 0x55a9f58137b0 2024-03-04T09:14:59.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.767+0000 7fb7daffd640 1 -- 172.21.15.82:0/3207894278 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 27) v1 ==== 7942+0+0 (secure 0 0 0) 0x7fb7ec0049f0 con 0x55a9f58137b0 2024-03-04T09:14:59.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.767+0000 7fb804600740 10 client.15261 fetch_fsmap finished waiting for FSMap version 27 2024-03-04T09:14:59.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.767+0000 7fb804600740 10 client.15261 resolve_mds: resolved name 'i' to daemon mds.i 2024-03-04T09:14:59.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.767+0000 7fb804600740 20 client.15261 populate_metadata read hostname 'smithi082' 2024-03-04T09:14:59.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.767+0000 7fb804600740 1 --2- 172.21.15.82:0/3207894278 >> [v2:172.21.15.190:6838/878555510,v1:172.21.15.190:6839/878555510] conn(0x55a9f582a5f0 0x55a9f5829820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.767+0000 7fb804600740 4 client.15261 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-04T09:14:59.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.767+0000 7fb804600740 1 -- 172.21.15.82:0/3207894278 --> [v2:172.21.15.190:6838/878555510,v1:172.21.15.190:6839/878555510] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a9f5785bf0 con 0x55a9f582a5f0 2024-03-04T09:14:59.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.767+0000 7fb7fa7fc640 1 --2- 172.21.15.82:0/3207894278 >> [v2:172.21.15.190:6838/878555510,v1:172.21.15.190:6839/878555510] conn(0x55a9f582a5f0 0x55a9f5829820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.767+0000 7fb7fa7fc640 1 --2- 172.21.15.82:0/3207894278 >> [v2:172.21.15.190:6838/878555510,v1:172.21.15.190:6839/878555510] conn(0x55a9f582a5f0 0x55a9f5829820 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=87b98ad0adad2888 server_cookie=b1ed8cbe7db2ee44 in_seq=0 out_seq=0 2024-03-04T09:14:59.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.767+0000 7fb7daffd640 10 client.15261 ms_handle_connect on v2:172.21.15.190:6838/878555510 2024-03-04T09:14:59.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.768+0000 7fb7daffd640 1 -- 172.21.15.82:0/3207894278 <== mds.1 v2:172.21.15.190:6838/878555510 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55a9f5785bf0 con 0x55a9f582a5f0 2024-03-04T09:14:59.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.768+0000 7fb7daffd640 10 client.15261 handle_command_reply: tid=0 2024-03-04T09:14:59.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.768+0000 7fb804600740 1 client.15261 shutdown 2024-03-04T09:14:59.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.768+0000 7fb804600740 1 -- 172.21.15.82:0/3207894278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a9f58137b0 msgr2=0x55a9f581dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:59.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.768+0000 7fb804600740 1 --2- 172.21.15.82:0/3207894278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a9f58137b0 0x55a9f581dca0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec009c70 tx=0x7fb7ec003f10 comp rx=0 tx=0).stop 2024-03-04T09:14:59.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.768+0000 7fb804600740 1 -- 172.21.15.82:0/3207894278 shutdown_connections 2024-03-04T09:14:59.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.768+0000 7fb804600740 1 --2- 172.21.15.82:0/3207894278 >> [v2:172.21.15.190:6838/878555510,v1:172.21.15.190:6839/878555510] conn(0x55a9f582a5f0 0x55a9f5829820 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.768+0000 7fb804600740 1 --2- 172.21.15.82:0/3207894278 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9f5815340 0x55a9f5825220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.768+0000 7fb804600740 1 --2- 172.21.15.82:0/3207894278 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a9f5814980 0x55a9f581e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.768+0000 7fb804600740 1 --2- 172.21.15.82:0/3207894278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a9f58137b0 0x55a9f581dca0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.768+0000 7fb804600740 1 -- 172.21.15.82:0/3207894278 >> 172.21.15.82:0/3207894278 conn(0x55a9f580eba0 msgr2=0x55a9f580dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:59.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.768+0000 7fb7daffd640 0 client.15261 ms_handle_reset on v2:172.21.15.190:6838/878555510 2024-03-04T09:14:59.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.768+0000 7fb804600740 1 -- 172.21.15.82:0/3207894278 shutdown_connections 2024-03-04T09:14:59.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.769+0000 7fb804600740 1 -- 172.21.15.82:0/3207894278 wait complete. 2024-03-04T09:14:59.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.769+0000 7fb804600740 20 client.15261 trim_cache size 0 max 16384 2024-03-04T09:14:59.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.802+0000 7fb804600740 1 Processor -- start 2024-03-04T09:14:59.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.802+0000 7fb804600740 1 -- start start 2024-03-04T09:14:59.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.803+0000 7fb804600740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a9f58137b0 0x55a9f5818530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.803+0000 7fb804600740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9f5814980 0x55a9f5818a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.803+0000 7fb804600740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a9f5815340 0x55a9f58251e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.803+0000 7fb804600740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9f5829e10 con 0x55a9f5815340 2024-03-04T09:14:59.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.803+0000 7fb804600740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9f582a470 con 0x55a9f58137b0 2024-03-04T09:14:59.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.803+0000 7fb804600740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9f582aad0 con 0x55a9f5814980 2024-03-04T09:14:59.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.803+0000 7fb7fb7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a9f5815340 0x55a9f58251e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.803+0000 7fb7fb7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a9f5815340 0x55a9f58251e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34050/0 (socket says 172.21.15.82:34050) 2024-03-04T09:14:59.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.803+0000 7fb7fa7fc640 1 --2- 172.21.15.82:0/872111010 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9f5814980 0x55a9f5818a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.803+0000 7fb7fb7fe640 1 -- 172.21.15.82:0/872111010 learned_addr learned my addr 172.21.15.82:0/872111010 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:59.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.803+0000 7fb7faffd640 1 --2- 172.21.15.82:0/872111010 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a9f58137b0 0x55a9f5818530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.803+0000 7fb7fb7fe640 1 -- 172.21.15.82:0/872111010 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9f5814980 msgr2=0x55a9f5818a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:14:59.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.803+0000 7fb7fb7fe640 1 --2- 172.21.15.82:0/872111010 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9f5814980 0x55a9f5818a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.803+0000 7fb7fb7fe640 1 -- 172.21.15.82:0/872111010 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a9f58137b0 msgr2=0x55a9f5818530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:14:59.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.803+0000 7fb7fb7fe640 1 --2- 172.21.15.82:0/872111010 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a9f58137b0 0x55a9f5818530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.803+0000 7fb7fb7fe640 1 -- 172.21.15.82:0/872111010 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a9f5829b90 con 0x55a9f5815340 2024-03-04T09:14:59.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.803+0000 7fb7fa7fc640 1 --2- 172.21.15.82:0/872111010 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9f5814980 0x55a9f5818a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:14:59.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.803+0000 7fb7fb7fe640 1 --2- 172.21.15.82:0/872111010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a9f5815340 0x55a9f58251e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4009ca0 tx=0x7fb7f4009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=780c05b95a695781 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:59.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.803+0000 7fb7e17fa640 1 -- 172.21.15.82:0/872111010 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f4039040 con 0x55a9f5815340 2024-03-04T09:14:59.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.803+0000 7fb7e17fa640 1 -- 172.21.15.82:0/872111010 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fb7f403a040 con 0x55a9f5815340 2024-03-04T09:14:59.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.803+0000 7fb7e17fa640 1 -- 172.21.15.82:0/872111010 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f40346a0 con 0x55a9f5815340 2024-03-04T09:14:59.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.804+0000 7fb804600740 1 -- 172.21.15.82:0/872111010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a9f5815340 msgr2=0x55a9f58251e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:59.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.804+0000 7fb804600740 1 --2- 172.21.15.82:0/872111010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a9f5815340 0x55a9f58251e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4009ca0 tx=0x7fb7f4009360 comp rx=0 tx=0).stop 2024-03-04T09:14:59.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.804+0000 7fb804600740 1 -- 172.21.15.82:0/872111010 shutdown_connections 2024-03-04T09:14:59.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.804+0000 7fb804600740 1 --2- 172.21.15.82:0/872111010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a9f5815340 0x55a9f58251e0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.804+0000 7fb804600740 1 --2- 172.21.15.82:0/872111010 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9f5814980 0x55a9f5818a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.804+0000 7fb804600740 1 --2- 172.21.15.82:0/872111010 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a9f58137b0 0x55a9f5818530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.804+0000 7fb804600740 1 -- 172.21.15.82:0/872111010 >> 172.21.15.82:0/872111010 conn(0x55a9f580eba0 msgr2=0x55a9f5817980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:59.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.804+0000 7fb804600740 1 -- 172.21.15.82:0/872111010 shutdown_connections 2024-03-04T09:14:59.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.804+0000 7fb804600740 1 -- 172.21.15.82:0/872111010 wait complete. 2024-03-04T09:14:59.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.805+0000 7fb804600740 1 -- start start 2024-03-04T09:14:59.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.805+0000 7fb804600740 1 Processor -- start 2024-03-04T09:14:59.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.805+0000 7fb804600740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a9f58137b0 0x55a9f581f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.805+0000 7fb804600740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9f5814980 0x55a9f581f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.805+0000 7fb804600740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a9f5815340 0x55a9f58241d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.805+0000 7fb804600740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9f582b790 con 0x55a9f5815340 2024-03-04T09:14:59.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.805+0000 7fb804600740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9f582b130 con 0x55a9f58137b0 2024-03-04T09:14:59.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.805+0000 7fb804600740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9f582bdf0 con 0x55a9f5814980 2024-03-04T09:14:59.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.805+0000 7fb804600740 10 client.0 _ll_register_callbacks cb 0x7fb7ec009af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-04T09:14:59.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.806+0000 7fb7fb7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a9f5815340 0x55a9f58241d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.806+0000 7fb7fb7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a9f5815340 0x55a9f58241d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34056/0 (socket says 172.21.15.82:34056) 2024-03-04T09:14:59.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.806+0000 7fb7fb7fe640 1 -- 172.21.15.82:0/1967384884 learned_addr learned my addr 172.21.15.82:0/1967384884 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:59.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.806+0000 7fb7fa7fc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9f5814980 0x55a9f581f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.806+0000 7fb7faffd640 1 --2- 172.21.15.82:0/1967384884 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a9f58137b0 0x55a9f581f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.806+0000 7fb7fb7fe640 1 -- 172.21.15.82:0/1967384884 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9f5814980 msgr2=0x55a9f581f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:14:59.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.806+0000 7fb7fb7fe640 1 --2- 172.21.15.82:0/1967384884 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9f5814980 0x55a9f581f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.806+0000 7fb7fb7fe640 1 -- 172.21.15.82:0/1967384884 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a9f58137b0 msgr2=0x55a9f581f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:14:59.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.806+0000 7fb7fb7fe640 1 --2- 172.21.15.82:0/1967384884 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a9f58137b0 0x55a9f581f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.806+0000 7fb7fb7fe640 1 -- 172.21.15.82:0/1967384884 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a9f55576b0 con 0x55a9f5815340 2024-03-04T09:14:59.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.806+0000 7fb7fb7fe640 1 --2- 172.21.15.82:0/1967384884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a9f5815340 0x55a9f58241d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4009430 tx=0x7fb7f4004230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52f7a1df336b4329 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:59.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.806+0000 7fb7daffd640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-04T09:14:59.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.806+0000 7fb7daffd640 1 -- 172.21.15.82:0/1967384884 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f4039030 con 0x55a9f5815340 2024-03-04T09:14:59.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.806+0000 7fb804600740 1 -- 172.21.15.82:0/1967384884 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb7f403a040 con 0x55a9f5815340 2024-03-04T09:14:59.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.806+0000 7fb7daffd640 1 -- 172.21.15.82:0/1967384884 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9092+0+0 (secure 0 0 0) 0x7fb7f4034640 con 0x55a9f5815340 2024-03-04T09:14:59.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.806+0000 7fb7daffd640 1 -- 172.21.15.82:0/1967384884 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb7f406a050 con 0x55a9f5815340 2024-03-04T09:14:59.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.806+0000 7fb804600740 10 client.15267 fetch_fsmap learned FSMap version 27 2024-03-04T09:14:59.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.806+0000 7fb804600740 1 -- 172.21.15.82:0/1967384884 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55a9f5885740 con 0x55a9f5815340 2024-03-04T09:14:59.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.807+0000 7fb7daffd640 1 -- 172.21.15.82:0/1967384884 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fb7f403a040 con 0x55a9f5815340 2024-03-04T09:14:59.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.807+0000 7fb7daffd640 1 -- 172.21.15.82:0/1967384884 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 27) v1 ==== 7942+0+0 (secure 0 0 0) 0x7fb7f4044640 con 0x55a9f5815340 2024-03-04T09:14:59.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.807+0000 7fb804600740 10 client.15267 fetch_fsmap finished waiting for FSMap version 27 2024-03-04T09:14:59.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.807+0000 7fb804600740 10 client.15267 resolve_mds: resolved name 'i' to daemon mds.i 2024-03-04T09:14:59.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.807+0000 7fb804600740 20 client.15267 populate_metadata read hostname 'smithi082' 2024-03-04T09:14:59.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.807+0000 7fb804600740 1 --2- 172.21.15.82:0/1967384884 >> [v2:172.21.15.190:6838/878555510,v1:172.21.15.190:6839/878555510] conn(0x55a9f5889990 0x55a9f5885910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.807+0000 7fb804600740 4 client.15267 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-04T09:14:59.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.807+0000 7fb804600740 1 -- 172.21.15.82:0/1967384884 --> [v2:172.21.15.190:6838/878555510,v1:172.21.15.190:6839/878555510] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a9f577ff40 con 0x55a9f5889990 2024-03-04T09:14:59.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.807+0000 7fb7faffd640 1 --2- 172.21.15.82:0/1967384884 >> [v2:172.21.15.190:6838/878555510,v1:172.21.15.190:6839/878555510] conn(0x55a9f5889990 0x55a9f5885910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.807+0000 7fb7faffd640 1 --2- 172.21.15.82:0/1967384884 >> [v2:172.21.15.190:6838/878555510,v1:172.21.15.190:6839/878555510] conn(0x55a9f5889990 0x55a9f5885910 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=83da00702b3fc32a server_cookie=3bae038acc1de7b2 in_seq=0 out_seq=0 2024-03-04T09:14:59.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.807+0000 7fb7daffd640 10 client.15267 ms_handle_connect on v2:172.21.15.190:6838/878555510 2024-03-04T09:14:59.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.807+0000 7fb7daffd640 1 -- 172.21.15.82:0/1967384884 <== mds.1 v2:172.21.15.190:6838/878555510 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55a9f577ff40 con 0x55a9f5889990 2024-03-04T09:14:59.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.808+0000 7fb7daffd640 10 client.15267 handle_command_reply: tid=0 2024-03-04T09:14:59.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.808+0000 7fb804600740 1 client.15267 shutdown 2024-03-04T09:14:59.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.808+0000 7fb804600740 1 -- 172.21.15.82:0/1967384884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a9f5815340 msgr2=0x55a9f58241d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:59.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.808+0000 7fb804600740 1 --2- 172.21.15.82:0/1967384884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a9f5815340 0x55a9f58241d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4009430 tx=0x7fb7f4004230 comp rx=0 tx=0).stop 2024-03-04T09:14:59.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.808+0000 7fb804600740 1 -- 172.21.15.82:0/1967384884 shutdown_connections 2024-03-04T09:14:59.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.808+0000 7fb804600740 1 --2- 172.21.15.82:0/1967384884 >> [v2:172.21.15.190:6838/878555510,v1:172.21.15.190:6839/878555510] conn(0x55a9f5889990 0x55a9f5885910 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.808+0000 7fb804600740 1 --2- 172.21.15.82:0/1967384884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a9f5815340 0x55a9f58241d0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.808+0000 7fb804600740 1 --2- 172.21.15.82:0/1967384884 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55a9f5814980 0x55a9f581f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.808+0000 7fb7daffd640 0 client.15267 ms_handle_reset on v2:172.21.15.190:6838/878555510 2024-03-04T09:14:59.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.808+0000 7fb804600740 1 --2- 172.21.15.82:0/1967384884 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a9f58137b0 0x55a9f581f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.808+0000 7fb804600740 1 -- 172.21.15.82:0/1967384884 >> 172.21.15.82:0/1967384884 conn(0x55a9f580eba0 msgr2=0x55a9f5818530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:59.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.808+0000 7fb804600740 1 -- 172.21.15.82:0/1967384884 shutdown_connections 2024-03-04T09:14:59.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.808+0000 7fb804600740 1 -- 172.21.15.82:0/1967384884 wait complete. 2024-03-04T09:14:59.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.808+0000 7fb804600740 20 client.15267 trim_cache size 0 max 16384 2024-03-04T09:14:59.812 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-04T09:14:59.812 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "2e533fc8-da06-11ee-95c6-87774f69a715", 2024-03-04T09:14:59.812 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 1, 2024-03-04T09:14:59.813 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24469, 2024-03-04T09:14:59.813 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-03-04T09:14:59.813 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-03-04T09:14:59.813 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-03-04T09:14:59.813 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 85.457465701000004, 2024-03-04T09:14:59.813 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 27, 2024-03-04T09:14:59.813 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 92, 2024-03-04T09:14:59.813 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 90, 2024-03-04T09:14:59.813 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 122.99281940199999 2024-03-04T09:14:59.813 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-04T09:14:59.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.808+0000 7fb801a15640 1 -- 172.21.15.82:0/2871539071 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb7e40a1d80 msgr2=0x7fb7e40a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:59.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.808+0000 7fb801a15640 1 --2- 172.21.15.82:0/2871539071 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb7e40a1d80 0x7fb7e40a4240 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4005e30 tx=0x7fb7f402c0f0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.808+0000 7fb801a15640 1 -- 172.21.15.82:0/2871539071 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb7fc1016c0 msgr2=0x7fb7fc196d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:59.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.808+0000 7fb801a15640 1 --2- 172.21.15.82:0/2871539071 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb7fc1016c0 0x7fb7fc196d10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb7f000eb00 tx=0x7fb7f000ef00 comp rx=0 tx=0).stop 2024-03-04T09:14:59.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.808+0000 7fb801a15640 1 -- 172.21.15.82:0/2871539071 shutdown_connections 2024-03-04T09:14:59.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.808+0000 7fb801a15640 1 --2- 172.21.15.82:0/2871539071 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fb7e40a1d80 0x7fb7e40a4240 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.808+0000 7fb801a15640 1 --2- 172.21.15.82:0/2871539071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7fc102080 0x7fb7fc19dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.808+0000 7fb801a15640 1 --2- 172.21.15.82:0/2871539071 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb7fc1016c0 0x7fb7fc196d10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.808+0000 7fb801a15640 1 --2- 172.21.15.82:0/2871539071 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb7fc1004d0 0x7fb7fc1967d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.808+0000 7fb801a15640 1 -- 172.21.15.82:0/2871539071 >> 172.21.15.82:0/2871539071 conn(0x7fb7fc0fba60 msgr2=0x7fb7fc1049c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:59.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.809+0000 7fb801a15640 1 -- 172.21.15.82:0/2871539071 shutdown_connections 2024-03-04T09:14:59.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.809+0000 7fb801a15640 1 -- 172.21.15.82:0/2871539071 wait complete. 2024-03-04T09:14:59.816 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-03-04T09:14:59.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.924+0000 7f9ca833a640 1 -- 172.21.15.82:0/519586994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ca0104980 msgr2=0x7f9ca0106d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:59.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.924+0000 7f9ca833a640 1 --2- 172.21.15.82:0/519586994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ca0104980 0x7f9ca0106d70 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9c90009900 tx=0x7f9c9002bc30 comp rx=0 tx=0).stop 2024-03-04T09:14:59.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.924+0000 7f9ca833a640 1 -- 172.21.15.82:0/519586994 shutdown_connections 2024-03-04T09:14:59.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.924+0000 7f9ca833a640 1 --2- 172.21.15.82:0/519586994 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ca01072b0 0x7f9ca0109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.924+0000 7f9ca833a640 1 --2- 172.21.15.82:0/519586994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ca0104980 0x7f9ca0106d70 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.924+0000 7f9ca833a640 1 --2- 172.21.15.82:0/519586994 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ca0102050 0x7f9ca0104440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.924+0000 7f9ca833a640 1 -- 172.21.15.82:0/519586994 >> 172.21.15.82:0/519586994 conn(0x7f9ca00fba60 msgr2=0x7f9ca00fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:59.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.924+0000 7f9ca833a640 1 -- 172.21.15.82:0/519586994 shutdown_connections 2024-03-04T09:14:59.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.924+0000 7f9ca833a640 1 -- 172.21.15.82:0/519586994 wait complete. 2024-03-04T09:14:59.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.925+0000 7f9ca833a640 1 Processor -- start 2024-03-04T09:14:59.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.925+0000 7f9ca833a640 1 -- start start 2024-03-04T09:14:59.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.925+0000 7f9ca833a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ca0102050 0x7f9ca0197960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.925+0000 7f9ca833a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ca0104980 0x7f9ca0197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.925+0000 7f9ca833a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ca01072b0 0x7f9ca019ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.925+0000 7f9ca833a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca010d230 con 0x7f9ca0104980 2024-03-04T09:14:59.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.925+0000 7f9ca833a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca010d0b0 con 0x7f9ca0102050 2024-03-04T09:14:59.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.925+0000 7f9ca833a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca010d3b0 con 0x7f9ca01072b0 2024-03-04T09:14:59.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.925+0000 7f9ca58d5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ca0104980 0x7f9ca0197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.925+0000 7f9ca58d5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ca0104980 0x7f9ca0197ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34088/0 (socket says 172.21.15.82:34088) 2024-03-04T09:14:59.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.925+0000 7f9ca58d5640 1 -- 172.21.15.82:0/3694705989 learned_addr learned my addr 172.21.15.82:0/3694705989 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:59.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.925+0000 7f9ca60d6640 1 --2- 172.21.15.82:0/3694705989 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ca0102050 0x7f9ca0197960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.925+0000 7f9ca68d7640 1 --2- 172.21.15.82:0/3694705989 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ca01072b0 0x7f9ca019ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.925+0000 7f9ca58d5640 1 -- 172.21.15.82:0/3694705989 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ca01072b0 msgr2=0x7f9ca019ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:59.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.925+0000 7f9ca58d5640 1 --2- 172.21.15.82:0/3694705989 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ca01072b0 0x7f9ca019ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.925+0000 7f9ca58d5640 1 -- 172.21.15.82:0/3694705989 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ca0102050 msgr2=0x7f9ca0197960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:59.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.925+0000 7f9ca58d5640 1 --2- 172.21.15.82:0/3694705989 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ca0102050 0x7f9ca0197960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.925+0000 7f9ca58d5640 1 -- 172.21.15.82:0/3694705989 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca019f580 con 0x7f9ca0104980 2024-03-04T09:14:59.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.925+0000 7f9ca58d5640 1 --2- 172.21.15.82:0/3694705989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ca0104980 0x7f9ca0197ea0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f9c90005ab0 tx=0x7f9c90005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:59.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.926+0000 7f9c977fe640 1 -- 172.21.15.82:0/3694705989 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c90043020 con 0x7f9ca0104980 2024-03-04T09:14:59.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.926+0000 7f9c977fe640 1 -- 172.21.15.82:0/3694705989 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f9c900054b0 con 0x7f9ca0104980 2024-03-04T09:14:59.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.926+0000 7f9ca833a640 1 -- 172.21.15.82:0/3694705989 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ca019f810 con 0x7f9ca0104980 2024-03-04T09:14:59.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.926+0000 7f9c977fe640 1 -- 172.21.15.82:0/3694705989 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c90003bb0 con 0x7f9ca0104980 2024-03-04T09:14:59.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.926+0000 7f9ca833a640 1 -- 172.21.15.82:0/3694705989 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ca019fd60 con 0x7f9ca0104980 2024-03-04T09:14:59.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.928+0000 7f9c977fe640 1 -- 172.21.15.82:0/3694705989 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f9c90046020 con 0x7f9ca0104980 2024-03-04T09:14:59.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.928+0000 7f9caaffa740 1 Processor -- start 2024-03-04T09:14:59.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.929+0000 7f9caaffa740 1 -- start start 2024-03-04T09:14:59.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.929+0000 7f9caaffa740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8ad5167b0 0x55d8ad516bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.929+0000 7f9caaffa740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8ad517980 0x55d8ad517e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.929+0000 7f9caaffa740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8ad518340 0x55d8ad51ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.929+0000 7f9caaffa740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8ad47b6b0 con 0x55d8ad518340 2024-03-04T09:14:59.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.929+0000 7f9caaffa740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8ad424a60 con 0x55d8ad517980 2024-03-04T09:14:59.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.929+0000 7f9caaffa740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8ad477750 con 0x55d8ad5167b0 2024-03-04T09:14:59.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.929+0000 7f9ca58d5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8ad518340 0x55d8ad51ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.929+0000 7f9ca60d6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8ad517980 0x55d8ad517e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.929+0000 7f9ca58d5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8ad518340 0x55d8ad51ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34104/0 (socket says 172.21.15.82:34104) 2024-03-04T09:14:59.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.929+0000 7f9ca58d5640 1 -- 172.21.15.82:0/1635667647 learned_addr learned my addr 172.21.15.82:0/1635667647 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:59.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.929+0000 7f9ca60d6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8ad517980 0x55d8ad517e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.82:56236/0 (socket says 172.21.15.82:56236) 2024-03-04T09:14:59.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.929+0000 7f9ca68d7640 1 --2- 172.21.15.82:0/1635667647 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8ad5167b0 0x55d8ad516bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.929+0000 7f9c977fe640 1 --2- 172.21.15.82:0/3694705989 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f9c8c0a1d80 0x7f9c8c0a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.929+0000 7f9ca60d6640 1 -- 172.21.15.82:0/1635667647 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8ad5167b0 msgr2=0x55d8ad516bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:14:59.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.929+0000 7f9ca60d6640 1 --2- 172.21.15.82:0/1635667647 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8ad5167b0 0x55d8ad516bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.929+0000 7f9ca60d6640 1 -- 172.21.15.82:0/1635667647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8ad518340 msgr2=0x55d8ad51ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:14:59.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.929+0000 7f9ca60d6640 1 --2- 172.21.15.82:0/1635667647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8ad518340 0x55d8ad51ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.929+0000 7f9ca60d6640 1 -- 172.21.15.82:0/1635667647 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d8ad442f30 con 0x55d8ad517980 2024-03-04T09:14:59.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.929+0000 7f9ca68d7640 1 --2- 172.21.15.82:0/3694705989 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f9c8c0a1d80 0x7f9c8c0a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.929+0000 7f9c977fe640 1 -- 172.21.15.82:0/3694705989 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9092+0+0 (secure 0 0 0) 0x7f9c900efc80 con 0x7f9ca0104980 2024-03-04T09:14:59.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.930+0000 7f9ca60d6640 1 --2- 172.21.15.82:0/1635667647 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8ad517980 0x55d8ad517e00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c009c20 tx=0x7f9c9c011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8d20e94aa31e4f7 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:59.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.930+0000 7f9ca68d7640 1 --2- 172.21.15.82:0/3694705989 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f9c8c0a1d80 0x7f9c8c0a4240 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9c98009fd0 tx=0x7f9c98004a40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:59.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.930+0000 7f9c94bfe640 1 -- 172.21.15.82:0/1635667647 <== mon.2 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c004050 con 0x55d8ad517980 2024-03-04T09:14:59.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.930+0000 7f9c94bfe640 1 -- 172.21.15.82:0/1635667647 <== mon.2 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f9c9c0054f0 con 0x55d8ad517980 2024-03-04T09:14:59.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.930+0000 7f9c94bfe640 1 -- 172.21.15.82:0/1635667647 <== mon.2 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c004cd0 con 0x55d8ad517980 2024-03-04T09:14:59.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.930+0000 7f9caaffa740 1 -- 172.21.15.82:0/1635667647 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8ad517980 msgr2=0x55d8ad517e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:59.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.930+0000 7f9caaffa740 1 --2- 172.21.15.82:0/1635667647 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8ad517980 0x55d8ad517e00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c009c20 tx=0x7f9c9c011810 comp rx=0 tx=0).stop 2024-03-04T09:14:59.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.931+0000 7f9caaffa740 1 -- 172.21.15.82:0/1635667647 shutdown_connections 2024-03-04T09:14:59.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.931+0000 7f9caaffa740 1 --2- 172.21.15.82:0/1635667647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8ad518340 0x55d8ad51ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.931+0000 7f9caaffa740 1 --2- 172.21.15.82:0/1635667647 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8ad517980 0x55d8ad517e00 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.931+0000 7f9caaffa740 1 --2- 172.21.15.82:0/1635667647 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8ad5167b0 0x55d8ad516bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.931+0000 7f9caaffa740 1 -- 172.21.15.82:0/1635667647 >> 172.21.15.82:0/1635667647 conn(0x55d8ad511ba0 msgr2=0x55d8ad511fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:59.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.931+0000 7f9caaffa740 1 -- 172.21.15.82:0/1635667647 shutdown_connections 2024-03-04T09:14:59.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.931+0000 7f9caaffa740 1 -- 172.21.15.82:0/1635667647 wait complete. 2024-03-04T09:14:59.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.931+0000 7f9caaffa740 1 -- start start 2024-03-04T09:14:59.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.931+0000 7f9caaffa740 1 Processor -- start 2024-03-04T09:14:59.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.931+0000 7f9caaffa740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8ad5167b0 0x55d8ad520d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.931+0000 7f9caaffa740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8ad517980 0x55d8ad521240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.931+0000 7f9caaffa740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8ad518340 0x55d8ad528280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.931+0000 7f9caaffa740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8ad51f350 con 0x55d8ad517980 2024-03-04T09:14:59.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.931+0000 7f9caaffa740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8ad437ea0 con 0x55d8ad5167b0 2024-03-04T09:14:59.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.931+0000 7f9caaffa740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8ad51f4d0 con 0x55d8ad518340 2024-03-04T09:14:59.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.931+0000 7f9caaffa740 10 client.0 _ll_register_callbacks cb 0x55d8ad437870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-04T09:14:59.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.931+0000 7f9ca60d6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8ad5167b0 0x55d8ad520d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.931+0000 7f9ca58d5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8ad517980 0x55d8ad521240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.931+0000 7f9ca60d6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8ad5167b0 0x55d8ad520d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.82:56240/0 (socket says 172.21.15.82:56240) 2024-03-04T09:14:59.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.931+0000 7f9ca60d6640 1 -- 172.21.15.82:0/3992974519 learned_addr learned my addr 172.21.15.82:0/3992974519 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:59.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.931+0000 7f9ca68d7640 1 --2- 172.21.15.82:0/3992974519 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8ad518340 0x55d8ad528280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.932+0000 7f9ca58d5640 1 -- 172.21.15.82:0/3992974519 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8ad518340 msgr2=0x55d8ad528280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:14:59.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.932+0000 7f9ca58d5640 1 --2- 172.21.15.82:0/3992974519 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8ad518340 0x55d8ad528280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.932+0000 7f9ca58d5640 1 -- 172.21.15.82:0/3992974519 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8ad5167b0 msgr2=0x55d8ad520d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:14:59.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.932+0000 7f9ca58d5640 1 --2- 172.21.15.82:0/3992974519 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8ad5167b0 0x55d8ad520d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.932+0000 7f9ca58d5640 1 -- 172.21.15.82:0/3992974519 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d8ad438270 con 0x55d8ad517980 2024-03-04T09:14:59.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.932+0000 7f9ca60d6640 1 --2- 172.21.15.82:0/3992974519 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8ad5167b0 0x55d8ad520d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:14:59.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.932+0000 7f9ca58d5640 1 --2- 172.21.15.82:0/3992974519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8ad517980 0x55d8ad521240 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9c90006010 tx=0x7f9c90005660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=352f177a78a132c3 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:59.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.932+0000 7f9c89ffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-04T09:14:59.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.932+0000 7f9c89ffb640 1 -- 172.21.15.82:0/3992974519 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c900bc420 con 0x55d8ad517980 2024-03-04T09:14:59.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.932+0000 7f9c89ffb640 1 -- 172.21.15.82:0/3992974519 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9092+0+0 (secure 0 0 0) 0x7f9c90003d50 con 0x55d8ad517980 2024-03-04T09:14:59.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.932+0000 7f9caaffa740 1 -- 172.21.15.82:0/3992974519 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9c9c0054f0 con 0x55d8ad517980 2024-03-04T09:14:59.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.932+0000 7f9c89ffb640 1 -- 172.21.15.82:0/3992974519 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9c900bbfb0 con 0x55d8ad517980 2024-03-04T09:14:59.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.932+0000 7f9caaffa740 10 client.15279 fetch_fsmap learned FSMap version 27 2024-03-04T09:14:59.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.932+0000 7f9caaffa740 1 -- 172.21.15.82:0/3992974519 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55d8ad1902d0 con 0x55d8ad517980 2024-03-04T09:14:59.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.932+0000 7f9c89ffb640 1 -- 172.21.15.82:0/3992974519 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f9c9c0054f0 con 0x55d8ad517980 2024-03-04T09:14:59.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.932+0000 7f9c89ffb640 1 -- 172.21.15.82:0/3992974519 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 27) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f9c900f7040 con 0x55d8ad517980 2024-03-04T09:14:59.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.932+0000 7f9caaffa740 10 client.15279 fetch_fsmap finished waiting for FSMap version 27 2024-03-04T09:14:59.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.932+0000 7f9caaffa740 10 client.15279 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-04T09:14:59.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.932+0000 7f9caaffa740 20 client.15279 populate_metadata read hostname 'smithi082' 2024-03-04T09:14:59.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.932+0000 7f9caaffa740 1 --2- 172.21.15.82:0/3992974519 >> [v2:172.21.15.102:6838/35424130,v1:172.21.15.102:6839/35424130] conn(0x55d8ad52d830 0x55d8ad52c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.933+0000 7f9caaffa740 4 client.15279 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-04T09:14:59.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.933+0000 7f9caaffa740 1 -- 172.21.15.82:0/3992974519 --> [v2:172.21.15.102:6838/35424130,v1:172.21.15.102:6839/35424130] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d8ad488bf0 con 0x55d8ad52d830 2024-03-04T09:14:59.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.933+0000 7f9ca60d6640 1 --2- 172.21.15.82:0/3992974519 >> [v2:172.21.15.102:6838/35424130,v1:172.21.15.102:6839/35424130] conn(0x55d8ad52d830 0x55d8ad52c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.933+0000 7f9c89ffb640 10 client.15279 ms_handle_connect on v2:172.21.15.102:6838/35424130 2024-03-04T09:14:59.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.933+0000 7f9ca60d6640 1 --2- 172.21.15.82:0/3992974519 >> [v2:172.21.15.102:6838/35424130,v1:172.21.15.102:6839/35424130] conn(0x55d8ad52d830 0x55d8ad52c770 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3a01bec3a9591d7 server_cookie=15608a08948a9789 in_seq=0 out_seq=0 2024-03-04T09:14:59.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.934+0000 7f9c89ffb640 1 -- 172.21.15.82:0/3992974519 <== mds.0 v2:172.21.15.102:6838/35424130 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55d8ad488bf0 con 0x55d8ad52d830 2024-03-04T09:14:59.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.934+0000 7f9c89ffb640 10 client.15279 handle_command_reply: tid=0 2024-03-04T09:14:59.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.934+0000 7f9caaffa740 1 client.15279 shutdown 2024-03-04T09:14:59.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.934+0000 7f9caaffa740 1 -- 172.21.15.82:0/3992974519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8ad517980 msgr2=0x55d8ad521240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:59.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.934+0000 7f9caaffa740 1 --2- 172.21.15.82:0/3992974519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8ad517980 0x55d8ad521240 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9c90006010 tx=0x7f9c90005660 comp rx=0 tx=0).stop 2024-03-04T09:14:59.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.934+0000 7f9caaffa740 1 -- 172.21.15.82:0/3992974519 shutdown_connections 2024-03-04T09:14:59.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.934+0000 7f9caaffa740 1 --2- 172.21.15.82:0/3992974519 >> [v2:172.21.15.102:6838/35424130,v1:172.21.15.102:6839/35424130] conn(0x55d8ad52d830 0x55d8ad52c770 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.934+0000 7f9caaffa740 1 --2- 172.21.15.82:0/3992974519 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8ad518340 0x55d8ad528280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.934+0000 7f9caaffa740 1 --2- 172.21.15.82:0/3992974519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8ad517980 0x55d8ad521240 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.934+0000 7f9c89ffb640 0 client.15279 ms_handle_reset on v2:172.21.15.102:6838/35424130 2024-03-04T09:14:59.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.934+0000 7f9caaffa740 1 --2- 172.21.15.82:0/3992974519 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8ad5167b0 0x55d8ad520d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.934+0000 7f9caaffa740 1 -- 172.21.15.82:0/3992974519 >> 172.21.15.82:0/3992974519 conn(0x55d8ad511ba0 msgr2=0x55d8ad510da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:59.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.934+0000 7f9caaffa740 1 -- 172.21.15.82:0/3992974519 shutdown_connections 2024-03-04T09:14:59.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.934+0000 7f9caaffa740 1 -- 172.21.15.82:0/3992974519 wait complete. 2024-03-04T09:14:59.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.934+0000 7f9caaffa740 20 client.15279 trim_cache size 0 max 16384 2024-03-04T09:14:59.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.950+0000 7f9caaffa740 1 Processor -- start 2024-03-04T09:14:59.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.951+0000 7f9caaffa740 1 -- start start 2024-03-04T09:14:59.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.951+0000 7f9caaffa740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8ad5167b0 0x55d8ad51b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.951+0000 7f9caaffa740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8ad517980 0x55d8ad51baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.951+0000 7f9caaffa740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8ad518340 0x55d8ad528240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.951+0000 7f9caaffa740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8ad52d050 con 0x55d8ad5167b0 2024-03-04T09:14:59.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.951+0000 7f9caaffa740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8ad52d6b0 con 0x55d8ad518340 2024-03-04T09:14:59.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.951+0000 7f9caaffa740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8ad52dd10 con 0x55d8ad517980 2024-03-04T09:14:59.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.951+0000 7f9ca60d6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8ad5167b0 0x55d8ad51b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.951+0000 7f9ca58d5640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8ad517980 0x55d8ad51baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.951+0000 7f9ca60d6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8ad5167b0 0x55d8ad51b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34126/0 (socket says 172.21.15.82:34126) 2024-03-04T09:14:59.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.951+0000 7f9ca60d6640 1 -- 172.21.15.82:0/4081744184 learned_addr learned my addr 172.21.15.82:0/4081744184 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:59.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.951+0000 7f9ca68d7640 1 --2- 172.21.15.82:0/4081744184 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8ad518340 0x55d8ad528240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.951+0000 7f9ca60d6640 1 -- 172.21.15.82:0/4081744184 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8ad517980 msgr2=0x55d8ad51baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:14:59.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.951+0000 7f9ca60d6640 1 --2- 172.21.15.82:0/4081744184 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8ad517980 0x55d8ad51baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.951+0000 7f9ca60d6640 1 -- 172.21.15.82:0/4081744184 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8ad518340 msgr2=0x55d8ad528240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:14:59.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.951+0000 7f9ca60d6640 1 --2- 172.21.15.82:0/4081744184 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8ad518340 0x55d8ad528240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.951+0000 7f9ca60d6640 1 -- 172.21.15.82:0/4081744184 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d8ad25a6b0 con 0x55d8ad5167b0 2024-03-04T09:14:59.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.951+0000 7f9ca60d6640 1 --2- 172.21.15.82:0/4081744184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8ad5167b0 0x55d8ad51b560 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c009c20 tx=0x7f9c9c005d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3061b2597a820f4c server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:59.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.951+0000 7f9c8bfff640 1 -- 172.21.15.82:0/4081744184 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c033070 con 0x55d8ad5167b0 2024-03-04T09:14:59.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.951+0000 7f9c8bfff640 1 -- 172.21.15.82:0/4081744184 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f9c9c02e2f0 con 0x55d8ad5167b0 2024-03-04T09:14:59.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.951+0000 7f9c8bfff640 1 -- 172.21.15.82:0/4081744184 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c004d40 con 0x55d8ad5167b0 2024-03-04T09:14:59.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.952+0000 7f9caaffa740 1 -- 172.21.15.82:0/4081744184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8ad5167b0 msgr2=0x55d8ad51b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:59.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.952+0000 7f9caaffa740 1 --2- 172.21.15.82:0/4081744184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8ad5167b0 0x55d8ad51b560 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c009c20 tx=0x7f9c9c005d30 comp rx=0 tx=0).stop 2024-03-04T09:14:59.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.952+0000 7f9caaffa740 1 -- 172.21.15.82:0/4081744184 shutdown_connections 2024-03-04T09:14:59.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.952+0000 7f9caaffa740 1 --2- 172.21.15.82:0/4081744184 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8ad518340 0x55d8ad528240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.952+0000 7f9caaffa740 1 --2- 172.21.15.82:0/4081744184 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8ad517980 0x55d8ad51baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.952+0000 7f9caaffa740 1 --2- 172.21.15.82:0/4081744184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8ad5167b0 0x55d8ad51b560 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.952+0000 7f9caaffa740 1 -- 172.21.15.82:0/4081744184 >> 172.21.15.82:0/4081744184 conn(0x55d8ad511ba0 msgr2=0x55d8ad50cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:59.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.952+0000 7f9caaffa740 1 -- 172.21.15.82:0/4081744184 shutdown_connections 2024-03-04T09:14:59.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.952+0000 7f9caaffa740 1 -- 172.21.15.82:0/4081744184 wait complete. 2024-03-04T09:14:59.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.952+0000 7f9caaffa740 1 -- start start 2024-03-04T09:14:59.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.953+0000 7f9caaffa740 1 Processor -- start 2024-03-04T09:14:59.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.953+0000 7f9caaffa740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8ad5167b0 0x55d8ad522460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.953+0000 7f9caaffa740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8ad517980 0x55d8ad5229a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.953+0000 7f9caaffa740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8ad518340 0x55d8ad5276d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.953+0000 7f9caaffa740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8ad52e9d0 con 0x55d8ad517980 2024-03-04T09:14:59.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.953+0000 7f9caaffa740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8ad52e370 con 0x55d8ad518340 2024-03-04T09:14:59.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.953+0000 7f9caaffa740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8ad52f030 con 0x55d8ad5167b0 2024-03-04T09:14:59.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.953+0000 7f9caaffa740 10 client.0 _ll_register_callbacks cb 0x55d8ad437870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-04T09:14:59.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.953+0000 7f9ca58d5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8ad517980 0x55d8ad5229a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.953+0000 7f9ca58d5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8ad517980 0x55d8ad5229a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34132/0 (socket says 172.21.15.82:34132) 2024-03-04T09:14:59.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.953+0000 7f9ca58d5640 1 -- 172.21.15.82:0/4203408152 learned_addr learned my addr 172.21.15.82:0/4203408152 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:14:59.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.953+0000 7f9ca60d6640 1 --2- 172.21.15.82:0/4203408152 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8ad5167b0 0x55d8ad522460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.953+0000 7f9ca68d7640 1 --2- 172.21.15.82:0/4203408152 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8ad518340 0x55d8ad5276d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.953+0000 7f9ca58d5640 1 -- 172.21.15.82:0/4203408152 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8ad5167b0 msgr2=0x55d8ad522460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:14:59.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.953+0000 7f9ca58d5640 1 --2- 172.21.15.82:0/4203408152 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8ad5167b0 0x55d8ad522460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.953+0000 7f9ca58d5640 1 -- 172.21.15.82:0/4203408152 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8ad518340 msgr2=0x55d8ad5276d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:14:59.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.953+0000 7f9ca58d5640 1 --2- 172.21.15.82:0/4203408152 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8ad518340 0x55d8ad5276d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.953+0000 7f9ca58d5640 1 -- 172.21.15.82:0/4203408152 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d8ad527cc0 con 0x55d8ad517980 2024-03-04T09:14:59.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.953+0000 7f9ca58d5640 1 --2- 172.21.15.82:0/4203408152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8ad517980 0x55d8ad5229a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9c900c48c0 tx=0x7f9c900035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bfe009fd1bfd5ae server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:14:59.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.953+0000 7f9c89ffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-04T09:14:59.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.953+0000 7f9c89ffb640 1 -- 172.21.15.82:0/4203408152 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c900bc190 con 0x55d8ad517980 2024-03-04T09:14:59.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.953+0000 7f9c89ffb640 1 -- 172.21.15.82:0/4203408152 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9092+0+0 (secure 0 0 0) 0x7f9c90003d50 con 0x55d8ad517980 2024-03-04T09:14:59.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.953+0000 7f9caaffa740 1 -- 172.21.15.82:0/4203408152 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d8ad482f40 con 0x55d8ad517980 2024-03-04T09:14:59.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.954+0000 7f9c89ffb640 1 -- 172.21.15.82:0/4203408152 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9c900bc420 con 0x55d8ad517980 2024-03-04T09:14:59.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.954+0000 7f9caaffa740 10 client.15285 fetch_fsmap learned FSMap version 27 2024-03-04T09:14:59.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.954+0000 7f9caaffa740 1 -- 172.21.15.82:0/4203408152 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55d8ad527cc0 con 0x55d8ad517980 2024-03-04T09:14:59.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.954+0000 7f9c89ffb640 1 -- 172.21.15.82:0/4203408152 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x55d8ad482f40 con 0x55d8ad517980 2024-03-04T09:14:59.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.954+0000 7f9c89ffb640 1 -- 172.21.15.82:0/4203408152 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 27) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f9c900ed470 con 0x55d8ad517980 2024-03-04T09:14:59.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.954+0000 7f9caaffa740 10 client.15285 fetch_fsmap finished waiting for FSMap version 27 2024-03-04T09:14:59.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.954+0000 7f9caaffa740 10 client.15285 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-04T09:14:59.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.954+0000 7f9caaffa740 20 client.15285 populate_metadata read hostname 'smithi082' 2024-03-04T09:14:59.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.954+0000 7f9caaffa740 1 --2- 172.21.15.82:0/4203408152 >> [v2:172.21.15.102:6838/35424130,v1:172.21.15.102:6839/35424130] conn(0x55d8ad58d330 0x55d8ad589180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:14:59.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.954+0000 7f9caaffa740 4 client.15285 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-04T09:14:59.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.954+0000 7f9caaffa740 1 -- 172.21.15.82:0/4203408152 --> [v2:172.21.15.102:6838/35424130,v1:172.21.15.102:6839/35424130] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d8ad4019a0 con 0x55d8ad58d330 2024-03-04T09:14:59.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.954+0000 7f9ca60d6640 1 --2- 172.21.15.82:0/4203408152 >> [v2:172.21.15.102:6838/35424130,v1:172.21.15.102:6839/35424130] conn(0x55d8ad58d330 0x55d8ad589180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:14:59.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.954+0000 7f9c89ffb640 10 client.15285 ms_handle_connect on v2:172.21.15.102:6838/35424130 2024-03-04T09:14:59.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.954+0000 7f9ca60d6640 1 --2- 172.21.15.82:0/4203408152 >> [v2:172.21.15.102:6838/35424130,v1:172.21.15.102:6839/35424130] conn(0x55d8ad58d330 0x55d8ad589180 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4dee1cf15fd9dad server_cookie=bf33e9ab55971f64 in_seq=0 out_seq=0 2024-03-04T09:14:59.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.955+0000 7f9c89ffb640 1 -- 172.21.15.82:0/4203408152 <== mds.0 v2:172.21.15.102:6838/35424130 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55d8ad4019a0 con 0x55d8ad58d330 2024-03-04T09:14:59.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.955+0000 7f9c89ffb640 10 client.15285 handle_command_reply: tid=0 2024-03-04T09:14:59.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.955+0000 7f9caaffa740 1 client.15285 shutdown 2024-03-04T09:14:59.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.955+0000 7f9caaffa740 1 -- 172.21.15.82:0/4203408152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8ad517980 msgr2=0x55d8ad5229a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:59.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.955+0000 7f9caaffa740 1 --2- 172.21.15.82:0/4203408152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8ad517980 0x55d8ad5229a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9c900c48c0 tx=0x7f9c900035f0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.955+0000 7f9caaffa740 1 -- 172.21.15.82:0/4203408152 shutdown_connections 2024-03-04T09:14:59.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.955+0000 7f9caaffa740 1 --2- 172.21.15.82:0/4203408152 >> [v2:172.21.15.102:6838/35424130,v1:172.21.15.102:6839/35424130] conn(0x55d8ad58d330 0x55d8ad589180 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.955+0000 7f9caaffa740 1 --2- 172.21.15.82:0/4203408152 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8ad518340 0x55d8ad5276d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.955+0000 7f9c89ffb640 0 client.15285 ms_handle_reset on v2:172.21.15.102:6838/35424130 2024-03-04T09:14:59.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.955+0000 7f9caaffa740 1 --2- 172.21.15.82:0/4203408152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8ad517980 0x55d8ad5229a0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.955+0000 7f9caaffa740 1 --2- 172.21.15.82:0/4203408152 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d8ad5167b0 0x55d8ad522460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.955+0000 7f9caaffa740 1 -- 172.21.15.82:0/4203408152 >> 172.21.15.82:0/4203408152 conn(0x55d8ad511ba0 msgr2=0x55d8ad520d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:59.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.955+0000 7f9caaffa740 1 -- 172.21.15.82:0/4203408152 shutdown_connections 2024-03-04T09:14:59.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.955+0000 7f9caaffa740 1 -- 172.21.15.82:0/4203408152 wait complete. 2024-03-04T09:14:59.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.955+0000 7f9caaffa740 20 client.15285 trim_cache size 0 max 16384 2024-03-04T09:14:59.959 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-04T09:14:59.960 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "2e533fc8-da06-11ee-95c6-87774f69a715", 2024-03-04T09:14:59.960 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 0, 2024-03-04T09:14:59.960 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24476, 2024-03-04T09:14:59.960 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-03-04T09:14:59.960 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-03-04T09:14:59.960 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-03-04T09:14:59.960 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 109.20372874500001, 2024-03-04T09:14:59.960 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 27, 2024-03-04T09:14:59.960 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 92, 2024-03-04T09:14:59.960 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 90, 2024-03-04T09:14:59.960 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 114.406701058 2024-03-04T09:14:59.960 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-04T09:14:59.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.955+0000 7f9ca833a640 1 -- 172.21.15.82:0/3694705989 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f9c8c0a1d80 msgr2=0x7f9c8c0a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:59.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.955+0000 7f9ca833a640 1 --2- 172.21.15.82:0/3694705989 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f9c8c0a1d80 0x7f9c8c0a4240 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9c98009fd0 tx=0x7f9c98004a40 comp rx=0 tx=0).stop 2024-03-04T09:14:59.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.955+0000 7f9ca833a640 1 -- 172.21.15.82:0/3694705989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ca0104980 msgr2=0x7f9ca0197ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:14:59.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.955+0000 7f9ca833a640 1 --2- 172.21.15.82:0/3694705989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ca0104980 0x7f9ca0197ea0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f9c90005ab0 tx=0x7f9c90005de0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.955+0000 7f9ca833a640 1 -- 172.21.15.82:0/3694705989 shutdown_connections 2024-03-04T09:14:59.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.955+0000 7f9ca833a640 1 --2- 172.21.15.82:0/3694705989 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f9c8c0a1d80 0x7f9c8c0a4240 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.955+0000 7f9ca833a640 1 --2- 172.21.15.82:0/3694705989 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ca01072b0 0x7f9ca019ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.955+0000 7f9ca833a640 1 --2- 172.21.15.82:0/3694705989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ca0104980 0x7f9ca0197ea0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.955+0000 7f9ca833a640 1 --2- 172.21.15.82:0/3694705989 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ca0102050 0x7f9ca0197960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:14:59.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.955+0000 7f9ca833a640 1 -- 172.21.15.82:0/3694705989 >> 172.21.15.82:0/3694705989 conn(0x7f9ca00fba60 msgr2=0x7f9ca0103ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:14:59.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.956+0000 7f9ca833a640 1 -- 172.21.15.82:0/3694705989 shutdown_connections 2024-03-04T09:14:59.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:14:59.956+0000 7f9ca833a640 1 -- 172.21.15.82:0/3694705989 wait complete. 2024-03-04T09:14:59.963 INFO:tasks.cephadm:Setup complete, yielding 2024-03-04T09:14:59.963 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-03-04T09:14:59.973 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi082.front.sepia.ceph.com 2024-03-04T09:14:59.974 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- bash -c 'ceph orch status' 2024-03-04T09:15:00.222 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:15:01.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:01 smithi190 ceph-mon[36341]: pgmap v346: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:15:01.679 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:01 smithi082 ceph-mon[32880]: pgmap v346: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:15:01.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:01 smithi102 ceph-mon[36220]: pgmap v346: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:15:02.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.076+0000 7f693ac1b700 1 -- 172.21.15.82:0/539051690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6934101c50 msgr2=0x7f69341094f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:02.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.076+0000 7f693ac1b700 1 --2- 172.21.15.82:0/539051690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6934101c50 0x7f69341094f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f692c00b0a0 tx=0x7f692c00b3b0 comp rx=0 tx=0).stop 2024-03-04T09:15:02.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.076+0000 7f693ac1b700 1 -- 172.21.15.82:0/539051690 shutdown_connections 2024-03-04T09:15:02.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.076+0000 7f693ac1b700 1 --2- 172.21.15.82:0/539051690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6934101c50 0x7f69341094f0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:02.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.076+0000 7f693ac1b700 1 --2- 172.21.15.82:0/539051690 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69341026c0 0x7f6934102ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:02.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.076+0000 7f693ac1b700 1 --2- 172.21.15.82:0/539051690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6934101290 0x7f6934101710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:02.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.076+0000 7f693ac1b700 1 -- 172.21.15.82:0/539051690 >> 172.21.15.82:0/539051690 conn(0x7f69340fbd60 msgr2=0x7f69340fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:02.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.077+0000 7f693ac1b700 1 -- 172.21.15.82:0/539051690 shutdown_connections 2024-03-04T09:15:02.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.077+0000 7f693ac1b700 1 -- 172.21.15.82:0/539051690 wait complete. 2024-03-04T09:15:02.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.078+0000 7f693ac1b700 1 Processor -- start 2024-03-04T09:15:02.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.078+0000 7f693ac1b700 1 -- start start 2024-03-04T09:15:02.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.078+0000 7f693ac1b700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6934101290 0x7f69341982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:02.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.078+0000 7f693ac1b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6934101c50 0x7f6934198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:02.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.078+0000 7f693ac1b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69341026c0 0x7f693419f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:02.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.078+0000 7f693ac1b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f693410cbf0 con 0x7f69341026c0 2024-03-04T09:15:02.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.078+0000 7f693ac1b700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f693410ca70 con 0x7f6934101290 2024-03-04T09:15:02.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.078+0000 7f693ac1b700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f693410cd70 con 0x7f6934101c50 2024-03-04T09:15:02.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.078+0000 7f69391b8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69341026c0 0x7f693419f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:02.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.078+0000 7f69391b8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69341026c0 0x7f693419f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34138/0 (socket says 172.21.15.82:34138) 2024-03-04T09:15:02.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.078+0000 7f69391b8700 1 -- 172.21.15.82:0/839701597 learned_addr learned my addr 172.21.15.82:0/839701597 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:02.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.078+0000 7f69389b7700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6934101290 0x7f69341982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:02.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.078+0000 7f6933fff700 1 --2- 172.21.15.82:0/839701597 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6934101c50 0x7f6934198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:02.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.078+0000 7f69391b8700 1 -- 172.21.15.82:0/839701597 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6934101c50 msgr2=0x7f6934198800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:02.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.078+0000 7f69391b8700 1 --2- 172.21.15.82:0/839701597 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6934101c50 0x7f6934198800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:02.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.078+0000 7f69391b8700 1 -- 172.21.15.82:0/839701597 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6934101290 msgr2=0x7f69341982c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:02.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.078+0000 7f69391b8700 1 --2- 172.21.15.82:0/839701597 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6934101290 0x7f69341982c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:02.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.078+0000 7f69391b8700 1 -- 172.21.15.82:0/839701597 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f693419fed0 con 0x7f69341026c0 2024-03-04T09:15:02.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.078+0000 7f69389b7700 1 --2- 172.21.15.82:0/839701597 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6934101290 0x7f69341982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:15:02.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.078+0000 7f69391b8700 1 --2- 172.21.15.82:0/839701597 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69341026c0 0x7f693419f830 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f692c00d010 tx=0x7f692c0094f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:02.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.079+0000 7f6931ffb700 1 -- 172.21.15.82:0/839701597 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692c021070 con 0x7f69341026c0 2024-03-04T09:15:02.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.079+0000 7f6931ffb700 1 -- 172.21.15.82:0/839701597 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f692c007b80 con 0x7f69341026c0 2024-03-04T09:15:02.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.079+0000 7f6931ffb700 1 -- 172.21.15.82:0/839701597 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692c005330 con 0x7f69341026c0 2024-03-04T09:15:02.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.079+0000 7f693ac1b700 1 -- 172.21.15.82:0/839701597 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69341a0160 con 0x7f69341026c0 2024-03-04T09:15:02.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.079+0000 7f693ac1b700 1 -- 172.21.15.82:0/839701597 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69341a05c0 con 0x7f69341026c0 2024-03-04T09:15:02.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.080+0000 7f693ac1b700 1 -- 172.21.15.82:0/839701597 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6934068d80 con 0x7f69341026c0 2024-03-04T09:15:02.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.081+0000 7f6931ffb700 1 -- 172.21.15.82:0/839701597 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f692c024070 con 0x7f69341026c0 2024-03-04T09:15:02.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.081+0000 7f6931ffb700 1 --2- 172.21.15.82:0/839701597 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f69240a1e10 0x7f69240a42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:02.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.082+0000 7f69389b7700 1 --2- 172.21.15.82:0/839701597 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f69240a1e10 0x7f69240a42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:02.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.082+0000 7f6931ffb700 1 -- 172.21.15.82:0/839701597 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9092+0+0 (secure 0 0 0) 0x7f692c0cf1f0 con 0x7f69341026c0 2024-03-04T09:15:02.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.082+0000 7f69389b7700 1 --2- 172.21.15.82:0/839701597 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f69240a1e10 0x7f69240a42d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6928007fd0 tx=0x7f69280073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:02.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.085+0000 7f6931ffb700 1 -- 172.21.15.82:0/839701597 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f692c09c350 con 0x7f69341026c0 2024-03-04T09:15:02.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.297+0000 7f693ac1b700 1 -- 172.21.15.82:0/839701597 --> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f69341a08e0 con 0x7f69240a1e10 2024-03-04T09:15:02.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.298+0000 7f6931ffb700 1 -- 172.21.15.82:0/839701597 <== mgr.14152 v2:172.21.15.82:6800/1278635224 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f69341a08e0 con 0x7f69240a1e10 2024-03-04T09:15:02.295 INFO:teuthology.orchestra.run.smithi082.stdout:Backend: cephadm 2024-03-04T09:15:02.295 INFO:teuthology.orchestra.run.smithi082.stdout:Available: Yes 2024-03-04T09:15:02.295 INFO:teuthology.orchestra.run.smithi082.stdout:Paused: No 2024-03-04T09:15:02.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.300+0000 7f693ac1b700 1 -- 172.21.15.82:0/839701597 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f69240a1e10 msgr2=0x7f69240a42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:02.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.300+0000 7f693ac1b700 1 --2- 172.21.15.82:0/839701597 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f69240a1e10 0x7f69240a42d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6928007fd0 tx=0x7f69280073d0 comp rx=0 tx=0).stop 2024-03-04T09:15:02.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.300+0000 7f693ac1b700 1 -- 172.21.15.82:0/839701597 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69341026c0 msgr2=0x7f693419f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:02.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.300+0000 7f693ac1b700 1 --2- 172.21.15.82:0/839701597 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69341026c0 0x7f693419f830 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f692c00d010 tx=0x7f692c0094f0 comp rx=0 tx=0).stop 2024-03-04T09:15:02.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.300+0000 7f693ac1b700 1 -- 172.21.15.82:0/839701597 shutdown_connections 2024-03-04T09:15:02.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.300+0000 7f693ac1b700 1 --2- 172.21.15.82:0/839701597 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f69240a1e10 0x7f69240a42d0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:02.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.300+0000 7f693ac1b700 1 --2- 172.21.15.82:0/839701597 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69341026c0 0x7f693419f830 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:02.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.300+0000 7f693ac1b700 1 --2- 172.21.15.82:0/839701597 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6934101290 0x7f69341982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:02.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.300+0000 7f693ac1b700 1 --2- 172.21.15.82:0/839701597 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6934101c50 0x7f6934198800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:02.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.300+0000 7f693ac1b700 1 -- 172.21.15.82:0/839701597 >> 172.21.15.82:0/839701597 conn(0x7f69340fbd60 msgr2=0x7f69340fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:02.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.300+0000 7f693ac1b700 1 -- 172.21.15.82:0/839701597 shutdown_connections 2024-03-04T09:15:02.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:02.300+0000 7f693ac1b700 1 -- 172.21.15.82:0/839701597 wait complete. 2024-03-04T09:15:02.943 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- bash -c 'ceph orch ps' 2024-03-04T09:15:03.185 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:15:03.557 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:03 smithi082 ceph-mon[32880]: pgmap v347: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-03-04T09:15:03.557 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:03 smithi082 ceph-mon[32880]: from='client.15291 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:15:03.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:03 smithi190 ceph-mon[36341]: pgmap v347: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-03-04T09:15:03.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:03 smithi190 ceph-mon[36341]: from='client.15291 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:15:03.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:03 smithi102 ceph-mon[36220]: pgmap v347: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-03-04T09:15:03.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:03 smithi102 ceph-mon[36220]: from='client.15291 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:15:04.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:04.981+0000 7fc5d6646700 1 -- 172.21.15.82:0/1448425860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5d01003b0 msgr2=0x7fc5d01007d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:04.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:04.981+0000 7fc5d6646700 1 --2- 172.21.15.82:0/1448425860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5d01003b0 0x7fc5d01007d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0009990 tx=0x7fc5c0009ca0 comp rx=0 tx=0).stop 2024-03-04T09:15:04.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:04.981+0000 7fc5d6646700 1 -- 172.21.15.82:0/1448425860 shutdown_connections 2024-03-04T09:15:04.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:04.981+0000 7fc5d6646700 1 --2- 172.21.15.82:0/1448425860 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc5d0103d30 0x7fc5d010a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:04.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:04.981+0000 7fc5d6646700 1 --2- 172.21.15.82:0/1448425860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5d01003b0 0x7fc5d01007d0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:04.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:04.981+0000 7fc5d6646700 1 --2- 172.21.15.82:0/1448425860 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5d0103390 0x7fc5d01037f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:04.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:04.981+0000 7fc5d6646700 1 -- 172.21.15.82:0/1448425860 >> 172.21.15.82:0/1448425860 conn(0x7fc5d00fbd30 msgr2=0x7fc5d00fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:04.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:04.981+0000 7fc5d6646700 1 -- 172.21.15.82:0/1448425860 shutdown_connections 2024-03-04T09:15:04.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:04.981+0000 7fc5d6646700 1 -- 172.21.15.82:0/1448425860 wait complete. 2024-03-04T09:15:04.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:04.982+0000 7fc5d6646700 1 Processor -- start 2024-03-04T09:15:04.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:04.982+0000 7fc5d6646700 1 -- start start 2024-03-04T09:15:04.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:04.982+0000 7fc5d6646700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc5d01003b0 0x7fc5d0198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:04.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:04.982+0000 7fc5d6646700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5d0103390 0x7fc5d01988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:04.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:04.982+0000 7fc5d6646700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5d0103d30 0x7fc5d019f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:04.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:04.982+0000 7fc5d6646700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d010dd10 con 0x7fc5d0103390 2024-03-04T09:15:04.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:04.982+0000 7fc5d6646700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d010db90 con 0x7fc5d0103d30 2024-03-04T09:15:04.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:04.982+0000 7fc5d6646700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d010de90 con 0x7fc5d01003b0 2024-03-04T09:15:04.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:04.982+0000 7fc5cf7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5d0103390 0x7fc5d01988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:04.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:04.982+0000 7fc5cf7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5d0103390 0x7fc5d01988b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34152/0 (socket says 172.21.15.82:34152) 2024-03-04T09:15:04.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:04.982+0000 7fc5cf7fe700 1 -- 172.21.15.82:0/2763464120 learned_addr learned my addr 172.21.15.82:0/2763464120 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:04.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:04.982+0000 7fc5d4be3700 1 --2- 172.21.15.82:0/2763464120 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5d0103d30 0x7fc5d019f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:04.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:04.982+0000 7fc5cffff700 1 --2- 172.21.15.82:0/2763464120 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc5d01003b0 0x7fc5d0198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:04.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:04.983+0000 7fc5d4be3700 1 -- 172.21.15.82:0/2763464120 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc5d01003b0 msgr2=0x7fc5d0198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:04.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:04.983+0000 7fc5d4be3700 1 --2- 172.21.15.82:0/2763464120 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc5d01003b0 0x7fc5d0198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:04.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:04.983+0000 7fc5d4be3700 1 -- 172.21.15.82:0/2763464120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5d0103390 msgr2=0x7fc5d01988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:04.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:04.983+0000 7fc5d4be3700 1 --2- 172.21.15.82:0/2763464120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5d0103390 0x7fc5d01988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:04.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:04.983+0000 7fc5d4be3700 1 -- 172.21.15.82:0/2763464120 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d019ffd0 con 0x7fc5d0103d30 2024-03-04T09:15:04.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:04.983+0000 7fc5d4be3700 1 --2- 172.21.15.82:0/2763464120 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5d0103d30 0x7fc5d019f930 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc5c800efc0 tx=0x7fc5c800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:04.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:04.983+0000 7fc5cd7fa700 1 -- 172.21.15.82:0/2763464120 <== mon.2 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c80092e0 con 0x7fc5d0103d30 2024-03-04T09:15:04.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:04.983+0000 7fc5cd7fa700 1 -- 172.21.15.82:0/2763464120 <== mon.2 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fc5c8004bb0 con 0x7fc5d0103d30 2024-03-04T09:15:04.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:04.983+0000 7fc5cd7fa700 1 -- 172.21.15.82:0/2763464120 <== mon.2 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c8004280 con 0x7fc5d0103d30 2024-03-04T09:15:04.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:04.983+0000 7fc5d6646700 1 -- 172.21.15.82:0/2763464120 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5d01a0260 con 0x7fc5d0103d30 2024-03-04T09:15:04.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:04.983+0000 7fc5d6646700 1 -- 172.21.15.82:0/2763464120 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5d01a0750 con 0x7fc5d0103d30 2024-03-04T09:15:04.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:04.984+0000 7fc5d6646700 1 -- 172.21.15.82:0/2763464120 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5d0068d80 con 0x7fc5d0103d30 2024-03-04T09:15:04.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:04.985+0000 7fc5cd7fa700 1 -- 172.21.15.82:0/2763464120 <== mon.2 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 18) v1 ==== 136756+0+0 (secure 0 0 0) 0x7fc5c801b030 con 0x7fc5d0103d30 2024-03-04T09:15:04.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:04.985+0000 7fc5cd7fa700 1 --2- 172.21.15.82:0/2763464120 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fc5bc0a1e10 0x7fc5bc0a42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:04.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:04.986+0000 7fc5cffff700 1 --2- 172.21.15.82:0/2763464120 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fc5bc0a1e10 0x7fc5bc0a42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:04.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:04.986+0000 7fc5cd7fa700 1 -- 172.21.15.82:0/2763464120 <== mon.2 v2:172.21.15.102:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9092+0+0 (secure 0 0 0) 0x7fc5c80cddc0 con 0x7fc5d0103d30 2024-03-04T09:15:04.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:04.986+0000 7fc5cffff700 1 --2- 172.21.15.82:0/2763464120 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fc5bc0a1e10 0x7fc5bc0a42d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc5c000b7f0 tx=0x7fc5c0005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:04.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:04.989+0000 7fc5cd7fa700 1 -- 172.21.15.82:0/2763464120 <== mon.2 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fc5c8022020 con 0x7fc5d0103d30 2024-03-04T09:15:05.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:05.194+0000 7fc5d6646700 1 -- 172.21.15.82:0/2763464120 --> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5d00625c0 con 0x7fc5bc0a1e10 2024-03-04T09:15:05.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:05.208+0000 7fc5cd7fa700 1 -- 172.21.15.82:0/2763464120 <== mgr.14152 v2:172.21.15.82:6800/1278635224 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+4123 (secure 0 0 0) 0x7fc5d00625c0 con 0x7fc5bc0a1e10 2024-03-04T09:15:05.205 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-04T09:15:05.205 INFO:teuthology.orchestra.run.smithi082.stdout:mds.a smithi082 running (2m) 19s ago 2m 17.5M - 19.0.0-1739-g1bc250c7 f88ffb32aa6a e7eed8ee517d 2024-03-04T09:15:05.205 INFO:teuthology.orchestra.run.smithi082.stdout:mds.b smithi102 running (2m) 53s ago 119s 26.1M - 19.0.0-1739-g1bc250c7 f88ffb32aa6a c6738d754c0d 2024-03-04T09:15:05.206 INFO:teuthology.orchestra.run.smithi082.stdout:mds.c smithi190 running (2m) 53s ago 2m 19.4M - 19.0.0-1739-g1bc250c7 f88ffb32aa6a b8ad6f518f39 2024-03-04T09:15:05.206 INFO:teuthology.orchestra.run.smithi082.stdout:mds.d smithi082 running (2m) 19s ago 2m 13.9M - 19.0.0-1739-g1bc250c7 f88ffb32aa6a dc6d2245f297 2024-03-04T09:15:05.206 INFO:teuthology.orchestra.run.smithi082.stdout:mds.e smithi102 running (2m) 53s ago 2m 18.3M - 19.0.0-1739-g1bc250c7 f88ffb32aa6a e3feb706fe2e 2024-03-04T09:15:05.206 INFO:teuthology.orchestra.run.smithi082.stdout:mds.f smithi190 running (2m) 53s ago 2m 17.0M - 19.0.0-1739-g1bc250c7 f88ffb32aa6a f653b0cd9cbb 2024-03-04T09:15:05.206 INFO:teuthology.orchestra.run.smithi082.stdout:mds.g smithi082 running (2m) 19s ago 2m 17.6M - 19.0.0-1739-g1bc250c7 f88ffb32aa6a 2d46f426b5af 2024-03-04T09:15:05.206 INFO:teuthology.orchestra.run.smithi082.stdout:mds.h smithi102 running (2m) 53s ago 2m 16.8M - 19.0.0-1739-g1bc250c7 f88ffb32aa6a 2ef4424c49d9 2024-03-04T09:15:05.207 INFO:teuthology.orchestra.run.smithi082.stdout:mds.i smithi190 running (2m) 53s ago 2m 17.2M - 19.0.0-1739-g1bc250c7 f88ffb32aa6a 6cd20d28ba89 2024-03-04T09:15:05.207 INFO:teuthology.orchestra.run.smithi082.stdout:mds.j smithi082 running (2m) 19s ago 2m 16.2M - 19.0.0-1739-g1bc250c7 f88ffb32aa6a 915a00d14ff3 2024-03-04T09:15:05.207 INFO:teuthology.orchestra.run.smithi082.stdout:mds.k smithi102 running (2m) 53s ago 2m 16.0M - 19.0.0-1739-g1bc250c7 f88ffb32aa6a 1650eab41f0d 2024-03-04T09:15:05.207 INFO:teuthology.orchestra.run.smithi082.stdout:mds.l smithi190 running (2m) 53s ago 2m 18.4M - 19.0.0-1739-g1bc250c7 f88ffb32aa6a a8098d38027e 2024-03-04T09:15:05.207 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.x smithi082 *:9283,8765 running (9m) 19s ago 9m 513M - 19.0.0-1739-g1bc250c7 f88ffb32aa6a c589e7f2c2f7 2024-03-04T09:15:05.207 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.y smithi102 *:8443,8765 running (7m) 53s ago 7m 451M - 19.0.0-1739-g1bc250c7 f88ffb32aa6a 3b58c026fa62 2024-03-04T09:15:05.208 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.z smithi190 *:8443,8765 running (7m) 53s ago 7m 452M - 19.0.0-1739-g1bc250c7 f88ffb32aa6a 63f707160b86 2024-03-04T09:15:05.208 INFO:teuthology.orchestra.run.smithi082.stdout:mon.a smithi082 running (9m) 19s ago 9m 50.4M 2048M 19.0.0-1739-g1bc250c7 f88ffb32aa6a 938c8db3694a 2024-03-04T09:15:05.208 INFO:teuthology.orchestra.run.smithi082.stdout:mon.b smithi102 running (7m) 53s ago 7m 40.0M 2048M 19.0.0-1739-g1bc250c7 f88ffb32aa6a 2bb2d29e7dd5 2024-03-04T09:15:05.208 INFO:teuthology.orchestra.run.smithi082.stdout:mon.c smithi190 running (8m) 53s ago 8m 38.3M 2048M 19.0.0-1739-g1bc250c7 f88ffb32aa6a 2d0032eabe8c 2024-03-04T09:15:05.208 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (7m) 19s ago 7m 48.2M 4272M 19.0.0-1739-g1bc250c7 f88ffb32aa6a 50e75a8dd32a 2024-03-04T09:15:05.209 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi102 running (7m) 53s ago 7m 59.5M 4272M 19.0.0-1739-g1bc250c7 f88ffb32aa6a 4fb7ba18bed9 2024-03-04T09:15:05.209 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi190 running (6m) 53s ago 6m 45.8M 4272M 19.0.0-1739-g1bc250c7 f88ffb32aa6a 1a52d98e7341 2024-03-04T09:15:05.209 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi082 running (6m) 19s ago 6m 57.7M 4272M 19.0.0-1739-g1bc250c7 f88ffb32aa6a 9d0e973651d6 2024-03-04T09:15:05.209 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi102 running (5m) 53s ago 5m 42.0M 4272M 19.0.0-1739-g1bc250c7 f88ffb32aa6a f8a02f7d0d9d 2024-03-04T09:15:05.209 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi190 running (5m) 53s ago 5m 45.3M 4272M 19.0.0-1739-g1bc250c7 f88ffb32aa6a 7abe748fbf23 2024-03-04T09:15:05.209 INFO:teuthology.orchestra.run.smithi082.stdout:osd.6 smithi082 running (4m) 19s ago 4m 43.2M 4272M 19.0.0-1739-g1bc250c7 f88ffb32aa6a a53c08516f5b 2024-03-04T09:15:05.210 INFO:teuthology.orchestra.run.smithi082.stdout:osd.7 smithi102 running (4m) 53s ago 4m 43.6M 4272M 19.0.0-1739-g1bc250c7 f88ffb32aa6a dfdb679ed883 2024-03-04T09:15:05.210 INFO:teuthology.orchestra.run.smithi082.stdout:osd.8 smithi190 running (4m) 53s ago 4m 57.4M 4272M 19.0.0-1739-g1bc250c7 f88ffb32aa6a dba5cb37e82b 2024-03-04T09:15:05.210 INFO:teuthology.orchestra.run.smithi082.stdout:osd.9 smithi082 running (3m) 19s ago 3m 53.4M 4272M 19.0.0-1739-g1bc250c7 f88ffb32aa6a 28c2b8b6f900 2024-03-04T09:15:05.210 INFO:teuthology.orchestra.run.smithi082.stdout:osd.10 smithi102 running (3m) 53s ago 3m 43.0M 4272M 19.0.0-1739-g1bc250c7 f88ffb32aa6a 7034f921d8fc 2024-03-04T09:15:05.211 INFO:teuthology.orchestra.run.smithi082.stdout:osd.11 smithi190 running (2m) 53s ago 2m 43.4M 4272M 19.0.0-1739-g1bc250c7 f88ffb32aa6a ea729f7ff4fa 2024-03-04T09:15:05.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:05.210+0000 7fc5d6646700 1 -- 172.21.15.82:0/2763464120 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fc5bc0a1e10 msgr2=0x7fc5bc0a42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:05.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:05.210+0000 7fc5d6646700 1 --2- 172.21.15.82:0/2763464120 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fc5bc0a1e10 0x7fc5bc0a42d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc5c000b7f0 tx=0x7fc5c0005fd0 comp rx=0 tx=0).stop 2024-03-04T09:15:05.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:05.210+0000 7fc5d6646700 1 -- 172.21.15.82:0/2763464120 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5d0103d30 msgr2=0x7fc5d019f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:05.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:05.210+0000 7fc5d6646700 1 --2- 172.21.15.82:0/2763464120 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5d0103d30 0x7fc5d019f930 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc5c800efc0 tx=0x7fc5c800c3a0 comp rx=0 tx=0).stop 2024-03-04T09:15:05.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:05.210+0000 7fc5d6646700 1 -- 172.21.15.82:0/2763464120 shutdown_connections 2024-03-04T09:15:05.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:05.210+0000 7fc5d6646700 1 --2- 172.21.15.82:0/2763464120 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fc5bc0a1e10 0x7fc5bc0a42d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:05.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:05.210+0000 7fc5d6646700 1 --2- 172.21.15.82:0/2763464120 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5d0103d30 0x7fc5d019f930 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:05.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:05.210+0000 7fc5d6646700 1 --2- 172.21.15.82:0/2763464120 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc5d01003b0 0x7fc5d0198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:05.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:05.210+0000 7fc5d6646700 1 --2- 172.21.15.82:0/2763464120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5d0103390 0x7fc5d01988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:05.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:05.210+0000 7fc5d6646700 1 -- 172.21.15.82:0/2763464120 >> 172.21.15.82:0/2763464120 conn(0x7fc5d00fbd30 msgr2=0x7fc5d0106710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:05.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:05.210+0000 7fc5d6646700 1 -- 172.21.15.82:0/2763464120 shutdown_connections 2024-03-04T09:15:05.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:05.210+0000 7fc5d6646700 1 -- 172.21.15.82:0/2763464120 wait complete. 2024-03-04T09:15:05.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:05 smithi082 ceph-mon[32880]: pgmap v348: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-03-04T09:15:05.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:05 smithi190 ceph-mon[36341]: pgmap v348: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-03-04T09:15:05.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:05 smithi102 ceph-mon[36220]: pgmap v348: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-03-04T09:15:05.927 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- bash -c 'ceph orch ls' 2024-03-04T09:15:06.170 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:15:06.551 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:06 smithi082 ceph-mon[32880]: from='client.25127 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:15:06.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:06 smithi190 ceph-mon[36341]: from='client.25127 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:15:06.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:06 smithi102 ceph-mon[36220]: from='client.25127 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:15:07.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:07 smithi190 ceph-mon[36341]: pgmap v349: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-03-04T09:15:07.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:07 smithi102 ceph-mon[36220]: pgmap v349: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-03-04T09:15:07.716 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:07 smithi082 ceph-mon[32880]: pgmap v349: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-03-04T09:15:07.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:07.955+0000 7f90c4ee1700 1 -- 172.21.15.82:0/4090615323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90c0103c80 msgr2=0x7f90c010a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:07.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:07.955+0000 7f90c4ee1700 1 --2- 172.21.15.82:0/4090615323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90c0103c80 0x7f90c010a530 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f90b800b0d0 tx=0x7f90b800b3e0 comp rx=0 tx=0).stop 2024-03-04T09:15:07.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:07.955+0000 7f90c4ee1700 1 -- 172.21.15.82:0/4090615323 shutdown_connections 2024-03-04T09:15:07.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:07.955+0000 7f90c4ee1700 1 --2- 172.21.15.82:0/4090615323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90c0103c80 0x7f90c010a530 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:07.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:07.955+0000 7f90c4ee1700 1 --2- 172.21.15.82:0/4090615323 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90c01020e0 0x7f90c0102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:07.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:07.955+0000 7f90c4ee1700 1 --2- 172.21.15.82:0/4090615323 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f90c01032e0 0x7f90c0103740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:07.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:07.955+0000 7f90c4ee1700 1 -- 172.21.15.82:0/4090615323 >> 172.21.15.82:0/4090615323 conn(0x7f90c00fd6a0 msgr2=0x7f90c00ffac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:07.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:07.955+0000 7f90c4ee1700 1 -- 172.21.15.82:0/4090615323 shutdown_connections 2024-03-04T09:15:07.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:07.955+0000 7f90c4ee1700 1 -- 172.21.15.82:0/4090615323 wait complete. 2024-03-04T09:15:07.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:07.956+0000 7f90c4ee1700 1 Processor -- start 2024-03-04T09:15:07.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:07.956+0000 7f90c4ee1700 1 -- start start 2024-03-04T09:15:07.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:07.956+0000 7f90c4ee1700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f90c01020e0 0x7f90c019a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:07.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:07.956+0000 7f90c4ee1700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90c01032e0 0x7f90c019a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:07.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:07.956+0000 7f90c4ee1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90c0103c80 0x7f90c01a1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:07.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:07.956+0000 7f90c4ee1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c010dce0 con 0x7f90c0103c80 2024-03-04T09:15:07.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:07.956+0000 7f90c4ee1700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c010db60 con 0x7f90c01032e0 2024-03-04T09:15:07.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:07.956+0000 7f90c4ee1700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c010de60 con 0x7f90c01020e0 2024-03-04T09:15:07.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:07.956+0000 7f90bed9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90c0103c80 0x7f90c01a1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:07.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:07.956+0000 7f90be59c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f90c01020e0 0x7f90c019a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:07.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:07.956+0000 7f90bed9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90c0103c80 0x7f90c01a1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46684/0 (socket says 172.21.15.82:46684) 2024-03-04T09:15:07.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:07.956+0000 7f90bed9d700 1 -- 172.21.15.82:0/190983511 learned_addr learned my addr 172.21.15.82:0/190983511 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:07.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:07.956+0000 7f90be59c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f90c01020e0 0x7f90c019a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.82:33576/0 (socket says 172.21.15.82:33576) 2024-03-04T09:15:07.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:07.956+0000 7f90bdd9b700 1 --2- 172.21.15.82:0/190983511 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90c01032e0 0x7f90c019a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:07.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:07.956+0000 7f90be59c700 1 -- 172.21.15.82:0/190983511 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90c01032e0 msgr2=0x7f90c019a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:07.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:07.956+0000 7f90be59c700 1 --2- 172.21.15.82:0/190983511 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90c01032e0 0x7f90c019a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:07.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:07.956+0000 7f90be59c700 1 -- 172.21.15.82:0/190983511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90c0103c80 msgr2=0x7f90c01a1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:07.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:07.956+0000 7f90be59c700 1 --2- 172.21.15.82:0/190983511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90c0103c80 0x7f90c01a1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:07.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:07.956+0000 7f90be59c700 1 -- 172.21.15.82:0/190983511 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c01a20e0 con 0x7f90c01020e0 2024-03-04T09:15:07.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:07.956+0000 7f90bdd9b700 1 --2- 172.21.15.82:0/190983511 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90c01032e0 0x7f90c019a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:15:07.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:07.956+0000 7f90bed9d700 1 --2- 172.21.15.82:0/190983511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90c0103c80 0x7f90c01a1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:15:07.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:07.956+0000 7f90be59c700 1 --2- 172.21.15.82:0/190983511 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f90c01020e0 0x7f90c019a480 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f90b000e9f0 tx=0x7f90b000ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:07.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:07.957+0000 7f90af7fe700 1 -- 172.21.15.82:0/190983511 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b0004220 con 0x7f90c01020e0 2024-03-04T09:15:07.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:07.957+0000 7f90c4ee1700 1 -- 172.21.15.82:0/190983511 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90c01a23d0 con 0x7f90c01020e0 2024-03-04T09:15:07.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:07.957+0000 7f90af7fe700 1 -- 172.21.15.82:0/190983511 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f90b00043c0 con 0x7f90c01020e0 2024-03-04T09:15:07.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:07.957+0000 7f90af7fe700 1 -- 172.21.15.82:0/190983511 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b0003cb0 con 0x7f90c01020e0 2024-03-04T09:15:07.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:07.957+0000 7f90c4ee1700 1 -- 172.21.15.82:0/190983511 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90c01a2960 con 0x7f90c01020e0 2024-03-04T09:15:07.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:07.958+0000 7f90c4ee1700 1 -- 172.21.15.82:0/190983511 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90c0068d80 con 0x7f90c01020e0 2024-03-04T09:15:07.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:07.959+0000 7f90af7fe700 1 -- 172.21.15.82:0/190983511 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 18) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f90b000c7c0 con 0x7f90c01020e0 2024-03-04T09:15:07.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:07.959+0000 7f90af7fe700 1 --2- 172.21.15.82:0/190983511 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f90a80a1e10 0x7f90a80a42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:07.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:07.959+0000 7f90bdd9b700 1 --2- 172.21.15.82:0/190983511 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f90a80a1e10 0x7f90a80a42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:07.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:07.960+0000 7f90af7fe700 1 -- 172.21.15.82:0/190983511 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9092+0+0 (secure 0 0 0) 0x7f90b00ce3c0 con 0x7f90c01020e0 2024-03-04T09:15:07.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:07.960+0000 7f90bdd9b700 1 --2- 172.21.15.82:0/190983511 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f90a80a1e10 0x7f90a80a42d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f90b4011490 tx=0x7f90b4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:07.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:07.967+0000 7f90af7fe700 1 -- 172.21.15.82:0/190983511 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f90b009b520 con 0x7f90c01020e0 2024-03-04T09:15:08.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:08.175+0000 7f90c4ee1700 1 -- 172.21.15.82:0/190983511 --> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f90c0075a10 con 0x7f90a80a1e10 2024-03-04T09:15:08.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:08.181+0000 7f90af7fe700 1 -- 172.21.15.82:0/190983511 <== mgr.14152 v2:172.21.15.82:6800/1278635224 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+980 (secure 0 0 0) 0x7f90c0075a10 con 0x7f90a80a1e10 2024-03-04T09:15:08.178 INFO:teuthology.orchestra.run.smithi082.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-03-04T09:15:08.178 INFO:teuthology.orchestra.run.smithi082.stdout:mds.all 12/12 56s ago 2m smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi102=b;smithi102=e;smithi102=h;smithi102=k;smithi190=c;smithi190=f;smithi190=i;smithi190=l;count:12 2024-03-04T09:15:08.178 INFO:teuthology.orchestra.run.smithi082.stdout:mgr 3/3 56s ago 7m smithi082=x;smithi102=y;smithi190=z;count:3 2024-03-04T09:15:08.179 INFO:teuthology.orchestra.run.smithi082.stdout:mon 3/3 56s ago 8m smithi082:172.21.15.82=a;smithi102:172.21.15.102=b;smithi190:172.21.15.190=c;count:3 2024-03-04T09:15:08.179 INFO:teuthology.orchestra.run.smithi082.stdout:osd 12 56s ago - 2024-03-04T09:15:08.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:08.183+0000 7f90c4ee1700 1 -- 172.21.15.82:0/190983511 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f90a80a1e10 msgr2=0x7f90a80a42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:08.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:08.183+0000 7f90c4ee1700 1 --2- 172.21.15.82:0/190983511 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f90a80a1e10 0x7f90a80a42d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f90b4011490 tx=0x7f90b4009260 comp rx=0 tx=0).stop 2024-03-04T09:15:08.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:08.183+0000 7f90c4ee1700 1 -- 172.21.15.82:0/190983511 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f90c01020e0 msgr2=0x7f90c019a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:08.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:08.183+0000 7f90c4ee1700 1 --2- 172.21.15.82:0/190983511 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f90c01020e0 0x7f90c019a480 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f90b000e9f0 tx=0x7f90b000ed00 comp rx=0 tx=0).stop 2024-03-04T09:15:08.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:08.183+0000 7f90c4ee1700 1 -- 172.21.15.82:0/190983511 shutdown_connections 2024-03-04T09:15:08.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:08.183+0000 7f90c4ee1700 1 --2- 172.21.15.82:0/190983511 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f90a80a1e10 0x7f90a80a42d0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:08.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:08.183+0000 7f90c4ee1700 1 --2- 172.21.15.82:0/190983511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90c0103c80 0x7f90c01a1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:08.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:08.183+0000 7f90c4ee1700 1 --2- 172.21.15.82:0/190983511 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f90c01020e0 0x7f90c019a480 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:08.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:08.183+0000 7f90c4ee1700 1 --2- 172.21.15.82:0/190983511 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90c01032e0 0x7f90c019a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:08.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:08.183+0000 7f90c4ee1700 1 -- 172.21.15.82:0/190983511 >> 172.21.15.82:0/190983511 conn(0x7f90c00fd6a0 msgr2=0x7f90c00742f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:08.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:08.183+0000 7f90c4ee1700 1 -- 172.21.15.82:0/190983511 shutdown_connections 2024-03-04T09:15:08.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:08.183+0000 7f90c4ee1700 1 -- 172.21.15.82:0/190983511 wait complete. 2024-03-04T09:15:08.797 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- bash -c 'ceph orch host ls' 2024-03-04T09:15:09.040 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:15:09.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:09 smithi082 ceph-mon[32880]: from='client.25084 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:15:09.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:09 smithi082 ceph-mon[32880]: pgmap v350: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-03-04T09:15:09.420 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:09 smithi190 ceph-mon[36341]: from='client.25084 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:15:09.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:09 smithi190 ceph-mon[36341]: pgmap v350: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-03-04T09:15:09.428 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:09 smithi102 ceph-mon[36220]: from='client.25084 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:15:09.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:09 smithi102 ceph-mon[36220]: pgmap v350: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-03-04T09:15:10.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:10.841+0000 7f868a98f700 1 -- 172.21.15.82:0/1591254818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86841021f0 msgr2=0x7f8684102650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:10.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:10.841+0000 7f868a98f700 1 --2- 172.21.15.82:0/1591254818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86841021f0 0x7f8684102650 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f86740099c0 tx=0x7f8674009cd0 comp rx=0 tx=0).stop 2024-03-04T09:15:10.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:10.841+0000 7f868a98f700 1 -- 172.21.15.82:0/1591254818 shutdown_connections 2024-03-04T09:15:10.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:10.841+0000 7f868a98f700 1 --2- 172.21.15.82:0/1591254818 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8684102b90 0x7f8684109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:10.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:10.841+0000 7f868a98f700 1 --2- 172.21.15.82:0/1591254818 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8684100ff0 0x7f8684101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:10.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:10.841+0000 7f868a98f700 1 --2- 172.21.15.82:0/1591254818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86841021f0 0x7f8684102650 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:10.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:10.841+0000 7f868a98f700 1 -- 172.21.15.82:0/1591254818 >> 172.21.15.82:0/1591254818 conn(0x7f86840fc590 msgr2=0x7f86840fe9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:10.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:10.841+0000 7f868a98f700 1 -- 172.21.15.82:0/1591254818 shutdown_connections 2024-03-04T09:15:10.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:10.841+0000 7f868a98f700 1 -- 172.21.15.82:0/1591254818 wait complete. 2024-03-04T09:15:10.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:10.842+0000 7f868a98f700 1 Processor -- start 2024-03-04T09:15:10.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:10.842+0000 7f868a98f700 1 -- start start 2024-03-04T09:15:10.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:10.842+0000 7f868a98f700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8684100ff0 0x7f86841983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:10.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:10.842+0000 7f868a98f700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86841021f0 0x7f8684198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:10.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:10.842+0000 7f868a98f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8684102b90 0x7f868419f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:10.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:10.842+0000 7f868a98f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868410cc40 con 0x7f8684102b90 2024-03-04T09:15:10.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:10.842+0000 7f868a98f700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868410cac0 con 0x7f8684100ff0 2024-03-04T09:15:10.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:10.842+0000 7f868a98f700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868410cdc0 con 0x7f86841021f0 2024-03-04T09:15:10.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:10.842+0000 7f8688f2c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8684102b90 0x7f868419f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:10.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:10.842+0000 7f8683fff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8684100ff0 0x7f86841983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:10.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:10.842+0000 7f86837fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86841021f0 0x7f8684198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:10.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:10.842+0000 7f8688f2c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8684102b90 0x7f868419f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46698/0 (socket says 172.21.15.82:46698) 2024-03-04T09:15:10.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:10.842+0000 7f8683fff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8684100ff0 0x7f86841983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.82:42834/0 (socket says 172.21.15.82:42834) 2024-03-04T09:15:10.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:10.842+0000 7f8688f2c700 1 -- 172.21.15.82:0/1966358490 learned_addr learned my addr 172.21.15.82:0/1966358490 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:10.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:10.842+0000 7f8688f2c700 1 -- 172.21.15.82:0/1966358490 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86841021f0 msgr2=0x7f8684198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:10.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:10.843+0000 7f8688f2c700 1 --2- 172.21.15.82:0/1966358490 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86841021f0 0x7f8684198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:10.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:10.843+0000 7f8688f2c700 1 -- 172.21.15.82:0/1966358490 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8684100ff0 msgr2=0x7f86841983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:10.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:10.843+0000 7f8688f2c700 1 --2- 172.21.15.82:0/1966358490 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8684100ff0 0x7f86841983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:10.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:10.843+0000 7f8688f2c700 1 -- 172.21.15.82:0/1966358490 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86841a0040 con 0x7f8684102b90 2024-03-04T09:15:10.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:10.843+0000 7f86837fe700 1 --2- 172.21.15.82:0/1966358490 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86841021f0 0x7f8684198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:15:10.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:10.843+0000 7f8683fff700 1 --2- 172.21.15.82:0/1966358490 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8684100ff0 0x7f86841983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:15:10.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:10.843+0000 7f8688f2c700 1 --2- 172.21.15.82:0/1966358490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8684102b90 0x7f868419f9a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f867c00ef60 tx=0x7f867c00ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:10.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:10.843+0000 7f86817fa700 1 -- 172.21.15.82:0/1966358490 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c0092e0 con 0x7f8684102b90 2024-03-04T09:15:10.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:10.843+0000 7f86817fa700 1 -- 172.21.15.82:0/1966358490 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f867c004bb0 con 0x7f8684102b90 2024-03-04T09:15:10.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:10.843+0000 7f868a98f700 1 -- 172.21.15.82:0/1966358490 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86841a02d0 con 0x7f8684102b90 2024-03-04T09:15:10.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:10.843+0000 7f86817fa700 1 -- 172.21.15.82:0/1966358490 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c004280 con 0x7f8684102b90 2024-03-04T09:15:10.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:10.843+0000 7f868a98f700 1 -- 172.21.15.82:0/1966358490 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86841a07c0 con 0x7f8684102b90 2024-03-04T09:15:10.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:10.844+0000 7f868a98f700 1 -- 172.21.15.82:0/1966358490 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8684068d80 con 0x7f8684102b90 2024-03-04T09:15:10.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:10.845+0000 7f86817fa700 1 -- 172.21.15.82:0/1966358490 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f867c01b030 con 0x7f8684102b90 2024-03-04T09:15:10.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:10.846+0000 7f86817fa700 1 --2- 172.21.15.82:0/1966358490 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f86700a1e10 0x7f86700a42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:10.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:10.846+0000 7f8683fff700 1 --2- 172.21.15.82:0/1966358490 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f86700a1e10 0x7f86700a42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:10.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:10.846+0000 7f86817fa700 1 -- 172.21.15.82:0/1966358490 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9092+0+0 (secure 0 0 0) 0x7f867c0ce4e0 con 0x7f8684102b90 2024-03-04T09:15:10.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:10.846+0000 7f8683fff700 1 --2- 172.21.15.82:0/1966358490 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f86700a1e10 0x7f86700a42d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8684102050 tx=0x7f866c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:10.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:10.849+0000 7f86817fa700 1 -- 172.21.15.82:0/1966358490 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f867c022020 con 0x7f8684102b90 2024-03-04T09:15:11.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:11.049+0000 7f868a98f700 1 -- 172.21.15.82:0/1966358490 --> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f86841a0ae0 con 0x7f86700a1e10 2024-03-04T09:15:11.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:11.051+0000 7f86817fa700 1 -- 172.21.15.82:0/1966358490 <== mgr.14152 v2:172.21.15.82:6800/1278635224 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+191 (secure 0 0 0) 0x7f86841a0ae0 con 0x7f86700a1e10 2024-03-04T09:15:11.047 INFO:teuthology.orchestra.run.smithi082.stdout:HOST ADDR LABELS STATUS 2024-03-04T09:15:11.047 INFO:teuthology.orchestra.run.smithi082.stdout:smithi082 172.21.15.82 2024-03-04T09:15:11.048 INFO:teuthology.orchestra.run.smithi082.stdout:smithi102 172.21.15.102 2024-03-04T09:15:11.048 INFO:teuthology.orchestra.run.smithi082.stdout:smithi190 172.21.15.190 2024-03-04T09:15:11.048 INFO:teuthology.orchestra.run.smithi082.stdout:3 hosts in cluster 2024-03-04T09:15:11.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:11.053+0000 7f868a98f700 1 -- 172.21.15.82:0/1966358490 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f86700a1e10 msgr2=0x7f86700a42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:11.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:11.053+0000 7f868a98f700 1 --2- 172.21.15.82:0/1966358490 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f86700a1e10 0x7f86700a42d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8684102050 tx=0x7f866c009260 comp rx=0 tx=0).stop 2024-03-04T09:15:11.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:11.053+0000 7f868a98f700 1 -- 172.21.15.82:0/1966358490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8684102b90 msgr2=0x7f868419f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:11.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:11.053+0000 7f868a98f700 1 --2- 172.21.15.82:0/1966358490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8684102b90 0x7f868419f9a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f867c00ef60 tx=0x7f867c00ef90 comp rx=0 tx=0).stop 2024-03-04T09:15:11.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:11.054+0000 7f868a98f700 1 -- 172.21.15.82:0/1966358490 shutdown_connections 2024-03-04T09:15:11.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:11.054+0000 7f868a98f700 1 --2- 172.21.15.82:0/1966358490 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f86700a1e10 0x7f86700a42d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:11.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:11.054+0000 7f868a98f700 1 --2- 172.21.15.82:0/1966358490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8684102b90 0x7f868419f9a0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:11.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:11.054+0000 7f868a98f700 1 --2- 172.21.15.82:0/1966358490 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8684100ff0 0x7f86841983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:11.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:11.054+0000 7f868a98f700 1 --2- 172.21.15.82:0/1966358490 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86841021f0 0x7f8684198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:11.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:11.054+0000 7f868a98f700 1 -- 172.21.15.82:0/1966358490 >> 172.21.15.82:0/1966358490 conn(0x7f86840fc590 msgr2=0x7f86840fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:11.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:11.054+0000 7f868a98f700 1 -- 172.21.15.82:0/1966358490 shutdown_connections 2024-03-04T09:15:11.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:11.054+0000 7f868a98f700 1 -- 172.21.15.82:0/1966358490 wait complete. 2024-03-04T09:15:11.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:11 smithi190 ceph-mon[36341]: pgmap v351: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s 2024-03-04T09:15:11.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:11 smithi102 ceph-mon[36220]: pgmap v351: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s 2024-03-04T09:15:11.812 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:11 smithi082 ceph-mon[32880]: pgmap v351: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s 2024-03-04T09:15:11.841 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- bash -c 'ceph orch device ls' 2024-03-04T09:15:12.083 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:15:12.498 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:12 smithi082 ceph-mon[32880]: from='client.15309 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:15:12.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:12 smithi190 ceph-mon[36341]: from='client.15309 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:15:12.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:12 smithi102 ceph-mon[36220]: from='client.15309 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:15:13.540 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:13 smithi082 ceph-mon[32880]: pgmap v352: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2024-03-04T09:15:13.541 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:13 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]: dispatch 2024-03-04T09:15:13.541 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:13 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-03-04T09:15:13.541 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:13 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]}]: dispatch 2024-03-04T09:15:13.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:13 smithi190 ceph-mon[36341]: pgmap v352: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2024-03-04T09:15:13.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:13 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]: dispatch 2024-03-04T09:15:13.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:13 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-03-04T09:15:13.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:13 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]}]: dispatch 2024-03-04T09:15:13.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:13 smithi102 ceph-mon[36220]: pgmap v352: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2024-03-04T09:15:13.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:13 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]: dispatch 2024-03-04T09:15:13.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:13 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-03-04T09:15:13.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:13 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]}]: dispatch 2024-03-04T09:15:13.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:13.902+0000 7f691568e700 1 -- 172.21.15.82:0/2956858588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6910101260 msgr2=0x7f69101016e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:13.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:13.902+0000 7f691568e700 1 --2- 172.21.15.82:0/2956858588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6910101260 0x7f69101016e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f6904009990 tx=0x7f6904009ca0 comp rx=0 tx=0).stop 2024-03-04T09:15:13.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:13.902+0000 7f691568e700 1 -- 172.21.15.82:0/2956858588 shutdown_connections 2024-03-04T09:15:13.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:13.902+0000 7f691568e700 1 --2- 172.21.15.82:0/2956858588 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6910101c20 0x7f69101094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:13.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:13.902+0000 7f691568e700 1 --2- 172.21.15.82:0/2956858588 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6910102690 0x7f6910102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:13.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:13.902+0000 7f691568e700 1 --2- 172.21.15.82:0/2956858588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6910101260 0x7f69101016e0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:13.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:13.902+0000 7f691568e700 1 -- 172.21.15.82:0/2956858588 >> 172.21.15.82:0/2956858588 conn(0x7f69100fbd10 msgr2=0x7f69100fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:13.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:13.902+0000 7f691568e700 1 -- 172.21.15.82:0/2956858588 shutdown_connections 2024-03-04T09:15:13.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:13.902+0000 7f691568e700 1 -- 172.21.15.82:0/2956858588 wait complete. 2024-03-04T09:15:13.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:13.903+0000 7f691568e700 1 Processor -- start 2024-03-04T09:15:13.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:13.903+0000 7f691568e700 1 -- start start 2024-03-04T09:15:13.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:13.903+0000 7f691568e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6910101260 0x7f6910100cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:13.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:13.903+0000 7f691568e700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6910101c20 0x7f691019d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:13.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:13.903+0000 7f691568e700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6910102690 0x7f691019f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:13.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:13.903+0000 7f691568e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f691010cc00 con 0x7f6910101260 2024-03-04T09:15:13.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:13.903+0000 7f691568e700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f691010ca80 con 0x7f6910102690 2024-03-04T09:15:13.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:13.903+0000 7f691568e700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f691010cd80 con 0x7f6910101c20 2024-03-04T09:15:13.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:13.903+0000 7f690effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6910101260 0x7f6910100cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:13.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:13.903+0000 7f690effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6910101260 0x7f6910100cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46708/0 (socket says 172.21.15.82:46708) 2024-03-04T09:15:13.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:13.903+0000 7f690effd700 1 -- 172.21.15.82:0/1726738011 learned_addr learned my addr 172.21.15.82:0/1726738011 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:13.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:13.903+0000 7f690e7fc700 1 --2- 172.21.15.82:0/1726738011 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6910101c20 0x7f691019d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:13.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:13.903+0000 7f690f7fe700 1 --2- 172.21.15.82:0/1726738011 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6910102690 0x7f691019f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:13.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:13.904+0000 7f690effd700 1 -- 172.21.15.82:0/1726738011 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6910101c20 msgr2=0x7f691019d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:13.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:13.904+0000 7f690effd700 1 --2- 172.21.15.82:0/1726738011 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6910101c20 0x7f691019d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:13.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:13.904+0000 7f690effd700 1 -- 172.21.15.82:0/1726738011 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6910102690 msgr2=0x7f691019f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:13.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:13.904+0000 7f690effd700 1 --2- 172.21.15.82:0/1726738011 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6910102690 0x7f691019f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:13.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:13.904+0000 7f690effd700 1 -- 172.21.15.82:0/1726738011 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f691019ff90 con 0x7f6910101260 2024-03-04T09:15:13.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:13.904+0000 7f690effd700 1 --2- 172.21.15.82:0/1726738011 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6910101260 0x7f6910100cd0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f690000e9c0 tx=0x7f690000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:13.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:13.904+0000 7f68f7fff700 1 -- 172.21.15.82:0/1726738011 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690000cbd0 con 0x7f6910101260 2024-03-04T09:15:13.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:13.904+0000 7f68f7fff700 1 -- 172.21.15.82:0/1726738011 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f690000ee60 con 0x7f6910101260 2024-03-04T09:15:13.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:13.904+0000 7f691568e700 1 -- 172.21.15.82:0/1726738011 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69101a0280 con 0x7f6910101260 2024-03-04T09:15:13.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:13.904+0000 7f68f7fff700 1 -- 172.21.15.82:0/1726738011 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69000055f0 con 0x7f6910101260 2024-03-04T09:15:13.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:13.904+0000 7f691568e700 1 -- 172.21.15.82:0/1726738011 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69101a0790 con 0x7f6910101260 2024-03-04T09:15:13.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:13.905+0000 7f691568e700 1 -- 172.21.15.82:0/1726738011 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6910068d80 con 0x7f6910101260 2024-03-04T09:15:13.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:13.907+0000 7f68f7fff700 1 -- 172.21.15.82:0/1726738011 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f6900004750 con 0x7f6910101260 2024-03-04T09:15:13.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:13.907+0000 7f68f7fff700 1 --2- 172.21.15.82:0/1726738011 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f68f80a1e90 0x7f68f80a4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:13.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:13.908+0000 7f690e7fc700 1 --2- 172.21.15.82:0/1726738011 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f68f80a1e90 0x7f68f80a4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:13.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:13.908+0000 7f68f7fff700 1 -- 172.21.15.82:0/1726738011 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9179+0+0 (secure 0 0 0) 0x7f69000ce570 con 0x7f6910101260 2024-03-04T09:15:13.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:13.908+0000 7f690e7fc700 1 --2- 172.21.15.82:0/1726738011 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f68f80a1e90 0x7f68f80a4350 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f690400b2e0 tx=0x7f690400b8c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:13.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:13.911+0000 7f68f7fff700 1 -- 172.21.15.82:0/1726738011 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f6900053280 con 0x7f6910101260 2024-03-04T09:15:14.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:14.115+0000 7f691568e700 1 -- 172.21.15.82:0/1726738011 --> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f6910062500 con 0x7f68f80a1e90 2024-03-04T09:15:14.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:14.117+0000 7f68f7fff700 1 -- 172.21.15.82:0/1726738011 <== mgr.14152 v2:172.21.15.82:6800/1278635224 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+532 (secure 0 0 0) 0x7f6910062500 con 0x7f68f80a1e90 2024-03-04T09:15:14.113 INFO:teuthology.orchestra.run.smithi082.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-03-04T09:15:14.114 INFO:teuthology.orchestra.run.smithi082.stdout:smithi082 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400SD400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-03-04T09:15:14.114 INFO:teuthology.orchestra.run.smithi082.stdout:smithi102 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400VK400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-03-04T09:15:14.114 INFO:teuthology.orchestra.run.smithi082.stdout:smithi190 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT63210012400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-03-04T09:15:14.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:14.119+0000 7f691568e700 1 -- 172.21.15.82:0/1726738011 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f68f80a1e90 msgr2=0x7f68f80a4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:14.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:14.119+0000 7f691568e700 1 --2- 172.21.15.82:0/1726738011 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f68f80a1e90 0x7f68f80a4350 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f690400b2e0 tx=0x7f690400b8c0 comp rx=0 tx=0).stop 2024-03-04T09:15:14.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:14.119+0000 7f691568e700 1 -- 172.21.15.82:0/1726738011 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6910101260 msgr2=0x7f6910100cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:14.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:14.119+0000 7f691568e700 1 --2- 172.21.15.82:0/1726738011 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6910101260 0x7f6910100cd0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f690000e9c0 tx=0x7f690000ecd0 comp rx=0 tx=0).stop 2024-03-04T09:15:14.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:14.119+0000 7f691568e700 1 -- 172.21.15.82:0/1726738011 shutdown_connections 2024-03-04T09:15:14.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:14.119+0000 7f691568e700 1 --2- 172.21.15.82:0/1726738011 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f68f80a1e90 0x7f68f80a4350 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:14.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:14.119+0000 7f691568e700 1 --2- 172.21.15.82:0/1726738011 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6910102690 0x7f691019f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:14.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:14.119+0000 7f691568e700 1 --2- 172.21.15.82:0/1726738011 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6910101260 0x7f6910100cd0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:14.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:14.119+0000 7f691568e700 1 --2- 172.21.15.82:0/1726738011 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6910101c20 0x7f691019d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:14.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:14.119+0000 7f691568e700 1 -- 172.21.15.82:0/1726738011 >> 172.21.15.82:0/1726738011 conn(0x7f69100fbd10 msgr2=0x7f6910105570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:14.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:14.119+0000 7f691568e700 1 -- 172.21.15.82:0/1726738011 shutdown_connections 2024-03-04T09:15:14.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:14.119+0000 7f691568e700 1 -- 172.21.15.82:0/1726738011 wait complete. 2024-03-04T09:15:14.415 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:14 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]': finished 2024-03-04T09:15:14.416 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:14 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-03-04T09:15:14.416 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:14 smithi082 ceph-mon[32880]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]}]': finished 2024-03-04T09:15:14.416 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:14 smithi082 ceph-mon[32880]: osdmap e93: 12 total, 12 up, 12 in 2024-03-04T09:15:14.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:14 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]': finished 2024-03-04T09:15:14.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:14 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-03-04T09:15:14.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:14 smithi190 ceph-mon[36341]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]}]': finished 2024-03-04T09:15:14.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:14 smithi190 ceph-mon[36341]: osdmap e93: 12 total, 12 up, 12 in 2024-03-04T09:15:14.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:14 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]': finished 2024-03-04T09:15:14.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:14 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-03-04T09:15:14.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:14 smithi102 ceph-mon[36220]: from='mgr.14152 172.21.15.82:0/3492905242' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]}]': finished 2024-03-04T09:15:14.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:14 smithi102 ceph-mon[36220]: osdmap e93: 12 total, 12 up, 12 in 2024-03-04T09:15:14.770 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-03-04T09:15:14.781 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi082.front.sepia.ceph.com 2024-03-04T09:15:14.782 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- bash -c 'ceph fs dump' 2024-03-04T09:15:15.047 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:15:15.421 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:15 smithi082 ceph-mon[32880]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:15:15.421 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:15 smithi082 ceph-mon[32880]: pgmap v354: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2024-03-04T09:15:15.421 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:15 smithi082 ceph-mon[32880]: osdmap e94: 12 total, 12 up, 12 in 2024-03-04T09:15:15.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:15 smithi190 ceph-mon[36341]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:15:15.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:15 smithi190 ceph-mon[36341]: pgmap v354: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2024-03-04T09:15:15.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:15 smithi190 ceph-mon[36341]: osdmap e94: 12 total, 12 up, 12 in 2024-03-04T09:15:15.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:15 smithi102 ceph-mon[36220]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:15:15.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:15 smithi102 ceph-mon[36220]: pgmap v354: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2024-03-04T09:15:15.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:15 smithi102 ceph-mon[36220]: osdmap e94: 12 total, 12 up, 12 in 2024-03-04T09:15:16.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:16.908+0000 7f26457c8700 1 -- 172.21.15.82:0/3249829172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26401021f0 msgr2=0x7f2640102650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:16.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:16.908+0000 7f26457c8700 1 --2- 172.21.15.82:0/3249829172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26401021f0 0x7f2640102650 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f26340099c0 tx=0x7f2634009cd0 comp rx=0 tx=0).stop 2024-03-04T09:15:16.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:16.909+0000 7f26457c8700 1 -- 172.21.15.82:0/3249829172 shutdown_connections 2024-03-04T09:15:16.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:16.909+0000 7f26457c8700 1 --2- 172.21.15.82:0/3249829172 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2640102b90 0x7f2640109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:16.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:16.909+0000 7f26457c8700 1 --2- 172.21.15.82:0/3249829172 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2640100ff0 0x7f2640101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:16.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:16.909+0000 7f26457c8700 1 --2- 172.21.15.82:0/3249829172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26401021f0 0x7f2640102650 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:16.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:16.909+0000 7f26457c8700 1 -- 172.21.15.82:0/3249829172 >> 172.21.15.82:0/3249829172 conn(0x7f26400fc590 msgr2=0x7f26400fe9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:16.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:16.909+0000 7f26457c8700 1 -- 172.21.15.82:0/3249829172 shutdown_connections 2024-03-04T09:15:16.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:16.909+0000 7f26457c8700 1 -- 172.21.15.82:0/3249829172 wait complete. 2024-03-04T09:15:16.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:16.909+0000 7f26457c8700 1 Processor -- start 2024-03-04T09:15:16.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:16.909+0000 7f26457c8700 1 -- start start 2024-03-04T09:15:16.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:16.910+0000 7f26457c8700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2640100ff0 0x7f2640197210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:16.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:16.910+0000 7f26457c8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26401021f0 0x7f2640197750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:16.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:16.910+0000 7f26457c8700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2640102b90 0x7f264019e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:16.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:16.910+0000 7f26457c8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264010cc20 con 0x7f26401021f0 2024-03-04T09:15:16.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:16.910+0000 7f26457c8700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264010caa0 con 0x7f2640102b90 2024-03-04T09:15:16.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:16.910+0000 7f26457c8700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264010cda0 con 0x7f2640100ff0 2024-03-04T09:15:16.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:16.910+0000 7f263e7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26401021f0 0x7f2640197750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:16.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:16.910+0000 7f263effd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2640100ff0 0x7f2640197210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:16.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:16.910+0000 7f263e7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26401021f0 0x7f2640197750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48888/0 (socket says 172.21.15.82:48888) 2024-03-04T09:15:16.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:16.910+0000 7f263e7fc700 1 -- 172.21.15.82:0/3217344763 learned_addr learned my addr 172.21.15.82:0/3217344763 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:16.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:16.910+0000 7f263f7fe700 1 --2- 172.21.15.82:0/3217344763 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2640102b90 0x7f264019e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:16.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:16.910+0000 7f263e7fc700 1 -- 172.21.15.82:0/3217344763 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2640100ff0 msgr2=0x7f2640197210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:16.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:16.910+0000 7f263e7fc700 1 --2- 172.21.15.82:0/3217344763 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2640100ff0 0x7f2640197210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:16.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:16.910+0000 7f263e7fc700 1 -- 172.21.15.82:0/3217344763 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2640102b90 msgr2=0x7f264019e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:16.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:16.910+0000 7f263e7fc700 1 --2- 172.21.15.82:0/3217344763 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2640102b90 0x7f264019e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:16.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:16.910+0000 7f263e7fc700 1 -- 172.21.15.82:0/3217344763 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f264019ee70 con 0x7f26401021f0 2024-03-04T09:15:16.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:16.910+0000 7f263effd700 1 --2- 172.21.15.82:0/3217344763 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2640100ff0 0x7f2640197210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:15:16.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:16.910+0000 7f263f7fe700 1 --2- 172.21.15.82:0/3217344763 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2640102b90 0x7f264019e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:15:16.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:16.910+0000 7f263e7fc700 1 --2- 172.21.15.82:0/3217344763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26401021f0 0x7f2640197750 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f2634000c00 tx=0x7f263400bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:16.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:16.910+0000 7f2627fff700 1 -- 172.21.15.82:0/3217344763 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2634009e60 con 0x7f26401021f0 2024-03-04T09:15:16.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:16.911+0000 7f26457c8700 1 -- 172.21.15.82:0/3217344763 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f264019f100 con 0x7f26401021f0 2024-03-04T09:15:16.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:16.911+0000 7f2627fff700 1 -- 172.21.15.82:0/3217344763 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f263400f460 con 0x7f26401021f0 2024-03-04T09:15:16.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:16.911+0000 7f2627fff700 1 -- 172.21.15.82:0/3217344763 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2634017650 con 0x7f26401021f0 2024-03-04T09:15:16.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:16.911+0000 7f26457c8700 1 -- 172.21.15.82:0/3217344763 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f264019f550 con 0x7f26401021f0 2024-03-04T09:15:16.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:16.912+0000 7f26457c8700 1 -- 172.21.15.82:0/3217344763 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f262c005360 con 0x7f26401021f0 2024-03-04T09:15:16.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:16.913+0000 7f2627fff700 1 -- 172.21.15.82:0/3217344763 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f26340052d0 con 0x7f26401021f0 2024-03-04T09:15:16.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:16.913+0000 7f2627fff700 1 --2- 172.21.15.82:0/3217344763 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f26280a1e10 0x7f26280a42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:16.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:16.913+0000 7f263effd700 1 --2- 172.21.15.82:0/3217344763 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f26280a1e10 0x7f26280a42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:16.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:16.913+0000 7f2627fff700 1 -- 172.21.15.82:0/3217344763 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9179+0+0 (secure 0 0 0) 0x7f26340cee70 con 0x7f26401021f0 2024-03-04T09:15:16.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:16.914+0000 7f263effd700 1 --2- 172.21.15.82:0/3217344763 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f26280a1e10 0x7f26280a42d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2640102050 tx=0x7f2630009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:16.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:16.918+0000 7f2627fff700 1 -- 172.21.15.82:0/3217344763 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f2634013070 con 0x7f26401021f0 2024-03-04T09:15:17.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:17.156+0000 7f26457c8700 1 -- 172.21.15.82:0/3217344763 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f262c005e60 con 0x7f26401021f0 2024-03-04T09:15:17.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:17.156+0000 7f2627fff700 1 -- 172.21.15.82:0/3217344763 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) v1 ==== 76+0+3040 (secure 0 0 0) 0x7f2634020370 con 0x7f26401021f0 2024-03-04T09:15:17.153 INFO:teuthology.orchestra.run.smithi082.stdout:e27 2024-03-04T09:15:17.153 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-04T09:15:17.153 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-03-04T09:15:17.153 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-03-04T09:15:17.153 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:15:17.153 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-03-04T09:15:17.153 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-03-04T09:15:17.153 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 27 2024-03-04T09:15:17.154 INFO:teuthology.orchestra.run.smithi082.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-03-04T09:15:17.154 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-03-04T09:13:10.076732+0000 2024-03-04T09:15:17.154 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-03-04T09:13:38.017758+0000 2024-03-04T09:15:17.154 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-03-04T09:15:17.154 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-03-04T09:15:17.154 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 300 2024-03-04T09:15:17.154 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-03-04T09:15:17.154 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-03-04T09:15:17.154 INFO:teuthology.orchestra.run.smithi082.stdout:max_xattr_size 65536 2024-03-04T09:15:17.154 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-03-04T09:15:17.154 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-03-04T09:15:17.154 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 0 2024-03-04T09:15:17.154 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-03-04T09:15:17.154 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 5 2024-03-04T09:15:17.154 INFO:teuthology.orchestra.run.smithi082.stdout:in 0,1,2,3,4 2024-03-04T09:15:17.155 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=24476,1=24469,2=24451,3=24449,4=24439} 2024-03-04T09:15:17.155 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-03-04T09:15:17.155 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-03-04T09:15:17.155 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 2024-03-04T09:15:17.155 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3,4] 2024-03-04T09:15:17.155 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-03-04T09:15:17.155 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data disabled 2024-03-04T09:15:17.155 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-03-04T09:15:17.155 INFO:teuthology.orchestra.run.smithi082.stdout:bal_rank_mask -1 2024-03-04T09:15:17.155 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 0 2024-03-04T09:15:17.155 INFO:teuthology.orchestra.run.smithi082.stdout:qdb_cluster leader: 24476 members: 24449,24439,24451,24476,24469 2024-03-04T09:15:17.155 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.b{0:24476} state up:active seq 3 addr [v2:172.21.15.102:6838/35424130,v1:172.21.15.102:6839/35424130] compat {c=[1],r=[1],i=[fff]}] 2024-03-04T09:15:17.155 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.e{0:24422} state up:standby-replay seq 1 addr [v2:172.21.15.102:6834/2134310473,v1:172.21.15.102:6835/2134310473] compat {c=[1],r=[1],i=[fff]}] 2024-03-04T09:15:17.156 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.i{1:24469} state up:active seq 11 addr [v2:172.21.15.190:6838/878555510,v1:172.21.15.190:6839/878555510] compat {c=[1],r=[1],i=[fff]}] 2024-03-04T09:15:17.156 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.l{1:24403} state up:standby-replay seq 1 addr [v2:172.21.15.190:6832/3023382814,v1:172.21.15.190:6833/3023382814] compat {c=[1],r=[1],i=[fff]}] 2024-03-04T09:15:17.156 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.c{2:24451} state up:active seq 13 addr [v2:172.21.15.190:6836/1198639527,v1:172.21.15.190:6837/1198639527] compat {c=[1],r=[1],i=[fff]}] 2024-03-04T09:15:17.156 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.k{2:24398} state up:standby-replay seq 1 addr [v2:172.21.15.102:6832/1142302200,v1:172.21.15.102:6833/1142302200] compat {c=[1],r=[1],i=[fff]}] 2024-03-04T09:15:17.156 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.h{3:24449} state up:active seq 12 addr [v2:172.21.15.102:6836/1210579527,v1:172.21.15.102:6837/1210579527] compat {c=[1],r=[1],i=[fff]}] 2024-03-04T09:15:17.156 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.a{3:14625} state up:standby-replay seq 1 addr [v2:172.21.15.82:6840/213594267,v1:172.21.15.82:6841/213594267] compat {c=[1],r=[1],i=[fff]}] 2024-03-04T09:15:17.156 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.f{4:24439} state up:active seq 14 addr [v2:172.21.15.190:6834/3183532624,v1:172.21.15.190:6835/3183532624] compat {c=[1],r=[1],i=[fff]}] 2024-03-04T09:15:17.156 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.g{4:14613} state up:standby-replay seq 1 addr [v2:172.21.15.82:6838/1240838024,v1:172.21.15.82:6839/1240838024] compat {c=[1],r=[1],i=[fff]}] 2024-03-04T09:15:17.156 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:15:17.156 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:15:17.156 INFO:teuthology.orchestra.run.smithi082.stdout:Standby daemons: 2024-03-04T09:15:17.156 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:15:17.156 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.j{-1:14544} state up:standby seq 1 addr [v2:172.21.15.82:6834/3123844705,v1:172.21.15.82:6835/3123844705] compat {c=[1],r=[1],i=[fff]}] 2024-03-04T09:15:17.156 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.d{-1:14556} state up:standby seq 1 addr [v2:172.21.15.82:6836/2620634252,v1:172.21.15.82:6837/2620634252] compat {c=[1],r=[1],i=[fff]}] 2024-03-04T09:15:17.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:17.159+0000 7f26457c8700 1 -- 172.21.15.82:0/3217344763 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f26280a1e10 msgr2=0x7f26280a42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:17.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:17.159+0000 7f26457c8700 1 --2- 172.21.15.82:0/3217344763 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f26280a1e10 0x7f26280a42d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2640102050 tx=0x7f2630009260 comp rx=0 tx=0).stop 2024-03-04T09:15:17.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:17.159+0000 7f26457c8700 1 -- 172.21.15.82:0/3217344763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26401021f0 msgr2=0x7f2640197750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:17.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:17.159+0000 7f26457c8700 1 --2- 172.21.15.82:0/3217344763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26401021f0 0x7f2640197750 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f2634000c00 tx=0x7f263400bee0 comp rx=0 tx=0).stop 2024-03-04T09:15:17.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:17.159+0000 7f26457c8700 1 -- 172.21.15.82:0/3217344763 shutdown_connections 2024-03-04T09:15:17.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:17.159+0000 7f26457c8700 1 --2- 172.21.15.82:0/3217344763 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f26280a1e10 0x7f26280a42d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:17.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:17.159+0000 7f26457c8700 1 --2- 172.21.15.82:0/3217344763 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2640102b90 0x7f264019e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:17.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:17.159+0000 7f26457c8700 1 --2- 172.21.15.82:0/3217344763 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2640100ff0 0x7f2640197210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:17.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:17.159+0000 7f26457c8700 1 --2- 172.21.15.82:0/3217344763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26401021f0 0x7f2640197750 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:17.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:17.159+0000 7f26457c8700 1 -- 172.21.15.82:0/3217344763 >> 172.21.15.82:0/3217344763 conn(0x7f26400fc590 msgr2=0x7f26401055b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:17.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:17.160+0000 7f26457c8700 1 -- 172.21.15.82:0/3217344763 shutdown_connections 2024-03-04T09:15:17.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:17.160+0000 7f26457c8700 1 -- 172.21.15.82:0/3217344763 wait complete. 2024-03-04T09:15:17.158 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 27 2024-03-04T09:15:17.537 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:17 smithi082 ceph-mon[32880]: pgmap v356: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-03-04T09:15:17.537 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:17 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/3217344763' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-04T09:15:17.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:17 smithi190 ceph-mon[36341]: pgmap v356: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-03-04T09:15:17.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:17 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/3217344763' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-04T09:15:17.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:17 smithi102 ceph-mon[36220]: pgmap v356: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-03-04T09:15:17.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:17 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/3217344763' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-04T09:15:17.783 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- bash -c 'ceph osd dump' 2024-03-04T09:15:18.026 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:15:19.509 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:19 smithi082 ceph-mon[32880]: pgmap v357: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-03-04T09:15:19.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:19 smithi190 ceph-mon[36341]: pgmap v357: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-03-04T09:15:19.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:19 smithi102 ceph-mon[36220]: pgmap v357: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-03-04T09:15:19.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:19.814+0000 7fd52be18700 1 -- 172.21.15.82:0/101797963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd524102bc0 msgr2=0x7fd524109470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:19.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:19.814+0000 7fd52be18700 1 --2- 172.21.15.82:0/101797963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd524102bc0 0x7fd524109470 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd51c00b0d0 tx=0x7fd51c00b3e0 comp rx=0 tx=0).stop 2024-03-04T09:15:19.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:19.814+0000 7fd52be18700 1 -- 172.21.15.82:0/101797963 shutdown_connections 2024-03-04T09:15:19.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:19.814+0000 7fd52be18700 1 --2- 172.21.15.82:0/101797963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd524102bc0 0x7fd524109470 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:19.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:19.814+0000 7fd52be18700 1 --2- 172.21.15.82:0/101797963 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd524101020 0x7fd524101440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:19.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:19.814+0000 7fd52be18700 1 --2- 172.21.15.82:0/101797963 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd524102220 0x7fd524102680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:19.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:19.814+0000 7fd52be18700 1 -- 172.21.15.82:0/101797963 >> 172.21.15.82:0/101797963 conn(0x7fd5240fc5e0 msgr2=0x7fd5240fea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:19.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:19.815+0000 7fd52be18700 1 -- 172.21.15.82:0/101797963 shutdown_connections 2024-03-04T09:15:19.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:19.815+0000 7fd52be18700 1 -- 172.21.15.82:0/101797963 wait complete. 2024-03-04T09:15:19.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:19.815+0000 7fd52be18700 1 Processor -- start 2024-03-04T09:15:19.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:19.815+0000 7fd52be18700 1 -- start start 2024-03-04T09:15:19.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:19.815+0000 7fd52be18700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd524101020 0x7fd524104f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:19.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:19.815+0000 7fd52be18700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd524102220 0x7fd524103600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:19.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:19.815+0000 7fd52be18700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd524102bc0 0x7fd524103b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:19.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:19.815+0000 7fd52be18700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52410cc50 con 0x7fd524102bc0 2024-03-04T09:15:19.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:19.815+0000 7fd52be18700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52410cad0 con 0x7fd524102220 2024-03-04T09:15:19.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:19.815+0000 7fd52be18700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52410cdd0 con 0x7fd524101020 2024-03-04T09:15:19.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:19.815+0000 7fd52a3b5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd524102bc0 0x7fd524103b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:19.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:19.815+0000 7fd5293b3700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd524102220 0x7fd524103600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:19.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:19.815+0000 7fd529bb4700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd524101020 0x7fd524104f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:19.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:19.815+0000 7fd5293b3700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd524102220 0x7fd524103600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.82:34556/0 (socket says 172.21.15.82:34556) 2024-03-04T09:15:19.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:19.815+0000 7fd5293b3700 1 -- 172.21.15.82:0/416663034 learned_addr learned my addr 172.21.15.82:0/416663034 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:19.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:19.816+0000 7fd52a3b5700 1 -- 172.21.15.82:0/416663034 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd524101020 msgr2=0x7fd524104f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:19.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:19.816+0000 7fd52a3b5700 1 --2- 172.21.15.82:0/416663034 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd524101020 0x7fd524104f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:19.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:19.816+0000 7fd52a3b5700 1 -- 172.21.15.82:0/416663034 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd524102220 msgr2=0x7fd524103600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:19.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:19.816+0000 7fd52a3b5700 1 --2- 172.21.15.82:0/416663034 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd524102220 0x7fd524103600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:19.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:19.816+0000 7fd52a3b5700 1 -- 172.21.15.82:0/416663034 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd524104410 con 0x7fd524102bc0 2024-03-04T09:15:19.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:19.816+0000 7fd5293b3700 1 --2- 172.21.15.82:0/416663034 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd524102220 0x7fd524103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:15:19.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:19.816+0000 7fd52a3b5700 1 --2- 172.21.15.82:0/416663034 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd524102bc0 0x7fd524103b40 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd51c009c60 tx=0x7fd51c007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:19.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:19.816+0000 7fd51affd700 1 -- 172.21.15.82:0/416663034 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c01f070 con 0x7fd524102bc0 2024-03-04T09:15:19.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:19.816+0000 7fd52be18700 1 -- 172.21.15.82:0/416663034 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5241a2360 con 0x7fd524102bc0 2024-03-04T09:15:19.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:19.816+0000 7fd51affd700 1 -- 172.21.15.82:0/416663034 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fd51c007e40 con 0x7fd524102bc0 2024-03-04T09:15:19.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:19.816+0000 7fd51affd700 1 -- 172.21.15.82:0/416663034 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c01b6a0 con 0x7fd524102bc0 2024-03-04T09:15:19.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:19.816+0000 7fd52be18700 1 -- 172.21.15.82:0/416663034 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5241a2810 con 0x7fd524102bc0 2024-03-04T09:15:19.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:19.817+0000 7fd52be18700 1 -- 172.21.15.82:0/416663034 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd524068d80 con 0x7fd524102bc0 2024-03-04T09:15:19.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:19.819+0000 7fd51affd700 1 -- 172.21.15.82:0/416663034 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 136756+0+0 (secure 0 0 0) 0x7fd51c022070 con 0x7fd524102bc0 2024-03-04T09:15:19.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:19.819+0000 7fd51affd700 1 --2- 172.21.15.82:0/416663034 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fd5100a1e10 0x7fd5100a42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:19.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:19.819+0000 7fd529bb4700 1 --2- 172.21.15.82:0/416663034 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fd5100a1e10 0x7fd5100a42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:19.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:19.819+0000 7fd51affd700 1 -- 172.21.15.82:0/416663034 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9179+0+0 (secure 0 0 0) 0x7fd51c00f020 con 0x7fd524102bc0 2024-03-04T09:15:19.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:19.820+0000 7fd529bb4700 1 --2- 172.21.15.82:0/416663034 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fd5100a1e10 0x7fd5100a42d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd524102080 tx=0x7fd520009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:19.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:19.823+0000 7fd51affd700 1 -- 172.21.15.82:0/416663034 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fd51c029020 con 0x7fd524102bc0 2024-03-04T09:15:20.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:20.016+0000 7fd52be18700 1 -- 172.21.15.82:0/416663034 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7fd5241a2c00 con 0x7fd524102bc0 2024-03-04T09:15:20.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:20.017+0000 7fd51affd700 1 -- 172.21.15.82:0/416663034 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v94) v1 ==== 56+0+5668 (secure 0 0 0) 0x7fd51c09c6e0 con 0x7fd524102bc0 2024-03-04T09:15:20.014 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 94 2024-03-04T09:15:20.014 INFO:teuthology.orchestra.run.smithi082.stdout:fsid 2e533fc8-da06-11ee-95c6-87774f69a715 2024-03-04T09:15:20.014 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-03-04T09:05:16.488249+0000 2024-03-04T09:15:20.014 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-03-04T09:15:14.344362+0000 2024-03-04T09:15:20.014 INFO:teuthology.orchestra.run.smithi082.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-03-04T09:15:20.014 INFO:teuthology.orchestra.run.smithi082.stdout:crush_version 27 2024-03-04T09:15:20.014 INFO:teuthology.orchestra.run.smithi082.stdout:full_ratio 0.95 2024-03-04T09:15:20.014 INFO:teuthology.orchestra.run.smithi082.stdout:backfillfull_ratio 0.9 2024-03-04T09:15:20.014 INFO:teuthology.orchestra.run.smithi082.stdout:nearfull_ratio 0.85 2024-03-04T09:15:20.014 INFO:teuthology.orchestra.run.smithi082.stdout:require_min_compat_client luminous 2024-03-04T09:15:20.015 INFO:teuthology.orchestra.run.smithi082.stdout:min_compat_client luminous 2024-03-04T09:15:20.015 INFO:teuthology.orchestra.run.smithi082.stdout:require_osd_release squid 2024-03-04T09:15:20.015 INFO:teuthology.orchestra.run.smithi082.stdout:stretch_mode_enabled false 2024-03-04T09:15:20.015 INFO:teuthology.orchestra.run.smithi082.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-03-04T09:15:20.015 INFO:teuthology.orchestra.run.smithi082.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 85 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-03-04T09:15:20.015 INFO:teuthology.orchestra.run.smithi082.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 86 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-03-04T09:15:20.015 INFO:teuthology.orchestra.run.smithi082.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 90 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-03-04T09:15:20.015 INFO:teuthology.orchestra.run.smithi082.stdout:max_osd 12 2024-03-04T09:15:20.015 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 up in weight 1 up_from 8 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.82:6802/709655235,v1:172.21.15.82:6803/709655235] [v2:172.21.15.82:6804/709655235,v1:172.21.15.82:6805/709655235] exists,up 085b5c4b-ede9-4d0d-b994-50c89d991012 2024-03-04T09:15:20.015 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 up in weight 1 up_from 13 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.102:6800/270721212,v1:172.21.15.102:6801/270721212] [v2:172.21.15.102:6802/270721212,v1:172.21.15.102:6803/270721212] exists,up e4dd7079-333e-4bcf-b3af-11fb082a5af9 2024-03-04T09:15:20.015 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 up in weight 1 up_from 18 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.190:6800/946410459,v1:172.21.15.190:6801/946410459] [v2:172.21.15.190:6802/946410459,v1:172.21.15.190:6803/946410459] exists,up 6fed5fd6-dc82-497f-9d69-c10a5e5802da 2024-03-04T09:15:20.015 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 up in weight 1 up_from 26 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.82:6810/980870924,v1:172.21.15.82:6811/980870924] [v2:172.21.15.82:6812/980870924,v1:172.21.15.82:6813/980870924] exists,up 91ccbdc3-3da6-4d39-8a89-3a7b7bb4adc3 2024-03-04T09:15:20.015 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 up in weight 1 up_from 34 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.102:6808/1229627753,v1:172.21.15.102:6809/1229627753] [v2:172.21.15.102:6810/1229627753,v1:172.21.15.102:6811/1229627753] exists,up dbb9d486-5daa-4819-bbed-04fc76ca473e 2024-03-04T09:15:20.015 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 up in weight 1 up_from 39 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.190:6808/2171194148,v1:172.21.15.190:6809/2171194148] [v2:172.21.15.190:6810/2171194148,v1:172.21.15.190:6811/2171194148] exists,up 6b50127b-df2b-4c95-8e53-9d42b40273fa 2024-03-04T09:15:20.016 INFO:teuthology.orchestra.run.smithi082.stdout:osd.6 up in weight 1 up_from 47 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.82:6818/454436959,v1:172.21.15.82:6819/454436959] [v2:172.21.15.82:6820/454436959,v1:172.21.15.82:6821/454436959] exists,up e72bebb0-5939-4210-950a-41c25c23c62f 2024-03-04T09:15:20.016 INFO:teuthology.orchestra.run.smithi082.stdout:osd.7 up in weight 1 up_from 52 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.102:6816/2745057274,v1:172.21.15.102:6817/2745057274] [v2:172.21.15.102:6818/2745057274,v1:172.21.15.102:6819/2745057274] exists,up 72f83f97-f496-4503-8284-6a7b8f99a6f3 2024-03-04T09:15:20.016 INFO:teuthology.orchestra.run.smithi082.stdout:osd.8 up in weight 1 up_from 60 up_thru 93 down_at 0 last_clean_interval [0,0) [v2:172.21.15.190:6816/1679683516,v1:172.21.15.190:6817/1679683516] [v2:172.21.15.190:6818/1679683516,v1:172.21.15.190:6819/1679683516] exists,up 92c9109d-6ebb-4c50-9944-28cd7b2f9c0a 2024-03-04T09:15:20.016 INFO:teuthology.orchestra.run.smithi082.stdout:osd.9 up in weight 1 up_from 68 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.82:6826/1777272933,v1:172.21.15.82:6827/1777272933] [v2:172.21.15.82:6828/1777272933,v1:172.21.15.82:6829/1777272933] exists,up a3cfce03-0148-475d-bf55-b8284ae1cad2 2024-03-04T09:15:20.016 INFO:teuthology.orchestra.run.smithi082.stdout:osd.10 up in weight 1 up_from 73 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.102:6824/1012784035,v1:172.21.15.102:6825/1012784035] [v2:172.21.15.102:6826/1012784035,v1:172.21.15.102:6827/1012784035] exists,up db156ccf-4396-43cb-b69a-bb9095b94b40 2024-03-04T09:15:20.016 INFO:teuthology.orchestra.run.smithi082.stdout:osd.11 up in weight 1 up_from 81 up_thru 93 down_at 0 last_clean_interval [0,0) [v2:172.21.15.190:6824/144700355,v1:172.21.15.190:6825/144700355] [v2:172.21.15.190:6826/144700355,v1:172.21.15.190:6827/144700355] exists,up b4d52576-f5b4-479f-8ff6-8fdba4635ca5 2024-03-04T09:15:20.016 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 2.0 [7,11] 2024-03-04T09:15:20.016 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 2.f [8,11] 2024-03-04T09:15:20.016 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 2.14 [2,4] 2024-03-04T09:15:20.016 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 2.1d [2,1] 2024-03-04T09:15:20.016 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 3.11 [4,6] 2024-03-04T09:15:20.016 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 3.27 [3,9] 2024-03-04T09:15:20.016 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 3.31 [4,8] 2024-03-04T09:15:20.016 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 3.33 [5,9] 2024-03-04T09:15:20.017 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 3.34 [4,9] 2024-03-04T09:15:20.017 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 4.2 [9,1] 2024-03-04T09:15:20.017 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 4.5 [5,8] 2024-03-04T09:15:20.017 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 4.10 [9,8] 2024-03-04T09:15:20.017 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 4.19 [9,10] 2024-03-04T09:15:20.017 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:6800/1901539016 expires 2024-03-05T09:06:12.169231+0000 2024-03-04T09:15:20.017 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:0/1124105204 expires 2024-03-05T09:06:12.169231+0000 2024-03-04T09:15:20.017 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:6801/1901539016 expires 2024-03-05T09:06:12.169231+0000 2024-03-04T09:15:20.017 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:0/735262841 expires 2024-03-05T09:05:44.913099+0000 2024-03-04T09:15:20.017 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:0/2402774828 expires 2024-03-05T09:05:44.913099+0000 2024-03-04T09:15:20.017 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:6801/3291527077 expires 2024-03-05T09:05:44.913099+0000 2024-03-04T09:15:20.017 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:0/1846720385 expires 2024-03-05T09:05:44.913099+0000 2024-03-04T09:15:20.017 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:0/3757201752 expires 2024-03-05T09:06:12.169231+0000 2024-03-04T09:15:20.017 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:6800/3291527077 expires 2024-03-05T09:05:44.913099+0000 2024-03-04T09:15:20.017 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:0/984630078 expires 2024-03-05T09:06:12.169231+0000 2024-03-04T09:15:20.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:20.019+0000 7fd52be18700 1 -- 172.21.15.82:0/416663034 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fd5100a1e10 msgr2=0x7fd5100a42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:20.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:20.019+0000 7fd52be18700 1 --2- 172.21.15.82:0/416663034 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fd5100a1e10 0x7fd5100a42d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd524102080 tx=0x7fd520009260 comp rx=0 tx=0).stop 2024-03-04T09:15:20.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:20.019+0000 7fd52be18700 1 -- 172.21.15.82:0/416663034 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd524102bc0 msgr2=0x7fd524103b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:20.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:20.019+0000 7fd52be18700 1 --2- 172.21.15.82:0/416663034 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd524102bc0 0x7fd524103b40 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd51c009c60 tx=0x7fd51c007a00 comp rx=0 tx=0).stop 2024-03-04T09:15:20.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:20.019+0000 7fd52be18700 1 -- 172.21.15.82:0/416663034 shutdown_connections 2024-03-04T09:15:20.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:20.019+0000 7fd52be18700 1 --2- 172.21.15.82:0/416663034 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fd5100a1e10 0x7fd5100a42d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:20.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:20.019+0000 7fd52be18700 1 --2- 172.21.15.82:0/416663034 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd524102bc0 0x7fd524103b40 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:20.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:20.019+0000 7fd52be18700 1 --2- 172.21.15.82:0/416663034 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd524101020 0x7fd524104f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:20.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:20.019+0000 7fd52be18700 1 --2- 172.21.15.82:0/416663034 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd524102220 0x7fd524103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:20.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:20.019+0000 7fd52be18700 1 -- 172.21.15.82:0/416663034 >> 172.21.15.82:0/416663034 conn(0x7fd5240fc5e0 msgr2=0x7fd5240fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:20.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:20.020+0000 7fd52be18700 1 -- 172.21.15.82:0/416663034 shutdown_connections 2024-03-04T09:15:20.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:20.020+0000 7fd52be18700 1 -- 172.21.15.82:0/416663034 wait complete. 2024-03-04T09:15:20.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:20 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/416663034' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-03-04T09:15:20.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:20 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/416663034' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-03-04T09:15:20.806 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:20 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/416663034' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-03-04T09:15:20.837 INFO:teuthology.run_tasks:Running task fs.ready... 2024-03-04T09:15:20.848 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T09:15:20.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:20.960+0000 7fe3ae5c7640 1 -- 172.21.15.82:0/626729250 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3a81020c0 msgr2=0x7fe3a8108950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:20.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:20.960+0000 7fe3ae5c7640 1 --2- 172.21.15.82:0/626729250 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3a81020c0 0x7fe3a8108950 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0009ca0 tx=0x7fe3a002c0f0 comp rx=0 tx=0).stop 2024-03-04T09:15:20.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:20.960+0000 7fe3ae5c7640 1 -- 172.21.15.82:0/626729250 shutdown_connections 2024-03-04T09:15:20.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:20.960+0000 7fe3ae5c7640 1 --2- 172.21.15.82:0/626729250 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3a81020c0 0x7fe3a8108950 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:20.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:20.960+0000 7fe3ae5c7640 1 --2- 172.21.15.82:0/626729250 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3a8101700 0x7fe3a8101b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:20.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:20.960+0000 7fe3ae5c7640 1 --2- 172.21.15.82:0/626729250 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3a8100510 0x7fe3a8100930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:20.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:20.960+0000 7fe3ae5c7640 1 -- 172.21.15.82:0/626729250 >> 172.21.15.82:0/626729250 conn(0x7fe3a80fba80 msgr2=0x7fe3a80fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:20.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:20.960+0000 7fe3ae5c7640 1 -- 172.21.15.82:0/626729250 shutdown_connections 2024-03-04T09:15:20.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:20.960+0000 7fe3ae5c7640 1 -- 172.21.15.82:0/626729250 wait complete. 2024-03-04T09:15:20.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:20.961+0000 7fe3ae5c7640 1 Processor -- start 2024-03-04T09:15:20.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:20.961+0000 7fe3ae5c7640 1 -- start start 2024-03-04T09:15:20.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:20.961+0000 7fe3ae5c7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3a8100510 0x7fe3a81967c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:20.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:20.961+0000 7fe3ae5c7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3a8101700 0x7fe3a8196d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:20.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:20.961+0000 7fe3ae5c7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3a81020c0 0x7fe3a819dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:20.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:20.961+0000 7fe3ae5c7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a810c170 con 0x7fe3a81020c0 2024-03-04T09:15:20.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:20.961+0000 7fe3ae5c7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a810bff0 con 0x7fe3a8101700 2024-03-04T09:15:20.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:20.961+0000 7fe3ae5c7640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a810c2f0 con 0x7fe3a8100510 2024-03-04T09:15:20.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:20.961+0000 7fe3acb64640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3a81020c0 0x7fe3a819dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:20.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:20.961+0000 7fe3acb64640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3a81020c0 0x7fe3a819dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48912/0 (socket says 172.21.15.82:48912) 2024-03-04T09:15:20.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:20.961+0000 7fe3a7fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3a8100510 0x7fe3a81967c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:20.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:20.961+0000 7fe3acb64640 1 -- 172.21.15.82:0/2784914816 learned_addr learned my addr 172.21.15.82:0/2784914816 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:20.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:20.961+0000 7fe3a77fe640 1 --2- 172.21.15.82:0/2784914816 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3a8101700 0x7fe3a8196d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:20.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:20.961+0000 7fe3acb64640 1 -- 172.21.15.82:0/2784914816 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3a8100510 msgr2=0x7fe3a81967c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:20.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:20.961+0000 7fe3acb64640 1 --2- 172.21.15.82:0/2784914816 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3a8100510 0x7fe3a81967c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:20.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:20.961+0000 7fe3acb64640 1 -- 172.21.15.82:0/2784914816 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3a8101700 msgr2=0x7fe3a8196d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:20.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:20.961+0000 7fe3acb64640 1 --2- 172.21.15.82:0/2784914816 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3a8101700 0x7fe3a8196d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:20.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:20.961+0000 7fe3acb64640 1 -- 172.21.15.82:0/2784914816 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a819e3e0 con 0x7fe3a81020c0 2024-03-04T09:15:20.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:20.962+0000 7fe3acb64640 1 --2- 172.21.15.82:0/2784914816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3a81020c0 0x7fe3a819dd70 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fe3a002c630 tx=0x7fe3a0032980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:20.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:20.962+0000 7fe3a57fa640 1 -- 172.21.15.82:0/2784914816 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a0039050 con 0x7fe3a81020c0 2024-03-04T09:15:20.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:20.962+0000 7fe3ae5c7640 1 -- 172.21.15.82:0/2784914816 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3a819e670 con 0x7fe3a81020c0 2024-03-04T09:15:20.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:20.962+0000 7fe3a57fa640 1 -- 172.21.15.82:0/2784914816 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fe3a003a040 con 0x7fe3a81020c0 2024-03-04T09:15:20.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:20.962+0000 7fe3a57fa640 1 -- 172.21.15.82:0/2784914816 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a0004850 con 0x7fe3a81020c0 2024-03-04T09:15:20.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:20.962+0000 7fe3ae5c7640 1 -- 172.21.15.82:0/2784914816 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3a819ebb0 con 0x7fe3a81020c0 2024-03-04T09:15:20.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:20.963+0000 7fe3ae5c7640 1 -- 172.21.15.82:0/2784914816 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3a8107830 con 0x7fe3a81020c0 2024-03-04T09:15:20.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:20.964+0000 7fe3a57fa640 1 -- 172.21.15.82:0/2784914816 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 136756+0+0 (secure 0 0 0) 0x7fe3a0004040 con 0x7fe3a81020c0 2024-03-04T09:15:20.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:20.964+0000 7fe3a57fa640 1 --2- 172.21.15.82:0/2784914816 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fe3900a1f20 0x7fe3900a43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:20.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:20.964+0000 7fe3a7fff640 1 --2- 172.21.15.82:0/2784914816 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fe3900a1f20 0x7fe3900a43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:20.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:20.964+0000 7fe3a57fa640 1 -- 172.21.15.82:0/2784914816 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9179+0+0 (secure 0 0 0) 0x7fe3a00f0bf0 con 0x7fe3a81020c0 2024-03-04T09:15:20.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:20.965+0000 7fe3a7fff640 1 --2- 172.21.15.82:0/2784914816 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fe3900a1f20 0x7fe3900a43e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe3a8101560 tx=0x7fe39c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:20.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:20.969+0000 7fe3a57fa640 1 -- 172.21.15.82:0/2784914816 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fe3a0004330 con 0x7fe3a81020c0 2024-03-04T09:15:21.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.146+0000 7fe3ae5c7640 1 -- 172.21.15.82:0/2784914816 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3a80621d0 con 0x7fe3a81020c0 2024-03-04T09:15:21.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.148+0000 7fe3a57fa640 1 -- 172.21.15.82:0/2784914816 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+24760 (secure 0 0 0) 0x7fe3a00bdc70 con 0x7fe3a81020c0 2024-03-04T09:15:21.145 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:15:21.145 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":94,"fsid":"2e533fc8-da06-11ee-95c6-87774f69a715","created":"2024-03-04T09:05:16.488249+0000","modified":"2024-03-04T09:15:14.344362+0000","last_up_change":"2024-03-04T09:12:22.308711+0000","last_in_change":"2024-03-04T09:12:02.548212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T09:08:36.508257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T09:13:07.981726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T09:13:09.289799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-04T09:13:13.008516+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"085b5c4b-ede9-4d0d-b994-50c89d991012","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6803","nonce":709655235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6805","nonce":709655235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6809","nonce":709655235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6807","nonce":709655235}]},"public_addr":"172.21.15.82:6803/709655235","cluster_addr":"172.21.15.82:6805/709655235","heartbeat_back_addr":"172.21.15.82:6809/709655235","heartbeat_front_addr":"172.21.15.82:6807/709655235","state":["exists","up"]},{"osd":1,"uuid":"e4dd7079-333e-4bcf-b3af-11fb082a5af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6801","nonce":270721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6803","nonce":270721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6807","nonce":270721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6805","nonce":270721212}]},"public_addr":"172.21.15.102:6801/270721212","cluster_addr":"172.21.15.102:6803/270721212","heartbeat_back_addr":"172.21.15.102:6807/270721212","heartbeat_front_addr":"172.21.15.102:6805/270721212","state":["exists","up"]},{"osd":2,"uuid":"6fed5fd6-dc82-497f-9d69-c10a5e5802da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6801","nonce":946410459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6803","nonce":946410459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6807","nonce":946410459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6805","nonce":946410459}]},"public_addr":"172.21.15.190:6801/946410459","cluster_addr":"172.21.15.190:6803/946410459","heartbeat_back_addr":"172.21.15.190:6807/946410459","heartbeat_front_addr":"172.21.15.190:6805/946410459","state":["exists","up"]},{"osd":3,"uuid":"91ccbdc3-3da6-4d39-8a89-3a7b7bb4adc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6811","nonce":980870924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6813","nonce":980870924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6817","nonce":980870924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6815","nonce":980870924}]},"public_addr":"172.21.15.82:6811/980870924","cluster_addr":"172.21.15.82:6813/980870924","heartbeat_back_addr":"172.21.15.82:6817/980870924","heartbeat_front_addr":"172.21.15.82:6815/980870924","state":["exists","up"]},{"osd":4,"uuid":"dbb9d486-5daa-4819-bbed-04fc76ca473e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6809","nonce":1229627753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6811","nonce":1229627753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6815","nonce":1229627753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6813","nonce":1229627753}]},"public_addr":"172.21.15.102:6809/1229627753","cluster_addr":"172.21.15.102:6811/1229627753","heartbeat_back_addr":"172.21.15.102:6815/1229627753","heartbeat_front_addr":"172.21.15.102:6813/1229627753","state":["exists","up"]},{"osd":5,"uuid":"6b50127b-df2b-4c95-8e53-9d42b40273fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6809","nonce":2171194148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6811","nonce":2171194148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6815","nonce":2171194148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6813","nonce":2171194148}]},"public_addr":"172.21.15.190:6809/2171194148","cluster_addr":"172.21.15.190:6811/2171194148","heartbeat_back_addr":"172.21.15.190:6815/2171194148","heartbeat_front_addr":"172.21.15.190:6813/2171194148","state":["exists","up"]},{"osd":6,"uuid":"e72bebb0-5939-4210-950a-41c25c23c62f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6819","nonce":454436959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6821","nonce":454436959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6825","nonce":454436959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6823","nonce":454436959}]},"public_addr":"172.21.15.82:6819/454436959","cluster_addr":"172.21.15.82:6821/454436959","heartbeat_back_addr":"172.21.15.82:6825/454436959","heartbeat_front_addr":"172.21.15.82:6823/454436959","state":["exists","up"]},{"osd":7,"uuid":"72f83f97-f496-4503-8284-6a7b8f99a6f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6817","nonce":2745057274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6819","nonce":2745057274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6823","nonce":2745057274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6821","nonce":2745057274}]},"public_addr":"172.21.15.102:6817/2745057274","cluster_addr":"172.21.15.102:6819/2745057274","heartbeat_back_addr":"172.21.15.102:6823/2745057274","heartbeat_front_addr":"172.21.15.102:6821/2745057274","state":["exists","up"]},{"osd":8,"uuid":"92c9109d-6ebb-4c50-9944-28cd7b2f9c0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6817","nonce":1679683516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6819","nonce":1679683516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6823","nonce":1679683516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6821","nonce":1679683516}]},"public_addr":"172.21.15.190:6817/1679683516","cluster_addr":"172.21.15.190:6819/1679683516","heartbeat_back_addr":"172.21.15.190:6823/1679683516","heartbeat_front_addr":"172.21.15.190:6821/1679683516","state":["exists","up"]},{"osd":9,"uuid":"a3cfce03-0148-475d-bf55-b8284ae1cad2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6827","nonce":1777272933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6829","nonce":1777272933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6833","nonce":1777272933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6831","nonce":1777272933}]},"public_addr":"172.21.15.82:6827/1777272933","cluster_addr":"172.21.15.82:6829/1777272933","heartbeat_back_addr":"172.21.15.82:6833/1777272933","heartbeat_front_addr":"172.21.15.82:6831/1777272933","state":["exists","up"]},{"osd":10,"uuid":"db156ccf-4396-43cb-b69a-bb9095b94b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6825","nonce":1012784035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6827","nonce":1012784035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6831","nonce":1012784035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6829","nonce":1012784035}]},"public_addr":"172.21.15.102:6825/1012784035","cluster_addr":"172.21.15.102:6827/1012784035","heartbeat_back_addr":"172.21.15.102:6831/1012784035","heartbeat_front_addr":"172.21.15.102:6829/1012784035","state":["exists","up"]},{"osd":11,"uuid":"b4d52576-f5b4-479f-8ff6-8fdba4635ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6825","nonce":144700355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6827","nonce":144700355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6831","nonce":144700355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6829","nonce":144700355}]},"public_addr":"172.21.15.190:6825/144700355","cluster_addr":"172.21.15.190:6827/144700355","heartbeat_back_addr":"172.21.15.190:6831/144700355","heartbeat_front_addr":"172.21.15.190:6829/144700355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:07:47.007772+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:09.944738+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:33.183567+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:58.302023+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:09:23.042488+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:09:47.616009+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:10:13.122887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:10:38.584530+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:03.473453+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:29.847105+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:55.152195+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:12:20.401765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6800/1901539016":"2024-03-05T09:06:12.169231+0000","172.21.15.82:0/1124105204":"2024-03-05T09:06:12.169231+0000","172.21.15.82:6801/1901539016":"2024-03-05T09:06:12.169231+0000","172.21.15.82:0/735262841":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/2402774828":"2024-03-05T09:05:44.913099+0000","172.21.15.82:6801/3291527077":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/1846720385":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/3757201752":"2024-03-05T09:06:12.169231+0000","172.21.15.82:6800/3291527077":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/984630078":"2024-03-05T09:06:12.169231+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T09:15:21.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.150+0000 7fe3ae5c7640 1 -- 172.21.15.82:0/2784914816 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fe3900a1f20 msgr2=0x7fe3900a43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:21.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.150+0000 7fe3ae5c7640 1 --2- 172.21.15.82:0/2784914816 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fe3900a1f20 0x7fe3900a43e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe3a8101560 tx=0x7fe39c005f90 comp rx=0 tx=0).stop 2024-03-04T09:15:21.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.150+0000 7fe3ae5c7640 1 -- 172.21.15.82:0/2784914816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3a81020c0 msgr2=0x7fe3a819dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:21.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.150+0000 7fe3ae5c7640 1 --2- 172.21.15.82:0/2784914816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3a81020c0 0x7fe3a819dd70 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fe3a002c630 tx=0x7fe3a0032980 comp rx=0 tx=0).stop 2024-03-04T09:15:21.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.150+0000 7fe3ae5c7640 1 -- 172.21.15.82:0/2784914816 shutdown_connections 2024-03-04T09:15:21.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.150+0000 7fe3ae5c7640 1 --2- 172.21.15.82:0/2784914816 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fe3900a1f20 0x7fe3900a43e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:21.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.150+0000 7fe3ae5c7640 1 --2- 172.21.15.82:0/2784914816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3a81020c0 0x7fe3a819dd70 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:21.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.150+0000 7fe3ae5c7640 1 --2- 172.21.15.82:0/2784914816 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3a8101700 0x7fe3a8196d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:21.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.150+0000 7fe3ae5c7640 1 --2- 172.21.15.82:0/2784914816 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3a8100510 0x7fe3a81967c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:21.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.150+0000 7fe3ae5c7640 1 -- 172.21.15.82:0/2784914816 >> 172.21.15.82:0/2784914816 conn(0x7fe3a80fba80 msgr2=0x7fe3a8104a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:21.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.150+0000 7fe3ae5c7640 1 -- 172.21.15.82:0/2784914816 shutdown_connections 2024-03-04T09:15:21.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.150+0000 7fe3ae5c7640 1 -- 172.21.15.82:0/2784914816 wait complete. 2024-03-04T09:15:21.158 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T09:08:36.508257+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-04T09:13:07.981726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-04T09:13:09.289799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-04T09:13:13.008516+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-04T09:15:21.158 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-04T09:15:21.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.266+0000 7fede1604640 1 -- 172.21.15.82:0/1526471077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feddc1003f0 msgr2=0x7feddc100810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:21.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.266+0000 7fede1604640 1 --2- 172.21.15.82:0/1526471077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feddc1003f0 0x7feddc100810 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fedcc009900 tx=0x7fedcc02bc30 comp rx=0 tx=0).stop 2024-03-04T09:15:21.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.266+0000 7fede1604640 1 -- 172.21.15.82:0/1526471077 shutdown_connections 2024-03-04T09:15:21.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.266+0000 7fede1604640 1 --2- 172.21.15.82:0/1526471077 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feddc101fa0 0x7feddc108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:21.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.266+0000 7fede1604640 1 --2- 172.21.15.82:0/1526471077 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feddc1015e0 0x7feddc101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:21.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.266+0000 7fede1604640 1 --2- 172.21.15.82:0/1526471077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feddc1003f0 0x7feddc100810 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:21.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.266+0000 7fede1604640 1 -- 172.21.15.82:0/1526471077 >> 172.21.15.82:0/1526471077 conn(0x7feddc0fb980 msgr2=0x7feddc0fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:21.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.266+0000 7fede1604640 1 -- 172.21.15.82:0/1526471077 shutdown_connections 2024-03-04T09:15:21.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.266+0000 7fede1604640 1 -- 172.21.15.82:0/1526471077 wait complete. 2024-03-04T09:15:21.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.267+0000 7fede1604640 1 Processor -- start 2024-03-04T09:15:21.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.267+0000 7fede1604640 1 -- start start 2024-03-04T09:15:21.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.267+0000 7fede1604640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feddc1003f0 0x7feddc06a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:21.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.267+0000 7fede1604640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feddc1015e0 0x7feddc19c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:21.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.267+0000 7fede1604640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feddc101fa0 0x7feddc19eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:21.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.267+0000 7fede1604640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feddc10c040 con 0x7feddc101fa0 2024-03-04T09:15:21.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.267+0000 7fede1604640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feddc10bec0 con 0x7feddc1015e0 2024-03-04T09:15:21.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.267+0000 7fede1604640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feddc10c1c0 con 0x7feddc1003f0 2024-03-04T09:15:21.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.267+0000 7feddb7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feddc101fa0 0x7feddc19eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:21.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.267+0000 7feddb7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feddc101fa0 0x7feddc19eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48924/0 (socket says 172.21.15.82:48924) 2024-03-04T09:15:21.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.267+0000 7feddb7fe640 1 -- 172.21.15.82:0/3631756504 learned_addr learned my addr 172.21.15.82:0/3631756504 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:21.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.267+0000 7feddaffd640 1 --2- 172.21.15.82:0/3631756504 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feddc1003f0 0x7feddc06a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:21.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.267+0000 7fedd27fc640 1 --2- 172.21.15.82:0/3631756504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feddc1015e0 0x7feddc19c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:21.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.268+0000 7feddb7fe640 1 -- 172.21.15.82:0/3631756504 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feddc1003f0 msgr2=0x7feddc06a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:21.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.268+0000 7feddb7fe640 1 --2- 172.21.15.82:0/3631756504 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feddc1003f0 0x7feddc06a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:21.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.268+0000 7feddb7fe640 1 -- 172.21.15.82:0/3631756504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feddc1015e0 msgr2=0x7feddc19c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:21.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.268+0000 7feddb7fe640 1 --2- 172.21.15.82:0/3631756504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feddc1015e0 0x7feddc19c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:21.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.268+0000 7feddb7fe640 1 -- 172.21.15.82:0/3631756504 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feddc19f440 con 0x7feddc101fa0 2024-03-04T09:15:21.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.268+0000 7feddb7fe640 1 --2- 172.21.15.82:0/3631756504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feddc101fa0 0x7feddc19eb80 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fedd400eb10 tx=0x7fedd400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:21.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.268+0000 7fedd8ff9640 1 -- 172.21.15.82:0/3631756504 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd4004b20 con 0x7feddc101fa0 2024-03-04T09:15:21.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.268+0000 7fede1604640 1 -- 172.21.15.82:0/3631756504 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feddc19f730 con 0x7feddc101fa0 2024-03-04T09:15:21.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.268+0000 7fedd8ff9640 1 -- 172.21.15.82:0/3631756504 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fedd4004cc0 con 0x7feddc101fa0 2024-03-04T09:15:21.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.268+0000 7fedd8ff9640 1 -- 172.21.15.82:0/3631756504 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd4010700 con 0x7feddc101fa0 2024-03-04T09:15:21.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.268+0000 7fede1604640 1 -- 172.21.15.82:0/3631756504 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feddc19fc30 con 0x7feddc101fa0 2024-03-04T09:15:21.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.269+0000 7fede1604640 1 -- 172.21.15.82:0/3631756504 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feddc107760 con 0x7feddc101fa0 2024-03-04T09:15:21.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.270+0000 7fedd8ff9640 1 -- 172.21.15.82:0/3631756504 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 136756+0+0 (secure 0 0 0) 0x7fedd4004e70 con 0x7feddc101fa0 2024-03-04T09:15:21.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.270+0000 7fedd8ff9640 1 --2- 172.21.15.82:0/3631756504 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fedc80a1d80 0x7fedc80a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:21.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.271+0000 7feddaffd640 1 --2- 172.21.15.82:0/3631756504 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fedc80a1d80 0x7fedc80a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:21.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.271+0000 7fedd8ff9640 1 -- 172.21.15.82:0/3631756504 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9179+0+0 (secure 0 0 0) 0x7fedd40ce6f0 con 0x7feddc101fa0 2024-03-04T09:15:21.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.271+0000 7feddaffd640 1 --2- 172.21.15.82:0/3631756504 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fedc80a1d80 0x7fedc80a4240 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fedcc000c00 tx=0x7fedcc005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:21.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.275+0000 7fedd8ff9640 1 -- 172.21.15.82:0/3631756504 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fedd409b770 con 0x7feddc101fa0 2024-03-04T09:15:21.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.451+0000 7fede1604640 1 -- 172.21.15.82:0/3631756504 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feddc0621d0 con 0x7feddc101fa0 2024-03-04T09:15:21.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.452+0000 7fedd8ff9640 1 -- 172.21.15.82:0/3631756504 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) v1 ==== 93+0+10 (secure 0 0 0) 0x7fedd409b070 con 0x7feddc101fa0 2024-03-04T09:15:21.448 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-03-04T09:15:21.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.454+0000 7fede1604640 1 -- 172.21.15.82:0/3631756504 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fedc80a1d80 msgr2=0x7fedc80a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:21.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.454+0000 7fede1604640 1 --2- 172.21.15.82:0/3631756504 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fedc80a1d80 0x7fedc80a4240 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fedcc000c00 tx=0x7fedcc005fd0 comp rx=0 tx=0).stop 2024-03-04T09:15:21.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.454+0000 7fede1604640 1 -- 172.21.15.82:0/3631756504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feddc101fa0 msgr2=0x7feddc19eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:21.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.454+0000 7fede1604640 1 --2- 172.21.15.82:0/3631756504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feddc101fa0 0x7feddc19eb80 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fedd400eb10 tx=0x7fedd400c2d0 comp rx=0 tx=0).stop 2024-03-04T09:15:21.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.454+0000 7fede1604640 1 -- 172.21.15.82:0/3631756504 shutdown_connections 2024-03-04T09:15:21.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.454+0000 7fede1604640 1 --2- 172.21.15.82:0/3631756504 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fedc80a1d80 0x7fedc80a4240 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:21.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.454+0000 7fede1604640 1 --2- 172.21.15.82:0/3631756504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feddc101fa0 0x7feddc19eb80 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:21.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.454+0000 7fede1604640 1 --2- 172.21.15.82:0/3631756504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feddc1015e0 0x7feddc19c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:21.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.454+0000 7fede1604640 1 --2- 172.21.15.82:0/3631756504 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feddc1003f0 0x7feddc06a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:21.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.454+0000 7fede1604640 1 -- 172.21.15.82:0/3631756504 >> 172.21.15.82:0/3631756504 conn(0x7feddc0fb980 msgr2=0x7feddc104930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:21.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.454+0000 7fede1604640 1 -- 172.21.15.82:0/3631756504 shutdown_connections 2024-03-04T09:15:21.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.454+0000 7fede1604640 1 -- 172.21.15.82:0/3631756504 wait complete. 2024-03-04T09:15:21.460 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:21 smithi082 ceph-mon[32880]: pgmap v358: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 9 op/s; 2 B/s, 1 keys/s, 1 objects/s recovering 2024-03-04T09:15:21.460 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:21 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/2784914816' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:15:21.462 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-04T09:15:21.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.571+0000 7f1fe5b7a640 1 -- 172.21.15.82:0/824953695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fe0102080 msgr2=0x7f1fe0108910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:21.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.571+0000 7f1fe5b7a640 1 --2- 172.21.15.82:0/824953695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fe0102080 0x7f1fe0108910 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f1fd8009ca0 tx=0x7f1fd802c0f0 comp rx=0 tx=0).stop 2024-03-04T09:15:21.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.571+0000 7f1fe5b7a640 1 -- 172.21.15.82:0/824953695 shutdown_connections 2024-03-04T09:15:21.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.571+0000 7f1fe5b7a640 1 --2- 172.21.15.82:0/824953695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fe0102080 0x7f1fe0108910 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:21.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.571+0000 7f1fe5b7a640 1 --2- 172.21.15.82:0/824953695 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1fe01016c0 0x7f1fe0101b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:21.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.571+0000 7f1fe5b7a640 1 --2- 172.21.15.82:0/824953695 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1fe01004d0 0x7f1fe01008f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:21.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.571+0000 7f1fe5b7a640 1 -- 172.21.15.82:0/824953695 >> 172.21.15.82:0/824953695 conn(0x7f1fe00fba60 msgr2=0x7f1fe00fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:21.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.571+0000 7f1fe5b7a640 1 -- 172.21.15.82:0/824953695 shutdown_connections 2024-03-04T09:15:21.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.571+0000 7f1fe5b7a640 1 -- 172.21.15.82:0/824953695 wait complete. 2024-03-04T09:15:21.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.571+0000 7f1fe5b7a640 1 Processor -- start 2024-03-04T09:15:21.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.571+0000 7f1fe5b7a640 1 -- start start 2024-03-04T09:15:21.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.571+0000 7f1fe5b7a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1fe01004d0 0x7f1fe00692a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:21.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.571+0000 7f1fe5b7a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1fe01016c0 0x7f1fe019ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:21.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.571+0000 7f1fe5b7a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fe0102080 0x7f1fe01a0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:21.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.571+0000 7f1fe5b7a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe010c120 con 0x7f1fe0102080 2024-03-04T09:15:21.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.571+0000 7f1fe5b7a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe010bfa0 con 0x7f1fe01004d0 2024-03-04T09:15:21.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.571+0000 7f1fe5b7a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe010c2a0 con 0x7f1fe01016c0 2024-03-04T09:15:21.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.571+0000 7f1fdffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fe0102080 0x7f1fe01a0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:21.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.572+0000 7f1fdffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fe0102080 0x7f1fe01a0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48944/0 (socket says 172.21.15.82:48944) 2024-03-04T09:15:21.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.572+0000 7f1fdffff640 1 -- 172.21.15.82:0/2174492039 learned_addr learned my addr 172.21.15.82:0/2174492039 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:21.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.572+0000 7f1fdf7fe640 1 --2- 172.21.15.82:0/2174492039 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1fe01004d0 0x7f1fe00692a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:21.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.572+0000 7f1fd7fff640 1 --2- 172.21.15.82:0/2174492039 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1fe01016c0 0x7f1fe019ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:21.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.572+0000 7f1fdffff640 1 -- 172.21.15.82:0/2174492039 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1fe01016c0 msgr2=0x7f1fe019ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:21.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.572+0000 7f1fdffff640 1 --2- 172.21.15.82:0/2174492039 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1fe01016c0 0x7f1fe019ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:21.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.572+0000 7f1fdffff640 1 -- 172.21.15.82:0/2174492039 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1fe01004d0 msgr2=0x7f1fe00692a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:21.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.572+0000 7f1fdffff640 1 --2- 172.21.15.82:0/2174492039 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1fe01004d0 0x7f1fe00692a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:21.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.572+0000 7f1fdffff640 1 -- 172.21.15.82:0/2174492039 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe01a1750 con 0x7f1fe0102080 2024-03-04T09:15:21.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.572+0000 7f1fdffff640 1 --2- 172.21.15.82:0/2174492039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fe0102080 0x7f1fe01a0f60 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f1fd802c630 tx=0x7f1fd8032980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:21.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.572+0000 7f1fdd7fa640 1 -- 172.21.15.82:0/2174492039 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd8039050 con 0x7f1fe0102080 2024-03-04T09:15:21.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.572+0000 7f1fdd7fa640 1 -- 172.21.15.82:0/2174492039 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f1fd803a040 con 0x7f1fe0102080 2024-03-04T09:15:21.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.572+0000 7f1fe5b7a640 1 -- 172.21.15.82:0/2174492039 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fe01a1980 con 0x7f1fe0102080 2024-03-04T09:15:21.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.572+0000 7f1fdd7fa640 1 -- 172.21.15.82:0/2174492039 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd8004850 con 0x7f1fe0102080 2024-03-04T09:15:21.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.572+0000 7f1fe5b7a640 1 -- 172.21.15.82:0/2174492039 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fe01a1e70 con 0x7f1fe0102080 2024-03-04T09:15:21.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.573+0000 7f1fe5b7a640 1 -- 172.21.15.82:0/2174492039 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fe01077f0 con 0x7f1fe0102080 2024-03-04T09:15:21.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.574+0000 7f1fdd7fa640 1 -- 172.21.15.82:0/2174492039 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f1fd8004040 con 0x7f1fe0102080 2024-03-04T09:15:21.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.575+0000 7f1fdd7fa640 1 --2- 172.21.15.82:0/2174492039 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f1fcc0a1f50 0x7f1fcc0a4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:21.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.575+0000 7f1fdf7fe640 1 --2- 172.21.15.82:0/2174492039 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f1fcc0a1f50 0x7f1fcc0a4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:21.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.575+0000 7f1fdd7fa640 1 -- 172.21.15.82:0/2174492039 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9179+0+0 (secure 0 0 0) 0x7f1fd80f0b90 con 0x7f1fe0102080 2024-03-04T09:15:21.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.575+0000 7f1fdf7fe640 1 --2- 172.21.15.82:0/2174492039 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f1fcc0a1f50 0x7f1fcc0a4410 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0101520 tx=0x7f1fd0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:21.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.579+0000 7f1fdd7fa640 1 -- 172.21.15.82:0/2174492039 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f1fd8004330 con 0x7f1fe0102080 2024-03-04T09:15:21.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:21 smithi190 ceph-mon[36341]: pgmap v358: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 9 op/s; 2 B/s, 1 keys/s, 1 objects/s recovering 2024-03-04T09:15:21.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:21 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/2784914816' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:15:21.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:21 smithi102 ceph-mon[36220]: pgmap v358: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 9 op/s; 2 B/s, 1 keys/s, 1 objects/s recovering 2024-03-04T09:15:21.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:21 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/2784914816' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:15:21.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.752+0000 7f1fe5b7a640 1 -- 172.21.15.82:0/2174492039 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1fe002d1d0 con 0x7f1fe0102080 2024-03-04T09:15:21.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.752+0000 7f1fdd7fa640 1 -- 172.21.15.82:0/2174492039 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1fd80bdc10 con 0x7f1fe0102080 2024-03-04T09:15:21.749 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-03-04T09:15:21.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.754+0000 7f1fe5b7a640 1 -- 172.21.15.82:0/2174492039 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f1fcc0a1f50 msgr2=0x7f1fcc0a4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:21.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.754+0000 7f1fe5b7a640 1 --2- 172.21.15.82:0/2174492039 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f1fcc0a1f50 0x7f1fcc0a4410 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0101520 tx=0x7f1fd0005f90 comp rx=0 tx=0).stop 2024-03-04T09:15:21.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.754+0000 7f1fe5b7a640 1 -- 172.21.15.82:0/2174492039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fe0102080 msgr2=0x7f1fe01a0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:21.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.754+0000 7f1fe5b7a640 1 --2- 172.21.15.82:0/2174492039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fe0102080 0x7f1fe01a0f60 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f1fd802c630 tx=0x7f1fd8032980 comp rx=0 tx=0).stop 2024-03-04T09:15:21.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.754+0000 7f1fe5b7a640 1 -- 172.21.15.82:0/2174492039 shutdown_connections 2024-03-04T09:15:21.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.754+0000 7f1fe5b7a640 1 --2- 172.21.15.82:0/2174492039 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f1fcc0a1f50 0x7f1fcc0a4410 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:21.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.754+0000 7f1fe5b7a640 1 --2- 172.21.15.82:0/2174492039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fe0102080 0x7f1fe01a0f60 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:21.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.754+0000 7f1fe5b7a640 1 --2- 172.21.15.82:0/2174492039 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1fe01016c0 0x7f1fe019ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:21.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.754+0000 7f1fe5b7a640 1 --2- 172.21.15.82:0/2174492039 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1fe01004d0 0x7f1fe00692a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:21.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.754+0000 7f1fe5b7a640 1 -- 172.21.15.82:0/2174492039 >> 172.21.15.82:0/2174492039 conn(0x7f1fe00fba60 msgr2=0x7f1fe01049c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:21.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.754+0000 7f1fe5b7a640 1 -- 172.21.15.82:0/2174492039 shutdown_connections 2024-03-04T09:15:21.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.754+0000 7f1fe5b7a640 1 -- 172.21.15.82:0/2174492039 wait complete. 2024-03-04T09:15:21.762 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-04T09:15:21.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.869+0000 7fa422d13640 1 -- 172.21.15.82:0/521165573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa41c101600 msgr2=0x7fa41c101a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:21.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.869+0000 7fa422d13640 1 --2- 172.21.15.82:0/521165573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa41c101600 0x7fa41c101a20 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fa40c009900 tx=0x7fa40c02bc30 comp rx=0 tx=0).stop 2024-03-04T09:15:21.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.869+0000 7fa422d13640 1 -- 172.21.15.82:0/521165573 shutdown_connections 2024-03-04T09:15:21.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.869+0000 7fa422d13640 1 --2- 172.21.15.82:0/521165573 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa41c1031b0 0x7fa41c109a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:21.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.869+0000 7fa422d13640 1 --2- 172.21.15.82:0/521165573 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa41c1027f0 0x7fa41c102c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:21.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.869+0000 7fa422d13640 1 --2- 172.21.15.82:0/521165573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa41c101600 0x7fa41c101a20 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:21.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.869+0000 7fa422d13640 1 -- 172.21.15.82:0/521165573 >> 172.21.15.82:0/521165573 conn(0x7fa41c0fcb70 msgr2=0x7fa41c0fefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:21.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.869+0000 7fa422d13640 1 -- 172.21.15.82:0/521165573 shutdown_connections 2024-03-04T09:15:21.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.870+0000 7fa422d13640 1 -- 172.21.15.82:0/521165573 wait complete. 2024-03-04T09:15:21.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.870+0000 7fa422d13640 1 Processor -- start 2024-03-04T09:15:21.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.870+0000 7fa422d13640 1 -- start start 2024-03-04T09:15:21.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.870+0000 7fa422d13640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa41c101600 0x7fa41c199bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:21.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.870+0000 7fa422d13640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa41c1027f0 0x7fa41c19a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:21.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.870+0000 7fa422d13640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa41c1031b0 0x7fa41c1a1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:21.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.870+0000 7fa422d13640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41c10d260 con 0x7fa41c1027f0 2024-03-04T09:15:21.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.870+0000 7fa422d13640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41c10d0e0 con 0x7fa41c101600 2024-03-04T09:15:21.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.870+0000 7fa422d13640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41c10d3e0 con 0x7fa41c1031b0 2024-03-04T09:15:21.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.870+0000 7fa420aaf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa41c101600 0x7fa41c199bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:21.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.870+0000 7fa41bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa41c1027f0 0x7fa41c19a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:21.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.870+0000 7fa420aaf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa41c101600 0x7fa41c199bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.82:34602/0 (socket says 172.21.15.82:34602) 2024-03-04T09:15:21.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.870+0000 7fa420aaf640 1 -- 172.21.15.82:0/2512539073 learned_addr learned my addr 172.21.15.82:0/2512539073 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:21.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.870+0000 7fa4212b0640 1 --2- 172.21.15.82:0/2512539073 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa41c1031b0 0x7fa41c1a1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:21.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.871+0000 7fa420aaf640 1 -- 172.21.15.82:0/2512539073 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa41c1031b0 msgr2=0x7fa41c1a1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:21.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.871+0000 7fa420aaf640 1 --2- 172.21.15.82:0/2512539073 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa41c1031b0 0x7fa41c1a1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:21.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.871+0000 7fa420aaf640 1 -- 172.21.15.82:0/2512539073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa41c1027f0 msgr2=0x7fa41c19a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:21.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.871+0000 7fa420aaf640 1 --2- 172.21.15.82:0/2512539073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa41c1027f0 0x7fa41c19a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:21.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.871+0000 7fa420aaf640 1 -- 172.21.15.82:0/2512539073 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa41c1a17d0 con 0x7fa41c101600 2024-03-04T09:15:21.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.871+0000 7fa41bfff640 1 --2- 172.21.15.82:0/2512539073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa41c1027f0 0x7fa41c19a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:15:21.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.871+0000 7fa420aaf640 1 --2- 172.21.15.82:0/2512539073 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa41c101600 0x7fa41c199bb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa40c005ab0 tx=0x7fa40c005de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:21.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.871+0000 7fa419ffb640 1 -- 172.21.15.82:0/2512539073 <== mon.2 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40c043020 con 0x7fa41c101600 2024-03-04T09:15:21.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.871+0000 7fa422d13640 1 -- 172.21.15.82:0/2512539073 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa41c1a1a60 con 0x7fa41c101600 2024-03-04T09:15:21.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.871+0000 7fa419ffb640 1 -- 172.21.15.82:0/2512539073 <== mon.2 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fa40c0053f0 con 0x7fa41c101600 2024-03-04T09:15:21.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.871+0000 7fa419ffb640 1 -- 172.21.15.82:0/2512539073 <== mon.2 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40c003b20 con 0x7fa41c101600 2024-03-04T09:15:21.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.871+0000 7fa422d13640 1 -- 172.21.15.82:0/2512539073 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa41c1a1fb0 con 0x7fa41c101600 2024-03-04T09:15:21.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.872+0000 7fa422d13640 1 -- 172.21.15.82:0/2512539073 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa41c1a2240 con 0x7fa41c101600 2024-03-04T09:15:21.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.873+0000 7fa419ffb640 1 -- 172.21.15.82:0/2512539073 <== mon.2 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 18) v1 ==== 136756+0+0 (secure 0 0 0) 0x7fa40c046020 con 0x7fa41c101600 2024-03-04T09:15:21.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.874+0000 7fa419ffb640 1 --2- 172.21.15.82:0/2512539073 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fa4040a1d80 0x7fa4040a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:21.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.874+0000 7fa41bfff640 1 --2- 172.21.15.82:0/2512539073 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fa4040a1d80 0x7fa4040a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:21.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.874+0000 7fa419ffb640 1 -- 172.21.15.82:0/2512539073 <== mon.2 v2:172.21.15.102:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9179+0+0 (secure 0 0 0) 0x7fa40c0f0010 con 0x7fa41c101600 2024-03-04T09:15:21.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.874+0000 7fa41bfff640 1 --2- 172.21.15.82:0/2512539073 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fa4040a1d80 0x7fa4040a4240 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa41c19b0c0 tx=0x7fa410005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:21.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:21.877+0000 7fa419ffb640 1 -- 172.21.15.82:0/2512539073 <== mon.2 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fa40c0bd090 con 0x7fa41c101600 2024-03-04T09:15:22.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.066+0000 7fa422d13640 1 -- 172.21.15.82:0/2512539073 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa41c1a2410 con 0x7fa41c101600 2024-03-04T09:15:22.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.067+0000 7fa419ffb640 1 -- 172.21.15.82:0/2512539073 <== mon.2 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa40c0bc990 con 0x7fa41c101600 2024-03-04T09:15:22.063 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2024-03-04T09:15:22.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.069+0000 7fa422d13640 1 -- 172.21.15.82:0/2512539073 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fa4040a1d80 msgr2=0x7fa4040a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:22.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.069+0000 7fa422d13640 1 --2- 172.21.15.82:0/2512539073 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fa4040a1d80 0x7fa4040a4240 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa41c19b0c0 tx=0x7fa410005f90 comp rx=0 tx=0).stop 2024-03-04T09:15:22.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.069+0000 7fa422d13640 1 -- 172.21.15.82:0/2512539073 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa41c101600 msgr2=0x7fa41c199bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:22.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.069+0000 7fa422d13640 1 --2- 172.21.15.82:0/2512539073 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa41c101600 0x7fa41c199bb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa40c005ab0 tx=0x7fa40c005de0 comp rx=0 tx=0).stop 2024-03-04T09:15:22.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.069+0000 7fa422d13640 1 -- 172.21.15.82:0/2512539073 shutdown_connections 2024-03-04T09:15:22.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.069+0000 7fa422d13640 1 --2- 172.21.15.82:0/2512539073 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fa4040a1d80 0x7fa4040a4240 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:22.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.069+0000 7fa422d13640 1 --2- 172.21.15.82:0/2512539073 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa41c1031b0 0x7fa41c1a1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:22.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.069+0000 7fa422d13640 1 --2- 172.21.15.82:0/2512539073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa41c1027f0 0x7fa41c19a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:22.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.069+0000 7fa422d13640 1 --2- 172.21.15.82:0/2512539073 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa41c101600 0x7fa41c199bb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:22.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.069+0000 7fa422d13640 1 -- 172.21.15.82:0/2512539073 >> 172.21.15.82:0/2512539073 conn(0x7fa41c0fcb70 msgr2=0x7fa41c073800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:22.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.069+0000 7fa422d13640 1 -- 172.21.15.82:0/2512539073 shutdown_connections 2024-03-04T09:15:22.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.069+0000 7fa422d13640 1 -- 172.21.15.82:0/2512539073 wait complete. 2024-03-04T09:15:22.076 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-04T09:15:22.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.184+0000 7fdd32165640 1 -- 172.21.15.82:0/432945406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd2c103190 msgr2=0x7fdd2c109a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:22.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.184+0000 7fdd32165640 1 --2- 172.21.15.82:0/432945406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd2c103190 0x7fdd2c109a20 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fdd24009ca0 tx=0x7fdd2402c0f0 comp rx=0 tx=0).stop 2024-03-04T09:15:22.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.184+0000 7fdd32165640 1 -- 172.21.15.82:0/432945406 shutdown_connections 2024-03-04T09:15:22.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.184+0000 7fdd32165640 1 --2- 172.21.15.82:0/432945406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd2c103190 0x7fdd2c109a20 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:22.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.184+0000 7fdd32165640 1 --2- 172.21.15.82:0/432945406 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd2c1027d0 0x7fdd2c102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:22.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.184+0000 7fdd32165640 1 --2- 172.21.15.82:0/432945406 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdd2c1015e0 0x7fdd2c101a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:22.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.184+0000 7fdd32165640 1 -- 172.21.15.82:0/432945406 >> 172.21.15.82:0/432945406 conn(0x7fdd2c0fcb70 msgr2=0x7fdd2c0fef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:22.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.184+0000 7fdd32165640 1 -- 172.21.15.82:0/432945406 shutdown_connections 2024-03-04T09:15:22.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.184+0000 7fdd32165640 1 -- 172.21.15.82:0/432945406 wait complete. 2024-03-04T09:15:22.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.185+0000 7fdd32165640 1 Processor -- start 2024-03-04T09:15:22.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.185+0000 7fdd32165640 1 -- start start 2024-03-04T09:15:22.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.185+0000 7fdd32165640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd2c1015e0 0x7fdd2c197890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:22.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.185+0000 7fdd32165640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdd2c1027d0 0x7fdd2c197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:22.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.185+0000 7fdd32165640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd2c103190 0x7fdd2c19ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:22.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.185+0000 7fdd32165640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2c10d240 con 0x7fdd2c103190 2024-03-04T09:15:22.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.185+0000 7fdd32165640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2c10d0c0 con 0x7fdd2c1015e0 2024-03-04T09:15:22.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.185+0000 7fdd32165640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2c10d3c0 con 0x7fdd2c1027d0 2024-03-04T09:15:22.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.185+0000 7fdd2bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd2c103190 0x7fdd2c19ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:22.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.185+0000 7fdd2b7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd2c1015e0 0x7fdd2c197890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:22.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.185+0000 7fdd2bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd2c103190 0x7fdd2c19ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48998/0 (socket says 172.21.15.82:48998) 2024-03-04T09:15:22.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.185+0000 7fdd2bfff640 1 -- 172.21.15.82:0/2562037277 learned_addr learned my addr 172.21.15.82:0/2562037277 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:22.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.185+0000 7fdd2affd640 1 --2- 172.21.15.82:0/2562037277 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdd2c1027d0 0x7fdd2c197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:22.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.185+0000 7fdd2bfff640 1 -- 172.21.15.82:0/2562037277 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdd2c1027d0 msgr2=0x7fdd2c197dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:22.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.185+0000 7fdd2bfff640 1 --2- 172.21.15.82:0/2562037277 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdd2c1027d0 0x7fdd2c197dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:22.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.185+0000 7fdd2bfff640 1 -- 172.21.15.82:0/2562037277 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd2c1015e0 msgr2=0x7fdd2c197890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:22.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.185+0000 7fdd2bfff640 1 --2- 172.21.15.82:0/2562037277 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd2c1015e0 0x7fdd2c197890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:22.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.185+0000 7fdd2bfff640 1 -- 172.21.15.82:0/2562037277 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd2c19f4b0 con 0x7fdd2c103190 2024-03-04T09:15:22.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.186+0000 7fdd2bfff640 1 --2- 172.21.15.82:0/2562037277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd2c103190 0x7fdd2c19ee40 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fdd2402c630 tx=0x7fdd24032980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:22.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.186+0000 7fdd28ff9640 1 -- 172.21.15.82:0/2562037277 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd24039050 con 0x7fdd2c103190 2024-03-04T09:15:22.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.186+0000 7fdd32165640 1 -- 172.21.15.82:0/2562037277 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd2c19f740 con 0x7fdd2c103190 2024-03-04T09:15:22.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.186+0000 7fdd28ff9640 1 -- 172.21.15.82:0/2562037277 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fdd2403a040 con 0x7fdd2c103190 2024-03-04T09:15:22.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.186+0000 7fdd28ff9640 1 -- 172.21.15.82:0/2562037277 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd24004850 con 0x7fdd2c103190 2024-03-04T09:15:22.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.186+0000 7fdd32165640 1 -- 172.21.15.82:0/2562037277 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd2c19fc80 con 0x7fdd2c103190 2024-03-04T09:15:22.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.187+0000 7fdd32165640 1 -- 172.21.15.82:0/2562037277 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd2c108900 con 0x7fdd2c103190 2024-03-04T09:15:22.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.188+0000 7fdd28ff9640 1 -- 172.21.15.82:0/2562037277 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 136756+0+0 (secure 0 0 0) 0x7fdd24004040 con 0x7fdd2c103190 2024-03-04T09:15:22.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.188+0000 7fdd28ff9640 1 --2- 172.21.15.82:0/2562037277 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fdd140a1f20 0x7fdd140a43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:22.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.189+0000 7fdd2b7fe640 1 --2- 172.21.15.82:0/2562037277 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fdd140a1f20 0x7fdd140a43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:22.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.189+0000 7fdd28ff9640 1 -- 172.21.15.82:0/2562037277 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9179+0+0 (secure 0 0 0) 0x7fdd240f0d00 con 0x7fdd2c103190 2024-03-04T09:15:22.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.189+0000 7fdd2b7fe640 1 --2- 172.21.15.82:0/2562037277 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fdd140a1f20 0x7fdd140a43e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c102630 tx=0x7fdd1c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:22.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.193+0000 7fdd28ff9640 1 -- 172.21.15.82:0/2562037277 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fdd24004330 con 0x7fdd2c103190 2024-03-04T09:15:22.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.368+0000 7fdd32165640 1 -- 172.21.15.82:0/2562037277 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fdd2c0621d0 con 0x7fdd2c103190 2024-03-04T09:15:22.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.370+0000 7fdd28ff9640 1 -- 172.21.15.82:0/2562037277 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v94) v1 ==== 103+0+11 (secure 0 0 0) 0x7fdd240bdd20 con 0x7fdd2c103190 2024-03-04T09:15:22.367 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-03-04T09:15:22.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.372+0000 7fdd32165640 1 -- 172.21.15.82:0/2562037277 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fdd140a1f20 msgr2=0x7fdd140a43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:22.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.372+0000 7fdd32165640 1 --2- 172.21.15.82:0/2562037277 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fdd140a1f20 0x7fdd140a43e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c102630 tx=0x7fdd1c005f90 comp rx=0 tx=0).stop 2024-03-04T09:15:22.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.372+0000 7fdd32165640 1 -- 172.21.15.82:0/2562037277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd2c103190 msgr2=0x7fdd2c19ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:22.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.372+0000 7fdd32165640 1 --2- 172.21.15.82:0/2562037277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd2c103190 0x7fdd2c19ee40 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fdd2402c630 tx=0x7fdd24032980 comp rx=0 tx=0).stop 2024-03-04T09:15:22.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.372+0000 7fdd32165640 1 -- 172.21.15.82:0/2562037277 shutdown_connections 2024-03-04T09:15:22.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.372+0000 7fdd32165640 1 --2- 172.21.15.82:0/2562037277 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fdd140a1f20 0x7fdd140a43e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:22.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.372+0000 7fdd32165640 1 --2- 172.21.15.82:0/2562037277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd2c103190 0x7fdd2c19ee40 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:22.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.372+0000 7fdd32165640 1 --2- 172.21.15.82:0/2562037277 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdd2c1027d0 0x7fdd2c197dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:22.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.372+0000 7fdd32165640 1 --2- 172.21.15.82:0/2562037277 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd2c1015e0 0x7fdd2c197890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:22.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.372+0000 7fdd32165640 1 -- 172.21.15.82:0/2562037277 >> 172.21.15.82:0/2562037277 conn(0x7fdd2c0fcb70 msgr2=0x7fdd2c105ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:22.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.373+0000 7fdd32165640 1 -- 172.21.15.82:0/2562037277 shutdown_connections 2024-03-04T09:15:22.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.373+0000 7fdd32165640 1 -- 172.21.15.82:0/2562037277 wait complete. 2024-03-04T09:15:22.381 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T09:15:22.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.486+0000 7faba61e2640 1 -- 172.21.15.82:0/1744016549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faba01049c0 msgr2=0x7faba0106db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:22.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.486+0000 7faba61e2640 1 --2- 172.21.15.82:0/1744016549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faba01049c0 0x7faba0106db0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fab94009900 tx=0x7fab9402bc30 comp rx=0 tx=0).stop 2024-03-04T09:15:22.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.486+0000 7faba61e2640 1 -- 172.21.15.82:0/1744016549 shutdown_connections 2024-03-04T09:15:22.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.486+0000 7faba61e2640 1 --2- 172.21.15.82:0/1744016549 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faba01072f0 0x7faba0109740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:22.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.486+0000 7faba61e2640 1 --2- 172.21.15.82:0/1744016549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faba01049c0 0x7faba0106db0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:22.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.486+0000 7faba61e2640 1 --2- 172.21.15.82:0/1744016549 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faba0102090 0x7faba0104480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:22.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.486+0000 7faba61e2640 1 -- 172.21.15.82:0/1744016549 >> 172.21.15.82:0/1744016549 conn(0x7faba00fba80 msgr2=0x7faba00fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:22.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.486+0000 7faba61e2640 1 -- 172.21.15.82:0/1744016549 shutdown_connections 2024-03-04T09:15:22.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.486+0000 7faba61e2640 1 -- 172.21.15.82:0/1744016549 wait complete. 2024-03-04T09:15:22.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.487+0000 7faba61e2640 1 Processor -- start 2024-03-04T09:15:22.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.487+0000 7faba61e2640 1 -- start start 2024-03-04T09:15:22.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.487+0000 7faba61e2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faba0102090 0x7faba0197930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:22.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.487+0000 7faba61e2640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faba01049c0 0x7faba0197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:22.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.487+0000 7faba61e2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faba01072f0 0x7faba019eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:22.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.487+0000 7faba61e2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba010d250 con 0x7faba01072f0 2024-03-04T09:15:22.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.487+0000 7faba61e2640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba010d0d0 con 0x7faba0102090 2024-03-04T09:15:22.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.487+0000 7faba61e2640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba010d3d0 con 0x7faba01049c0 2024-03-04T09:15:22.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.487+0000 7fab9ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faba01072f0 0x7faba019eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:22.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.487+0000 7fab9f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faba0102090 0x7faba0197930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:22.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.487+0000 7fab9f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faba0102090 0x7faba0197930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.82:34650/0 (socket says 172.21.15.82:34650) 2024-03-04T09:15:22.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.487+0000 7fab9f7fe640 1 -- 172.21.15.82:0/4100414545 learned_addr learned my addr 172.21.15.82:0/4100414545 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:22.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.487+0000 7fab9ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faba01072f0 0x7faba019eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49012/0 (socket says 172.21.15.82:49012) 2024-03-04T09:15:22.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.487+0000 7fab9effd640 1 --2- 172.21.15.82:0/4100414545 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faba01049c0 0x7faba0197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:22.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.487+0000 7fab9f7fe640 1 -- 172.21.15.82:0/4100414545 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faba01049c0 msgr2=0x7faba0197e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:22.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.487+0000 7fab9f7fe640 1 --2- 172.21.15.82:0/4100414545 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faba01049c0 0x7faba0197e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:22.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.487+0000 7fab9f7fe640 1 -- 172.21.15.82:0/4100414545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faba01072f0 msgr2=0x7faba019eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:22.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.487+0000 7fab9f7fe640 1 --2- 172.21.15.82:0/4100414545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faba01072f0 0x7faba019eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:22.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.487+0000 7fab9f7fe640 1 -- 172.21.15.82:0/4100414545 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba019f550 con 0x7faba0102090 2024-03-04T09:15:22.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.487+0000 7fab9ffff640 1 --2- 172.21.15.82:0/4100414545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faba01072f0 0x7faba019eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:15:22.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.488+0000 7fab9f7fe640 1 --2- 172.21.15.82:0/4100414545 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faba0102090 0x7faba0197930 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fab9000e9f0 tx=0x7fab9000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:22.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.488+0000 7fab9cff9640 1 -- 172.21.15.82:0/4100414545 <== mon.2 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9000cd80 con 0x7faba0102090 2024-03-04T09:15:22.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.488+0000 7fab9cff9640 1 -- 172.21.15.82:0/4100414545 <== mon.2 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fab90010900 con 0x7faba0102090 2024-03-04T09:15:22.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.488+0000 7fab9cff9640 1 -- 172.21.15.82:0/4100414545 <== mon.2 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab900189e0 con 0x7faba0102090 2024-03-04T09:15:22.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.488+0000 7faba61e2640 1 -- 172.21.15.82:0/4100414545 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faba019f840 con 0x7faba0102090 2024-03-04T09:15:22.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.488+0000 7faba61e2640 1 -- 172.21.15.82:0/4100414545 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faba019fd60 con 0x7faba0102090 2024-03-04T09:15:22.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.489+0000 7faba61e2640 1 -- 172.21.15.82:0/4100414545 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faba00fd570 con 0x7faba0102090 2024-03-04T09:15:22.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.490+0000 7fab9cff9640 1 -- 172.21.15.82:0/4100414545 <== mon.2 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 18) v1 ==== 136756+0+0 (secure 0 0 0) 0x7fab90010ab0 con 0x7faba0102090 2024-03-04T09:15:22.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.490+0000 7fab9cff9640 1 --2- 172.21.15.82:0/4100414545 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fab880a1d80 0x7fab880a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:22.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.491+0000 7fab9effd640 1 --2- 172.21.15.82:0/4100414545 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fab880a1d80 0x7fab880a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:22.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.491+0000 7fab9cff9640 1 -- 172.21.15.82:0/4100414545 <== mon.2 v2:172.21.15.102:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9179+0+0 (secure 0 0 0) 0x7fab900ce440 con 0x7faba0102090 2024-03-04T09:15:22.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.491+0000 7fab9effd640 1 --2- 172.21.15.82:0/4100414545 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fab880a1d80 0x7fab880a4240 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fab94000c00 tx=0x7fab94005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:22.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.494+0000 7fab9cff9640 1 -- 172.21.15.82:0/4100414545 <== mon.2 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fab9009ae10 con 0x7faba0102090 2024-03-04T09:15:22.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:22 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/3631756504' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-04T09:15:22.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:22 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/2174492039' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-04T09:15:22.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:22 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/2512539073' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-04T09:15:22.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:22 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/3631756504' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-04T09:15:22.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:22 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/2174492039' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-04T09:15:22.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:22 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/2512539073' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-04T09:15:22.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.705+0000 7faba61e2640 1 -- 172.21.15.82:0/4100414545 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faba002cff0 con 0x7faba0102090 2024-03-04T09:15:22.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.706+0000 7fab9cff9640 1 -- 172.21.15.82:0/4100414545 <== mon.2 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11462 (secure 0 0 0) 0x7fab9009eeb0 con 0x7faba0102090 2024-03-04T09:15:22.703 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:15:22.703 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3123844705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3123844705},{"type":"v1","addr":"172.21.15.82:6835","nonce":3123844705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2620634252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2620634252},{"type":"v1","addr":"172.21.15.82:6837","nonce":2620634252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-04T09:13:10.076732+0000","modified":"2024-03-04T09:13:38.017758+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24476,"mds_1":24469,"mds_2":24451,"mds_3":24449,"mds_4":24439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14613":{"gid":14613,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/1240838024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1240838024},{"type":"v1","addr":"172.21.15.82:6839","nonce":1240838024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14625":{"gid":14625,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/213594267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":213594267},{"type":"v1","addr":"172.21.15.82:6841","nonce":213594267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24398":{"gid":24398,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/1142302200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":1142302200},{"type":"v1","addr":"172.21.15.102:6833","nonce":1142302200}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24403":{"gid":24403,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6833/3023382814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":3023382814},{"type":"v1","addr":"172.21.15.190:6833","nonce":3023382814}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24422":{"gid":24422,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6835/2134310473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":2134310473},{"type":"v1","addr":"172.21.15.102:6835","nonce":2134310473}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24439":{"gid":24439,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":14,"addr":"172.21.15.190:6835/3183532624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3183532624},{"type":"v1","addr":"172.21.15.190:6835","nonce":3183532624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24449":{"gid":24449,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":12,"addr":"172.21.15.102:6837/1210579527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1210579527},{"type":"v1","addr":"172.21.15.102:6837","nonce":1210579527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24451":{"gid":24451,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.190:6837/1198639527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":1198639527},{"type":"v1","addr":"172.21.15.190:6837","nonce":1198639527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.190:6839/878555510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":878555510},{"type":"v1","addr":"172.21.15.190:6839","nonce":878555510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6839/35424130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":35424130},{"type":"v1","addr":"172.21.15.102:6839","nonce":35424130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24449,24439,24451,24476,24469]},"id":1}]} 2024-03-04T09:15:22.703 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 27 2024-03-04T09:15:22.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.708+0000 7faba61e2640 1 -- 172.21.15.82:0/4100414545 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fab880a1d80 msgr2=0x7fab880a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:22.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.708+0000 7faba61e2640 1 --2- 172.21.15.82:0/4100414545 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fab880a1d80 0x7fab880a4240 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fab94000c00 tx=0x7fab94005fd0 comp rx=0 tx=0).stop 2024-03-04T09:15:22.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.708+0000 7faba61e2640 1 -- 172.21.15.82:0/4100414545 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faba0102090 msgr2=0x7faba0197930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:22.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.708+0000 7faba61e2640 1 --2- 172.21.15.82:0/4100414545 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faba0102090 0x7faba0197930 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fab9000e9f0 tx=0x7fab9000eeb0 comp rx=0 tx=0).stop 2024-03-04T09:15:22.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.708+0000 7faba61e2640 1 -- 172.21.15.82:0/4100414545 shutdown_connections 2024-03-04T09:15:22.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.708+0000 7faba61e2640 1 --2- 172.21.15.82:0/4100414545 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fab880a1d80 0x7fab880a4240 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:22.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.708+0000 7faba61e2640 1 --2- 172.21.15.82:0/4100414545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faba01072f0 0x7faba019eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:22.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.708+0000 7faba61e2640 1 --2- 172.21.15.82:0/4100414545 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faba01049c0 0x7faba0197e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:22.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.708+0000 7faba61e2640 1 --2- 172.21.15.82:0/4100414545 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faba0102090 0x7faba0197930 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:22.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.708+0000 7faba61e2640 1 -- 172.21.15.82:0/4100414545 >> 172.21.15.82:0/4100414545 conn(0x7faba00fba80 msgr2=0x7faba0102c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:22.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.708+0000 7faba61e2640 1 -- 172.21.15.82:0/4100414545 shutdown_connections 2024-03-04T09:15:22.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.708+0000 7faba61e2640 1 -- 172.21.15.82:0/4100414545 wait complete. 2024-03-04T09:15:22.715 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:22 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/3631756504' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-04T09:15:22.715 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:22 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/2174492039' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-04T09:15:22.715 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:22 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/2512539073' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-04T09:15:22.716 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T09:15:22.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.823+0000 7fcdf9bac640 1 -- 172.21.15.82:0/3078401119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdf4102150 msgr2=0x7fcdf4104540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:22.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.823+0000 7fcdf9bac640 1 --2- 172.21.15.82:0/3078401119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdf4102150 0x7fcdf4104540 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fcde4009900 tx=0x7fcde402bc30 comp rx=0 tx=0).stop 2024-03-04T09:15:22.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.823+0000 7fcdf9bac640 1 -- 172.21.15.82:0/3078401119 shutdown_connections 2024-03-04T09:15:22.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.823+0000 7fcdf9bac640 1 --2- 172.21.15.82:0/3078401119 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcdf41073b0 0x7fcdf41097a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:22.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.823+0000 7fcdf9bac640 1 --2- 172.21.15.82:0/3078401119 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcdf4104a80 0x7fcdf4106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:22.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.823+0000 7fcdf9bac640 1 --2- 172.21.15.82:0/3078401119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdf4102150 0x7fcdf4104540 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:22.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.823+0000 7fcdf9bac640 1 -- 172.21.15.82:0/3078401119 >> 172.21.15.82:0/3078401119 conn(0x7fcdf40fbb00 msgr2=0x7fcdf40fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:22.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.823+0000 7fcdf9bac640 1 -- 172.21.15.82:0/3078401119 shutdown_connections 2024-03-04T09:15:22.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.823+0000 7fcdf9bac640 1 -- 172.21.15.82:0/3078401119 wait complete. 2024-03-04T09:15:22.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.824+0000 7fcdf9bac640 1 Processor -- start 2024-03-04T09:15:22.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.824+0000 7fcdf9bac640 1 -- start start 2024-03-04T09:15:22.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.824+0000 7fcdf9bac640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdf4102150 0x7fcdf4197980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:22.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.824+0000 7fcdf9bac640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcdf4104a80 0x7fcdf4197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:22.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.824+0000 7fcdf9bac640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcdf41073b0 0x7fcdf419ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:22.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.824+0000 7fcdf9bac640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf410d280 con 0x7fcdf4102150 2024-03-04T09:15:22.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.824+0000 7fcdf9bac640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf410d100 con 0x7fcdf4104a80 2024-03-04T09:15:22.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.824+0000 7fcdf9bac640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf410d400 con 0x7fcdf41073b0 2024-03-04T09:15:22.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.824+0000 7fcdf37fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdf4102150 0x7fcdf4197980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:22.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.824+0000 7fcdf37fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdf4102150 0x7fcdf4197980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49022/0 (socket says 172.21.15.82:49022) 2024-03-04T09:15:22.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.824+0000 7fcdf37fe640 1 -- 172.21.15.82:0/2315650025 learned_addr learned my addr 172.21.15.82:0/2315650025 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:22.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.824+0000 7fcdf2ffd640 1 --2- 172.21.15.82:0/2315650025 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcdf4104a80 0x7fcdf4197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:22.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.824+0000 7fcdf3fff640 1 --2- 172.21.15.82:0/2315650025 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcdf41073b0 0x7fcdf419ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:22.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.824+0000 7fcdf37fe640 1 -- 172.21.15.82:0/2315650025 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcdf41073b0 msgr2=0x7fcdf419ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:22.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.824+0000 7fcdf37fe640 1 --2- 172.21.15.82:0/2315650025 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcdf41073b0 0x7fcdf419ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:22.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.824+0000 7fcdf37fe640 1 -- 172.21.15.82:0/2315650025 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcdf4104a80 msgr2=0x7fcdf4197ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:22.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.825+0000 7fcdf37fe640 1 --2- 172.21.15.82:0/2315650025 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcdf4104a80 0x7fcdf4197ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:22.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.825+0000 7fcdf37fe640 1 -- 172.21.15.82:0/2315650025 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf419f5a0 con 0x7fcdf4102150 2024-03-04T09:15:22.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.825+0000 7fcdf37fe640 1 --2- 172.21.15.82:0/2315650025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdf4102150 0x7fcdf4197980 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fcde4009230 tx=0x7fcde4005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:22.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.825+0000 7fcdf0ff9640 1 -- 172.21.15.82:0/2315650025 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde4043020 con 0x7fcdf4102150 2024-03-04T09:15:22.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.825+0000 7fcdf9bac640 1 -- 172.21.15.82:0/2315650025 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdf419f830 con 0x7fcdf4102150 2024-03-04T09:15:22.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.825+0000 7fcdf0ff9640 1 -- 172.21.15.82:0/2315650025 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fcde40054b0 con 0x7fcdf4102150 2024-03-04T09:15:22.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.825+0000 7fcdf0ff9640 1 -- 172.21.15.82:0/2315650025 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde4003b80 con 0x7fcdf4102150 2024-03-04T09:15:22.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.825+0000 7fcdf9bac640 1 -- 172.21.15.82:0/2315650025 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdf419fd80 con 0x7fcdf4102150 2024-03-04T09:15:22.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.826+0000 7fcdf9bac640 1 -- 172.21.15.82:0/2315650025 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdf40fd5f0 con 0x7fcdf4102150 2024-03-04T09:15:22.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.827+0000 7fcdf0ff9640 1 -- 172.21.15.82:0/2315650025 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 136756+0+0 (secure 0 0 0) 0x7fcde4046020 con 0x7fcdf4102150 2024-03-04T09:15:22.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.827+0000 7fcdf0ff9640 1 --2- 172.21.15.82:0/2315650025 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fcddc0a1d80 0x7fcddc0a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:22.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.828+0000 7fcdf2ffd640 1 --2- 172.21.15.82:0/2315650025 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fcddc0a1d80 0x7fcddc0a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:22.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.828+0000 7fcdf0ff9640 1 -- 172.21.15.82:0/2315650025 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9179+0+0 (secure 0 0 0) 0x7fcde40f0510 con 0x7fcdf4102150 2024-03-04T09:15:22.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.828+0000 7fcdf2ffd640 1 --2- 172.21.15.82:0/2315650025 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fcddc0a1d80 0x7fcddc0a4240 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fcdf4198e90 tx=0x7fcde8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:22.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:22.831+0000 7fcdf0ff9640 1 -- 172.21.15.82:0/2315650025 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fcde404d070 con 0x7fcdf4102150 2024-03-04T09:15:23.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.007+0000 7fcdf9bac640 1 -- 172.21.15.82:0/2315650025 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcdf40621d0 con 0x7fcdf4102150 2024-03-04T09:15:23.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.008+0000 7fcdf0ff9640 1 -- 172.21.15.82:0/2315650025 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+24760 (secure 0 0 0) 0x7fcde40bd590 con 0x7fcdf4102150 2024-03-04T09:15:23.005 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:15:23.005 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":94,"fsid":"2e533fc8-da06-11ee-95c6-87774f69a715","created":"2024-03-04T09:05:16.488249+0000","modified":"2024-03-04T09:15:14.344362+0000","last_up_change":"2024-03-04T09:12:22.308711+0000","last_in_change":"2024-03-04T09:12:02.548212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T09:08:36.508257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T09:13:07.981726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T09:13:09.289799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-04T09:13:13.008516+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"085b5c4b-ede9-4d0d-b994-50c89d991012","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6803","nonce":709655235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6805","nonce":709655235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6809","nonce":709655235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6807","nonce":709655235}]},"public_addr":"172.21.15.82:6803/709655235","cluster_addr":"172.21.15.82:6805/709655235","heartbeat_back_addr":"172.21.15.82:6809/709655235","heartbeat_front_addr":"172.21.15.82:6807/709655235","state":["exists","up"]},{"osd":1,"uuid":"e4dd7079-333e-4bcf-b3af-11fb082a5af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6801","nonce":270721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6803","nonce":270721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6807","nonce":270721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6805","nonce":270721212}]},"public_addr":"172.21.15.102:6801/270721212","cluster_addr":"172.21.15.102:6803/270721212","heartbeat_back_addr":"172.21.15.102:6807/270721212","heartbeat_front_addr":"172.21.15.102:6805/270721212","state":["exists","up"]},{"osd":2,"uuid":"6fed5fd6-dc82-497f-9d69-c10a5e5802da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6801","nonce":946410459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6803","nonce":946410459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6807","nonce":946410459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6805","nonce":946410459}]},"public_addr":"172.21.15.190:6801/946410459","cluster_addr":"172.21.15.190:6803/946410459","heartbeat_back_addr":"172.21.15.190:6807/946410459","heartbeat_front_addr":"172.21.15.190:6805/946410459","state":["exists","up"]},{"osd":3,"uuid":"91ccbdc3-3da6-4d39-8a89-3a7b7bb4adc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6811","nonce":980870924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6813","nonce":980870924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6817","nonce":980870924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6815","nonce":980870924}]},"public_addr":"172.21.15.82:6811/980870924","cluster_addr":"172.21.15.82:6813/980870924","heartbeat_back_addr":"172.21.15.82:6817/980870924","heartbeat_front_addr":"172.21.15.82:6815/980870924","state":["exists","up"]},{"osd":4,"uuid":"dbb9d486-5daa-4819-bbed-04fc76ca473e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6809","nonce":1229627753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6811","nonce":1229627753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6815","nonce":1229627753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6813","nonce":1229627753}]},"public_addr":"172.21.15.102:6809/1229627753","cluster_addr":"172.21.15.102:6811/1229627753","heartbeat_back_addr":"172.21.15.102:6815/1229627753","heartbeat_front_addr":"172.21.15.102:6813/1229627753","state":["exists","up"]},{"osd":5,"uuid":"6b50127b-df2b-4c95-8e53-9d42b40273fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6809","nonce":2171194148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6811","nonce":2171194148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6815","nonce":2171194148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6813","nonce":2171194148}]},"public_addr":"172.21.15.190:6809/2171194148","cluster_addr":"172.21.15.190:6811/2171194148","heartbeat_back_addr":"172.21.15.190:6815/2171194148","heartbeat_front_addr":"172.21.15.190:6813/2171194148","state":["exists","up"]},{"osd":6,"uuid":"e72bebb0-5939-4210-950a-41c25c23c62f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6819","nonce":454436959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6821","nonce":454436959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6825","nonce":454436959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6823","nonce":454436959}]},"public_addr":"172.21.15.82:6819/454436959","cluster_addr":"172.21.15.82:6821/454436959","heartbeat_back_addr":"172.21.15.82:6825/454436959","heartbeat_front_addr":"172.21.15.82:6823/454436959","state":["exists","up"]},{"osd":7,"uuid":"72f83f97-f496-4503-8284-6a7b8f99a6f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6817","nonce":2745057274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6819","nonce":2745057274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6823","nonce":2745057274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6821","nonce":2745057274}]},"public_addr":"172.21.15.102:6817/2745057274","cluster_addr":"172.21.15.102:6819/2745057274","heartbeat_back_addr":"172.21.15.102:6823/2745057274","heartbeat_front_addr":"172.21.15.102:6821/2745057274","state":["exists","up"]},{"osd":8,"uuid":"92c9109d-6ebb-4c50-9944-28cd7b2f9c0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6817","nonce":1679683516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6819","nonce":1679683516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6823","nonce":1679683516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6821","nonce":1679683516}]},"public_addr":"172.21.15.190:6817/1679683516","cluster_addr":"172.21.15.190:6819/1679683516","heartbeat_back_addr":"172.21.15.190:6823/1679683516","heartbeat_front_addr":"172.21.15.190:6821/1679683516","state":["exists","up"]},{"osd":9,"uuid":"a3cfce03-0148-475d-bf55-b8284ae1cad2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6827","nonce":1777272933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6829","nonce":1777272933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6833","nonce":1777272933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6831","nonce":1777272933}]},"public_addr":"172.21.15.82:6827/1777272933","cluster_addr":"172.21.15.82:6829/1777272933","heartbeat_back_addr":"172.21.15.82:6833/1777272933","heartbeat_front_addr":"172.21.15.82:6831/1777272933","state":["exists","up"]},{"osd":10,"uuid":"db156ccf-4396-43cb-b69a-bb9095b94b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6825","nonce":1012784035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6827","nonce":1012784035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6831","nonce":1012784035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6829","nonce":1012784035}]},"public_addr":"172.21.15.102:6825/1012784035","cluster_addr":"172.21.15.102:6827/1012784035","heartbeat_back_addr":"172.21.15.102:6831/1012784035","heartbeat_front_addr":"172.21.15.102:6829/1012784035","state":["exists","up"]},{"osd":11,"uuid":"b4d52576-f5b4-479f-8ff6-8fdba4635ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6825","nonce":144700355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6827","nonce":144700355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6831","nonce":144700355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6829","nonce":144700355}]},"public_addr":"172.21.15.190:6825/144700355","cluster_addr":"172.21.15.190:6827/144700355","heartbeat_back_addr":"172.21.15.190:6831/144700355","heartbeat_front_addr":"172.21.15.190:6829/144700355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:07:47.007772+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:09.944738+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:33.183567+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:58.302023+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:09:23.042488+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:09:47.616009+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:10:13.122887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:10:38.584530+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:03.473453+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:29.847105+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:55.152195+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:12:20.401765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6800/1901539016":"2024-03-05T09:06:12.169231+0000","172.21.15.82:0/1124105204":"2024-03-05T09:06:12.169231+0000","172.21.15.82:6801/1901539016":"2024-03-05T09:06:12.169231+0000","172.21.15.82:0/735262841":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/2402774828":"2024-03-05T09:05:44.913099+0000","172.21.15.82:6801/3291527077":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/1846720385":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/3757201752":"2024-03-05T09:06:12.169231+0000","172.21.15.82:6800/3291527077":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/984630078":"2024-03-05T09:06:12.169231+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T09:15:23.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.011+0000 7fcdf9bac640 1 -- 172.21.15.82:0/2315650025 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fcddc0a1d80 msgr2=0x7fcddc0a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:23.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.011+0000 7fcdf9bac640 1 --2- 172.21.15.82:0/2315650025 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fcddc0a1d80 0x7fcddc0a4240 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fcdf4198e90 tx=0x7fcde8005f90 comp rx=0 tx=0).stop 2024-03-04T09:15:23.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.011+0000 7fcdf9bac640 1 -- 172.21.15.82:0/2315650025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdf4102150 msgr2=0x7fcdf4197980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:23.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.011+0000 7fcdf9bac640 1 --2- 172.21.15.82:0/2315650025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdf4102150 0x7fcdf4197980 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fcde4009230 tx=0x7fcde4005dd0 comp rx=0 tx=0).stop 2024-03-04T09:15:23.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.011+0000 7fcdf9bac640 1 -- 172.21.15.82:0/2315650025 shutdown_connections 2024-03-04T09:15:23.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.011+0000 7fcdf9bac640 1 --2- 172.21.15.82:0/2315650025 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fcddc0a1d80 0x7fcddc0a4240 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:23.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.011+0000 7fcdf9bac640 1 --2- 172.21.15.82:0/2315650025 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcdf41073b0 0x7fcdf419ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:23.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.011+0000 7fcdf9bac640 1 --2- 172.21.15.82:0/2315650025 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcdf4104a80 0x7fcdf4197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:23.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.011+0000 7fcdf9bac640 1 --2- 172.21.15.82:0/2315650025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdf4102150 0x7fcdf4197980 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:23.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.011+0000 7fcdf9bac640 1 -- 172.21.15.82:0/2315650025 >> 172.21.15.82:0/2315650025 conn(0x7fcdf40fbb00 msgr2=0x7fcdf4102bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:23.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.011+0000 7fcdf9bac640 1 -- 172.21.15.82:0/2315650025 shutdown_connections 2024-03-04T09:15:23.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.011+0000 7fcdf9bac640 1 -- 172.21.15.82:0/2315650025 wait complete. 2024-03-04T09:15:23.019 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T09:08:36.508257+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-04T09:13:07.981726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-04T09:13:09.289799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-04T09:13:13.008516+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-04T09:15:23.020 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-04T09:15:23.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.127+0000 7f5a966a4640 1 -- 172.21.15.82:0/1423674813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a901004d0 msgr2=0x7f5a901008f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:23.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.127+0000 7f5a966a4640 1 --2- 172.21.15.82:0/1423674813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a901004d0 0x7f5a901008f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f5a80009900 tx=0x7f5a8002bc30 comp rx=0 tx=0).stop 2024-03-04T09:15:23.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.127+0000 7f5a966a4640 1 -- 172.21.15.82:0/1423674813 shutdown_connections 2024-03-04T09:15:23.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.127+0000 7f5a966a4640 1 --2- 172.21.15.82:0/1423674813 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5a90102080 0x7f5a90108910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:23.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.127+0000 7f5a966a4640 1 --2- 172.21.15.82:0/1423674813 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a901016c0 0x7f5a90101b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:23.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.127+0000 7f5a966a4640 1 --2- 172.21.15.82:0/1423674813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a901004d0 0x7f5a901008f0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:23.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.127+0000 7f5a966a4640 1 -- 172.21.15.82:0/1423674813 >> 172.21.15.82:0/1423674813 conn(0x7f5a900fba60 msgr2=0x7f5a900fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:23.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.127+0000 7f5a966a4640 1 -- 172.21.15.82:0/1423674813 shutdown_connections 2024-03-04T09:15:23.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.127+0000 7f5a966a4640 1 -- 172.21.15.82:0/1423674813 wait complete. 2024-03-04T09:15:23.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.128+0000 7f5a966a4640 1 Processor -- start 2024-03-04T09:15:23.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.128+0000 7f5a966a4640 1 -- start start 2024-03-04T09:15:23.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.128+0000 7f5a966a4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5a901004d0 0x7f5a901979b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:23.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.128+0000 7f5a966a4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a901016c0 0x7f5a90197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:23.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.128+0000 7f5a966a4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a90102080 0x7f5a9019ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:23.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.128+0000 7f5a966a4640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9010c120 con 0x7f5a901016c0 2024-03-04T09:15:23.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.128+0000 7f5a966a4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9010bfa0 con 0x7f5a90102080 2024-03-04T09:15:23.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.128+0000 7f5a966a4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9010c2a0 con 0x7f5a901004d0 2024-03-04T09:15:23.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.128+0000 7f5a8f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a901016c0 0x7f5a90197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:23.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.128+0000 7f5a8ffff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5a901004d0 0x7f5a901979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:23.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.128+0000 7f5a8f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a901016c0 0x7f5a90197ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49038/0 (socket says 172.21.15.82:49038) 2024-03-04T09:15:23.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.128+0000 7f5a94c41640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a90102080 0x7f5a9019ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:23.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.128+0000 7f5a8f7fe640 1 -- 172.21.15.82:0/2098887780 learned_addr learned my addr 172.21.15.82:0/2098887780 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:23.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.128+0000 7f5a8ffff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5a901004d0 0x7f5a901979b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.82:44198/0 (socket says 172.21.15.82:44198) 2024-03-04T09:15:23.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.129+0000 7f5a8f7fe640 1 -- 172.21.15.82:0/2098887780 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5a901004d0 msgr2=0x7f5a901979b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:23.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.129+0000 7f5a8f7fe640 1 --2- 172.21.15.82:0/2098887780 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5a901004d0 0x7f5a901979b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:23.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.129+0000 7f5a8f7fe640 1 -- 172.21.15.82:0/2098887780 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a90102080 msgr2=0x7f5a9019ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:23.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.129+0000 7f5a8f7fe640 1 --2- 172.21.15.82:0/2098887780 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a90102080 0x7f5a9019ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:23.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.129+0000 7f5a8f7fe640 1 -- 172.21.15.82:0/2098887780 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a9019f5d0 con 0x7f5a901016c0 2024-03-04T09:15:23.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.129+0000 7f5a8f7fe640 1 --2- 172.21.15.82:0/2098887780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a901016c0 0x7f5a90197ef0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f5a8400e9f0 tx=0x7f5a8400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:23.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.129+0000 7f5a8d7fa640 1 -- 172.21.15.82:0/2098887780 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8400ccc0 con 0x7f5a901016c0 2024-03-04T09:15:23.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.129+0000 7f5a966a4640 1 -- 172.21.15.82:0/2098887780 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a9019f8c0 con 0x7f5a901016c0 2024-03-04T09:15:23.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.129+0000 7f5a8d7fa640 1 -- 172.21.15.82:0/2098887780 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f5a84010900 con 0x7f5a901016c0 2024-03-04T09:15:23.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.129+0000 7f5a8d7fa640 1 -- 172.21.15.82:0/2098887780 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a840188a0 con 0x7f5a901016c0 2024-03-04T09:15:23.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.129+0000 7f5a966a4640 1 -- 172.21.15.82:0/2098887780 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a9019fe10 con 0x7f5a901016c0 2024-03-04T09:15:23.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.130+0000 7f5a966a4640 1 -- 172.21.15.82:0/2098887780 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a900683c0 con 0x7f5a901016c0 2024-03-04T09:15:23.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.131+0000 7f5a8d7fa640 1 -- 172.21.15.82:0/2098887780 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f5a84010ab0 con 0x7f5a901016c0 2024-03-04T09:15:23.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.132+0000 7f5a8d7fa640 1 --2- 172.21.15.82:0/2098887780 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f5a780a1d80 0x7f5a780a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:23.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.132+0000 7f5a8ffff640 1 --2- 172.21.15.82:0/2098887780 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f5a780a1d80 0x7f5a780a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:23.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.132+0000 7f5a8d7fa640 1 -- 172.21.15.82:0/2098887780 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9179+0+0 (secure 0 0 0) 0x7f5a840cea20 con 0x7f5a901016c0 2024-03-04T09:15:23.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.132+0000 7f5a8ffff640 1 --2- 172.21.15.82:0/2098887780 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f5a780a1d80 0x7f5a780a4240 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5a80000c00 tx=0x7f5a80005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:23.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.136+0000 7f5a8d7fa640 1 -- 172.21.15.82:0/2098887780 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f5a8409ba40 con 0x7f5a901016c0 2024-03-04T09:15:23.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.309+0000 7f5a966a4640 1 -- 172.21.15.82:0/2098887780 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5a901a0290 con 0x7f5a901016c0 2024-03-04T09:15:23.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.309+0000 7f5a8d7fa640 1 -- 172.21.15.82:0/2098887780 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5a8409b340 con 0x7f5a901016c0 2024-03-04T09:15:23.306 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-03-04T09:15:23.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.311+0000 7f5a966a4640 1 -- 172.21.15.82:0/2098887780 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f5a780a1d80 msgr2=0x7f5a780a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:23.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.311+0000 7f5a966a4640 1 --2- 172.21.15.82:0/2098887780 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f5a780a1d80 0x7f5a780a4240 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5a80000c00 tx=0x7f5a80005fd0 comp rx=0 tx=0).stop 2024-03-04T09:15:23.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.311+0000 7f5a966a4640 1 -- 172.21.15.82:0/2098887780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a901016c0 msgr2=0x7f5a90197ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:23.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.311+0000 7f5a966a4640 1 --2- 172.21.15.82:0/2098887780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a901016c0 0x7f5a90197ef0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f5a8400e9f0 tx=0x7f5a8400edf0 comp rx=0 tx=0).stop 2024-03-04T09:15:23.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.312+0000 7f5a966a4640 1 -- 172.21.15.82:0/2098887780 shutdown_connections 2024-03-04T09:15:23.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.312+0000 7f5a966a4640 1 --2- 172.21.15.82:0/2098887780 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f5a780a1d80 0x7f5a780a4240 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:23.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.312+0000 7f5a966a4640 1 --2- 172.21.15.82:0/2098887780 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a90102080 0x7f5a9019ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:23.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.312+0000 7f5a966a4640 1 --2- 172.21.15.82:0/2098887780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a901016c0 0x7f5a90197ef0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:23.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.312+0000 7f5a966a4640 1 --2- 172.21.15.82:0/2098887780 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5a901004d0 0x7f5a901979b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:23.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.312+0000 7f5a966a4640 1 -- 172.21.15.82:0/2098887780 >> 172.21.15.82:0/2098887780 conn(0x7f5a900fba60 msgr2=0x7f5a900687e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:23.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.312+0000 7f5a966a4640 1 -- 172.21.15.82:0/2098887780 shutdown_connections 2024-03-04T09:15:23.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.312+0000 7f5a966a4640 1 -- 172.21.15.82:0/2098887780 wait complete. 2024-03-04T09:15:23.319 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-04T09:15:23.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.428+0000 7ff2cafe9640 1 -- 172.21.15.82:0/737727135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2c4103240 msgr2=0x7ff2c4109ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:23.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.428+0000 7ff2cafe9640 1 --2- 172.21.15.82:0/737727135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2c4103240 0x7ff2c4109ad0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc009cd0 tx=0x7ff2bc02c0f0 comp rx=0 tx=0).stop 2024-03-04T09:15:23.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.428+0000 7ff2cafe9640 1 -- 172.21.15.82:0/737727135 shutdown_connections 2024-03-04T09:15:23.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.428+0000 7ff2cafe9640 1 --2- 172.21.15.82:0/737727135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2c4103240 0x7ff2c4109ad0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:23.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.428+0000 7ff2cafe9640 1 --2- 172.21.15.82:0/737727135 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff2c4102880 0x7ff2c4102d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:23.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.428+0000 7ff2cafe9640 1 --2- 172.21.15.82:0/737727135 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2c40ff8b0 0x7ff2c40ffcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:23.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.428+0000 7ff2cafe9640 1 -- 172.21.15.82:0/737727135 >> 172.21.15.82:0/737727135 conn(0x7ff2c40fb1e0 msgr2=0x7ff2c40fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:23.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.428+0000 7ff2cafe9640 1 -- 172.21.15.82:0/737727135 shutdown_connections 2024-03-04T09:15:23.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.428+0000 7ff2cafe9640 1 -- 172.21.15.82:0/737727135 wait complete. 2024-03-04T09:15:23.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.429+0000 7ff2cafe9640 1 Processor -- start 2024-03-04T09:15:23.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.429+0000 7ff2cafe9640 1 -- start start 2024-03-04T09:15:23.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.429+0000 7ff2cafe9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2c40ff8b0 0x7ff2c41021f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:23.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.429+0000 7ff2cafe9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff2c4102880 0x7ff2c4100830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:23.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.429+0000 7ff2cafe9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2c4103240 0x7ff2c4100d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:23.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.429+0000 7ff2cafe9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c410d270 con 0x7ff2c4103240 2024-03-04T09:15:23.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.429+0000 7ff2cafe9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c410d0f0 con 0x7ff2c4102880 2024-03-04T09:15:23.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.429+0000 7ff2cafe9640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c410d3f0 con 0x7ff2c40ff8b0 2024-03-04T09:15:23.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.429+0000 7ff2c9586640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2c4103240 0x7ff2c4100d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:23.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.429+0000 7ff2c9586640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2c4103240 0x7ff2c4100d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49048/0 (socket says 172.21.15.82:49048) 2024-03-04T09:15:23.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.429+0000 7ff2c9586640 1 -- 172.21.15.82:0/2459249265 learned_addr learned my addr 172.21.15.82:0/2459249265 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:23.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.429+0000 7ff2c8d85640 1 --2- 172.21.15.82:0/2459249265 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2c40ff8b0 0x7ff2c41021f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:23.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.429+0000 7ff2c3fff640 1 --2- 172.21.15.82:0/2459249265 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff2c4102880 0x7ff2c4100830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:23.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.429+0000 7ff2c9586640 1 -- 172.21.15.82:0/2459249265 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2c40ff8b0 msgr2=0x7ff2c41021f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:23.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.429+0000 7ff2c9586640 1 --2- 172.21.15.82:0/2459249265 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2c40ff8b0 0x7ff2c41021f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:23.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.429+0000 7ff2c9586640 1 -- 172.21.15.82:0/2459249265 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff2c4102880 msgr2=0x7ff2c4100830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:23.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.429+0000 7ff2c9586640 1 --2- 172.21.15.82:0/2459249265 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff2c4102880 0x7ff2c4100830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:23.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.429+0000 7ff2c9586640 1 -- 172.21.15.82:0/2459249265 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c4101600 con 0x7ff2c4103240 2024-03-04T09:15:23.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.430+0000 7ff2c9586640 1 --2- 172.21.15.82:0/2459249265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2c4103240 0x7ff2c4100d70 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc02c630 tx=0x7ff2bc0326d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:23.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.430+0000 7ff2c1ffb640 1 -- 172.21.15.82:0/2459249265 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc039050 con 0x7ff2c4103240 2024-03-04T09:15:23.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.430+0000 7ff2cafe9640 1 -- 172.21.15.82:0/2459249265 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2c41a19a0 con 0x7ff2c4103240 2024-03-04T09:15:23.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.430+0000 7ff2c1ffb640 1 -- 172.21.15.82:0/2459249265 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7ff2bc03a040 con 0x7ff2c4103240 2024-03-04T09:15:23.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.430+0000 7ff2c1ffb640 1 -- 172.21.15.82:0/2459249265 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc0045e0 con 0x7ff2c4103240 2024-03-04T09:15:23.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.430+0000 7ff2cafe9640 1 -- 172.21.15.82:0/2459249265 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2c41a1f40 con 0x7ff2c4103240 2024-03-04T09:15:23.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.431+0000 7ff2cafe9640 1 -- 172.21.15.82:0/2459249265 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2c41089b0 con 0x7ff2c4103240 2024-03-04T09:15:23.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.432+0000 7ff2c1ffb640 1 -- 172.21.15.82:0/2459249265 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 136756+0+0 (secure 0 0 0) 0x7ff2bc034cc0 con 0x7ff2c4103240 2024-03-04T09:15:23.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.432+0000 7ff2c1ffb640 1 --2- 172.21.15.82:0/2459249265 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff2b40a1d80 0x7ff2b40a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:23.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.433+0000 7ff2c8d85640 1 --2- 172.21.15.82:0/2459249265 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff2b40a1d80 0x7ff2b40a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:23.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.433+0000 7ff2c1ffb640 1 -- 172.21.15.82:0/2459249265 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9179+0+0 (secure 0 0 0) 0x7ff2bc0f0750 con 0x7ff2c4103240 2024-03-04T09:15:23.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.433+0000 7ff2c8d85640 1 --2- 172.21.15.82:0/2459249265 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff2b40a1d80 0x7ff2b40a4240 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff2c40699c0 tx=0x7ff2b8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:23.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.437+0000 7ff2c1ffb640 1 -- 172.21.15.82:0/2459249265 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7ff2bc0bd7d0 con 0x7ff2c4103240 2024-03-04T09:15:23.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.611+0000 7ff2cafe9640 1 -- 172.21.15.82:0/2459249265 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff2c40621d0 con 0x7ff2c4103240 2024-03-04T09:15:23.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.611+0000 7ff2c1ffb640 1 -- 172.21.15.82:0/2459249265 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff2bc0bd0d0 con 0x7ff2c4103240 2024-03-04T09:15:23.608 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-03-04T09:15:23.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.613+0000 7ff2cafe9640 1 -- 172.21.15.82:0/2459249265 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff2b40a1d80 msgr2=0x7ff2b40a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:23.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.613+0000 7ff2cafe9640 1 --2- 172.21.15.82:0/2459249265 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff2b40a1d80 0x7ff2b40a4240 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff2c40699c0 tx=0x7ff2b8005f90 comp rx=0 tx=0).stop 2024-03-04T09:15:23.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.613+0000 7ff2cafe9640 1 -- 172.21.15.82:0/2459249265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2c4103240 msgr2=0x7ff2c4100d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:23.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.613+0000 7ff2cafe9640 1 --2- 172.21.15.82:0/2459249265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2c4103240 0x7ff2c4100d70 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc02c630 tx=0x7ff2bc0326d0 comp rx=0 tx=0).stop 2024-03-04T09:15:23.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.613+0000 7ff2cafe9640 1 -- 172.21.15.82:0/2459249265 shutdown_connections 2024-03-04T09:15:23.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.613+0000 7ff2cafe9640 1 --2- 172.21.15.82:0/2459249265 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ff2b40a1d80 0x7ff2b40a4240 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:23.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.613+0000 7ff2cafe9640 1 --2- 172.21.15.82:0/2459249265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2c4103240 0x7ff2c4100d70 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:23.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.613+0000 7ff2cafe9640 1 --2- 172.21.15.82:0/2459249265 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff2c4102880 0x7ff2c4100830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:23.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.613+0000 7ff2cafe9640 1 --2- 172.21.15.82:0/2459249265 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff2c40ff8b0 0x7ff2c41021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:23.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.613+0000 7ff2cafe9640 1 -- 172.21.15.82:0/2459249265 >> 172.21.15.82:0/2459249265 conn(0x7ff2c40fb1e0 msgr2=0x7ff2c4105b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:23.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.613+0000 7ff2cafe9640 1 -- 172.21.15.82:0/2459249265 shutdown_connections 2024-03-04T09:15:23.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.613+0000 7ff2cafe9640 1 -- 172.21.15.82:0/2459249265 wait complete. 2024-03-04T09:15:23.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:23 smithi082 ceph-mon[32880]: pgmap v359: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 8 op/s; 2 B/s, 1 keys/s, 1 objects/s recovering 2024-03-04T09:15:23.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:23 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/2562037277' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-04T09:15:23.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:23 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/4100414545' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:15:23.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:23 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/2315650025' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:15:23.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:23 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/2098887780' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-04T09:15:23.621 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-04T09:15:23.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:23 smithi190 ceph-mon[36341]: pgmap v359: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 8 op/s; 2 B/s, 1 keys/s, 1 objects/s recovering 2024-03-04T09:15:23.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:23 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/2562037277' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-04T09:15:23.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:23 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/4100414545' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:15:23.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:23 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/2315650025' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:15:23.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:23 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/2098887780' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-04T09:15:23.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:23 smithi102 ceph-mon[36220]: pgmap v359: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 8 op/s; 2 B/s, 1 keys/s, 1 objects/s recovering 2024-03-04T09:15:23.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:23 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/2562037277' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-04T09:15:23.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:23 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/4100414545' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:15:23.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:23 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/2315650025' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:15:23.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:23 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/2098887780' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-04T09:15:23.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.728+0000 7f6ab49d7640 1 -- 172.21.15.82:0/2894322186 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ab01004f0 msgr2=0x7f6ab0100910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:23.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.728+0000 7f6ab49d7640 1 --2- 172.21.15.82:0/2894322186 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ab01004f0 0x7f6ab0100910 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6a98009860 tx=0x7f6a9802bb70 comp rx=0 tx=0).stop 2024-03-04T09:15:23.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.728+0000 7f6ab49d7640 1 -- 172.21.15.82:0/2894322186 shutdown_connections 2024-03-04T09:15:23.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.728+0000 7f6ab49d7640 1 --2- 172.21.15.82:0/2894322186 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ab01020a0 0x7f6ab0108930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:23.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.728+0000 7f6ab49d7640 1 --2- 172.21.15.82:0/2894322186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ab01016e0 0x7f6ab0101b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:23.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.728+0000 7f6ab49d7640 1 --2- 172.21.15.82:0/2894322186 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ab01004f0 0x7f6ab0100910 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:23.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.728+0000 7f6ab49d7640 1 -- 172.21.15.82:0/2894322186 >> 172.21.15.82:0/2894322186 conn(0x7f6ab00fba80 msgr2=0x7f6ab00fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:23.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.728+0000 7f6ab49d7640 1 -- 172.21.15.82:0/2894322186 shutdown_connections 2024-03-04T09:15:23.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.728+0000 7f6ab49d7640 1 -- 172.21.15.82:0/2894322186 wait complete. 2024-03-04T09:15:23.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.729+0000 7f6ab49d7640 1 Processor -- start 2024-03-04T09:15:23.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.729+0000 7f6ab49d7640 1 -- start start 2024-03-04T09:15:23.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.729+0000 7f6ab49d7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ab01004f0 0x7f6ab0197960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:23.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.729+0000 7f6ab49d7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ab01016e0 0x7f6ab0197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:23.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.729+0000 7f6ab49d7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ab01020a0 0x7f6ab019ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:23.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.729+0000 7f6ab49d7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab010c100 con 0x7f6ab01020a0 2024-03-04T09:15:23.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.729+0000 7f6ab49d7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab010bf80 con 0x7f6ab01004f0 2024-03-04T09:15:23.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.729+0000 7f6ab49d7640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab010c280 con 0x7f6ab01016e0 2024-03-04T09:15:23.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.729+0000 7f6aaed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ab01020a0 0x7f6ab019ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:23.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.729+0000 7f6aadd9b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ab01016e0 0x7f6ab0197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:23.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.729+0000 7f6aaed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ab01020a0 0x7f6ab019ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49074/0 (socket says 172.21.15.82:49074) 2024-03-04T09:15:23.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.729+0000 7f6aaed9d640 1 -- 172.21.15.82:0/1287471498 learned_addr learned my addr 172.21.15.82:0/1287471498 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:23.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.729+0000 7f6aae59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ab01004f0 0x7f6ab0197960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:23.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.729+0000 7f6aaed9d640 1 -- 172.21.15.82:0/1287471498 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ab01016e0 msgr2=0x7f6ab0197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:23.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.729+0000 7f6aaed9d640 1 --2- 172.21.15.82:0/1287471498 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ab01016e0 0x7f6ab0197ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:23.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.729+0000 7f6aaed9d640 1 -- 172.21.15.82:0/1287471498 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ab01004f0 msgr2=0x7f6ab0197960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:23.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.729+0000 7f6aaed9d640 1 --2- 172.21.15.82:0/1287471498 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ab01004f0 0x7f6ab0197960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:23.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.729+0000 7f6aaed9d640 1 -- 172.21.15.82:0/1287471498 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab019f580 con 0x7f6ab01020a0 2024-03-04T09:15:23.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.729+0000 7f6aae59c640 1 --2- 172.21.15.82:0/1287471498 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ab01004f0 0x7f6ab0197960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:15:23.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.729+0000 7f6aadd9b640 1 --2- 172.21.15.82:0/1287471498 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ab01016e0 0x7f6ab0197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:15:23.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.730+0000 7f6aaed9d640 1 --2- 172.21.15.82:0/1287471498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ab01020a0 0x7f6ab019ef10 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f6aa800eb10 tx=0x7f6aa800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:23.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.730+0000 7f6aa77fe640 1 -- 172.21.15.82:0/1287471498 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa8004b20 con 0x7f6ab01020a0 2024-03-04T09:15:23.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.730+0000 7f6ab49d7640 1 -- 172.21.15.82:0/1287471498 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ab019f870 con 0x7f6ab01020a0 2024-03-04T09:15:23.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.730+0000 7f6aa77fe640 1 -- 172.21.15.82:0/1287471498 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f6aa8004cc0 con 0x7f6ab01020a0 2024-03-04T09:15:23.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.730+0000 7f6aa77fe640 1 -- 172.21.15.82:0/1287471498 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa8010700 con 0x7f6ab01020a0 2024-03-04T09:15:23.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.730+0000 7f6ab49d7640 1 -- 172.21.15.82:0/1287471498 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ab019fd70 con 0x7f6ab01020a0 2024-03-04T09:15:23.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.731+0000 7f6ab49d7640 1 -- 172.21.15.82:0/1287471498 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ab01a0030 con 0x7f6ab01020a0 2024-03-04T09:15:23.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.732+0000 7f6aa77fe640 1 -- 172.21.15.82:0/1287471498 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f6aa8004e70 con 0x7f6ab01020a0 2024-03-04T09:15:23.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.732+0000 7f6aa77fe640 1 --2- 172.21.15.82:0/1287471498 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f6a9c0a1d80 0x7f6a9c0a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:23.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.733+0000 7f6aae59c640 1 --2- 172.21.15.82:0/1287471498 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f6a9c0a1d80 0x7f6a9c0a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:23.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.733+0000 7f6aa77fe640 1 -- 172.21.15.82:0/1287471498 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9179+0+0 (secure 0 0 0) 0x7f6aa80ce8a0 con 0x7f6ab01020a0 2024-03-04T09:15:23.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.733+0000 7f6aae59c640 1 --2- 172.21.15.82:0/1287471498 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f6a9c0a1d80 0x7f6a9c0a4240 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6a98000c00 tx=0x7f6a98005a90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:23.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.736+0000 7f6aa77fe640 1 -- 172.21.15.82:0/1287471498 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f6aa8053280 con 0x7f6ab01020a0 2024-03-04T09:15:23.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.907+0000 7f6ab49d7640 1 -- 172.21.15.82:0/1287471498 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6ab01a0200 con 0x7f6ab01020a0 2024-03-04T09:15:23.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.908+0000 7f6aa77fe640 1 -- 172.21.15.82:0/1287471498 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6aa809b920 con 0x7f6ab01020a0 2024-03-04T09:15:23.905 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2024-03-04T09:15:23.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.910+0000 7f6ab49d7640 1 -- 172.21.15.82:0/1287471498 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f6a9c0a1d80 msgr2=0x7f6a9c0a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:23.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.910+0000 7f6ab49d7640 1 --2- 172.21.15.82:0/1287471498 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f6a9c0a1d80 0x7f6a9c0a4240 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6a98000c00 tx=0x7f6a98005a90 comp rx=0 tx=0).stop 2024-03-04T09:15:23.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.910+0000 7f6ab49d7640 1 -- 172.21.15.82:0/1287471498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ab01020a0 msgr2=0x7f6ab019ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:23.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.910+0000 7f6ab49d7640 1 --2- 172.21.15.82:0/1287471498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ab01020a0 0x7f6ab019ef10 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f6aa800eb10 tx=0x7f6aa800c2d0 comp rx=0 tx=0).stop 2024-03-04T09:15:23.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.910+0000 7f6ab49d7640 1 -- 172.21.15.82:0/1287471498 shutdown_connections 2024-03-04T09:15:23.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.910+0000 7f6ab49d7640 1 --2- 172.21.15.82:0/1287471498 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f6a9c0a1d80 0x7f6a9c0a4240 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:23.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.910+0000 7f6ab49d7640 1 --2- 172.21.15.82:0/1287471498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ab01020a0 0x7f6ab019ef10 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:23.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.910+0000 7f6ab49d7640 1 --2- 172.21.15.82:0/1287471498 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ab01016e0 0x7f6ab0197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:23.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.910+0000 7f6ab49d7640 1 --2- 172.21.15.82:0/1287471498 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ab01004f0 0x7f6ab0197960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:23.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.910+0000 7f6ab49d7640 1 -- 172.21.15.82:0/1287471498 >> 172.21.15.82:0/1287471498 conn(0x7f6ab00fba80 msgr2=0x7f6ab0069c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:23.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.910+0000 7f6ab49d7640 1 -- 172.21.15.82:0/1287471498 shutdown_connections 2024-03-04T09:15:23.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:23.910+0000 7f6ab49d7640 1 -- 172.21.15.82:0/1287471498 wait complete. 2024-03-04T09:15:23.917 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-04T09:15:24.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.025+0000 7f7e42bbd640 1 -- 172.21.15.82:0/3369086938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e3c1072b0 msgr2=0x7f7e3c109700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:24.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.025+0000 7f7e42bbd640 1 --2- 172.21.15.82:0/3369086938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e3c1072b0 0x7f7e3c109700 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7e34009ca0 tx=0x7f7e3402c0f0 comp rx=0 tx=0).stop 2024-03-04T09:15:24.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.025+0000 7f7e42bbd640 1 -- 172.21.15.82:0/3369086938 shutdown_connections 2024-03-04T09:15:24.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.025+0000 7f7e42bbd640 1 --2- 172.21.15.82:0/3369086938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e3c1072b0 0x7f7e3c109700 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:24.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.025+0000 7f7e42bbd640 1 --2- 172.21.15.82:0/3369086938 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e3c104980 0x7f7e3c106d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:24.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.025+0000 7f7e42bbd640 1 --2- 172.21.15.82:0/3369086938 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e3c102050 0x7f7e3c104440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:24.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.025+0000 7f7e42bbd640 1 -- 172.21.15.82:0/3369086938 >> 172.21.15.82:0/3369086938 conn(0x7f7e3c0fba60 msgr2=0x7f7e3c0fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:24.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.025+0000 7f7e42bbd640 1 -- 172.21.15.82:0/3369086938 shutdown_connections 2024-03-04T09:15:24.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.025+0000 7f7e42bbd640 1 -- 172.21.15.82:0/3369086938 wait complete. 2024-03-04T09:15:24.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.026+0000 7f7e42bbd640 1 Processor -- start 2024-03-04T09:15:24.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.026+0000 7f7e42bbd640 1 -- start start 2024-03-04T09:15:24.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.026+0000 7f7e42bbd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e3c102050 0x7f7e3c1978e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:24.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.026+0000 7f7e42bbd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e3c104980 0x7f7e3c197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:24.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.026+0000 7f7e42bbd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e3c1072b0 0x7f7e3c19ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:24.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.026+0000 7f7e42bbd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3c10d230 con 0x7f7e3c1072b0 2024-03-04T09:15:24.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.026+0000 7f7e42bbd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3c10d0b0 con 0x7f7e3c104980 2024-03-04T09:15:24.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.026+0000 7f7e42bbd640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3c10d3b0 con 0x7f7e3c102050 2024-03-04T09:15:24.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.026+0000 7f7e4115a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e3c1072b0 0x7f7e3c19ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:24.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.026+0000 7f7e4115a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e3c1072b0 0x7f7e3c19ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49084/0 (socket says 172.21.15.82:49084) 2024-03-04T09:15:24.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.026+0000 7f7e4115a640 1 -- 172.21.15.82:0/2723324186 learned_addr learned my addr 172.21.15.82:0/2723324186 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:24.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.026+0000 7f7e40959640 1 --2- 172.21.15.82:0/2723324186 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e3c102050 0x7f7e3c1978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:24.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.026+0000 7f7e3bfff640 1 --2- 172.21.15.82:0/2723324186 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e3c104980 0x7f7e3c197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:24.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.026+0000 7f7e4115a640 1 -- 172.21.15.82:0/2723324186 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e3c102050 msgr2=0x7f7e3c1978e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:24.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.026+0000 7f7e4115a640 1 --2- 172.21.15.82:0/2723324186 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e3c102050 0x7f7e3c1978e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:24.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.026+0000 7f7e4115a640 1 -- 172.21.15.82:0/2723324186 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e3c104980 msgr2=0x7f7e3c197e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:24.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.026+0000 7f7e4115a640 1 --2- 172.21.15.82:0/2723324186 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e3c104980 0x7f7e3c197e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:24.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.026+0000 7f7e4115a640 1 -- 172.21.15.82:0/2723324186 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e3c19f500 con 0x7f7e3c1072b0 2024-03-04T09:15:24.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.026+0000 7f7e4115a640 1 --2- 172.21.15.82:0/2723324186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e3c1072b0 0x7f7e3c19ee90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f7e3402c630 tx=0x7f7e34032980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:24.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.026+0000 7f7e39ffb640 1 -- 172.21.15.82:0/2723324186 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e34039050 con 0x7f7e3c1072b0 2024-03-04T09:15:24.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.027+0000 7f7e39ffb640 1 -- 172.21.15.82:0/2723324186 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f7e3403a040 con 0x7f7e3c1072b0 2024-03-04T09:15:24.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.027+0000 7f7e39ffb640 1 -- 172.21.15.82:0/2723324186 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e34004850 con 0x7f7e3c1072b0 2024-03-04T09:15:24.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.027+0000 7f7e42bbd640 1 -- 172.21.15.82:0/2723324186 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e3c19f790 con 0x7f7e3c1072b0 2024-03-04T09:15:24.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.027+0000 7f7e42bbd640 1 -- 172.21.15.82:0/2723324186 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e3c19fcd0 con 0x7f7e3c1072b0 2024-03-04T09:15:24.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.028+0000 7f7e42bbd640 1 -- 172.21.15.82:0/2723324186 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e3c0fd550 con 0x7f7e3c1072b0 2024-03-04T09:15:24.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.029+0000 7f7e39ffb640 1 -- 172.21.15.82:0/2723324186 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f7e34004040 con 0x7f7e3c1072b0 2024-03-04T09:15:24.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.029+0000 7f7e39ffb640 1 --2- 172.21.15.82:0/2723324186 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f7e280a1fa0 0x7f7e280a4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:24.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.029+0000 7f7e40959640 1 --2- 172.21.15.82:0/2723324186 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f7e280a1fa0 0x7f7e280a4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:24.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.029+0000 7f7e39ffb640 1 -- 172.21.15.82:0/2723324186 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9179+0+0 (secure 0 0 0) 0x7f7e340f0b50 con 0x7f7e3c1072b0 2024-03-04T09:15:24.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.030+0000 7f7e40959640 1 --2- 172.21.15.82:0/2723324186 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f7e280a1fa0 0x7f7e280a4460 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7e240095f0 tx=0x7f7e24005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:24.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.034+0000 7f7e39ffb640 1 -- 172.21.15.82:0/2723324186 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f7e34004330 con 0x7f7e3c1072b0 2024-03-04T09:15:24.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.206+0000 7f7e42bbd640 1 -- 172.21.15.82:0/2723324186 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f7e3c0621d0 con 0x7f7e3c1072b0 2024-03-04T09:15:24.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.206+0000 7f7e39ffb640 1 -- 172.21.15.82:0/2723324186 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v94) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7e340bdbd0 con 0x7f7e3c1072b0 2024-03-04T09:15:24.203 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-03-04T09:15:24.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.209+0000 7f7e42bbd640 1 -- 172.21.15.82:0/2723324186 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f7e280a1fa0 msgr2=0x7f7e280a4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:24.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.209+0000 7f7e42bbd640 1 --2- 172.21.15.82:0/2723324186 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f7e280a1fa0 0x7f7e280a4460 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7e240095f0 tx=0x7f7e24005f90 comp rx=0 tx=0).stop 2024-03-04T09:15:24.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.209+0000 7f7e42bbd640 1 -- 172.21.15.82:0/2723324186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e3c1072b0 msgr2=0x7f7e3c19ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:24.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.209+0000 7f7e42bbd640 1 --2- 172.21.15.82:0/2723324186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e3c1072b0 0x7f7e3c19ee90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f7e3402c630 tx=0x7f7e34032980 comp rx=0 tx=0).stop 2024-03-04T09:15:24.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.209+0000 7f7e42bbd640 1 -- 172.21.15.82:0/2723324186 shutdown_connections 2024-03-04T09:15:24.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.209+0000 7f7e42bbd640 1 --2- 172.21.15.82:0/2723324186 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f7e280a1fa0 0x7f7e280a4460 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:24.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.209+0000 7f7e42bbd640 1 --2- 172.21.15.82:0/2723324186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e3c1072b0 0x7f7e3c19ee90 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:24.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.209+0000 7f7e42bbd640 1 --2- 172.21.15.82:0/2723324186 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e3c104980 0x7f7e3c197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:24.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.209+0000 7f7e42bbd640 1 --2- 172.21.15.82:0/2723324186 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e3c102050 0x7f7e3c1978e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:24.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.209+0000 7f7e42bbd640 1 -- 172.21.15.82:0/2723324186 >> 172.21.15.82:0/2723324186 conn(0x7f7e3c0fba60 msgr2=0x7f7e3c1028f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:24.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.209+0000 7f7e42bbd640 1 -- 172.21.15.82:0/2723324186 shutdown_connections 2024-03-04T09:15:24.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.209+0000 7f7e42bbd640 1 -- 172.21.15.82:0/2723324186 wait complete. 2024-03-04T09:15:24.216 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T09:15:24.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.321+0000 7f91d3671640 1 -- 172.21.15.82:0/1043359768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91cc1016e0 msgr2=0x7f91cc101b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:24.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.321+0000 7f91d3671640 1 --2- 172.21.15.82:0/1043359768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91cc1016e0 0x7f91cc101b60 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f91bc009900 tx=0x7f91bc02bc30 comp rx=0 tx=0).stop 2024-03-04T09:15:24.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.321+0000 7f91d3671640 1 -- 172.21.15.82:0/1043359768 shutdown_connections 2024-03-04T09:15:24.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.321+0000 7f91d3671640 1 --2- 172.21.15.82:0/1043359768 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91cc1020a0 0x7f91cc108930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:24.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.321+0000 7f91d3671640 1 --2- 172.21.15.82:0/1043359768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91cc1016e0 0x7f91cc101b60 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:24.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.321+0000 7f91d3671640 1 --2- 172.21.15.82:0/1043359768 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91cc1004f0 0x7f91cc100910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:24.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.321+0000 7f91d3671640 1 -- 172.21.15.82:0/1043359768 >> 172.21.15.82:0/1043359768 conn(0x7f91cc0fba60 msgr2=0x7f91cc0fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:24.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.322+0000 7f91d3671640 1 -- 172.21.15.82:0/1043359768 shutdown_connections 2024-03-04T09:15:24.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.322+0000 7f91d3671640 1 -- 172.21.15.82:0/1043359768 wait complete. 2024-03-04T09:15:24.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.322+0000 7f91d3671640 1 Processor -- start 2024-03-04T09:15:24.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.322+0000 7f91d3671640 1 -- start start 2024-03-04T09:15:24.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.322+0000 7f91d3671640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91cc1004f0 0x7f91cc0692a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:24.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.322+0000 7f91d3671640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91cc1016e0 0x7f91cc19c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:24.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.322+0000 7f91d3671640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91cc1020a0 0x7f91cc19ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:24.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.322+0000 7f91d3671640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc10c150 con 0x7f91cc1020a0 2024-03-04T09:15:24.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.322+0000 7f91d3671640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc10bfd0 con 0x7f91cc1004f0 2024-03-04T09:15:24.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.322+0000 7f91d3671640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc10c2d0 con 0x7f91cc1016e0 2024-03-04T09:15:24.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.322+0000 7f91d1c0e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91cc1020a0 0x7f91cc19ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:24.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.322+0000 7f91d1c0e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91cc1020a0 0x7f91cc19ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49094/0 (socket says 172.21.15.82:49094) 2024-03-04T09:15:24.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.322+0000 7f91d140d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91cc1004f0 0x7f91cc0692a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:24.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.322+0000 7f91d1c0e640 1 -- 172.21.15.82:0/855040279 learned_addr learned my addr 172.21.15.82:0/855040279 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:24.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.322+0000 7f91d0c0c640 1 --2- 172.21.15.82:0/855040279 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91cc1016e0 0x7f91cc19c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:24.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.323+0000 7f91d1c0e640 1 -- 172.21.15.82:0/855040279 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91cc1016e0 msgr2=0x7f91cc19c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:24.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.323+0000 7f91d1c0e640 1 --2- 172.21.15.82:0/855040279 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91cc1016e0 0x7f91cc19c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:24.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.323+0000 7f91d1c0e640 1 -- 172.21.15.82:0/855040279 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91cc1004f0 msgr2=0x7f91cc0692a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:24.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.323+0000 7f91d1c0e640 1 --2- 172.21.15.82:0/855040279 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91cc1004f0 0x7f91cc0692a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:24.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.323+0000 7f91d1c0e640 1 -- 172.21.15.82:0/855040279 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91cc19f5a0 con 0x7f91cc1020a0 2024-03-04T09:15:24.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.323+0000 7f91d140d640 1 --2- 172.21.15.82:0/855040279 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91cc1004f0 0x7f91cc0692a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:15:24.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.323+0000 7f91d1c0e640 1 --2- 172.21.15.82:0/855040279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91cc1020a0 0x7f91cc19ec90 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f91c400e9b0 tx=0x7f91c400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:24.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.323+0000 7f91c27fc640 1 -- 172.21.15.82:0/855040279 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c400cd80 con 0x7f91cc1020a0 2024-03-04T09:15:24.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.323+0000 7f91c27fc640 1 -- 172.21.15.82:0/855040279 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f91c40035f0 con 0x7f91cc1020a0 2024-03-04T09:15:24.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.323+0000 7f91d3671640 1 -- 172.21.15.82:0/855040279 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91cc19f830 con 0x7f91cc1020a0 2024-03-04T09:15:24.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.323+0000 7f91c27fc640 1 -- 172.21.15.82:0/855040279 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c4010690 con 0x7f91cc1020a0 2024-03-04T09:15:24.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.323+0000 7f91d3671640 1 -- 172.21.15.82:0/855040279 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91cc19fd00 con 0x7f91cc1020a0 2024-03-04T09:15:24.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.324+0000 7f91d3671640 1 -- 172.21.15.82:0/855040279 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91cc107890 con 0x7f91cc1020a0 2024-03-04T09:15:24.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.325+0000 7f91c27fc640 1 -- 172.21.15.82:0/855040279 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f91c40037a0 con 0x7f91cc1020a0 2024-03-04T09:15:24.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.325+0000 7f91c27fc640 1 --2- 172.21.15.82:0/855040279 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f91b80a1d80 0x7f91b80a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:24.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.326+0000 7f91d140d640 1 --2- 172.21.15.82:0/855040279 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f91b80a1d80 0x7f91b80a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:24.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.326+0000 7f91c27fc640 1 -- 172.21.15.82:0/855040279 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9179+0+0 (secure 0 0 0) 0x7f91c40ce3a0 con 0x7f91cc1020a0 2024-03-04T09:15:24.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.326+0000 7f91d140d640 1 --2- 172.21.15.82:0/855040279 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f91b80a1d80 0x7f91b80a4240 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f91cc101540 tx=0x7f91c8009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:24.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.330+0000 7f91c27fc640 1 -- 172.21.15.82:0/855040279 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f91c409b4c0 con 0x7f91cc1020a0 2024-03-04T09:15:24.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.542+0000 7f91d3671640 1 -- 172.21.15.82:0/855040279 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f91cc02d1a0 con 0x7f91cc1020a0 2024-03-04T09:15:24.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.543+0000 7f91c27fc640 1 -- 172.21.15.82:0/855040279 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11462 (secure 0 0 0) 0x7f91c409adc0 con 0x7f91cc1020a0 2024-03-04T09:15:24.540 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:15:24.541 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3123844705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3123844705},{"type":"v1","addr":"172.21.15.82:6835","nonce":3123844705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2620634252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2620634252},{"type":"v1","addr":"172.21.15.82:6837","nonce":2620634252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-04T09:13:10.076732+0000","modified":"2024-03-04T09:13:38.017758+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24476,"mds_1":24469,"mds_2":24451,"mds_3":24449,"mds_4":24439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14613":{"gid":14613,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/1240838024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1240838024},{"type":"v1","addr":"172.21.15.82:6839","nonce":1240838024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14625":{"gid":14625,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/213594267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":213594267},{"type":"v1","addr":"172.21.15.82:6841","nonce":213594267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24398":{"gid":24398,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/1142302200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":1142302200},{"type":"v1","addr":"172.21.15.102:6833","nonce":1142302200}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24403":{"gid":24403,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6833/3023382814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":3023382814},{"type":"v1","addr":"172.21.15.190:6833","nonce":3023382814}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24422":{"gid":24422,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6835/2134310473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":2134310473},{"type":"v1","addr":"172.21.15.102:6835","nonce":2134310473}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24439":{"gid":24439,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":14,"addr":"172.21.15.190:6835/3183532624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3183532624},{"type":"v1","addr":"172.21.15.190:6835","nonce":3183532624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24449":{"gid":24449,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":12,"addr":"172.21.15.102:6837/1210579527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1210579527},{"type":"v1","addr":"172.21.15.102:6837","nonce":1210579527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24451":{"gid":24451,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.190:6837/1198639527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":1198639527},{"type":"v1","addr":"172.21.15.190:6837","nonce":1198639527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.190:6839/878555510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":878555510},{"type":"v1","addr":"172.21.15.190:6839","nonce":878555510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6839/35424130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":35424130},{"type":"v1","addr":"172.21.15.102:6839","nonce":35424130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24449,24439,24451,24476,24469]},"id":1}]} 2024-03-04T09:15:24.542 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 27 2024-03-04T09:15:24.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.545+0000 7f91d3671640 1 -- 172.21.15.82:0/855040279 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f91b80a1d80 msgr2=0x7f91b80a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:24.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.545+0000 7f91d3671640 1 --2- 172.21.15.82:0/855040279 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f91b80a1d80 0x7f91b80a4240 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f91cc101540 tx=0x7f91c8009500 comp rx=0 tx=0).stop 2024-03-04T09:15:24.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.545+0000 7f91d3671640 1 -- 172.21.15.82:0/855040279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91cc1020a0 msgr2=0x7f91cc19ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:24.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.545+0000 7f91d3671640 1 --2- 172.21.15.82:0/855040279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91cc1020a0 0x7f91cc19ec90 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f91c400e9b0 tx=0x7f91c400ee70 comp rx=0 tx=0).stop 2024-03-04T09:15:24.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.545+0000 7f91d3671640 1 -- 172.21.15.82:0/855040279 shutdown_connections 2024-03-04T09:15:24.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.545+0000 7f91d3671640 1 --2- 172.21.15.82:0/855040279 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f91b80a1d80 0x7f91b80a4240 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:24.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.545+0000 7f91d3671640 1 --2- 172.21.15.82:0/855040279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91cc1020a0 0x7f91cc19ec90 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:24.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.545+0000 7f91d3671640 1 --2- 172.21.15.82:0/855040279 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91cc1016e0 0x7f91cc19c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:24.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.545+0000 7f91d3671640 1 --2- 172.21.15.82:0/855040279 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91cc1004f0 0x7f91cc0692a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:24.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.545+0000 7f91d3671640 1 -- 172.21.15.82:0/855040279 >> 172.21.15.82:0/855040279 conn(0x7f91cc0fba60 msgr2=0x7f91cc104a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:24.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.545+0000 7f91d3671640 1 -- 172.21.15.82:0/855040279 shutdown_connections 2024-03-04T09:15:24.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.545+0000 7f91d3671640 1 -- 172.21.15.82:0/855040279 wait complete. 2024-03-04T09:15:24.551 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:24 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/2459249265' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-04T09:15:24.551 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:24 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/1287471498' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-04T09:15:24.551 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:24 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/2723324186' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-04T09:15:24.553 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T09:15:24.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.659+0000 7f4da1c47640 1 -- 172.21.15.82:0/4042454825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d9c1031a0 msgr2=0x7f4d9c109a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:24.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.659+0000 7f4da1c47640 1 --2- 172.21.15.82:0/4042454825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d9c1031a0 0x7f4d9c109a30 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f4d94009ca0 tx=0x7f4d9402c0f0 comp rx=0 tx=0).stop 2024-03-04T09:15:24.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.659+0000 7f4da1c47640 1 -- 172.21.15.82:0/4042454825 shutdown_connections 2024-03-04T09:15:24.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.659+0000 7f4da1c47640 1 --2- 172.21.15.82:0/4042454825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d9c1031a0 0x7f4d9c109a30 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:24.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.659+0000 7f4da1c47640 1 --2- 172.21.15.82:0/4042454825 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d9c1027e0 0x7f4d9c102c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:24.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.659+0000 7f4da1c47640 1 --2- 172.21.15.82:0/4042454825 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4d9c1015f0 0x7f4d9c101a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:24.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.659+0000 7f4da1c47640 1 -- 172.21.15.82:0/4042454825 >> 172.21.15.82:0/4042454825 conn(0x7f4d9c0fcb80 msgr2=0x7f4d9c0fefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:24.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.659+0000 7f4da1c47640 1 -- 172.21.15.82:0/4042454825 shutdown_connections 2024-03-04T09:15:24.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.659+0000 7f4da1c47640 1 -- 172.21.15.82:0/4042454825 wait complete. 2024-03-04T09:15:24.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.660+0000 7f4da1c47640 1 Processor -- start 2024-03-04T09:15:24.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.660+0000 7f4da1c47640 1 -- start start 2024-03-04T09:15:24.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.660+0000 7f4da1c47640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d9c1015f0 0x7f4d9c1978c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:24.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.660+0000 7f4da1c47640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d9c1027e0 0x7f4d9c197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:24.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.660+0000 7f4da1c47640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4d9c1031a0 0x7f4d9c19ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:24.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.660+0000 7f4da1c47640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9c10d250 con 0x7f4d9c1015f0 2024-03-04T09:15:24.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.660+0000 7f4da1c47640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9c10d0d0 con 0x7f4d9c1027e0 2024-03-04T09:15:24.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.660+0000 7f4da1c47640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9c10d3d0 con 0x7f4d9c1031a0 2024-03-04T09:15:24.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.660+0000 7f4d9b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d9c1015f0 0x7f4d9c1978c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:24.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.660+0000 7f4d9b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d9c1015f0 0x7f4d9c1978c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49118/0 (socket says 172.21.15.82:49118) 2024-03-04T09:15:24.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.660+0000 7f4d9b7fe640 1 -- 172.21.15.82:0/3083201961 learned_addr learned my addr 172.21.15.82:0/3083201961 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:24.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.660+0000 7f4d93fff640 1 --2- 172.21.15.82:0/3083201961 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d9c1027e0 0x7f4d9c197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:24.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.660+0000 7f4d9bfff640 1 --2- 172.21.15.82:0/3083201961 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4d9c1031a0 0x7f4d9c19ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:24.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.660+0000 7f4d9b7fe640 1 -- 172.21.15.82:0/3083201961 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4d9c1031a0 msgr2=0x7f4d9c19ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:24.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.660+0000 7f4d9b7fe640 1 --2- 172.21.15.82:0/3083201961 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4d9c1031a0 0x7f4d9c19ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:24.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.660+0000 7f4d9b7fe640 1 -- 172.21.15.82:0/3083201961 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d9c1027e0 msgr2=0x7f4d9c197e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:24.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.660+0000 7f4d9b7fe640 1 --2- 172.21.15.82:0/3083201961 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d9c1027e0 0x7f4d9c197e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:24.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.660+0000 7f4d9b7fe640 1 -- 172.21.15.82:0/3083201961 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d9c19f4e0 con 0x7f4d9c1015f0 2024-03-04T09:15:24.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.660+0000 7f4d9b7fe640 1 --2- 172.21.15.82:0/3083201961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d9c1015f0 0x7f4d9c1978c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c00e9c0 tx=0x7f4d8c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:24.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.660+0000 7f4d997fa640 1 -- 172.21.15.82:0/3083201961 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c00cd80 con 0x7f4d9c1015f0 2024-03-04T09:15:24.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.660+0000 7f4d997fa640 1 -- 172.21.15.82:0/3083201961 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f4d8c0035f0 con 0x7f4d9c1015f0 2024-03-04T09:15:24.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.660+0000 7f4da1c47640 1 -- 172.21.15.82:0/3083201961 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d9c19f7d0 con 0x7f4d9c1015f0 2024-03-04T09:15:24.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.660+0000 7f4d997fa640 1 -- 172.21.15.82:0/3083201961 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c010690 con 0x7f4d9c1015f0 2024-03-04T09:15:24.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.661+0000 7f4da1c47640 1 -- 172.21.15.82:0/3083201961 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d9c19fcd0 con 0x7f4d9c1015f0 2024-03-04T09:15:24.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.661+0000 7f4da1c47640 1 -- 172.21.15.82:0/3083201961 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d9c108910 con 0x7f4d9c1015f0 2024-03-04T09:15:24.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.662+0000 7f4d997fa640 1 -- 172.21.15.82:0/3083201961 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f4d8c0037a0 con 0x7f4d9c1015f0 2024-03-04T09:15:24.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.663+0000 7f4d997fa640 1 --2- 172.21.15.82:0/3083201961 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f4d880a1d80 0x7f4d880a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:24.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.663+0000 7f4d93fff640 1 --2- 172.21.15.82:0/3083201961 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f4d880a1d80 0x7f4d880a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:24.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.663+0000 7f4d997fa640 1 -- 172.21.15.82:0/3083201961 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9179+0+0 (secure 0 0 0) 0x7f4d8c0ce530 con 0x7f4d9c1015f0 2024-03-04T09:15:24.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.664+0000 7f4d93fff640 1 --2- 172.21.15.82:0/3083201961 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f4d880a1d80 0x7f4d880a4240 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4d840095f0 tx=0x7f4d84005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:24.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.668+0000 7f4d997fa640 1 -- 172.21.15.82:0/3083201961 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f4d8c09b5b0 con 0x7f4d9c1015f0 2024-03-04T09:15:24.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:24 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/2459249265' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-04T09:15:24.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:24 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/1287471498' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-04T09:15:24.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:24 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/2723324186' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-04T09:15:24.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:24 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/2459249265' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-04T09:15:24.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:24 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/1287471498' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-04T09:15:24.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:24 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/2723324186' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-04T09:15:24.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.855+0000 7f4da1c47640 1 -- 172.21.15.82:0/3083201961 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d9c0621d0 con 0x7f4d9c1015f0 2024-03-04T09:15:24.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.857+0000 7f4d997fa640 1 -- 172.21.15.82:0/3083201961 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+24760 (secure 0 0 0) 0x7f4d8c09aeb0 con 0x7f4d9c1015f0 2024-03-04T09:15:24.854 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:15:24.855 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":94,"fsid":"2e533fc8-da06-11ee-95c6-87774f69a715","created":"2024-03-04T09:05:16.488249+0000","modified":"2024-03-04T09:15:14.344362+0000","last_up_change":"2024-03-04T09:12:22.308711+0000","last_in_change":"2024-03-04T09:12:02.548212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T09:08:36.508257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T09:13:07.981726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T09:13:09.289799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-04T09:13:13.008516+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"085b5c4b-ede9-4d0d-b994-50c89d991012","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6803","nonce":709655235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6805","nonce":709655235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6809","nonce":709655235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6807","nonce":709655235}]},"public_addr":"172.21.15.82:6803/709655235","cluster_addr":"172.21.15.82:6805/709655235","heartbeat_back_addr":"172.21.15.82:6809/709655235","heartbeat_front_addr":"172.21.15.82:6807/709655235","state":["exists","up"]},{"osd":1,"uuid":"e4dd7079-333e-4bcf-b3af-11fb082a5af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6801","nonce":270721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6803","nonce":270721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6807","nonce":270721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6805","nonce":270721212}]},"public_addr":"172.21.15.102:6801/270721212","cluster_addr":"172.21.15.102:6803/270721212","heartbeat_back_addr":"172.21.15.102:6807/270721212","heartbeat_front_addr":"172.21.15.102:6805/270721212","state":["exists","up"]},{"osd":2,"uuid":"6fed5fd6-dc82-497f-9d69-c10a5e5802da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6801","nonce":946410459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6803","nonce":946410459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6807","nonce":946410459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6805","nonce":946410459}]},"public_addr":"172.21.15.190:6801/946410459","cluster_addr":"172.21.15.190:6803/946410459","heartbeat_back_addr":"172.21.15.190:6807/946410459","heartbeat_front_addr":"172.21.15.190:6805/946410459","state":["exists","up"]},{"osd":3,"uuid":"91ccbdc3-3da6-4d39-8a89-3a7b7bb4adc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6811","nonce":980870924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6813","nonce":980870924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6817","nonce":980870924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6815","nonce":980870924}]},"public_addr":"172.21.15.82:6811/980870924","cluster_addr":"172.21.15.82:6813/980870924","heartbeat_back_addr":"172.21.15.82:6817/980870924","heartbeat_front_addr":"172.21.15.82:6815/980870924","state":["exists","up"]},{"osd":4,"uuid":"dbb9d486-5daa-4819-bbed-04fc76ca473e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6809","nonce":1229627753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6811","nonce":1229627753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6815","nonce":1229627753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6813","nonce":1229627753}]},"public_addr":"172.21.15.102:6809/1229627753","cluster_addr":"172.21.15.102:6811/1229627753","heartbeat_back_addr":"172.21.15.102:6815/1229627753","heartbeat_front_addr":"172.21.15.102:6813/1229627753","state":["exists","up"]},{"osd":5,"uuid":"6b50127b-df2b-4c95-8e53-9d42b40273fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6809","nonce":2171194148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6811","nonce":2171194148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6815","nonce":2171194148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6813","nonce":2171194148}]},"public_addr":"172.21.15.190:6809/2171194148","cluster_addr":"172.21.15.190:6811/2171194148","heartbeat_back_addr":"172.21.15.190:6815/2171194148","heartbeat_front_addr":"172.21.15.190:6813/2171194148","state":["exists","up"]},{"osd":6,"uuid":"e72bebb0-5939-4210-950a-41c25c23c62f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6819","nonce":454436959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6821","nonce":454436959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6825","nonce":454436959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6823","nonce":454436959}]},"public_addr":"172.21.15.82:6819/454436959","cluster_addr":"172.21.15.82:6821/454436959","heartbeat_back_addr":"172.21.15.82:6825/454436959","heartbeat_front_addr":"172.21.15.82:6823/454436959","state":["exists","up"]},{"osd":7,"uuid":"72f83f97-f496-4503-8284-6a7b8f99a6f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6817","nonce":2745057274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6819","nonce":2745057274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6823","nonce":2745057274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6821","nonce":2745057274}]},"public_addr":"172.21.15.102:6817/2745057274","cluster_addr":"172.21.15.102:6819/2745057274","heartbeat_back_addr":"172.21.15.102:6823/2745057274","heartbeat_front_addr":"172.21.15.102:6821/2745057274","state":["exists","up"]},{"osd":8,"uuid":"92c9109d-6ebb-4c50-9944-28cd7b2f9c0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6817","nonce":1679683516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6819","nonce":1679683516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6823","nonce":1679683516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6821","nonce":1679683516}]},"public_addr":"172.21.15.190:6817/1679683516","cluster_addr":"172.21.15.190:6819/1679683516","heartbeat_back_addr":"172.21.15.190:6823/1679683516","heartbeat_front_addr":"172.21.15.190:6821/1679683516","state":["exists","up"]},{"osd":9,"uuid":"a3cfce03-0148-475d-bf55-b8284ae1cad2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6827","nonce":1777272933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6829","nonce":1777272933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6833","nonce":1777272933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6831","nonce":1777272933}]},"public_addr":"172.21.15.82:6827/1777272933","cluster_addr":"172.21.15.82:6829/1777272933","heartbeat_back_addr":"172.21.15.82:6833/1777272933","heartbeat_front_addr":"172.21.15.82:6831/1777272933","state":["exists","up"]},{"osd":10,"uuid":"db156ccf-4396-43cb-b69a-bb9095b94b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6825","nonce":1012784035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6827","nonce":1012784035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6831","nonce":1012784035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6829","nonce":1012784035}]},"public_addr":"172.21.15.102:6825/1012784035","cluster_addr":"172.21.15.102:6827/1012784035","heartbeat_back_addr":"172.21.15.102:6831/1012784035","heartbeat_front_addr":"172.21.15.102:6829/1012784035","state":["exists","up"]},{"osd":11,"uuid":"b4d52576-f5b4-479f-8ff6-8fdba4635ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6825","nonce":144700355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6827","nonce":144700355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6831","nonce":144700355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6829","nonce":144700355}]},"public_addr":"172.21.15.190:6825/144700355","cluster_addr":"172.21.15.190:6827/144700355","heartbeat_back_addr":"172.21.15.190:6831/144700355","heartbeat_front_addr":"172.21.15.190:6829/144700355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:07:47.007772+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:09.944738+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:33.183567+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:58.302023+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:09:23.042488+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:09:47.616009+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:10:13.122887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:10:38.584530+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:03.473453+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:29.847105+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:55.152195+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:12:20.401765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6800/1901539016":"2024-03-05T09:06:12.169231+0000","172.21.15.82:0/1124105204":"2024-03-05T09:06:12.169231+0000","172.21.15.82:6801/1901539016":"2024-03-05T09:06:12.169231+0000","172.21.15.82:0/735262841":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/2402774828":"2024-03-05T09:05:44.913099+0000","172.21.15.82:6801/3291527077":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/1846720385":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/3757201752":"2024-03-05T09:06:12.169231+0000","172.21.15.82:6800/3291527077":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/984630078":"2024-03-05T09:06:12.169231+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T09:15:24.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.860+0000 7f4da1c47640 1 -- 172.21.15.82:0/3083201961 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f4d880a1d80 msgr2=0x7f4d880a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:24.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.860+0000 7f4da1c47640 1 --2- 172.21.15.82:0/3083201961 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f4d880a1d80 0x7f4d880a4240 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4d840095f0 tx=0x7f4d84005f90 comp rx=0 tx=0).stop 2024-03-04T09:15:24.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.860+0000 7f4da1c47640 1 -- 172.21.15.82:0/3083201961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d9c1015f0 msgr2=0x7f4d9c1978c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:24.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.860+0000 7f4da1c47640 1 --2- 172.21.15.82:0/3083201961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d9c1015f0 0x7f4d9c1978c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c00e9c0 tx=0x7f4d8c00ee80 comp rx=0 tx=0).stop 2024-03-04T09:15:24.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.860+0000 7f4da1c47640 1 -- 172.21.15.82:0/3083201961 shutdown_connections 2024-03-04T09:15:24.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.860+0000 7f4da1c47640 1 --2- 172.21.15.82:0/3083201961 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f4d880a1d80 0x7f4d880a4240 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:24.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.860+0000 7f4da1c47640 1 --2- 172.21.15.82:0/3083201961 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4d9c1031a0 0x7f4d9c19ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:24.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.860+0000 7f4da1c47640 1 --2- 172.21.15.82:0/3083201961 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d9c1027e0 0x7f4d9c197e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:24.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.860+0000 7f4da1c47640 1 --2- 172.21.15.82:0/3083201961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d9c1015f0 0x7f4d9c1978c0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:24.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.860+0000 7f4da1c47640 1 -- 172.21.15.82:0/3083201961 >> 172.21.15.82:0/3083201961 conn(0x7f4d9c0fcb80 msgr2=0x7f4d9c105ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:24.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.860+0000 7f4da1c47640 1 -- 172.21.15.82:0/3083201961 shutdown_connections 2024-03-04T09:15:24.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.860+0000 7f4da1c47640 1 -- 172.21.15.82:0/3083201961 wait complete. 2024-03-04T09:15:24.869 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-03-04T09:13:10.076732+0000', 'modified': '2024-03-04T09:13:38.017758+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24476, 'mds_1': 24469, 'mds_2': 24451, 'mds_3': 24449, 'mds_4': 24439}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14613': {'gid': 14613, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.82:6839/1240838024', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6838', 'nonce': 1240838024}, {'type': 'v1', 'addr': '172.21.15.82:6839', 'nonce': 1240838024}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_14625': {'gid': 14625, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.82:6841/213594267', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6840', 'nonce': 213594267}, {'type': 'v1', 'addr': '172.21.15.82:6841', 'nonce': 213594267}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24398': {'gid': 24398, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.102:6833/1142302200', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6832', 'nonce': 1142302200}, {'type': 'v1', 'addr': '172.21.15.102:6833', 'nonce': 1142302200}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24403': {'gid': 24403, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.190:6833/3023382814', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.190:6832', 'nonce': 3023382814}, {'type': 'v1', 'addr': '172.21.15.190:6833', 'nonce': 3023382814}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24422': {'gid': 24422, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.102:6835/2134310473', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6834', 'nonce': 2134310473}, {'type': 'v1', 'addr': '172.21.15.102:6835', 'nonce': 2134310473}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24439': {'gid': 24439, 'name': 'f', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.190:6835/3183532624', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.190:6834', 'nonce': 3183532624}, {'type': 'v1', 'addr': '172.21.15.190:6835', 'nonce': 3183532624}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24449': {'gid': 24449, 'name': 'h', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.102:6837/1210579527', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6836', 'nonce': 1210579527}, {'type': 'v1', 'addr': '172.21.15.102:6837', 'nonce': 1210579527}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24451': {'gid': 24451, 'name': 'c', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.190:6837/1198639527', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.190:6836', 'nonce': 1198639527}, {'type': 'v1', 'addr': '172.21.15.190:6837', 'nonce': 1198639527}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24469': {'gid': 24469, 'name': 'i', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.190:6839/878555510', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.190:6838', 'nonce': 878555510}, {'type': 'v1', 'addr': '172.21.15.190:6839', 'nonce': 878555510}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24476': {'gid': 24476, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.102:6839/35424130', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6838', 'nonce': 35424130}, {'type': 'v1', 'addr': '172.21.15.102:6839', 'nonce': 35424130}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24476, 'qdb_cluster': [24449, 24439, 24451, 24476, 24469]} 2024-03-04T09:15:24.869 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-03-04T09:15:24.870 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-03-04T09:15:24.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.976+0000 7fcfb79d7640 1 -- 172.21.15.82:0/3251895119 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcfb0104980 msgr2=0x7fcfb0106d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:24.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.976+0000 7fcfb79d7640 1 --2- 172.21.15.82:0/3251895119 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcfb0104980 0x7fcfb0106d70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0009900 tx=0x7fcfa002bc30 comp rx=0 tx=0).stop 2024-03-04T09:15:24.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.976+0000 7fcfb79d7640 1 -- 172.21.15.82:0/3251895119 shutdown_connections 2024-03-04T09:15:24.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.976+0000 7fcfb79d7640 1 --2- 172.21.15.82:0/3251895119 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcfb01072b0 0x7fcfb0109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:24.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.976+0000 7fcfb79d7640 1 --2- 172.21.15.82:0/3251895119 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcfb0104980 0x7fcfb0106d70 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:24.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.976+0000 7fcfb79d7640 1 --2- 172.21.15.82:0/3251895119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfb0102050 0x7fcfb0104440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:24.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.976+0000 7fcfb79d7640 1 -- 172.21.15.82:0/3251895119 >> 172.21.15.82:0/3251895119 conn(0x7fcfb00fba60 msgr2=0x7fcfb00fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:24.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.977+0000 7fcfb79d7640 1 -- 172.21.15.82:0/3251895119 shutdown_connections 2024-03-04T09:15:24.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.977+0000 7fcfb79d7640 1 -- 172.21.15.82:0/3251895119 wait complete. 2024-03-04T09:15:24.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.977+0000 7fcfb79d7640 1 Processor -- start 2024-03-04T09:15:24.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.977+0000 7fcfb79d7640 1 -- start start 2024-03-04T09:15:24.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.977+0000 7fcfb79d7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcfb0102050 0x7fcfb0197960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:24.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.977+0000 7fcfb79d7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfb0104980 0x7fcfb0197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:24.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.977+0000 7fcfb79d7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcfb01072b0 0x7fcfb019ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:24.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.977+0000 7fcfb79d7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb010d230 con 0x7fcfb0104980 2024-03-04T09:15:24.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.977+0000 7fcfb79d7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb010d0b0 con 0x7fcfb0102050 2024-03-04T09:15:24.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.977+0000 7fcfb79d7640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb010d3b0 con 0x7fcfb01072b0 2024-03-04T09:15:24.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.977+0000 7fcfb4f72640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfb0104980 0x7fcfb0197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:24.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.977+0000 7fcfb4f72640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfb0104980 0x7fcfb0197ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49134/0 (socket says 172.21.15.82:49134) 2024-03-04T09:15:24.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.977+0000 7fcfb4f72640 1 -- 172.21.15.82:0/1723078793 learned_addr learned my addr 172.21.15.82:0/1723078793 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:24.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.977+0000 7fcfb5f74640 1 --2- 172.21.15.82:0/1723078793 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcfb01072b0 0x7fcfb019ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:24.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.977+0000 7fcfb5773640 1 --2- 172.21.15.82:0/1723078793 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcfb0102050 0x7fcfb0197960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:24.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.978+0000 7fcfb4f72640 1 -- 172.21.15.82:0/1723078793 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcfb01072b0 msgr2=0x7fcfb019ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:24.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.978+0000 7fcfb4f72640 1 --2- 172.21.15.82:0/1723078793 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcfb01072b0 0x7fcfb019ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:24.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.978+0000 7fcfb4f72640 1 -- 172.21.15.82:0/1723078793 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcfb0102050 msgr2=0x7fcfb0197960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:24.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.978+0000 7fcfb4f72640 1 --2- 172.21.15.82:0/1723078793 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcfb0102050 0x7fcfb0197960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:24.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.978+0000 7fcfb4f72640 1 -- 172.21.15.82:0/1723078793 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb019f580 con 0x7fcfb0104980 2024-03-04T09:15:24.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.978+0000 7fcfb4f72640 1 --2- 172.21.15.82:0/1723078793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfb0104980 0x7fcfb0197ea0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0005ab0 tx=0x7fcfa0005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:24.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.978+0000 7fcfa67fc640 1 -- 172.21.15.82:0/1723078793 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa0043020 con 0x7fcfb0104980 2024-03-04T09:15:24.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.978+0000 7fcfa67fc640 1 -- 172.21.15.82:0/1723078793 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fcfa00054b0 con 0x7fcfb0104980 2024-03-04T09:15:24.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.978+0000 7fcfb79d7640 1 -- 172.21.15.82:0/1723078793 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfb019f810 con 0x7fcfb0104980 2024-03-04T09:15:24.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.978+0000 7fcfa67fc640 1 -- 172.21.15.82:0/1723078793 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa0003bb0 con 0x7fcfb0104980 2024-03-04T09:15:24.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.978+0000 7fcfb79d7640 1 -- 172.21.15.82:0/1723078793 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfb019fd60 con 0x7fcfb0104980 2024-03-04T09:15:24.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.980+0000 7fcfa67fc640 1 -- 172.21.15.82:0/1723078793 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 136756+0+0 (secure 0 0 0) 0x7fcfa0046020 con 0x7fcfb0104980 2024-03-04T09:15:24.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.981+0000 7fcfba5c0740 1 Processor -- start 2024-03-04T09:15:24.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.981+0000 7fcfba5c0740 1 -- start start 2024-03-04T09:15:24.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.981+0000 7fcfba5c0740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e12b2e37b0 0x55e12b2e3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:24.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.981+0000 7fcfa67fc640 1 --2- 172.21.15.82:0/1723078793 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fcf9c0a1d80 0x7fcf9c0a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:24.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.981+0000 7fcfba5c0740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e12b2e4980 0x55e12b2e4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:24.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.981+0000 7fcfba5c0740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e12b2e5340 0x55e12b2ebbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:24.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.981+0000 7fcfba5c0740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e12b2486b0 con 0x55e12b2e5340 2024-03-04T09:15:24.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.981+0000 7fcfba5c0740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e12b1f1a60 con 0x55e12b2e4980 2024-03-04T09:15:24.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.981+0000 7fcfba5c0740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e12b244750 con 0x55e12b2e37b0 2024-03-04T09:15:24.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.981+0000 7fcfb5773640 1 --2- 172.21.15.82:0/1723078793 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fcf9c0a1d80 0x7fcf9c0a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:24.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.981+0000 7fcfb5f74640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e12b2e5340 0x55e12b2ebbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:24.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.981+0000 7fcfb5f74640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e12b2e5340 0x55e12b2ebbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49144/0 (socket says 172.21.15.82:49144) 2024-03-04T09:15:24.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.981+0000 7fcfb5f74640 1 -- 172.21.15.82:0/1593887974 learned_addr learned my addr 172.21.15.82:0/1593887974 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:24.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.981+0000 7fcfb5f74640 1 --2- 172.21.15.82:0/1593887974 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e12b2e37b0 0x55e12b2e3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:24.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.981+0000 7fcfa67fc640 1 -- 172.21.15.82:0/1723078793 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9179+0+0 (secure 0 0 0) 0x7fcfa00efcd0 con 0x7fcfb0104980 2024-03-04T09:15:24.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.981+0000 7fcfb4f72640 1 --2- 172.21.15.82:0/1593887974 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e12b2e4980 0x55e12b2e4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:24.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.981+0000 7fcfb5f74640 1 -- 172.21.15.82:0/1593887974 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e12b2e37b0 msgr2=0x55e12b2e3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:15:24.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.981+0000 7fcfb5f74640 1 --2- 172.21.15.82:0/1593887974 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e12b2e37b0 0x55e12b2e3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:24.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.982+0000 7fcfb5f74640 1 -- 172.21.15.82:0/1593887974 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e12b2e4980 msgr2=0x55e12b2e4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:15:24.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.982+0000 7fcfb5f74640 1 --2- 172.21.15.82:0/1593887974 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e12b2e4980 0x55e12b2e4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:24.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.982+0000 7fcfb5f74640 1 -- 172.21.15.82:0/1593887974 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e12b20ff30 con 0x55e12b2e5340 2024-03-04T09:15:24.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.982+0000 7fcfb5773640 1 --2- 172.21.15.82:0/1723078793 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fcf9c0a1d80 0x7fcf9c0a4240 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fcfac005fd0 tx=0x7fcfac009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:24.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.982+0000 7fcfb5f74640 1 --2- 172.21.15.82:0/1593887974 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e12b2e5340 0x55e12b2ebbd0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fcfa80117c0 tx=0x7fcfa80097d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65ef7ab50305c820 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:24.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.982+0000 7fcf9b7fe640 1 -- 172.21.15.82:0/1593887974 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa800f7c0 con 0x55e12b2e5340 2024-03-04T09:15:24.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.982+0000 7fcf9b7fe640 1 -- 172.21.15.82:0/1593887974 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fcfa800fe30 con 0x55e12b2e5340 2024-03-04T09:15:24.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.982+0000 7fcf9b7fe640 1 -- 172.21.15.82:0/1593887974 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa801fdd0 con 0x55e12b2e5340 2024-03-04T09:15:24.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.982+0000 7fcfba5c0740 1 -- 172.21.15.82:0/1593887974 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e12b2e5340 msgr2=0x55e12b2ebbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:24.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.982+0000 7fcfba5c0740 1 --2- 172.21.15.82:0/1593887974 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e12b2e5340 0x55e12b2ebbd0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fcfa80117c0 tx=0x7fcfa80097d0 comp rx=0 tx=0).stop 2024-03-04T09:15:24.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.983+0000 7fcfba5c0740 1 -- 172.21.15.82:0/1593887974 shutdown_connections 2024-03-04T09:15:24.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.983+0000 7fcfba5c0740 1 --2- 172.21.15.82:0/1593887974 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e12b2e5340 0x55e12b2ebbd0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:24.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.983+0000 7fcfba5c0740 1 --2- 172.21.15.82:0/1593887974 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e12b2e4980 0x55e12b2e4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:24.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.983+0000 7fcfba5c0740 1 --2- 172.21.15.82:0/1593887974 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e12b2e37b0 0x55e12b2e3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:24.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.983+0000 7fcfba5c0740 1 -- 172.21.15.82:0/1593887974 >> 172.21.15.82:0/1593887974 conn(0x55e12b2deba0 msgr2=0x55e12b2defa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:24.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.983+0000 7fcfba5c0740 1 -- 172.21.15.82:0/1593887974 shutdown_connections 2024-03-04T09:15:24.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.983+0000 7fcfba5c0740 1 -- 172.21.15.82:0/1593887974 wait complete. 2024-03-04T09:15:24.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.983+0000 7fcfba5c0740 1 -- start start 2024-03-04T09:15:24.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.983+0000 7fcfba5c0740 1 Processor -- start 2024-03-04T09:15:24.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.983+0000 7fcfba5c0740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e12b2e37b0 0x55e12b2eddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:24.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.983+0000 7fcfba5c0740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e12b2e4980 0x55e12b2ee330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:24.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.983+0000 7fcfba5c0740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e12b2e5340 0x55e12b2f5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:24.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.983+0000 7fcfba5c0740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e12b2ec350 con 0x55e12b2e5340 2024-03-04T09:15:24.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.983+0000 7fcfba5c0740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e12b204ea0 con 0x55e12b2e37b0 2024-03-04T09:15:24.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.983+0000 7fcfba5c0740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e12b2ec4d0 con 0x55e12b2e4980 2024-03-04T09:15:24.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.983+0000 7fcfba5c0740 10 client.0 _ll_register_callbacks cb 0x55e12b204870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-04T09:15:24.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.983+0000 7fcfb5773640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e12b2e37b0 0x55e12b2eddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:24.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.983+0000 7fcfb5f74640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e12b2e5340 0x55e12b2f5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:24.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.983+0000 7fcfb5773640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e12b2e37b0 0x55e12b2eddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.82:34802/0 (socket says 172.21.15.82:34802) 2024-03-04T09:15:24.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.983+0000 7fcfb5773640 1 -- 172.21.15.82:0/3491482216 learned_addr learned my addr 172.21.15.82:0/3491482216 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:24.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.983+0000 7fcfb5f74640 1 --2- 172.21.15.82:0/3491482216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e12b2e5340 0x55e12b2f5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49154/0 (socket says 172.21.15.82:49154) 2024-03-04T09:15:24.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.984+0000 7fcfb4f72640 1 --2- 172.21.15.82:0/3491482216 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e12b2e4980 0x55e12b2ee330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:24.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.984+0000 7fcfb5773640 1 -- 172.21.15.82:0/3491482216 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e12b2e4980 msgr2=0x55e12b2ee330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:15:24.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.984+0000 7fcfb5773640 1 --2- 172.21.15.82:0/3491482216 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e12b2e4980 0x55e12b2ee330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:24.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.984+0000 7fcfb5773640 1 -- 172.21.15.82:0/3491482216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e12b2e5340 msgr2=0x55e12b2f5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:15:24.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.984+0000 7fcfb5773640 1 --2- 172.21.15.82:0/3491482216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e12b2e5340 0x55e12b2f5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:24.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.984+0000 7fcfb5773640 1 -- 172.21.15.82:0/3491482216 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e12b205270 con 0x55e12b2e37b0 2024-03-04T09:15:24.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.984+0000 7fcfb5f74640 1 --2- 172.21.15.82:0/3491482216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e12b2e5340 0x55e12b2f5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:15:24.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.984+0000 7fcfb5773640 1 --2- 172.21.15.82:0/3491482216 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e12b2e37b0 0x55e12b2eddf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcfac003fd0 tx=0x7fcfac004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef272017a6bf14bd server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:24.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.984+0000 7fcf98ff9640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-03-04T09:15:24.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.984+0000 7fcf98ff9640 1 -- 172.21.15.82:0/3491482216 <== mon.2 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac01d9c0 con 0x55e12b2e37b0 2024-03-04T09:15:24.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.984+0000 7fcfba5c0740 1 -- 172.21.15.82:0/3491482216 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcfa800fe30 con 0x55e12b2e37b0 2024-03-04T09:15:24.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.984+0000 7fcf98ff9640 1 -- 172.21.15.82:0/3491482216 <== mon.2 v2:172.21.15.102:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9179+0+0 (secure 0 0 0) 0x7fcfac01db60 con 0x55e12b2e37b0 2024-03-04T09:15:24.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.984+0000 7fcf98ff9640 1 -- 172.21.15.82:0/3491482216 <== mon.2 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcfac031050 con 0x55e12b2e37b0 2024-03-04T09:15:24.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.984+0000 7fcfba5c0740 10 client.25247 fetch_fsmap learned FSMap version 27 2024-03-04T09:15:24.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.984+0000 7fcfba5c0740 1 -- 172.21.15.82:0/3491482216 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55e12af5d2d0 con 0x55e12b2e37b0 2024-03-04T09:15:24.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.985+0000 7fcf98ff9640 1 -- 172.21.15.82:0/3491482216 <== mon.2 v2:172.21.15.102:3300/0 4 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fcfa800fe30 con 0x55e12b2e37b0 2024-03-04T09:15:24.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.985+0000 7fcf98ff9640 1 -- 172.21.15.82:0/3491482216 <== mon.2 v2:172.21.15.102:3300/0 5 ==== fsmap(e 27) v1 ==== 7942+0+0 (secure 0 0 0) 0x7fcfac01b540 con 0x55e12b2e37b0 2024-03-04T09:15:24.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.985+0000 7fcfba5c0740 10 client.25247 fetch_fsmap finished waiting for FSMap version 27 2024-03-04T09:15:24.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.985+0000 7fcfba5c0740 10 client.25247 resolve_mds: resolved name 'f' to daemon mds.f 2024-03-04T09:15:24.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.985+0000 7fcfba5c0740 20 client.25247 populate_metadata read hostname 'smithi082' 2024-03-04T09:15:24.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.985+0000 7fcfba5c0740 1 --2- 172.21.15.82:0/3491482216 >> [v2:172.21.15.190:6834/3183532624,v1:172.21.15.190:6835/3183532624] conn(0x55e12b2fa8d0 0x55e12b2f9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:24.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.985+0000 7fcfba5c0740 4 client.25247 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-04T09:15:24.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.985+0000 7fcfba5c0740 1 -- 172.21.15.82:0/3491482216 --> [v2:172.21.15.190:6834/3183532624,v1:172.21.15.190:6835/3183532624] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e12b255bf0 con 0x55e12b2fa8d0 2024-03-04T09:15:24.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.985+0000 7fcfb4f72640 1 --2- 172.21.15.82:0/3491482216 >> [v2:172.21.15.190:6834/3183532624,v1:172.21.15.190:6835/3183532624] conn(0x55e12b2fa8d0 0x55e12b2f9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:24.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.985+0000 7fcf98ff9640 10 client.25247 ms_handle_connect on v2:172.21.15.190:6834/3183532624 2024-03-04T09:15:24.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.985+0000 7fcfb4f72640 1 --2- 172.21.15.82:0/3491482216 >> [v2:172.21.15.190:6834/3183532624,v1:172.21.15.190:6835/3183532624] conn(0x55e12b2fa8d0 0x55e12b2f9970 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c814c191f51107ed server_cookie=71edc3af19dedab1 in_seq=0 out_seq=0 2024-03-04T09:15:24.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.986+0000 7fcf98ff9640 1 -- 172.21.15.82:0/3491482216 <== mds.4 v2:172.21.15.190:6834/3183532624 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55e12b255bf0 con 0x55e12b2fa8d0 2024-03-04T09:15:24.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.986+0000 7fcf98ff9640 10 client.25247 handle_command_reply: tid=0 2024-03-04T09:15:24.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.986+0000 7fcfba5c0740 1 client.25247 shutdown 2024-03-04T09:15:24.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.987+0000 7fcfba5c0740 1 -- 172.21.15.82:0/3491482216 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e12b2e37b0 msgr2=0x55e12b2eddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:24.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.987+0000 7fcfba5c0740 1 --2- 172.21.15.82:0/3491482216 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e12b2e37b0 0x55e12b2eddf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcfac003fd0 tx=0x7fcfac004ab0 comp rx=0 tx=0).stop 2024-03-04T09:15:24.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.987+0000 7fcfba5c0740 1 -- 172.21.15.82:0/3491482216 shutdown_connections 2024-03-04T09:15:24.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.987+0000 7fcfba5c0740 1 --2- 172.21.15.82:0/3491482216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e12b2e5340 0x55e12b2f5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:24.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.987+0000 7fcfba5c0740 1 --2- 172.21.15.82:0/3491482216 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e12b2e4980 0x55e12b2ee330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:24.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.987+0000 7fcfba5c0740 1 --2- 172.21.15.82:0/3491482216 >> [v2:172.21.15.190:6834/3183532624,v1:172.21.15.190:6835/3183532624] conn(0x55e12b2fa8d0 0x55e12b2f9970 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:24.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.987+0000 7fcfba5c0740 1 --2- 172.21.15.82:0/3491482216 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e12b2e37b0 0x55e12b2eddf0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:24.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.987+0000 7fcf98ff9640 0 client.25247 ms_handle_reset on v2:172.21.15.190:6834/3183532624 2024-03-04T09:15:24.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.987+0000 7fcfba5c0740 1 -- 172.21.15.82:0/3491482216 >> 172.21.15.82:0/3491482216 conn(0x55e12b2deba0 msgr2=0x55e12b2ddda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:24.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.987+0000 7fcfba5c0740 1 -- 172.21.15.82:0/3491482216 shutdown_connections 2024-03-04T09:15:24.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.987+0000 7fcfba5c0740 1 -- 172.21.15.82:0/3491482216 wait complete. 2024-03-04T09:15:24.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:24.987+0000 7fcfba5c0740 20 client.25247 trim_cache size 0 max 16384 2024-03-04T09:15:25.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.003+0000 7fcfba5c0740 1 Processor -- start 2024-03-04T09:15:25.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.003+0000 7fcfba5c0740 1 -- start start 2024-03-04T09:15:25.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.003+0000 7fcfba5c0740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e12b2e37b0 0x55e12b2ec870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.003+0000 7fcfba5c0740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e12b2e4980 0x55e12b2ecdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.003+0000 7fcfba5c0740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e12b2e5340 0x55e12b2f5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.003+0000 7fcfba5c0740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e12b2fa0f0 con 0x55e12b2e37b0 2024-03-04T09:15:25.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.003+0000 7fcfba5c0740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e12b2fa750 con 0x55e12b2e4980 2024-03-04T09:15:25.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.003+0000 7fcfba5c0740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e12b2fadb0 con 0x55e12b2e5340 2024-03-04T09:15:25.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.003+0000 7fcfb5773640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e12b2e37b0 0x55e12b2ec870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.003+0000 7fcfb5773640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e12b2e37b0 0x55e12b2ec870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49162/0 (socket says 172.21.15.82:49162) 2024-03-04T09:15:25.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.003+0000 7fcfb5773640 1 -- 172.21.15.82:0/2907548501 learned_addr learned my addr 172.21.15.82:0/2907548501 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:25.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.004+0000 7fcfb5f74640 1 --2- 172.21.15.82:0/2907548501 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e12b2e5340 0x55e12b2f5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.004+0000 7fcfb4f72640 1 --2- 172.21.15.82:0/2907548501 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e12b2e4980 0x55e12b2ecdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.004+0000 7fcfb5773640 1 -- 172.21.15.82:0/2907548501 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e12b2e5340 msgr2=0x55e12b2f5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:15:25.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.004+0000 7fcfb5773640 1 --2- 172.21.15.82:0/2907548501 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e12b2e5340 0x55e12b2f5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.004+0000 7fcfb5773640 1 -- 172.21.15.82:0/2907548501 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e12b2e4980 msgr2=0x55e12b2ecdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:15:25.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.004+0000 7fcfb5773640 1 --2- 172.21.15.82:0/2907548501 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e12b2e4980 0x55e12b2ecdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.004+0000 7fcfb5773640 1 -- 172.21.15.82:0/2907548501 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e12b0276b0 con 0x55e12b2e37b0 2024-03-04T09:15:25.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.004+0000 7fcfb4f72640 1 --2- 172.21.15.82:0/2907548501 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e12b2e4980 0x55e12b2ecdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T09:15:25.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.004+0000 7fcfb5773640 1 --2- 172.21.15.82:0/2907548501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e12b2e37b0 0x55e12b2ec870 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fcfac009730 tx=0x7fcfac003f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f52648097433a7 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:25.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.004+0000 7fcf9affd640 1 -- 172.21.15.82:0/2907548501 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac039020 con 0x55e12b2e37b0 2024-03-04T09:15:25.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.004+0000 7fcf9affd640 1 -- 172.21.15.82:0/2907548501 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fcfac01b620 con 0x55e12b2e37b0 2024-03-04T09:15:25.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.004+0000 7fcf9affd640 1 -- 172.21.15.82:0/2907548501 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac01d7c0 con 0x55e12b2e37b0 2024-03-04T09:15:25.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.005+0000 7fcfba5c0740 1 -- 172.21.15.82:0/2907548501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e12b2e37b0 msgr2=0x55e12b2ec870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:25.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.005+0000 7fcfba5c0740 1 --2- 172.21.15.82:0/2907548501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e12b2e37b0 0x55e12b2ec870 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fcfac009730 tx=0x7fcfac003f00 comp rx=0 tx=0).stop 2024-03-04T09:15:25.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.005+0000 7fcfba5c0740 1 -- 172.21.15.82:0/2907548501 shutdown_connections 2024-03-04T09:15:25.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.005+0000 7fcfba5c0740 1 --2- 172.21.15.82:0/2907548501 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e12b2e5340 0x55e12b2f5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.005+0000 7fcfba5c0740 1 --2- 172.21.15.82:0/2907548501 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e12b2e4980 0x55e12b2ecdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.005+0000 7fcfba5c0740 1 --2- 172.21.15.82:0/2907548501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e12b2e37b0 0x55e12b2ec870 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.005+0000 7fcfba5c0740 1 -- 172.21.15.82:0/2907548501 >> 172.21.15.82:0/2907548501 conn(0x55e12b2deba0 msgr2=0x55e12b2e7ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:25.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.005+0000 7fcfba5c0740 1 -- 172.21.15.82:0/2907548501 shutdown_connections 2024-03-04T09:15:25.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.005+0000 7fcfba5c0740 1 -- 172.21.15.82:0/2907548501 wait complete. 2024-03-04T09:15:25.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.005+0000 7fcfba5c0740 1 -- start start 2024-03-04T09:15:25.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.005+0000 7fcfba5c0740 1 Processor -- start 2024-03-04T09:15:25.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.005+0000 7fcfba5c0740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e12b2e37b0 0x55e12b2ef870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.005+0000 7fcfba5c0740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e12b2e4980 0x55e12b2efdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.005+0000 7fcfba5c0740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e12b2e5340 0x55e12b2f4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.005+0000 7fcfba5c0740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e12b2fba70 con 0x55e12b2e4980 2024-03-04T09:15:25.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.005+0000 7fcfba5c0740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e12b2fb410 con 0x55e12b2e5340 2024-03-04T09:15:25.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.005+0000 7fcfba5c0740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e12b2fc0d0 con 0x55e12b2e37b0 2024-03-04T09:15:25.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.005+0000 7fcfba5c0740 10 client.0 _ll_register_callbacks cb 0x7fcfac004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-04T09:15:25.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.005+0000 7fcfb4f72640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e12b2e4980 0x55e12b2efdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.005+0000 7fcfb4f72640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e12b2e4980 0x55e12b2efdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49170/0 (socket says 172.21.15.82:49170) 2024-03-04T09:15:25.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.005+0000 7fcfb4f72640 1 -- 172.21.15.82:0/681431740 learned_addr learned my addr 172.21.15.82:0/681431740 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:25.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.005+0000 7fcfb5f74640 1 --2- 172.21.15.82:0/681431740 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e12b2e5340 0x55e12b2f4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.005+0000 7fcfb5773640 1 --2- 172.21.15.82:0/681431740 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e12b2e37b0 0x55e12b2ef870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.006+0000 7fcfb4f72640 1 -- 172.21.15.82:0/681431740 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e12b2e37b0 msgr2=0x55e12b2ef870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:15:25.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.006+0000 7fcfb4f72640 1 --2- 172.21.15.82:0/681431740 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e12b2e37b0 0x55e12b2ef870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.006+0000 7fcfb4f72640 1 -- 172.21.15.82:0/681431740 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e12b2e5340 msgr2=0x55e12b2f4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:15:25.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.006+0000 7fcfb4f72640 1 --2- 172.21.15.82:0/681431740 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e12b2e5340 0x55e12b2f4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.006+0000 7fcfb4f72640 1 -- 172.21.15.82:0/681431740 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e12b2f5340 con 0x55e12b2e4980 2024-03-04T09:15:25.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.006+0000 7fcfb5f74640 1 --2- 172.21.15.82:0/681431740 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e12b2e5340 0x55e12b2f4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:15:25.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.006+0000 7fcfb4f72640 1 --2- 172.21.15.82:0/681431740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e12b2e4980 0x55e12b2efdb0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fcfa00b9020 tx=0x7fcfa00a7040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=366b154506d73010 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:25.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.006+0000 7fcf98ff9640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-04T09:15:25.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.006+0000 7fcf98ff9640 1 -- 172.21.15.82:0/681431740 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa00c16c0 con 0x55e12b2e4980 2024-03-04T09:15:25.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.006+0000 7fcf98ff9640 1 -- 172.21.15.82:0/681431740 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9179+0+0 (secure 0 0 0) 0x7fcfa00c19a0 con 0x55e12b2e4980 2024-03-04T09:15:25.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.006+0000 7fcfba5c0740 1 -- 172.21.15.82:0/681431740 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcfac01b620 con 0x55e12b2e4980 2024-03-04T09:15:25.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.006+0000 7fcf98ff9640 1 -- 172.21.15.82:0/681431740 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcfa00bd780 con 0x55e12b2e4980 2024-03-04T09:15:25.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.006+0000 7fcfba5c0740 10 client.15423 fetch_fsmap learned FSMap version 27 2024-03-04T09:15:25.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.006+0000 7fcfba5c0740 1 -- 172.21.15.82:0/681431740 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55e12b3566d0 con 0x55e12b2e4980 2024-03-04T09:15:25.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.006+0000 7fcf98ff9640 1 -- 172.21.15.82:0/681431740 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fcfac01b620 con 0x55e12b2e4980 2024-03-04T09:15:25.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.006+0000 7fcf98ff9640 1 -- 172.21.15.82:0/681431740 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 27) v1 ==== 7942+0+0 (secure 0 0 0) 0x7fcfa00b8cc0 con 0x55e12b2e4980 2024-03-04T09:15:25.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.006+0000 7fcfba5c0740 10 client.15423 fetch_fsmap finished waiting for FSMap version 27 2024-03-04T09:15:25.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.006+0000 7fcfba5c0740 10 client.15423 resolve_mds: resolved name 'f' to daemon mds.f 2024-03-04T09:15:25.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.006+0000 7fcfba5c0740 20 client.15423 populate_metadata read hostname 'smithi082' 2024-03-04T09:15:25.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.006+0000 7fcfba5c0740 1 --2- 172.21.15.82:0/681431740 >> [v2:172.21.15.190:6834/3183532624,v1:172.21.15.190:6835/3183532624] conn(0x55e12b35ae70 0x55e12b356a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.006+0000 7fcfba5c0740 4 client.15423 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-04T09:15:25.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.006+0000 7fcfba5c0740 1 -- 172.21.15.82:0/681431740 --> [v2:172.21.15.190:6834/3183532624,v1:172.21.15.190:6835/3183532624] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e12b24ff40 con 0x55e12b35ae70 2024-03-04T09:15:25.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.007+0000 7fcfb5773640 1 --2- 172.21.15.82:0/681431740 >> [v2:172.21.15.190:6834/3183532624,v1:172.21.15.190:6835/3183532624] conn(0x55e12b35ae70 0x55e12b356a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.007+0000 7fcf98ff9640 10 client.15423 ms_handle_connect on v2:172.21.15.190:6834/3183532624 2024-03-04T09:15:25.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.007+0000 7fcfb5773640 1 --2- 172.21.15.82:0/681431740 >> [v2:172.21.15.190:6834/3183532624,v1:172.21.15.190:6835/3183532624] conn(0x55e12b35ae70 0x55e12b356a10 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=97c8c0cc9ab2c7d9 server_cookie=9bfe71fccbe3d5b0 in_seq=0 out_seq=0 2024-03-04T09:15:25.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.007+0000 7fcf98ff9640 1 -- 172.21.15.82:0/681431740 <== mds.4 v2:172.21.15.190:6834/3183532624 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55e12b24ff40 con 0x55e12b35ae70 2024-03-04T09:15:25.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.007+0000 7fcf98ff9640 10 client.15423 handle_command_reply: tid=0 2024-03-04T09:15:25.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.007+0000 7fcfba5c0740 1 client.15423 shutdown 2024-03-04T09:15:25.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.007+0000 7fcfba5c0740 1 -- 172.21.15.82:0/681431740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e12b2e4980 msgr2=0x55e12b2efdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:25.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.007+0000 7fcfba5c0740 1 --2- 172.21.15.82:0/681431740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e12b2e4980 0x55e12b2efdb0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fcfa00b9020 tx=0x7fcfa00a7040 comp rx=0 tx=0).stop 2024-03-04T09:15:25.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.007+0000 7fcfba5c0740 1 -- 172.21.15.82:0/681431740 shutdown_connections 2024-03-04T09:15:25.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.007+0000 7fcfba5c0740 1 --2- 172.21.15.82:0/681431740 >> [v2:172.21.15.190:6834/3183532624,v1:172.21.15.190:6835/3183532624] conn(0x55e12b35ae70 0x55e12b356a10 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.007+0000 7fcfba5c0740 1 --2- 172.21.15.82:0/681431740 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e12b2e5340 0x55e12b2f4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.007+0000 7fcfba5c0740 1 --2- 172.21.15.82:0/681431740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e12b2e4980 0x55e12b2efdb0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.007+0000 7fcf98ff9640 0 client.15423 ms_handle_reset on v2:172.21.15.190:6834/3183532624 2024-03-04T09:15:25.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.007+0000 7fcfba5c0740 1 --2- 172.21.15.82:0/681431740 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e12b2e37b0 0x55e12b2ef870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.007+0000 7fcfba5c0740 1 -- 172.21.15.82:0/681431740 >> 172.21.15.82:0/681431740 conn(0x55e12b2deba0 msgr2=0x55e12b2ed9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:25.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.007+0000 7fcfba5c0740 1 -- 172.21.15.82:0/681431740 shutdown_connections 2024-03-04T09:15:25.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.007+0000 7fcfba5c0740 1 -- 172.21.15.82:0/681431740 wait complete. 2024-03-04T09:15:25.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.007+0000 7fcfba5c0740 20 client.15423 trim_cache size 0 max 16384 2024-03-04T09:15:25.012 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-04T09:15:25.012 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "2e533fc8-da06-11ee-95c6-87774f69a715", 2024-03-04T09:15:25.012 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 4, 2024-03-04T09:15:25.012 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24439, 2024-03-04T09:15:25.012 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-03-04T09:15:25.013 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-03-04T09:15:25.013 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-03-04T09:15:25.013 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 107.63232671900001, 2024-03-04T09:15:25.013 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 27, 2024-03-04T09:15:25.013 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 94, 2024-03-04T09:15:25.013 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 90, 2024-03-04T09:15:25.013 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 156.561635731 2024-03-04T09:15:25.013 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-04T09:15:25.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.008+0000 7fcfb79d7640 1 -- 172.21.15.82:0/1723078793 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fcf9c0a1d80 msgr2=0x7fcf9c0a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:25.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.008+0000 7fcfb79d7640 1 --2- 172.21.15.82:0/1723078793 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fcf9c0a1d80 0x7fcf9c0a4240 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fcfac005fd0 tx=0x7fcfac009500 comp rx=0 tx=0).stop 2024-03-04T09:15:25.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.008+0000 7fcfb79d7640 1 -- 172.21.15.82:0/1723078793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfb0104980 msgr2=0x7fcfb0197ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:25.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.008+0000 7fcfb79d7640 1 --2- 172.21.15.82:0/1723078793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfb0104980 0x7fcfb0197ea0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0005ab0 tx=0x7fcfa0005de0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.008+0000 7fcfb79d7640 1 -- 172.21.15.82:0/1723078793 shutdown_connections 2024-03-04T09:15:25.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.008+0000 7fcfb79d7640 1 --2- 172.21.15.82:0/1723078793 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fcf9c0a1d80 0x7fcf9c0a4240 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.008+0000 7fcfb79d7640 1 --2- 172.21.15.82:0/1723078793 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcfb01072b0 0x7fcfb019ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.008+0000 7fcfb79d7640 1 --2- 172.21.15.82:0/1723078793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfb0104980 0x7fcfb0197ea0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.008+0000 7fcfb79d7640 1 --2- 172.21.15.82:0/1723078793 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcfb0102050 0x7fcfb0197960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.008+0000 7fcfb79d7640 1 -- 172.21.15.82:0/1723078793 >> 172.21.15.82:0/1723078793 conn(0x7fcfb00fba60 msgr2=0x7fcfb0103ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:25.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.008+0000 7fcfb79d7640 1 -- 172.21.15.82:0/1723078793 shutdown_connections 2024-03-04T09:15:25.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.008+0000 7fcfb79d7640 1 -- 172.21.15.82:0/1723078793 wait complete. 2024-03-04T09:15:25.015 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2024-03-04T09:15:25.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.122+0000 7f766841c640 1 -- 172.21.15.82:0/2546920945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7660102080 msgr2=0x7f7660108910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:25.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.122+0000 7f766841c640 1 --2- 172.21.15.82:0/2546920945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7660102080 0x7f7660108910 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7658009ca0 tx=0x7f765802c0f0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.122+0000 7f766841c640 1 -- 172.21.15.82:0/2546920945 shutdown_connections 2024-03-04T09:15:25.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.122+0000 7f766841c640 1 --2- 172.21.15.82:0/2546920945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7660102080 0x7f7660108910 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.122+0000 7f766841c640 1 --2- 172.21.15.82:0/2546920945 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76601016c0 0x7f7660101b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.122+0000 7f766841c640 1 --2- 172.21.15.82:0/2546920945 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76601004d0 0x7f76601008f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.122+0000 7f766841c640 1 -- 172.21.15.82:0/2546920945 >> 172.21.15.82:0/2546920945 conn(0x7f76600fba40 msgr2=0x7f76600fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:25.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.122+0000 7f766841c640 1 -- 172.21.15.82:0/2546920945 shutdown_connections 2024-03-04T09:15:25.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.122+0000 7f766841c640 1 -- 172.21.15.82:0/2546920945 wait complete. 2024-03-04T09:15:25.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.122+0000 7f766841c640 1 Processor -- start 2024-03-04T09:15:25.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.123+0000 7f766841c640 1 -- start start 2024-03-04T09:15:25.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.123+0000 7f766841c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76601004d0 0x7f76601978b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.123+0000 7f766841c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76601016c0 0x7f7660197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.123+0000 7f766841c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7660102080 0x7f766019ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.123+0000 7f766841c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f766010d240 con 0x7f76601016c0 2024-03-04T09:15:25.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.123+0000 7f766841c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f766010d0c0 con 0x7f76601004d0 2024-03-04T09:15:25.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.123+0000 7f766841c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f766010d3c0 con 0x7f7660102080 2024-03-04T09:15:25.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.123+0000 7f76659b7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76601016c0 0x7f7660197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.123+0000 7f76661b8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76601004d0 0x7f76601978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.123+0000 7f76659b7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76601016c0 0x7f7660197df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49194/0 (socket says 172.21.15.82:49194) 2024-03-04T09:15:25.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.123+0000 7f76659b7640 1 -- 172.21.15.82:0/2496059652 learned_addr learned my addr 172.21.15.82:0/2496059652 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:25.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.123+0000 7f76669b9640 1 --2- 172.21.15.82:0/2496059652 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7660102080 0x7f766019ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.123+0000 7f76659b7640 1 -- 172.21.15.82:0/2496059652 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7660102080 msgr2=0x7f766019ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:25.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.123+0000 7f76659b7640 1 --2- 172.21.15.82:0/2496059652 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7660102080 0x7f766019ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.123+0000 7f76659b7640 1 -- 172.21.15.82:0/2496059652 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76601004d0 msgr2=0x7f76601978b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:25.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.123+0000 7f76659b7640 1 --2- 172.21.15.82:0/2496059652 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76601004d0 0x7f76601978b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.123+0000 7f76659b7640 1 -- 172.21.15.82:0/2496059652 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f766019f4d0 con 0x7f76601016c0 2024-03-04T09:15:25.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.123+0000 7f76661b8640 1 --2- 172.21.15.82:0/2496059652 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76601004d0 0x7f76601978b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:15:25.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.123+0000 7f76659b7640 1 --2- 172.21.15.82:0/2496059652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76601016c0 0x7f7660197df0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f765000e9f0 tx=0x7f765000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:25.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.123+0000 7f76577fe640 1 -- 172.21.15.82:0/2496059652 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765000cd80 con 0x7f76601016c0 2024-03-04T09:15:25.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.123+0000 7f76577fe640 1 -- 172.21.15.82:0/2496059652 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f76500054f0 con 0x7f76601016c0 2024-03-04T09:15:25.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.123+0000 7f76577fe640 1 -- 172.21.15.82:0/2496059652 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7650010690 con 0x7f76601016c0 2024-03-04T09:15:25.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.123+0000 7f766841c640 1 -- 172.21.15.82:0/2496059652 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f766019f7c0 con 0x7f76601016c0 2024-03-04T09:15:25.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.124+0000 7f766841c640 1 -- 172.21.15.82:0/2496059652 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f766019fcc0 con 0x7f76601016c0 2024-03-04T09:15:25.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.126+0000 7f76577fe640 1 -- 172.21.15.82:0/2496059652 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f7650004f20 con 0x7f76601016c0 2024-03-04T09:15:25.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.126+0000 7f766b009740 1 Processor -- start 2024-03-04T09:15:25.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.127+0000 7f766b009740 1 -- start start 2024-03-04T09:15:25.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.127+0000 7f766b009740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec22342bc0 0x55ec22342fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.127+0000 7f766b009740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec22343d90 0x55ec22344210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.127+0000 7f766b009740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec22344750 0x55ec2234afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.127+0000 7f766b009740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec222a36b0 con 0x55ec22343d90 2024-03-04T09:15:25.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.127+0000 7f766b009740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec2224ca60 con 0x55ec22342bc0 2024-03-04T09:15:25.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.127+0000 7f766b009740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec2229f750 con 0x55ec22344750 2024-03-04T09:15:25.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.127+0000 7f76661b8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec22343d90 0x55ec22344210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.127+0000 7f76669b9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec22342bc0 0x55ec22342fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.127+0000 7f76659b7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec22344750 0x55ec2234afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.127+0000 7f76661b8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec22343d90 0x55ec22344210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49206/0 (socket says 172.21.15.82:49206) 2024-03-04T09:15:25.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.127+0000 7f76669b9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec22342bc0 0x55ec22342fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.82:34842/0 (socket says 172.21.15.82:34842) 2024-03-04T09:15:25.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.127+0000 7f76661b8640 1 -- 172.21.15.82:0/879483024 learned_addr learned my addr 172.21.15.82:0/879483024 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:25.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.127+0000 7f76577fe640 1 --2- 172.21.15.82:0/2496059652 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f764c0a1d80 0x7f764c0a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.127+0000 7f76669b9640 1 --2- 172.21.15.82:0/2496059652 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f764c0a1d80 0x7f764c0a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.127+0000 7f76661b8640 1 -- 172.21.15.82:0/879483024 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec22344750 msgr2=0x55ec2234afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:15:25.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.127+0000 7f76661b8640 1 --2- 172.21.15.82:0/879483024 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec22344750 0x55ec2234afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.127+0000 7f76577fe640 1 -- 172.21.15.82:0/2496059652 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9179+0+0 (secure 0 0 0) 0x7f76500ce540 con 0x7f76601016c0 2024-03-04T09:15:25.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.127+0000 7f76661b8640 1 -- 172.21.15.82:0/879483024 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec22342bc0 msgr2=0x55ec22342fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:15:25.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.127+0000 7f76661b8640 1 --2- 172.21.15.82:0/879483024 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec22342bc0 0x55ec22342fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.127+0000 7f76661b8640 1 -- 172.21.15.82:0/879483024 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ec2226af30 con 0x55ec22343d90 2024-03-04T09:15:25.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.127+0000 7f76669b9640 1 --2- 172.21.15.82:0/879483024 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec22342bc0 0x55ec22342fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:15:25.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.128+0000 7f76661b8640 1 --2- 172.21.15.82:0/879483024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec22343d90 0x55ec22344210 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f765c0114c0 tx=0x7f765c011980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2cbb7d48df8393a server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:25.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.128+0000 7f76669b9640 1 --2- 172.21.15.82:0/2496059652 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f764c0a1d80 0x7f764c0a4240 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7658005e30 tx=0x7f765802c0f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:25.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.128+0000 7f7654bfe640 1 -- 172.21.15.82:0/879483024 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765c004020 con 0x55ec22343d90 2024-03-04T09:15:25.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.128+0000 7f7654bfe640 1 -- 172.21.15.82:0/879483024 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f765c0041c0 con 0x55ec22343d90 2024-03-04T09:15:25.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.128+0000 7f7654bfe640 1 -- 172.21.15.82:0/879483024 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765c00f930 con 0x55ec22343d90 2024-03-04T09:15:25.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.129+0000 7f766b009740 1 -- 172.21.15.82:0/879483024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec22343d90 msgr2=0x55ec22344210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:25.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.129+0000 7f766b009740 1 --2- 172.21.15.82:0/879483024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec22343d90 0x55ec22344210 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f765c0114c0 tx=0x7f765c011980 comp rx=0 tx=0).stop 2024-03-04T09:15:25.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.129+0000 7f766b009740 1 -- 172.21.15.82:0/879483024 shutdown_connections 2024-03-04T09:15:25.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.129+0000 7f766b009740 1 --2- 172.21.15.82:0/879483024 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec22344750 0x55ec2234afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.129+0000 7f766b009740 1 --2- 172.21.15.82:0/879483024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec22343d90 0x55ec22344210 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.129+0000 7f766b009740 1 --2- 172.21.15.82:0/879483024 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec22342bc0 0x55ec22342fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.129+0000 7f766b009740 1 -- 172.21.15.82:0/879483024 >> 172.21.15.82:0/879483024 conn(0x55ec22339ba0 msgr2=0x55ec22339fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:25.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.129+0000 7f766b009740 1 -- 172.21.15.82:0/879483024 shutdown_connections 2024-03-04T09:15:25.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.129+0000 7f766b009740 1 -- 172.21.15.82:0/879483024 wait complete. 2024-03-04T09:15:25.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.129+0000 7f766b009740 1 -- start start 2024-03-04T09:15:25.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.129+0000 7f766b009740 1 Processor -- start 2024-03-04T09:15:25.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.129+0000 7f766b009740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec22342bc0 0x55ec2234d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.129+0000 7f766b009740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec22343d90 0x55ec2234d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.129+0000 7f766b009740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec22344750 0x55ec22354640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.129+0000 7f766b009740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec2234b760 con 0x55ec22344750 2024-03-04T09:15:25.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.129+0000 7f766b009740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec2225fea0 con 0x55ec22343d90 2024-03-04T09:15:25.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.129+0000 7f766b009740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec2234b8e0 con 0x55ec22342bc0 2024-03-04T09:15:25.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.129+0000 7f766b009740 10 client.0 _ll_register_callbacks cb 0x55ec2225f870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-04T09:15:25.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.129+0000 7f76669b9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec22344750 0x55ec22354640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.129+0000 7f76669b9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec22344750 0x55ec22354640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49214/0 (socket says 172.21.15.82:49214) 2024-03-04T09:15:25.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.129+0000 7f76669b9640 1 -- 172.21.15.82:0/2487921922 learned_addr learned my addr 172.21.15.82:0/2487921922 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:25.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.129+0000 7f76661b8640 1 --2- 172.21.15.82:0/2487921922 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec22342bc0 0x55ec2234d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.129+0000 7f76659b7640 1 --2- 172.21.15.82:0/2487921922 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec22343d90 0x55ec2234d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.130+0000 7f76669b9640 1 -- 172.21.15.82:0/2487921922 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec22342bc0 msgr2=0x55ec2234d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:15:25.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.130+0000 7f76669b9640 1 --2- 172.21.15.82:0/2487921922 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec22342bc0 0x55ec2234d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.130+0000 7f76669b9640 1 -- 172.21.15.82:0/2487921922 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec22343d90 msgr2=0x55ec2234d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:15:25.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.130+0000 7f76669b9640 1 --2- 172.21.15.82:0/2487921922 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec22343d90 0x55ec2234d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.130+0000 7f76669b9640 1 -- 172.21.15.82:0/2487921922 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ec22260270 con 0x55ec22344750 2024-03-04T09:15:25.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.130+0000 7f76669b9640 1 --2- 172.21.15.82:0/2487921922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec22344750 0x55ec22354640 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7658009ca0 tx=0x7f76580095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd726b52f001e238 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:25.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.130+0000 7f7649ffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-04T09:15:25.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.130+0000 7f7649ffb640 1 -- 172.21.15.82:0/2487921922 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7658039040 con 0x55ec22344750 2024-03-04T09:15:25.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.130+0000 7f7649ffb640 1 -- 172.21.15.82:0/2487921922 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9179+0+0 (secure 0 0 0) 0x7f7658004240 con 0x55ec22344750 2024-03-04T09:15:25.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.130+0000 7f766b009740 1 -- 172.21.15.82:0/2487921922 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f765c0041c0 con 0x55ec22344750 2024-03-04T09:15:25.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.130+0000 7f7649ffb640 1 -- 172.21.15.82:0/2487921922 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f765805b050 con 0x55ec22344750 2024-03-04T09:15:25.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.130+0000 7f766b009740 10 client.15435 fetch_fsmap learned FSMap version 27 2024-03-04T09:15:25.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.130+0000 7f766b009740 1 -- 172.21.15.82:0/2487921922 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55ec21fb82d0 con 0x55ec22344750 2024-03-04T09:15:25.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.130+0000 7f7649ffb640 1 -- 172.21.15.82:0/2487921922 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f765c0041c0 con 0x55ec22344750 2024-03-04T09:15:25.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.130+0000 7f7649ffb640 1 -- 172.21.15.82:0/2487921922 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 27) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f7658034b30 con 0x55ec22344750 2024-03-04T09:15:25.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.130+0000 7f766b009740 10 client.15435 fetch_fsmap finished waiting for FSMap version 27 2024-03-04T09:15:25.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.130+0000 7f766b009740 10 client.15435 resolve_mds: resolved name 'h' to daemon mds.h 2024-03-04T09:15:25.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.130+0000 7f766b009740 20 client.15435 populate_metadata read hostname 'smithi082' 2024-03-04T09:15:25.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.131+0000 7f766b009740 1 --2- 172.21.15.82:0/2487921922 >> [v2:172.21.15.102:6836/1210579527,v1:172.21.15.102:6837/1210579527] conn(0x55ec22359d00 0x55ec22358d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.131+0000 7f766b009740 4 client.15435 mds_command: new command op to 24449 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-04T09:15:25.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.131+0000 7f766b009740 1 -- 172.21.15.82:0/2487921922 --> [v2:172.21.15.102:6836/1210579527,v1:172.21.15.102:6837/1210579527] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ec222b0bf0 con 0x55ec22359d00 2024-03-04T09:15:25.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.131+0000 7f76661b8640 1 --2- 172.21.15.82:0/2487921922 >> [v2:172.21.15.102:6836/1210579527,v1:172.21.15.102:6837/1210579527] conn(0x55ec22359d00 0x55ec22358d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.131+0000 7f7649ffb640 10 client.15435 ms_handle_connect on v2:172.21.15.102:6836/1210579527 2024-03-04T09:15:25.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.131+0000 7f76661b8640 1 --2- 172.21.15.82:0/2487921922 >> [v2:172.21.15.102:6836/1210579527,v1:172.21.15.102:6837/1210579527] conn(0x55ec22359d00 0x55ec22358d10 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ed76d79c74b32e74 server_cookie=61fc2e6adea79709 in_seq=0 out_seq=0 2024-03-04T09:15:25.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.132+0000 7f7649ffb640 1 -- 172.21.15.82:0/2487921922 <== mds.3 v2:172.21.15.102:6836/1210579527 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55ec222b0bf0 con 0x55ec22359d00 2024-03-04T09:15:25.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.132+0000 7f7649ffb640 10 client.15435 handle_command_reply: tid=0 2024-03-04T09:15:25.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.132+0000 7f766b009740 1 client.15435 shutdown 2024-03-04T09:15:25.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.132+0000 7f766b009740 1 -- 172.21.15.82:0/2487921922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec22344750 msgr2=0x55ec22354640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:25.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.132+0000 7f766b009740 1 --2- 172.21.15.82:0/2487921922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec22344750 0x55ec22354640 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7658009ca0 tx=0x7f76580095c0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.132+0000 7f766b009740 1 -- 172.21.15.82:0/2487921922 shutdown_connections 2024-03-04T09:15:25.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.132+0000 7f766b009740 1 --2- 172.21.15.82:0/2487921922 >> [v2:172.21.15.102:6836/1210579527,v1:172.21.15.102:6837/1210579527] conn(0x55ec22359d00 0x55ec22358d10 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.132+0000 7f766b009740 1 --2- 172.21.15.82:0/2487921922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec22344750 0x55ec22354640 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.132+0000 7f7649ffb640 0 client.15435 ms_handle_reset on v2:172.21.15.102:6836/1210579527 2024-03-04T09:15:25.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.132+0000 7f766b009740 1 --2- 172.21.15.82:0/2487921922 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec22343d90 0x55ec2234d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.132+0000 7f766b009740 1 --2- 172.21.15.82:0/2487921922 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec22342bc0 0x55ec2234d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.132+0000 7f766b009740 1 -- 172.21.15.82:0/2487921922 >> 172.21.15.82:0/2487921922 conn(0x55ec22339ba0 msgr2=0x55ec22338da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:25.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.132+0000 7f766b009740 1 -- 172.21.15.82:0/2487921922 shutdown_connections 2024-03-04T09:15:25.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.132+0000 7f766b009740 1 -- 172.21.15.82:0/2487921922 wait complete. 2024-03-04T09:15:25.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.132+0000 7f766b009740 20 client.15435 trim_cache size 0 max 16384 2024-03-04T09:15:25.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.149+0000 7f766b009740 1 Processor -- start 2024-03-04T09:15:25.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.149+0000 7f766b009740 1 -- start start 2024-03-04T09:15:25.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.149+0000 7f766b009740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec22342bc0 0x55ec223394d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.149+0000 7f766b009740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec22343d90 0x55ec22354560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.149+0000 7f766b009740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec22344750 0x55ec2234d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.149+0000 7f766b009740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec22359520 con 0x55ec22343d90 2024-03-04T09:15:25.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.149+0000 7f766b009740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec22359b80 con 0x55ec22344750 2024-03-04T09:15:25.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.149+0000 7f766b009740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec2235a1e0 con 0x55ec22342bc0 2024-03-04T09:15:25.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.149+0000 7f76659b7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec22343d90 0x55ec22354560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.149+0000 7f76659b7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec22343d90 0x55ec22354560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49230/0 (socket says 172.21.15.82:49230) 2024-03-04T09:15:25.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.149+0000 7f76659b7640 1 -- 172.21.15.82:0/289516223 learned_addr learned my addr 172.21.15.82:0/289516223 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:25.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.149+0000 7f76661b8640 1 --2- 172.21.15.82:0/289516223 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec22342bc0 0x55ec223394d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.149+0000 7f76669b9640 1 --2- 172.21.15.82:0/289516223 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec22344750 0x55ec2234d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.149+0000 7f76659b7640 1 -- 172.21.15.82:0/289516223 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec22342bc0 msgr2=0x55ec223394d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:15:25.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.149+0000 7f76659b7640 1 --2- 172.21.15.82:0/289516223 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec22342bc0 0x55ec223394d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.149+0000 7f76659b7640 1 -- 172.21.15.82:0/289516223 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec22344750 msgr2=0x55ec2234d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:15:25.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.149+0000 7f76659b7640 1 --2- 172.21.15.82:0/289516223 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec22344750 0x55ec2234d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.149+0000 7f76659b7640 1 -- 172.21.15.82:0/289516223 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ec220826b0 con 0x55ec22343d90 2024-03-04T09:15:25.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.149+0000 7f76659b7640 1 --2- 172.21.15.82:0/289516223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec22343d90 0x55ec22354560 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7650097890 tx=0x7f765009ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e4ba76538891da2 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:25.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.150+0000 7f764bfff640 1 -- 172.21.15.82:0/289516223 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765009aec0 con 0x55ec22343d90 2024-03-04T09:15:25.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.150+0000 7f764bfff640 1 -- 172.21.15.82:0/289516223 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f765009f010 con 0x55ec22343d90 2024-03-04T09:15:25.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.150+0000 7f764bfff640 1 -- 172.21.15.82:0/289516223 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7650097530 con 0x55ec22343d90 2024-03-04T09:15:25.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.150+0000 7f766b009740 1 -- 172.21.15.82:0/289516223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec22343d90 msgr2=0x55ec22354560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:25.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.150+0000 7f766b009740 1 --2- 172.21.15.82:0/289516223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec22343d90 0x55ec22354560 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7650097890 tx=0x7f765009ad40 comp rx=0 tx=0).stop 2024-03-04T09:15:25.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.150+0000 7f766b009740 1 -- 172.21.15.82:0/289516223 shutdown_connections 2024-03-04T09:15:25.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.150+0000 7f766b009740 1 --2- 172.21.15.82:0/289516223 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec22344750 0x55ec2234d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.150+0000 7f766b009740 1 --2- 172.21.15.82:0/289516223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec22343d90 0x55ec22354560 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.150+0000 7f766b009740 1 --2- 172.21.15.82:0/289516223 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec22342bc0 0x55ec223394d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.150+0000 7f766b009740 1 -- 172.21.15.82:0/289516223 >> 172.21.15.82:0/289516223 conn(0x55ec22339ba0 msgr2=0x55ec22339f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:25.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.150+0000 7f766b009740 1 -- 172.21.15.82:0/289516223 shutdown_connections 2024-03-04T09:15:25.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.150+0000 7f766b009740 1 -- 172.21.15.82:0/289516223 wait complete. 2024-03-04T09:15:25.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.151+0000 7f766b009740 1 -- start start 2024-03-04T09:15:25.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.151+0000 7f766b009740 1 Processor -- start 2024-03-04T09:15:25.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.151+0000 7f766b009740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec22342bc0 0x55ec22354150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.151+0000 7f766b009740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec22343d90 0x55ec22354690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.151+0000 7f766b009740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec22344750 0x55ec22350d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.151+0000 7f766b009740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec2235aea0 con 0x55ec22344750 2024-03-04T09:15:25.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.151+0000 7f766b009740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec2235a840 con 0x55ec22343d90 2024-03-04T09:15:25.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.151+0000 7f766b009740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec2235b500 con 0x55ec22342bc0 2024-03-04T09:15:25.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.151+0000 7f766b009740 10 client.0 _ll_register_callbacks cb 0x7f7658032a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-04T09:15:25.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.151+0000 7f76669b9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec22344750 0x55ec22350d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.151+0000 7f76669b9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec22344750 0x55ec22350d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49236/0 (socket says 172.21.15.82:49236) 2024-03-04T09:15:25.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.151+0000 7f76669b9640 1 -- 172.21.15.82:0/3016250025 learned_addr learned my addr 172.21.15.82:0/3016250025 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:25.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.151+0000 7f76661b8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec22342bc0 0x55ec22354150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.151+0000 7f76659b7640 1 --2- 172.21.15.82:0/3016250025 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec22343d90 0x55ec22354690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.151+0000 7f76669b9640 1 -- 172.21.15.82:0/3016250025 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec22342bc0 msgr2=0x55ec22354150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:15:25.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.151+0000 7f76669b9640 1 --2- 172.21.15.82:0/3016250025 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec22342bc0 0x55ec22354150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.151+0000 7f76669b9640 1 -- 172.21.15.82:0/3016250025 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec22343d90 msgr2=0x55ec22354690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:15:25.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.151+0000 7f76669b9640 1 --2- 172.21.15.82:0/3016250025 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec22343d90 0x55ec22354690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.151+0000 7f76669b9640 1 -- 172.21.15.82:0/3016250025 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ec22351540 con 0x55ec22344750 2024-03-04T09:15:25.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.151+0000 7f76669b9640 1 --2- 172.21.15.82:0/3016250025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec22344750 0x55ec22350d10 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f7658032500 tx=0x7f765804d6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c060dee12e11ec8 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:25.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.151+0000 7f7649ffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-04T09:15:25.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.151+0000 7f7649ffb640 1 -- 172.21.15.82:0/3016250025 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7658039040 con 0x55ec22344750 2024-03-04T09:15:25.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.152+0000 7f7649ffb640 1 -- 172.21.15.82:0/3016250025 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9179+0+0 (secure 0 0 0) 0x7f765804dcf0 con 0x55ec22344750 2024-03-04T09:15:25.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.152+0000 7f766b009740 1 -- 172.21.15.82:0/3016250025 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f765009f010 con 0x55ec22344750 2024-03-04T09:15:25.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.152+0000 7f7649ffb640 1 -- 172.21.15.82:0/3016250025 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7658032e70 con 0x55ec22344750 2024-03-04T09:15:25.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.152+0000 7f766b009740 10 client.15441 fetch_fsmap learned FSMap version 27 2024-03-04T09:15:25.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.152+0000 7f766b009740 1 -- 172.21.15.82:0/3016250025 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55ec223b5b70 con 0x55ec22344750 2024-03-04T09:15:25.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.152+0000 7f7649ffb640 1 -- 172.21.15.82:0/3016250025 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f765009f010 con 0x55ec22344750 2024-03-04T09:15:25.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.152+0000 7f7649ffb640 1 -- 172.21.15.82:0/3016250025 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 27) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f7658066020 con 0x55ec22344750 2024-03-04T09:15:25.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.152+0000 7f766b009740 10 client.15441 fetch_fsmap finished waiting for FSMap version 27 2024-03-04T09:15:25.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.152+0000 7f766b009740 10 client.15441 resolve_mds: resolved name 'h' to daemon mds.h 2024-03-04T09:15:25.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.152+0000 7f766b009740 20 client.15441 populate_metadata read hostname 'smithi082' 2024-03-04T09:15:25.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.152+0000 7f766b009740 1 --2- 172.21.15.82:0/3016250025 >> [v2:172.21.15.102:6836/1210579527,v1:172.21.15.102:6837/1210579527] conn(0x55ec223ba1e0 0x55ec223b5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.152+0000 7f766b009740 4 client.15441 mds_command: new command op to 24449 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-04T09:15:25.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.152+0000 7f766b009740 1 -- 172.21.15.82:0/3016250025 --> [v2:172.21.15.102:6836/1210579527,v1:172.21.15.102:6837/1210579527] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ec222aaf40 con 0x55ec223ba1e0 2024-03-04T09:15:25.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.152+0000 7f76661b8640 1 --2- 172.21.15.82:0/3016250025 >> [v2:172.21.15.102:6836/1210579527,v1:172.21.15.102:6837/1210579527] conn(0x55ec223ba1e0 0x55ec223b5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.153+0000 7f76661b8640 1 --2- 172.21.15.82:0/3016250025 >> [v2:172.21.15.102:6836/1210579527,v1:172.21.15.102:6837/1210579527] conn(0x55ec223ba1e0 0x55ec223b5e00 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=7395a23d7b481d15 server_cookie=57e9540fcf77dd66 in_seq=0 out_seq=0 2024-03-04T09:15:25.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.153+0000 7f7649ffb640 10 client.15441 ms_handle_connect on v2:172.21.15.102:6836/1210579527 2024-03-04T09:15:25.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.153+0000 7f7649ffb640 1 -- 172.21.15.82:0/3016250025 <== mds.3 v2:172.21.15.102:6836/1210579527 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55ec222aaf40 con 0x55ec223ba1e0 2024-03-04T09:15:25.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.153+0000 7f7649ffb640 10 client.15441 handle_command_reply: tid=0 2024-03-04T09:15:25.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.153+0000 7f766b009740 1 client.15441 shutdown 2024-03-04T09:15:25.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.153+0000 7f766b009740 1 -- 172.21.15.82:0/3016250025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec22344750 msgr2=0x55ec22350d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:25.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.153+0000 7f766b009740 1 --2- 172.21.15.82:0/3016250025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec22344750 0x55ec22350d10 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f7658032500 tx=0x7f765804d6e0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.153+0000 7f766b009740 1 -- 172.21.15.82:0/3016250025 shutdown_connections 2024-03-04T09:15:25.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.153+0000 7f766b009740 1 --2- 172.21.15.82:0/3016250025 >> [v2:172.21.15.102:6836/1210579527,v1:172.21.15.102:6837/1210579527] conn(0x55ec223ba1e0 0x55ec223b5e00 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.153+0000 7f766b009740 1 --2- 172.21.15.82:0/3016250025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec22344750 0x55ec22350d10 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.153+0000 7f7649ffb640 0 client.15441 ms_handle_reset on v2:172.21.15.102:6836/1210579527 2024-03-04T09:15:25.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.153+0000 7f766b009740 1 --2- 172.21.15.82:0/3016250025 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec22343d90 0x55ec22354690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.153+0000 7f766b009740 1 --2- 172.21.15.82:0/3016250025 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55ec22342bc0 0x55ec22354150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.153+0000 7f766b009740 1 -- 172.21.15.82:0/3016250025 >> 172.21.15.82:0/3016250025 conn(0x55ec22339ba0 msgr2=0x55ec2234d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:25.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.153+0000 7f766b009740 1 -- 172.21.15.82:0/3016250025 shutdown_connections 2024-03-04T09:15:25.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.153+0000 7f766b009740 1 -- 172.21.15.82:0/3016250025 wait complete. 2024-03-04T09:15:25.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.153+0000 7f766b009740 20 client.15441 trim_cache size 0 max 16384 2024-03-04T09:15:25.160 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-04T09:15:25.160 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "2e533fc8-da06-11ee-95c6-87774f69a715", 2024-03-04T09:15:25.160 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 3, 2024-03-04T09:15:25.160 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24449, 2024-03-04T09:15:25.160 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-03-04T09:15:25.160 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-03-04T09:15:25.161 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-03-04T09:15:25.161 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 108.78464841900001, 2024-03-04T09:15:25.161 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 27, 2024-03-04T09:15:25.161 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 94, 2024-03-04T09:15:25.161 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 90, 2024-03-04T09:15:25.161 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 151.09643126500001 2024-03-04T09:15:25.162 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-04T09:15:25.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.153+0000 7f766841c640 1 -- 172.21.15.82:0/2496059652 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f764c0a1d80 msgr2=0x7f764c0a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:25.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.153+0000 7f766841c640 1 --2- 172.21.15.82:0/2496059652 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f764c0a1d80 0x7f764c0a4240 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7658005e30 tx=0x7f765802c0f0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.153+0000 7f766841c640 1 -- 172.21.15.82:0/2496059652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76601016c0 msgr2=0x7f7660197df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:25.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.153+0000 7f766841c640 1 --2- 172.21.15.82:0/2496059652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76601016c0 0x7f7660197df0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f765000e9f0 tx=0x7f765000edf0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.154+0000 7f766841c640 1 -- 172.21.15.82:0/2496059652 shutdown_connections 2024-03-04T09:15:25.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.154+0000 7f766841c640 1 --2- 172.21.15.82:0/2496059652 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f764c0a1d80 0x7f764c0a4240 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.154+0000 7f766841c640 1 --2- 172.21.15.82:0/2496059652 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7660102080 0x7f766019ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.154+0000 7f766841c640 1 --2- 172.21.15.82:0/2496059652 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76601016c0 0x7f7660197df0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.154+0000 7f766841c640 1 --2- 172.21.15.82:0/2496059652 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76601004d0 0x7f76601978b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.154+0000 7f766841c640 1 -- 172.21.15.82:0/2496059652 >> 172.21.15.82:0/2496059652 conn(0x7f76600fba40 msgr2=0x7f7660104a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:25.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.154+0000 7f766841c640 1 -- 172.21.15.82:0/2496059652 shutdown_connections 2024-03-04T09:15:25.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.154+0000 7f766841c640 1 -- 172.21.15.82:0/2496059652 wait complete. 2024-03-04T09:15:25.165 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-03-04T09:15:25.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.272+0000 7f6debc55640 1 -- 172.21.15.82:0/2649295611 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6de4101600 msgr2=0x7f6de4101a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:25.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.272+0000 7f6debc55640 1 --2- 172.21.15.82:0/2649295611 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6de4101600 0x7f6de4101a20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc009be0 tx=0x7f6ddc02bef0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.272+0000 7f6debc55640 1 -- 172.21.15.82:0/2649295611 shutdown_connections 2024-03-04T09:15:25.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.272+0000 7f6debc55640 1 --2- 172.21.15.82:0/2649295611 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6de41031b0 0x7f6de4109a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.272+0000 7f6debc55640 1 --2- 172.21.15.82:0/2649295611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6de41027f0 0x7f6de4102c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.272+0000 7f6debc55640 1 --2- 172.21.15.82:0/2649295611 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6de4101600 0x7f6de4101a20 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.272+0000 7f6debc55640 1 -- 172.21.15.82:0/2649295611 >> 172.21.15.82:0/2649295611 conn(0x7f6de40fcb70 msgr2=0x7f6de40fefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:25.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.272+0000 7f6debc55640 1 -- 172.21.15.82:0/2649295611 shutdown_connections 2024-03-04T09:15:25.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.272+0000 7f6debc55640 1 -- 172.21.15.82:0/2649295611 wait complete. 2024-03-04T09:15:25.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.272+0000 7f6debc55640 1 Processor -- start 2024-03-04T09:15:25.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.272+0000 7f6debc55640 1 -- start start 2024-03-04T09:15:25.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.273+0000 7f6debc55640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6de4101600 0x7f6de4197940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.273+0000 7f6debc55640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6de41027f0 0x7f6de4197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.273+0000 7f6debc55640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6de41031b0 0x7f6de419eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.273+0000 7f6debc55640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de410d260 con 0x7f6de41031b0 2024-03-04T09:15:25.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.273+0000 7f6debc55640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de410d0e0 con 0x7f6de41027f0 2024-03-04T09:15:25.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.273+0000 7f6debc55640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de410d3e0 con 0x7f6de4101600 2024-03-04T09:15:25.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.273+0000 7f6dea1f2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6de41031b0 0x7f6de419eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.273+0000 7f6de99f1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6de4101600 0x7f6de4197940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.273+0000 7f6dea1f2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6de41031b0 0x7f6de419eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49244/0 (socket says 172.21.15.82:49244) 2024-03-04T09:15:25.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.273+0000 7f6dea1f2640 1 -- 172.21.15.82:0/394040046 learned_addr learned my addr 172.21.15.82:0/394040046 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:25.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.273+0000 7f6de99f1640 1 --2- 172.21.15.82:0/394040046 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6de4101600 0x7f6de4197940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.82:44424/0 (socket says 172.21.15.82:44424) 2024-03-04T09:15:25.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.273+0000 7f6de91f0640 1 --2- 172.21.15.82:0/394040046 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6de41027f0 0x7f6de4197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.273+0000 7f6dea1f2640 1 -- 172.21.15.82:0/394040046 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6de4101600 msgr2=0x7f6de4197940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:25.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.273+0000 7f6dea1f2640 1 --2- 172.21.15.82:0/394040046 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6de4101600 0x7f6de4197940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.273+0000 7f6dea1f2640 1 -- 172.21.15.82:0/394040046 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6de41027f0 msgr2=0x7f6de4197e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:25.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.273+0000 7f6dea1f2640 1 --2- 172.21.15.82:0/394040046 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6de41027f0 0x7f6de4197e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.273+0000 7f6dea1f2640 1 -- 172.21.15.82:0/394040046 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de419f560 con 0x7f6de41031b0 2024-03-04T09:15:25.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.273+0000 7f6dea1f2640 1 --2- 172.21.15.82:0/394040046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6de41031b0 0x7f6de419eef0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6dd400e970 tx=0x7f6dd400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:25.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.273+0000 7f6de2ffd640 1 -- 172.21.15.82:0/394040046 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd400ccc0 con 0x7f6de41031b0 2024-03-04T09:15:25.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.273+0000 7f6debc55640 1 -- 172.21.15.82:0/394040046 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6de419f850 con 0x7f6de41031b0 2024-03-04T09:15:25.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.273+0000 7f6de2ffd640 1 -- 172.21.15.82:0/394040046 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f6dd400ce60 con 0x7f6de41031b0 2024-03-04T09:15:25.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.273+0000 7f6de2ffd640 1 -- 172.21.15.82:0/394040046 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd4010430 con 0x7f6de41031b0 2024-03-04T09:15:25.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.273+0000 7f6debc55640 1 -- 172.21.15.82:0/394040046 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6de419fdf0 con 0x7f6de41031b0 2024-03-04T09:15:25.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.275+0000 7f6de2ffd640 1 -- 172.21.15.82:0/394040046 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f6dd4005000 con 0x7f6de41031b0 2024-03-04T09:15:25.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.276+0000 7f6dee83f740 1 Processor -- start 2024-03-04T09:15:25.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.276+0000 7f6dee83f740 1 -- start start 2024-03-04T09:15:25.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.276+0000 7f6dee83f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f8dd067b0 0x556f8dd06bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.276+0000 7f6dee83f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556f8dd07980 0x556f8dd07e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.276+0000 7f6dee83f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556f8dd08340 0x556f8dd0ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.276+0000 7f6dee83f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f8dc6b6b0 con 0x556f8dd067b0 2024-03-04T09:15:25.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.276+0000 7f6dee83f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f8dc14a60 con 0x556f8dd07980 2024-03-04T09:15:25.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.276+0000 7f6dee83f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f8dc67750 con 0x556f8dd08340 2024-03-04T09:15:25.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.276+0000 7f6de2ffd640 1 --2- 172.21.15.82:0/394040046 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f6dcc0a1d80 0x7f6dcc0a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.276+0000 7f6de91f0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f8dd067b0 0x556f8dd06bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.277+0000 7f6de91f0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f8dd067b0 0x556f8dd06bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49250/0 (socket says 172.21.15.82:49250) 2024-03-04T09:15:25.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.277+0000 7f6de91f0640 1 -- 172.21.15.82:0/3230459293 learned_addr learned my addr 172.21.15.82:0/3230459293 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:25.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.277+0000 7f6de99f1640 1 --2- 172.21.15.82:0/3230459293 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556f8dd07980 0x556f8dd07e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.277+0000 7f6dea1f2640 1 --2- 172.21.15.82:0/394040046 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f6dcc0a1d80 0x7f6dcc0a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.277+0000 7f6de91f0640 1 --2- 172.21.15.82:0/3230459293 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556f8dd08340 0x556f8dd0ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.277+0000 7f6de2ffd640 1 -- 172.21.15.82:0/394040046 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9179+0+0 (secure 0 0 0) 0x7f6dd40ce700 con 0x7f6de41031b0 2024-03-04T09:15:25.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.277+0000 7f6de99f1640 1 -- 172.21.15.82:0/3230459293 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556f8dd08340 msgr2=0x556f8dd0ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:15:25.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.277+0000 7f6de99f1640 1 --2- 172.21.15.82:0/3230459293 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556f8dd08340 0x556f8dd0ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.277+0000 7f6de99f1640 1 -- 172.21.15.82:0/3230459293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f8dd067b0 msgr2=0x556f8dd06bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:15:25.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.277+0000 7f6de99f1640 1 --2- 172.21.15.82:0/3230459293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f8dd067b0 0x556f8dd06bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.277+0000 7f6de99f1640 1 -- 172.21.15.82:0/3230459293 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556f8dc32f30 con 0x556f8dd07980 2024-03-04T09:15:25.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.277+0000 7f6de91f0640 1 --2- 172.21.15.82:0/3230459293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f8dd067b0 0x556f8dd06bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:15:25.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.277+0000 7f6dea1f2640 1 --2- 172.21.15.82:0/394040046 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f6dcc0a1d80 0x7f6dcc0a4240 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6dd40979f0 tx=0x7f6dd406d030 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:25.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.277+0000 7f6de99f1640 1 --2- 172.21.15.82:0/3230459293 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556f8dd07980 0x556f8dd07e00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc034f50 tx=0x7f6ddc009330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4459b98aabe2ce3e server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:25.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.277+0000 7f6dcbfff640 1 -- 172.21.15.82:0/3230459293 <== mon.2 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ddc043030 con 0x556f8dd07980 2024-03-04T09:15:25.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.277+0000 7f6dcbfff640 1 -- 172.21.15.82:0/3230459293 <== mon.2 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f6ddc0334e0 con 0x556f8dd07980 2024-03-04T09:15:25.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.277+0000 7f6dcbfff640 1 -- 172.21.15.82:0/3230459293 <== mon.2 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ddc003df0 con 0x556f8dd07980 2024-03-04T09:15:25.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.278+0000 7f6dee83f740 1 -- 172.21.15.82:0/3230459293 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556f8dd07980 msgr2=0x556f8dd07e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:25.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.278+0000 7f6dee83f740 1 --2- 172.21.15.82:0/3230459293 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556f8dd07980 0x556f8dd07e00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc034f50 tx=0x7f6ddc009330 comp rx=0 tx=0).stop 2024-03-04T09:15:25.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.278+0000 7f6dee83f740 1 -- 172.21.15.82:0/3230459293 shutdown_connections 2024-03-04T09:15:25.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.278+0000 7f6dee83f740 1 --2- 172.21.15.82:0/3230459293 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556f8dd08340 0x556f8dd0ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.278+0000 7f6dee83f740 1 --2- 172.21.15.82:0/3230459293 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556f8dd07980 0x556f8dd07e00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.278+0000 7f6dee83f740 1 --2- 172.21.15.82:0/3230459293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f8dd067b0 0x556f8dd06bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.278+0000 7f6dee83f740 1 -- 172.21.15.82:0/3230459293 >> 172.21.15.82:0/3230459293 conn(0x556f8dd01ba0 msgr2=0x556f8dd01fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:25.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.278+0000 7f6dee83f740 1 -- 172.21.15.82:0/3230459293 shutdown_connections 2024-03-04T09:15:25.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.278+0000 7f6dee83f740 1 -- 172.21.15.82:0/3230459293 wait complete. 2024-03-04T09:15:25.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.278+0000 7f6dee83f740 1 -- start start 2024-03-04T09:15:25.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.278+0000 7f6dee83f740 1 Processor -- start 2024-03-04T09:15:25.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.279+0000 7f6dee83f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f8dd067b0 0x556f8dd15100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.279+0000 7f6dee83f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556f8dd07980 0x556f8dd15640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.279+0000 7f6dee83f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556f8dd08340 0x556f8dd1c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.279+0000 7f6dee83f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f8dd0f2f0 con 0x556f8dd067b0 2024-03-04T09:15:25.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.279+0000 7f6dee83f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f8dc27ea0 con 0x556f8dd07980 2024-03-04T09:15:25.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.279+0000 7f6dee83f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f8dd0f470 con 0x556f8dd08340 2024-03-04T09:15:25.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.279+0000 7f6dee83f740 10 client.0 _ll_register_callbacks cb 0x556f8dc27870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-04T09:15:25.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.279+0000 7f6de91f0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f8dd067b0 0x556f8dd15100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.279+0000 7f6de91f0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f8dd067b0 0x556f8dd15100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49264/0 (socket says 172.21.15.82:49264) 2024-03-04T09:15:25.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.279+0000 7f6de91f0640 1 -- 172.21.15.82:0/1413878069 learned_addr learned my addr 172.21.15.82:0/1413878069 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:25.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.279+0000 7f6de99f1640 1 --2- 172.21.15.82:0/1413878069 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556f8dd07980 0x556f8dd15640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.279+0000 7f6de91f0640 1 --2- 172.21.15.82:0/1413878069 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556f8dd08340 0x556f8dd1c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.279+0000 7f6de91f0640 1 -- 172.21.15.82:0/1413878069 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556f8dd08340 msgr2=0x556f8dd1c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:15:25.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.279+0000 7f6de91f0640 1 --2- 172.21.15.82:0/1413878069 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556f8dd08340 0x556f8dd1c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.279+0000 7f6de91f0640 1 -- 172.21.15.82:0/1413878069 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556f8dd07980 msgr2=0x556f8dd15640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:15:25.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.279+0000 7f6de91f0640 1 --2- 172.21.15.82:0/1413878069 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556f8dd07980 0x556f8dd15640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.279+0000 7f6de91f0640 1 -- 172.21.15.82:0/1413878069 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556f8dc28270 con 0x556f8dd067b0 2024-03-04T09:15:25.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.279+0000 7f6de91f0640 1 --2- 172.21.15.82:0/1413878069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f8dd067b0 0x556f8dd15100 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8013e30 tx=0x7f6dd8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33f1ad14af6e3e01 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:25.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.279+0000 7f6dc97fa640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-04T09:15:25.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.280+0000 7f6dc97fa640 1 -- 172.21.15.82:0/1413878069 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd8005050 con 0x556f8dd067b0 2024-03-04T09:15:25.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.280+0000 7f6dee83f740 1 -- 172.21.15.82:0/1413878069 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6ddc0334e0 con 0x556f8dd067b0 2024-03-04T09:15:25.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.280+0000 7f6dc97fa640 1 -- 172.21.15.82:0/1413878069 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9179+0+0 (secure 0 0 0) 0x7f6dd80051f0 con 0x556f8dd067b0 2024-03-04T09:15:25.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.280+0000 7f6dc97fa640 1 -- 172.21.15.82:0/1413878069 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6dd8029050 con 0x556f8dd067b0 2024-03-04T09:15:25.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.280+0000 7f6dee83f740 10 client.15453 fetch_fsmap learned FSMap version 27 2024-03-04T09:15:25.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.280+0000 7f6dee83f740 1 -- 172.21.15.82:0/1413878069 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x556f8d9802d0 con 0x556f8dd067b0 2024-03-04T09:15:25.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.280+0000 7f6dc97fa640 1 -- 172.21.15.82:0/1413878069 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f6ddc0334e0 con 0x556f8dd067b0 2024-03-04T09:15:25.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.280+0000 7f6dc97fa640 1 -- 172.21.15.82:0/1413878069 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 27) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f6dd800f450 con 0x556f8dd067b0 2024-03-04T09:15:25.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.280+0000 7f6dee83f740 10 client.15453 fetch_fsmap finished waiting for FSMap version 27 2024-03-04T09:15:25.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.280+0000 7f6dee83f740 10 client.15453 resolve_mds: resolved name 'c' to daemon mds.c 2024-03-04T09:15:25.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.280+0000 7f6dee83f740 20 client.15453 populate_metadata read hostname 'smithi082' 2024-03-04T09:15:25.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.280+0000 7f6dee83f740 1 --2- 172.21.15.82:0/1413878069 >> [v2:172.21.15.190:6836/1198639527,v1:172.21.15.190:6837/1198639527] conn(0x556f8dd21c10 0x556f8dd20ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.280+0000 7f6dee83f740 4 client.15453 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-04T09:15:25.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.280+0000 7f6dee83f740 1 -- 172.21.15.82:0/1413878069 --> [v2:172.21.15.190:6836/1198639527,v1:172.21.15.190:6837/1198639527] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556f8dc78bf0 con 0x556f8dd21c10 2024-03-04T09:15:25.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.280+0000 7f6de99f1640 1 --2- 172.21.15.82:0/1413878069 >> [v2:172.21.15.190:6836/1198639527,v1:172.21.15.190:6837/1198639527] conn(0x556f8dd21c10 0x556f8dd20ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.281+0000 7f6dc97fa640 10 client.15453 ms_handle_connect on v2:172.21.15.190:6836/1198639527 2024-03-04T09:15:25.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.281+0000 7f6de99f1640 1 --2- 172.21.15.82:0/1413878069 >> [v2:172.21.15.190:6836/1198639527,v1:172.21.15.190:6837/1198639527] conn(0x556f8dd21c10 0x556f8dd20ce0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=545ce4606bb8c287 server_cookie=7b591976bfcb082b in_seq=0 out_seq=0 2024-03-04T09:15:25.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.281+0000 7f6dc97fa640 1 -- 172.21.15.82:0/1413878069 <== mds.2 v2:172.21.15.190:6836/1198639527 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x556f8dc78bf0 con 0x556f8dd21c10 2024-03-04T09:15:25.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.281+0000 7f6dc97fa640 10 client.15453 handle_command_reply: tid=0 2024-03-04T09:15:25.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.281+0000 7f6dee83f740 1 client.15453 shutdown 2024-03-04T09:15:25.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.281+0000 7f6dee83f740 1 -- 172.21.15.82:0/1413878069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f8dd067b0 msgr2=0x556f8dd15100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:25.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.281+0000 7f6dee83f740 1 --2- 172.21.15.82:0/1413878069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f8dd067b0 0x556f8dd15100 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8013e30 tx=0x7f6dd8009260 comp rx=0 tx=0).stop 2024-03-04T09:15:25.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.281+0000 7f6dee83f740 1 -- 172.21.15.82:0/1413878069 shutdown_connections 2024-03-04T09:15:25.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.282+0000 7f6dee83f740 1 --2- 172.21.15.82:0/1413878069 >> [v2:172.21.15.190:6836/1198639527,v1:172.21.15.190:6837/1198639527] conn(0x556f8dd21c10 0x556f8dd20ce0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.282+0000 7f6dee83f740 1 --2- 172.21.15.82:0/1413878069 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556f8dd08340 0x556f8dd1c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.282+0000 7f6dee83f740 1 --2- 172.21.15.82:0/1413878069 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556f8dd07980 0x556f8dd15640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.282+0000 7f6dc97fa640 0 client.15453 ms_handle_reset on v2:172.21.15.190:6836/1198639527 2024-03-04T09:15:25.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.282+0000 7f6dee83f740 1 --2- 172.21.15.82:0/1413878069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f8dd067b0 0x556f8dd15100 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.282+0000 7f6dee83f740 1 -- 172.21.15.82:0/1413878069 >> 172.21.15.82:0/1413878069 conn(0x556f8dd01ba0 msgr2=0x556f8dd00da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:25.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.282+0000 7f6dee83f740 1 -- 172.21.15.82:0/1413878069 shutdown_connections 2024-03-04T09:15:25.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.282+0000 7f6dee83f740 1 -- 172.21.15.82:0/1413878069 wait complete. 2024-03-04T09:15:25.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.282+0000 7f6dee83f740 20 client.15453 trim_cache size 0 max 16384 2024-03-04T09:15:25.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.298+0000 7f6dee83f740 1 Processor -- start 2024-03-04T09:15:25.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.298+0000 7f6dee83f740 1 -- start start 2024-03-04T09:15:25.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.298+0000 7f6dee83f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556f8dd01ba0 0x556f8dd14d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.298+0000 7f6dee83f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f8dd067b0 0x556f8dd1c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.299+0000 7f6dee83f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556f8dd07980 0x556f8dd152d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.299+0000 7f6dee83f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f8dd21430 con 0x556f8dd067b0 2024-03-04T09:15:25.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.299+0000 7f6dee83f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f8dd21a90 con 0x556f8dd07980 2024-03-04T09:15:25.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.299+0000 7f6dee83f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f8dd220f0 con 0x556f8dd01ba0 2024-03-04T09:15:25.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.299+0000 7f6de99f1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f8dd067b0 0x556f8dd1c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.299+0000 7f6de99f1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f8dd067b0 0x556f8dd1c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49270/0 (socket says 172.21.15.82:49270) 2024-03-04T09:15:25.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.299+0000 7f6de99f1640 1 -- 172.21.15.82:0/1297983054 learned_addr learned my addr 172.21.15.82:0/1297983054 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:25.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.299+0000 7f6de91f0640 1 --2- 172.21.15.82:0/1297983054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556f8dd01ba0 0x556f8dd14d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.299+0000 7f6de91f0640 1 --2- 172.21.15.82:0/1297983054 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556f8dd07980 0x556f8dd152d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.299+0000 7f6de99f1640 1 -- 172.21.15.82:0/1297983054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556f8dd01ba0 msgr2=0x556f8dd14d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:15:25.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.299+0000 7f6de99f1640 1 --2- 172.21.15.82:0/1297983054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556f8dd01ba0 0x556f8dd14d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.299+0000 7f6de99f1640 1 -- 172.21.15.82:0/1297983054 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556f8dd07980 msgr2=0x556f8dd152d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:15:25.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.299+0000 7f6de99f1640 1 --2- 172.21.15.82:0/1297983054 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556f8dd07980 0x556f8dd152d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.299+0000 7f6de99f1640 1 -- 172.21.15.82:0/1297983054 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556f8da4a6b0 con 0x556f8dd067b0 2024-03-04T09:15:25.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.299+0000 7f6de91f0640 1 --2- 172.21.15.82:0/1297983054 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556f8dd07980 0x556f8dd152d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T09:15:25.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.299+0000 7f6de99f1640 1 --2- 172.21.15.82:0/1297983054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f8dd067b0 0x556f8dd1c5a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x556f8dd02b10 tx=0x7f6ddc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35d62475248f2357 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:25.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.299+0000 7f6dcb7fe640 1 -- 172.21.15.82:0/1297983054 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ddc043040 con 0x556f8dd067b0 2024-03-04T09:15:25.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.299+0000 7f6dcb7fe640 1 -- 172.21.15.82:0/1297983054 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f6ddc0334e0 con 0x556f8dd067b0 2024-03-04T09:15:25.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.299+0000 7f6dcb7fe640 1 -- 172.21.15.82:0/1297983054 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ddc02caf0 con 0x556f8dd067b0 2024-03-04T09:15:25.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.300+0000 7f6dee83f740 1 -- 172.21.15.82:0/1297983054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f8dd067b0 msgr2=0x556f8dd1c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:25.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.300+0000 7f6dee83f740 1 --2- 172.21.15.82:0/1297983054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f8dd067b0 0x556f8dd1c5a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x556f8dd02b10 tx=0x7f6ddc004a40 comp rx=0 tx=0).stop 2024-03-04T09:15:25.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.300+0000 7f6dee83f740 1 -- 172.21.15.82:0/1297983054 shutdown_connections 2024-03-04T09:15:25.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.300+0000 7f6dee83f740 1 --2- 172.21.15.82:0/1297983054 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556f8dd07980 0x556f8dd152d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.300+0000 7f6dee83f740 1 --2- 172.21.15.82:0/1297983054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f8dd067b0 0x556f8dd1c5a0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.300+0000 7f6dee83f740 1 --2- 172.21.15.82:0/1297983054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556f8dd01ba0 0x556f8dd14d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.300+0000 7f6dee83f740 1 -- 172.21.15.82:0/1297983054 >> 172.21.15.82:0/1297983054 conn(0x556f8dd21050 msgr2=0x556f8dd0b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:25.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.300+0000 7f6dee83f740 1 -- 172.21.15.82:0/1297983054 shutdown_connections 2024-03-04T09:15:25.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.300+0000 7f6dee83f740 1 -- 172.21.15.82:0/1297983054 wait complete. 2024-03-04T09:15:25.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.300+0000 7f6dee83f740 1 -- start start 2024-03-04T09:15:25.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.300+0000 7f6dee83f740 1 Processor -- start 2024-03-04T09:15:25.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.301+0000 7f6dee83f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f8dd01ba0 0x556f8dd16890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.301+0000 7f6dee83f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556f8dd067b0 0x556f8dd16dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.301+0000 7f6dee83f740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556f8dd07980 0x556f8dd1be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.301+0000 7f6dee83f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f8dd22db0 con 0x556f8dd01ba0 2024-03-04T09:15:25.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.301+0000 7f6dee83f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f8dd22750 con 0x556f8dd067b0 2024-03-04T09:15:25.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.301+0000 7f6dee83f740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f8dd23410 con 0x556f8dd07980 2024-03-04T09:15:25.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.301+0000 7f6dee83f740 10 client.0 _ll_register_callbacks cb 0x7f6dd80138e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-04T09:15:25.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.301+0000 7f6de91f0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f8dd01ba0 0x556f8dd16890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.301+0000 7f6de91f0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f8dd01ba0 0x556f8dd16890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49274/0 (socket says 172.21.15.82:49274) 2024-03-04T09:15:25.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.301+0000 7f6de91f0640 1 -- 172.21.15.82:0/2064625951 learned_addr learned my addr 172.21.15.82:0/2064625951 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:25.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.301+0000 7f6de99f1640 1 --2- 172.21.15.82:0/2064625951 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556f8dd067b0 0x556f8dd16dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.301+0000 7f6de91f0640 1 --2- 172.21.15.82:0/2064625951 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556f8dd07980 0x556f8dd1be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.301+0000 7f6de99f1640 1 -- 172.21.15.82:0/2064625951 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556f8dd07980 msgr2=0x556f8dd1be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:15:25.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.301+0000 7f6de99f1640 1 --2- 172.21.15.82:0/2064625951 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556f8dd07980 0x556f8dd1be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.301+0000 7f6de99f1640 1 -- 172.21.15.82:0/2064625951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f8dd01ba0 msgr2=0x556f8dd16890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:15:25.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.301+0000 7f6de99f1640 1 --2- 172.21.15.82:0/2064625951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f8dd01ba0 0x556f8dd16890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.301+0000 7f6de99f1640 1 -- 172.21.15.82:0/2064625951 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556f8dd1c3f0 con 0x556f8dd067b0 2024-03-04T09:15:25.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.301+0000 7f6de99f1640 1 --2- 172.21.15.82:0/2064625951 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556f8dd067b0 0x556f8dd16dd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc004ab0 tx=0x7f6ddc02c5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8e6b232ffe26698 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:25.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.301+0000 7f6dc97fa640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-03-04T09:15:25.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.301+0000 7f6dc97fa640 1 -- 172.21.15.82:0/2064625951 <== mon.2 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ddc043040 con 0x556f8dd067b0 2024-03-04T09:15:25.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.301+0000 7f6dee83f740 1 -- 172.21.15.82:0/2064625951 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6ddc0334e0 con 0x556f8dd067b0 2024-03-04T09:15:25.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.301+0000 7f6dc97fa640 1 -- 172.21.15.82:0/2064625951 <== mon.2 v2:172.21.15.102:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9179+0+0 (secure 0 0 0) 0x7f6ddc003b70 con 0x556f8dd067b0 2024-03-04T09:15:25.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.301+0000 7f6dc97fa640 1 -- 172.21.15.82:0/2064625951 <== mon.2 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ddc033bb0 con 0x556f8dd067b0 2024-03-04T09:15:25.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.301+0000 7f6dee83f740 10 client.25289 fetch_fsmap learned FSMap version 27 2024-03-04T09:15:25.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.301+0000 7f6dee83f740 1 -- 172.21.15.82:0/2064625951 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x556f8dd7d830 con 0x556f8dd067b0 2024-03-04T09:15:25.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.302+0000 7f6dc97fa640 1 -- 172.21.15.82:0/2064625951 <== mon.2 v2:172.21.15.102:3300/0 4 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f6ddc0334e0 con 0x556f8dd067b0 2024-03-04T09:15:25.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.302+0000 7f6dc97fa640 1 -- 172.21.15.82:0/2064625951 <== mon.2 v2:172.21.15.102:3300/0 5 ==== fsmap(e 27) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f6ddc004490 con 0x556f8dd067b0 2024-03-04T09:15:25.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.302+0000 7f6dee83f740 10 client.25289 fetch_fsmap finished waiting for FSMap version 27 2024-03-04T09:15:25.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.302+0000 7f6dee83f740 10 client.25289 resolve_mds: resolved name 'c' to daemon mds.c 2024-03-04T09:15:25.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.302+0000 7f6dee83f740 20 client.25289 populate_metadata read hostname 'smithi082' 2024-03-04T09:15:25.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.302+0000 7f6dee83f740 1 --2- 172.21.15.82:0/2064625951 >> [v2:172.21.15.190:6836/1198639527,v1:172.21.15.190:6837/1198639527] conn(0x556f8dd08340 0x556f8dd7da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.302+0000 7f6dee83f740 4 client.25289 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-04T09:15:25.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.302+0000 7f6dee83f740 1 -- 172.21.15.82:0/2064625951 --> [v2:172.21.15.190:6836/1198639527,v1:172.21.15.190:6837/1198639527] -- command(tid 0: {"prefix": "status"}) v1 -- 0x556f8dc72f40 con 0x556f8dd08340 2024-03-04T09:15:25.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.302+0000 7f6de91f0640 1 --2- 172.21.15.82:0/2064625951 >> [v2:172.21.15.190:6836/1198639527,v1:172.21.15.190:6837/1198639527] conn(0x556f8dd08340 0x556f8dd7da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.302+0000 7f6de91f0640 1 --2- 172.21.15.82:0/2064625951 >> [v2:172.21.15.190:6836/1198639527,v1:172.21.15.190:6837/1198639527] conn(0x556f8dd08340 0x556f8dd7da00 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6a71e78a8e6a82f7 server_cookie=eb28d0c1dca3a32 in_seq=0 out_seq=0 2024-03-04T09:15:25.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.302+0000 7f6dc97fa640 10 client.25289 ms_handle_connect on v2:172.21.15.190:6836/1198639527 2024-03-04T09:15:25.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.303+0000 7f6dc97fa640 1 -- 172.21.15.82:0/2064625951 <== mds.2 v2:172.21.15.190:6836/1198639527 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x556f8dc72f40 con 0x556f8dd08340 2024-03-04T09:15:25.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.303+0000 7f6dc97fa640 10 client.25289 handle_command_reply: tid=0 2024-03-04T09:15:25.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.303+0000 7f6dee83f740 1 client.25289 shutdown 2024-03-04T09:15:25.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.303+0000 7f6dee83f740 1 -- 172.21.15.82:0/2064625951 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556f8dd067b0 msgr2=0x556f8dd16dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:25.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.303+0000 7f6dee83f740 1 --2- 172.21.15.82:0/2064625951 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556f8dd067b0 0x556f8dd16dd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc004ab0 tx=0x7f6ddc02c5f0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.303+0000 7f6dee83f740 1 -- 172.21.15.82:0/2064625951 shutdown_connections 2024-03-04T09:15:25.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.303+0000 7f6dee83f740 1 --2- 172.21.15.82:0/2064625951 >> [v2:172.21.15.190:6836/1198639527,v1:172.21.15.190:6837/1198639527] conn(0x556f8dd08340 0x556f8dd7da00 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.303+0000 7f6dee83f740 1 --2- 172.21.15.82:0/2064625951 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556f8dd07980 0x556f8dd1be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.303+0000 7f6dee83f740 1 --2- 172.21.15.82:0/2064625951 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556f8dd067b0 0x556f8dd16dd0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.303+0000 7f6dc97fa640 0 client.25289 ms_handle_reset on v2:172.21.15.190:6836/1198639527 2024-03-04T09:15:25.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.303+0000 7f6dee83f740 1 --2- 172.21.15.82:0/2064625951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f8dd01ba0 0x556f8dd16890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.303+0000 7f6dee83f740 1 -- 172.21.15.82:0/2064625951 >> 172.21.15.82:0/2064625951 conn(0x556f8dd21050 msgr2=0x556f8dd0abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:25.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.303+0000 7f6dee83f740 1 -- 172.21.15.82:0/2064625951 shutdown_connections 2024-03-04T09:15:25.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.303+0000 7f6dee83f740 1 -- 172.21.15.82:0/2064625951 wait complete. 2024-03-04T09:15:25.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.303+0000 7f6dee83f740 20 client.25289 trim_cache size 0 max 16384 2024-03-04T09:15:25.307 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-04T09:15:25.307 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "2e533fc8-da06-11ee-95c6-87774f69a715", 2024-03-04T09:15:25.307 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 2, 2024-03-04T09:15:25.307 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24451, 2024-03-04T09:15:25.307 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-03-04T09:15:25.307 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-03-04T09:15:25.307 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-03-04T09:15:25.307 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 109.946221898, 2024-03-04T09:15:25.307 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 27, 2024-03-04T09:15:25.307 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 94, 2024-03-04T09:15:25.307 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 90, 2024-03-04T09:15:25.307 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 154.11773564500001 2024-03-04T09:15:25.307 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-04T09:15:25.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.303+0000 7f6debc55640 1 -- 172.21.15.82:0/394040046 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f6dcc0a1d80 msgr2=0x7f6dcc0a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:25.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.303+0000 7f6debc55640 1 --2- 172.21.15.82:0/394040046 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f6dcc0a1d80 0x7f6dcc0a4240 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6dd40979f0 tx=0x7f6dd406d030 comp rx=0 tx=0).stop 2024-03-04T09:15:25.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.303+0000 7f6debc55640 1 -- 172.21.15.82:0/394040046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6de41031b0 msgr2=0x7f6de419eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:25.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.303+0000 7f6debc55640 1 --2- 172.21.15.82:0/394040046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6de41031b0 0x7f6de419eef0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6dd400e970 tx=0x7f6dd400ed70 comp rx=0 tx=0).stop 2024-03-04T09:15:25.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.303+0000 7f6debc55640 1 -- 172.21.15.82:0/394040046 shutdown_connections 2024-03-04T09:15:25.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.303+0000 7f6debc55640 1 --2- 172.21.15.82:0/394040046 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f6dcc0a1d80 0x7f6dcc0a4240 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.303+0000 7f6debc55640 1 --2- 172.21.15.82:0/394040046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6de41031b0 0x7f6de419eef0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.303+0000 7f6debc55640 1 --2- 172.21.15.82:0/394040046 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6de41027f0 0x7f6de4197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.303+0000 7f6debc55640 1 --2- 172.21.15.82:0/394040046 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6de4101600 0x7f6de4197940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.303+0000 7f6debc55640 1 -- 172.21.15.82:0/394040046 >> 172.21.15.82:0/394040046 conn(0x7f6de40fcb70 msgr2=0x7f6de4105b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:25.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.304+0000 7f6debc55640 1 -- 172.21.15.82:0/394040046 shutdown_connections 2024-03-04T09:15:25.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.304+0000 7f6debc55640 1 -- 172.21.15.82:0/394040046 wait complete. 2024-03-04T09:15:25.311 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-03-04T09:15:25.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.418+0000 7f22bef81640 1 -- 172.21.15.82:0/4282813222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22b8101180 msgr2=0x7f22b8108a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:25.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.418+0000 7f22bef81640 1 --2- 172.21.15.82:0/4282813222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22b8101180 0x7f22b8108a20 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f22b0009ca0 tx=0x7f22b002c0f0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.418+0000 7f22bef81640 1 -- 172.21.15.82:0/4282813222 shutdown_connections 2024-03-04T09:15:25.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.418+0000 7f22bef81640 1 --2- 172.21.15.82:0/4282813222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22b8101180 0x7f22b8108a20 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.418+0000 7f22bef81640 1 --2- 172.21.15.82:0/4282813222 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22b81007c0 0x7f22b8100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.418+0000 7f22bef81640 1 --2- 172.21.15.82:0/4282813222 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f22b8101a90 0x7f22b8101eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.418+0000 7f22bef81640 1 -- 172.21.15.82:0/4282813222 >> 172.21.15.82:0/4282813222 conn(0x7f22b80fb1d0 msgr2=0x7f22b80fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:25.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.418+0000 7f22bef81640 1 -- 172.21.15.82:0/4282813222 shutdown_connections 2024-03-04T09:15:25.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.418+0000 7f22bef81640 1 -- 172.21.15.82:0/4282813222 wait complete. 2024-03-04T09:15:25.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.418+0000 7f22bef81640 1 Processor -- start 2024-03-04T09:15:25.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.418+0000 7f22bef81640 1 -- start start 2024-03-04T09:15:25.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.418+0000 7f22bef81640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22b81007c0 0x7f22b8100240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.418+0000 7f22bef81640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22b8101180 0x7f22b819c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.418+0000 7f22bef81640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f22b8101a90 0x7f22b819ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.418+0000 7f22bef81640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b810c170 con 0x7f22b8101180 2024-03-04T09:15:25.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.418+0000 7f22bef81640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b810bff0 con 0x7f22b81007c0 2024-03-04T09:15:25.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.418+0000 7f22bef81640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b810c2f0 con 0x7f22b8101a90 2024-03-04T09:15:25.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.419+0000 7f22b7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22b8101180 0x7f22b819c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.419+0000 7f22b7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22b8101180 0x7f22b819c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49290/0 (socket says 172.21.15.82:49290) 2024-03-04T09:15:25.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.419+0000 7f22b7fff640 1 -- 172.21.15.82:0/3195535306 learned_addr learned my addr 172.21.15.82:0/3195535306 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:25.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.419+0000 7f22bcd1d640 1 --2- 172.21.15.82:0/3195535306 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22b81007c0 0x7f22b8100240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.419+0000 7f22bd51e640 1 --2- 172.21.15.82:0/3195535306 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f22b8101a90 0x7f22b819ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.419+0000 7f22b7fff640 1 -- 172.21.15.82:0/3195535306 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f22b8101a90 msgr2=0x7f22b819ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:25.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.419+0000 7f22b7fff640 1 --2- 172.21.15.82:0/3195535306 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f22b8101a90 0x7f22b819ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.419+0000 7f22b7fff640 1 -- 172.21.15.82:0/3195535306 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22b81007c0 msgr2=0x7f22b8100240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:25.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.419+0000 7f22b7fff640 1 --2- 172.21.15.82:0/3195535306 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22b81007c0 0x7f22b8100240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.419+0000 7f22b7fff640 1 -- 172.21.15.82:0/3195535306 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b819f4c0 con 0x7f22b8101180 2024-03-04T09:15:25.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.419+0000 7f22bcd1d640 1 --2- 172.21.15.82:0/3195535306 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22b81007c0 0x7f22b8100240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:15:25.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.419+0000 7f22b7fff640 1 --2- 172.21.15.82:0/3195535306 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22b8101180 0x7f22b819c5c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f22a400ea60 tx=0x7f22a400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:25.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.419+0000 7f22b5ffb640 1 -- 172.21.15.82:0/3195535306 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a400cde0 con 0x7f22b8101180 2024-03-04T09:15:25.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.419+0000 7f22b5ffb640 1 -- 172.21.15.82:0/3195535306 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f22a40035f0 con 0x7f22b8101180 2024-03-04T09:15:25.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.419+0000 7f22b5ffb640 1 -- 172.21.15.82:0/3195535306 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a4010690 con 0x7f22b8101180 2024-03-04T09:15:25.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.419+0000 7f22bef81640 1 -- 172.21.15.82:0/3195535306 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22b819f7b0 con 0x7f22b8101180 2024-03-04T09:15:25.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.419+0000 7f22bef81640 1 -- 172.21.15.82:0/3195535306 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22b819fd00 con 0x7f22b8101180 2024-03-04T09:15:25.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.421+0000 7f22b5ffb640 1 -- 172.21.15.82:0/3195535306 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f22a40037a0 con 0x7f22b8101180 2024-03-04T09:15:25.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.422+0000 7f22c1b6c740 1 Processor -- start 2024-03-04T09:15:25.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.422+0000 7f22c1b6c740 1 -- start start 2024-03-04T09:15:25.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.422+0000 7f22b5ffb640 1 --2- 172.21.15.82:0/3195535306 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f22a80a1d80 0x7f22a80a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.422+0000 7f22c1b6c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563901d777b0 0x563901d77bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.422+0000 7f22c1b6c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563901d78980 0x563901d78e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.422+0000 7f22c1b6c740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563901d79340 0x563901d7fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.422+0000 7f22c1b6c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563901cdc6b0 con 0x563901d777b0 2024-03-04T09:15:25.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.422+0000 7f22c1b6c740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x563901c85a60 con 0x563901d79340 2024-03-04T09:15:25.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.422+0000 7f22c1b6c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x563901cd8750 con 0x563901d78980 2024-03-04T09:15:25.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.422+0000 7f22bd51e640 1 --2- 172.21.15.82:0/3195535306 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f22a80a1d80 0x7f22a80a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.422+0000 7f22bcd1d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563901d777b0 0x563901d77bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.422+0000 7f22bcd1d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563901d777b0 0x563901d77bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49306/0 (socket says 172.21.15.82:49306) 2024-03-04T09:15:25.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.422+0000 7f22bcd1d640 1 -- 172.21.15.82:0/3789183623 learned_addr learned my addr 172.21.15.82:0/3789183623 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:25.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.422+0000 7f22b5ffb640 1 -- 172.21.15.82:0/3195535306 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9179+0+0 (secure 0 0 0) 0x7f22a40ce380 con 0x7f22b8101180 2024-03-04T09:15:25.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.422+0000 7f22b7fff640 1 --2- 172.21.15.82:0/3789183623 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563901d78980 0x563901d78e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.422+0000 7f22bd51e640 1 --2- 172.21.15.82:0/3789183623 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563901d79340 0x563901d7fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.422+0000 7f22bcd1d640 1 -- 172.21.15.82:0/3789183623 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563901d78980 msgr2=0x563901d78e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:15:25.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.422+0000 7f22bcd1d640 1 --2- 172.21.15.82:0/3789183623 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563901d78980 0x563901d78e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.422+0000 7f22bcd1d640 1 -- 172.21.15.82:0/3789183623 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563901d79340 msgr2=0x563901d7fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:15:25.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.422+0000 7f22bcd1d640 1 --2- 172.21.15.82:0/3789183623 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563901d79340 0x563901d7fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.422+0000 7f22bcd1d640 1 -- 172.21.15.82:0/3789183623 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563901ca3f30 con 0x563901d777b0 2024-03-04T09:15:25.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.422+0000 7f22b7fff640 1 --2- 172.21.15.82:0/3789183623 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563901d78980 0x563901d78e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:15:25.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.422+0000 7f22bd51e640 1 --2- 172.21.15.82:0/3195535306 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f22a80a1d80 0x7f22a80a4240 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f22b0005e30 tx=0x7f22b0009800 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:25.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.423+0000 7f22bcd1d640 1 --2- 172.21.15.82:0/3789183623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563901d777b0 0x563901d77bd0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f22ac0114c0 tx=0x7f22ac011980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba549844a6621f44 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:25.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.423+0000 7f22a2ffd640 1 -- 172.21.15.82:0/3789183623 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac011250 con 0x563901d777b0 2024-03-04T09:15:25.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.423+0000 7f22a2ffd640 1 -- 172.21.15.82:0/3789183623 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f22ac0054f0 con 0x563901d777b0 2024-03-04T09:15:25.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.423+0000 7f22a2ffd640 1 -- 172.21.15.82:0/3789183623 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac00f820 con 0x563901d777b0 2024-03-04T09:15:25.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.423+0000 7f22c1b6c740 1 -- 172.21.15.82:0/3789183623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563901d777b0 msgr2=0x563901d77bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:25.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.423+0000 7f22c1b6c740 1 --2- 172.21.15.82:0/3789183623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563901d777b0 0x563901d77bd0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f22ac0114c0 tx=0x7f22ac011980 comp rx=0 tx=0).stop 2024-03-04T09:15:25.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.423+0000 7f22c1b6c740 1 -- 172.21.15.82:0/3789183623 shutdown_connections 2024-03-04T09:15:25.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.423+0000 7f22c1b6c740 1 --2- 172.21.15.82:0/3789183623 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563901d79340 0x563901d7fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.423+0000 7f22c1b6c740 1 --2- 172.21.15.82:0/3789183623 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563901d78980 0x563901d78e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.423+0000 7f22c1b6c740 1 --2- 172.21.15.82:0/3789183623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563901d777b0 0x563901d77bd0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.423+0000 7f22c1b6c740 1 -- 172.21.15.82:0/3789183623 >> 172.21.15.82:0/3789183623 conn(0x563901d72ba0 msgr2=0x563901d72fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:25.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.423+0000 7f22c1b6c740 1 -- 172.21.15.82:0/3789183623 shutdown_connections 2024-03-04T09:15:25.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.423+0000 7f22c1b6c740 1 -- 172.21.15.82:0/3789183623 wait complete. 2024-03-04T09:15:25.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.424+0000 7f22c1b6c740 1 -- start start 2024-03-04T09:15:25.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.424+0000 7f22c1b6c740 1 Processor -- start 2024-03-04T09:15:25.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.424+0000 7f22c1b6c740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563901d777b0 0x563901d81d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.424+0000 7f22c1b6c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563901d78980 0x563901d82260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.424+0000 7f22c1b6c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563901d79340 0x563901d892a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.424+0000 7f22c1b6c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563901d80350 con 0x563901d78980 2024-03-04T09:15:25.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.424+0000 7f22c1b6c740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x563901c98ea0 con 0x563901d777b0 2024-03-04T09:15:25.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.424+0000 7f22c1b6c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x563901d804d0 con 0x563901d79340 2024-03-04T09:15:25.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.424+0000 7f22c1b6c740 10 client.0 _ll_register_callbacks cb 0x563901c98870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-04T09:15:25.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.424+0000 7f22b7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563901d78980 0x563901d82260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.424+0000 7f22b7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563901d78980 0x563901d82260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49318/0 (socket says 172.21.15.82:49318) 2024-03-04T09:15:25.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.424+0000 7f22b7fff640 1 -- 172.21.15.82:0/2456235641 learned_addr learned my addr 172.21.15.82:0/2456235641 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:25.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.424+0000 7f22bcd1d640 1 --2- 172.21.15.82:0/2456235641 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563901d777b0 0x563901d81d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.424+0000 7f22bd51e640 1 --2- 172.21.15.82:0/2456235641 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563901d79340 0x563901d892a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.424+0000 7f22b7fff640 1 -- 172.21.15.82:0/2456235641 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563901d79340 msgr2=0x563901d892a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:15:25.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.424+0000 7f22b7fff640 1 --2- 172.21.15.82:0/2456235641 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563901d79340 0x563901d892a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.424+0000 7f22b7fff640 1 -- 172.21.15.82:0/2456235641 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563901d777b0 msgr2=0x563901d81d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:15:25.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.424+0000 7f22b7fff640 1 --2- 172.21.15.82:0/2456235641 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563901d777b0 0x563901d81d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.424+0000 7f22b7fff640 1 -- 172.21.15.82:0/2456235641 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563901c99270 con 0x563901d78980 2024-03-04T09:15:25.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.425+0000 7f22b7fff640 1 --2- 172.21.15.82:0/2456235641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563901d78980 0x563901d82260 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f22a4097200 tx=0x7f22a409a9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccc74489a9af8ec9 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:25.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.425+0000 7f2297fff640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-04T09:15:25.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.425+0000 7f2297fff640 1 -- 172.21.15.82:0/2456235641 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a40c91e0 con 0x563901d78980 2024-03-04T09:15:25.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.425+0000 7f2297fff640 1 -- 172.21.15.82:0/2456235641 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9179+0+0 (secure 0 0 0) 0x7f22a40990a0 con 0x563901d78980 2024-03-04T09:15:25.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.425+0000 7f22c1b6c740 1 -- 172.21.15.82:0/2456235641 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f22ac0054f0 con 0x563901d78980 2024-03-04T09:15:25.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.425+0000 7f2297fff640 1 -- 172.21.15.82:0/2456235641 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f22a409ada0 con 0x563901d78980 2024-03-04T09:15:25.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.425+0000 7f22c1b6c740 10 client.15471 fetch_fsmap learned FSMap version 27 2024-03-04T09:15:25.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.425+0000 7f22c1b6c740 1 -- 172.21.15.82:0/2456235641 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5639019f12d0 con 0x563901d78980 2024-03-04T09:15:25.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.425+0000 7f2297fff640 1 -- 172.21.15.82:0/2456235641 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f22ac0054f0 con 0x563901d78980 2024-03-04T09:15:25.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.425+0000 7f2297fff640 1 -- 172.21.15.82:0/2456235641 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 27) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f22a4096af0 con 0x563901d78980 2024-03-04T09:15:25.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.425+0000 7f22c1b6c740 10 client.15471 fetch_fsmap finished waiting for FSMap version 27 2024-03-04T09:15:25.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.425+0000 7f22c1b6c740 10 client.15471 resolve_mds: resolved name 'i' to daemon mds.i 2024-03-04T09:15:25.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.425+0000 7f22c1b6c740 20 client.15471 populate_metadata read hostname 'smithi082' 2024-03-04T09:15:25.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.425+0000 7f22c1b6c740 1 --2- 172.21.15.82:0/2456235641 >> [v2:172.21.15.190:6838/878555510,v1:172.21.15.190:6839/878555510] conn(0x563901d8e840 0x563901d8d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.425+0000 7f22c1b6c740 4 client.15471 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-04T09:15:25.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.425+0000 7f22c1b6c740 1 -- 172.21.15.82:0/2456235641 --> [v2:172.21.15.190:6838/878555510,v1:172.21.15.190:6839/878555510] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563901ce9bf0 con 0x563901d8e840 2024-03-04T09:15:25.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.426+0000 7f22bcd1d640 1 --2- 172.21.15.82:0/2456235641 >> [v2:172.21.15.190:6838/878555510,v1:172.21.15.190:6839/878555510] conn(0x563901d8e840 0x563901d8d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.426+0000 7f22bcd1d640 1 --2- 172.21.15.82:0/2456235641 >> [v2:172.21.15.190:6838/878555510,v1:172.21.15.190:6839/878555510] conn(0x563901d8e840 0x563901d8d920 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=12479ec9eef598cb server_cookie=b70f37afb3e7f1d7 in_seq=0 out_seq=0 2024-03-04T09:15:25.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.426+0000 7f2297fff640 10 client.15471 ms_handle_connect on v2:172.21.15.190:6838/878555510 2024-03-04T09:15:25.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.427+0000 7f2297fff640 1 -- 172.21.15.82:0/2456235641 <== mds.1 v2:172.21.15.190:6838/878555510 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x563901ce9bf0 con 0x563901d8e840 2024-03-04T09:15:25.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.427+0000 7f2297fff640 10 client.15471 handle_command_reply: tid=0 2024-03-04T09:15:25.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.427+0000 7f22c1b6c740 1 client.15471 shutdown 2024-03-04T09:15:25.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.427+0000 7f22c1b6c740 1 -- 172.21.15.82:0/2456235641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563901d78980 msgr2=0x563901d82260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:25.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.427+0000 7f22c1b6c740 1 --2- 172.21.15.82:0/2456235641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563901d78980 0x563901d82260 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f22a4097200 tx=0x7f22a409a9a0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.427+0000 7f22c1b6c740 1 -- 172.21.15.82:0/2456235641 shutdown_connections 2024-03-04T09:15:25.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.427+0000 7f22c1b6c740 1 --2- 172.21.15.82:0/2456235641 >> [v2:172.21.15.190:6838/878555510,v1:172.21.15.190:6839/878555510] conn(0x563901d8e840 0x563901d8d920 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.427+0000 7f22c1b6c740 1 --2- 172.21.15.82:0/2456235641 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563901d79340 0x563901d892a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.427+0000 7f22c1b6c740 1 --2- 172.21.15.82:0/2456235641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563901d78980 0x563901d82260 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.427+0000 7f22c1b6c740 1 --2- 172.21.15.82:0/2456235641 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563901d777b0 0x563901d81d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.427+0000 7f22c1b6c740 1 -- 172.21.15.82:0/2456235641 >> 172.21.15.82:0/2456235641 conn(0x563901d72ba0 msgr2=0x563901d71da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:25.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.427+0000 7f2297fff640 0 client.15471 ms_handle_reset on v2:172.21.15.190:6838/878555510 2024-03-04T09:15:25.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.427+0000 7f22c1b6c740 1 -- 172.21.15.82:0/2456235641 shutdown_connections 2024-03-04T09:15:25.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.427+0000 7f22c1b6c740 1 -- 172.21.15.82:0/2456235641 wait complete. 2024-03-04T09:15:25.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.427+0000 7f22c1b6c740 20 client.15471 trim_cache size 0 max 16384 2024-03-04T09:15:25.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.444+0000 7f22c1b6c740 1 Processor -- start 2024-03-04T09:15:25.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.444+0000 7f22c1b6c740 1 -- start start 2024-03-04T09:15:25.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.444+0000 7f22c1b6c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563901d777b0 0x563901d72f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.444+0000 7f22c1b6c740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563901d78980 0x563901d89260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.444+0000 7f22c1b6c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563901d79340 0x563901d81930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.444+0000 7f22c1b6c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563901d8e060 con 0x563901d777b0 2024-03-04T09:15:25.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.444+0000 7f22c1b6c740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x563901d8e6c0 con 0x563901d78980 2024-03-04T09:15:25.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.444+0000 7f22c1b6c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x563901d8ed20 con 0x563901d79340 2024-03-04T09:15:25.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.444+0000 7f22bcd1d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563901d777b0 0x563901d72f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.444+0000 7f22bd51e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563901d79340 0x563901d81930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.444+0000 7f22b7fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563901d78980 0x563901d89260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.444+0000 7f22bcd1d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563901d777b0 0x563901d72f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49328/0 (socket says 172.21.15.82:49328) 2024-03-04T09:15:25.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.444+0000 7f22bd51e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563901d79340 0x563901d81930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.82:44494/0 (socket says 172.21.15.82:44494) 2024-03-04T09:15:25.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.444+0000 7f22bcd1d640 1 -- 172.21.15.82:0/1369907748 learned_addr learned my addr 172.21.15.82:0/1369907748 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:25.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.444+0000 7f22bcd1d640 1 -- 172.21.15.82:0/1369907748 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563901d79340 msgr2=0x563901d81930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:15:25.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.444+0000 7f22bcd1d640 1 --2- 172.21.15.82:0/1369907748 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563901d79340 0x563901d81930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.444+0000 7f22bcd1d640 1 -- 172.21.15.82:0/1369907748 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563901d78980 msgr2=0x563901d89260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:15:25.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.444+0000 7f22bcd1d640 1 --2- 172.21.15.82:0/1369907748 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563901d78980 0x563901d89260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.444+0000 7f22bcd1d640 1 -- 172.21.15.82:0/1369907748 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563901abb6b0 con 0x563901d777b0 2024-03-04T09:15:25.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.444+0000 7f22bd51e640 1 --2- 172.21.15.82:0/1369907748 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563901d79340 0x563901d81930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:15:25.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.444+0000 7f22b7fff640 1 --2- 172.21.15.82:0/1369907748 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563901d78980 0x563901d89260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:15:25.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.445+0000 7f22bcd1d640 1 --2- 172.21.15.82:0/1369907748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563901d777b0 0x563901d72f80 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f22ac009fb0 tx=0x7f22ac005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=631ffaa60482d25 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:25.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.445+0000 7f22a27fc640 1 -- 172.21.15.82:0/1369907748 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac031070 con 0x563901d777b0 2024-03-04T09:15:25.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.445+0000 7f22a27fc640 1 -- 172.21.15.82:0/1369907748 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f22ac011040 con 0x563901d777b0 2024-03-04T09:15:25.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.445+0000 7f22a27fc640 1 -- 172.21.15.82:0/1369907748 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac01d040 con 0x563901d777b0 2024-03-04T09:15:25.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.446+0000 7f22c1b6c740 1 -- 172.21.15.82:0/1369907748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563901d777b0 msgr2=0x563901d72f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:25.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.446+0000 7f22c1b6c740 1 --2- 172.21.15.82:0/1369907748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563901d777b0 0x563901d72f80 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f22ac009fb0 tx=0x7f22ac005f90 comp rx=0 tx=0).stop 2024-03-04T09:15:25.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.446+0000 7f22c1b6c740 1 -- 172.21.15.82:0/1369907748 shutdown_connections 2024-03-04T09:15:25.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.446+0000 7f22c1b6c740 1 --2- 172.21.15.82:0/1369907748 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563901d79340 0x563901d81930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.446+0000 7f22c1b6c740 1 --2- 172.21.15.82:0/1369907748 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563901d78980 0x563901d89260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.446+0000 7f22c1b6c740 1 --2- 172.21.15.82:0/1369907748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563901d777b0 0x563901d72f80 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.446+0000 7f22c1b6c740 1 -- 172.21.15.82:0/1369907748 >> 172.21.15.82:0/1369907748 conn(0x563901d72ba0 msgr2=0x563901d6de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:25.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.446+0000 7f22c1b6c740 1 -- 172.21.15.82:0/1369907748 shutdown_connections 2024-03-04T09:15:25.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.446+0000 7f22c1b6c740 1 -- 172.21.15.82:0/1369907748 wait complete. 2024-03-04T09:15:25.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.446+0000 7f22c1b6c740 1 -- start start 2024-03-04T09:15:25.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.446+0000 7f22c1b6c740 1 Processor -- start 2024-03-04T09:15:25.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.446+0000 7f22c1b6c740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563901d777b0 0x563901d85410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.446+0000 7f22c1b6c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563901d78980 0x563901d85950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.446+0000 7f22c1b6c740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563901d79340 0x563901d88970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.446+0000 7f22c1b6c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563901d8f9e0 con 0x563901d78980 2024-03-04T09:15:25.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.446+0000 7f22c1b6c740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x563901d8f380 con 0x563901d777b0 2024-03-04T09:15:25.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.446+0000 7f22c1b6c740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x563901d90040 con 0x563901d79340 2024-03-04T09:15:25.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.446+0000 7f22c1b6c740 10 client.0 _ll_register_callbacks cb 0x7f22a409ab70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-04T09:15:25.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.447+0000 7f22b7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563901d78980 0x563901d85950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.447+0000 7f22b7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563901d78980 0x563901d85950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49340/0 (socket says 172.21.15.82:49340) 2024-03-04T09:15:25.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.447+0000 7f22b7fff640 1 -- 172.21.15.82:0/1560228214 learned_addr learned my addr 172.21.15.82:0/1560228214 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:25.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.447+0000 7f22bd51e640 1 --2- 172.21.15.82:0/1560228214 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563901d79340 0x563901d88970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.447+0000 7f22bcd1d640 1 --2- 172.21.15.82:0/1560228214 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563901d777b0 0x563901d85410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.447+0000 7f22b7fff640 1 -- 172.21.15.82:0/1560228214 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563901d79340 msgr2=0x563901d88970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:15:25.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.447+0000 7f22b7fff640 1 --2- 172.21.15.82:0/1560228214 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563901d79340 0x563901d88970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.447+0000 7f22b7fff640 1 -- 172.21.15.82:0/1560228214 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563901d777b0 msgr2=0x563901d85410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:15:25.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.447+0000 7f22b7fff640 1 --2- 172.21.15.82:0/1560228214 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563901d777b0 0x563901d85410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.447+0000 7f22b7fff640 1 -- 172.21.15.82:0/1560228214 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563901d88f60 con 0x563901d78980 2024-03-04T09:15:25.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.447+0000 7f22b7fff640 1 --2- 172.21.15.82:0/1560228214 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563901d78980 0x563901d85950 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f22a4004610 tx=0x7f22a40c8880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a04cbf359c0a5795 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:25.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.447+0000 7f2297fff640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-04T09:15:25.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.447+0000 7f2297fff640 1 -- 172.21.15.82:0/1560228214 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a4097040 con 0x563901d78980 2024-03-04T09:15:25.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.447+0000 7f2297fff640 1 -- 172.21.15.82:0/1560228214 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9179+0+0 (secure 0 0 0) 0x7f22a40042f0 con 0x563901d78980 2024-03-04T09:15:25.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.447+0000 7f22c1b6c740 1 -- 172.21.15.82:0/1560228214 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f22ac011040 con 0x563901d78980 2024-03-04T09:15:25.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.447+0000 7f2297fff640 1 -- 172.21.15.82:0/1560228214 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f22a409eef0 con 0x563901d78980 2024-03-04T09:15:25.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.447+0000 7f22c1b6c740 10 client.15477 fetch_fsmap learned FSMap version 27 2024-03-04T09:15:25.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.447+0000 7f22c1b6c740 1 -- 172.21.15.82:0/1560228214 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x563901dea390 con 0x563901d78980 2024-03-04T09:15:25.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.447+0000 7f2297fff640 1 -- 172.21.15.82:0/1560228214 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f22ac011040 con 0x563901d78980 2024-03-04T09:15:25.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.448+0000 7f2297fff640 1 -- 172.21.15.82:0/1560228214 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 27) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f22a40b90d0 con 0x563901d78980 2024-03-04T09:15:25.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.448+0000 7f22c1b6c740 10 client.15477 fetch_fsmap finished waiting for FSMap version 27 2024-03-04T09:15:25.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.448+0000 7f22c1b6c740 10 client.15477 resolve_mds: resolved name 'i' to daemon mds.i 2024-03-04T09:15:25.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.448+0000 7f22c1b6c740 20 client.15477 populate_metadata read hostname 'smithi082' 2024-03-04T09:15:25.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.448+0000 7f22c1b6c740 1 --2- 172.21.15.82:0/1560228214 >> [v2:172.21.15.190:6838/878555510,v1:172.21.15.190:6839/878555510] conn(0x563901deea50 0x563901dea670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.448+0000 7f22c1b6c740 4 client.15477 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-04T09:15:25.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.448+0000 7f22c1b6c740 1 -- 172.21.15.82:0/1560228214 --> [v2:172.21.15.190:6838/878555510,v1:172.21.15.190:6839/878555510] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563901ce3f40 con 0x563901deea50 2024-03-04T09:15:25.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.448+0000 7f22bcd1d640 1 --2- 172.21.15.82:0/1560228214 >> [v2:172.21.15.190:6838/878555510,v1:172.21.15.190:6839/878555510] conn(0x563901deea50 0x563901dea670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.448+0000 7f2297fff640 10 client.15477 ms_handle_connect on v2:172.21.15.190:6838/878555510 2024-03-04T09:15:25.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.448+0000 7f22bcd1d640 1 --2- 172.21.15.82:0/1560228214 >> [v2:172.21.15.190:6838/878555510,v1:172.21.15.190:6839/878555510] conn(0x563901deea50 0x563901dea670 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9021330ba6ba0335 server_cookie=c151404a7565ca2c in_seq=0 out_seq=0 2024-03-04T09:15:25.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.448+0000 7f2297fff640 1 -- 172.21.15.82:0/1560228214 <== mds.1 v2:172.21.15.190:6838/878555510 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x563901ce3f40 con 0x563901deea50 2024-03-04T09:15:25.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.448+0000 7f2297fff640 10 client.15477 handle_command_reply: tid=0 2024-03-04T09:15:25.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.448+0000 7f22c1b6c740 1 client.15477 shutdown 2024-03-04T09:15:25.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.449+0000 7f22c1b6c740 1 -- 172.21.15.82:0/1560228214 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563901d78980 msgr2=0x563901d85950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:25.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.449+0000 7f22c1b6c740 1 --2- 172.21.15.82:0/1560228214 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563901d78980 0x563901d85950 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f22a4004610 tx=0x7f22a40c8880 comp rx=0 tx=0).stop 2024-03-04T09:15:25.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.449+0000 7f22c1b6c740 1 -- 172.21.15.82:0/1560228214 shutdown_connections 2024-03-04T09:15:25.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.449+0000 7f22c1b6c740 1 --2- 172.21.15.82:0/1560228214 >> [v2:172.21.15.190:6838/878555510,v1:172.21.15.190:6839/878555510] conn(0x563901deea50 0x563901dea670 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.449+0000 7f22c1b6c740 1 --2- 172.21.15.82:0/1560228214 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563901d79340 0x563901d88970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.449+0000 7f22c1b6c740 1 --2- 172.21.15.82:0/1560228214 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563901d78980 0x563901d85950 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.449+0000 7f2297fff640 0 client.15477 ms_handle_reset on v2:172.21.15.190:6838/878555510 2024-03-04T09:15:25.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.449+0000 7f22c1b6c740 1 --2- 172.21.15.82:0/1560228214 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563901d777b0 0x563901d85410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.449+0000 7f22c1b6c740 1 -- 172.21.15.82:0/1560228214 >> 172.21.15.82:0/1560228214 conn(0x563901d72ba0 msgr2=0x563901d72f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:25.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.449+0000 7f22c1b6c740 1 -- 172.21.15.82:0/1560228214 shutdown_connections 2024-03-04T09:15:25.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.449+0000 7f22c1b6c740 1 -- 172.21.15.82:0/1560228214 wait complete. 2024-03-04T09:15:25.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.449+0000 7f22c1b6c740 20 client.15477 trim_cache size 0 max 16384 2024-03-04T09:15:25.452 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-04T09:15:25.452 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "2e533fc8-da06-11ee-95c6-87774f69a715", 2024-03-04T09:15:25.452 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 1, 2024-03-04T09:15:25.453 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24469, 2024-03-04T09:15:25.453 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-03-04T09:15:25.453 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-03-04T09:15:25.453 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-03-04T09:15:25.453 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 111.098443356, 2024-03-04T09:15:25.453 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 27, 2024-03-04T09:15:25.453 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 94, 2024-03-04T09:15:25.453 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 90, 2024-03-04T09:15:25.453 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 148.63380022499999 2024-03-04T09:15:25.453 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-04T09:15:25.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.449+0000 7f22bef81640 1 -- 172.21.15.82:0/3195535306 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f22a80a1d80 msgr2=0x7f22a80a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:25.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.449+0000 7f22bef81640 1 --2- 172.21.15.82:0/3195535306 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f22a80a1d80 0x7f22a80a4240 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f22b0005e30 tx=0x7f22b0009800 comp rx=0 tx=0).stop 2024-03-04T09:15:25.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.449+0000 7f22bef81640 1 -- 172.21.15.82:0/3195535306 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22b8101180 msgr2=0x7f22b819c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:25.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.449+0000 7f22bef81640 1 --2- 172.21.15.82:0/3195535306 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22b8101180 0x7f22b819c5c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f22a400ea60 tx=0x7f22a400ef20 comp rx=0 tx=0).stop 2024-03-04T09:15:25.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.450+0000 7f22bef81640 1 -- 172.21.15.82:0/3195535306 shutdown_connections 2024-03-04T09:15:25.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.450+0000 7f22bef81640 1 --2- 172.21.15.82:0/3195535306 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f22a80a1d80 0x7f22a80a4240 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.450+0000 7f22bef81640 1 --2- 172.21.15.82:0/3195535306 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f22b8101a90 0x7f22b819ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.450+0000 7f22bef81640 1 --2- 172.21.15.82:0/3195535306 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22b8101180 0x7f22b819c5c0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.450+0000 7f22bef81640 1 --2- 172.21.15.82:0/3195535306 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22b81007c0 0x7f22b8100240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.450+0000 7f22bef81640 1 -- 172.21.15.82:0/3195535306 >> 172.21.15.82:0/3195535306 conn(0x7f22b80fb1d0 msgr2=0x7f22b8104b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:25.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.450+0000 7f22bef81640 1 -- 172.21.15.82:0/3195535306 shutdown_connections 2024-03-04T09:15:25.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.450+0000 7f22bef81640 1 -- 172.21.15.82:0/3195535306 wait complete. 2024-03-04T09:15:25.457 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:25 smithi082 ceph-mon[32880]: pgmap v360: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s; 2 B/s, 0 keys/s, 0 objects/s recovering 2024-03-04T09:15:25.457 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:25 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/855040279' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:15:25.457 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:25 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/3083201961' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:15:25.458 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-03-04T09:15:25.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.566+0000 7f058b0df640 1 -- 172.21.15.82:0/2283456575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0584102880 msgr2=0x7f0584102d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:25.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.566+0000 7f058b0df640 1 --2- 172.21.15.82:0/2283456575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0584102880 0x7f0584102d00 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f0570009930 tx=0x7f057002bc30 comp rx=0 tx=0).stop 2024-03-04T09:15:25.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.566+0000 7f058b0df640 1 -- 172.21.15.82:0/2283456575 shutdown_connections 2024-03-04T09:15:25.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.566+0000 7f058b0df640 1 --2- 172.21.15.82:0/2283456575 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0584103240 0x7f0584109ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.566+0000 7f058b0df640 1 --2- 172.21.15.82:0/2283456575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0584102880 0x7f0584102d00 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.566+0000 7f058b0df640 1 --2- 172.21.15.82:0/2283456575 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f05840ff8b0 0x7f05840ffcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.566+0000 7f058b0df640 1 -- 172.21.15.82:0/2283456575 >> 172.21.15.82:0/2283456575 conn(0x7f05840fb1c0 msgr2=0x7f05840fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:25.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.566+0000 7f058b0df640 1 -- 172.21.15.82:0/2283456575 shutdown_connections 2024-03-04T09:15:25.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.566+0000 7f058b0df640 1 -- 172.21.15.82:0/2283456575 wait complete. 2024-03-04T09:15:25.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.567+0000 7f058b0df640 1 Processor -- start 2024-03-04T09:15:25.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.567+0000 7f058b0df640 1 -- start start 2024-03-04T09:15:25.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.567+0000 7f058b0df640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05840ff8b0 0x7f0584197910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.567+0000 7f058b0df640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0584102880 0x7f0584197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.567+0000 7f058b0df640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0584103240 0x7f058419eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.567+0000 7f058b0df640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058410d270 con 0x7f05840ff8b0 2024-03-04T09:15:25.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.567+0000 7f058b0df640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058410d0f0 con 0x7f0584102880 2024-03-04T09:15:25.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.567+0000 7f058b0df640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058410d3f0 con 0x7f0584103240 2024-03-04T09:15:25.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.567+0000 7f0588e7b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05840ff8b0 0x7f0584197910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.567+0000 7f0588e7b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05840ff8b0 0x7f0584197910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49360/0 (socket says 172.21.15.82:49360) 2024-03-04T09:15:25.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.567+0000 7f0588e7b640 1 -- 172.21.15.82:0/3874975524 learned_addr learned my addr 172.21.15.82:0/3874975524 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:25.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.567+0000 7f058967c640 1 --2- 172.21.15.82:0/3874975524 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0584103240 0x7f058419eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.567+0000 7f0583fff640 1 --2- 172.21.15.82:0/3874975524 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0584102880 0x7f0584197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.567+0000 7f0588e7b640 1 -- 172.21.15.82:0/3874975524 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0584103240 msgr2=0x7f058419eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:25.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.567+0000 7f0588e7b640 1 --2- 172.21.15.82:0/3874975524 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0584103240 0x7f058419eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.567+0000 7f0588e7b640 1 -- 172.21.15.82:0/3874975524 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0584102880 msgr2=0x7f0584197e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:25.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.567+0000 7f0588e7b640 1 --2- 172.21.15.82:0/3874975524 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0584102880 0x7f0584197e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.567+0000 7f0588e7b640 1 -- 172.21.15.82:0/3874975524 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f058419f530 con 0x7f05840ff8b0 2024-03-04T09:15:25.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.567+0000 7f0588e7b640 1 --2- 172.21.15.82:0/3874975524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05840ff8b0 0x7f0584197910 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f057800e9c0 tx=0x7f057800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:25.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.567+0000 7f0581ffb640 1 -- 172.21.15.82:0/3874975524 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057800cd80 con 0x7f05840ff8b0 2024-03-04T09:15:25.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.567+0000 7f0581ffb640 1 -- 172.21.15.82:0/3874975524 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f05780035f0 con 0x7f05840ff8b0 2024-03-04T09:15:25.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.567+0000 7f058b0df640 1 -- 172.21.15.82:0/3874975524 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f058419f820 con 0x7f05840ff8b0 2024-03-04T09:15:25.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.568+0000 7f0581ffb640 1 -- 172.21.15.82:0/3874975524 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0578010690 con 0x7f05840ff8b0 2024-03-04T09:15:25.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.568+0000 7f058b0df640 1 -- 172.21.15.82:0/3874975524 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f058419fd40 con 0x7f05840ff8b0 2024-03-04T09:15:25.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.570+0000 7f0581ffb640 1 -- 172.21.15.82:0/3874975524 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f05780037a0 con 0x7f05840ff8b0 2024-03-04T09:15:25.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.570+0000 7f058dda1740 1 Processor -- start 2024-03-04T09:15:25.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.570+0000 7f058dda1740 1 -- start start 2024-03-04T09:15:25.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.570+0000 7f0581ffb640 1 --2- 172.21.15.82:0/3874975524 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f05740a1d80 0x7f05740a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.571+0000 7f058dda1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611b89497b0 0x5611b8949bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.571+0000 7f058dda1740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611b894a980 0x5611b894ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.571+0000 7f058dda1740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5611b894b340 0x5611b8951bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.571+0000 7f058967c640 1 --2- 172.21.15.82:0/3874975524 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f05740a1d80 0x7f05740a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.571+0000 7f058dda1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611b88ae6b0 con 0x5611b89497b0 2024-03-04T09:15:25.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.571+0000 7f058dda1740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611b8857a60 con 0x5611b894a980 2024-03-04T09:15:25.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.571+0000 7f058dda1740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611b88aa750 con 0x5611b894b340 2024-03-04T09:15:25.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.571+0000 7f0581ffb640 1 -- 172.21.15.82:0/3874975524 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9179+0+0 (secure 0 0 0) 0x7f05780ce540 con 0x7f05840ff8b0 2024-03-04T09:15:25.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.571+0000 7f0588e7b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611b89497b0 0x5611b8949bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.571+0000 7f0583fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611b894a980 0x5611b894ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.571+0000 7f0588e7b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611b89497b0 0x5611b8949bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49370/0 (socket says 172.21.15.82:49370) 2024-03-04T09:15:25.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.571+0000 7f0588e7b640 1 -- 172.21.15.82:0/1166575701 learned_addr learned my addr 172.21.15.82:0/1166575701 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:25.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.571+0000 7f058967c640 1 --2- 172.21.15.82:0/1166575701 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5611b894b340 0x5611b8951bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.571+0000 7f0588e7b640 1 -- 172.21.15.82:0/1166575701 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5611b894b340 msgr2=0x5611b8951bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:15:25.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.571+0000 7f0588e7b640 1 --2- 172.21.15.82:0/1166575701 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5611b894b340 0x5611b8951bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.571+0000 7f0588e7b640 1 -- 172.21.15.82:0/1166575701 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611b894a980 msgr2=0x5611b894ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:15:25.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.571+0000 7f0588e7b640 1 --2- 172.21.15.82:0/1166575701 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611b894a980 0x5611b894ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.571+0000 7f0588e7b640 1 -- 172.21.15.82:0/1166575701 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611b8875f30 con 0x5611b89497b0 2024-03-04T09:15:25.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.571+0000 7f0583fff640 1 --2- 172.21.15.82:0/1166575701 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611b894a980 0x5611b894ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:15:25.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.571+0000 7f058967c640 1 --2- 172.21.15.82:0/3874975524 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f05740a1d80 0x7f05740a4240 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f057c005fd0 tx=0x7f057c009f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:25.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.571+0000 7f0588e7b640 1 --2- 172.21.15.82:0/1166575701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611b89497b0 0x5611b8949bd0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f05780a3110 tx=0x7f057809a9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0cdf9f1e2748d09 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:25.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.571+0000 7f056effd640 1 -- 172.21.15.82:0/1166575701 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057809b5a0 con 0x5611b89497b0 2024-03-04T09:15:25.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.571+0000 7f056effd640 1 -- 172.21.15.82:0/1166575701 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f057800ac00 con 0x5611b89497b0 2024-03-04T09:15:25.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.571+0000 7f056effd640 1 -- 172.21.15.82:0/1166575701 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05780991a0 con 0x5611b89497b0 2024-03-04T09:15:25.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.572+0000 7f058dda1740 1 -- 172.21.15.82:0/1166575701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611b89497b0 msgr2=0x5611b8949bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:25.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.572+0000 7f058dda1740 1 --2- 172.21.15.82:0/1166575701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611b89497b0 0x5611b8949bd0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f05780a3110 tx=0x7f057809a9e0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.572+0000 7f058dda1740 1 -- 172.21.15.82:0/1166575701 shutdown_connections 2024-03-04T09:15:25.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.572+0000 7f058dda1740 1 --2- 172.21.15.82:0/1166575701 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5611b894b340 0x5611b8951bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.572+0000 7f058dda1740 1 --2- 172.21.15.82:0/1166575701 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611b894a980 0x5611b894ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.572+0000 7f058dda1740 1 --2- 172.21.15.82:0/1166575701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611b89497b0 0x5611b8949bd0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.572+0000 7f058dda1740 1 -- 172.21.15.82:0/1166575701 >> 172.21.15.82:0/1166575701 conn(0x5611b8944ba0 msgr2=0x5611b8944fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:25.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.572+0000 7f058dda1740 1 -- 172.21.15.82:0/1166575701 shutdown_connections 2024-03-04T09:15:25.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.572+0000 7f058dda1740 1 -- 172.21.15.82:0/1166575701 wait complete. 2024-03-04T09:15:25.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.572+0000 7f058dda1740 1 -- start start 2024-03-04T09:15:25.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.572+0000 7f058dda1740 1 Processor -- start 2024-03-04T09:15:25.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.573+0000 7f058dda1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611b89497b0 0x5611b8953d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.573+0000 7f058dda1740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611b894a980 0x5611b8954240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.573+0000 7f058dda1740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5611b894b340 0x5611b895b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.573+0000 7f058dda1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611b89522f0 con 0x5611b89497b0 2024-03-04T09:15:25.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.573+0000 7f058dda1740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611b886aea0 con 0x5611b894a980 2024-03-04T09:15:25.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.573+0000 7f058dda1740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611b8952470 con 0x5611b894b340 2024-03-04T09:15:25.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.573+0000 7f058dda1740 10 client.0 _ll_register_callbacks cb 0x5611b886a870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-04T09:15:25.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.573+0000 7f0588e7b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611b89497b0 0x5611b8953d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.573+0000 7f0588e7b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611b89497b0 0x5611b8953d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49376/0 (socket says 172.21.15.82:49376) 2024-03-04T09:15:25.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.573+0000 7f0588e7b640 1 -- 172.21.15.82:0/1853167850 learned_addr learned my addr 172.21.15.82:0/1853167850 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:25.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.573+0000 7f058967c640 1 --2- 172.21.15.82:0/1853167850 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5611b894b340 0x5611b895b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.573+0000 7f0583fff640 1 --2- 172.21.15.82:0/1853167850 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611b894a980 0x5611b8954240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.573+0000 7f0588e7b640 1 -- 172.21.15.82:0/1853167850 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5611b894b340 msgr2=0x5611b895b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:15:25.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.573+0000 7f0588e7b640 1 --2- 172.21.15.82:0/1853167850 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5611b894b340 0x5611b895b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.573+0000 7f0588e7b640 1 -- 172.21.15.82:0/1853167850 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611b894a980 msgr2=0x5611b8954240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:15:25.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.573+0000 7f0588e7b640 1 --2- 172.21.15.82:0/1853167850 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611b894a980 0x5611b8954240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.573+0000 7f0588e7b640 1 -- 172.21.15.82:0/1853167850 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611b886b270 con 0x5611b89497b0 2024-03-04T09:15:25.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.573+0000 7f0588e7b640 1 --2- 172.21.15.82:0/1853167850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611b89497b0 0x5611b8953d00 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f057800c6a0 tx=0x7f0578014420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58cab7896685cbec server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:25.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.573+0000 7f0563fff640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-04T09:15:25.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.573+0000 7f0563fff640 1 -- 172.21.15.82:0/1853167850 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0578014230 con 0x5611b89497b0 2024-03-04T09:15:25.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.573+0000 7f0563fff640 1 -- 172.21.15.82:0/1853167850 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9179+0+0 (secure 0 0 0) 0x7f05780ce240 con 0x5611b89497b0 2024-03-04T09:15:25.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.573+0000 7f058dda1740 1 -- 172.21.15.82:0/1853167850 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f057800ac00 con 0x5611b89497b0 2024-03-04T09:15:25.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.574+0000 7f0563fff640 1 -- 172.21.15.82:0/1853167850 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0578081050 con 0x5611b89497b0 2024-03-04T09:15:25.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.574+0000 7f058dda1740 10 client.15489 fetch_fsmap learned FSMap version 27 2024-03-04T09:15:25.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.574+0000 7f058dda1740 1 -- 172.21.15.82:0/1853167850 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5611b85c32d0 con 0x5611b89497b0 2024-03-04T09:15:25.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.574+0000 7f0563fff640 1 -- 172.21.15.82:0/1853167850 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f057800ac00 con 0x5611b89497b0 2024-03-04T09:15:25.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.574+0000 7f0563fff640 1 -- 172.21.15.82:0/1853167850 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 27) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f05780a31b0 con 0x5611b89497b0 2024-03-04T09:15:25.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.574+0000 7f058dda1740 10 client.15489 fetch_fsmap finished waiting for FSMap version 27 2024-03-04T09:15:25.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.574+0000 7f058dda1740 10 client.15489 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-04T09:15:25.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.574+0000 7f058dda1740 20 client.15489 populate_metadata read hostname 'smithi082' 2024-03-04T09:15:25.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.574+0000 7f058dda1740 1 --2- 172.21.15.82:0/1853167850 >> [v2:172.21.15.102:6838/35424130,v1:172.21.15.102:6839/35424130] conn(0x5611b895fc40 0x5611b8964700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.574+0000 7f058dda1740 4 client.15489 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-04T09:15:25.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.574+0000 7f058dda1740 1 -- 172.21.15.82:0/1853167850 --> [v2:172.21.15.102:6838/35424130,v1:172.21.15.102:6839/35424130] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5611b88bbbf0 con 0x5611b895fc40 2024-03-04T09:15:25.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.574+0000 7f0583fff640 1 --2- 172.21.15.82:0/1853167850 >> [v2:172.21.15.102:6838/35424130,v1:172.21.15.102:6839/35424130] conn(0x5611b895fc40 0x5611b8964700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.575+0000 7f0563fff640 10 client.15489 ms_handle_connect on v2:172.21.15.102:6838/35424130 2024-03-04T09:15:25.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.575+0000 7f0583fff640 1 --2- 172.21.15.82:0/1853167850 >> [v2:172.21.15.102:6838/35424130,v1:172.21.15.102:6839/35424130] conn(0x5611b895fc40 0x5611b8964700 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8e3d31346e16d1a server_cookie=e0f0cd6b3ebcdacc in_seq=0 out_seq=0 2024-03-04T09:15:25.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.575+0000 7f0563fff640 1 -- 172.21.15.82:0/1853167850 <== mds.0 v2:172.21.15.102:6838/35424130 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x5611b88bbbf0 con 0x5611b895fc40 2024-03-04T09:15:25.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.575+0000 7f0563fff640 10 client.15489 handle_command_reply: tid=0 2024-03-04T09:15:25.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.575+0000 7f058dda1740 1 client.15489 shutdown 2024-03-04T09:15:25.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.575+0000 7f058dda1740 1 -- 172.21.15.82:0/1853167850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611b89497b0 msgr2=0x5611b8953d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:25.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.575+0000 7f058dda1740 1 --2- 172.21.15.82:0/1853167850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611b89497b0 0x5611b8953d00 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f057800c6a0 tx=0x7f0578014420 comp rx=0 tx=0).stop 2024-03-04T09:15:25.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.575+0000 7f058dda1740 1 -- 172.21.15.82:0/1853167850 shutdown_connections 2024-03-04T09:15:25.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.575+0000 7f058dda1740 1 --2- 172.21.15.82:0/1853167850 >> [v2:172.21.15.102:6838/35424130,v1:172.21.15.102:6839/35424130] conn(0x5611b895fc40 0x5611b8964700 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.575+0000 7f058dda1740 1 --2- 172.21.15.82:0/1853167850 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5611b894b340 0x5611b895b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.575+0000 7f058dda1740 1 --2- 172.21.15.82:0/1853167850 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611b894a980 0x5611b8954240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.575+0000 7f058dda1740 1 --2- 172.21.15.82:0/1853167850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611b89497b0 0x5611b8953d00 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.575+0000 7f0563fff640 0 client.15489 ms_handle_reset on v2:172.21.15.102:6838/35424130 2024-03-04T09:15:25.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.575+0000 7f058dda1740 1 -- 172.21.15.82:0/1853167850 >> 172.21.15.82:0/1853167850 conn(0x5611b8944ba0 msgr2=0x5611b8943da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:25.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.575+0000 7f058dda1740 1 -- 172.21.15.82:0/1853167850 shutdown_connections 2024-03-04T09:15:25.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.575+0000 7f058dda1740 1 -- 172.21.15.82:0/1853167850 wait complete. 2024-03-04T09:15:25.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.576+0000 7f058dda1740 20 client.15489 trim_cache size 0 max 16384 2024-03-04T09:15:25.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.592+0000 7f058dda1740 1 Processor -- start 2024-03-04T09:15:25.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.592+0000 7f058dda1740 1 -- start start 2024-03-04T09:15:25.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.592+0000 7f058dda1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611b89497b0 0x5611b8944f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.592+0000 7f058dda1740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611b894a980 0x5611b895b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.592+0000 7f058dda1740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5611b894b340 0x5611b8953910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.592+0000 7f058dda1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611b895fac0 con 0x5611b89497b0 2024-03-04T09:15:25.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.592+0000 7f058dda1740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611b8960100 con 0x5611b894a980 2024-03-04T09:15:25.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.592+0000 7f058dda1740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611b8960760 con 0x5611b894b340 2024-03-04T09:15:25.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.592+0000 7f0588e7b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611b89497b0 0x5611b8944f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.592+0000 7f0588e7b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611b89497b0 0x5611b8944f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49386/0 (socket says 172.21.15.82:49386) 2024-03-04T09:15:25.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.592+0000 7f0588e7b640 1 -- 172.21.15.82:0/2343956393 learned_addr learned my addr 172.21.15.82:0/2343956393 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:25.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.592+0000 7f058967c640 1 --2- 172.21.15.82:0/2343956393 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5611b894b340 0x5611b8953910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.592+0000 7f0583fff640 1 --2- 172.21.15.82:0/2343956393 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611b894a980 0x5611b895b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.592+0000 7f0588e7b640 1 -- 172.21.15.82:0/2343956393 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5611b894b340 msgr2=0x5611b8953910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:15:25.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.592+0000 7f0588e7b640 1 --2- 172.21.15.82:0/2343956393 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5611b894b340 0x5611b8953910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.592+0000 7f0588e7b640 1 -- 172.21.15.82:0/2343956393 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611b894a980 msgr2=0x5611b895b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:15:25.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.592+0000 7f0588e7b640 1 --2- 172.21.15.82:0/2343956393 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611b894a980 0x5611b895b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.592+0000 7f0588e7b640 1 -- 172.21.15.82:0/2343956393 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611b868d6b0 con 0x5611b89497b0 2024-03-04T09:15:25.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.592+0000 7f0583fff640 1 --2- 172.21.15.82:0/2343956393 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611b894a980 0x5611b895b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T09:15:25.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.592+0000 7f0588e7b640 1 --2- 172.21.15.82:0/2343956393 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611b89497b0 0x5611b8944f80 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0578097820 tx=0x7f057809a9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20b3a04fdef5aa52 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:25.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.593+0000 7f056e7fc640 1 -- 172.21.15.82:0/2343956393 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05780a8070 con 0x5611b89497b0 2024-03-04T09:15:25.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.593+0000 7f056e7fc640 1 -- 172.21.15.82:0/2343956393 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f057809b5a0 con 0x5611b89497b0 2024-03-04T09:15:25.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.593+0000 7f056e7fc640 1 -- 172.21.15.82:0/2343956393 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05780ce360 con 0x5611b89497b0 2024-03-04T09:15:25.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.593+0000 7f058dda1740 1 -- 172.21.15.82:0/2343956393 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611b89497b0 msgr2=0x5611b8944f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:25.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.593+0000 7f058dda1740 1 --2- 172.21.15.82:0/2343956393 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611b89497b0 0x5611b8944f80 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0578097820 tx=0x7f057809a9e0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.593+0000 7f058dda1740 1 -- 172.21.15.82:0/2343956393 shutdown_connections 2024-03-04T09:15:25.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.593+0000 7f058dda1740 1 --2- 172.21.15.82:0/2343956393 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5611b894b340 0x5611b8953910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.593+0000 7f058dda1740 1 --2- 172.21.15.82:0/2343956393 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611b894a980 0x5611b895b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.593+0000 7f058dda1740 1 --2- 172.21.15.82:0/2343956393 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611b89497b0 0x5611b8944f80 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.593+0000 7f058dda1740 1 -- 172.21.15.82:0/2343956393 >> 172.21.15.82:0/2343956393 conn(0x5611b8944ba0 msgr2=0x5611b893fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:25.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.593+0000 7f058dda1740 1 -- 172.21.15.82:0/2343956393 shutdown_connections 2024-03-04T09:15:25.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.593+0000 7f058dda1740 1 -- 172.21.15.82:0/2343956393 wait complete. 2024-03-04T09:15:25.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.593+0000 7f058dda1740 1 -- start start 2024-03-04T09:15:25.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.594+0000 7f058dda1740 1 Processor -- start 2024-03-04T09:15:25.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.594+0000 7f058dda1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611b89497b0 0x5611b8957010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.594+0000 7f058dda1740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611b894a980 0x5611b8957550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.594+0000 7f058dda1740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5611b894b340 0x5611b895a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.594+0000 7f058dda1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611b8961420 con 0x5611b89497b0 2024-03-04T09:15:25.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.594+0000 7f058dda1740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611b8960dc0 con 0x5611b894a980 2024-03-04T09:15:25.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.594+0000 7f058dda1740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611b8961a80 con 0x5611b894b340 2024-03-04T09:15:25.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.594+0000 7f058dda1740 10 client.0 _ll_register_callbacks cb 0x7f05780a36b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-04T09:15:25.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.594+0000 7f0588e7b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611b89497b0 0x5611b8957010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.594+0000 7f0588e7b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611b89497b0 0x5611b8957010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49398/0 (socket says 172.21.15.82:49398) 2024-03-04T09:15:25.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.594+0000 7f0588e7b640 1 -- 172.21.15.82:0/70141721 learned_addr learned my addr 172.21.15.82:0/70141721 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:25.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.594+0000 7f0583fff640 1 --2- 172.21.15.82:0/70141721 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611b894a980 0x5611b8957550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.594+0000 7f058967c640 1 --2- 172.21.15.82:0/70141721 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5611b894b340 0x5611b895a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.594+0000 7f0588e7b640 1 -- 172.21.15.82:0/70141721 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5611b894b340 msgr2=0x5611b895a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:15:25.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.594+0000 7f0588e7b640 1 --2- 172.21.15.82:0/70141721 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5611b894b340 0x5611b895a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.594+0000 7f0588e7b640 1 -- 172.21.15.82:0/70141721 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611b894a980 msgr2=0x5611b8957550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-04T09:15:25.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.594+0000 7f0588e7b640 1 --2- 172.21.15.82:0/70141721 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611b894a980 0x5611b8957550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.594+0000 7f0588e7b640 1 -- 172.21.15.82:0/70141721 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611b895ab60 con 0x5611b89497b0 2024-03-04T09:15:25.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.594+0000 7f058967c640 1 --2- 172.21.15.82:0/70141721 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5611b894b340 0x5611b895a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T09:15:25.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.594+0000 7f0588e7b640 1 --2- 172.21.15.82:0/70141721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611b89497b0 0x5611b8957010 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f05780a3110 tx=0x7f0578003ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99e5d741199926d7 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:25.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.594+0000 7f0563fff640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-04T09:15:25.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.595+0000 7f0563fff640 1 -- 172.21.15.82:0/70141721 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05780a8070 con 0x5611b89497b0 2024-03-04T09:15:25.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.595+0000 7f0563fff640 1 -- 172.21.15.82:0/70141721 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9179+0+0 (secure 0 0 0) 0x7f05780b3bd0 con 0x5611b89497b0 2024-03-04T09:15:25.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.595+0000 7f058dda1740 1 -- 172.21.15.82:0/70141721 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f057809b5a0 con 0x5611b89497b0 2024-03-04T09:15:25.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.595+0000 7f0563fff640 1 -- 172.21.15.82:0/70141721 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0578014230 con 0x5611b89497b0 2024-03-04T09:15:25.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.595+0000 7f058dda1740 10 client.15495 fetch_fsmap learned FSMap version 27 2024-03-04T09:15:25.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.595+0000 7f058dda1740 1 -- 172.21.15.82:0/70141721 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5611b895ab60 con 0x5611b89497b0 2024-03-04T09:15:25.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.595+0000 7f0563fff640 1 -- 172.21.15.82:0/70141721 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f057809b5a0 con 0x5611b89497b0 2024-03-04T09:15:25.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.595+0000 7f0563fff640 1 -- 172.21.15.82:0/70141721 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 27) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f0578096d10 con 0x5611b89497b0 2024-03-04T09:15:25.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.595+0000 7f058dda1740 10 client.15495 fetch_fsmap finished waiting for FSMap version 27 2024-03-04T09:15:25.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.595+0000 7f058dda1740 10 client.15495 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-04T09:15:25.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.595+0000 7f058dda1740 20 client.15495 populate_metadata read hostname 'smithi082' 2024-03-04T09:15:25.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.595+0000 7f058dda1740 1 --2- 172.21.15.82:0/70141721 >> [v2:172.21.15.102:6838/35424130,v1:172.21.15.102:6839/35424130] conn(0x5611b89bd280 0x5611b89bbec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:25.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.595+0000 7f058dda1740 4 client.15495 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-04T09:15:25.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.595+0000 7f058dda1740 1 -- 172.21.15.82:0/70141721 --> [v2:172.21.15.102:6838/35424130,v1:172.21.15.102:6839/35424130] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5611b88b5f40 con 0x5611b89bd280 2024-03-04T09:15:25.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.595+0000 7f0583fff640 1 --2- 172.21.15.82:0/70141721 >> [v2:172.21.15.102:6838/35424130,v1:172.21.15.102:6839/35424130] conn(0x5611b89bd280 0x5611b89bbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:25.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.596+0000 7f0563fff640 10 client.15495 ms_handle_connect on v2:172.21.15.102:6838/35424130 2024-03-04T09:15:25.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.596+0000 7f0583fff640 1 --2- 172.21.15.82:0/70141721 >> [v2:172.21.15.102:6838/35424130,v1:172.21.15.102:6839/35424130] conn(0x5611b89bd280 0x5611b89bbec0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83d03bb228bfaa34 server_cookie=eb889c717d8f110b in_seq=0 out_seq=0 2024-03-04T09:15:25.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.596+0000 7f0563fff640 1 -- 172.21.15.82:0/70141721 <== mds.0 v2:172.21.15.102:6838/35424130 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x5611b88b5f40 con 0x5611b89bd280 2024-03-04T09:15:25.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.596+0000 7f0563fff640 10 client.15495 handle_command_reply: tid=0 2024-03-04T09:15:25.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.596+0000 7f058dda1740 1 client.15495 shutdown 2024-03-04T09:15:25.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.596+0000 7f058dda1740 1 -- 172.21.15.82:0/70141721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611b89497b0 msgr2=0x5611b8957010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:25.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.596+0000 7f058dda1740 1 --2- 172.21.15.82:0/70141721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611b89497b0 0x5611b8957010 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f05780a3110 tx=0x7f0578003ea0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.596+0000 7f058dda1740 1 -- 172.21.15.82:0/70141721 shutdown_connections 2024-03-04T09:15:25.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.596+0000 7f058dda1740 1 --2- 172.21.15.82:0/70141721 >> [v2:172.21.15.102:6838/35424130,v1:172.21.15.102:6839/35424130] conn(0x5611b89bd280 0x5611b89bbec0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.596+0000 7f058dda1740 1 --2- 172.21.15.82:0/70141721 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5611b894b340 0x5611b895a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.596+0000 7f058dda1740 1 --2- 172.21.15.82:0/70141721 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611b894a980 0x5611b8957550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.596+0000 7f0563fff640 0 client.15495 ms_handle_reset on v2:172.21.15.102:6838/35424130 2024-03-04T09:15:25.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.596+0000 7f058dda1740 1 --2- 172.21.15.82:0/70141721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611b89497b0 0x5611b8957010 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.596+0000 7f058dda1740 1 -- 172.21.15.82:0/70141721 >> 172.21.15.82:0/70141721 conn(0x5611b8944ba0 msgr2=0x5611b8944f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:25.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.596+0000 7f058dda1740 1 -- 172.21.15.82:0/70141721 shutdown_connections 2024-03-04T09:15:25.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.596+0000 7f058dda1740 1 -- 172.21.15.82:0/70141721 wait complete. 2024-03-04T09:15:25.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.596+0000 7f058dda1740 20 client.15495 trim_cache size 0 max 16384 2024-03-04T09:15:25.600 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-04T09:15:25.600 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "2e533fc8-da06-11ee-95c6-87774f69a715", 2024-03-04T09:15:25.600 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 0, 2024-03-04T09:15:25.600 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24476, 2024-03-04T09:15:25.600 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-03-04T09:15:25.600 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-03-04T09:15:25.600 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-03-04T09:15:25.601 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 134.84481253600001, 2024-03-04T09:15:25.601 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 27, 2024-03-04T09:15:25.601 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 94, 2024-03-04T09:15:25.601 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 90, 2024-03-04T09:15:25.601 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 140.04778465199999 2024-03-04T09:15:25.601 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-04T09:15:25.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.597+0000 7f058b0df640 1 -- 172.21.15.82:0/3874975524 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f05740a1d80 msgr2=0x7f05740a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:25.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.597+0000 7f058b0df640 1 --2- 172.21.15.82:0/3874975524 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f05740a1d80 0x7f05740a4240 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f057c005fd0 tx=0x7f057c009f90 comp rx=0 tx=0).stop 2024-03-04T09:15:25.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.597+0000 7f058b0df640 1 -- 172.21.15.82:0/3874975524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05840ff8b0 msgr2=0x7f0584197910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:25.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.597+0000 7f058b0df640 1 --2- 172.21.15.82:0/3874975524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05840ff8b0 0x7f0584197910 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f057800e9c0 tx=0x7f057800ee80 comp rx=0 tx=0).stop 2024-03-04T09:15:25.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.597+0000 7f058b0df640 1 -- 172.21.15.82:0/3874975524 shutdown_connections 2024-03-04T09:15:25.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.597+0000 7f058b0df640 1 --2- 172.21.15.82:0/3874975524 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f05740a1d80 0x7f05740a4240 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.597+0000 7f058b0df640 1 --2- 172.21.15.82:0/3874975524 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0584103240 0x7f058419eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.597+0000 7f058b0df640 1 --2- 172.21.15.82:0/3874975524 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0584102880 0x7f0584197e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.597+0000 7f058b0df640 1 --2- 172.21.15.82:0/3874975524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05840ff8b0 0x7f0584197910 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:25.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.597+0000 7f058b0df640 1 -- 172.21.15.82:0/3874975524 >> 172.21.15.82:0/3874975524 conn(0x7f05840fb1c0 msgr2=0x7f0584105c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:25.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.597+0000 7f058b0df640 1 -- 172.21.15.82:0/3874975524 shutdown_connections 2024-03-04T09:15:25.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:25.597+0000 7f058b0df640 1 -- 172.21.15.82:0/3874975524 wait complete. 2024-03-04T09:15:25.604 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-03-04T09:15:25.615 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-03-04T09:15:25.616 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-03-04T09:15:25.616 INFO:tasks.ceph_fuse:client.0 config is {'mount_subvol_num': 0} 2024-03-04T09:15:25.616 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-04T09:15:25.616 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-04T09:15:25.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T09:15:25.616 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-03-04T09:15:25.631 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-03-04T09:15:25.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T09:15:25.632 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-04T09:15:25.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:25 smithi190 ceph-mon[36341]: pgmap v360: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s; 2 B/s, 0 keys/s, 0 objects/s recovering 2024-03-04T09:15:25.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:25 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/855040279' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:15:25.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:25 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/3083201961' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:15:25.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:25 smithi102 ceph-mon[36220]: pgmap v360: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s; 2 B/s, 0 keys/s, 0 objects/s recovering 2024-03-04T09:15:25.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:25 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/855040279' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:15:25.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:25 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/3083201961' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:15:25.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T09:15:25.700 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link delete ceph-brx 2024-03-04T09:15:25.807 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-03-04T09:15:25.807 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph fs ls 2024-03-04T09:15:26.051 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:15:27.512 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:27 smithi082 ceph-mon[32880]: pgmap v361: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s; 1 B/s, 0 keys/s, 0 objects/s recovering 2024-03-04T09:15:27.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:27 smithi190 ceph-mon[36341]: pgmap v361: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s; 1 B/s, 0 keys/s, 0 objects/s recovering 2024-03-04T09:15:27.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:27 smithi102 ceph-mon[36220]: pgmap v361: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s; 1 B/s, 0 keys/s, 0 objects/s recovering 2024-03-04T09:15:27.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.746+0000 7f5640968700 1 -- 172.21.15.82:0/1297472332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f563c101960 msgr2=0x7f563c10de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:27.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.746+0000 7f5640968700 1 --2- 172.21.15.82:0/1297472332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f563c101960 0x7f563c10de40 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f563400b0a0 tx=0x7f563400b3b0 comp rx=0 tx=0).stop 2024-03-04T09:15:27.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.746+0000 7f5640968700 1 -- 172.21.15.82:0/1297472332 shutdown_connections 2024-03-04T09:15:27.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.746+0000 7f5640968700 1 --2- 172.21.15.82:0/1297472332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f563c101960 0x7f563c10de40 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:27.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.746+0000 7f5640968700 1 --2- 172.21.15.82:0/1297472332 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f563c107000 0x7f563c1073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:27.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.746+0000 7f5640968700 1 --2- 172.21.15.82:0/1297472332 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f563c100fc0 0x7f563c101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:27.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.746+0000 7f5640968700 1 -- 172.21.15.82:0/1297472332 >> 172.21.15.82:0/1297472332 conn(0x7f563c077ef0 msgr2=0x7f563c078300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:27.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.746+0000 7f5640968700 1 -- 172.21.15.82:0/1297472332 shutdown_connections 2024-03-04T09:15:27.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.746+0000 7f5640968700 1 -- 172.21.15.82:0/1297472332 wait complete. 2024-03-04T09:15:27.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.747+0000 7f5640968700 1 Processor -- start 2024-03-04T09:15:27.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.747+0000 7f5640968700 1 -- start start 2024-03-04T09:15:27.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.747+0000 7f5640968700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f563c100fc0 0x7f563c102c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:27.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.747+0000 7f5640968700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f563c101960 0x7f563c1031b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:27.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.747+0000 7f5640968700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f563c107000 0x7f563c1036f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:27.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.747+0000 7f5640968700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f563c111240 con 0x7f563c101960 2024-03-04T09:15:27.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.747+0000 7f5640968700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f563c1110c0 con 0x7f563c107000 2024-03-04T09:15:27.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.747+0000 7f5640968700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f563c1113c0 con 0x7f563c100fc0 2024-03-04T09:15:27.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.747+0000 7f5633fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f563c101960 0x7f563c1031b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:27.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.747+0000 7f563a59c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f563c100fc0 0x7f563c102c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:27.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.747+0000 7f5633fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f563c101960 0x7f563c1031b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45754/0 (socket says 172.21.15.82:45754) 2024-03-04T09:15:27.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.747+0000 7f5633fff700 1 -- 172.21.15.82:0/1512678463 learned_addr learned my addr 172.21.15.82:0/1512678463 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:27.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.747+0000 7f563ad9d700 1 --2- 172.21.15.82:0/1512678463 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f563c107000 0x7f563c1036f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:27.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.747+0000 7f563a59c700 1 -- 172.21.15.82:0/1512678463 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f563c107000 msgr2=0x7f563c1036f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:27.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.747+0000 7f563a59c700 1 --2- 172.21.15.82:0/1512678463 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f563c107000 0x7f563c1036f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:27.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.747+0000 7f563a59c700 1 -- 172.21.15.82:0/1512678463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f563c101960 msgr2=0x7f563c1031b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:27.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.747+0000 7f563a59c700 1 --2- 172.21.15.82:0/1512678463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f563c101960 0x7f563c1031b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:27.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.747+0000 7f563a59c700 1 -- 172.21.15.82:0/1512678463 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f563c1a6d50 con 0x7f563c100fc0 2024-03-04T09:15:27.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.747+0000 7f5633fff700 1 --2- 172.21.15.82:0/1512678463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f563c101960 0x7f563c1031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:15:27.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.748+0000 7f563a59c700 1 --2- 172.21.15.82:0/1512678463 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f563c100fc0 0x7f563c102c70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f562c00e9f0 tx=0x7f562c00ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:27.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.748+0000 7f56337fe700 1 -- 172.21.15.82:0/1512678463 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562c00c9c0 con 0x7f563c100fc0 2024-03-04T09:15:27.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.748+0000 7f56337fe700 1 -- 172.21.15.82:0/1512678463 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f562c00cb60 con 0x7f563c100fc0 2024-03-04T09:15:27.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.748+0000 7f5640968700 1 -- 172.21.15.82:0/1512678463 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f563c1a6fe0 con 0x7f563c100fc0 2024-03-04T09:15:27.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.748+0000 7f56337fe700 1 -- 172.21.15.82:0/1512678463 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562c018680 con 0x7f563c100fc0 2024-03-04T09:15:27.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.748+0000 7f5640968700 1 -- 172.21.15.82:0/1512678463 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f563c1a74f0 con 0x7f563c100fc0 2024-03-04T09:15:27.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.749+0000 7f5640968700 1 -- 172.21.15.82:0/1512678463 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f563c068d80 con 0x7f563c100fc0 2024-03-04T09:15:27.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.750+0000 7f56337fe700 1 -- 172.21.15.82:0/1512678463 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 18) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f562c010430 con 0x7f563c100fc0 2024-03-04T09:15:27.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.750+0000 7f56337fe700 1 --2- 172.21.15.82:0/1512678463 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f56280a1e10 0x7f56280a42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:27.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.751+0000 7f5633fff700 1 --2- 172.21.15.82:0/1512678463 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f56280a1e10 0x7f56280a42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:27.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.751+0000 7f56337fe700 1 -- 172.21.15.82:0/1512678463 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9179+0+0 (secure 0 0 0) 0x7f562c0ce240 con 0x7f563c100fc0 2024-03-04T09:15:27.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.751+0000 7f5633fff700 1 --2- 172.21.15.82:0/1512678463 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f56280a1e10 0x7f56280a42d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f563c0784f0 tx=0x7f5624009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:27.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.754+0000 7f56337fe700 1 -- 172.21.15.82:0/1512678463 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f562c09b260 con 0x7f563c100fc0 2024-03-04T09:15:27.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.992+0000 7f5640968700 1 -- 172.21.15.82:0/1512678463 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f563c1a78a0 con 0x7f563c100fc0 2024-03-04T09:15:27.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.992+0000 7f56337fe700 1 -- 172.21.15.82:0/1512678463 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) v1 ==== 53+0+88 (secure 0 0 0) 0x7f562c09ab60 con 0x7f563c100fc0 2024-03-04T09:15:27.989 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-03-04T09:15:27.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.994+0000 7f5640968700 1 -- 172.21.15.82:0/1512678463 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f56280a1e10 msgr2=0x7f56280a42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:27.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.994+0000 7f5640968700 1 --2- 172.21.15.82:0/1512678463 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f56280a1e10 0x7f56280a42d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f563c0784f0 tx=0x7f5624009260 comp rx=0 tx=0).stop 2024-03-04T09:15:27.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.994+0000 7f5640968700 1 -- 172.21.15.82:0/1512678463 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f563c100fc0 msgr2=0x7f563c102c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:27.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.994+0000 7f5640968700 1 --2- 172.21.15.82:0/1512678463 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f563c100fc0 0x7f563c102c70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f562c00e9f0 tx=0x7f562c00ed00 comp rx=0 tx=0).stop 2024-03-04T09:15:27.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.994+0000 7f5640968700 1 -- 172.21.15.82:0/1512678463 shutdown_connections 2024-03-04T09:15:27.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.994+0000 7f5640968700 1 --2- 172.21.15.82:0/1512678463 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f56280a1e10 0x7f56280a42d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:27.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.994+0000 7f5640968700 1 --2- 172.21.15.82:0/1512678463 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f563c107000 0x7f563c1036f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:27.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.994+0000 7f5640968700 1 --2- 172.21.15.82:0/1512678463 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f563c100fc0 0x7f563c102c70 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:27.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.994+0000 7f5640968700 1 --2- 172.21.15.82:0/1512678463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f563c101960 0x7f563c1031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:27.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.994+0000 7f5640968700 1 -- 172.21.15.82:0/1512678463 >> 172.21.15.82:0/1512678463 conn(0x7f563c077ef0 msgr2=0x7f563c100330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:27.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.995+0000 7f5640968700 1 -- 172.21.15.82:0/1512678463 shutdown_connections 2024-03-04T09:15:27.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:27.995+0000 7f5640968700 1 -- 172.21.15.82:0/1512678463 wait complete. 2024-03-04T09:15:28.663 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:28 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/1512678463' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-03-04T09:15:28.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:28 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/1512678463' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-03-04T09:15:28.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:28 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/1512678463' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-03-04T09:15:28.695 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-04T09:15:28.695 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-04T09:15:28.695 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi082.front.sepia.ceph.com 2024-03-04T09:15:28.695 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-04T09:15:28.695 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-04T09:15:28.695 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-04T09:15:28.695 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-04T09:15:28.695 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-04T09:15:28.696 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-04T09:15:28.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T09:15:28.696 DEBUG:teuthology.orchestra.run.smithi082:> ip addr 2024-03-04T09:15:28.714 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-04T09:15:28.714 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-04T09:15:28.714 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2024-03-04T09:15:28.714 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-03-04T09:15:28.714 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2024-03-04T09:15:28.714 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-03-04T09:15:28.714 INFO:teuthology.orchestra.run.smithi082.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-04T09:15:28.714 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c6 brd ff:ff:ff:ff:ff:ff 2024-03-04T09:15:28.714 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f0 2024-03-04T09:15:28.714 INFO:teuthology.orchestra.run.smithi082.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-04T09:15:28.714 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c7 brd ff:ff:ff:ff:ff:ff 2024-03-04T09:15:28.714 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f1 2024-03-04T09:15:28.714 INFO:teuthology.orchestra.run.smithi082.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-04T09:15:28.715 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:fe brd ff:ff:ff:ff:ff:ff 2024-03-04T09:15:28.715 INFO:teuthology.orchestra.run.smithi082.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-04T09:15:28.715 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:ff brd ff:ff:ff:ff:ff:ff 2024-03-04T09:15:28.715 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.21.15.82/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-04T09:15:28.715 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft 42067sec preferred_lft 42067sec 2024-03-04T09:15:28.715 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2024-03-04T09:15:28.715 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-03-04T09:15:28.715 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-04T09:15:28.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T09:15:28.715 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2024-03-04T09:15:28.716 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-03-04T09:15:28.716 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link add name ceph-brx type bridge 2024-03-04T09:15:28.716 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip addr flush dev ceph-brx 2024-03-04T09:15:28.716 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set ceph-brx up 2024-03-04T09:15:28.716 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-04T09:15:28.716 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-03-04T09:15:28.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T09:15:28.827 DEBUG:teuthology.orchestra.run.smithi082:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-04T09:15:28.854 INFO:teuthology.orchestra.run.smithi082.stdout:1 2024-03-04T09:15:28.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T09:15:28.855 DEBUG:teuthology.orchestra.run.smithi082:> route 2024-03-04T09:15:28.911 INFO:teuthology.orchestra.run.smithi082.stdout:Kernel IP routing table 2024-03-04T09:15:28.911 INFO:teuthology.orchestra.run.smithi082.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-04T09:15:28.911 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-04T09:15:28.911 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-04T09:15:28.911 INFO:teuthology.orchestra.run.smithi082.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-04T09:15:28.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T09:15:28.912 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2024-03-04T09:15:28.912 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-03-04T09:15:28.912 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-04T09:15:28.912 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-04T09:15:28.912 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-04T09:15:28.912 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-03-04T09:15:29.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T09:15:29.008 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-03-04T09:15:29.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T09:15:29.024 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list-id 2024-03-04T09:15:29.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T09:15:29.078 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2024-03-04T09:15:29.078 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-03-04T09:15:29.079 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-04T09:15:29.079 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-03-04T09:15:29.079 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-03-04T09:15:29.161 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-03-04T09:15:29.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T09:15:29.162 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2024-03-04T09:15:29.162 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-03-04T09:15:29.162 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-03-04T09:15:29.162 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-04T09:15:29.162 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-03-04T09:15:29.162 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-03-04T09:15:29.162 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-03-04T09:15:29.163 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-03-04T09:15:29.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T09:15:29.289 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2024-03-04T09:15:29.289 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-03-04T09:15:29.289 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set brx.0 up 2024-03-04T09:15:29.289 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set dev brx.0 master ceph-brx 2024-03-04T09:15:29.289 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-03-04T09:15:29.330 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mount_subvol_num': 0} 2024-03-04T09:15:29.330 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-04T09:15:29.330 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-04T09:15:29.383 INFO:teuthology.orchestra.run.smithi082.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-04T09:15:29.383 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-04T09:15:29.383 DEBUG:teuthology.orchestra.run.smithi082:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-04T09:15:29.438 DEBUG:teuthology.orchestra.run.smithi082:> sudo modprobe fuse 2024-03-04T09:15:29.502 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:29 smithi082 ceph-mon[32880]: pgmap v362: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s; 1 B/s, 0 objects/s recovering 2024-03-04T09:15:29.506 DEBUG:teuthology.orchestra.run.smithi082:> cat /proc/self/mounts | awk '{print $2}' 2024-03-04T09:15:29.566 INFO:teuthology.orchestra.run.smithi082.stdout:/proc 2024-03-04T09:15:29.567 INFO:teuthology.orchestra.run.smithi082.stdout:/sys 2024-03-04T09:15:29.567 INFO:teuthology.orchestra.run.smithi082.stdout:/dev 2024-03-04T09:15:29.567 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/security 2024-03-04T09:15:29.567 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/shm 2024-03-04T09:15:29.567 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/pts 2024-03-04T09:15:29.567 INFO:teuthology.orchestra.run.smithi082.stdout:/run 2024-03-04T09:15:29.567 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/cgroup 2024-03-04T09:15:29.567 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/pstore 2024-03-04T09:15:29.567 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/bpf 2024-03-04T09:15:29.567 INFO:teuthology.orchestra.run.smithi082.stdout:/ 2024-03-04T09:15:29.568 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/selinux 2024-03-04T09:15:29.568 INFO:teuthology.orchestra.run.smithi082.stdout:/proc/sys/fs/binfmt_misc 2024-03-04T09:15:29.568 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/mqueue 2024-03-04T09:15:29.568 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/hugepages 2024-03-04T09:15:29.568 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/debug 2024-03-04T09:15:29.568 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/tracing 2024-03-04T09:15:29.568 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-04T09:15:29.568 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/fuse/connections 2024-03-04T09:15:29.568 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-sysctl.service 2024-03-04T09:15:29.568 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/config 2024-03-04T09:15:29.568 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-04T09:15:29.568 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/nfs/rpc_pipefs 2024-03-04T09:15:29.568 INFO:teuthology.orchestra.run.smithi082.stdout:/run/user/1000 2024-03-04T09:15:29.569 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph 2024-03-04T09:15:29.569 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay 2024-03-04T09:15:29.569 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/da0108e0274a2327ce79079bd48b76735c940bb9cfd4df9b40266a721caa8793/merged 2024-03-04T09:15:29.569 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/30fcf765d083a7489da0daf27a3e27bfba29f51e425bd9ca7c77849f4dc652b9/merged 2024-03-04T09:15:29.569 INFO:teuthology.orchestra.run.smithi082.stdout:/run/user/0 2024-03-04T09:15:29.569 INFO:teuthology.orchestra.run.smithi082.stdout:/proc/sys/fs/binfmt_misc 2024-03-04T09:15:29.569 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/f7be2e8cc64a6302de7c1fb624d205384c6cc97a4603eb1e1cfde905997b9dd9/merged 2024-03-04T09:15:29.569 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/b12c5c634cfcdbe1f46d6888c628ffd47c6365791103f8eba2fdba65c118bd26/merged 2024-03-04T09:15:29.569 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/168950f35057454c6e681f62b53b4680dfa38932e5b8c4963d27caeadd34aadd/merged 2024-03-04T09:15:29.569 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/3210b6571f74524d4c0ae2e50ba2ffb24c19e097fd9b95995393553992388887/merged 2024-03-04T09:15:29.569 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/399d87fe5c475bc0e99d88c207618456f76c5a3725cf00d12562b2bb966f1b4c/merged 2024-03-04T09:15:29.569 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/e77e1360832dc3fe58d78fa55e8c2e6321a3fe2a17c3f2314a24d9accc5d1f55/merged 2024-03-04T09:15:29.569 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/bcad1ad7ad348be0dc0017b8e90198ed0a47cc553dd4d1a5cfae474f8b12a17c/merged 2024-03-04T09:15:29.569 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/f06ef84d9d7df151261f6a6b7a0d1fec461c8df2cb247f091b66043698771305/merged 2024-03-04T09:15:29.570 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns 2024-03-04T09:15:29.570 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-04T09:15:29.570 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-04T09:15:29.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T09:15:29.570 DEBUG:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2024-03-04T09:15:29.628 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-04T09:15:29.628 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/volumes/qa/sv_0/13e71396-3e50-499b-895f-c2eff6f4bf3d --client_fs=cephfs) 2024-03-04T09:15:29.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:29 smithi190 ceph-mon[36341]: pgmap v362: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s; 1 B/s, 0 objects/s recovering 2024-03-04T09:15:29.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:29 smithi102 ceph-mon[36220]: pgmap v362: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s; 1 B/s, 0 objects/s recovering 2024-03-04T09:15:29.684 DEBUG:teuthology.orchestra.run.smithi082:> sudo modprobe fuse 2024-03-04T09:15:29.724 DEBUG:teuthology.orchestra.run.smithi082:> cat /proc/self/mounts | awk '{print $2}' 2024-03-04T09:15:29.773 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:2024-03-04T09:15:29.771+0000 7f48a4580480 -1 init, newargv = 0x55e8bd9f4c20 newargc=15 2024-03-04T09:15:29.773 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:ceph-fuse[86598]: starting ceph client 2024-03-04T09:15:29.788 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:ceph-fuse[86598]: starting fuse 2024-03-04T09:15:29.794 INFO:teuthology.orchestra.run.smithi082.stdout:/proc 2024-03-04T09:15:29.794 INFO:teuthology.orchestra.run.smithi082.stdout:/sys 2024-03-04T09:15:29.794 INFO:teuthology.orchestra.run.smithi082.stdout:/dev 2024-03-04T09:15:29.794 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/security 2024-03-04T09:15:29.794 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/shm 2024-03-04T09:15:29.794 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/pts 2024-03-04T09:15:29.794 INFO:teuthology.orchestra.run.smithi082.stdout:/run 2024-03-04T09:15:29.794 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/cgroup 2024-03-04T09:15:29.794 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/pstore 2024-03-04T09:15:29.795 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/bpf 2024-03-04T09:15:29.795 INFO:teuthology.orchestra.run.smithi082.stdout:/ 2024-03-04T09:15:29.795 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/selinux 2024-03-04T09:15:29.795 INFO:teuthology.orchestra.run.smithi082.stdout:/proc/sys/fs/binfmt_misc 2024-03-04T09:15:29.795 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/mqueue 2024-03-04T09:15:29.795 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/hugepages 2024-03-04T09:15:29.795 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/debug 2024-03-04T09:15:29.795 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/tracing 2024-03-04T09:15:29.795 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-04T09:15:29.795 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/fuse/connections 2024-03-04T09:15:29.795 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-sysctl.service 2024-03-04T09:15:29.796 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/config 2024-03-04T09:15:29.796 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-04T09:15:29.796 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/nfs/rpc_pipefs 2024-03-04T09:15:29.796 INFO:teuthology.orchestra.run.smithi082.stdout:/run/user/1000 2024-03-04T09:15:29.796 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph 2024-03-04T09:15:29.796 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay 2024-03-04T09:15:29.796 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/da0108e0274a2327ce79079bd48b76735c940bb9cfd4df9b40266a721caa8793/merged 2024-03-04T09:15:29.796 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/30fcf765d083a7489da0daf27a3e27bfba29f51e425bd9ca7c77849f4dc652b9/merged 2024-03-04T09:15:29.796 INFO:teuthology.orchestra.run.smithi082.stdout:/run/user/0 2024-03-04T09:15:29.796 INFO:teuthology.orchestra.run.smithi082.stdout:/proc/sys/fs/binfmt_misc 2024-03-04T09:15:29.796 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/f7be2e8cc64a6302de7c1fb624d205384c6cc97a4603eb1e1cfde905997b9dd9/merged 2024-03-04T09:15:29.796 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/b12c5c634cfcdbe1f46d6888c628ffd47c6365791103f8eba2fdba65c118bd26/merged 2024-03-04T09:15:29.797 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/168950f35057454c6e681f62b53b4680dfa38932e5b8c4963d27caeadd34aadd/merged 2024-03-04T09:15:29.797 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/3210b6571f74524d4c0ae2e50ba2ffb24c19e097fd9b95995393553992388887/merged 2024-03-04T09:15:29.797 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/399d87fe5c475bc0e99d88c207618456f76c5a3725cf00d12562b2bb966f1b4c/merged 2024-03-04T09:15:29.797 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/e77e1360832dc3fe58d78fa55e8c2e6321a3fe2a17c3f2314a24d9accc5d1f55/merged 2024-03-04T09:15:29.797 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/bcad1ad7ad348be0dc0017b8e90198ed0a47cc553dd4d1a5cfae474f8b12a17c/merged 2024-03-04T09:15:29.797 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/f06ef84d9d7df151261f6a6b7a0d1fec461c8df2cb247f091b66043698771305/merged 2024-03-04T09:15:29.797 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns 2024-03-04T09:15:29.797 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-04T09:15:29.797 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-04T09:15:29.797 INFO:teuthology.orchestra.run.smithi082.stdout:/home/ubuntu/cephtest/mnt.0 2024-03-04T09:15:29.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T09:15:29.797 DEBUG:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2024-03-04T09:15:29.860 INFO:teuthology.orchestra.run.smithi082.stdout:119 2024-03-04T09:15:29.861 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [119] 2024-03-04T09:15:29.861 DEBUG:teuthology.orchestra.run.smithi082:> sudo stdin-killer -- python3 -c ' 2024-03-04T09:15:29.861 DEBUG:teuthology.orchestra.run.smithi082:> import glob 2024-03-04T09:15:29.861 DEBUG:teuthology.orchestra.run.smithi082:> import re 2024-03-04T09:15:29.861 DEBUG:teuthology.orchestra.run.smithi082:> import os 2024-03-04T09:15:29.861 DEBUG:teuthology.orchestra.run.smithi082:> import subprocess 2024-03-04T09:15:29.861 DEBUG:teuthology.orchestra.run.smithi082:> 2024-03-04T09:15:29.861 DEBUG:teuthology.orchestra.run.smithi082:> def _find_admin_socket(client_name): 2024-03-04T09:15:29.861 DEBUG:teuthology.orchestra.run.smithi082:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-03-04T09:15:29.861 DEBUG:teuthology.orchestra.run.smithi082:> files = glob.glob(asok_path) 2024-03-04T09:15:29.861 DEBUG:teuthology.orchestra.run.smithi082:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-03-04T09:15:29.861 DEBUG:teuthology.orchestra.run.smithi082:> 2024-03-04T09:15:29.861 DEBUG:teuthology.orchestra.run.smithi082:> # Given a non-glob path, it better be there 2024-03-04T09:15:29.862 DEBUG:teuthology.orchestra.run.smithi082:> if "*" not in asok_path: 2024-03-04T09:15:29.862 DEBUG:teuthology.orchestra.run.smithi082:> assert(len(files) == 1) 2024-03-04T09:15:29.862 DEBUG:teuthology.orchestra.run.smithi082:> return files[0] 2024-03-04T09:15:29.862 DEBUG:teuthology.orchestra.run.smithi082:> 2024-03-04T09:15:29.862 DEBUG:teuthology.orchestra.run.smithi082:> for f in files: 2024-03-04T09:15:29.862 DEBUG:teuthology.orchestra.run.smithi082:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-04T09:15:29.862 DEBUG:teuthology.orchestra.run.smithi082:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-04T09:15:29.862 DEBUG:teuthology.orchestra.run.smithi082:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-04T09:15:29.862 DEBUG:teuthology.orchestra.run.smithi082:> contents = proc_f.read() 2024-03-04T09:15:29.862 DEBUG:teuthology.orchestra.run.smithi082:> if mountpoint in contents: 2024-03-04T09:15:29.862 DEBUG:teuthology.orchestra.run.smithi082:> return f 2024-03-04T09:15:29.862 DEBUG:teuthology.orchestra.run.smithi082:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-04T09:15:29.862 DEBUG:teuthology.orchestra.run.smithi082:> 2024-03-04T09:15:29.862 DEBUG:teuthology.orchestra.run.smithi082:> print(_find_admin_socket("client.0")) 2024-03-04T09:15:29.862 DEBUG:teuthology.orchestra.run.smithi082:> ' 2024-03-04T09:15:29.992 INFO:teuthology.orchestra.run.smithi082.stdout:/var/run/ceph/ceph-client.0.86598.asok 2024-03-04T09:15:29.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-04T09:15:30.003 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.86598.asok 2024-03-04T09:15:30.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T09:15:30.003 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.86598.asok status 2024-03-04T09:15:30.154 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-04T09:15:30.155 INFO:teuthology.orchestra.run.smithi082.stdout: "metadata": { 2024-03-04T09:15:30.155 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_sha1": "1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd", 2024-03-04T09:15:30.155 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_version": "ceph version 19.0.0-1739-g1bc250c7 (1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd) squid (dev)", 2024-03-04T09:15:30.155 INFO:teuthology.orchestra.run.smithi082.stdout: "entity_id": "0", 2024-03-04T09:15:30.155 INFO:teuthology.orchestra.run.smithi082.stdout: "hostname": "smithi082", 2024-03-04T09:15:30.155 INFO:teuthology.orchestra.run.smithi082.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-03-04T09:15:30.155 INFO:teuthology.orchestra.run.smithi082.stdout: "pid": "86598", 2024-03-04T09:15:30.155 INFO:teuthology.orchestra.run.smithi082.stdout: "root": "/volumes/qa/sv_0/13e71396-3e50-499b-895f-c2eff6f4bf3d" 2024-03-04T09:15:30.155 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:15:30.155 INFO:teuthology.orchestra.run.smithi082.stdout: "dentry_count": 0, 2024-03-04T09:15:30.155 INFO:teuthology.orchestra.run.smithi082.stdout: "dentry_pinned_count": 0, 2024-03-04T09:15:30.155 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 15507, 2024-03-04T09:15:30.155 INFO:teuthology.orchestra.run.smithi082.stdout: "inst": { 2024-03-04T09:15:30.155 INFO:teuthology.orchestra.run.smithi082.stdout: "name": { 2024-03-04T09:15:30.156 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "client", 2024-03-04T09:15:30.156 INFO:teuthology.orchestra.run.smithi082.stdout: "num": 15507 2024-03-04T09:15:30.156 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:15:30.156 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": { 2024-03-04T09:15:30.156 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v1", 2024-03-04T09:15:30.156 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "192.168.0.1:0", 2024-03-04T09:15:30.156 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 59413018 2024-03-04T09:15:30.156 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:15:30.156 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:15:30.156 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": { 2024-03-04T09:15:30.156 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v1", 2024-03-04T09:15:30.156 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "192.168.0.1:0", 2024-03-04T09:15:30.156 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 59413018 2024-03-04T09:15:30.156 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:15:30.157 INFO:teuthology.orchestra.run.smithi082.stdout: "inst_str": "client.15507 192.168.0.1:0/59413018", 2024-03-04T09:15:30.157 INFO:teuthology.orchestra.run.smithi082.stdout: "addr_str": "192.168.0.1:0/59413018", 2024-03-04T09:15:30.157 INFO:teuthology.orchestra.run.smithi082.stdout: "inode_count": 5, 2024-03-04T09:15:30.157 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_epoch": 27, 2024-03-04T09:15:30.157 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_epoch": 94, 2024-03-04T09:15:30.157 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_epoch_barrier": 0, 2024-03-04T09:15:30.157 INFO:teuthology.orchestra.run.smithi082.stdout: "blocklisted": false, 2024-03-04T09:15:30.157 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs" 2024-03-04T09:15:30.157 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-04T09:15:30.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T09:15:30.166 DEBUG:teuthology.orchestra.run.smithi082:> stat --file-system '--printf=%T 2024-03-04T09:15:30.166 DEBUG:teuthology.orchestra.run.smithi082:> ' -- /home/ubuntu/cephtest/mnt.0 2024-03-04T09:15:30.182 INFO:teuthology.orchestra.run.smithi082.stdout:fuseblk 2024-03-04T09:15:30.183 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-03-04T09:15:30.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T09:15:30.183 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-04T09:15:30.254 INFO:teuthology.run_tasks:Running task exec... 2024-03-04T09:15:30.285 INFO:teuthology.task.exec:Executing custom commands... 2024-03-04T09:15:30.286 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi082.front.sepia.ceph.com 2024-03-04T09:15:30.286 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-03-04T09:15:30.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:30.412+0000 7f4503b5e640 1 -- 172.21.15.82:0/1584809107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44fc100820 msgr2=0x7f44fc100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:30.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:30.412+0000 7f4503b5e640 1 --2- 172.21.15.82:0/1584809107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44fc100820 0x7f44fc100c80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f44ec009900 tx=0x7f44ec02bc30 comp rx=0 tx=0).stop 2024-03-04T09:15:30.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:30.412+0000 7f4503b5e640 1 -- 172.21.15.82:0/1584809107 shutdown_connections 2024-03-04T09:15:30.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:30.412+0000 7f4503b5e640 1 --2- 172.21.15.82:0/1584809107 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44fc1011c0 0x7f44fc101640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:30.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:30.412+0000 7f4503b5e640 1 --2- 172.21.15.82:0/1584809107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44fc100820 0x7f44fc100c80 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:30.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:30.412+0000 7f4503b5e640 1 --2- 172.21.15.82:0/1584809107 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44fc0ffec0 0x7f44fc1002e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:30.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:30.412+0000 7f4503b5e640 1 -- 172.21.15.82:0/1584809107 >> 172.21.15.82:0/1584809107 conn(0x7f44fc0fba60 msgr2=0x7f44fc0fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:30.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:30.412+0000 7f4503b5e640 1 -- 172.21.15.82:0/1584809107 shutdown_connections 2024-03-04T09:15:30.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:30.412+0000 7f4503b5e640 1 -- 172.21.15.82:0/1584809107 wait complete. 2024-03-04T09:15:30.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:30.413+0000 7f4503b5e640 1 Processor -- start 2024-03-04T09:15:30.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:30.413+0000 7f4503b5e640 1 -- start start 2024-03-04T09:15:30.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:30.413+0000 7f4503b5e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44fc0ffec0 0x7f44fc199a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:30.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:30.413+0000 7f4503b5e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44fc100820 0x7f44fc199f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:30.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:30.413+0000 7f4503b5e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44fc1011c0 0x7f44fc1a0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:30.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:30.413+0000 7f4503b5e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc10f460 con 0x7f44fc0ffec0 2024-03-04T09:15:30.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:30.413+0000 7f4503b5e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc10f2e0 con 0x7f44fc1011c0 2024-03-04T09:15:30.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:30.413+0000 7f4503b5e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc10f5e0 con 0x7f44fc100820 2024-03-04T09:15:30.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:30.413+0000 7f45018fa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44fc0ffec0 0x7f44fc199a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:30.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:30.413+0000 7f45018fa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44fc0ffec0 0x7f44fc199a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45776/0 (socket says 172.21.15.82:45776) 2024-03-04T09:15:30.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:30.413+0000 7f45018fa640 1 -- 172.21.15.82:0/3437475669 learned_addr learned my addr 172.21.15.82:0/3437475669 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:30.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:30.413+0000 7f45010f9640 1 --2- 172.21.15.82:0/3437475669 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44fc100820 0x7f44fc199f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:30.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:30.413+0000 7f45020fb640 1 --2- 172.21.15.82:0/3437475669 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44fc1011c0 0x7f44fc1a0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:30.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:30.413+0000 7f45018fa640 1 -- 172.21.15.82:0/3437475669 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44fc100820 msgr2=0x7f44fc199f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:30.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:30.413+0000 7f45018fa640 1 --2- 172.21.15.82:0/3437475669 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44fc100820 0x7f44fc199f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:30.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:30.413+0000 7f45018fa640 1 -- 172.21.15.82:0/3437475669 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44fc1011c0 msgr2=0x7f44fc1a0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:30.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:30.413+0000 7f45018fa640 1 --2- 172.21.15.82:0/3437475669 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44fc1011c0 0x7f44fc1a0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:30.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:30.413+0000 7f45018fa640 1 -- 172.21.15.82:0/3437475669 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44fc1a1640 con 0x7f44fc0ffec0 2024-03-04T09:15:30.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:30.413+0000 7f45018fa640 1 --2- 172.21.15.82:0/3437475669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44fc0ffec0 0x7f44fc199a20 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f44f800e9f0 tx=0x7f44f800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:30.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:30.414+0000 7f44f2ffd640 1 -- 172.21.15.82:0/3437475669 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f800cd80 con 0x7f44fc0ffec0 2024-03-04T09:15:30.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:30.414+0000 7f44f2ffd640 1 -- 172.21.15.82:0/3437475669 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f44f8010900 con 0x7f44fc0ffec0 2024-03-04T09:15:30.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:30.414+0000 7f4503b5e640 1 -- 172.21.15.82:0/3437475669 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44fc1a1930 con 0x7f44fc0ffec0 2024-03-04T09:15:30.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:30.414+0000 7f44f2ffd640 1 -- 172.21.15.82:0/3437475669 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f80189e0 con 0x7f44fc0ffec0 2024-03-04T09:15:30.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:30.414+0000 7f4503b5e640 1 -- 172.21.15.82:0/3437475669 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44fc1a1ea0 con 0x7f44fc0ffec0 2024-03-04T09:15:30.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:30.415+0000 7f4503b5e640 1 -- 172.21.15.82:0/3437475669 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44fc10ac10 con 0x7f44fc0ffec0 2024-03-04T09:15:30.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:30.416+0000 7f44f2ffd640 1 -- 172.21.15.82:0/3437475669 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f44f8010ab0 con 0x7f44fc0ffec0 2024-03-04T09:15:30.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:30.417+0000 7f44f2ffd640 1 --2- 172.21.15.82:0/3437475669 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f44e80a1ea0 0x7f44e80a4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:30.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:30.417+0000 7f45010f9640 1 --2- 172.21.15.82:0/3437475669 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f44e80a1ea0 0x7f44e80a4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:30.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:30.417+0000 7f44f2ffd640 1 -- 172.21.15.82:0/3437475669 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9179+0+0 (secure 0 0 0) 0x7f44f80ce3e0 con 0x7f44fc0ffec0 2024-03-04T09:15:30.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:30.417+0000 7f45010f9640 1 --2- 172.21.15.82:0/3437475669 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f44e80a1ea0 0x7f44e80a4360 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f44ec005ab0 tx=0x7f44ec005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:30.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:30.421+0000 7f44f2ffd640 1 -- 172.21.15.82:0/3437475669 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f44f809ae10 con 0x7f44fc0ffec0 2024-03-04T09:15:30.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:30.643+0000 7f4503b5e640 1 -- 172.21.15.82:0/3437475669 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) v1 -- 0x7f44fc062200 con 0x7f44fc0ffec0 2024-03-04T09:15:31.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.390+0000 7f44f2ffd640 1 -- 172.21.15.82:0/3437475669 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v28) v1 ==== 118+0+0 (secure 0 0 0) 0x7f44f809eeb0 con 0x7f44fc0ffec0 2024-03-04T09:15:31.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.392+0000 7f4503b5e640 1 -- 172.21.15.82:0/3437475669 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f44e80a1ea0 msgr2=0x7f44e80a4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:31.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.392+0000 7f4503b5e640 1 --2- 172.21.15.82:0/3437475669 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f44e80a1ea0 0x7f44e80a4360 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f44ec005ab0 tx=0x7f44ec005fd0 comp rx=0 tx=0).stop 2024-03-04T09:15:31.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.392+0000 7f4503b5e640 1 -- 172.21.15.82:0/3437475669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44fc0ffec0 msgr2=0x7f44fc199a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:31.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.392+0000 7f4503b5e640 1 --2- 172.21.15.82:0/3437475669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44fc0ffec0 0x7f44fc199a20 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f44f800e9f0 tx=0x7f44f800eeb0 comp rx=0 tx=0).stop 2024-03-04T09:15:31.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.392+0000 7f4503b5e640 1 -- 172.21.15.82:0/3437475669 shutdown_connections 2024-03-04T09:15:31.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.392+0000 7f4503b5e640 1 --2- 172.21.15.82:0/3437475669 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f44e80a1ea0 0x7f44e80a4360 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:31.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.392+0000 7f4503b5e640 1 --2- 172.21.15.82:0/3437475669 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44fc1011c0 0x7f44fc1a0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:31.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.392+0000 7f4503b5e640 1 --2- 172.21.15.82:0/3437475669 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44fc100820 0x7f44fc199f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:31.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.392+0000 7f4503b5e640 1 --2- 172.21.15.82:0/3437475669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44fc0ffec0 0x7f44fc199a20 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:31.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.392+0000 7f4503b5e640 1 -- 172.21.15.82:0/3437475669 >> 172.21.15.82:0/3437475669 conn(0x7f44fc0fba60 msgr2=0x7f44fc0fd560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:31.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.392+0000 7f4503b5e640 1 -- 172.21.15.82:0/3437475669 shutdown_connections 2024-03-04T09:15:31.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.393+0000 7f4503b5e640 1 -- 172.21.15.82:0/3437475669 wait complete. 2024-03-04T09:15:31.401 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-03-04T09:15:31.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.511+0000 7f11aaa66640 1 -- 172.21.15.82:0/516921865 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11a41016e0 msgr2=0x7f11a4101b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:31.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.511+0000 7f11aaa66640 1 --2- 172.21.15.82:0/516921865 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11a41016e0 0x7f11a4101b60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1194009900 tx=0x7f119402bc30 comp rx=0 tx=0).stop 2024-03-04T09:15:31.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.511+0000 7f11aaa66640 1 -- 172.21.15.82:0/516921865 shutdown_connections 2024-03-04T09:15:31.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.511+0000 7f11aaa66640 1 --2- 172.21.15.82:0/516921865 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11a41020a0 0x7f11a4108930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:31.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.511+0000 7f11aaa66640 1 --2- 172.21.15.82:0/516921865 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11a41016e0 0x7f11a4101b60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:31.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.511+0000 7f11aaa66640 1 --2- 172.21.15.82:0/516921865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11a41004f0 0x7f11a4100910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:31.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.511+0000 7f11aaa66640 1 -- 172.21.15.82:0/516921865 >> 172.21.15.82:0/516921865 conn(0x7f11a40fba60 msgr2=0x7f11a40fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:31.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.511+0000 7f11aaa66640 1 -- 172.21.15.82:0/516921865 shutdown_connections 2024-03-04T09:15:31.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.511+0000 7f11aaa66640 1 -- 172.21.15.82:0/516921865 wait complete. 2024-03-04T09:15:31.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.511+0000 7f11aaa66640 1 Processor -- start 2024-03-04T09:15:31.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.511+0000 7f11aaa66640 1 -- start start 2024-03-04T09:15:31.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.511+0000 7f11aaa66640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11a41004f0 0x7f11a4199a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:31.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.511+0000 7f11aaa66640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11a41016e0 0x7f11a4199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:31.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.511+0000 7f11aaa66640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11a41020a0 0x7f11a41a1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:31.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.511+0000 7f11aaa66640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a410c150 con 0x7f11a41004f0 2024-03-04T09:15:31.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.511+0000 7f11aaa66640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a410bfd0 con 0x7f11a41020a0 2024-03-04T09:15:31.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.511+0000 7f11aaa66640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a410c2d0 con 0x7f11a41016e0 2024-03-04T09:15:31.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.512+0000 7f11a8802640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11a41004f0 0x7f11a4199a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:31.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.512+0000 7f11a8802640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11a41004f0 0x7f11a4199a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45782/0 (socket says 172.21.15.82:45782) 2024-03-04T09:15:31.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.512+0000 7f11a8802640 1 -- 172.21.15.82:0/1138409616 learned_addr learned my addr 172.21.15.82:0/1138409616 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:31.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.512+0000 7f11a9003640 1 --2- 172.21.15.82:0/1138409616 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11a41020a0 0x7f11a41a1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:31.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.512+0000 7f11a3fff640 1 --2- 172.21.15.82:0/1138409616 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11a41016e0 0x7f11a4199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:31.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.512+0000 7f11a8802640 1 -- 172.21.15.82:0/1138409616 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11a41016e0 msgr2=0x7f11a4199fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:31.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.512+0000 7f11a8802640 1 --2- 172.21.15.82:0/1138409616 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11a41016e0 0x7f11a4199fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:31.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.512+0000 7f11a8802640 1 -- 172.21.15.82:0/1138409616 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11a41020a0 msgr2=0x7f11a41a1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:31.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.512+0000 7f11a8802640 1 --2- 172.21.15.82:0/1138409616 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11a41020a0 0x7f11a41a1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:31.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.512+0000 7f11a8802640 1 -- 172.21.15.82:0/1138409616 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a41a16b0 con 0x7f11a41004f0 2024-03-04T09:15:31.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.512+0000 7f11a9003640 1 --2- 172.21.15.82:0/1138409616 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11a41020a0 0x7f11a41a1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:15:31.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.512+0000 7f11a8802640 1 --2- 172.21.15.82:0/1138409616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11a41004f0 0x7f11a4199a90 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f119c00ebc0 tx=0x7f119c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:31.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.512+0000 7f11a1ffb640 1 -- 172.21.15.82:0/1138409616 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119c003b70 con 0x7f11a41004f0 2024-03-04T09:15:31.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.512+0000 7f11aaa66640 1 -- 172.21.15.82:0/1138409616 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11a41a19a0 con 0x7f11a41004f0 2024-03-04T09:15:31.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.512+0000 7f11a1ffb640 1 -- 172.21.15.82:0/1138409616 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f119c003d10 con 0x7f11a41004f0 2024-03-04T09:15:31.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.512+0000 7f11a1ffb640 1 -- 172.21.15.82:0/1138409616 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119c019860 con 0x7f11a41004f0 2024-03-04T09:15:31.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.512+0000 7f11aaa66640 1 -- 172.21.15.82:0/1138409616 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11a41a1ec0 con 0x7f11a41004f0 2024-03-04T09:15:31.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.513+0000 7f11aaa66640 1 -- 172.21.15.82:0/1138409616 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11a404f330 con 0x7f11a41004f0 2024-03-04T09:15:31.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.514+0000 7f11a1ffb640 1 -- 172.21.15.82:0/1138409616 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 136756+0+0 (secure 0 0 0) 0x7f119c019a00 con 0x7f11a41004f0 2024-03-04T09:15:31.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.515+0000 7f11a1ffb640 1 --2- 172.21.15.82:0/1138409616 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f11900a1e20 0x7f11900a42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:31.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.515+0000 7f11a3fff640 1 --2- 172.21.15.82:0/1138409616 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f11900a1e20 0x7f11900a42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:31.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.515+0000 7f11a1ffb640 1 -- 172.21.15.82:0/1138409616 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9179+0+0 (secure 0 0 0) 0x7f119c0cea60 con 0x7f11a41004f0 2024-03-04T09:15:31.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.515+0000 7f11a3fff640 1 --2- 172.21.15.82:0/1138409616 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f11900a1e20 0x7f11900a42e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1194005ab0 tx=0x7f1194005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:31.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.519+0000 7f11a1ffb640 1 -- 172.21.15.82:0/1138409616 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f119c09bae0 con 0x7f11a41004f0 2024-03-04T09:15:31.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:31 smithi082 ceph-mon[32880]: pgmap v363: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s; 1 B/s, 0 objects/s recovering 2024-03-04T09:15:31.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:31 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/3437475669' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-03-04T09:15:31.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:31 smithi190 ceph-mon[36341]: pgmap v363: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s; 1 B/s, 0 objects/s recovering 2024-03-04T09:15:31.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:31 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/3437475669' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-03-04T09:15:31.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:31 smithi102 ceph-mon[36220]: pgmap v363: 129 pgs: 129 active+clean; 644 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s; 1 B/s, 0 objects/s recovering 2024-03-04T09:15:31.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:31 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/3437475669' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-03-04T09:15:31.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.719+0000 7f11aaa66640 1 -- 172.21.15.82:0/1138409616 --> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) v1 -- 0x7f11a40fdbd0 con 0x7f11900a1e20 2024-03-04T09:15:31.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.729+0000 7f11a1ffb640 1 -- 172.21.15.82:0/1138409616 <== mgr.14152 v2:172.21.15.82:6800/1278635224 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3 (secure 0 0 0) 0x7f11a40fdbd0 con 0x7f11900a1e20 2024-03-04T09:15:31.726 INFO:teuthology.orchestra.run.smithi082.stdout:{} 2024-03-04T09:15:31.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.731+0000 7f11aaa66640 1 -- 172.21.15.82:0/1138409616 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f11900a1e20 msgr2=0x7f11900a42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:31.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.731+0000 7f11aaa66640 1 --2- 172.21.15.82:0/1138409616 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f11900a1e20 0x7f11900a42e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1194005ab0 tx=0x7f1194005fd0 comp rx=0 tx=0).stop 2024-03-04T09:15:31.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.731+0000 7f11aaa66640 1 -- 172.21.15.82:0/1138409616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11a41004f0 msgr2=0x7f11a4199a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:31.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.731+0000 7f11aaa66640 1 --2- 172.21.15.82:0/1138409616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11a41004f0 0x7f11a4199a90 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f119c00ebc0 tx=0x7f119c00c6a0 comp rx=0 tx=0).stop 2024-03-04T09:15:31.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.731+0000 7f11aaa66640 1 -- 172.21.15.82:0/1138409616 shutdown_connections 2024-03-04T09:15:31.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.731+0000 7f11aaa66640 1 --2- 172.21.15.82:0/1138409616 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f11900a1e20 0x7f11900a42e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:31.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.731+0000 7f11aaa66640 1 --2- 172.21.15.82:0/1138409616 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11a41020a0 0x7f11a41a1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:31.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.731+0000 7f11aaa66640 1 --2- 172.21.15.82:0/1138409616 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11a41016e0 0x7f11a4199fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:31.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.731+0000 7f11aaa66640 1 --2- 172.21.15.82:0/1138409616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11a41004f0 0x7f11a4199a90 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:31.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.731+0000 7f11aaa66640 1 -- 172.21.15.82:0/1138409616 >> 172.21.15.82:0/1138409616 conn(0x7f11a40fba60 msgr2=0x7f11a40fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:31.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.732+0000 7f11aaa66640 1 -- 172.21.15.82:0/1138409616 shutdown_connections 2024-03-04T09:15:31.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.732+0000 7f11aaa66640 1 -- 172.21.15.82:0/1138409616 wait complete. 2024-03-04T09:15:31.739 INFO:teuthology.run_tasks:Running task check-counter... 2024-03-04T09:15:31.750 INFO:teuthology.run_tasks:Running task exec... 2024-03-04T09:15:31.769 INFO:teuthology.task.exec:Executing custom commands... 2024-03-04T09:15:31.769 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi082.front.sepia.ceph.com 2024-03-04T09:15:31.770 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-03-04T09:15:31.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.875+0000 7ffaed40e640 1 -- 172.21.15.82:0/2961752856 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffae81020a0 msgr2=0x7ffae8108930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:31.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.875+0000 7ffaed40e640 1 --2- 172.21.15.82:0/2961752856 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffae81020a0 0x7ffae8108930 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ffae0009900 tx=0x7ffae002bc30 comp rx=0 tx=0).stop 2024-03-04T09:15:31.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.875+0000 7ffaed40e640 1 -- 172.21.15.82:0/2961752856 shutdown_connections 2024-03-04T09:15:31.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.875+0000 7ffaed40e640 1 --2- 172.21.15.82:0/2961752856 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffae81020a0 0x7ffae8108930 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:31.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.875+0000 7ffaed40e640 1 --2- 172.21.15.82:0/2961752856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffae81016e0 0x7ffae8101b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:31.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.875+0000 7ffaed40e640 1 --2- 172.21.15.82:0/2961752856 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffae81004f0 0x7ffae8100910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:31.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.875+0000 7ffaed40e640 1 -- 172.21.15.82:0/2961752856 >> 172.21.15.82:0/2961752856 conn(0x7ffae80fba60 msgr2=0x7ffae80fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:31.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.876+0000 7ffaed40e640 1 -- 172.21.15.82:0/2961752856 shutdown_connections 2024-03-04T09:15:31.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.876+0000 7ffaed40e640 1 -- 172.21.15.82:0/2961752856 wait complete. 2024-03-04T09:15:31.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.876+0000 7ffaed40e640 1 Processor -- start 2024-03-04T09:15:31.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.876+0000 7ffaed40e640 1 -- start start 2024-03-04T09:15:31.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.876+0000 7ffaed40e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffae81004f0 0x7ffae8197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:31.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.876+0000 7ffaed40e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffae81016e0 0x7ffae8197d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:31.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.876+0000 7ffaed40e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffae81020a0 0x7ffae819edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:31.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.876+0000 7ffaed40e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae810d260 con 0x7ffae81016e0 2024-03-04T09:15:31.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.876+0000 7ffaed40e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae810d0e0 con 0x7ffae81004f0 2024-03-04T09:15:31.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.876+0000 7ffaed40e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae810d3e0 con 0x7ffae81020a0 2024-03-04T09:15:31.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.877+0000 7ffae67fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffae81016e0 0x7ffae8197d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:31.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.877+0000 7ffae6ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffae81004f0 0x7ffae8197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:31.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.877+0000 7ffae67fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffae81016e0 0x7ffae8197d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45814/0 (socket says 172.21.15.82:45814) 2024-03-04T09:15:31.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.877+0000 7ffae67fc640 1 -- 172.21.15.82:0/1521022528 learned_addr learned my addr 172.21.15.82:0/1521022528 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:31.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.877+0000 7ffae77fe640 1 --2- 172.21.15.82:0/1521022528 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffae81020a0 0x7ffae819edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:31.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.877+0000 7ffae67fc640 1 -- 172.21.15.82:0/1521022528 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffae81020a0 msgr2=0x7ffae819edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:31.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.877+0000 7ffae67fc640 1 --2- 172.21.15.82:0/1521022528 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffae81020a0 0x7ffae819edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:31.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.877+0000 7ffae67fc640 1 -- 172.21.15.82:0/1521022528 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffae81004f0 msgr2=0x7ffae8197840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:31.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.877+0000 7ffae67fc640 1 --2- 172.21.15.82:0/1521022528 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffae81004f0 0x7ffae8197840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:31.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.877+0000 7ffae67fc640 1 -- 172.21.15.82:0/1521022528 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae819f460 con 0x7ffae81016e0 2024-03-04T09:15:31.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.877+0000 7ffae6ffd640 1 --2- 172.21.15.82:0/1521022528 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffae81004f0 0x7ffae8197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:15:31.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.877+0000 7ffae67fc640 1 --2- 172.21.15.82:0/1521022528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffae81016e0 0x7ffae8197d80 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ffadc00e9f0 tx=0x7ffadc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:31.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.877+0000 7ffacffff640 1 -- 172.21.15.82:0/1521022528 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffadc00cd80 con 0x7ffae81016e0 2024-03-04T09:15:31.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.877+0000 7ffaed40e640 1 -- 172.21.15.82:0/1521022528 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffae819f750 con 0x7ffae81016e0 2024-03-04T09:15:31.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.877+0000 7ffacffff640 1 -- 172.21.15.82:0/1521022528 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7ffadc010900 con 0x7ffae81016e0 2024-03-04T09:15:31.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.877+0000 7ffacffff640 1 -- 172.21.15.82:0/1521022528 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffadc0189e0 con 0x7ffae81016e0 2024-03-04T09:15:31.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.877+0000 7ffaed40e640 1 -- 172.21.15.82:0/1521022528 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffae819fca0 con 0x7ffae81016e0 2024-03-04T09:15:31.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.878+0000 7ffaed40e640 1 -- 172.21.15.82:0/1521022528 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffae81077b0 con 0x7ffae81016e0 2024-03-04T09:15:31.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.879+0000 7ffacffff640 1 -- 172.21.15.82:0/1521022528 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 136756+0+0 (secure 0 0 0) 0x7ffadc010ab0 con 0x7ffae81016e0 2024-03-04T09:15:31.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.880+0000 7ffacffff640 1 --2- 172.21.15.82:0/1521022528 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ffad00a1e20 0x7ffad00a42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:31.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.880+0000 7ffae6ffd640 1 --2- 172.21.15.82:0/1521022528 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ffad00a1e20 0x7ffad00a42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:31.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.880+0000 7ffacffff640 1 -- 172.21.15.82:0/1521022528 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9179+0+0 (secure 0 0 0) 0x7ffadc0ce910 con 0x7ffae81016e0 2024-03-04T09:15:31.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.881+0000 7ffae6ffd640 1 --2- 172.21.15.82:0/1521022528 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ffad00a1e20 0x7ffad00a42e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ffae8101540 tx=0x7ffad8009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:31.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:31.884+0000 7ffacffff640 1 -- 172.21.15.82:0/1521022528 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7ffadc09b340 con 0x7ffae81016e0 2024-03-04T09:15:32.068 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:15:31 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:15:31.723+0000 7f119a718700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T09:15:32.068 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:15:31 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:15:31.723+0000 7f119a718700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T09:15:32.068 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:15:31 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:15:31.723+0000 7f119a718700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T09:15:32.068 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:15:31 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:15:31.723+0000 7f119a718700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T09:15:32.068 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:15:31 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:15:31.723+0000 7f119a718700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T09:15:32.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.104+0000 7ffaed40e640 1 -- 172.21.15.82:0/1521022528 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7ffae802d180 con 0x7ffae81016e0 2024-03-04T09:15:32.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.399+0000 7ffacffff640 1 -- 172.21.15.82:0/1521022528 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) v1 ==== 92+0+0 (secure 0 0 0) 0x7ffadc09f3e0 con 0x7ffae81016e0 2024-03-04T09:15:32.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.402+0000 7ffaed40e640 1 -- 172.21.15.82:0/1521022528 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ffad00a1e20 msgr2=0x7ffad00a42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:32.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.402+0000 7ffaed40e640 1 --2- 172.21.15.82:0/1521022528 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ffad00a1e20 0x7ffad00a42e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ffae8101540 tx=0x7ffad8009500 comp rx=0 tx=0).stop 2024-03-04T09:15:32.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.402+0000 7ffaed40e640 1 -- 172.21.15.82:0/1521022528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffae81016e0 msgr2=0x7ffae8197d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:32.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.402+0000 7ffaed40e640 1 --2- 172.21.15.82:0/1521022528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffae81016e0 0x7ffae8197d80 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ffadc00e9f0 tx=0x7ffadc00eeb0 comp rx=0 tx=0).stop 2024-03-04T09:15:32.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.402+0000 7ffaed40e640 1 -- 172.21.15.82:0/1521022528 shutdown_connections 2024-03-04T09:15:32.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.402+0000 7ffaed40e640 1 --2- 172.21.15.82:0/1521022528 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7ffad00a1e20 0x7ffad00a42e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:32.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.402+0000 7ffaed40e640 1 --2- 172.21.15.82:0/1521022528 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffae81020a0 0x7ffae819edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:32.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.402+0000 7ffaed40e640 1 --2- 172.21.15.82:0/1521022528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffae81016e0 0x7ffae8197d80 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:32.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.402+0000 7ffaed40e640 1 --2- 172.21.15.82:0/1521022528 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffae81004f0 0x7ffae8197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:32.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.402+0000 7ffaed40e640 1 -- 172.21.15.82:0/1521022528 >> 172.21.15.82:0/1521022528 conn(0x7ffae80fba60 msgr2=0x7ffae8104980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:32.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.402+0000 7ffaed40e640 1 -- 172.21.15.82:0/1521022528 shutdown_connections 2024-03-04T09:15:32.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.402+0000 7ffaed40e640 1 -- 172.21.15.82:0/1521022528 wait complete. 2024-03-04T09:15:32.416 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-03-04T09:15:32.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.528+0000 7f7b7211e640 1 -- 172.21.15.82:0/3642148658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b6c1004f0 msgr2=0x7f7b6c100910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:32.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.528+0000 7f7b7211e640 1 --2- 172.21.15.82:0/3642148658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b6c1004f0 0x7f7b6c100910 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f7b64009ca0 tx=0x7f7b6402c0f0 comp rx=0 tx=0).stop 2024-03-04T09:15:32.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.528+0000 7f7b7211e640 1 -- 172.21.15.82:0/3642148658 shutdown_connections 2024-03-04T09:15:32.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.528+0000 7f7b7211e640 1 --2- 172.21.15.82:0/3642148658 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b6c1020a0 0x7f7b6c108930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:32.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.528+0000 7f7b7211e640 1 --2- 172.21.15.82:0/3642148658 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7b6c1016e0 0x7f7b6c101b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:32.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.528+0000 7f7b7211e640 1 --2- 172.21.15.82:0/3642148658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b6c1004f0 0x7f7b6c100910 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:32.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.528+0000 7f7b7211e640 1 -- 172.21.15.82:0/3642148658 >> 172.21.15.82:0/3642148658 conn(0x7f7b6c0fba60 msgr2=0x7f7b6c0fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:32.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.528+0000 7f7b7211e640 1 -- 172.21.15.82:0/3642148658 shutdown_connections 2024-03-04T09:15:32.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.528+0000 7f7b7211e640 1 -- 172.21.15.82:0/3642148658 wait complete. 2024-03-04T09:15:32.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.529+0000 7f7b7211e640 1 Processor -- start 2024-03-04T09:15:32.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.529+0000 7f7b7211e640 1 -- start start 2024-03-04T09:15:32.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.529+0000 7f7b7211e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b6c1004f0 0x7f7b6c1978d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:32.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.529+0000 7f7b7211e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b6c1016e0 0x7f7b6c197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:32.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.529+0000 7f7b7211e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7b6c1020a0 0x7f7b6c19ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:32.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.529+0000 7f7b7211e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6c10c150 con 0x7f7b6c1016e0 2024-03-04T09:15:32.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.529+0000 7f7b7211e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6c10bfd0 con 0x7f7b6c1004f0 2024-03-04T09:15:32.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.529+0000 7f7b7211e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6c10c2d0 con 0x7f7b6c1020a0 2024-03-04T09:15:32.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.529+0000 7f7b6affd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b6c1016e0 0x7f7b6c197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:32.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.529+0000 7f7b6affd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b6c1016e0 0x7f7b6c197e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45844/0 (socket says 172.21.15.82:45844) 2024-03-04T09:15:32.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.529+0000 7f7b6affd640 1 -- 172.21.15.82:0/307163212 learned_addr learned my addr 172.21.15.82:0/307163212 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:32.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.529+0000 7f7b6b7fe640 1 --2- 172.21.15.82:0/307163212 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b6c1004f0 0x7f7b6c1978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:32.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.529+0000 7f7b6bfff640 1 --2- 172.21.15.82:0/307163212 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7b6c1020a0 0x7f7b6c19ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:32.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.530+0000 7f7b6affd640 1 -- 172.21.15.82:0/307163212 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7b6c1020a0 msgr2=0x7f7b6c19ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:32.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.530+0000 7f7b6affd640 1 --2- 172.21.15.82:0/307163212 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7b6c1020a0 0x7f7b6c19ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:32.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.530+0000 7f7b6affd640 1 -- 172.21.15.82:0/307163212 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b6c1004f0 msgr2=0x7f7b6c1978d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:32.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.530+0000 7f7b6affd640 1 --2- 172.21.15.82:0/307163212 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b6c1004f0 0x7f7b6c1978d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:32.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.530+0000 7f7b6affd640 1 -- 172.21.15.82:0/307163212 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b6c19f4a0 con 0x7f7b6c1016e0 2024-03-04T09:15:32.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.530+0000 7f7b6affd640 1 --2- 172.21.15.82:0/307163212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b6c1016e0 0x7f7b6c197e10 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f7b5400e9f0 tx=0x7f7b5400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:32.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.530+0000 7f7b68ff9640 1 -- 172.21.15.82:0/307163212 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5400cd80 con 0x7f7b6c1016e0 2024-03-04T09:15:32.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.530+0000 7f7b68ff9640 1 -- 172.21.15.82:0/307163212 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f7b540054f0 con 0x7f7b6c1016e0 2024-03-04T09:15:32.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.530+0000 7f7b7211e640 1 -- 172.21.15.82:0/307163212 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b6c19f790 con 0x7f7b6c1016e0 2024-03-04T09:15:32.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.530+0000 7f7b68ff9640 1 -- 172.21.15.82:0/307163212 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b54010690 con 0x7f7b6c1016e0 2024-03-04T09:15:32.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.530+0000 7f7b7211e640 1 -- 172.21.15.82:0/307163212 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b6c19fc90 con 0x7f7b6c1016e0 2024-03-04T09:15:32.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.531+0000 7f7b7211e640 1 -- 172.21.15.82:0/307163212 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b6c19ff50 con 0x7f7b6c1016e0 2024-03-04T09:15:32.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.532+0000 7f7b68ff9640 1 -- 172.21.15.82:0/307163212 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 136773+0+0 (secure 0 0 0) 0x7f7b54004f00 con 0x7f7b6c1016e0 2024-03-04T09:15:32.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.533+0000 7f7b68ff9640 1 --2- 172.21.15.82:0/307163212 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f7b580a1e70 0x7f7b580a4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:32.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.533+0000 7f7b6b7fe640 1 -- 172.21.15.82:0/307163212 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f7b580a1e70 msgr2=0x7f7b580a4330 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/1278635224 2024-03-04T09:15:32.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.533+0000 7f7b68ff9640 1 -- 172.21.15.82:0/307163212 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9179+0+0 (secure 0 0 0) 0x7f7b540ce790 con 0x7f7b6c1016e0 2024-03-04T09:15:32.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.533+0000 7f7b6b7fe640 1 --2- 172.21.15.82:0/307163212 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f7b580a1e70 0x7f7b580a4330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-04T09:15:32.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.541+0000 7f7b68ff9640 1 -- 172.21.15.82:0/307163212 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f7b54053280 con 0x7f7b6c1016e0 2024-03-04T09:15:32.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:32 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/3437475669' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-03-04T09:15:32.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:32 smithi190 ceph-mon[36341]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:15:32.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:32 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/1521022528' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-03-04T09:15:32.671 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:15:32 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z[38195]: ignoring --setuser ceph since I am not root 2024-03-04T09:15:32.671 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:15:32 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z[38195]: ignoring --setgroup ceph since I am not root 2024-03-04T09:15:32.671 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:15:32 smithi190 ceph-mgr[38199]: -- 172.21.15.190:0/2278004344 <== mon.1 v2:172.21.15.190:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x560e38dfe5a0 con 0x560e38dd2c00 2024-03-04T09:15:32.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:32 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/3437475669' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-03-04T09:15:32.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:32 smithi102 ceph-mon[36220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:15:32.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:32 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/1521022528' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-03-04T09:15:32.679 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:15:32 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-y[37603]: ignoring --setuser ceph since I am not root 2024-03-04T09:15:32.679 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:15:32 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-y[37603]: ignoring --setgroup ceph since I am not root 2024-03-04T09:15:32.679 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:15:32 smithi102 ceph-mgr[37607]: -- 172.21.15.102:0/1586673443 <== mon.2 v2:172.21.15.102:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5609e87125a0 con 0x5609e86e7000 2024-03-04T09:15:32.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.722+0000 7f7b7211e640 1 -- 172.21.15.82:0/307163212 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f7b6c1a0650 con 0x7f7b6c1016e0 2024-03-04T09:15:32.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.726+0000 7f7b68ff9640 1 -- 172.21.15.82:0/307163212 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v27)=0 v27) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7b5409b810 con 0x7f7b6c1016e0 2024-03-04T09:15:32.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.728+0000 7f7b7211e640 1 -- 172.21.15.82:0/307163212 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f7b580a1e70 msgr2=0x7f7b580a4330 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-04T09:15:32.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.728+0000 7f7b7211e640 1 --2- 172.21.15.82:0/307163212 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f7b580a1e70 0x7f7b580a4330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:32.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.728+0000 7f7b7211e640 1 -- 172.21.15.82:0/307163212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b6c1016e0 msgr2=0x7f7b6c197e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:32.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.728+0000 7f7b7211e640 1 --2- 172.21.15.82:0/307163212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b6c1016e0 0x7f7b6c197e10 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f7b5400e9f0 tx=0x7f7b5400edf0 comp rx=0 tx=0).stop 2024-03-04T09:15:32.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.728+0000 7f7b7211e640 1 -- 172.21.15.82:0/307163212 shutdown_connections 2024-03-04T09:15:32.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.728+0000 7f7b7211e640 1 --2- 172.21.15.82:0/307163212 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f7b580a1e70 0x7f7b580a4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:32.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.728+0000 7f7b7211e640 1 --2- 172.21.15.82:0/307163212 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7b6c1020a0 0x7f7b6c19ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:32.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.728+0000 7f7b7211e640 1 --2- 172.21.15.82:0/307163212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b6c1016e0 0x7f7b6c197e10 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:32.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.728+0000 7f7b7211e640 1 --2- 172.21.15.82:0/307163212 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b6c1004f0 0x7f7b6c1978d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:32.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.728+0000 7f7b7211e640 1 -- 172.21.15.82:0/307163212 >> 172.21.15.82:0/307163212 conn(0x7f7b6c0fba60 msgr2=0x7f7b6c0fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:32.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.728+0000 7f7b7211e640 1 -- 172.21.15.82:0/307163212 shutdown_connections 2024-03-04T09:15:32.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.728+0000 7f7b7211e640 1 -- 172.21.15.82:0/307163212 wait complete. 2024-03-04T09:15:32.735 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:32 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/3437475669' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-03-04T09:15:32.735 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:32 smithi082 ceph-mon[32880]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:15:32.735 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:32 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/1521022528' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-03-04T09:15:32.735 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:15:32 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: ignoring --setuser ceph since I am not root 2024-03-04T09:15:32.735 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:15:32 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: ignoring --setgroup ceph since I am not root 2024-03-04T09:15:32.736 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-03-04T09:15:32.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.844+0000 7f48dd065640 1 -- 172.21.15.82:0/2506623424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48d81004f0 msgr2=0x7f48d8100910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:32.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.844+0000 7f48dd065640 1 --2- 172.21.15.82:0/2506623424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48d81004f0 0x7f48d8100910 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f48c8009900 tx=0x7f48c802bc30 comp rx=0 tx=0).stop 2024-03-04T09:15:32.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.844+0000 7f48dd065640 1 -- 172.21.15.82:0/2506623424 shutdown_connections 2024-03-04T09:15:32.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.844+0000 7f48dd065640 1 --2- 172.21.15.82:0/2506623424 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48d81020a0 0x7f48d8108930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:32.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.844+0000 7f48dd065640 1 --2- 172.21.15.82:0/2506623424 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f48d81016e0 0x7f48d8101b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:32.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.844+0000 7f48dd065640 1 --2- 172.21.15.82:0/2506623424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48d81004f0 0x7f48d8100910 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:32.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.844+0000 7f48dd065640 1 -- 172.21.15.82:0/2506623424 >> 172.21.15.82:0/2506623424 conn(0x7f48d80fba60 msgr2=0x7f48d80fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:32.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.844+0000 7f48dd065640 1 -- 172.21.15.82:0/2506623424 shutdown_connections 2024-03-04T09:15:32.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.844+0000 7f48dd065640 1 -- 172.21.15.82:0/2506623424 wait complete. 2024-03-04T09:15:32.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.845+0000 7f48dd065640 1 Processor -- start 2024-03-04T09:15:32.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.845+0000 7f48dd065640 1 -- start start 2024-03-04T09:15:32.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.845+0000 7f48dd065640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f48d81004f0 0x7f48d8199aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:32.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.845+0000 7f48dd065640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48d81016e0 0x7f48d8199fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:32.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.845+0000 7f48dd065640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48d81020a0 0x7f48d81a1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:32.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.845+0000 7f48dd065640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d810c1a0 con 0x7f48d81020a0 2024-03-04T09:15:32.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.845+0000 7f48dd065640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d810c020 con 0x7f48d81016e0 2024-03-04T09:15:32.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.845+0000 7f48dd065640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d810c320 con 0x7f48d81004f0 2024-03-04T09:15:32.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.845+0000 7f48d759e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48d81020a0 0x7f48d81a1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:32.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.845+0000 7f48d759e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48d81020a0 0x7f48d81a1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45856/0 (socket says 172.21.15.82:45856) 2024-03-04T09:15:32.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.845+0000 7f48d759e640 1 -- 172.21.15.82:0/3382232227 learned_addr learned my addr 172.21.15.82:0/3382232227 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:32.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.845+0000 7f48d6d9d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f48d81004f0 0x7f48d8199aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:32.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.845+0000 7f48cffff640 1 --2- 172.21.15.82:0/3382232227 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48d81016e0 0x7f48d8199fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:32.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.845+0000 7f48d759e640 1 -- 172.21.15.82:0/3382232227 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f48d81004f0 msgr2=0x7f48d8199aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:32.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.845+0000 7f48d759e640 1 --2- 172.21.15.82:0/3382232227 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f48d81004f0 0x7f48d8199aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:32.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.845+0000 7f48d759e640 1 -- 172.21.15.82:0/3382232227 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48d81016e0 msgr2=0x7f48d8199fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:32.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.845+0000 7f48d759e640 1 --2- 172.21.15.82:0/3382232227 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48d81016e0 0x7f48d8199fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:32.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.845+0000 7f48d759e640 1 -- 172.21.15.82:0/3382232227 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d81a16c0 con 0x7f48d81020a0 2024-03-04T09:15:32.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.845+0000 7f48d759e640 1 --2- 172.21.15.82:0/3382232227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48d81020a0 0x7f48d81a1050 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f48d000eb10 tx=0x7f48d000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:32.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.846+0000 7f48d4d99640 1 -- 172.21.15.82:0/3382232227 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d0004b20 con 0x7f48d81020a0 2024-03-04T09:15:32.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.846+0000 7f48dd065640 1 -- 172.21.15.82:0/3382232227 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48d81a19b0 con 0x7f48d81020a0 2024-03-04T09:15:32.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.846+0000 7f48d4d99640 1 -- 172.21.15.82:0/3382232227 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f48d0004cc0 con 0x7f48d81020a0 2024-03-04T09:15:32.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.846+0000 7f48d4d99640 1 -- 172.21.15.82:0/3382232227 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d0010700 con 0x7f48d81020a0 2024-03-04T09:15:32.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.846+0000 7f48dd065640 1 -- 172.21.15.82:0/3382232227 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48d81a1eb0 con 0x7f48d81020a0 2024-03-04T09:15:32.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.847+0000 7f48dd065640 1 -- 172.21.15.82:0/3382232227 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48d81a2140 con 0x7f48d81020a0 2024-03-04T09:15:32.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.848+0000 7f48d4d99640 1 -- 172.21.15.82:0/3382232227 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 136773+0+0 (secure 0 0 0) 0x7f48d0004e70 con 0x7f48d81020a0 2024-03-04T09:15:32.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.848+0000 7f48d4d99640 1 --2- 172.21.15.82:0/3382232227 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f48c40a1e70 0x7f48c40a4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:32.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.848+0000 7f48d6d9d640 1 -- 172.21.15.82:0/3382232227 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f48c40a1e70 msgr2=0x7f48c40a4330 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/1278635224 2024-03-04T09:15:32.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.848+0000 7f48d4d99640 1 -- 172.21.15.82:0/3382232227 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9179+0+0 (secure 0 0 0) 0x7f48d00ce770 con 0x7f48d81020a0 2024-03-04T09:15:32.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.848+0000 7f48d6d9d640 1 --2- 172.21.15.82:0/3382232227 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f48c40a1e70 0x7f48c40a4330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-04T09:15:32.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:32.853+0000 7f48d4d99640 1 -- 172.21.15.82:0/3382232227 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f48d009b7f0 con 0x7f48d81020a0 2024-03-04T09:15:33.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.031+0000 7f48dd065640 1 -- 172.21.15.82:0/3382232227 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f48d81a2310 con 0x7f48d81020a0 2024-03-04T09:15:33.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.035+0000 7f48d4d99640 1 -- 172.21.15.82:0/3382232227 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v28)=0 v28) v1 ==== 133+0+0 (secure 0 0 0) 0x7f48d009b0f0 con 0x7f48d81020a0 2024-03-04T09:15:33.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.037+0000 7f48dd065640 1 -- 172.21.15.82:0/3382232227 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f48c40a1e70 msgr2=0x7f48c40a4330 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-04T09:15:33.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.037+0000 7f48dd065640 1 --2- 172.21.15.82:0/3382232227 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f48c40a1e70 0x7f48c40a4330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:33.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.037+0000 7f48dd065640 1 -- 172.21.15.82:0/3382232227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48d81020a0 msgr2=0x7f48d81a1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:33.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.037+0000 7f48dd065640 1 --2- 172.21.15.82:0/3382232227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48d81020a0 0x7f48d81a1050 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f48d000eb10 tx=0x7f48d000c2d0 comp rx=0 tx=0).stop 2024-03-04T09:15:33.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.038+0000 7f48dd065640 1 -- 172.21.15.82:0/3382232227 shutdown_connections 2024-03-04T09:15:33.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.038+0000 7f48dd065640 1 --2- 172.21.15.82:0/3382232227 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7f48c40a1e70 0x7f48c40a4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:33.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.038+0000 7f48dd065640 1 --2- 172.21.15.82:0/3382232227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48d81020a0 0x7f48d81a1050 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:33.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.038+0000 7f48dd065640 1 --2- 172.21.15.82:0/3382232227 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48d81016e0 0x7f48d8199fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:33.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.038+0000 7f48dd065640 1 --2- 172.21.15.82:0/3382232227 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f48d81004f0 0x7f48d8199aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:33.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.038+0000 7f48dd065640 1 -- 172.21.15.82:0/3382232227 >> 172.21.15.82:0/3382232227 conn(0x7f48d80fba60 msgr2=0x7f48d8068c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:33.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.038+0000 7f48dd065640 1 -- 172.21.15.82:0/3382232227 shutdown_connections 2024-03-04T09:15:33.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.038+0000 7f48dd065640 1 -- 172.21.15.82:0/3382232227 wait complete. 2024-03-04T09:15:33.045 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-03-04T09:15:33.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.154+0000 7fe7aecf4640 1 -- 172.21.15.82:0/2755576282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7a81020b0 msgr2=0x7fe7a8108940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:33.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.154+0000 7fe7aecf4640 1 --2- 172.21.15.82:0/2755576282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7a81020b0 0x7fe7a8108940 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0009ca0 tx=0x7fe7a002c0f0 comp rx=0 tx=0).stop 2024-03-04T09:15:33.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.154+0000 7fe7aecf4640 1 -- 172.21.15.82:0/2755576282 shutdown_connections 2024-03-04T09:15:33.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.154+0000 7fe7aecf4640 1 --2- 172.21.15.82:0/2755576282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7a81020b0 0x7fe7a8108940 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:33.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.154+0000 7fe7aecf4640 1 --2- 172.21.15.82:0/2755576282 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7a81016f0 0x7fe7a8101b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:33.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.154+0000 7fe7aecf4640 1 --2- 172.21.15.82:0/2755576282 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe7a8100500 0x7fe7a8100920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:33.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.154+0000 7fe7aecf4640 1 -- 172.21.15.82:0/2755576282 >> 172.21.15.82:0/2755576282 conn(0x7fe7a80fba90 msgr2=0x7fe7a80fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:33.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.154+0000 7fe7aecf4640 1 -- 172.21.15.82:0/2755576282 shutdown_connections 2024-03-04T09:15:33.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.154+0000 7fe7aecf4640 1 -- 172.21.15.82:0/2755576282 wait complete. 2024-03-04T09:15:33.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.155+0000 7fe7aecf4640 1 Processor -- start 2024-03-04T09:15:33.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.155+0000 7fe7aecf4640 1 -- start start 2024-03-04T09:15:33.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.155+0000 7fe7aecf4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe7a8100500 0x7fe7a8197810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:33.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.155+0000 7fe7aecf4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7a81016f0 0x7fe7a8197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:33.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.155+0000 7fe7aecf4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7a81020b0 0x7fe7a819edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:33.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.155+0000 7fe7aecf4640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a810c160 con 0x7fe7a81016f0 2024-03-04T09:15:33.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.155+0000 7fe7aecf4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a810bfe0 con 0x7fe7a81020b0 2024-03-04T09:15:33.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.155+0000 7fe7aecf4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a810c2e0 con 0x7fe7a8100500 2024-03-04T09:15:33.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.155+0000 7fe7a7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7a81016f0 0x7fe7a8197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:33.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.155+0000 7fe7a7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7a81016f0 0x7fe7a8197d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45872/0 (socket says 172.21.15.82:45872) 2024-03-04T09:15:33.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.155+0000 7fe7a7fff640 1 -- 172.21.15.82:0/2275305982 learned_addr learned my addr 172.21.15.82:0/2275305982 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:33.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.155+0000 7fe7aca90640 1 --2- 172.21.15.82:0/2275305982 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe7a8100500 0x7fe7a8197810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:33.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.155+0000 7fe7ad291640 1 --2- 172.21.15.82:0/2275305982 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7a81020b0 0x7fe7a819edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:33.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.155+0000 7fe7a7fff640 1 -- 172.21.15.82:0/2275305982 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe7a8100500 msgr2=0x7fe7a8197810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:33.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.155+0000 7fe7a7fff640 1 --2- 172.21.15.82:0/2275305982 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe7a8100500 0x7fe7a8197810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:33.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.155+0000 7fe7a7fff640 1 -- 172.21.15.82:0/2275305982 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7a81020b0 msgr2=0x7fe7a819edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:33.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.155+0000 7fe7a7fff640 1 --2- 172.21.15.82:0/2275305982 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7a81020b0 0x7fe7a819edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:33.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.155+0000 7fe7a7fff640 1 -- 172.21.15.82:0/2275305982 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a819f430 con 0x7fe7a81016f0 2024-03-04T09:15:33.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.155+0000 7fe7a7fff640 1 --2- 172.21.15.82:0/2275305982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7a81016f0 0x7fe7a8197d50 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fe79400ea60 tx=0x7fe79400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:33.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.156+0000 7fe7a5ffb640 1 -- 172.21.15.82:0/2275305982 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79400cde0 con 0x7fe7a81016f0 2024-03-04T09:15:33.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.156+0000 7fe7a5ffb640 1 -- 172.21.15.82:0/2275305982 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fe7940035f0 con 0x7fe7a81016f0 2024-03-04T09:15:33.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.156+0000 7fe7aecf4640 1 -- 172.21.15.82:0/2275305982 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7a819f720 con 0x7fe7a81016f0 2024-03-04T09:15:33.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.156+0000 7fe7a5ffb640 1 -- 172.21.15.82:0/2275305982 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe794010690 con 0x7fe7a81016f0 2024-03-04T09:15:33.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.156+0000 7fe7aecf4640 1 -- 172.21.15.82:0/2275305982 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7a819fc70 con 0x7fe7a81016f0 2024-03-04T09:15:33.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.157+0000 7fe7aecf4640 1 -- 172.21.15.82:0/2275305982 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7a819ff30 con 0x7fe7a81016f0 2024-03-04T09:15:33.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.158+0000 7fe7a5ffb640 1 -- 172.21.15.82:0/2275305982 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 136773+0+0 (secure 0 0 0) 0x7fe7940037a0 con 0x7fe7a81016f0 2024-03-04T09:15:33.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.158+0000 7fe7a5ffb640 1 --2- 172.21.15.82:0/2275305982 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fe7980a1e70 0x7fe7980a4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:33.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.158+0000 7fe7aca90640 1 -- 172.21.15.82:0/2275305982 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fe7980a1e70 msgr2=0x7fe7980a4330 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/1278635224 2024-03-04T09:15:33.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.158+0000 7fe7a5ffb640 1 -- 172.21.15.82:0/2275305982 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9179+0+0 (secure 0 0 0) 0x7fe7940ce490 con 0x7fe7a81016f0 2024-03-04T09:15:33.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.158+0000 7fe7aca90640 1 --2- 172.21.15.82:0/2275305982 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fe7980a1e70 0x7fe7980a4330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-04T09:15:33.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.163+0000 7fe7a5ffb640 1 -- 172.21.15.82:0/2275305982 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fe79409b510 con 0x7fe7a81016f0 2024-03-04T09:15:33.317 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:15:32 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:15:32.991+0000 7fa7e0e18200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-04T09:15:33.317 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:15:33 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:15:33.091+0000 7fa7e0e18200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-04T09:15:33.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.359+0000 7fe7aca90640 1 -- 172.21.15.82:0/2275305982 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fe7980a1e70 msgr2=0x7fe7980a4330 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/1278635224 2024-03-04T09:15:33.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.359+0000 7fe7aca90640 1 --2- 172.21.15.82:0/2275305982 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fe7980a1e70 0x7fe7980a4330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-04T09:15:33.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.361+0000 7fe7aecf4640 1 -- 172.21.15.82:0/2275305982 --> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) v1 -- 0x7fe7a80fdb90 con 0x7fe7980a1e70 2024-03-04T09:15:33.409 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:15:32 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-y[37603]: 2024-03-04T09:15:32.983+0000 7f4c38aa9200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-04T09:15:33.410 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:15:33 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-y[37603]: 2024-03-04T09:15:33.080+0000 7f4c38aa9200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-04T09:15:33.411 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:15:33 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z[38195]: 2024-03-04T09:15:33.113+0000 7fc52c730200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-04T09:15:33.411 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:15:33 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z[38195]: 2024-03-04T09:15:33.217+0000 7fc52c730200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-04T09:15:33.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:33 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/1521022528' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-03-04T09:15:33.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:33 smithi190 ceph-mon[36341]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-03-04T09:15:33.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:33 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/307163212' entity='client.admin' 2024-03-04T09:15:33.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:33 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/3382232227' entity='client.admin' 2024-03-04T09:15:33.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:33 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/1521022528' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-03-04T09:15:33.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:33 smithi102 ceph-mon[36220]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-03-04T09:15:33.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:33 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/307163212' entity='client.admin' 2024-03-04T09:15:33.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:33 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/3382232227' entity='client.admin' 2024-03-04T09:15:33.733 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:33 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/1521022528' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-03-04T09:15:33.733 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:33 smithi082 ceph-mon[32880]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-03-04T09:15:33.733 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:33 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/307163212' entity='client.admin' 2024-03-04T09:15:33.733 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:33 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/3382232227' entity='client.admin' 2024-03-04T09:15:33.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.760+0000 7fe7aca90640 1 -- 172.21.15.82:0/2275305982 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fe7980a1e70 msgr2=0x7fe7980a4330 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/1278635224 2024-03-04T09:15:33.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:33.760+0000 7fe7aca90640 1 --2- 172.21.15.82:0/2275305982 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fe7980a1e70 0x7fe7980a4330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-04T09:15:34.065 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:15:33 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:15:33.736+0000 7fa7e0e18200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-04T09:15:34.066 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:15:33 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:15:33.831+0000 7fa7e0e18200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-04T09:15:34.066 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:15:33 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:15:33.974+0000 7fa7e0e18200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-04T09:15:34.075 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:15:33 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-y[37603]: 2024-03-04T09:15:33.820+0000 7f4c38aa9200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-04T09:15:34.075 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:15:33 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-y[37603]: 2024-03-04T09:15:33.917+0000 7f4c38aa9200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-04T09:15:34.170 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:15:33 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z[38195]: 2024-03-04T09:15:33.902+0000 7fc52c730200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-04T09:15:34.171 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:15:34 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z[38195]: 2024-03-04T09:15:34.020+0000 7fc52c730200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-04T09:15:34.317 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:15:34 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:15:34.069+0000 7fa7e0e18200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-04T09:15:34.317 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:15:34 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:15:34.153+0000 7fa7e0e18200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-04T09:15:34.429 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:15:34 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-y[37603]: 2024-03-04T09:15:34.078+0000 7f4c38aa9200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-04T09:15:34.429 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:15:34 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-y[37603]: 2024-03-04T09:15:34.178+0000 7f4c38aa9200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-04T09:15:34.429 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:15:34 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-y[37603]: 2024-03-04T09:15:34.264+0000 7f4c38aa9200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-04T09:15:34.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:34.561+0000 7fe7aca90640 1 -- 172.21.15.82:0/2275305982 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fe7980a1e70 msgr2=0x7fe7980a4330 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/1278635224 2024-03-04T09:15:34.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:34.561+0000 7fe7aca90640 1 --2- 172.21.15.82:0/2275305982 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fe7980a1e70 0x7fe7980a4330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-04T09:15:34.672 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:15:34 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z[38195]: 2024-03-04T09:15:34.216+0000 7fc52c730200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-04T09:15:34.672 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:15:34 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z[38195]: 2024-03-04T09:15:34.352+0000 7fc52c730200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-04T09:15:34.672 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:15:34 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z[38195]: 2024-03-04T09:15:34.442+0000 7fc52c730200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-04T09:15:34.704 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:15:34 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:15:34.417+0000 7fa7e0e18200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-04T09:15:34.705 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:15:34 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:15:34.526+0000 7fa7e0e18200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-04T09:15:34.705 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:15:34 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:15:34.613+0000 7fa7e0e18200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-04T09:15:34.705 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:15:34 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:15:34.708+0000 7fa7e0e18200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-04T09:15:34.883 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:15:34 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-y[37603]: 2024-03-04T09:15:34.545+0000 7f4c38aa9200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-04T09:15:34.883 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:15:34 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-y[37603]: 2024-03-04T09:15:34.657+0000 7f4c38aa9200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-04T09:15:34.883 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:15:34 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-y[37603]: 2024-03-04T09:15:34.744+0000 7f4c38aa9200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-04T09:15:35.061 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:15:34 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z[38195]: 2024-03-04T09:15:34.743+0000 7fc52c730200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-04T09:15:35.062 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:15:34 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z[38195]: 2024-03-04T09:15:34.881+0000 7fc52c730200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-04T09:15:35.062 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:15:34 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z[38195]: 2024-03-04T09:15:34.968+0000 7fc52c730200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-04T09:15:35.062 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:15:35 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z[38195]: 2024-03-04T09:15:35.065+0000 7fc52c730200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-04T09:15:35.066 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:15:34 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:15:34.886+0000 7fa7e0e18200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-04T09:15:35.179 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:15:34 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-y[37603]: 2024-03-04T09:15:34.886+0000 7f4c38aa9200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-04T09:15:35.179 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:15:35 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-y[37603]: 2024-03-04T09:15:35.092+0000 7f4c38aa9200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-04T09:15:35.420 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:15:35 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z[38195]: 2024-03-04T09:15:35.274+0000 7fc52c730200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-04T09:15:36.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:36.162+0000 7fe7aca90640 1 -- 172.21.15.82:0/2275305982 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fe7980a1e70 msgr2=0x7fe7980a4330 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/1278635224 2024-03-04T09:15:36.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:36.162+0000 7fe7aca90640 1 --2- 172.21.15.82:0/2275305982 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fe7980a1e70 0x7fe7980a4330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-03-04T09:15:36.313 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:15:35 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:15:35.849+0000 7fa7e0e18200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-04T09:15:36.313 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:15:35 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:15:35.981+0000 7fa7e0e18200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-04T09:15:36.429 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:15:36 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-y[37603]: 2024-03-04T09:15:36.075+0000 7f4c38aa9200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-04T09:15:36.429 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:15:36 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-y[37603]: 2024-03-04T09:15:36.208+0000 7f4c38aa9200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-04T09:15:36.567 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:15:36 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:15:36.316+0000 7fa7e0e18200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-04T09:15:36.567 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:15:36 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:15:36.407+0000 7fa7e0e18200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-04T09:15:36.855 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:15:36 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-y[37603]: 2024-03-04T09:15:36.570+0000 7f4c38aa9200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-04T09:15:36.856 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:15:36 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-y[37603]: 2024-03-04T09:15:36.661+0000 7f4c38aa9200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-04T09:15:36.920 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:15:36 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z[38195]: 2024-03-04T09:15:36.471+0000 7fc52c730200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-04T09:15:36.920 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:15:36 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z[38195]: 2024-03-04T09:15:36.626+0000 7fc52c730200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-04T09:15:37.067 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:15:36 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:15:36.607+0000 7fa7e0e18200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-04T09:15:37.067 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:15:36 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:15:36.795+0000 7fa7e0e18200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-04T09:15:37.179 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:15:36 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-y[37603]: 2024-03-04T09:15:36.859+0000 7f4c38aa9200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-04T09:15:37.179 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:15:37 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-y[37603]: 2024-03-04T09:15:37.069+0000 7f4c38aa9200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-04T09:15:37.339 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:15:37 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:15:37.083+0000 7fa7e0e18200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-04T09:15:37.408 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:15:37 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z[38195]: 2024-03-04T09:15:37.026+0000 7fc52c730200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-04T09:15:37.409 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:15:37 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z[38195]: 2024-03-04T09:15:37.146+0000 7fc52c730200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-04T09:15:37.661 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:15:37 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-y[37603]: 2024-03-04T09:15:37.397+0000 7f4c38aa9200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-04T09:15:37.670 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:15:37 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z[38195]: 2024-03-04T09:15:37.412+0000 7fc52c730200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-04T09:15:37.671 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:15:37 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z[38195]: 2024-03-04T09:15:37.643+0000 7fc52c730200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-04T09:15:37.817 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:15:37 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:15:37.342+0000 7fa7e0e18200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-04T09:15:37.817 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:15:37 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:15:37.582+0000 7fa7e0e18200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-04T09:15:37.929 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:15:37 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-y[37603]: 2024-03-04T09:15:37.664+0000 7f4c38aa9200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-04T09:15:38.229 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:15:37 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z[38195]: 2024-03-04T09:15:37.956+0000 7fc52c730200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-04T09:15:38.429 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:15:37 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-y[37603]: 2024-03-04T09:15:37.953+0000 7f4c38aa9200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-04T09:15:38.536 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:15:38 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z[38195]: 2024-03-04T09:15:38.232+0000 7fc52c730200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-04T09:15:38.817 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:15:38 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:15:38.393+0000 7fa7e0e18200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-04T09:15:38.920 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:15:38 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z[38195]: 2024-03-04T09:15:38.540+0000 7fc52c730200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-04T09:15:39.179 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:15:38 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-y[37603]: 2024-03-04T09:15:38.883+0000 7f4c38aa9200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-04T09:15:39.284 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:15:38 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:15:38.966+0000 7fa7e0e18200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-04T09:15:39.284 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:15:39 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:15:39.066+0000 7fa7e0e18200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-04T09:15:39.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:39.312+0000 7fe7a5ffb640 1 -- 172.21.15.82:0/2275305982 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 20) v1 ==== 136441+0+0 (secure 0 0 0) 0x7fe794097480 con 0x7fe7a81016f0 2024-03-04T09:15:39.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:39.313+0000 7fe7a5ffb640 1 -- 172.21.15.82:0/2275305982 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fe7980a1e70 msgr2=0x7fe7980a4330 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-04T09:15:39.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:39.313+0000 7fe7a5ffb640 1 --2- 172.21.15.82:0/2275305982 >> [v2:172.21.15.82:6800/1278635224,v1:172.21.15.82:6801/1278635224] conn(0x7fe7980a1e70 0x7fe7980a4330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:39.550 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:15:39 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:15:39.288+0000 7fa7e0e18200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-04T09:15:39.550 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:39 smithi082 ceph-mon[32880]: Active manager daemon x restarted 2024-03-04T09:15:39.550 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:39 smithi082 ceph-mon[32880]: Activating manager daemon x 2024-03-04T09:15:39.550 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:39 smithi082 ceph-mon[32880]: osdmap e95: 12 total, 12 up, 12 in 2024-03-04T09:15:39.551 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:39 smithi082 ceph-mon[32880]: mgrmap e20: x(active, starting, since 0.0123565s), standbys: z, y 2024-03-04T09:15:39.551 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:39 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T09:15:39.551 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:39 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T09:15:39.551 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:39 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T09:15:39.551 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:39 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-03-04T09:15:39.551 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:39 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-03-04T09:15:39.551 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:39 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-04T09:15:39.551 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:39 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-04T09:15:39.551 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:39 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-03-04T09:15:39.551 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:39 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-04T09:15:39.551 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:39 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-03-04T09:15:39.551 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:39 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-04T09:15:39.551 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:39 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-04T09:15:39.551 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:39 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-03-04T09:15:39.552 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:39 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-04T09:15:39.552 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:39 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-04T09:15:39.552 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:39 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-04T09:15:39.552 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:39 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-03-04T09:15:39.552 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:39 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-04T09:15:39.552 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:39 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-04T09:15:39.552 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:39 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-04T09:15:39.552 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:39 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-04T09:15:39.552 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:39 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-04T09:15:39.552 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:39 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-04T09:15:39.552 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:39 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-04T09:15:39.552 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:39 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-04T09:15:39.552 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:39 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-04T09:15:39.553 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:39 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-04T09:15:39.553 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:39 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-04T09:15:39.553 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:39 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-04T09:15:39.553 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:39 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-04T09:15:39.553 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:39 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-04T09:15:39.553 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:39 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-04T09:15:39.553 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:39 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-04T09:15:39.553 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:39 smithi082 ceph-mon[32880]: Manager daemon x is now available 2024-03-04T09:15:39.606 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:39 smithi190 ceph-mon[36341]: Active manager daemon x restarted 2024-03-04T09:15:39.606 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:39 smithi190 ceph-mon[36341]: Activating manager daemon x 2024-03-04T09:15:39.606 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:39 smithi190 ceph-mon[36341]: osdmap e95: 12 total, 12 up, 12 in 2024-03-04T09:15:39.606 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:39 smithi190 ceph-mon[36341]: mgrmap e20: x(active, starting, since 0.0123565s), standbys: z, y 2024-03-04T09:15:39.606 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:39 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T09:15:39.606 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:39 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T09:15:39.606 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:39 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T09:15:39.607 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:39 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-03-04T09:15:39.607 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:39 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-03-04T09:15:39.607 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:39 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-04T09:15:39.607 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:39 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-04T09:15:39.607 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:39 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-03-04T09:15:39.607 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:39 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-04T09:15:39.607 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:39 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-03-04T09:15:39.607 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:39 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-04T09:15:39.607 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:39 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-04T09:15:39.607 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:39 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-03-04T09:15:39.608 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:39 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-04T09:15:39.608 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:39 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-04T09:15:39.608 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:39 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-04T09:15:39.608 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:39 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-03-04T09:15:39.608 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:39 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-04T09:15:39.608 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:39 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-04T09:15:39.608 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:39 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-04T09:15:39.608 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:39 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-04T09:15:39.608 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:39 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-04T09:15:39.608 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:39 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-04T09:15:39.609 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:39 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-04T09:15:39.609 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:39 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-04T09:15:39.609 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:39 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-04T09:15:39.609 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:39 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-04T09:15:39.609 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:39 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-04T09:15:39.609 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:39 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-04T09:15:39.609 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:39 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-04T09:15:39.609 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:39 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-04T09:15:39.609 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:39 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-04T09:15:39.609 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:39 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-04T09:15:39.609 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:39 smithi190 ceph-mon[36341]: Manager daemon x is now available 2024-03-04T09:15:39.679 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:15:39 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-y[37603]: 2024-03-04T09:15:39.565+0000 7f4c38aa9200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-04T09:15:39.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:39 smithi102 ceph-mon[36220]: Active manager daemon x restarted 2024-03-04T09:15:39.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:39 smithi102 ceph-mon[36220]: Activating manager daemon x 2024-03-04T09:15:39.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:39 smithi102 ceph-mon[36220]: osdmap e95: 12 total, 12 up, 12 in 2024-03-04T09:15:39.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:39 smithi102 ceph-mon[36220]: mgrmap e20: x(active, starting, since 0.0123565s), standbys: z, y 2024-03-04T09:15:39.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:39 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-04T09:15:39.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:39 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-04T09:15:39.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:39 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-04T09:15:39.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:39 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-03-04T09:15:39.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:39 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-03-04T09:15:39.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:39 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-04T09:15:39.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:39 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-04T09:15:39.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:39 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-03-04T09:15:39.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:39 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-04T09:15:39.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:39 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-03-04T09:15:39.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:39 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-04T09:15:39.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:39 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-04T09:15:39.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:39 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-03-04T09:15:39.681 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:39 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-04T09:15:39.681 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:39 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-04T09:15:39.681 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:39 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-04T09:15:39.681 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:39 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-03-04T09:15:39.681 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:39 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-04T09:15:39.681 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:39 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-04T09:15:39.681 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:39 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-04T09:15:39.681 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:39 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-04T09:15:39.681 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:39 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-04T09:15:39.681 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:39 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-04T09:15:39.681 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:39 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-04T09:15:39.681 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:39 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-04T09:15:39.681 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:39 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-04T09:15:39.681 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:39 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-04T09:15:39.682 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:39 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-04T09:15:39.682 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:39 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-04T09:15:39.682 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:39 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-04T09:15:39.682 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:39 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-04T09:15:39.682 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:39 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-04T09:15:39.682 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:39 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-04T09:15:39.682 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:39 smithi102 ceph-mon[36220]: Manager daemon x is now available 2024-03-04T09:15:39.817 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:15:39 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:15:39.564+0000 7fa73f7e8700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T09:15:39.817 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:15:39 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:15:39.564+0000 7fa73f7e8700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T09:15:39.817 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:15:39 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:15:39.564+0000 7fa73f7e8700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T09:15:39.817 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:15:39 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:15:39.564+0000 7fa73f7e8700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T09:15:39.817 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:15:39 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:15:39.564+0000 7fa73f7e8700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T09:15:39.818 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:15:39 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:15:39.564+0000 7fa7437f0700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T09:15:39.818 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:15:39 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:15:39.564+0000 7fa7437f0700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T09:15:39.818 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:15:39 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:15:39.564+0000 7fa7437f0700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T09:15:39.818 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:15:39 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:15:39.564+0000 7fa7437f0700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T09:15:39.818 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:15:39 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:15:39.564+0000 7fa7437f0700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T09:15:39.920 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:15:39 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z[38195]: 2024-03-04T09:15:39.607+0000 7fc52c730200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-04T09:15:39.940 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:15:39 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-y[37603]: 2024-03-04T09:15:39.683+0000 7f4c38aa9200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-04T09:15:40.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.318+0000 7fe7a5ffb640 1 -- 172.21.15.82:0/2275305982 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mgrmap(e 21) v1 ==== 136568+0+0 (secure 0 0 0) 0x7fe794096b60 con 0x7fe7a81016f0 2024-03-04T09:15:40.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.318+0000 7fe7a5ffb640 1 --2- 172.21.15.82:0/2275305982 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7fe798050950 0x7fe798050d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:40.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.318+0000 7fe7a5ffb640 1 -- 172.21.15.82:0/2275305982 --> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) v1 -- 0x7fe7940b9350 con 0x7fe798050950 2024-03-04T09:15:40.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.322+0000 7fe7aca90640 1 --2- 172.21.15.82:0/2275305982 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7fe798050950 0x7fe798050d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:40.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.323+0000 7fe7aca90640 1 --2- 172.21.15.82:0/2275305982 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7fe798050950 0x7fe798050d30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe7a8101550 tx=0x7fe79c005f90 comp rx=0 tx=0).ready entity=mgr.15543 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:40.351 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:15:39 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-y[37603]: 2024-03-04T09:15:39.943+0000 7f4c38aa9200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-04T09:15:40.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.394+0000 7fe7a5ffb640 1 -- 172.21.15.82:0/2275305982 <== mgr.15543 v2:172.21.15.82:6800/662455866 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fe7940b9350 con 0x7fe798050950 2024-03-04T09:15:40.392 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule set for path / 2024-03-04T09:15:40.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.396+0000 7fe7aecf4640 1 -- 172.21.15.82:0/2275305982 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7fe798050950 msgr2=0x7fe798050d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:40.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.396+0000 7fe7aecf4640 1 --2- 172.21.15.82:0/2275305982 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7fe798050950 0x7fe798050d30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe7a8101550 tx=0x7fe79c005f90 comp rx=0 tx=0).stop 2024-03-04T09:15:40.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.396+0000 7fe7aecf4640 1 -- 172.21.15.82:0/2275305982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7a81016f0 msgr2=0x7fe7a8197d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:40.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.396+0000 7fe7aecf4640 1 --2- 172.21.15.82:0/2275305982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7a81016f0 0x7fe7a8197d50 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fe79400ea60 tx=0x7fe79400ef20 comp rx=0 tx=0).stop 2024-03-04T09:15:40.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.396+0000 7fe7ad291640 1 -- 172.21.15.82:0/2275305982 reap_dead start 2024-03-04T09:15:40.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.396+0000 7fe7aecf4640 1 -- 172.21.15.82:0/2275305982 shutdown_connections 2024-03-04T09:15:40.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.396+0000 7fe7aecf4640 1 -- 172.21.15.82:0/2275305982 >> 172.21.15.82:0/2275305982 conn(0x7fe7a80fba90 msgr2=0x7fe7a80fd480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:40.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.396+0000 7fe7aecf4640 1 -- 172.21.15.82:0/2275305982 shutdown_connections 2024-03-04T09:15:40.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.396+0000 7fe7aecf4640 1 -- 172.21.15.82:0/2275305982 wait complete. 2024-03-04T09:15:40.403 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-03-04T09:15:40.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.514+0000 7ffa3cbe4640 1 -- 172.21.15.82:0/2385496689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa381004f0 msgr2=0x7ffa38100910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:40.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.514+0000 7ffa3cbe4640 1 --2- 172.21.15.82:0/2385496689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa381004f0 0x7ffa38100910 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ffa28009900 tx=0x7ffa2802bc30 comp rx=0 tx=0).stop 2024-03-04T09:15:40.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.514+0000 7ffa3cbe4640 1 -- 172.21.15.82:0/2385496689 shutdown_connections 2024-03-04T09:15:40.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.514+0000 7ffa3cbe4640 1 --2- 172.21.15.82:0/2385496689 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa381020a0 0x7ffa38108930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:40.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.514+0000 7ffa3cbe4640 1 --2- 172.21.15.82:0/2385496689 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa381016e0 0x7ffa38101b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:40.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.514+0000 7ffa3cbe4640 1 --2- 172.21.15.82:0/2385496689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa381004f0 0x7ffa38100910 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:40.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.514+0000 7ffa3cbe4640 1 -- 172.21.15.82:0/2385496689 >> 172.21.15.82:0/2385496689 conn(0x7ffa380fba60 msgr2=0x7ffa380fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:40.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.514+0000 7ffa3cbe4640 1 -- 172.21.15.82:0/2385496689 shutdown_connections 2024-03-04T09:15:40.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.514+0000 7ffa3cbe4640 1 -- 172.21.15.82:0/2385496689 wait complete. 2024-03-04T09:15:40.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.514+0000 7ffa3cbe4640 1 Processor -- start 2024-03-04T09:15:40.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.515+0000 7ffa3cbe4640 1 -- start start 2024-03-04T09:15:40.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.515+0000 7ffa3cbe4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa381004f0 0x7ffa38104480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:40.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.515+0000 7ffa3cbe4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa381016e0 0x7ffa38102ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:40.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.515+0000 7ffa3cbe4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa381020a0 0x7ffa38103000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:40.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.515+0000 7ffa3cbe4640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3810c150 con 0x7ffa381016e0 2024-03-04T09:15:40.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.515+0000 7ffa3cbe4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3810bfd0 con 0x7ffa381004f0 2024-03-04T09:15:40.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.515+0000 7ffa3cbe4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3810c2d0 con 0x7ffa381020a0 2024-03-04T09:15:40.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.515+0000 7ffa2ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa381016e0 0x7ffa38102ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:40.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.515+0000 7ffa3659c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa381004f0 0x7ffa38104480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:40.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.515+0000 7ffa3659c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa381004f0 0x7ffa38104480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.82:39190/0 (socket says 172.21.15.82:39190) 2024-03-04T09:15:40.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.515+0000 7ffa2ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa381016e0 0x7ffa38102ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59002/0 (socket says 172.21.15.82:59002) 2024-03-04T09:15:40.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.515+0000 7ffa3659c640 1 -- 172.21.15.82:0/3717244287 learned_addr learned my addr 172.21.15.82:0/3717244287 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:40.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.515+0000 7ffa36d9d640 1 --2- 172.21.15.82:0/3717244287 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa381020a0 0x7ffa38103000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:40.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.515+0000 7ffa3659c640 1 -- 172.21.15.82:0/3717244287 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa381020a0 msgr2=0x7ffa38103000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:40.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.515+0000 7ffa3659c640 1 --2- 172.21.15.82:0/3717244287 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa381020a0 0x7ffa38103000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:40.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.515+0000 7ffa3659c640 1 -- 172.21.15.82:0/3717244287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa381016e0 msgr2=0x7ffa38102ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:40.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.515+0000 7ffa3659c640 1 --2- 172.21.15.82:0/3717244287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa381016e0 0x7ffa38102ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:40.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.515+0000 7ffa3659c640 1 -- 172.21.15.82:0/3717244287 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa38103890 con 0x7ffa381004f0 2024-03-04T09:15:40.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.515+0000 7ffa2ffff640 1 --2- 172.21.15.82:0/3717244287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa381016e0 0x7ffa38102ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:15:40.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.515+0000 7ffa3659c640 1 --2- 172.21.15.82:0/3717244287 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa381004f0 0x7ffa38104480 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ffa28005ab0 tx=0x7ffa28005de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:40.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.516+0000 7ffa2f7fe640 1 -- 172.21.15.82:0/3717244287 <== mon.2 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa28043020 con 0x7ffa381004f0 2024-03-04T09:15:40.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.516+0000 7ffa3cbe4640 1 -- 172.21.15.82:0/3717244287 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa381a1a00 con 0x7ffa381004f0 2024-03-04T09:15:40.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.516+0000 7ffa2f7fe640 1 -- 172.21.15.82:0/3717244287 <== mon.2 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7ffa280054b0 con 0x7ffa381004f0 2024-03-04T09:15:40.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.516+0000 7ffa3cbe4640 1 -- 172.21.15.82:0/3717244287 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa381a1fa0 con 0x7ffa381004f0 2024-03-04T09:15:40.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.516+0000 7ffa2f7fe640 1 -- 172.21.15.82:0/3717244287 <== mon.2 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa28003b50 con 0x7ffa381004f0 2024-03-04T09:15:40.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.516+0000 7ffa3cbe4640 1 -- 172.21.15.82:0/3717244287 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa381a2170 con 0x7ffa381004f0 2024-03-04T09:15:40.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.518+0000 7ffa2f7fe640 1 -- 172.21.15.82:0/3717244287 <== mon.2 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 21) v1 ==== 136568+0+0 (secure 0 0 0) 0x7ffa28046020 con 0x7ffa381004f0 2024-03-04T09:15:40.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.518+0000 7ffa2f7fe640 1 --2- 172.21.15.82:0/3717244287 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7ffa240a1c30 0x7ffa240a40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:40.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.519+0000 7ffa2ffff640 1 --2- 172.21.15.82:0/3717244287 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7ffa240a1c30 0x7ffa240a40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:40.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.519+0000 7ffa2f7fe640 1 -- 172.21.15.82:0/3717244287 <== mon.2 v2:172.21.15.102:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 9437+0+0 (secure 0 0 0) 0x7ffa280efff0 con 0x7ffa381004f0 2024-03-04T09:15:40.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.519+0000 7ffa2ffff640 1 --2- 172.21.15.82:0/3717244287 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7ffa240a1c30 0x7ffa240a40f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ffa381041f0 tx=0x7ffa20005f90 comp rx=0 tx=0).ready entity=mgr.15543 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:40.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.522+0000 7ffa2f7fe640 1 -- 172.21.15.82:0/3717244287 <== mon.2 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7ffa280bd380 con 0x7ffa381004f0 2024-03-04T09:15:40.609 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:40 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:15:40.609 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:40 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:15:40.609 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:40 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-04T09:15:40.609 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:40 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-04T09:15:40.610 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:40 smithi102 ceph-mon[36220]: Standby manager daemon y restarted 2024-03-04T09:15:40.610 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:40 smithi102 ceph-mon[36220]: Standby manager daemon y started 2024-03-04T09:15:40.610 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:40 smithi102 ceph-mon[36220]: from='mgr.? 172.21.15.102:0/3446941140' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-03-04T09:15:40.610 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:40 smithi102 ceph-mon[36220]: from='mgr.? 172.21.15.102:0/3446941140' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-04T09:15:40.610 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:40 smithi102 ceph-mon[36220]: from='mgr.? 172.21.15.102:0/3446941140' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-03-04T09:15:40.610 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:40 smithi102 ceph-mon[36220]: from='mgr.? 172.21.15.102:0/3446941140' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-04T09:15:40.610 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:40 smithi102 ceph-mon[36220]: mgrmap e21: x(active, since 1.0194s), standbys: y, z 2024-03-04T09:15:40.671 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:15:40 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z[38195]: 2024-03-04T09:15:40.323+0000 7fc52c730200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-04T09:15:40.671 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:15:40 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z[38195]: 2024-03-04T09:15:40.475+0000 7fc52c730200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-04T09:15:40.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:40 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:15:40.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:40 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:15:40.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:40 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-04T09:15:40.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:40 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-04T09:15:40.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:40 smithi190 ceph-mon[36341]: Standby manager daemon y restarted 2024-03-04T09:15:40.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:40 smithi190 ceph-mon[36341]: Standby manager daemon y started 2024-03-04T09:15:40.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:40 smithi190 ceph-mon[36341]: from='mgr.? 172.21.15.102:0/3446941140' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-03-04T09:15:40.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:40 smithi190 ceph-mon[36341]: from='mgr.? 172.21.15.102:0/3446941140' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-04T09:15:40.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:40 smithi190 ceph-mon[36341]: from='mgr.? 172.21.15.102:0/3446941140' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-03-04T09:15:40.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:40 smithi190 ceph-mon[36341]: from='mgr.? 172.21.15.102:0/3446941140' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-04T09:15:40.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:40 smithi190 ceph-mon[36341]: mgrmap e21: x(active, since 1.0194s), standbys: y, z 2024-03-04T09:15:40.711 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:40 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:15:40.712 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:40 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:15:40.712 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:40 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-04T09:15:40.712 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:40 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-04T09:15:40.712 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:40 smithi082 ceph-mon[32880]: Standby manager daemon y restarted 2024-03-04T09:15:40.712 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:40 smithi082 ceph-mon[32880]: Standby manager daemon y started 2024-03-04T09:15:40.712 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:40 smithi082 ceph-mon[32880]: from='mgr.? 172.21.15.102:0/3446941140' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-03-04T09:15:40.712 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:40 smithi082 ceph-mon[32880]: from='mgr.? 172.21.15.102:0/3446941140' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-04T09:15:40.712 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:40 smithi082 ceph-mon[32880]: from='mgr.? 172.21.15.102:0/3446941140' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-03-04T09:15:40.712 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:40 smithi082 ceph-mon[32880]: from='mgr.? 172.21.15.102:0/3446941140' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-04T09:15:40.712 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:40 smithi082 ceph-mon[32880]: mgrmap e21: x(active, since 1.0194s), standbys: y, z 2024-03-04T09:15:40.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.745+0000 7ffa3cbe4640 1 -- 172.21.15.82:0/3717244287 --> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa380fdbf0 con 0x7ffa240a1c30 2024-03-04T09:15:40.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.805+0000 7ffa2f7fe640 1 -- 172.21.15.82:0/3717244287 <== mgr.15543 v2:172.21.15.82:6800/662455866 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7ffa380fdbf0 con 0x7ffa240a1c30 2024-03-04T09:15:40.802 INFO:teuthology.orchestra.run.smithi082.stdout:Retention added to path / 2024-03-04T09:15:40.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.807+0000 7ffa3cbe4640 1 -- 172.21.15.82:0/3717244287 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7ffa240a1c30 msgr2=0x7ffa240a40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:40.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.807+0000 7ffa3cbe4640 1 --2- 172.21.15.82:0/3717244287 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7ffa240a1c30 0x7ffa240a40f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ffa381041f0 tx=0x7ffa20005f90 comp rx=0 tx=0).stop 2024-03-04T09:15:40.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.807+0000 7ffa3cbe4640 1 -- 172.21.15.82:0/3717244287 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa381004f0 msgr2=0x7ffa38104480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:40.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.807+0000 7ffa3cbe4640 1 --2- 172.21.15.82:0/3717244287 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa381004f0 0x7ffa38104480 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ffa28005ab0 tx=0x7ffa28005de0 comp rx=0 tx=0).stop 2024-03-04T09:15:40.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.808+0000 7ffa3cbe4640 1 -- 172.21.15.82:0/3717244287 shutdown_connections 2024-03-04T09:15:40.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.808+0000 7ffa3cbe4640 1 --2- 172.21.15.82:0/3717244287 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7ffa240a1c30 0x7ffa240a40f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:40.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.808+0000 7ffa3cbe4640 1 --2- 172.21.15.82:0/3717244287 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa381020a0 0x7ffa38103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:40.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.808+0000 7ffa3cbe4640 1 --2- 172.21.15.82:0/3717244287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa381016e0 0x7ffa38102ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:40.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.808+0000 7ffa3cbe4640 1 --2- 172.21.15.82:0/3717244287 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa381004f0 0x7ffa38104480 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:40.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.808+0000 7ffa3cbe4640 1 -- 172.21.15.82:0/3717244287 >> 172.21.15.82:0/3717244287 conn(0x7ffa380fba60 msgr2=0x7ffa380fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:40.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.808+0000 7ffa3cbe4640 1 -- 172.21.15.82:0/3717244287 shutdown_connections 2024-03-04T09:15:40.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.808+0000 7ffa3cbe4640 1 -- 172.21.15.82:0/3717244287 wait complete. 2024-03-04T09:15:40.819 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-03-04T09:15:40.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.929+0000 7f6494b8a640 1 -- 172.21.15.82:0/3885539699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6490102090 msgr2=0x7f6490104480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:40.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.929+0000 7f6494b8a640 1 --2- 172.21.15.82:0/3885539699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6490102090 0x7f6490104480 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f6480009900 tx=0x7f648002bc30 comp rx=0 tx=0).stop 2024-03-04T09:15:40.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.929+0000 7f6494b8a640 1 -- 172.21.15.82:0/3885539699 shutdown_connections 2024-03-04T09:15:40.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.929+0000 7f6494b8a640 1 --2- 172.21.15.82:0/3885539699 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64901072f0 0x7f6490109740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:40.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.929+0000 7f6494b8a640 1 --2- 172.21.15.82:0/3885539699 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64901049c0 0x7f6490106db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:40.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.929+0000 7f6494b8a640 1 --2- 172.21.15.82:0/3885539699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6490102090 0x7f6490104480 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:40.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.929+0000 7f6494b8a640 1 -- 172.21.15.82:0/3885539699 >> 172.21.15.82:0/3885539699 conn(0x7f64900fba80 msgr2=0x7f64900fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:40.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.929+0000 7f6494b8a640 1 -- 172.21.15.82:0/3885539699 shutdown_connections 2024-03-04T09:15:40.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.929+0000 7f6494b8a640 1 -- 172.21.15.82:0/3885539699 wait complete. 2024-03-04T09:15:40.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.929+0000 7f6494b8a640 1 Processor -- start 2024-03-04T09:15:40.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.929+0000 7f6494b8a640 1 -- start start 2024-03-04T09:15:40.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.930+0000 7f6494b8a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6490102090 0x7f6490197880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:40.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.930+0000 7f6494b8a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64901049c0 0x7f6490197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:40.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.930+0000 7f6494b8a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64901072f0 0x7f649019ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:40.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.930+0000 7f6494b8a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f649010d290 con 0x7f6490102090 2024-03-04T09:15:40.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.930+0000 7f6494b8a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f649010d110 con 0x7f64901049c0 2024-03-04T09:15:40.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.930+0000 7f6494b8a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f649010d410 con 0x7f64901072f0 2024-03-04T09:15:40.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.930+0000 7f648e59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6490102090 0x7f6490197880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:40.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.930+0000 7f648e59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6490102090 0x7f6490197880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59012/0 (socket says 172.21.15.82:59012) 2024-03-04T09:15:40.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.930+0000 7f648e59c640 1 -- 172.21.15.82:0/256935366 learned_addr learned my addr 172.21.15.82:0/256935366 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:40.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.930+0000 7f648ed9d640 1 --2- 172.21.15.82:0/256935366 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64901072f0 0x7f649019ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:40.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.930+0000 7f648dd9b640 1 --2- 172.21.15.82:0/256935366 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64901049c0 0x7f6490197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:40.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.930+0000 7f648e59c640 1 -- 172.21.15.82:0/256935366 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64901072f0 msgr2=0x7f649019ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:40.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.930+0000 7f648e59c640 1 --2- 172.21.15.82:0/256935366 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64901072f0 0x7f649019ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:40.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.930+0000 7f648e59c640 1 -- 172.21.15.82:0/256935366 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64901049c0 msgr2=0x7f6490197dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:40.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.930+0000 7f648e59c640 1 --2- 172.21.15.82:0/256935366 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64901049c0 0x7f6490197dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:40.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.930+0000 7f648e59c640 1 -- 172.21.15.82:0/256935366 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f649019f4a0 con 0x7f6490102090 2024-03-04T09:15:40.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.930+0000 7f648e59c640 1 --2- 172.21.15.82:0/256935366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6490102090 0x7f6490197880 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f6480009230 tx=0x7f6480005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:40.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.930+0000 7f647f7fe640 1 -- 172.21.15.82:0/256935366 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6480043020 con 0x7f6490102090 2024-03-04T09:15:40.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.930+0000 7f647f7fe640 1 -- 172.21.15.82:0/256935366 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f64800054b0 con 0x7f6490102090 2024-03-04T09:15:40.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.930+0000 7f6494b8a640 1 -- 172.21.15.82:0/256935366 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f649019f730 con 0x7f6490102090 2024-03-04T09:15:40.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.930+0000 7f647f7fe640 1 -- 172.21.15.82:0/256935366 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6480003b80 con 0x7f6490102090 2024-03-04T09:15:40.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.930+0000 7f6494b8a640 1 -- 172.21.15.82:0/256935366 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f649019fc80 con 0x7f6490102090 2024-03-04T09:15:40.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.931+0000 7f6494b8a640 1 -- 172.21.15.82:0/256935366 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64900fd570 con 0x7f6490102090 2024-03-04T09:15:40.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.932+0000 7f647f7fe640 1 -- 172.21.15.82:0/256935366 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 21) v1 ==== 136568+0+0 (secure 0 0 0) 0x7f6480046020 con 0x7f6490102090 2024-03-04T09:15:40.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.933+0000 7f647f7fe640 1 --2- 172.21.15.82:0/256935366 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f64780a1c30 0x7f64780a40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:40.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.933+0000 7f648dd9b640 1 --2- 172.21.15.82:0/256935366 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f64780a1c30 0x7f64780a40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:40.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.933+0000 7f647f7fe640 1 -- 172.21.15.82:0/256935366 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 9437+0+0 (secure 0 0 0) 0x7f64800efa40 con 0x7f6490102090 2024-03-04T09:15:40.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.933+0000 7f648dd9b640 1 --2- 172.21.15.82:0/256935366 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f64780a1c30 0x7f64780a40f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6490198d90 tx=0x7f6484005f90 comp rx=0 tx=0).ready entity=mgr.15543 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:40.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:40.937+0000 7f647f7fe640 1 -- 172.21.15.82:0/256935366 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f64800f1e20 con 0x7f6490102090 2024-03-04T09:15:41.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.151+0000 7f6494b8a640 1 -- 172.21.15.82:0/256935366 --> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) v1 -- 0x7f6490061a10 con 0x7f64780a1c30 2024-03-04T09:15:41.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.159+0000 7f647f7fe640 1 -- 172.21.15.82:0/256935366 <== mgr.15543 v2:172.21.15.82:6800/662455866 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+298 (secure 0 0 0) 0x7f6490061a10 con 0x7f64780a1c30 2024-03-04T09:15:41.156 INFO:teuthology.orchestra.run.smithi082.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-03-04T00:00:00", "created": "2024-03-04T09:15:40", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-03-04T09:15:41.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.161+0000 7f6494b8a640 1 -- 172.21.15.82:0/256935366 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f64780a1c30 msgr2=0x7f64780a40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:41.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.161+0000 7f6494b8a640 1 --2- 172.21.15.82:0/256935366 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f64780a1c30 0x7f64780a40f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6490198d90 tx=0x7f6484005f90 comp rx=0 tx=0).stop 2024-03-04T09:15:41.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.161+0000 7f6494b8a640 1 -- 172.21.15.82:0/256935366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6490102090 msgr2=0x7f6490197880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:41.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.161+0000 7f6494b8a640 1 --2- 172.21.15.82:0/256935366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6490102090 0x7f6490197880 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f6480009230 tx=0x7f6480005dd0 comp rx=0 tx=0).stop 2024-03-04T09:15:41.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.161+0000 7f6494b8a640 1 -- 172.21.15.82:0/256935366 shutdown_connections 2024-03-04T09:15:41.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.161+0000 7f6494b8a640 1 --2- 172.21.15.82:0/256935366 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f64780a1c30 0x7f64780a40f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:41.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.161+0000 7f6494b8a640 1 --2- 172.21.15.82:0/256935366 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64901072f0 0x7f649019ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:41.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.161+0000 7f6494b8a640 1 --2- 172.21.15.82:0/256935366 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64901049c0 0x7f6490197dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:41.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.161+0000 7f6494b8a640 1 --2- 172.21.15.82:0/256935366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6490102090 0x7f6490197880 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:41.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.161+0000 7f6494b8a640 1 -- 172.21.15.82:0/256935366 >> 172.21.15.82:0/256935366 conn(0x7f64900fba80 msgr2=0x7f6490102a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:41.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.162+0000 7f6494b8a640 1 -- 172.21.15.82:0/256935366 shutdown_connections 2024-03-04T09:15:41.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.162+0000 7f6494b8a640 1 -- 172.21.15.82:0/256935366 wait complete. 2024-03-04T09:15:41.170 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-03-04T09:15:41.171 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:15:40 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z[38195]: 2024-03-04T09:15:40.741+0000 7fc52c730200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-04T09:15:41.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.291+0000 7fd3a5df7640 1 -- 172.21.15.82:0/4173954528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3a01020b0 msgr2=0x7fd3a01044a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:41.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.291+0000 7fd3a5df7640 1 --2- 172.21.15.82:0/4173954528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3a01020b0 0x7fd3a01044a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fd390009900 tx=0x7fd39002bc30 comp rx=0 tx=0).stop 2024-03-04T09:15:41.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.291+0000 7fd3a5df7640 1 -- 172.21.15.82:0/4173954528 shutdown_connections 2024-03-04T09:15:41.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.291+0000 7fd3a5df7640 1 --2- 172.21.15.82:0/4173954528 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3a0107310 0x7fd3a0109760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:41.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.291+0000 7fd3a5df7640 1 --2- 172.21.15.82:0/4173954528 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3a01049e0 0x7fd3a0106dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:41.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.291+0000 7fd3a5df7640 1 --2- 172.21.15.82:0/4173954528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3a01020b0 0x7fd3a01044a0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:41.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.291+0000 7fd3a5df7640 1 -- 172.21.15.82:0/4173954528 >> 172.21.15.82:0/4173954528 conn(0x7fd3a00fbaa0 msgr2=0x7fd3a00fdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:41.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.291+0000 7fd3a5df7640 1 -- 172.21.15.82:0/4173954528 shutdown_connections 2024-03-04T09:15:41.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.291+0000 7fd3a5df7640 1 -- 172.21.15.82:0/4173954528 wait complete. 2024-03-04T09:15:41.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.292+0000 7fd3a5df7640 1 Processor -- start 2024-03-04T09:15:41.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.292+0000 7fd3a5df7640 1 -- start start 2024-03-04T09:15:41.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.292+0000 7fd3a5df7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3a01020b0 0x7fd3a01978f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:41.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.292+0000 7fd3a5df7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3a01049e0 0x7fd3a0197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:41.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.292+0000 7fd3a5df7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3a0107310 0x7fd3a019eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:41.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.292+0000 7fd3a5df7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a010d360 con 0x7fd3a01049e0 2024-03-04T09:15:41.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.292+0000 7fd3a5df7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a010d1e0 con 0x7fd3a0107310 2024-03-04T09:15:41.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.292+0000 7fd3a5df7640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a010d4e0 con 0x7fd3a01020b0 2024-03-04T09:15:41.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.293+0000 7fd39effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3a01049e0 0x7fd3a0197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:41.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.293+0000 7fd39f7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3a01020b0 0x7fd3a01978f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:41.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.293+0000 7fd39ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3a0107310 0x7fd3a019eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:41.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.293+0000 7fd39f7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3a01020b0 0x7fd3a01978f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.82:46074/0 (socket says 172.21.15.82:46074) 2024-03-04T09:15:41.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.293+0000 7fd39f7fe640 1 -- 172.21.15.82:0/4154170863 learned_addr learned my addr 172.21.15.82:0/4154170863 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:15:41.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.293+0000 7fd39effd640 1 -- 172.21.15.82:0/4154170863 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3a01020b0 msgr2=0x7fd3a01978f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:41.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.293+0000 7fd39effd640 1 --2- 172.21.15.82:0/4154170863 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3a01020b0 0x7fd3a01978f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:41.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.293+0000 7fd39effd640 1 -- 172.21.15.82:0/4154170863 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3a0107310 msgr2=0x7fd3a019eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:41.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.293+0000 7fd39effd640 1 --2- 172.21.15.82:0/4154170863 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3a0107310 0x7fd3a019eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:41.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.293+0000 7fd39effd640 1 -- 172.21.15.82:0/4154170863 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a019f510 con 0x7fd3a01049e0 2024-03-04T09:15:41.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.293+0000 7fd39f7fe640 1 --2- 172.21.15.82:0/4154170863 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3a01020b0 0x7fd3a01978f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:15:41.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.293+0000 7fd39ffff640 1 --2- 172.21.15.82:0/4154170863 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3a0107310 0x7fd3a019eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:15:41.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.293+0000 7fd39effd640 1 --2- 172.21.15.82:0/4154170863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3a01049e0 0x7fd3a0197e30 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fd39400b3c0 tx=0x7fd39400b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:41.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.293+0000 7fd39cff9640 1 -- 172.21.15.82:0/4154170863 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd394011830 con 0x7fd3a01049e0 2024-03-04T09:15:41.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.293+0000 7fd3a5df7640 1 -- 172.21.15.82:0/4154170863 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3a019f800 con 0x7fd3a01049e0 2024-03-04T09:15:41.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.293+0000 7fd39cff9640 1 -- 172.21.15.82:0/4154170863 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fd394016070 con 0x7fd3a01049e0 2024-03-04T09:15:41.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.293+0000 7fd39cff9640 1 -- 172.21.15.82:0/4154170863 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39400f2e0 con 0x7fd3a01049e0 2024-03-04T09:15:41.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.294+0000 7fd3a5df7640 1 -- 172.21.15.82:0/4154170863 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3a019fdd0 con 0x7fd3a01049e0 2024-03-04T09:15:41.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.295+0000 7fd3a5df7640 1 -- 172.21.15.82:0/4154170863 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3a00fd590 con 0x7fd3a01049e0 2024-03-04T09:15:41.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.296+0000 7fd39cff9640 1 -- 172.21.15.82:0/4154170863 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 21) v1 ==== 136568+0+0 (secure 0 0 0) 0x7fd3940119d0 con 0x7fd3a01049e0 2024-03-04T09:15:41.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.297+0000 7fd39cff9640 1 --2- 172.21.15.82:0/4154170863 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7fd3880a1c30 0x7fd3880a40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:15:41.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.297+0000 7fd39cff9640 1 -- 172.21.15.82:0/4154170863 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 9437+0+0 (secure 0 0 0) 0x7fd3940cd3c0 con 0x7fd3a01049e0 2024-03-04T09:15:41.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.297+0000 7fd39f7fe640 1 --2- 172.21.15.82:0/4154170863 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7fd3880a1c30 0x7fd3880a40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:15:41.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.297+0000 7fd39f7fe640 1 --2- 172.21.15.82:0/4154170863 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7fd3880a1c30 0x7fd3880a40f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd3900096c0 tx=0x7fd39002c820 comp rx=0 tx=0).ready entity=mgr.15543 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:15:41.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.302+0000 7fd39cff9640 1 -- 172.21.15.82:0/4154170863 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fd39409a630 con 0x7fd3a01049e0 2024-03-04T09:15:41.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.369+0000 7fd39cff9640 1 -- 172.21.15.82:0/4154170863 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 22) v1 ==== 136876+0+0 (secure 0 0 0) 0x7fd3940965a0 con 0x7fd3a01049e0 2024-03-04T09:15:41.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.546+0000 7fd3a5df7640 1 -- 172.21.15.82:0/4154170863 --> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fd3a0061a10 con 0x7fd3880a1c30 2024-03-04T09:15:41.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.553+0000 7fd39cff9640 1 -- 172.21.15.82:0/4154170863 <== mgr.15543 v2:172.21.15.82:6800/662455866 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+10 (secure 0 0 0) 0x7fd3a0061a10 con 0x7fd3880a1c30 2024-03-04T09:15:41.549 INFO:teuthology.orchestra.run.smithi082.stdout:/ 1m 6m3h 2024-03-04T09:15:41.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.555+0000 7fd3a5df7640 1 -- 172.21.15.82:0/4154170863 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7fd3880a1c30 msgr2=0x7fd3880a40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:41.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.555+0000 7fd3a5df7640 1 --2- 172.21.15.82:0/4154170863 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7fd3880a1c30 0x7fd3880a40f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd3900096c0 tx=0x7fd39002c820 comp rx=0 tx=0).stop 2024-03-04T09:15:41.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.555+0000 7fd3a5df7640 1 -- 172.21.15.82:0/4154170863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3a01049e0 msgr2=0x7fd3a0197e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:15:41.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.555+0000 7fd3a5df7640 1 --2- 172.21.15.82:0/4154170863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3a01049e0 0x7fd3a0197e30 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fd39400b3c0 tx=0x7fd39400b880 comp rx=0 tx=0).stop 2024-03-04T09:15:41.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.555+0000 7fd3a5df7640 1 -- 172.21.15.82:0/4154170863 shutdown_connections 2024-03-04T09:15:41.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.555+0000 7fd3a5df7640 1 --2- 172.21.15.82:0/4154170863 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7fd3880a1c30 0x7fd3880a40f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:41.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.555+0000 7fd3a5df7640 1 --2- 172.21.15.82:0/4154170863 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3a0107310 0x7fd3a019eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:41.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.555+0000 7fd3a5df7640 1 --2- 172.21.15.82:0/4154170863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3a01049e0 0x7fd3a0197e30 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:41.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.555+0000 7fd3a5df7640 1 --2- 172.21.15.82:0/4154170863 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3a01020b0 0x7fd3a01978f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:15:41.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.555+0000 7fd3a5df7640 1 -- 172.21.15.82:0/4154170863 >> 172.21.15.82:0/4154170863 conn(0x7fd3a00fbaa0 msgr2=0x7fd3a0102bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:15:41.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.555+0000 7fd3a5df7640 1 -- 172.21.15.82:0/4154170863 shutdown_connections 2024-03-04T09:15:41.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:15:41.555+0000 7fd3a5df7640 1 -- 172.21.15.82:0/4154170863 wait complete. 2024-03-04T09:15:41.562 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:41 smithi082 ceph-mon[32880]: [04/Mar/2024:09:15:39] ENGINE Bus STARTING 2024-03-04T09:15:41.562 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:41 smithi082 ceph-mon[32880]: [04/Mar/2024:09:15:39] ENGINE Serving on https://172.21.15.82:7150 2024-03-04T09:15:41.562 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:41 smithi082 ceph-mon[32880]: [04/Mar/2024:09:15:39] ENGINE Serving on http://172.21.15.82:8765 2024-03-04T09:15:41.562 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:41 smithi082 ceph-mon[32880]: [04/Mar/2024:09:15:39] ENGINE Bus STARTED 2024-03-04T09:15:41.562 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:41 smithi082 ceph-mon[32880]: from='client.15567 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:15:41.562 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:41 smithi082 ceph-mon[32880]: pgmap v3: 129 pgs: 129 active+clean; 1.1 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:15:41.563 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:41 smithi082 ceph-mon[32880]: Standby manager daemon z restarted 2024-03-04T09:15:41.563 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:41 smithi082 ceph-mon[32880]: Standby manager daemon z started 2024-03-04T09:15:41.563 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:41 smithi082 ceph-mon[32880]: from='mgr.? 172.21.15.190:0/1570520939' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-03-04T09:15:41.563 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:41 smithi082 ceph-mon[32880]: from='mgr.? 172.21.15.190:0/1570520939' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-04T09:15:41.563 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:41 smithi082 ceph-mon[32880]: from='mgr.? 172.21.15.190:0/1570520939' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-03-04T09:15:41.563 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:41 smithi082 ceph-mon[32880]: from='mgr.? 172.21.15.190:0/1570520939' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-04T09:15:41.564 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-03-04T09:15:41.593 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-03-04T09:15:41.605 INFO:teuthology.run_tasks:Running task workunit... 2024-03-04T09:15:41.620 INFO:tasks.workunit:Pulling workunits from ref 1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd 2024-03-04T09:15:41.620 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-04T09:15:41.620 INFO:tasks.workunit:timeout=3h 2024-03-04T09:15:41.620 INFO:tasks.workunit:cleanup=True 2024-03-04T09:15:41.621 DEBUG:teuthology.orchestra.run.smithi082:> stat -- /home/ubuntu/cephtest/mnt.0 2024-03-04T09:15:41.648 INFO:teuthology.orchestra.run.smithi082.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-03-04T09:15:41.649 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-03-04T09:15:41.649 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 77h/119d Inode: 1 Links: 2 2024-03-04T09:15:41.649 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-04T09:15:41.649 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:fusefs_t:s0 2024-03-04T09:15:41.649 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-03-04 09:13:37.057837502 +0000 2024-03-04T09:15:41.649 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-03-04 09:13:37.057837502 +0000 2024-03-04T09:15:41.649 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-03-04 09:15:30.255106728 +0000 2024-03-04T09:15:41.649 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: - 2024-03-04T09:15:41.649 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-03-04T09:15:41.649 DEBUG:teuthology.orchestra.run.smithi082:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-03-04T09:15:41.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:41 smithi190 ceph-mon[36341]: [04/Mar/2024:09:15:39] ENGINE Bus STARTING 2024-03-04T09:15:41.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:41 smithi190 ceph-mon[36341]: [04/Mar/2024:09:15:39] ENGINE Serving on https://172.21.15.82:7150 2024-03-04T09:15:41.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:41 smithi190 ceph-mon[36341]: [04/Mar/2024:09:15:39] ENGINE Serving on http://172.21.15.82:8765 2024-03-04T09:15:41.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:41 smithi190 ceph-mon[36341]: [04/Mar/2024:09:15:39] ENGINE Bus STARTED 2024-03-04T09:15:41.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:41 smithi190 ceph-mon[36341]: from='client.15567 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:15:41.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:41 smithi190 ceph-mon[36341]: pgmap v3: 129 pgs: 129 active+clean; 1.1 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:15:41.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:41 smithi190 ceph-mon[36341]: Standby manager daemon z restarted 2024-03-04T09:15:41.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:41 smithi190 ceph-mon[36341]: Standby manager daemon z started 2024-03-04T09:15:41.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:41 smithi190 ceph-mon[36341]: from='mgr.? 172.21.15.190:0/1570520939' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-03-04T09:15:41.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:41 smithi190 ceph-mon[36341]: from='mgr.? 172.21.15.190:0/1570520939' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-04T09:15:41.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:41 smithi190 ceph-mon[36341]: from='mgr.? 172.21.15.190:0/1570520939' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-03-04T09:15:41.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:41 smithi190 ceph-mon[36341]: from='mgr.? 172.21.15.190:0/1570520939' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-04T09:15:41.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:41 smithi102 ceph-mon[36220]: [04/Mar/2024:09:15:39] ENGINE Bus STARTING 2024-03-04T09:15:41.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:41 smithi102 ceph-mon[36220]: [04/Mar/2024:09:15:39] ENGINE Serving on https://172.21.15.82:7150 2024-03-04T09:15:41.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:41 smithi102 ceph-mon[36220]: [04/Mar/2024:09:15:39] ENGINE Serving on http://172.21.15.82:8765 2024-03-04T09:15:41.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:41 smithi102 ceph-mon[36220]: [04/Mar/2024:09:15:39] ENGINE Bus STARTED 2024-03-04T09:15:41.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:41 smithi102 ceph-mon[36220]: from='client.15567 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:15:41.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:41 smithi102 ceph-mon[36220]: pgmap v3: 129 pgs: 129 active+clean; 1.1 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:15:41.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:41 smithi102 ceph-mon[36220]: Standby manager daemon z restarted 2024-03-04T09:15:41.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:41 smithi102 ceph-mon[36220]: Standby manager daemon z started 2024-03-04T09:15:41.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:41 smithi102 ceph-mon[36220]: from='mgr.? 172.21.15.190:0/1570520939' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-03-04T09:15:41.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:41 smithi102 ceph-mon[36220]: from='mgr.? 172.21.15.190:0/1570520939' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-04T09:15:41.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:41 smithi102 ceph-mon[36220]: from='mgr.? 172.21.15.190:0/1570520939' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-03-04T09:15:41.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:41 smithi102 ceph-mon[36220]: from='mgr.? 172.21.15.190:0/1570520939' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-04T09:15:41.724 DEBUG:teuthology.orchestra.run.smithi082:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd 2024-03-04T09:15:41.779 INFO:tasks.workunit.client.0.smithi082.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-03-04T09:15:42.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:42 smithi190 ceph-mon[36341]: from='client.25436 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:15:42.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:42 smithi190 ceph-mon[36341]: from='client.15615 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:15:42.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:42 smithi190 ceph-mon[36341]: pgmap v4: 129 pgs: 129 active+clean; 1.1 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:15:42.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:42 smithi190 ceph-mon[36341]: mgrmap e22: x(active, since 2s), standbys: y, z 2024-03-04T09:15:42.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:42 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:42.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:42 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:42.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:42 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:42.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:42 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:42.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:42 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:42.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:42 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:42.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:42 smithi102 ceph-mon[36220]: from='client.25436 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:15:42.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:42 smithi102 ceph-mon[36220]: from='client.15615 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:15:42.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:42 smithi102 ceph-mon[36220]: pgmap v4: 129 pgs: 129 active+clean; 1.1 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:15:42.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:42 smithi102 ceph-mon[36220]: mgrmap e22: x(active, since 2s), standbys: y, z 2024-03-04T09:15:42.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:42 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:42.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:42 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:42.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:42 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:42.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:42 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:42.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:42 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:42.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:42 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:42.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:42 smithi082 ceph-mon[32880]: from='client.25436 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:15:42.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:42 smithi082 ceph-mon[32880]: from='client.15615 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:15:42.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:42 smithi082 ceph-mon[32880]: pgmap v4: 129 pgs: 129 active+clean; 1.1 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:15:42.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:42 smithi082 ceph-mon[32880]: mgrmap e22: x(active, since 2s), standbys: y, z 2024-03-04T09:15:42.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:42 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:42.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:42 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:42.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:42 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:42.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:42 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:42.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:42 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:42.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:42 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:43.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:43 smithi190 ceph-mon[36341]: from='client.15621 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:15:43.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:43 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:43.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:43 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:43.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:43 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:15:43.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:43 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:15:43.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:43 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:15:43.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:43 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:15:43.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:43 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:43.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:43 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:43.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:43 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:15:43.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:43 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:15:43.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:43 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:15:43.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:43 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:15:43.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:43 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:43.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:43 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:43.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:43 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:15:43.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:43 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:15:43.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:43 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:15:43.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:43 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:15:43.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:43 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:15:43.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:43 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:15:43.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:43 smithi102 ceph-mon[36220]: from='client.15621 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:15:43.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:43 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:43.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:43 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:43.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:43 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:15:43.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:43 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:15:43.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:43 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:15:43.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:43 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:15:43.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:43 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:43.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:43 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:43.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:43 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:15:43.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:43 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:15:43.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:43 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:15:43.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:43 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:15:43.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:43 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:43.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:43 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:43.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:43 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:15:43.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:43 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:15:43.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:43 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:15:43.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:43 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:15:43.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:43 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:15:43.681 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:43 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:15:43.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:43 smithi082 ceph-mon[32880]: from='client.15621 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:15:43.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:43 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:43.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:43 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:43.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:43 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:15:43.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:43 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:15:43.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:43 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:15:43.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:43 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:15:43.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:43 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:43.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:43 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:43.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:43 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:15:43.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:43 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:15:43.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:43 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:15:43.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:43 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:15:43.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:43 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:43.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:43 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:43.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:43 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:15:43.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:43 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:15:43.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:43 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:15:43.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:43 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:15:43.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:43 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:15:43.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:43 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:15:44.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:44 smithi190 ceph-mon[36341]: Adjusting osd_memory_target on smithi082 to 176.2M 2024-03-04T09:15:44.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:44 smithi190 ceph-mon[36341]: Unable to set osd_memory_target on smithi082 to 184763801: error parsing value: Value '184763801' is below minimum 939524096 2024-03-04T09:15:44.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:44 smithi190 ceph-mon[36341]: Adjusting osd_memory_target on smithi102 to 176.2M 2024-03-04T09:15:44.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:44 smithi190 ceph-mon[36341]: Unable to set osd_memory_target on smithi102 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-03-04T09:15:44.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:44 smithi190 ceph-mon[36341]: Adjusting osd_memory_target on smithi190 to 176.2M 2024-03-04T09:15:44.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:44 smithi190 ceph-mon[36341]: Unable to set osd_memory_target on smithi190 to 184792473: error parsing value: Value '184792473' is below minimum 939524096 2024-03-04T09:15:44.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:44 smithi190 ceph-mon[36341]: Updating smithi082:/etc/ceph/ceph.conf 2024-03-04T09:15:44.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:44 smithi190 ceph-mon[36341]: Updating smithi102:/etc/ceph/ceph.conf 2024-03-04T09:15:44.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:44 smithi190 ceph-mon[36341]: Updating smithi190:/etc/ceph/ceph.conf 2024-03-04T09:15:44.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:44 smithi190 ceph-mon[36341]: Updating smithi102:/var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T09:15:44.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:44 smithi190 ceph-mon[36341]: Updating smithi082:/var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T09:15:44.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:44 smithi190 ceph-mon[36341]: Updating smithi190:/var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T09:15:44.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:44 smithi190 ceph-mon[36341]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:15:44.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:44 smithi190 ceph-mon[36341]: mgrmap e23: x(active, since 4s), standbys: y, z 2024-03-04T09:15:44.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:44 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:44.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:44 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:44.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:44 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:44.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:44 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:44.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:44 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:44.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:44 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:44.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:44 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:44.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:44 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:15:44.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:44 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:15:44.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:44 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:15:44.673 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:44 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:44.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:44 smithi102 ceph-mon[36220]: Adjusting osd_memory_target on smithi082 to 176.2M 2024-03-04T09:15:44.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:44 smithi102 ceph-mon[36220]: Unable to set osd_memory_target on smithi082 to 184763801: error parsing value: Value '184763801' is below minimum 939524096 2024-03-04T09:15:44.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:44 smithi102 ceph-mon[36220]: Adjusting osd_memory_target on smithi102 to 176.2M 2024-03-04T09:15:44.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:44 smithi102 ceph-mon[36220]: Unable to set osd_memory_target on smithi102 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-03-04T09:15:44.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:44 smithi102 ceph-mon[36220]: Adjusting osd_memory_target on smithi190 to 176.2M 2024-03-04T09:15:44.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:44 smithi102 ceph-mon[36220]: Unable to set osd_memory_target on smithi190 to 184792473: error parsing value: Value '184792473' is below minimum 939524096 2024-03-04T09:15:44.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:44 smithi102 ceph-mon[36220]: Updating smithi082:/etc/ceph/ceph.conf 2024-03-04T09:15:44.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:44 smithi102 ceph-mon[36220]: Updating smithi102:/etc/ceph/ceph.conf 2024-03-04T09:15:44.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:44 smithi102 ceph-mon[36220]: Updating smithi190:/etc/ceph/ceph.conf 2024-03-04T09:15:44.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:44 smithi102 ceph-mon[36220]: Updating smithi102:/var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T09:15:44.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:44 smithi102 ceph-mon[36220]: Updating smithi082:/var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T09:15:44.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:44 smithi102 ceph-mon[36220]: Updating smithi190:/var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T09:15:44.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:44 smithi102 ceph-mon[36220]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:15:44.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:44 smithi102 ceph-mon[36220]: mgrmap e23: x(active, since 4s), standbys: y, z 2024-03-04T09:15:44.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:44 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:44.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:44 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:44.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:44 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:44.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:44 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:44.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:44 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:44.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:44 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:44.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:44 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:44.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:44 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:15:44.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:44 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:15:44.681 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:44 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:15:44.681 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:44 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:44.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:44 smithi082 ceph-mon[32880]: Adjusting osd_memory_target on smithi082 to 176.2M 2024-03-04T09:15:44.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:44 smithi082 ceph-mon[32880]: Unable to set osd_memory_target on smithi082 to 184763801: error parsing value: Value '184763801' is below minimum 939524096 2024-03-04T09:15:44.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:44 smithi082 ceph-mon[32880]: Adjusting osd_memory_target on smithi102 to 176.2M 2024-03-04T09:15:44.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:44 smithi082 ceph-mon[32880]: Unable to set osd_memory_target on smithi102 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-03-04T09:15:44.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:44 smithi082 ceph-mon[32880]: Adjusting osd_memory_target on smithi190 to 176.2M 2024-03-04T09:15:44.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:44 smithi082 ceph-mon[32880]: Unable to set osd_memory_target on smithi190 to 184792473: error parsing value: Value '184792473' is below minimum 939524096 2024-03-04T09:15:44.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:44 smithi082 ceph-mon[32880]: Updating smithi082:/etc/ceph/ceph.conf 2024-03-04T09:15:44.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:44 smithi082 ceph-mon[32880]: Updating smithi102:/etc/ceph/ceph.conf 2024-03-04T09:15:44.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:44 smithi082 ceph-mon[32880]: Updating smithi190:/etc/ceph/ceph.conf 2024-03-04T09:15:44.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:44 smithi082 ceph-mon[32880]: Updating smithi102:/var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T09:15:44.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:44 smithi082 ceph-mon[32880]: Updating smithi082:/var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T09:15:44.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:44 smithi082 ceph-mon[32880]: Updating smithi190:/var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/config/ceph.conf 2024-03-04T09:15:44.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:44 smithi082 ceph-mon[32880]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:15:44.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:44 smithi082 ceph-mon[32880]: mgrmap e23: x(active, since 4s), standbys: y, z 2024-03-04T09:15:44.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:44 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:44.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:44 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:44.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:44 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:44.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:44 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:44.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:44 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:44.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:44 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:44.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:44 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:44.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:44 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:15:44.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:44 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:15:44.819 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:44 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:15:44.819 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:44 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:15:45.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:45 smithi190 ceph-mon[36341]: Updating smithi102:/etc/ceph/ceph.client.admin.keyring 2024-03-04T09:15:45.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:45 smithi190 ceph-mon[36341]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2024-03-04T09:15:45.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:45 smithi190 ceph-mon[36341]: Updating smithi190:/etc/ceph/ceph.client.admin.keyring 2024-03-04T09:15:45.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:45 smithi190 ceph-mon[36341]: Updating smithi102:/var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/config/ceph.client.admin.keyring 2024-03-04T09:15:45.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:45 smithi190 ceph-mon[36341]: Updating smithi082:/var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/config/ceph.client.admin.keyring 2024-03-04T09:15:45.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:45 smithi190 ceph-mon[36341]: Updating smithi190:/var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/config/ceph.client.admin.keyring 2024-03-04T09:15:45.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:45 smithi102 ceph-mon[36220]: Updating smithi102:/etc/ceph/ceph.client.admin.keyring 2024-03-04T09:15:45.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:45 smithi102 ceph-mon[36220]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2024-03-04T09:15:45.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:45 smithi102 ceph-mon[36220]: Updating smithi190:/etc/ceph/ceph.client.admin.keyring 2024-03-04T09:15:45.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:45 smithi102 ceph-mon[36220]: Updating smithi102:/var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/config/ceph.client.admin.keyring 2024-03-04T09:15:45.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:45 smithi102 ceph-mon[36220]: Updating smithi082:/var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/config/ceph.client.admin.keyring 2024-03-04T09:15:45.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:45 smithi102 ceph-mon[36220]: Updating smithi190:/var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/config/ceph.client.admin.keyring 2024-03-04T09:15:45.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:45 smithi082 ceph-mon[32880]: Updating smithi102:/etc/ceph/ceph.client.admin.keyring 2024-03-04T09:15:45.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:45 smithi082 ceph-mon[32880]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2024-03-04T09:15:45.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:45 smithi082 ceph-mon[32880]: Updating smithi190:/etc/ceph/ceph.client.admin.keyring 2024-03-04T09:15:45.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:45 smithi082 ceph-mon[32880]: Updating smithi102:/var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/config/ceph.client.admin.keyring 2024-03-04T09:15:45.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:45 smithi082 ceph-mon[32880]: Updating smithi082:/var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/config/ceph.client.admin.keyring 2024-03-04T09:15:45.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:45 smithi082 ceph-mon[32880]: Updating smithi190:/var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/config/ceph.client.admin.keyring 2024-03-04T09:15:46.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:46 smithi190 ceph-mon[36341]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-04T09:15:46.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:46 smithi102 ceph-mon[36220]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-04T09:15:46.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:46 smithi082 ceph-mon[32880]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-04T09:15:48.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:48 smithi190 ceph-mon[36341]: pgmap v7: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 132 KiB/s wr, 79 op/s 2024-03-04T09:15:48.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:48 smithi102 ceph-mon[36220]: pgmap v7: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 132 KiB/s wr, 79 op/s 2024-03-04T09:15:48.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:48 smithi082 ceph-mon[32880]: pgmap v7: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 132 KiB/s wr, 79 op/s 2024-03-04T09:15:50.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:50 smithi190 ceph-mon[36341]: pgmap v8: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 102 KiB/s wr, 61 op/s 2024-03-04T09:15:50.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:50 smithi102 ceph-mon[36220]: pgmap v8: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 102 KiB/s wr, 61 op/s 2024-03-04T09:15:50.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:50 smithi082 ceph-mon[32880]: pgmap v8: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 102 KiB/s wr, 61 op/s 2024-03-04T09:15:52.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:52 smithi190 ceph-mon[36341]: pgmap v9: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 84 KiB/s wr, 55 op/s 2024-03-04T09:15:52.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:52 smithi102 ceph-mon[36220]: pgmap v9: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 84 KiB/s wr, 55 op/s 2024-03-04T09:15:52.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:52 smithi082 ceph-mon[32880]: pgmap v9: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 84 KiB/s wr, 55 op/s 2024-03-04T09:15:54.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:54 smithi190 ceph-mon[36341]: pgmap v10: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 77 KiB/s wr, 50 op/s 2024-03-04T09:15:54.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:54 smithi102 ceph-mon[36220]: pgmap v10: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 77 KiB/s wr, 50 op/s 2024-03-04T09:15:54.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:54 smithi082 ceph-mon[32880]: pgmap v10: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 77 KiB/s wr, 50 op/s 2024-03-04T09:15:56.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:56 smithi190 ceph-mon[36341]: pgmap v11: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 77 KiB/s wr, 50 op/s 2024-03-04T09:15:56.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:56 smithi102 ceph-mon[36220]: pgmap v11: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 77 KiB/s wr, 50 op/s 2024-03-04T09:15:56.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:56 smithi082 ceph-mon[32880]: pgmap v11: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 77 KiB/s wr, 50 op/s 2024-03-04T09:15:58.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:15:58 smithi190 ceph-mon[36341]: pgmap v12: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 77 KiB/s wr, 54 op/s 2024-03-04T09:15:58.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:15:58 smithi102 ceph-mon[36220]: pgmap v12: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 77 KiB/s wr, 54 op/s 2024-03-04T09:15:58.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:15:58 smithi082 ceph-mon[32880]: pgmap v12: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 77 KiB/s wr, 54 op/s 2024-03-04T09:16:00.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:16:00 smithi190 ceph-mon[36341]: pgmap v13: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 8 op/s 2024-03-04T09:16:00.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:16:00 smithi102 ceph-mon[36220]: pgmap v13: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 8 op/s 2024-03-04T09:16:00.814 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:16:00 smithi082 ceph-mon[32880]: pgmap v13: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 8 op/s 2024-03-04T09:16:01.067 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:16:00 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:16:00.815+0000 7fa7213ec700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T09:16:01.067 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:16:00 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:16:00.815+0000 7fa7213ec700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T09:16:01.067 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:16:00 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:16:00.815+0000 7fa7213ec700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T09:16:01.067 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:16:00 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:16:00.815+0000 7fa7213ec700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T09:16:01.067 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:16:00 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:16:00.815+0000 7fa7213ec700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-04T09:16:02.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:16:02 smithi190 ceph-mon[36341]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 682 B/s wr, 12 op/s 2024-03-04T09:16:02.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:16:02 smithi102 ceph-mon[36220]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 682 B/s wr, 12 op/s 2024-03-04T09:16:02.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:16:02 smithi082 ceph-mon[32880]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 682 B/s wr, 12 op/s 2024-03-04T09:16:03.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:16:03 smithi190 ceph-mon[36341]: mgrmap e24: x(active, since 23s), standbys: y, z 2024-03-04T09:16:03.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:16:03 smithi102 ceph-mon[36220]: mgrmap e24: x(active, since 23s), standbys: y, z 2024-03-04T09:16:03.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:16:03 smithi082 ceph-mon[32880]: mgrmap e24: x(active, since 23s), standbys: y, z 2024-03-04T09:16:04.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:16:04 smithi102 ceph-mon[36220]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 8 op/s 2024-03-04T09:16:04.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:16:04 smithi082 ceph-mon[32880]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 8 op/s 2024-03-04T09:16:04.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:16:04 smithi190 ceph-mon[36341]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 8 op/s 2024-03-04T09:16:06.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:16:06 smithi102 ceph-mon[36220]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-04T09:16:06.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:16:06 smithi082 ceph-mon[32880]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-04T09:16:06.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:16:06 smithi190 ceph-mon[36341]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-03-04T09:16:08.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:16:08 smithi102 ceph-mon[36220]: pgmap v17: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 27 op/s 2024-03-04T09:16:08.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:16:08 smithi082 ceph-mon[32880]: pgmap v17: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 27 op/s 2024-03-04T09:16:08.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:16:08 smithi190 ceph-mon[36341]: pgmap v17: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 27 op/s 2024-03-04T09:16:10.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:16:10 smithi082 ceph-mon[32880]: pgmap v18: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-03-04T09:16:10.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:16:10 smithi190 ceph-mon[36341]: pgmap v18: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-03-04T09:16:10.928 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:16:10 smithi102 ceph-mon[36220]: pgmap v18: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-03-04T09:16:12.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:16:12 smithi082 ceph-mon[32880]: pgmap v19: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-03-04T09:16:12.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:16:12 smithi190 ceph-mon[36341]: pgmap v19: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-03-04T09:16:12.928 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:16:12 smithi102 ceph-mon[36220]: pgmap v19: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-03-04T09:16:14.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:16:14 smithi082 ceph-mon[32880]: pgmap v20: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-03-04T09:16:14.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:16:14 smithi190 ceph-mon[36341]: pgmap v20: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-03-04T09:16:14.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:16:14 smithi102 ceph-mon[36220]: pgmap v20: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-03-04T09:16:16.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:16:16 smithi082 ceph-mon[32880]: pgmap v21: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 27 op/s 2024-03-04T09:16:16.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:16:16 smithi190 ceph-mon[36341]: pgmap v21: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 27 op/s 2024-03-04T09:16:16.928 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:16:16 smithi102 ceph-mon[36220]: pgmap v21: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 27 op/s 2024-03-04T09:16:18.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:16:18 smithi082 ceph-mon[32880]: pgmap v22: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-03-04T09:16:18.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:16:18 smithi190 ceph-mon[36341]: pgmap v22: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-03-04T09:16:18.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:16:18 smithi102 ceph-mon[36220]: pgmap v22: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-03-04T09:16:20.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:16:20 smithi082 ceph-mon[32880]: pgmap v23: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2024-03-04T09:16:20.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:16:20 smithi190 ceph-mon[36341]: pgmap v23: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2024-03-04T09:16:20.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:16:20 smithi102 ceph-mon[36220]: pgmap v23: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2024-03-04T09:16:22.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:16:22 smithi082 ceph-mon[32880]: pgmap v24: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2024-03-04T09:16:22.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:16:22 smithi190 ceph-mon[36341]: pgmap v24: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2024-03-04T09:16:22.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:16:22 smithi102 ceph-mon[36220]: pgmap v24: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2024-03-04T09:16:24.723 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:16:24 smithi190 ceph-mon[36341]: pgmap v25: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-03-04T09:16:24.731 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:16:24 smithi102 ceph-mon[36220]: pgmap v25: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-03-04T09:16:24.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:16:24 smithi082 ceph-mon[32880]: pgmap v25: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-03-04T09:16:26.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:16:26 smithi082 ceph-mon[32880]: pgmap v26: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2024-03-04T09:16:26.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:16:26 smithi190 ceph-mon[36341]: pgmap v26: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2024-03-04T09:16:26.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:16:26 smithi102 ceph-mon[36220]: pgmap v26: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2024-03-04T09:16:28.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:16:28 smithi082 ceph-mon[32880]: pgmap v27: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:16:28.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:16:28 smithi190 ceph-mon[36341]: pgmap v27: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:16:28.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:16:28 smithi102 ceph-mon[36220]: pgmap v27: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:16:30.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:16:30 smithi082 ceph-mon[32880]: pgmap v28: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:16:30.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:16:30 smithi190 ceph-mon[36341]: pgmap v28: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:16:30.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:16:30 smithi102 ceph-mon[36220]: pgmap v28: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:16:32.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:16:32 smithi082 ceph-mon[32880]: pgmap v29: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:16:32.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:16:32 smithi190 ceph-mon[36341]: pgmap v29: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:16:32.928 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:16:32 smithi102 ceph-mon[36220]: pgmap v29: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:16:34.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:16:34 smithi082 ceph-mon[32880]: pgmap v30: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:16:34.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:16:34 smithi190 ceph-mon[36341]: pgmap v30: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:16:34.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:16:34 smithi102 ceph-mon[36220]: pgmap v30: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:16:36.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:16:36 smithi082 ceph-mon[32880]: pgmap v31: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:16:36.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:16:36 smithi190 ceph-mon[36341]: pgmap v31: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:16:36.928 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:16:36 smithi102 ceph-mon[36220]: pgmap v31: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:16:38.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:16:38 smithi082 ceph-mon[32880]: pgmap v32: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:16:38.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:16:38 smithi190 ceph-mon[36341]: pgmap v32: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:16:38.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:16:38 smithi102 ceph-mon[36220]: pgmap v32: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:16:40.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:16:40 smithi082 ceph-mon[32880]: pgmap v33: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:16:40.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:16:40 smithi190 ceph-mon[36341]: pgmap v33: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:16:40.928 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:16:40 smithi102 ceph-mon[36220]: pgmap v33: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:16:41.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:16:41 smithi082 ceph-mon[32880]: pgmap v34: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:16:41.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:16:41 smithi190 ceph-mon[36341]: pgmap v34: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:16:41.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:16:41 smithi102 ceph-mon[36220]: pgmap v34: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:16:44.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:16:44 smithi190 ceph-mon[36341]: pgmap v35: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:16:44.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:16:44 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:16:44.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:16:44 smithi102 ceph-mon[36220]: pgmap v35: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:16:44.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:16:44 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:16:44.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:16:44 smithi082 ceph-mon[32880]: pgmap v35: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:16:44.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:16:44 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:16:46.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:16:45 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:16:46.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:16:45 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:16:46.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:16:45 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:16:46.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:16:45 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:16:46.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:16:45 smithi190 ceph-mon[36341]: pgmap v36: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:16:46.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:16:45 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:16:46.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:16:45 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:16:46.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:16:45 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:16:46.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:16:45 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:16:46.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:16:45 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:16:46.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:16:45 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:16:46.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:16:45 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:16:46.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:16:45 smithi102 ceph-mon[36220]: pgmap v36: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:16:46.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:16:45 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:16:46.180 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:16:45 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:16:46.180 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:16:45 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:16:46.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:16:45 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:16:46.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:16:45 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:16:46.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:16:45 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:16:46.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:16:45 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:16:46.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:16:45 smithi082 ceph-mon[32880]: pgmap v36: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:16:46.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:16:45 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:16:46.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:16:45 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:16:46.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:16:45 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:16:48.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:16:48 smithi190 ceph-mon[36341]: pgmap v37: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:16:48.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:16:48 smithi102 ceph-mon[36220]: pgmap v37: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:16:48.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:16:48 smithi082 ceph-mon[32880]: pgmap v37: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:16:50.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:16:50 smithi190 ceph-mon[36341]: pgmap v38: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:16:50.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:16:50 smithi102 ceph-mon[36220]: pgmap v38: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:16:50.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:16:50 smithi082 ceph-mon[32880]: pgmap v38: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:16:52.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:16:52 smithi190 ceph-mon[36341]: pgmap v39: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:16:52.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:16:52 smithi102 ceph-mon[36220]: pgmap v39: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:16:52.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:16:52 smithi082 ceph-mon[32880]: pgmap v39: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:16:54.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:16:54 smithi190 ceph-mon[36341]: pgmap v40: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:16:54.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:16:54 smithi102 ceph-mon[36220]: pgmap v40: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:16:54.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:16:54 smithi082 ceph-mon[32880]: pgmap v40: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:16:56.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:16:56 smithi190 ceph-mon[36341]: pgmap v41: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:16:56.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:16:56 smithi102 ceph-mon[36220]: pgmap v41: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:16:56.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:16:56 smithi082 ceph-mon[32880]: pgmap v41: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:16:56.852 INFO:tasks.workunit.client.0.smithi082.stderr:Note: switching to '1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd'. 2024-03-04T09:16:56.853 INFO:tasks.workunit.client.0.smithi082.stderr: 2024-03-04T09:16:56.853 INFO:tasks.workunit.client.0.smithi082.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-04T09:16:56.853 INFO:tasks.workunit.client.0.smithi082.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-04T09:16:56.853 INFO:tasks.workunit.client.0.smithi082.stderr:state without impacting any branches by switching back to a branch. 2024-03-04T09:16:56.853 INFO:tasks.workunit.client.0.smithi082.stderr: 2024-03-04T09:16:56.853 INFO:tasks.workunit.client.0.smithi082.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-04T09:16:56.853 INFO:tasks.workunit.client.0.smithi082.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-04T09:16:56.853 INFO:tasks.workunit.client.0.smithi082.stderr: 2024-03-04T09:16:56.853 INFO:tasks.workunit.client.0.smithi082.stderr: git switch -c 2024-03-04T09:16:56.853 INFO:tasks.workunit.client.0.smithi082.stderr: 2024-03-04T09:16:56.853 INFO:tasks.workunit.client.0.smithi082.stderr:Or undo this operation with: 2024-03-04T09:16:56.853 INFO:tasks.workunit.client.0.smithi082.stderr: 2024-03-04T09:16:56.854 INFO:tasks.workunit.client.0.smithi082.stderr: git switch - 2024-03-04T09:16:56.854 INFO:tasks.workunit.client.0.smithi082.stderr: 2024-03-04T09:16:56.854 INFO:tasks.workunit.client.0.smithi082.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-04T09:16:56.854 INFO:tasks.workunit.client.0.smithi082.stderr: 2024-03-04T09:16:56.854 INFO:tasks.workunit.client.0.smithi082.stderr:HEAD is now at 1bc250c7129 mds/quiesce-db: incorporate review comments 2024-03-04T09:16:56.859 DEBUG:teuthology.orchestra.run.smithi082:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-03-04T09:16:56.926 INFO:tasks.workunit.client.0.smithi082.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-04T09:16:56.928 INFO:tasks.workunit.client.0.smithi082.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-04T09:16:56.928 INFO:tasks.workunit.client.0.smithi082.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-04T09:16:57.709 INFO:tasks.workunit.client.0.smithi082.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-04T09:16:57.785 INFO:tasks.workunit.client.0.smithi082.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-04T09:16:57.827 INFO:tasks.workunit.client.0.smithi082.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-04T09:16:57.828 INFO:tasks.workunit.client.0.smithi082.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-04T09:16:57.828 INFO:tasks.workunit.client.0.smithi082.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-04T09:16:57.868 INFO:tasks.workunit.client.0.smithi082.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-04T09:16:57.871 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-03-04T09:16:57.871 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-03-04T09:16:57.926 INFO:tasks.workunit:Running workunits matching fs/norstats on client.0... 2024-03-04T09:16:57.927 INFO:tasks.workunit:Running workunit fs/norstats/kernel_untar_tar.sh... 2024-03-04T09:16:57.928 DEBUG:teuthology.orchestra.run.smithi082:workunit test fs/norstats/kernel_untar_tar.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/norstats/kernel_untar_tar.sh 2024-03-04T09:16:57.991 INFO:tasks.workunit.client.0.smithi082.stderr:+ KERNEL=linux-4.0.5 2024-03-04T09:16:57.991 INFO:tasks.workunit.client.0.smithi082.stderr:+ wget -q http://download.ceph.com/qa/linux-4.0.5.tar.xz 2024-03-04T09:16:58.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:16:58 smithi190 ceph-mon[36341]: pgmap v42: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:16:58.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:16:58 smithi102 ceph-mon[36220]: pgmap v42: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:16:58.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:16:58 smithi082 ceph-mon[32880]: pgmap v42: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:17:00.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:17:00 smithi190 ceph-mon[36341]: pgmap v43: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:17:00.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:17:00 smithi102 ceph-mon[36220]: pgmap v43: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:17:00.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:17:00 smithi082 ceph-mon[32880]: pgmap v43: 129 pgs: 129 active+clean; 1.3 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:17:00.988 INFO:tasks.workunit.client.0.smithi082.stderr:+ mkdir untar_tar 2024-03-04T09:17:00.991 INFO:tasks.workunit.client.0.smithi082.stderr:+ cd untar_tar 2024-03-04T09:17:00.992 INFO:tasks.workunit.client.0.smithi082.stderr:+ tar Jxvf ../linux-4.0.5.tar.xz linux-4.0.5/Documentation/ 2024-03-04T09:17:01.054 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ 2024-03-04T09:17:01.056 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/00-INDEX 2024-03-04T09:17:01.058 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/ 2024-03-04T09:17:01.060 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/README 2024-03-04T09:17:01.062 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/obsolete/ 2024-03-04T09:17:01.064 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/obsolete/proc-sys-vm-nr_pdflush_threads 2024-03-04T09:17:01.066 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-bus-usb 2024-03-04T09:17:01.068 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-class-rfkill 2024-03-04T09:17:01.071 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-koneplus 2024-03-04T09:17:01.073 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-kovaplus 2024-03-04T09:17:01.075 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-pyra 2024-03-04T09:17:01.077 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/removed/ 2024-03-04T09:17:01.079 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/removed/devfs 2024-03-04T09:17:01.081 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/removed/dv1394 2024-03-04T09:17:01.084 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/removed/ip_queue 2024-03-04T09:17:01.086 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/removed/net_dma 2024-03-04T09:17:01.088 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/removed/o2cb 2024-03-04T09:17:01.090 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/removed/raw1394 2024-03-04T09:17:01.092 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/removed/video1394 2024-03-04T09:17:01.094 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/stable/ 2024-03-04T09:17:01.097 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/stable/firewire-cdev 2024-03-04T09:17:01.100 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/stable/o2cb 2024-03-04T09:17:01.102 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/stable/syscalls 2024-03-04T09:17:01.104 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-acpi-pmprofile 2024-03-04T09:17:01.106 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-firewire 2024-03-04T09:17:01.108 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-usb 2024-03-04T09:17:01.110 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-xen-backend 2024-03-04T09:17:01.113 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-backlight 2024-03-04T09:17:01.114 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-rfkill 2024-03-04T09:17:01.117 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-tpm 2024-03-04T09:17:01.120 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-ubi 2024-03-04T09:17:01.121 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-udc 2024-03-04T09:17:01.123 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-node 2024-03-04T09:17:01.125 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-cpu 2024-03-04T09:17:01.127 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-xen_memory 2024-03-04T09:17:01.129 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-ib_srp 2024-03-04T09:17:01.132 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-qla2xxx 2024-03-04T09:17:01.134 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-usb-usbtmc 2024-03-04T09:17:01.136 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-w1_ds28e04 2024-03-04T09:17:01.138 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-efi-vars 2024-03-04T09:17:01.140 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-dump 2024-03-04T09:17:01.142 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-elog 2024-03-04T09:17:01.144 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-module 2024-03-04T09:17:01.146 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-transport-srp 2024-03-04T09:17:01.148 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/stable/thermal-notification 2024-03-04T09:17:01.151 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/stable/vdso 2024-03-04T09:17:01.153 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/ 2024-03-04T09:17:01.155 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-spear-pcie-gadget 2024-03-04T09:17:01.157 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget 2024-03-04T09:17:01.160 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-acm 2024-03-04T09:17:01.161 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ecm 2024-03-04T09:17:01.164 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-eem 2024-03-04T09:17:01.166 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ffs 2024-03-04T09:17:01.168 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-hid 2024-03-04T09:17:01.169 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-loopback 2024-03-04T09:17:01.171 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-mass-storage 2024-03-04T09:17:01.174 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-midi 2024-03-04T09:17:01.176 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ncm 2024-03-04T09:17:01.178 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-obex 2024-03-04T09:17:01.180 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-phonet 2024-03-04T09:17:01.182 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-rndis 2024-03-04T09:17:01.184 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-serial 2024-03-04T09:17:01.186 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-sourcesink 2024-03-04T09:17:01.188 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-subset 2024-03-04T09:17:01.190 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac1 2024-03-04T09:17:01.192 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac2 2024-03-04T09:17:01.194 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uvc 2024-03-04T09:17:01.197 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-driver-genwqe 2024-03-04T09:17:01.199 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ec 2024-03-04T09:17:01.201 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ideapad 2024-03-04T09:17:01.203 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-olpc 2024-03-04T09:17:01.205 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pfo-nx-crypto 2024-03-04T09:17:01.207 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pktcdvd 2024-03-04T09:17:01.209 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/dev-kmsg 2024-03-04T09:17:01.212 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/evm 2024-03-04T09:17:01.213 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/ima_policy 2024-03-04T09:17:01.215 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/procfs-diskstats 2024-03-04T09:17:01.217 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/pstore 2024-03-04T09:17:01.219 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ata 2024-03-04T09:17:01.221 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block 2024-03-04T09:17:01.223 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-bcache 2024-03-04T09:17:01.225 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-dm 2024-03-04T09:17:01.228 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-rssd 2024-03-04T09:17:01.229 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-zram 2024-03-04T09:17:01.232 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-acpi 2024-03-04T09:17:01.234 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-amba 2024-03-04T09:17:01.236 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-bcma 2024-03-04T09:17:01.238 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etb10 2024-03-04T09:17:01.240 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etm3x 2024-03-04T09:17:01.243 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-funnel 2024-03-04T09:17:01.244 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-tmc 2024-03-04T09:17:01.247 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-css 2024-03-04T09:17:01.249 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-events 2024-03-04T09:17:01.252 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-format 2024-03-04T09:17:01.254 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_24x7 2024-03-04T09:17:01.256 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_gpci 2024-03-04T09:17:01.258 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-fcoe 2024-03-04T09:17:01.261 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-hsi 2024-03-04T09:17:01.263 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-fsa9480 2024-03-04T09:17:01.265 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-hm6352 2024-03-04T09:17:01.267 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-lm3533 2024-03-04T09:17:01.269 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio 2024-03-04T09:17:01.273 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-accel-bmc150 2024-03-04T09:17:01.275 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-ad9523 2024-03-04T09:17:01.277 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-adf4350 2024-03-04T09:17:01.279 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-gyro-bmg160 2024-03-04T09:17:01.282 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-light-lm3533-als 2024-03-04T09:17:01.285 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-mpu6050 2024-03-04T09:17:01.287 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-proximity-as3935 2024-03-04T09:17:01.289 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-trigger-sysfs 2024-03-04T09:17:01.291 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mdio 2024-03-04T09:17:01.293 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-media 2024-03-04T09:17:01.295 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mei 2024-03-04T09:17:01.297 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci 2024-03-04T09:17:01.300 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-devices-cciss 2024-03-04T09:17:01.302 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-drivers-ehci_hcd 2024-03-04T09:17:01.303 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-platform 2024-03-04T09:17:01.306 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rbd 2024-03-04T09:17:01.308 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rpmsg 2024-03-04T09:17:01.310 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-umc 2024-03-04T09:17:01.312 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb 2024-03-04T09:17:01.314 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-devices-usbsevseg 2024-03-04T09:17:01.316 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-lvstest 2024-03-04T09:17:01.318 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-c2port 2024-03-04T09:17:01.320 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-cfq-target-latency 2024-03-04T09:17:01.322 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class 2024-03-04T09:17:01.324 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-adp8870 2024-03-04T09:17:01.326 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-lm3533 2024-03-04T09:17:01.328 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-bdi 2024-03-04T09:17:01.331 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-cxl 2024-03-04T09:17:01.333 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-devfreq 2024-03-04T09:17:01.336 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-extcon 2024-03-04T09:17:01.338 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu 2024-03-04T09:17:01.340 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-amd-iommu 2024-03-04T09:17:01.342 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-intel-iommu 2024-03-04T09:17:01.344 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-lcd 2024-03-04T09:17:01.347 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led 2024-03-04T09:17:01.349 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led-driver-lm3533 2024-03-04T09:17:01.351 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-leds-gt683r 2024-03-04T09:17:01.353 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mei 2024-03-04T09:17:01.355 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mic.txt 2024-03-04T09:17:01.357 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mtd 2024-03-04T09:17:01.359 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net 2024-03-04T09:17:01.361 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-batman-adv 2024-03-04T09:17:01.364 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-cdc_ncm 2024-03-04T09:17:01.366 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-grcan 2024-03-04T09:17:01.368 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-mesh 2024-03-04T09:17:01.370 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-queues 2024-03-04T09:17:01.372 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-statistics 2024-03-04T09:17:01.374 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pktcdvd 2024-03-04T09:17:01.376 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-power 2024-03-04T09:17:01.378 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-powercap 2024-03-04T09:17:01.380 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pwm 2024-03-04T09:17:01.382 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rc 2024-03-04T09:17:01.384 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-regulator 2024-03-04T09:17:01.387 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rtc-rtc0-device-rtc_calibration 2024-03-04T09:17:01.389 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-scsi_host 2024-03-04T09:17:01.391 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc 2024-03-04T09:17:01.393 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc-wusbhc 2024-03-04T09:17:01.395 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-dev 2024-03-04T09:17:01.397 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices 2024-03-04T09:17:01.400 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-edac 2024-03-04T09:17:01.402 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-firmware_node 2024-03-04T09:17:01.405 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-lpss_ltr 2024-03-04T09:17:01.407 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-memory 2024-03-04T09:17:01.409 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-mmc 2024-03-04T09:17:01.411 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-online 2024-03-04T09:17:01.413 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-_UDC_-gadget 2024-03-04T09:17:01.415 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-docg3 2024-03-04T09:17:01.417 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-sh_mobile_lcdc_fb 2024-03-04T09:17:01.420 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power 2024-03-04T09:17:01.422 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D0 2024-03-04T09:17:01.424 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D1 2024-03-04T09:17:01.426 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D2 2024-03-04T09:17:01.428 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D3hot 2024-03-04T09:17:01.430 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_wakeup 2024-03-04T09:17:01.433 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_state 2024-03-04T09:17:01.435 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-real_power_state 2024-03-04T09:17:01.437 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-resource_in_use 2024-03-04T09:17:01.439 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-soc 2024-03-04T09:17:01.441 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-sun 2024-03-04T09:17:01.444 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-cpu 2024-03-04T09:17:01.446 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-ibm-rtl 2024-03-04T09:17:01.448 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-xen_cpu 2024-03-04T09:17:01.450 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-genwqe 2024-03-04T09:17:01.452 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid 2024-03-04T09:17:01.454 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-lenovo 2024-03-04T09:17:01.456 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-logitech-lg4ff 2024-03-04T09:17:01.459 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-multitouch 2024-03-04T09:17:01.461 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-picolcd 2024-03-04T09:17:01.463 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-prodikeys 2024-03-04T09:17:01.465 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-arvo 2024-03-04T09:17:01.468 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-isku 2024-03-04T09:17:01.470 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kone 2024-03-04T09:17:01.472 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-koneplus 2024-03-04T09:17:01.474 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-konepure 2024-03-04T09:17:01.476 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kovaplus 2024-03-04T09:17:01.479 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-lua 2024-03-04T09:17:01.481 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-pyra 2024-03-04T09:17:02.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:17:02 smithi190 ceph-mon[36341]: pgmap v44: 129 pgs: 129 active+clean; 53 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-03-04T09:17:02.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:17:02 smithi102 ceph-mon[36220]: pgmap v44: 129 pgs: 129 active+clean; 53 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-03-04T09:17:02.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:17:02 smithi082 ceph-mon[32880]: pgmap v44: 129 pgs: 129 active+clean; 53 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.3 MiB/s wr, 14 op/s 2024-03-04T09:17:04.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:17:04 smithi190 ceph-mon[36341]: pgmap v45: 129 pgs: 129 active+clean; 53 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-03-04T09:17:04.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:17:04 smithi102 ceph-mon[36220]: pgmap v45: 129 pgs: 129 active+clean; 53 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-03-04T09:17:04.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:17:04 smithi082 ceph-mon[32880]: pgmap v45: 129 pgs: 129 active+clean; 53 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.3 MiB/s wr, 10 op/s 2024-03-04T09:17:05.654 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-ryos 2024-03-04T09:17:05.656 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-savu 2024-03-04T09:17:05.659 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-srws1 2024-03-04T09:17:05.661 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-wiimote 2024-03-04T09:17:05.664 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-input-axp-pek 2024-03-04T09:17:05.666 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-intel-rapid-start 2024-03-04T09:17:05.668 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-pciback 2024-03-04T09:17:05.671 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-ppi 2024-03-04T09:17:05.673 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-samsung-laptop 2024-03-04T09:17:05.676 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-sunxi-sid 2024-03-04T09:17:05.678 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-tegra-fuse 2024-03-04T09:17:05.680 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-toshiba_acpi 2024-03-04T09:17:05.683 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-wacom 2024-03-04T09:17:05.685 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkback 2024-03-04T09:17:05.687 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkfront 2024-03-04T09:17:05.690 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-acpi 2024-03-04T09:17:05.692 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-dmi 2024-03-04T09:17:05.695 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi 2024-03-04T09:17:05.697 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi-runtime-map 2024-03-04T09:17:05.700 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-gsmi 2024-03-04T09:17:05.702 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-log 2024-03-04T09:17:05.704 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-memmap 2024-03-04T09:17:05.707 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-ofw 2024-03-04T09:17:05.709 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sfi 2024-03-04T09:17:05.712 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sgi_uv 2024-03-04T09:17:05.714 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-ext4 2024-03-04T09:17:05.716 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-f2fs 2024-03-04T09:17:05.718 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-nilfs2 2024-03-04T09:17:05.721 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-xfs 2024-03-04T09:17:05.723 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-gpio 2024-03-04T09:17:05.725 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-i2c-bmp085 2024-03-04T09:17:05.728 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ibft 2024-03-04T09:17:05.730 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-boot_params 2024-03-04T09:17:05.732 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-fscaps 2024-03-04T09:17:05.735 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-iommu_groups 2024-03-04T09:17:05.737 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-livepatch 2024-03-04T09:17:05.739 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm 2024-03-04T09:17:05.741 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-hugepages 2024-03-04T09:17:05.743 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-ksm 2024-03-04T09:17:05.747 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-slab 2024-03-04T09:17:05.749 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-uids 2024-03-04T09:17:05.751 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-vmcoreinfo 2024-03-04T09:17:05.753 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-memory-page-offline 2024-03-04T09:17:05.755 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-module 2024-03-04T09:17:05.758 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ocfs2 2024-03-04T09:17:05.760 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-laptop 2024-03-04T09:17:05.763 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-wmi 2024-03-04T09:17:05.765 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-at91 2024-03-04T09:17:05.767 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-brcmstb-gisb-arb 2024-03-04T09:17:05.769 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-chipidea-usb-otg 2024-03-04T09:17:05.772 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-eeepc-laptop 2024-03-04T09:17:05.774 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ideapad-laptop 2024-03-04T09:17:05.776 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-kim 2024-03-04T09:17:05.778 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-msi-laptop 2024-03-04T09:17:05.781 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-tahvo-usb 2024-03-04T09:17:05.783 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ts5500 2024-03-04T09:17:05.785 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-power 2024-03-04T09:17:05.787 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-pps 2024-03-04T09:17:05.791 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-profiling 2024-03-04T09:17:05.793 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ptp 2024-03-04T09:17:05.796 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-tty 2024-03-04T09:17:05.798 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-wusb_cbaf 2024-03-04T09:17:05.799 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/BUG-HUNTING 2024-03-04T09:17:05.802 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/Changes 2024-03-04T09:17:05.805 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/CodeOfConflict 2024-03-04T09:17:05.807 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/CodingStyle 2024-03-04T09:17:05.810 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DMA-API-HOWTO.txt 2024-03-04T09:17:05.813 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DMA-API.txt 2024-03-04T09:17:05.815 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DMA-ISA-LPC.txt 2024-03-04T09:17:05.818 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DMA-attributes.txt 2024-03-04T09:17:05.820 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/ 2024-03-04T09:17:05.822 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/.gitignore 2024-03-04T09:17:05.824 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/80211.tmpl 2024-03-04T09:17:05.827 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/Makefile 2024-03-04T09:17:05.829 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/alsa-driver-api.tmpl 2024-03-04T09:17:05.831 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/crypto-API.tmpl 2024-03-04T09:17:05.834 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/debugobjects.tmpl 2024-03-04T09:17:05.837 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/device-drivers.tmpl 2024-03-04T09:17:05.839 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/deviceiobook.tmpl 2024-03-04T09:17:05.841 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/drm.tmpl 2024-03-04T09:17:05.847 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/filesystems.tmpl 2024-03-04T09:17:05.850 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/gadget.tmpl 2024-03-04T09:17:05.853 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/genericirq.tmpl 2024-03-04T09:17:05.855 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/kernel-api.tmpl 2024-03-04T09:17:05.857 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/kernel-hacking.tmpl 2024-03-04T09:17:05.860 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/kernel-locking.tmpl 2024-03-04T09:17:05.863 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/kgdb.tmpl 2024-03-04T09:17:05.867 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/libata.tmpl 2024-03-04T09:17:05.870 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/librs.tmpl 2024-03-04T09:17:05.873 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/lsm.tmpl 2024-03-04T09:17:05.875 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/ 2024-03-04T09:17:05.876 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/Makefile 2024-03-04T09:17:05.879 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/bayer.png.b64 2024-03-04T09:17:05.881 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/constraints.png.b64 2024-03-04T09:17:05.883 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/crop.gif.b64 2024-03-04T09:17:05.885 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ 2024-03-04T09:17:05.887 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/.gitignore 2024-03-04T09:17:05.889 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/audio.xml 2024-03-04T09:17:05.892 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ca.xml 2024-03-04T09:17:05.894 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/demux.xml 2024-03-04T09:17:05.897 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbapi.xml 2024-03-04T09:17:05.899 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbproperty.xml 2024-03-04T09:17:05.902 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbstb.pdf 2024-03-04T09:17:05.905 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/examples.xml 2024-03-04T09:17:05.907 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/frontend.xml 2024-03-04T09:17:05.910 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/intro.xml 2024-03-04T09:17:05.912 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/kdapi.xml 2024-03-04T09:17:05.916 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/net.xml 2024-03-04T09:17:05.918 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/video.xml 2024-03-04T09:17:05.922 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/dvbstb.png.b64 2024-03-04T09:17:05.926 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_bt.gif.b64 2024-03-04T09:17:05.929 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_tb.gif.b64 2024-03-04T09:17:05.932 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt.gif.b64 2024-03-04T09:17:05.934 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt_example.gif.b64 2024-03-04T09:17:05.936 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/pipeline.png.b64 2024-03-04T09:17:05.938 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/selection.png.b64 2024-03-04T09:17:05.941 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/ 2024-03-04T09:17:05.943 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/.gitignore 2024-03-04T09:17:05.946 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/biblio.xml 2024-03-04T09:17:05.951 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/capture.c.xml 2024-03-04T09:17:05.952 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/common.xml 2024-03-04T09:17:05.953 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/compat.xml 2024-03-04T09:17:05.958 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/controls.xml 2024-03-04T09:17:05.965 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/crop.pdf 2024-03-04T09:17:05.967 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-capture.xml 2024-03-04T09:17:05.970 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-codec.xml 2024-03-04T09:17:05.972 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-effect.xml 2024-03-04T09:17:05.974 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-event.xml 2024-03-04T09:17:05.977 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-osd.xml 2024-03-04T09:17:05.979 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-output.xml 2024-03-04T09:17:05.981 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-overlay.xml 2024-03-04T09:17:05.983 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-radio.xml 2024-03-04T09:17:05.985 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-raw-vbi.xml 2024-03-04T09:17:05.988 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-rds.xml 2024-03-04T09:17:05.990 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sdr.xml 2024-03-04T09:17:05.992 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sliced-vbi.xml 2024-03-04T09:17:05.995 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-subdev.xml 2024-03-04T09:17:05.997 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-teletext.xml 2024-03-04T09:17:06.000 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/driver.xml 2024-03-04T09:17:06.002 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fdl-appendix.xml 2024-03-04T09:17:06.005 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_bt.pdf 2024-03-04T09:17:06.007 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_tb.pdf 2024-03-04T09:17:06.009 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-close.xml 2024-03-04T09:17:06.011 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-ioctl.xml 2024-03-04T09:17:06.013 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-mmap.xml 2024-03-04T09:17:06.016 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-munmap.xml 2024-03-04T09:17:06.018 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-open.xml 2024-03-04T09:17:06.020 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-poll.xml 2024-03-04T09:17:06.022 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-read.xml 2024-03-04T09:17:06.025 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-select.xml 2024-03-04T09:17:06.027 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-write.xml 2024-03-04T09:17:06.030 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/gen-errors.xml 2024-03-04T09:17:06.032 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/io.xml 2024-03-04T09:17:06.035 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/keytable.c.xml 2024-03-04T09:17:06.037 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/libv4l.xml 2024-03-04T09:17:06.039 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/lirc_device_interface.xml 2024-03-04T09:17:06.042 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-controller.xml 2024-03-04T09:17:06.044 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-close.xml 2024-03-04T09:17:06.046 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-ioctl.xml 2024-03-04T09:17:06.048 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-open.xml 2024-03-04T09:17:06.051 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-device-info.xml 2024-03-04T09:17:06.053 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-entities.xml 2024-03-04T09:17:06.055 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-links.xml 2024-03-04T09:17:06.057 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-setup-link.xml 2024-03-04T09:17:06.060 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pipeline.pdf 2024-03-04T09:17:06.062 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-grey.xml 2024-03-04T09:17:06.064 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-m420.xml 2024-03-04T09:17:06.067 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12.xml 2024-03-04T09:17:06.070 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12m.xml 2024-03-04T09:17:06.072 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12mt.xml 2024-03-04T09:17:06.074 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16.xml 2024-03-04T09:17:06.076 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16m.xml 2024-03-04T09:17:06.078 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv24.xml 2024-03-04T09:17:06.080 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-rgb.xml 2024-03-04T09:17:06.083 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-yuv.xml 2024-03-04T09:17:06.086 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr16.xml 2024-03-04T09:17:06.088 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr8.xml 2024-03-04T09:17:06.090 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs08.xml 2024-03-04T09:17:06.092 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs14le.xml 2024-03-04T09:17:06.094 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu08.xml 2024-03-04T09:17:06.096 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu16le.xml 2024-03-04T09:17:06.099 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-ru12le.xml 2024-03-04T09:17:06.101 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgbrg8.xml 2024-03-04T09:17:06.103 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgrbg8.xml 2024-03-04T09:17:06.105 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10.xml 2024-03-04T09:17:06.108 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10alaw8.xml 2024-03-04T09:17:06.110 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10dpcm8.xml 2024-03-04T09:17:06.112 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10p.xml 2024-03-04T09:17:06.114 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb12.xml 2024-03-04T09:17:06.116 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb8.xml 2024-03-04T09:17:06.119 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uv8.xml 2024-03-04T09:17:06.121 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uyvy.xml 2024-03-04T09:17:06.123 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-vyuy.xml 2024-03-04T09:17:06.125 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10.xml 2024-03-04T09:17:06.128 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10b.xml 2024-03-04T09:17:06.130 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y12.xml 2024-03-04T09:17:06.132 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y16.xml 2024-03-04T09:17:06.134 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y41p.xml 2024-03-04T09:17:06.136 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv410.xml 2024-03-04T09:17:06.139 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv411p.xml 2024-03-04T09:17:06.141 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420.xml 2024-03-04T09:17:06.143 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420m.xml 2024-03-04T09:17:06.146 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv422p.xml 2024-03-04T09:17:06.148 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuyv.xml 2024-03-04T09:17:06.150 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvu420m.xml 2024-03-04T09:17:06.153 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvyu.xml 2024-03-04T09:17:06.155 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt.xml 2024-03-04T09:17:06.159 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/planar-apis.xml 2024-03-04T09:17:06.161 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/remote_controllers.xml 2024-03-04T09:17:06.164 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selection-api.xml 2024-03-04T09:17:06.166 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selections-common.xml 2024-03-04T09:17:06.168 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-formats.xml 2024-03-04T09:17:06.173 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.dia 2024-03-04T09:17:06.176 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.svg 2024-03-04T09:17:06.179 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.dia 2024-03-04T09:17:06.182 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.svg 2024-03-04T09:17:06.184 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.dia 2024-03-04T09:17:06.187 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.svg 2024-03-04T09:17:06.190 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2.xml 2024-03-04T09:17:06.193 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2grab.c.xml 2024-03-04T09:17:06.195 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_525.pdf 2024-03-04T09:17:06.197 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_625.pdf 2024-03-04T09:17:06.199 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_hsync.pdf 2024-03-04T09:17:06.201 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-create-bufs.xml 2024-03-04T09:17:06.203 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-cropcap.xml 2024-03-04T09:17:06.205 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-chip-info.xml 2024-03-04T09:17:06.208 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-register.xml 2024-03-04T09:17:06.210 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-decoder-cmd.xml 2024-03-04T09:17:06.212 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dqevent.xml 2024-03-04T09:17:06.215 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dv-timings-cap.xml 2024-03-04T09:17:06.217 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-encoder-cmd.xml 2024-03-04T09:17:06.219 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-dv-timings.xml 2024-03-04T09:17:06.221 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-fmt.xml 2024-03-04T09:17:06.223 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-frameintervals.xml 2024-03-04T09:17:06.226 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-framesizes.xml 2024-03-04T09:17:06.228 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-freq-bands.xml 2024-03-04T09:17:06.231 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudio.xml 2024-03-04T09:17:06.233 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudioout.xml 2024-03-04T09:17:06.235 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enuminput.xml 2024-03-04T09:17:06.237 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumoutput.xml 2024-03-04T09:17:06.240 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumstd.xml 2024-03-04T09:17:06.242 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-expbuf.xml 2024-03-04T09:17:06.245 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audio.xml 2024-03-04T09:17:06.247 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audioout.xml 2024-03-04T09:17:06.249 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-crop.xml 2024-03-04T09:17:06.252 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ctrl.xml 2024-03-04T09:17:06.255 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-dv-timings.xml 2024-03-04T09:17:06.257 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-edid.xml 2024-03-04T09:17:06.260 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-enc-index.xml 2024-03-04T09:17:06.262 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ext-ctrls.xml 2024-03-04T09:17:06.264 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fbuf.xml 2024-03-04T09:17:06.267 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fmt.xml 2024-03-04T09:17:06.269 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-frequency.xml 2024-03-04T09:17:06.271 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-input.xml 2024-03-04T09:17:06.274 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-jpegcomp.xml 2024-03-04T09:17:06.276 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-modulator.xml 2024-03-04T09:17:06.279 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-output.xml 2024-03-04T09:17:06.281 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-parm.xml 2024-03-04T09:17:06.283 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-priority.xml 2024-03-04T09:17:06.285 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-selection.xml 2024-03-04T09:17:06.288 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-sliced-vbi-cap.xml 2024-03-04T09:17:06.290 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-std.xml 2024-03-04T09:17:06.292 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-tuner.xml 2024-03-04T09:17:06.295 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-log-status.xml 2024-03-04T09:17:06.298 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-overlay.xml 2024-03-04T09:17:06.300 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-prepare-buf.xml 2024-03-04T09:17:06.302 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-qbuf.xml 2024-03-04T09:17:06.304 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-query-dv-timings.xml 2024-03-04T09:17:06.306 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querybuf.xml 2024-03-04T09:17:06.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:17:06 smithi190 ceph-mon[36341]: pgmap v46: 129 pgs: 129 active+clean; 80 MiB data, 522 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.6 MiB/s wr, 46 op/s 2024-03-04T09:17:06.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:17:06 smithi102 ceph-mon[36220]: pgmap v46: 129 pgs: 129 active+clean; 80 MiB data, 522 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.6 MiB/s wr, 46 op/s 2024-03-04T09:17:06.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:17:06 smithi082 ceph-mon[32880]: pgmap v46: 129 pgs: 129 active+clean; 80 MiB data, 522 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.6 MiB/s wr, 46 op/s 2024-03-04T09:17:08.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:17:08 smithi190 ceph-mon[36341]: pgmap v47: 129 pgs: 129 active+clean; 80 MiB data, 522 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.6 MiB/s wr, 42 op/s 2024-03-04T09:17:08.678 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:17:08 smithi102 ceph-mon[36220]: pgmap v47: 129 pgs: 129 active+clean; 80 MiB data, 522 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.6 MiB/s wr, 42 op/s 2024-03-04T09:17:08.820 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:17:08 smithi082 ceph-mon[32880]: pgmap v47: 129 pgs: 129 active+clean; 80 MiB data, 522 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.6 MiB/s wr, 42 op/s 2024-03-04T09:17:09.691 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querycap.xml 2024-03-04T09:17:09.693 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-queryctrl.xml 2024-03-04T09:17:09.696 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querystd.xml 2024-03-04T09:17:09.698 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-reqbufs.xml 2024-03-04T09:17:09.701 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-s-hw-freq-seek.xml 2024-03-04T09:17:09.704 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-streamon.xml 2024-03-04T09:17:09.706 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-interval.xml 2024-03-04T09:17:09.709 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-size.xml 2024-03-04T09:17:09.711 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-mbus-code.xml 2024-03-04T09:17:09.713 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-crop.xml 2024-03-04T09:17:09.716 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-fmt.xml 2024-03-04T09:17:09.718 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-frame-interval.xml 2024-03-04T09:17:09.721 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-selection.xml 2024-03-04T09:17:09.723 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subscribe-event.xml 2024-03-04T09:17:09.725 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_525.gif.b64 2024-03-04T09:17:09.728 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_625.gif.b64 2024-03-04T09:17:09.731 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_hsync.gif.b64 2024-03-04T09:17:09.733 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/media_api.tmpl 2024-03-04T09:17:09.736 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/mtdnand.tmpl 2024-03-04T09:17:09.739 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/networking.tmpl 2024-03-04T09:17:09.742 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/rapidio.tmpl 2024-03-04T09:17:09.744 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/regulator.tmpl 2024-03-04T09:17:09.747 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/s390-drivers.tmpl 2024-03-04T09:17:09.749 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/scsi.tmpl 2024-03-04T09:17:09.752 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/sh.tmpl 2024-03-04T09:17:09.754 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/stylesheet.xsl 2024-03-04T09:17:09.756 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/tracepoint.tmpl 2024-03-04T09:17:09.758 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/uio-howto.tmpl 2024-03-04T09:17:09.761 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/usb.tmpl 2024-03-04T09:17:09.763 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/w1.tmpl 2024-03-04T09:17:09.766 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/writing-an-alsa-driver.tmpl 2024-03-04T09:17:09.772 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/writing_musb_glue_layer.tmpl 2024-03-04T09:17:09.776 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/writing_usb_driver.tmpl 2024-03-04T09:17:09.779 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/DocBook/z8530book.tmpl 2024-03-04T09:17:09.781 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/EDID/ 2024-03-04T09:17:09.784 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/EDID/1024x768.S 2024-03-04T09:17:09.786 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/EDID/1280x1024.S 2024-03-04T09:17:09.788 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/EDID/1600x1200.S 2024-03-04T09:17:09.790 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/EDID/1680x1050.S 2024-03-04T09:17:09.792 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/EDID/1920x1080.S 2024-03-04T09:17:09.794 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/EDID/800x600.S 2024-03-04T09:17:09.796 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/EDID/HOWTO.txt 2024-03-04T09:17:09.798 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/EDID/Makefile 2024-03-04T09:17:09.800 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/EDID/edid.S 2024-03-04T09:17:09.806 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/EDID/hex 2024-03-04T09:17:09.807 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/HOWTO 2024-03-04T09:17:09.810 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/IPMI.txt 2024-03-04T09:17:09.813 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/IRQ-affinity.txt 2024-03-04T09:17:09.815 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/IRQ-domain.txt 2024-03-04T09:17:09.817 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/IRQ.txt 2024-03-04T09:17:09.819 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/Intel-IOMMU.txt 2024-03-04T09:17:09.822 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/Makefile 2024-03-04T09:17:09.824 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ManagementStyle 2024-03-04T09:17:09.826 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/PCI/ 2024-03-04T09:17:09.828 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/PCI/00-INDEX 2024-03-04T09:17:09.830 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/PCI/MSI-HOWTO.txt 2024-03-04T09:17:09.832 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/PCI/PCIEBUS-HOWTO.txt 2024-03-04T09:17:09.835 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/PCI/pci-error-recovery.txt 2024-03-04T09:17:09.837 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/PCI/pci-iov-howto.txt 2024-03-04T09:17:09.839 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/PCI/pci.txt 2024-03-04T09:17:09.842 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/PCI/pcieaer-howto.txt 2024-03-04T09:17:09.844 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/RCU/ 2024-03-04T09:17:09.847 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/RCU/00-INDEX 2024-03-04T09:17:09.852 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/RCU/NMI-RCU.txt 2024-03-04T09:17:09.852 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/RCU/RTFP.txt 2024-03-04T09:17:09.855 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/RCU/UP.txt 2024-03-04T09:17:09.857 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/RCU/arrayRCU.txt 2024-03-04T09:17:09.859 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/RCU/checklist.txt 2024-03-04T09:17:09.862 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/RCU/listRCU.txt 2024-03-04T09:17:09.864 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/RCU/lockdep-splat.txt 2024-03-04T09:17:09.866 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/RCU/lockdep.txt 2024-03-04T09:17:09.868 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/RCU/rcu.txt 2024-03-04T09:17:09.870 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/RCU/rcu_dereference.txt 2024-03-04T09:17:09.873 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/RCU/rcubarrier.txt 2024-03-04T09:17:09.875 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/RCU/rculist_nulls.txt 2024-03-04T09:17:09.877 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/RCU/rcuref.txt 2024-03-04T09:17:09.879 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/RCU/stallwarn.txt 2024-03-04T09:17:09.881 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/RCU/torture.txt 2024-03-04T09:17:09.884 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/RCU/trace.txt 2024-03-04T09:17:09.886 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/RCU/whatisRCU.txt 2024-03-04T09:17:09.890 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/SAK.txt 2024-03-04T09:17:09.892 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/SM501.txt 2024-03-04T09:17:09.894 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/SecurityBugs 2024-03-04T09:17:09.896 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/SubmitChecklist 2024-03-04T09:17:09.899 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/SubmittingDrivers 2024-03-04T09:17:09.901 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/SubmittingPatches 2024-03-04T09:17:09.904 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/VGA-softcursor.txt 2024-03-04T09:17:09.906 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/accounting/ 2024-03-04T09:17:09.908 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/accounting/.gitignore 2024-03-04T09:17:09.910 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/accounting/Makefile 2024-03-04T09:17:09.913 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/accounting/cgroupstats.txt 2024-03-04T09:17:09.915 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/accounting/delay-accounting.txt 2024-03-04T09:17:09.917 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/accounting/getdelays.c 2024-03-04T09:17:09.919 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/accounting/taskstats-struct.txt 2024-03-04T09:17:09.922 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/accounting/taskstats.txt 2024-03-04T09:17:09.924 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/acpi/ 2024-03-04T09:17:09.926 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/acpi/apei/ 2024-03-04T09:17:09.927 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/acpi/apei/einj.txt 2024-03-04T09:17:09.929 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/acpi/apei/output_format.txt 2024-03-04T09:17:09.931 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/acpi/debug.txt 2024-03-04T09:17:09.934 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/acpi/dsdt-override.txt 2024-03-04T09:17:09.936 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/acpi/enumeration.txt 2024-03-04T09:17:09.938 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/acpi/gpio-properties.txt 2024-03-04T09:17:09.940 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/acpi/initrd_table_override.txt 2024-03-04T09:17:09.943 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/acpi/method-customizing.txt 2024-03-04T09:17:09.945 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/acpi/method-tracing.txt 2024-03-04T09:17:09.947 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/acpi/namespace.txt 2024-03-04T09:17:09.949 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/acpi/scan_handlers.txt 2024-03-04T09:17:09.951 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/acpi/video_extension.txt 2024-03-04T09:17:09.954 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/aoe/ 2024-03-04T09:17:09.956 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/aoe/aoe.txt 2024-03-04T09:17:09.959 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/aoe/autoload.sh 2024-03-04T09:17:09.961 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/aoe/status.sh 2024-03-04T09:17:09.963 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/aoe/todo.txt 2024-03-04T09:17:09.965 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/aoe/udev-install.sh 2024-03-04T09:17:09.967 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/aoe/udev.txt 2024-03-04T09:17:09.968 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/applying-patches.txt 2024-03-04T09:17:09.971 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/ 2024-03-04T09:17:09.973 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/00-INDEX 2024-03-04T09:17:09.975 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/Atmel/ 2024-03-04T09:17:09.976 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/Atmel/README 2024-03-04T09:17:09.978 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/Booting 2024-03-04T09:17:09.981 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/CCN.txt 2024-03-04T09:17:09.983 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/IXP4xx 2024-03-04T09:17:09.985 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/Interrupts 2024-03-04T09:17:09.987 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/Makefile 2024-03-04T09:17:09.989 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/Marvell/ 2024-03-04T09:17:09.990 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/Marvell/README 2024-03-04T09:17:09.993 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/Netwinder 2024-03-04T09:17:09.995 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/OMAP/ 2024-03-04T09:17:09.997 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/OMAP/DSS 2024-03-04T09:17:09.999 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/OMAP/omap_pm 2024-03-04T09:17:10.001 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/Porting 2024-03-04T09:17:10.004 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/README 2024-03-04T09:17:10.006 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/SA1100/ 2024-03-04T09:17:10.008 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/SA1100/ADSBitsy 2024-03-04T09:17:10.011 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/SA1100/Assabet 2024-03-04T09:17:10.013 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/SA1100/Brutus 2024-03-04T09:17:10.015 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/SA1100/CERF 2024-03-04T09:17:10.017 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/SA1100/FreeBird 2024-03-04T09:17:10.019 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsClient 2024-03-04T09:17:10.021 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsMaster 2024-03-04T09:17:10.024 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/SA1100/HUW_WEBPANEL 2024-03-04T09:17:10.026 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/SA1100/Itsy 2024-03-04T09:17:10.028 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/SA1100/LART 2024-03-04T09:17:10.030 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/SA1100/PLEB 2024-03-04T09:17:10.032 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/SA1100/Pangolin 2024-03-04T09:17:10.035 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/SA1100/Tifon 2024-03-04T09:17:10.037 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/SA1100/Victor 2024-03-04T09:17:10.039 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/SA1100/Yopy 2024-03-04T09:17:10.041 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/SA1100/empeg 2024-03-04T09:17:10.043 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/SA1100/nanoEngine 2024-03-04T09:17:10.046 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/SA1100/serial_UART 2024-03-04T09:17:10.048 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/ 2024-03-04T09:17:10.050 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/.gitignore 2024-03-04T09:17:10.052 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/Makefile 2024-03-04T09:17:10.055 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/vrl4.c 2024-03-04T09:17:10.056 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-mmcif.txt 2024-03-04T09:17:10.058 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-sdhi.txt 2024-03-04T09:17:10.060 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/SPEAr/ 2024-03-04T09:17:10.063 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/SPEAr/overview.txt 2024-03-04T09:17:10.065 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/ 2024-03-04T09:17:10.067 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/CPUfreq.txt 2024-03-04T09:17:10.069 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/EB2410ITX.txt 2024-03-04T09:17:10.072 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/GPIO.txt 2024-03-04T09:17:10.074 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/H1940.txt 2024-03-04T09:17:10.075 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/NAND.txt 2024-03-04T09:17:10.078 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Overview.txt 2024-03-04T09:17:10.080 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2412.txt 2024-03-04T09:17:10.082 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2413.txt 2024-03-04T09:17:10.084 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/SMDK2440.txt 2024-03-04T09:17:10.086 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Suspend.txt 2024-03-04T09:17:10.088 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/USB-Host.txt 2024-03-04T09:17:10.090 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/Samsung/ 2024-03-04T09:17:10.093 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/Samsung/GPIO.txt 2024-03-04T09:17:10.095 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/Samsung/Overview.txt 2024-03-04T09:17:10.097 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/Samsung/clksrc-change-registers.awk 2024-03-04T09:17:10.100 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/Setup 2024-03-04T09:17:10.102 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/VFP/ 2024-03-04T09:17:10.104 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/VFP/release-notes.txt 2024-03-04T09:17:10.106 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/cluster-pm-race-avoidance.txt 2024-03-04T09:17:10.109 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/firmware.txt 2024-03-04T09:17:10.111 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/kernel_mode_neon.txt 2024-03-04T09:17:10.113 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/kernel_user_helpers.txt 2024-03-04T09:17:10.115 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/mem_alignment 2024-03-04T09:17:10.117 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/memory.txt 2024-03-04T09:17:10.119 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/msm/ 2024-03-04T09:17:10.121 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/msm/gpiomux.txt 2024-03-04T09:17:10.123 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/nwfpe/ 2024-03-04T09:17:10.125 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/nwfpe/NOTES 2024-03-04T09:17:10.127 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/nwfpe/README 2024-03-04T09:17:10.129 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/nwfpe/README.FPE 2024-03-04T09:17:10.132 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/nwfpe/TODO 2024-03-04T09:17:10.134 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/pxa/ 2024-03-04T09:17:10.136 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/pxa/mfp.txt 2024-03-04T09:17:10.139 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/sti/ 2024-03-04T09:17:10.141 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/sti/overview.txt 2024-03-04T09:17:10.143 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/sti/stih407-overview.txt 2024-03-04T09:17:10.145 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/sti/stih415-overview.txt 2024-03-04T09:17:10.147 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/sti/stih416-overview.txt 2024-03-04T09:17:10.149 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/sti/stih418-overview.txt 2024-03-04T09:17:10.152 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/sunxi/ 2024-03-04T09:17:10.154 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/sunxi/README 2024-03-04T09:17:10.156 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/sunxi/clocks.txt 2024-03-04T09:17:10.158 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/swp_emulation 2024-03-04T09:17:10.160 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/tcm.txt 2024-03-04T09:17:10.162 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/uefi.txt 2024-03-04T09:17:10.164 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm/vlocks.txt 2024-03-04T09:17:10.166 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm64/ 2024-03-04T09:17:10.169 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm64/booting.txt 2024-03-04T09:17:10.171 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm64/legacy_instructions.txt 2024-03-04T09:17:10.173 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm64/memory.txt 2024-03-04T09:17:10.175 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/arm64/tagged-pointers.txt 2024-03-04T09:17:10.178 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/assoc_array.txt 2024-03-04T09:17:10.180 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/atomic_ops.txt 2024-03-04T09:17:10.183 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/auxdisplay/ 2024-03-04T09:17:10.185 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/auxdisplay/.gitignore 2024-03-04T09:17:10.187 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/auxdisplay/Makefile 2024-03-04T09:17:10.189 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b 2024-03-04T09:17:10.191 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b-example.c 2024-03-04T09:17:10.193 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/auxdisplay/ks0108 2024-03-04T09:17:10.195 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/backlight/ 2024-03-04T09:17:10.197 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/backlight/lp855x-driver.txt 2024-03-04T09:17:10.199 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/bad_memory.txt 2024-03-04T09:17:10.201 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/basic_profiling.txt 2024-03-04T09:17:10.204 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/bcache.txt 2024-03-04T09:17:10.206 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/binfmt_misc.txt 2024-03-04T09:17:10.209 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/blackfin/ 2024-03-04T09:17:10.211 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/blackfin/00-INDEX 2024-03-04T09:17:10.213 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/blackfin/Makefile 2024-03-04T09:17:10.215 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/blackfin/bfin-gpio-notes.txt 2024-03-04T09:17:10.216 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/blackfin/bfin-spi-notes.txt 2024-03-04T09:17:10.218 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/blackfin/gptimers-example.c 2024-03-04T09:17:10.221 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/block/ 2024-03-04T09:17:10.223 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/block/00-INDEX 2024-03-04T09:17:10.225 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/block/biodoc.txt 2024-03-04T09:17:10.228 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/block/biovecs.txt 2024-03-04T09:17:10.230 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/block/capability.txt 2024-03-04T09:17:10.232 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/block/cfq-iosched.txt 2024-03-04T09:17:10.234 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/block/cmdline-partition.txt 2024-03-04T09:17:10.237 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/block/data-integrity.txt 2024-03-04T09:17:10.239 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/block/deadline-iosched.txt 2024-03-04T09:17:10.241 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/block/ioprio.txt 2024-03-04T09:17:10.243 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/block/null_blk.txt 2024-03-04T09:17:10.245 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/block/queue-sysfs.txt 2024-03-04T09:17:10.247 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/block/request.txt 2024-03-04T09:17:10.249 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/block/stat.txt 2024-03-04T09:17:10.251 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/block/switching-sched.txt 2024-03-04T09:17:10.253 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/block/writeback_cache_control.txt 2024-03-04T09:17:10.255 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/blockdev/ 2024-03-04T09:17:10.258 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/blockdev/00-INDEX 2024-03-04T09:17:10.261 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/blockdev/README.DAC960 2024-03-04T09:17:10.263 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/blockdev/cciss.txt 2024-03-04T09:17:10.266 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/blockdev/cpqarray.txt 2024-03-04T09:17:10.268 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/blockdev/drbd/ 2024-03-04T09:17:10.270 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-8.3-data-packets.svg 2024-03-04T09:17:10.272 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-data-packets.svg 2024-03-04T09:17:10.275 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/blockdev/drbd/README.txt 2024-03-04T09:17:10.277 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/blockdev/drbd/conn-states-8.dot 2024-03-04T09:17:10.279 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/blockdev/drbd/data-structure-v9.txt 2024-03-04T09:17:10.281 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/blockdev/drbd/disk-states-8.dot 2024-03-04T09:17:10.283 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/blockdev/drbd/drbd-connection-state-overview.dot 2024-03-04T09:17:10.286 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/blockdev/drbd/node-states-8.dot 2024-03-04T09:17:10.288 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/blockdev/floppy.txt 2024-03-04T09:17:10.291 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/blockdev/mflash.txt 2024-03-04T09:17:10.293 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/blockdev/nbd.txt 2024-03-04T09:17:10.295 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/blockdev/paride.txt 2024-03-04T09:17:10.298 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/blockdev/ramdisk.txt 2024-03-04T09:17:10.300 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/blockdev/zram.txt 2024-03-04T09:17:10.302 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/braille-console.txt 2024-03-04T09:17:10.305 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/bt8xxgpio.txt 2024-03-04T09:17:10.307 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/btmrvl.txt 2024-03-04T09:17:10.309 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/bus-devices/ 2024-03-04T09:17:10.311 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/bus-devices/ti-gpmc.txt 2024-03-04T09:17:10.314 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/bus-virt-phys-mapping.txt 2024-03-04T09:17:10.316 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/cachetlb.txt 2024-03-04T09:17:10.318 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/cdrom/ 2024-03-04T09:17:10.321 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/cdrom/00-INDEX 2024-03-04T09:17:10.323 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/cdrom/Makefile 2024-03-04T09:17:10.325 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/cdrom/cdrom-standard.tex 2024-03-04T09:17:10.329 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/cdrom/ide-cd 2024-03-04T09:17:10.331 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/cdrom/packet-writing.txt 2024-03-04T09:17:10.333 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/cgroups/ 2024-03-04T09:17:10.336 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/cgroups/00-INDEX 2024-03-04T09:17:10.337 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/cgroups/blkio-controller.txt 2024-03-04T09:17:10.340 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/cgroups/cgroups.txt 2024-03-04T09:17:10.342 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/cgroups/cpuacct.txt 2024-03-04T09:17:10.344 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/cgroups/cpusets.txt 2024-03-04T09:17:10.347 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/cgroups/devices.txt 2024-03-04T09:17:10.349 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/cgroups/freezer-subsystem.txt 2024-03-04T09:17:10.351 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/cgroups/hugetlb.txt 2024-03-04T09:17:10.353 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/cgroups/memcg_test.txt 2024-03-04T09:17:10.355 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/cgroups/memory.txt 2024-03-04T09:17:10.358 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/cgroups/net_cls.txt 2024-03-04T09:17:10.360 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/cgroups/net_prio.txt 2024-03-04T09:17:10.362 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/cgroups/unified-hierarchy.txt 2024-03-04T09:17:10.365 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/circular-buffers.txt 2024-03-04T09:17:10.368 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/clk.txt 2024-03-04T09:17:10.370 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/coccinelle.txt 2024-03-04T09:17:10.372 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/connector/ 2024-03-04T09:17:10.374 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/connector/.gitignore 2024-03-04T09:17:10.376 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/connector/Makefile 2024-03-04T09:17:10.378 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/connector/cn_test.c 2024-03-04T09:17:10.380 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/connector/connector.txt 2024-03-04T09:17:10.382 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/connector/ucon.c 2024-03-04T09:17:10.384 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/console/ 2024-03-04T09:17:10.387 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/console/console.txt 2024-03-04T09:17:10.389 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/cpu-freq/ 2024-03-04T09:17:10.391 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/cpu-freq/amd-powernow.txt 2024-03-04T09:17:10.394 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/cpu-freq/boost.txt 2024-03-04T09:17:10.396 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/cpu-freq/core.txt 2024-03-04T09:17:10.398 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/cpu-freq/cpu-drivers.txt 2024-03-04T09:17:10.401 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-nforce2.txt 2024-03-04T09:17:10.403 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-stats.txt 2024-03-04T09:17:10.405 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/cpu-freq/governors.txt 2024-03-04T09:17:10.408 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/cpu-freq/index.txt 2024-03-04T09:17:10.410 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/cpu-freq/intel-pstate.txt 2024-03-04T09:17:10.412 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/cpu-freq/pcc-cpufreq.txt 2024-03-04T09:17:10.415 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/cpu-freq/user-guide.txt 2024-03-04T09:17:10.417 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/cpu-hotplug.txt 2024-03-04T09:17:10.421 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/cpu-load.txt 2024-03-04T09:17:10.425 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/cpuidle/ 2024-03-04T09:17:10.427 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/cpuidle/core.txt 2024-03-04T09:17:10.430 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/cpuidle/driver.txt 2024-03-04T09:17:10.432 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/cpuidle/governor.txt 2024-03-04T09:17:10.433 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/cpuidle/sysfs.txt 2024-03-04T09:17:10.435 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/cputopology.txt 2024-03-04T09:17:10.438 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/crc32.txt 2024-03-04T09:17:10.440 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/cris/ 2024-03-04T09:17:10.442 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/cris/README 2024-03-04T09:17:10.444 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/crypto/ 2024-03-04T09:17:10.446 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/crypto/api-intro.txt 2024-03-04T09:17:10.448 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/crypto/asymmetric-keys.txt 2024-03-04T09:17:10.450 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/crypto/async-tx-api.txt 2024-03-04T09:17:10.452 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/crypto/crypto-API-userspace.txt 2024-03-04T09:17:10.455 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/crypto/descore-readme.txt 2024-03-04T09:17:10.459 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/dcdbas.txt 2024-03-04T09:17:10.460 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/debugging-modules.txt 2024-03-04T09:17:10.462 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/debugging-via-ohci1394.txt 2024-03-04T09:17:10.464 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/dell_rbu.txt 2024-03-04T09:17:10.466 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/development-process/ 2024-03-04T09:17:10.468 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/development-process/1.Intro 2024-03-04T09:17:10.472 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/development-process/2.Process 2024-03-04T09:17:10.474 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/development-process/3.Early-stage 2024-03-04T09:17:10.476 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/development-process/4.Coding 2024-03-04T09:17:10.479 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/development-process/5.Posting 2024-03-04T09:17:10.481 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/development-process/6.Followthrough 2024-03-04T09:17:10.483 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/development-process/7.AdvancedTopics 2024-03-04T09:17:10.485 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/development-process/8.Conclusion 2024-03-04T09:17:10.487 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/device-mapper/ 2024-03-04T09:17:10.490 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/device-mapper/cache-policies.txt 2024-03-04T09:17:10.492 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/device-mapper/cache.txt 2024-03-04T09:17:10.495 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/device-mapper/delay.txt 2024-03-04T09:17:10.497 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/device-mapper/dm-crypt.txt 2024-03-04T09:17:10.499 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/device-mapper/dm-flakey.txt 2024-03-04T09:17:10.501 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/device-mapper/dm-io.txt 2024-03-04T09:17:10.503 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/device-mapper/dm-log.txt 2024-03-04T09:17:10.505 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/device-mapper/dm-queue-length.txt 2024-03-04T09:17:10.508 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/device-mapper/dm-raid.txt 2024-03-04T09:17:10.510 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/device-mapper/dm-service-time.txt 2024-03-04T09:17:10.512 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/device-mapper/dm-uevent.txt 2024-03-04T09:17:10.514 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/device-mapper/era.txt 2024-03-04T09:17:10.516 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/device-mapper/kcopyd.txt 2024-03-04T09:17:10.519 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/device-mapper/linear.txt 2024-03-04T09:17:10.520 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/device-mapper/persistent-data.txt 2024-03-04T09:17:10.522 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/device-mapper/snapshot.txt 2024-03-04T09:17:10.525 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/device-mapper/statistics.txt 2024-03-04T09:17:10.527 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/device-mapper/striped.txt 2024-03-04T09:17:10.529 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/device-mapper/switch.txt 2024-03-04T09:17:10.531 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/device-mapper/thin-provisioning.txt 2024-03-04T09:17:10.533 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/device-mapper/verity.txt 2024-03-04T09:17:10.535 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/device-mapper/zero.txt 2024-03-04T09:17:10.537 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devices.txt 2024-03-04T09:17:10.542 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/ 2024-03-04T09:17:10.544 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/00-INDEX 2024-03-04T09:17:10.546 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/ 2024-03-04T09:17:10.548 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/ABI.txt 2024-03-04T09:17:10.553 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/ 2024-03-04T09:17:10.556 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/interrupts.txt 2024-03-04T09:17:10.559 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/pmu.txt 2024-03-04T09:17:10.561 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ 2024-03-04T09:17:10.564 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/adapteva.txt 2024-03-04T09:17:10.568 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/ 2024-03-04T09:17:10.571 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-clk-manager.txt 2024-03-04T09:17:10.574 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-sdram-edac.txt 2024-03-04T09:17:10.576 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-system.txt 2024-03-04T09:17:10.579 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/amlogic.txt 2024-03-04T09:17:10.582 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arch_timer.txt 2024-03-04T09:17:10.585 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arm-boards 2024-03-04T09:17:10.587 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp-pmsu.txt 2024-03-04T09:17:10.590 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp.txt 2024-03-04T09:17:10.593 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-375.txt 2024-03-04T09:17:10.595 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-380-mpcore-soc-ctrl.txt 2024-03-04T09:17:10.597 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-38x.txt 2024-03-04T09:17:10.600 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-cpu-reset.txt 2024-03-04T09:17:10.603 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armadeus.txt 2024-03-04T09:17:10.605 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-at91.txt 2024-03-04T09:17:10.608 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-pmc.txt 2024-03-04T09:17:10.610 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/axxia.txt 2024-03-04T09:17:10.613 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/ 2024-03-04T09:17:10.615 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm11351.txt 2024-03-04T09:17:10.618 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm21664.txt 2024-03-04T09:17:10.620 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm63138.txt 2024-03-04T09:17:10.622 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/brcm,bcm11351-cpu-method 2024-03-04T09:17:10.625 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/cygnus.txt 2024-03-04T09:17:10.628 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-resetmgr.txt 2024-03-04T09:17:10.630 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-timer.txt 2024-03-04T09:17:10.633 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-wdt.txt 2024-03-04T09:17:10.635 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm2835.txt 2024-03-04T09:17:10.639 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm4708.txt 2024-03-04T09:17:10.641 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/brcm-brcmstb.txt 2024-03-04T09:17:10.644 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda.txt 2024-03-04T09:17:10.646 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/ 2024-03-04T09:17:10.649 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/combophy.txt 2024-03-04T09:17:10.652 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/l2ecc.txt 2024-03-04T09:17:10.654 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/mem-ctrlr.txt 2024-03-04T09:17:10.657 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cavium-thunder.txt 2024-03-04T09:17:10.660 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cci.txt 2024-03-04T09:17:10.663 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ccn.txt 2024-03-04T09:17:10.665 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coherency-fabric.txt 2024-03-04T09:17:10.667 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coresight.txt 2024-03-04T09:17:10.671 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/ 2024-03-04T09:17:10.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:17:10 smithi190 ceph-mon[36341]: pgmap v48: 129 pgs: 129 active+clean; 80 MiB data, 522 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.6 MiB/s wr, 42 op/s 2024-03-04T09:17:10.673 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/marvell,berlin-smp 2024-03-04T09:17:10.675 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpus.txt 2024-03-04T09:17:10.678 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci.txt 2024-03-04T09:17:10.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:17:10 smithi102 ceph-mon[36220]: pgmap v48: 129 pgs: 129 active+clean; 80 MiB data, 522 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.6 MiB/s wr, 42 op/s 2024-03-04T09:17:10.681 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/ 2024-03-04T09:17:10.683 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/cp-intc.txt 2024-03-04T09:17:10.687 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/digicolor.txt 2024-03-04T09:17:10.690 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/ 2024-03-04T09:17:10.692 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/power_domain.txt 2024-03-04T09:17:10.695 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/smp-sysram.txt 2024-03-04T09:17:10.698 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/ 2024-03-04T09:17:10.701 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/tlm,trusted-foundations.txt 2024-03-04T09:17:10.703 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fsl.txt 2024-03-04T09:17:10.706 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fw-cfg.txt 2024-03-04T09:17:10.709 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/geniatech.txt 2024-03-04T09:17:10.711 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic-v3.txt 2024-03-04T09:17:10.714 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic.txt 2024-03-04T09:17:10.717 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/global_timer.txt 2024-03-04T09:17:10.719 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/ 2024-03-04T09:17:10.722 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/hisilicon.txt 2024-03-04T09:17:10.726 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/idle-states.txt 2024-03-04T09:17:10.729 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/insignal-boards.txt 2024-03-04T09:17:10.731 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/ 2024-03-04T09:17:10.733 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/keystone.txt 2024-03-04T09:17:10.737 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/kirkwood.txt 2024-03-04T09:17:10.740 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/l2cc.txt 2024-03-04T09:17:10.742 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx-mic.txt 2024-03-04T09:17:10.745 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx.txt 2024-03-04T09:17:10.747 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,berlin.txt 2024-03-04T09:17:10.750 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,dove.txt 2024-03-04T09:17:10.754 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,kirkwood.txt 2024-03-04T09:17:10.757 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek.txt 2024-03-04T09:17:10.761 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/ 2024-03-04T09:17:10.763 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/mediatek,sysirq.txt 2024-03-04T09:17:10.766 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/moxart.txt 2024-03-04T09:17:10.770 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/ 2024-03-04T09:17:10.773 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/feroceon.txt 2024-03-04T09:17:10.777 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/intc.txt 2024-03-04T09:17:10.779 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/mrvl.txt 2024-03-04T09:17:10.782 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/tauros2.txt 2024-03-04T09:17:10.785 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/timer.txt 2024-03-04T09:17:10.788 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ 2024-03-04T09:17:10.791 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,kpss-acc.txt 2024-03-04T09:17:10.794 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,saw2.txt 2024-03-04T09:17:10.796 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ssbi.txt 2024-03-04T09:17:10.799 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/timer.txt 2024-03-04T09:17:10.802 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mvebu-system-controller.txt 2024-03-04T09:17:10.809 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/nspire.txt 2024-03-04T09:17:10.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:17:10 smithi082 ceph-mon[32880]: pgmap v48: 129 pgs: 129 active+clean; 80 MiB data, 522 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.6 MiB/s wr, 42 op/s 2024-03-04T09:17:10.857 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/olimex.txt 2024-03-04T09:17:10.860 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/ 2024-03-04T09:17:10.862 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/counter.txt 2024-03-04T09:17:10.864 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/crossbar.txt 2024-03-04T09:17:10.866 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dmm.txt 2024-03-04T09:17:10.869 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dsp.txt 2024-03-04T09:17:10.871 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/intc.txt 2024-03-04T09:17:10.873 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/iva.txt 2024-03-04T09:17:10.876 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/l3-noc.txt 2024-03-04T09:17:10.878 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/mpu.txt 2024-03-04T09:17:10.880 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/omap.txt 2024-03-04T09:17:10.882 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/prcm.txt 2024-03-04T09:17:10.884 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/timer.txt 2024-03-04T09:17:10.887 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/picoxcell.txt 2024-03-04T09:17:10.890 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/pmu.txt 2024-03-04T09:17:10.892 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/primecell.txt 2024-03-04T09:17:10.894 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/psci.txt 2024-03-04T09:17:10.896 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip.txt 2024-03-04T09:17:10.898 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/ 2024-03-04T09:17:10.900 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu-sram.txt 2024-03-04T09:17:10.902 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu.txt 2024-03-04T09:17:10.905 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/smp-sram.txt 2024-03-04T09:17:10.907 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rtsm-dcscb.txt 2024-03-04T09:17:10.910 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung-boards.txt 2024-03-04T09:17:10.912 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/ 2024-03-04T09:17:10.914 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-adc.txt 2024-03-04T09:17:10.916 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-chipid.txt 2024-03-04T09:17:10.919 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/interrupt-combiner.txt 2024-03-04T09:17:10.921 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/pmu.txt 2024-03-04T09:17:10.923 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/sysreg.txt 2024-03-04T09:17:10.926 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/shmobile.txt 2024-03-04T09:17:10.928 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sirf.txt 2024-03-04T09:17:10.930 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-misc.txt 2024-03-04T09:17:10.933 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-timer.txt 2024-03-04T09:17:10.935 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear.txt 2024-03-04T09:17:10.937 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/ 2024-03-04T09:17:10.940 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/shirq.txt 2024-03-04T09:17:10.942 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sprd.txt 2024-03-04T09:17:10.945 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-nomadik.txt 2024-03-04T09:17:10.947 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-u300.txt 2024-03-04T09:17:10.949 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sti.txt 2024-03-04T09:17:10.952 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sunxi.txt 2024-03-04T09:17:10.954 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra.txt 2024-03-04T09:17:10.956 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/ 2024-03-04T09:17:10.959 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-ahb.txt 2024-03-04T09:17:10.961 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-emc.txt 2024-03-04T09:17:10.963 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-flowctrl.txt 2024-03-04T09:17:10.965 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-mc.txt 2024-03-04T09:17:10.968 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-pmc.txt 2024-03-04T09:17:10.970 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra30-mc.txt 2024-03-04T09:17:10.972 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/topology.txt 2024-03-04T09:17:10.975 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/twd.txt 2024-03-04T09:17:10.980 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/ 2024-03-04T09:17:10.980 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/power_domain.txt 2024-03-04T09:17:10.982 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-fpga-irq.txt 2024-03-04T09:17:10.985 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-sysreg.txt 2024-03-04T09:17:10.987 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-scc.txt 2024-03-04T09:17:10.989 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-sysreg.txt 2024-03-04T09:17:10.991 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress.txt 2024-03-04T09:17:10.994 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vic.txt 2024-03-04T09:17:10.996 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500.txt 2024-03-04T09:17:10.998 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/ 2024-03-04T09:17:11.001 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-intc.txt 2024-03-04T09:17:11.004 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-pmc.txt 2024-03-04T09:17:11.006 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-timer.txt 2024-03-04T09:17:11.008 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xen.txt 2024-03-04T09:17:11.011 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xilinx.txt 2024-03-04T09:17:11.014 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ 2024-03-04T09:17:11.016 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-platform.txt 2024-03-04T09:17:11.018 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-st.txt 2024-03-04T09:17:11.020 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/apm-xgene.txt 2024-03-04T09:17:11.022 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/atmel-at91_cf.txt 2024-03-04T09:17:11.024 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/cavium-compact-flash.txt 2024-03-04T09:17:11.026 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/exynos-sata.txt 2024-03-04T09:17:11.029 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/fsl-sata.txt 2024-03-04T09:17:11.031 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-pata.txt 2024-03-04T09:17:11.033 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-sata.txt 2024-03-04T09:17:11.035 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/marvell.txt 2024-03-04T09:17:11.037 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/pata-arasan.txt 2024-03-04T09:17:11.040 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/qcom-sata.txt 2024-03-04T09:17:11.042 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_highbank.txt 2024-03-04T09:17:11.044 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_rcar.txt 2024-03-04T09:17:11.046 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/tegra-sata.txt 2024-03-04T09:17:11.049 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/btmrvl.txt 2024-03-04T09:17:11.052 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ 2024-03-04T09:17:11.054 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/bcma.txt 2024-03-04T09:17:11.057 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/brcm,gisb-arb.txt 2024-03-04T09:17:11.059 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/imx-weim.txt 2024-03-04T09:17:11.061 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/mvebu-mbus.txt 2024-03-04T09:17:11.063 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/omap-ocp2scp.txt 2024-03-04T09:17:11.066 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ti-gpmc.txt 2024-03-04T09:17:11.069 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/ 2024-03-04T09:17:11.071 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/clocks.txt 2024-03-04T09:17:11.073 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/dscr.txt 2024-03-04T09:17:11.075 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/emifa.txt 2024-03-04T09:17:11.078 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/interrupt.txt 2024-03-04T09:17:11.080 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/soc.txt 2024-03-04T09:17:11.082 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/timer64.txt 2024-03-04T09:17:11.084 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/chosen.txt 2024-03-04T09:17:11.087 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ 2024-03-04T09:17:11.089 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/alphascale,acc.txt 2024-03-04T09:17:11.092 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/altr_socfpga.txt 2024-03-04T09:17:11.094 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/arm-integrator.txt 2024-03-04T09:17:11.096 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/at91-clock.txt 2024-03-04T09:17:11.098 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/axi-clkgen.txt 2024-03-04T09:17:11.101 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-cygnus-clock.txt 2024-03-04T09:17:11.103 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-kona-clock.txt 2024-03-04T09:17:11.105 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/calxeda.txt 2024-03-04T09:17:11.107 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-exynos-audss.txt 2024-03-04T09:17:11.110 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-palmas-clk32kg-clocks.txt 2024-03-04T09:17:11.111 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-s5pv210-audss.txt 2024-03-04T09:17:11.114 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clock-bindings.txt 2024-03-04T09:17:11.116 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clps711x-clock.txt 2024-03-04T09:17:11.119 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/efm32-clock.txt 2024-03-04T09:17:11.121 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/emev2-clock.txt 2024-03-04T09:17:11.123 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos3250-clock.txt 2024-03-04T09:17:11.125 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4-clock.txt 2024-03-04T09:17:11.127 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4415-clock.txt 2024-03-04T09:17:11.130 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5250-clock.txt 2024-03-04T09:17:11.132 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5260-clock.txt 2024-03-04T09:17:11.134 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5410-clock.txt 2024-03-04T09:17:11.136 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5420-clock.txt 2024-03-04T09:17:11.138 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5440-clock.txt 2024-03-04T09:17:11.140 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos7-clock.txt 2024-03-04T09:17:11.143 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-clock.txt 2024-03-04T09:17:11.145 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-factor-clock.txt 2024-03-04T09:17:11.147 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/gpio-gate-clock.txt 2024-03-04T09:17:11.149 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hi3620-clock.txt 2024-03-04T09:17:11.151 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hix5hd2-clock.txt 2024-03-04T09:17:11.153 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx1-clock.txt 2024-03-04T09:17:11.155 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx21-clock.txt 2024-03-04T09:17:11.158 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx23-clock.txt 2024-03-04T09:17:11.160 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx25-clock.txt 2024-03-04T09:17:11.162 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx27-clock.txt 2024-03-04T09:17:11.164 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx28-clock.txt 2024-03-04T09:17:11.167 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx31-clock.txt 2024-03-04T09:17:11.169 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx35-clock.txt 2024-03-04T09:17:11.171 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx5-clock.txt 2024-03-04T09:17:11.173 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6q-clock.txt 2024-03-04T09:17:11.175 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sl-clock.txt 2024-03-04T09:17:11.177 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sx-clock.txt 2024-03-04T09:17:11.179 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-gate.txt 2024-03-04T09:17:11.182 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-pll.txt 2024-03-04T09:17:11.184 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/lsi,axm5516-clks.txt 2024-03-04T09:17:11.186 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,mmp2.txt 2024-03-04T09:17:11.188 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa168.txt 2024-03-04T09:17:11.190 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa910.txt 2024-03-04T09:17:11.192 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77686.txt 2024-03-04T09:17:11.195 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77802.txt 2024-03-04T09:17:11.197 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/moxa,moxart-clock.txt 2024-03-04T09:17:11.199 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-core-clock.txt 2024-03-04T09:17:11.201 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-corediv-clock.txt 2024-03-04T09:17:11.203 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-cpu-clock.txt 2024-03-04T09:17:11.205 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-gated-clock.txt 2024-03-04T09:17:11.208 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nspire-clock.txt 2024-03-04T09:17:11.210 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra114-car.txt 2024-03-04T09:17:11.212 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra124-car.txt 2024-03-04T09:17:11.214 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra20-car.txt 2024-03-04T09:17:11.216 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra30-car.txt 2024-03-04T09:17:11.219 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/prima2-clock.txt 2024-03-04T09:17:11.221 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/pxa-clock.txt 2024-03-04T09:17:11.223 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,gcc.txt 2024-03-04T09:17:11.225 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,lcc.txt 2024-03-04T09:17:11.227 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,mmcc.txt 2024-03-04T09:17:11.230 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qoriq-clock.txt 2024-03-04T09:17:11.232 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-div6-clocks.txt 2024-03-04T09:17:11.234 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-mstp-clocks.txt 2024-03-04T09:17:11.237 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a73a4-cpg-clocks.txt 2024-03-04T09:17:11.239 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7740-cpg-clocks.txt 2024-03-04T09:17:11.241 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7779-cpg-clocks.txt 2024-03-04T09:17:11.243 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rcar-gen2-cpg-clocks.txt 2024-03-04T09:17:11.245 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rz-cpg-clocks.txt 2024-03-04T09:17:11.247 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,sh73a0-cpg-clocks.txt 2024-03-04T09:17:11.250 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3188-cru.txt 2024-03-04T09:17:11.252 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3288-cru.txt 2024-03-04T09:17:11.254 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip.txt 2024-03-04T09:17:11.256 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2410-clock.txt 2024-03-04T09:17:11.259 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2412-clock.txt 2024-03-04T09:17:11.261 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2443-clock.txt 2024-03-04T09:17:11.263 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c64xx-clock.txt 2024-03-04T09:17:11.266 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s5pv210-clock.txt 2024-03-04T09:17:11.268 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si5351.txt 2024-03-04T09:17:11.271 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si570.txt 2024-03-04T09:17:11.273 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st,nomadik.txt 2024-03-04T09:17:11.275 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/ 2024-03-04T09:17:11.280 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-divmux.txt 2024-03-04T09:17:11.280 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-mux.txt 2024-03-04T09:17:11.282 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-pll.txt 2024-03-04T09:17:11.284 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-prediv.txt 2024-03-04T09:17:11.286 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-vcc.txt 2024-03-04T09:17:11.288 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen.txt 2024-03-04T09:17:11.290 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,flexgen.txt 2024-03-04T09:17:11.293 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,quadfs.txt 2024-03-04T09:17:11.295 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ste-u300-syscon-clock.txt 2024-03-04T09:17:11.298 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/sunxi.txt 2024-03-04T09:17:11.300 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti,cdce706.txt 2024-03-04T09:17:11.302 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti-keystone-pllctrl.txt 2024-03-04T09:17:11.305 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/ 2024-03-04T09:17:11.307 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/apll.txt 2024-03-04T09:17:11.309 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/autoidle.txt 2024-03-04T09:17:11.312 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/clockdomain.txt 2024-03-04T09:17:11.313 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/composite.txt 2024-03-04T09:17:11.316 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/divider.txt 2024-03-04T09:17:11.318 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dpll.txt 2024-03-04T09:17:11.321 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dra7-atl.txt 2024-03-04T09:17:11.323 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fapll.txt 2024-03-04T09:17:11.325 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fixed-factor-clock.txt 2024-03-04T09:17:11.328 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/gate.txt 2024-03-04T09:17:11.331 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/interface.txt 2024-03-04T09:17:11.333 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/mux.txt 2024-03-04T09:17:11.335 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vf610-clock.txt 2024-03-04T09:17:11.338 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vt8500.txt 2024-03-04T09:17:11.341 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/xgene.txt 2024-03-04T09:17:11.343 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/zynq-7000.txt 2024-03-04T09:17:11.345 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/ 2024-03-04T09:17:11.348 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/arm_big_little_dt.txt 2024-03-04T09:17:11.350 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-dt.txt 2024-03-04T09:17:11.353 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-exynos5440.txt 2024-03-04T09:17:11.355 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-spear.txt 2024-03-04T09:17:11.357 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/ 2024-03-04T09:17:11.360 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/amd-ccp.txt 2024-03-04T09:17:11.362 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/atmel-crypto.txt 2024-03-04T09:17:11.364 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-dcp.txt 2024-03-04T09:17:11.366 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-imx-sahara.txt 2024-03-04T09:17:11.368 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec2.txt 2024-03-04T09:17:11.370 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec4.txt 2024-03-04T09:17:11.373 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec6.txt 2024-03-04T09:17:11.375 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/mv_cesa.txt 2024-03-04T09:17:11.377 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-aes.txt 2024-03-04T09:17:11.380 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-des.txt 2024-03-04T09:17:11.382 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-sham.txt 2024-03-04T09:17:11.385 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/picochip-spacc.txt 2024-03-04T09:17:11.387 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/qcom-qce.txt 2024-03-04T09:17:11.390 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/samsung-sss.txt 2024-03-04T09:17:11.392 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/ 2024-03-04T09:17:11.394 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/ 2024-03-04T09:17:11.396 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/exynos-ppmu.txt 2024-03-04T09:17:11.399 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ 2024-03-04T09:17:11.402 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/arm-pl330.txt 2024-03-04T09:17:11.404 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-dma.txt 2024-03-04T09:17:11.406 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-xdma.txt 2024-03-04T09:17:11.408 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/bcm2835-dma.txt 2024-03-04T09:17:11.411 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/dma.txt 2024-03-04T09:17:11.413 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-edma.txt 2024-03-04T09:17:11.415 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-dma.txt 2024-03-04T09:17:11.417 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-sdma.txt 2024-03-04T09:17:11.420 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-mxs-dma.txt 2024-03-04T09:17:11.422 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/img-mdc-dma.txt 2024-03-04T09:17:11.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:17:11 smithi102 ceph-mon[36220]: mgrmap e25: x(active, since 91s), standbys: y, z 2024-03-04T09:17:11.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:17:11 smithi082 ceph-mon[32880]: mgrmap e25: x(active, since 91s), standbys: y, z 2024-03-04T09:17:11.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:17:11 smithi190 ceph-mon[36341]: mgrmap e25: x(active, since 91s), standbys: y, z 2024-03-04T09:17:12.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:17:12 smithi102 ceph-mon[36220]: pgmap v49: 129 pgs: 129 active+clean; 86 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 7.2 MiB/s wr, 94 op/s 2024-03-04T09:17:12.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:17:12 smithi102 ceph-mon[36220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:17:12.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:17:12 smithi082 ceph-mon[32880]: pgmap v49: 129 pgs: 129 active+clean; 86 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 7.2 MiB/s wr, 94 op/s 2024-03-04T09:17:12.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:17:12 smithi082 ceph-mon[32880]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:17:12.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:17:12 smithi190 ceph-mon[36341]: pgmap v49: 129 pgs: 129 active+clean; 86 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 7.2 MiB/s wr, 94 op/s 2024-03-04T09:17:12.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:17:12 smithi190 ceph-mon[36341]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:17:14.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:17:14 smithi102 ceph-mon[36220]: pgmap v50: 129 pgs: 129 active+clean; 86 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 2.8 MiB/s wr, 88 op/s 2024-03-04T09:17:14.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:17:14 smithi082 ceph-mon[32880]: pgmap v50: 129 pgs: 129 active+clean; 86 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 2.8 MiB/s wr, 88 op/s 2024-03-04T09:17:14.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:17:14 smithi190 ceph-mon[36341]: pgmap v50: 129 pgs: 129 active+clean; 86 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 2.8 MiB/s wr, 88 op/s 2024-03-04T09:17:16.102 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/k3dma.txt 2024-03-04T09:17:16.106 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mmp-dma.txt 2024-03-04T09:17:16.109 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/moxa,moxart-dma.txt 2024-03-04T09:17:16.113 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mpc512x-dma.txt 2024-03-04T09:17:16.116 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mv-xor.txt 2024-03-04T09:17:16.119 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/nbpfaxi.txt 2024-03-04T09:17:16.121 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_adm.txt 2024-03-04T09:17:16.124 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_bam_dma.txt 2024-03-04T09:17:16.127 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/rcar-audmapp.txt 2024-03-04T09:17:16.129 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/renesas,rcar-dmac.txt 2024-03-04T09:17:16.132 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/shdma.txt 2024-03-04T09:17:16.135 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sirfsoc-dma.txt 2024-03-04T09:17:16.137 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/snps-dma.txt 2024-03-04T09:17:16.140 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-coh901318.txt 2024-03-04T09:17:16.143 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-dma40.txt 2024-03-04T09:17:16.146 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sun6i-dma.txt 2024-03-04T09:17:16.148 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/tegra20-apbdma.txt 2024-03-04T09:17:16.151 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ti-edma.txt 2024-03-04T09:17:16.154 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/ 2024-03-04T09:17:16.156 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_dma.txt 2024-03-04T09:17:16.159 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_vdma.txt 2024-03-04T09:17:16.162 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/ 2024-03-04T09:17:16.166 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/ 2024-03-04T09:17:16.169 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/marvell,dove-lcd.txt 2024-03-04T09:17:16.173 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/ 2024-03-04T09:17:16.176 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/hlcdc-dc.txt 2024-03-04T09:17:16.178 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/ 2024-03-04T09:17:16.181 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/dw_hdmi.txt 2024-03-04T09:17:16.184 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/ 2024-03-04T09:17:16.187 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/tda998x.txt 2024-03-04T09:17:16.191 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ 2024-03-04T09:17:16.193 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/fsl-imx-drm.txt 2024-03-04T09:17:16.197 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/hdmi.txt 2024-03-04T09:17:16.199 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ldb.txt 2024-03-04T09:17:16.201 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/ 2024-03-04T09:17:16.204 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/gpu.txt 2024-03-04T09:17:16.206 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/hdmi.txt 2024-03-04T09:17:16.208 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/mdp.txt 2024-03-04T09:17:16.210 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/ 2024-03-04T09:17:16.214 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/panel.txt 2024-03-04T09:17:16.216 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/slave.txt 2024-03-04T09:17:16.219 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tfp410.txt 2024-03-04T09:17:16.221 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tilcdc.txt 2024-03-04T09:17:16.223 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/eeprom.txt 2024-03-04T09:17:16.226 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/ 2024-03-04T09:17:16.230 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-palmas.txt 2024-03-04T09:17:16.231 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-rt8973a.txt 2024-03-04T09:17:16.233 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-sm5502.txt 2024-03-04T09:17:16.236 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/ 2024-03-04T09:17:16.238 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/mxsfb.txt 2024-03-04T09:17:16.240 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/sm501fb.txt 2024-03-04T09:17:16.243 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/ 2024-03-04T09:17:16.246 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/altera-socfpga-fpga-mgr.txt 2024-03-04T09:17:16.248 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/ 2024-03-04T09:17:16.251 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/nvidia,tegra20-fuse.txt 2024-03-04T09:17:16.253 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/ 2024-03-04T09:17:16.255 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/8xxx_gpio.txt 2024-03-04T09:17:16.257 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/abilis,tb10x-gpio.txt 2024-03-04T09:17:16.259 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cavium-octeon-gpio.txt 2024-03-04T09:17:16.262 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cirrus,clps711x-mctrl-gpio.txt 2024-03-04T09:17:16.264 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fsl-imx-gpio.txt 2024-03-04T09:17:16.266 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fujitsu,mb86s70-gpio.txt 2024-03-04T09:17:16.268 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74x164.txt 2024-03-04T09:17:16.271 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74xx-mmio.txt 2024-03-04T09:17:16.273 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-adnp.txt 2024-03-04T09:17:16.275 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-bcm-kona.txt 2024-03-04T09:17:16.278 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-clps711x.txt 2024-03-04T09:17:16.280 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-davinci.txt 2024-03-04T09:17:16.282 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-dsp-keystone.txt 2024-03-04T09:17:16.284 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-fan.txt 2024-03-04T09:17:16.286 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-grgpio.txt 2024-03-04T09:17:16.288 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-lp3943.txt 2024-03-04T09:17:16.291 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-max732x.txt 2024-03-04T09:17:16.293 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mcp23s08.txt 2024-03-04T09:17:16.295 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mm-lantiq.txt 2024-03-04T09:17:16.297 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-msm.txt 2024-03-04T09:17:16.299 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mvebu.txt 2024-03-04T09:17:16.302 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mxs.txt 2024-03-04T09:17:16.304 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-nmk.txt 2024-03-04T09:17:16.306 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-omap.txt 2024-03-04T09:17:16.308 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-palmas.txt 2024-03-04T09:17:16.311 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pca953x.txt 2024-03-04T09:17:16.313 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pcf857x.txt 2024-03-04T09:17:16.315 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-poweroff.txt 2024-03-04T09:17:16.317 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-restart.txt 2024-03-04T09:17:16.319 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-samsung.txt 2024-03-04T09:17:16.324 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stericsson-coh901.txt 2024-03-04T09:17:16.324 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stmpe.txt 2024-03-04T09:17:16.325 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stp-xway.txt 2024-03-04T09:17:16.328 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-sx150x.txt 2024-03-04T09:17:16.330 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-twl4030.txt 2024-03-04T09:17:16.332 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090-pdc.txt 2024-03-04T09:17:16.335 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090.txt 2024-03-04T09:17:16.337 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-vf610.txt 2024-03-04T09:17:16.339 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene-sb.txt 2024-03-04T09:17:16.341 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene.txt 2024-03-04T09:17:16.343 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xilinx.txt 2024-03-04T09:17:16.345 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zevio.txt 2024-03-04T09:17:16.348 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zynq.txt 2024-03-04T09:17:16.350 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio.txt 2024-03-04T09:17:16.352 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_atmel.txt 2024-03-04T09:17:16.355 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_lpc32xx.txt 2024-03-04T09:17:16.357 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/moxa,moxart-gpio.txt 2024-03-04T09:17:16.359 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/mrvl-gpio.txt 2024-03-04T09:17:16.361 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/nvidia,tegra20-gpio.txt 2024-03-04T09:17:16.364 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/pl061-gpio.txt 2024-03-04T09:17:16.366 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/renesas,gpio-rcar.txt 2024-03-04T09:17:16.368 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/snps-dwapb-gpio.txt 2024-03-04T09:17:16.370 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/sodaville.txt 2024-03-04T09:17:16.373 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/spear_spics.txt 2024-03-04T09:17:16.375 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/ 2024-03-04T09:17:16.377 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,gk20a.txt 2024-03-04T09:17:16.379 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,tegra20-host1x.txt 2024-03-04T09:17:16.382 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-g2d.txt 2024-03-04T09:17:16.384 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-rotator.txt 2024-03-04T09:17:16.386 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/st,stih4xx.txt 2024-03-04T09:17:16.389 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/graph.txt 2024-03-04T09:17:16.392 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/ 2024-03-04T09:17:16.395 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/hid-over-i2c.txt 2024-03-04T09:17:16.396 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/ 2024-03-04T09:17:16.399 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/client-devices.txt 2024-03-04T09:17:16.402 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/nokia-modem.txt 2024-03-04T09:17:16.404 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/omap-ssi.txt 2024-03-04T09:17:16.406 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ 2024-03-04T09:17:16.409 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ads1015.txt 2024-03-04T09:17:16.411 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/g762.txt 2024-03-04T09:17:16.413 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ibmpowernv.txt 2024-03-04T09:17:16.415 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/lm90.txt 2024-03-04T09:17:16.417 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ltc2978.txt 2024-03-04T09:17:16.420 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ntc_thermistor.txt 2024-03-04T09:17:16.422 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/pwm-fan.txt 2024-03-04T09:17:16.424 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/vexpress.txt 2024-03-04T09:17:16.427 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/ 2024-03-04T09:17:16.430 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/atmel-trng.txt 2024-03-04T09:17:16.432 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/omap_rng.txt 2024-03-04T09:17:16.434 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/timeriomem_rng.txt 2024-03-04T09:17:16.437 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ 2024-03-04T09:17:16.440 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,bcm2835-i2c.txt 2024-03-04T09:17:16.445 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,iproc-i2c.txt 2024-03-04T09:17:16.448 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-arb-gpio-challenge.txt 2024-03-04T09:17:16.451 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-at91.txt 2024-03-04T09:17:16.456 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-axxia.txt 2024-03-04T09:17:16.461 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-bcm-kona.txt 2024-03-04T09:17:16.464 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cadence.txt 2024-03-04T09:17:16.466 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cbus-gpio.txt 2024-03-04T09:17:16.469 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cros-ec-tunnel.txt 2024-03-04T09:17:16.471 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-davinci.txt 2024-03-04T09:17:16.474 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-designware.txt 2024-03-04T09:17:16.477 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-efm32.txt 2024-03-04T09:17:16.479 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-exynos5.txt 2024-03-04T09:17:16.481 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-gpio.txt 2024-03-04T09:17:16.484 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-hix5hd2.txt 2024-03-04T09:17:16.487 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-img-scb.txt 2024-03-04T09:17:16.490 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-imx.txt 2024-03-04T09:17:16.493 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-meson.txt 2024-03-04T09:17:16.496 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mpc.txt 2024-03-04T09:17:16.498 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-gpio.txt 2024-03-04T09:17:16.501 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pca954x.txt 2024-03-04T09:17:16.503 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pinctrl.txt 2024-03-04T09:17:16.506 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux.txt 2024-03-04T09:17:16.509 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mv64xxx.txt 2024-03-04T09:17:16.511 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mxs.txt 2024-03-04T09:17:16.513 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-nomadik.txt 2024-03-04T09:17:16.516 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-ocores.txt 2024-03-04T09:17:16.519 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-octeon.txt 2024-03-04T09:17:16.521 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-omap.txt 2024-03-04T09:17:16.524 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-opal.txt 2024-03-04T09:17:16.527 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pnx.txt 2024-03-04T09:17:16.529 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa-pci-ce4100.txt 2024-03-04T09:17:16.531 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa.txt 2024-03-04T09:17:16.533 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rcar.txt 2024-03-04T09:17:16.536 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-riic.txt 2024-03-04T09:17:16.538 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rk3x.txt 2024-03-04T09:17:16.540 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-s3c2410.txt 2024-03-04T09:17:16.543 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sh_mobile.txt 2024-03-04T09:17:16.546 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sirf.txt 2024-03-04T09:17:16.548 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st-ddci2c.txt 2024-03-04T09:17:16.552 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st.txt 2024-03-04T09:17:16.555 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sunxi-p2wi.txt 2024-03-04T09:17:16.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:17:16 smithi102 ceph-mon[36220]: pgmap v51: 129 pgs: 129 active+clean; 89 MiB data, 571 MiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 3.0 MiB/s wr, 126 op/s 2024-03-04T09:17:16.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:17:16 smithi082 ceph-mon[32880]: pgmap v51: 129 pgs: 129 active+clean; 89 MiB data, 571 MiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 3.0 MiB/s wr, 126 op/s 2024-03-04T09:17:16.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:17:16 smithi190 ceph-mon[36341]: pgmap v51: 129 pgs: 129 active+clean; 89 MiB data, 571 MiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 3.0 MiB/s wr, 126 op/s 2024-03-04T09:17:17.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:17:17 smithi082 ceph-mon[32880]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:17:17.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:17:17 smithi190 ceph-mon[36341]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:17:17.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:17:17 smithi102 ceph-mon[36220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:17:18.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:17:18 smithi082 ceph-mon[32880]: pgmap v52: 129 pgs: 129 active+clean; 89 MiB data, 571 MiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 763 KiB/s wr, 90 op/s 2024-03-04T09:17:18.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:17:18 smithi190 ceph-mon[36341]: pgmap v52: 129 pgs: 129 active+clean; 89 MiB data, 571 MiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 763 KiB/s wr, 90 op/s 2024-03-04T09:17:18.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:17:18 smithi102 ceph-mon[36220]: pgmap v52: 129 pgs: 129 active+clean; 89 MiB data, 571 MiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 763 KiB/s wr, 90 op/s 2024-03-04T09:17:20.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:17:20 smithi082 ceph-mon[32880]: pgmap v53: 129 pgs: 129 active+clean; 89 MiB data, 571 MiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 763 KiB/s wr, 90 op/s 2024-03-04T09:17:20.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:17:20 smithi190 ceph-mon[36341]: pgmap v53: 129 pgs: 129 active+clean; 89 MiB data, 571 MiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 763 KiB/s wr, 90 op/s 2024-03-04T09:17:20.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:17:20 smithi102 ceph-mon[36220]: pgmap v53: 129 pgs: 129 active+clean; 89 MiB data, 571 MiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 763 KiB/s wr, 90 op/s 2024-03-04T09:17:20.965 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-versatile.txt 2024-03-04T09:17:20.969 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-vt8500.txt 2024-03-04T09:17:20.971 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-xiic.txt 2024-03-04T09:17:20.973 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina209.txt 2024-03-04T09:17:20.976 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina2xx.txt 2024-03-04T09:17:20.979 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/max6697.txt 2024-03-04T09:17:20.981 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/nvidia,tegra20-i2c.txt 2024-03-04T09:17:20.983 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/qcom,i2c-qup.txt 2024-03-04T09:17:20.986 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ti,bq32k.txt 2024-03-04T09:17:20.989 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/trivial-devices.txt 2024-03-04T09:17:20.991 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/ 2024-03-04T09:17:20.993 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/ 2024-03-04T09:17:20.995 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/bma180.txt 2024-03-04T09:17:20.997 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/ 2024-03-04T09:17:20.999 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/at91_adc.txt 2024-03-04T09:17:21.002 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/cc10001_adc.txt 2024-03-04T09:17:21.004 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/max1027-adc.txt 2024-03-04T09:17:21.006 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/nuvoton-nau7802.txt 2024-03-04T09:17:21.009 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-iadc.txt 2024-03-04T09:17:21.011 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-vadc.txt 2024-03-04T09:17:21.014 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/rockchip-saradc.txt 2024-03-04T09:17:21.016 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/twl4030-madc.txt 2024-03-04T09:17:21.018 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/vf610-adc.txt 2024-03-04T09:17:21.021 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/xilinx-xadc.txt 2024-03-04T09:17:21.023 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ 2024-03-04T09:17:21.025 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ad7303.txt 2024-03-04T09:17:21.027 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/max5821.txt 2024-03-04T09:17:21.030 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/ 2024-03-04T09:17:21.032 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/adf4350.txt 2024-03-04T09:17:21.034 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/ 2024-03-04T09:17:21.037 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/dht11.txt 2024-03-04T09:17:21.039 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/iio-bindings.txt 2024-03-04T09:17:21.042 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/ 2024-03-04T09:17:21.044 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/apds9300.txt 2024-03-04T09:17:21.046 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/cm36651.txt 2024-03-04T09:17:21.048 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/gp2ap020a00f.txt 2024-03-04T09:17:21.050 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/tsl2563.txt 2024-03-04T09:17:21.052 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ 2024-03-04T09:17:21.055 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ak8975.txt 2024-03-04T09:17:21.058 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/hmc5843.txt 2024-03-04T09:17:21.060 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/ 2024-03-04T09:17:21.062 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/as3935.txt 2024-03-04T09:17:21.064 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/sensorhub.txt 2024-03-04T09:17:21.067 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/st-sensors.txt 2024-03-04T09:17:21.070 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ 2024-03-04T09:17:21.072 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ads7846.txt 2024-03-04T09:17:21.075 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/atmel,maxtouch.txt 2024-03-04T09:17:21.077 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cap11xx.txt 2024-03-04T09:17:21.079 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/clps711x-keypad.txt 2024-03-04T09:17:21.081 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cros-ec-keyb.txt 2024-03-04T09:17:21.084 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/e3x0-button.txt 2024-03-04T09:17:21.086 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elan_i2c.txt 2024-03-04T09:17:21.089 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elants_i2c.txt 2024-03-04T09:17:21.091 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/fsl-mma8450.txt 2024-03-04T09:17:21.094 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-beeper.txt 2024-03-04T09:17:21.096 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys-polled.txt 2024-03-04T09:17:21.098 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys.txt 2024-03-04T09:17:21.100 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-matrix-keypad.txt 2024-03-04T09:17:21.102 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/imx-keypad.txt 2024-03-04T09:17:21.104 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/input-reset.txt 2024-03-04T09:17:21.106 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/lpc32xx-key.txt 2024-03-04T09:17:21.109 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/matrix-keymap.txt 2024-03-04T09:17:21.112 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/nvidia,tegra20-kbc.txt 2024-03-04T09:17:21.113 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/omap-keypad.txt 2024-03-04T09:17:21.115 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ps2keyb-mouse-apbps2.txt 2024-03-04T09:17:21.117 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pwm-beeper.txt 2024-03-04T09:17:21.119 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pxa27x-keypad.txt 2024-03-04T09:17:21.122 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-keypad.txt 2024-03-04T09:17:21.124 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-pwrkey.txt 2024-03-04T09:17:21.126 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-vib.txt 2024-03-04T09:17:21.128 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/regulator-haptic.txt 2024-03-04T09:17:21.130 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/rotary-encoder.txt 2024-03-04T09:17:21.133 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/samsung-keypad.txt 2024-03-04T09:17:21.135 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/spear-keyboard.txt 2024-03-04T09:17:21.137 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/st-keyscan.txt 2024-03-04T09:17:21.139 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/stmpe-keypad.txt 2024-03-04T09:17:21.141 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/sun4i-lradc-keys.txt 2024-03-04T09:17:21.143 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tca8418_keypad.txt 2024-03-04T09:17:21.145 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv260x.txt 2024-03-04T09:17:21.148 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv2667.txt 2024-03-04T09:17:21.150 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,nspire-keypad.txt 2024-03-04T09:17:21.152 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,palmas-pwrbutton.txt 2024-03-04T09:17:21.154 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ 2024-03-04T09:17:21.157 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/auo_pixcir_ts.txt 2024-03-04T09:17:21.159 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/bu21013.txt 2024-03-04T09:17:21.161 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/edt-ft5x06.txt 2024-03-04T09:17:21.164 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/egalax-ts.txt 2024-03-04T09:17:21.166 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/lpc32xx-tsc.txt 2024-03-04T09:17:21.168 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/mms114.txt 2024-03-04T09:17:21.170 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/pixcir_i2c_ts.txt 2024-03-04T09:17:21.173 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sitronix-st1232.txt 2024-03-04T09:17:21.175 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/stmpe.txt 2024-03-04T09:17:21.177 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sun4i.txt 2024-03-04T09:17:21.179 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ti-tsc-adc.txt 2024-03-04T09:17:21.182 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/touchscreen.txt 2024-03-04T09:17:21.184 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2005.txt 2024-03-04T09:17:21.186 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2007.txt 2024-03-04T09:17:21.188 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/zforce_ts.txt 2024-03-04T09:17:21.191 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tps65218-pwrbutton.txt 2024-03-04T09:17:21.193 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-keypad.txt 2024-03-04T09:17:21.195 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-pwrbutton.txt 2024-03-04T09:17:21.198 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ 2024-03-04T09:17:21.200 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/abilis,tb10x-ictl.txt 2024-03-04T09:17:21.202 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun4i-ic.txt 2024-03-04T09:17:21.205 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun67i-sc-nmi.txt 2024-03-04T09:17:21.207 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/atmel,aic.txt 2024-03-04T09:17:21.209 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm2835-armctrl-ic.txt 2024-03-04T09:17:21.211 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm7120-l2-intc.txt 2024-03-04T09:17:21.213 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,l2-intc.txt 2024-03-04T09:17:21.215 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/cirrus,clps711x-intc.txt 2024-03-04T09:17:21.218 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/digicolor-ic.txt 2024-03-04T09:17:21.220 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/interrupts.txt 2024-03-04T09:17:21.222 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/lsi,zevio-intc.txt 2024-03-04T09:17:21.225 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,armada-370-xp-mpic.txt 2024-03-04T09:17:21.227 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,orion-intc.txt 2024-03-04T09:17:21.229 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/mips-gic.txt 2024-03-04T09:17:21.232 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/opencores,or1k-pic.txt 2024-03-04T09:17:21.234 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,intc-irqpin.txt 2024-03-04T09:17:21.236 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,irqc.txt 2024-03-04T09:17:21.238 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/samsung,s3c24xx-irq.txt 2024-03-04T09:17:21.240 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/snps,dw-apb-ictl.txt 2024-03-04T09:17:21.243 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,keystone-irq.txt 2024-03-04T09:17:21.245 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,omap-intc-irq.txt 2024-03-04T09:17:21.247 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ 2024-03-04T09:17:21.250 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/arm,smmu.txt 2024-03-04T09:17:21.252 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/iommu.txt 2024-03-04T09:17:21.254 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra20-gart.txt 2024-03-04T09:17:21.257 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra30-smmu.txt 2024-03-04T09:17:21.259 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/renesas,ipmmu-vmsa.txt 2024-03-04T09:17:21.261 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/rockchip,iommu.txt 2024-03-04T09:17:21.263 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/samsung,sysmmu.txt 2024-03-04T09:17:21.265 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ti,omap-iommu.txt 2024-03-04T09:17:21.268 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/ 2024-03-04T09:17:21.270 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/common.txt 2024-03-04T09:17:21.273 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-gpio.txt 2024-03-04T09:17:21.276 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp55xx.txt 2024-03-04T09:17:21.278 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp8860.txt 2024-03-04T09:17:21.280 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-ns2.txt 2024-03-04T09:17:21.283 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-pwm.txt 2024-03-04T09:17:21.285 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/pca963x.txt 2024-03-04T09:17:21.287 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/register-bit-led.txt 2024-03-04T09:17:21.289 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/tca6507.txt 2024-03-04T09:17:21.292 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/ 2024-03-04T09:17:21.295 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2-timings.txt 2024-03-04T09:17:21.297 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2.txt 2024-03-04T09:17:21.300 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/ 2024-03-04T09:17:21.302 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/altera-mailbox.txt 2024-03-04T09:17:21.304 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/mailbox.txt 2024-03-04T09:17:21.307 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/omap-mailbox.txt 2024-03-04T09:17:21.309 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/marvell.txt 2024-03-04T09:17:21.315 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ 2024-03-04T09:17:21.316 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/atmel-isi.txt 2024-03-04T09:17:21.318 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/coda.txt 2024-03-04T09:17:21.320 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-fimc-lite.txt 2024-03-04T09:17:21.323 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-jpeg-codec.txt 2024-03-04T09:17:21.324 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos4-fimc-is.txt 2024-03-04T09:17:21.326 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos5-gsc.txt 2024-03-04T09:17:21.328 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/gpio-ir-receiver.txt 2024-03-04T09:17:21.331 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/hix5hd2-ir.txt 2024-03-04T09:17:21.333 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ 2024-03-04T09:17:21.335 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7343.txt 2024-03-04T09:17:21.337 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7604.txt 2024-03-04T09:17:21.339 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9m111.txt 2024-03-04T09:17:21.341 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9p031.txt 2024-03-04T09:17:21.344 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/nokia,smia.txt 2024-03-04T09:17:21.345 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ths8200.txt 2024-03-04T09:17:21.348 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp514x.txt 2024-03-04T09:17:21.350 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp7002.txt 2024-03-04T09:17:21.353 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/img-ir-rev1.txt 2024-03-04T09:17:21.357 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/meson-ir.txt 2024-03-04T09:17:21.358 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/pxa-camera.txt 2024-03-04T09:17:21.361 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/rcar_vin.txt 2024-03-04T09:17:21.363 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/renesas,vsp1.txt 2024-03-04T09:17:21.365 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/s5p-mfc.txt 2024-03-04T09:17:21.368 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-fimc.txt 2024-03-04T09:17:21.370 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-mipi-csis.txt 2024-03-04T09:17:21.372 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5c73m3.txt 2024-03-04T09:17:21.374 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k5baf.txt 2024-03-04T09:17:21.376 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k6a3.txt 2024-03-04T09:17:21.378 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sh_mobile_ceu.txt 2024-03-04T09:17:21.381 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/si4713.txt 2024-03-04T09:17:21.383 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/st-rc.txt 2024-03-04T09:17:21.386 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sunxi-ir.txt 2024-03-04T09:17:21.388 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ti-am437x-vpfe.txt 2024-03-04T09:17:21.390 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/video-interfaces.txt 2024-03-04T09:17:21.393 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ 2024-03-04T09:17:21.395 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ 2024-03-04T09:17:21.397 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ifc.txt 2024-03-04T09:17:21.400 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-devbus.txt 2024-03-04T09:17:21.404 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-sdram-controller.txt 2024-03-04T09:17:21.406 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/nvidia,tegra-mc.txt 2024-03-04T09:17:21.408 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/renesas-memory-controllers.txt 2024-03-04T09:17:21.410 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/synopsys.txt 2024-03-04T09:17:21.413 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti-aemif.txt 2024-03-04T09:17:21.415 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/ 2024-03-04T09:17:21.417 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/emif.txt 2024-03-04T09:17:21.420 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/ 2024-03-04T09:17:21.423 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta-intc.txt 2024-03-04T09:17:21.425 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta.txt 2024-03-04T09:17:21.427 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/pdc-intc.txt 2024-03-04T09:17:21.430 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ 2024-03-04T09:17:21.433 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/88pm860x.txt 2024-03-04T09:17:21.435 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ab8500.txt 2024-03-04T09:17:21.438 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/arizona.txt 2024-03-04T09:17:21.440 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3711.txt 2024-03-04T09:17:21.442 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3722.txt 2024-03-04T09:17:21.445 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-gpbr.txt 2024-03-04T09:17:21.447 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-hlcdc.txt 2024-03-04T09:17:21.449 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-matrix.txt 2024-03-04T09:17:21.452 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-smc.txt 2024-03-04T09:17:21.454 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bcm590xx.txt 2024-03-04T09:17:21.456 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bfticu.txt 2024-03-04T09:17:21.459 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/cros-ec.txt 2024-03-04T09:17:21.461 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9052-i2c.txt 2024-03-04T09:17:21.464 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9055.txt 2024-03-04T09:17:21.466 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9063.txt 2024-03-04T09:17:21.468 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/hi6421.txt 2024-03-04T09:17:21.470 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/lp3943.txt 2024-03-04T09:17:21.473 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max14577.txt 2024-03-04T09:17:21.475 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77686.txt 2024-03-04T09:17:21.477 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77693.txt 2024-03-04T09:17:21.479 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8925.txt 2024-03-04T09:17:21.482 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8998.txt 2024-03-04T09:17:21.484 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/mc13xxx.txt 2024-03-04T09:17:21.486 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-host.txt 2024-03-04T09:17:21.489 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-tll.txt 2024-03-04T09:17:21.491 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/palmas.txt 2024-03-04T09:17:21.493 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom,spmi-pmic.txt 2024-03-04T09:17:21.496 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-pm8xxx.txt 2024-03-04T09:17:21.498 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-rpm.txt 2024-03-04T09:17:21.500 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qriox.txt 2024-03-04T09:17:21.503 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rk808.txt 2024-03-04T09:17:21.505 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rn5t618.txt 2024-03-04T09:17:21.507 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mpa01.txt 2024-03-04T09:17:21.509 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mps11.txt 2024-03-04T09:17:21.511 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/stmpe.txt 2024-03-04T09:17:21.513 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/sun6i-prcm.txt 2024-03-04T09:17:21.516 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/syscon.txt 2024-03-04T09:17:21.518 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tc3589x.txt 2024-03-04T09:17:21.520 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ti-keystone-devctrl.txt 2024-03-04T09:17:21.523 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps6507x.txt 2024-03-04T09:17:21.525 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps65910.txt 2024-03-04T09:17:21.527 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl-familly.txt 2024-03-04T09:17:21.529 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-audio.txt 2024-03-04T09:17:21.532 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-power.txt 2024-03-04T09:17:21.534 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl6040.txt 2024-03-04T09:17:21.536 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/ 2024-03-04T09:17:21.539 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/ 2024-03-04T09:17:21.540 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/mipi-dsi-bus.txt 2024-03-04T09:17:21.542 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/nvidia,tegra114-mipi.txt 2024-03-04T09:17:21.546 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ 2024-03-04T09:17:21.549 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/ 2024-03-04T09:17:21.551 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bcm3384-intc.txt 2024-03-04T09:17:21.554 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bmips.txt 2024-03-04T09:17:21.556 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/cm-dsl.txt 2024-03-04T09:17:21.559 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/usb.txt 2024-03-04T09:17:21.561 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ 2024-03-04T09:17:21.564 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/bootbus.txt 2024-03-04T09:17:21.566 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/cib.txt 2024-03-04T09:17:21.569 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu.txt 2024-03-04T09:17:21.571 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu2.txt 2024-03-04T09:17:21.573 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/dma-engine.txt 2024-03-04T09:17:21.575 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/uctl.txt 2024-03-04T09:17:21.577 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cpu_irq.txt 2024-03-04T09:17:21.580 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ralink.txt 2024-03-04T09:17:21.583 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ 2024-03-04T09:17:21.586 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/allwinner,sunxi-sid.txt 2024-03-04T09:17:21.588 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/arm-charlcd.txt 2024-03-04T09:17:21.590 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/at25.txt 2024-03-04T09:17:21.593 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/atmel-ssc.txt 2024-03-04T09:17:21.595 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/bmp085.txt 2024-03-04T09:17:21.597 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/fsl,qoriq-mc.txt 2024-03-04T09:17:21.599 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ifm-csi.txt 2024-03-04T09:17:21.601 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/lis302.txt 2024-03-04T09:17:21.603 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/nvidia,tegra20-apbmisc.txt 2024-03-04T09:17:21.605 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/smc.txt 2024-03-04T09:17:21.607 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/sram.txt 2024-03-04T09:17:21.610 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ti,dac7512.txt 2024-03-04T09:17:21.612 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ 2024-03-04T09:17:21.614 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/arasan,sdhci.txt 2024-03-04T09:17:21.616 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/atmel-hsmci.txt 2024-03-04T09:17:21.618 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/brcm,bcm2835-sdhci.txt 2024-03-04T09:17:21.621 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/davinci_mmc.txt 2024-03-04T09:17:21.623 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/exynos-dw-mshc.txt 2024-03-04T09:17:21.625 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-esdhc.txt 2024-03-04T09:17:21.627 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-esdhc.txt 2024-03-04T09:17:21.629 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-mmc.txt 2024-03-04T09:17:21.631 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/img-dw-mshc.txt 2024-03-04T09:17:21.633 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/k3-dw-mshc.txt 2024-03-04T09:17:21.635 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/kona-sdhci.txt 2024-03-04T09:17:21.637 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-emmc.txt 2024-03-04T09:17:21.639 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-simple.txt 2024-03-04T09:17:21.641 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-spi-slot.txt 2024-03-04T09:17:21.643 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc.txt 2024-03-04T09:17:21.646 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmci.txt 2024-03-04T09:17:21.648 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/moxa,moxart-mmc.txt 2024-03-04T09:17:21.650 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mxs-mmc.txt 2024-03-04T09:17:21.653 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/nvidia,tegra20-sdhci.txt 2024-03-04T09:17:21.655 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/orion-sdio.txt 2024-03-04T09:17:21.657 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/pxa-mmc.txt 2024-03-04T09:17:21.659 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/renesas,mmcif.txt 2024-03-04T09:17:21.661 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/rockchip-dw-mshc.txt 2024-03-04T09:17:21.663 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/samsung-sdhci.txt 2024-03-04T09:17:21.665 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-dove.txt 2024-03-04T09:17:21.667 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-fujitsu.txt 2024-03-04T09:17:21.669 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-msm.txt 2024-03-04T09:17:21.671 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-pxa.txt 2024-03-04T09:17:21.674 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-sirf.txt 2024-03-04T09:17:21.676 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-spear.txt 2024-03-04T09:17:21.678 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-st.txt 2024-03-04T09:17:21.680 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/socfpga-dw-mshc.txt 2024-03-04T09:17:21.683 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sunxi-mmc.txt 2024-03-04T09:17:21.685 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/synopsys-dw-mshc.txt 2024-03-04T09:17:21.687 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap-hsmmc.txt 2024-03-04T09:17:21.689 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap.txt 2024-03-04T09:17:21.692 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/tmio_mmc.txt 2024-03-04T09:17:21.694 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/usdhi6rol0.txt 2024-03-04T09:17:21.696 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/vt8500-sdmmc.txt 2024-03-04T09:17:21.699 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/ 2024-03-04T09:17:21.701 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/arm-versatile.txt 2024-03-04T09:17:21.703 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-dataflash.txt 2024-03-04T09:17:21.705 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-nand.txt 2024-03-04T09:17:21.707 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/davinci-nand.txt 2024-03-04T09:17:21.709 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/denali-nand.txt 2024-03-04T09:17:21.712 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/diskonchip.txt 2024-03-04T09:17:21.714 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/elm.txt 2024-03-04T09:17:21.716 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/flctl-nand.txt 2024-03-04T09:17:21.718 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-quadspi.txt 2024-03-04T09:17:21.720 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-upm-nand.txt 2024-03-04T09:17:21.722 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsmc-nand.txt 2024-03-04T09:17:21.725 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpio-control-nand.txt 2024-03-04T09:17:21.727 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nand.txt 2024-03-04T09:17:21.730 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nor.txt 2024-03-04T09:17:21.732 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-onenand.txt 2024-03-04T09:17:21.734 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmi-nand.txt 2024-03-04T09:17:21.736 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/hisi504-nand.txt 2024-03-04T09:17:21.739 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-mlc.txt 2024-03-04T09:17:21.741 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-slc.txt 2024-03-04T09:17:21.743 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/m25p80.txt 2024-03-04T09:17:21.745 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mtd-physmap.txt 2024-03-04T09:17:21.747 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mxc-nand.txt 2024-03-04T09:17:21.750 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/nand.txt 2024-03-04T09:17:21.752 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/orion-nand.txt 2024-03-04T09:17:21.754 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/partition.txt 2024-03-04T09:17:21.757 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/pxa3xx-nand.txt 2024-03-04T09:17:21.759 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/spear_smi.txt 2024-03-04T09:17:21.761 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/st-fsm.txt 2024-03-04T09:17:21.763 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/sunxi-nand.txt 2024-03-04T09:17:21.765 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ 2024-03-04T09:17:21.768 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-emac.txt 2024-03-04T09:17:21.770 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-mdio.txt 2024-03-04T09:17:21.773 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun7i-a20-gmac.txt 2024-03-04T09:17:21.775 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/altera_tse.txt 2024-03-04T09:17:21.777 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe-phy.txt 2024-03-04T09:17:21.779 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe.txt 2024-03-04T09:17:21.782 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/apm-xgene-enet.txt 2024-03-04T09:17:21.784 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/arc_emac.txt 2024-03-04T09:17:21.786 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcm87xx.txt 2024-03-04T09:17:21.788 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcmgenet.txt 2024-03-04T09:17:21.791 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-mdio-unimac.txt 2024-03-04T09:17:21.793 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-sf2.txt 2024-03-04T09:17:21.795 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-systemport.txt 2024-03-04T09:17:21.797 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/calxeda-xgmac.txt 2024-03-04T09:17:21.800 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/ 2024-03-04T09:17:21.802 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/atmel-can.txt 2024-03-04T09:17:21.804 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/c_can.txt 2024-03-04T09:17:21.806 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/cc770.txt 2024-03-04T09:17:21.808 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/fsl-flexcan.txt 2024-03-04T09:17:21.811 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/grcan.txt 2024-03-04T09:17:21.813 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/m_can.txt 2024-03-04T09:17:21.815 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/microchip,mcp251x.txt 2024-03-04T09:17:21.818 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/mpc5xxx-mscan.txt 2024-03-04T09:17:21.820 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/rcar_can.txt 2024-03-04T09:17:21.822 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/sja1000.txt 2024-03-04T09:17:21.824 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/xilinx_can.txt 2024-03-04T09:17:21.827 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mdio.txt 2024-03-04T09:17:21.830 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mix.txt 2024-03-04T09:17:21.832 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-pip.txt 2024-03-04T09:17:21.834 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cdns-emac.txt 2024-03-04T09:17:21.837 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw-phy-sel.txt 2024-03-04T09:17:21.839 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw.txt 2024-03-04T09:17:21.841 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davicom-dm9000.txt 2024-03-04T09:17:21.843 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci-mdio.txt 2024-03-04T09:17:21.846 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci_emac.txt 2024-03-04T09:17:21.848 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/ 2024-03-04T09:17:21.850 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/dsa.txt 2024-03-04T09:17:21.853 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/emac_rockchip.txt 2024-03-04T09:17:21.856 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ethernet.txt 2024-03-04T09:17:21.865 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fixed-link.txt 2024-03-04T09:17:21.936 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-fec.txt 2024-03-04T09:17:21.939 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-tsec-phy.txt 2024-03-04T09:17:21.941 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/gpmc-eth.txt 2024-03-04T09:17:21.943 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hip04-net.txt 2024-03-04T09:17:21.945 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hix5hd2-gmac.txt 2024-03-04T09:17:21.947 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/ 2024-03-04T09:17:21.949 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/at86rf230.txt 2024-03-04T09:17:21.951 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/cc2520.txt 2024-03-04T09:17:21.954 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/keystone-netcp.txt 2024-03-04T09:17:21.957 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/lpc-eth.txt 2024-03-04T09:17:21.959 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/macb.txt 2024-03-04T09:17:21.961 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-armada-370-neta.txt 2024-03-04T09:17:21.964 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-mdio.txt 2024-03-04T09:17:21.966 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-net.txt 2024-03-04T09:17:21.968 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pp2.txt 2024-03-04T09:17:21.970 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pxa168.txt 2024-03-04T09:17:21.972 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-gpio.txt 2024-03-04T09:17:21.975 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-gpio.txt 2024-03-04T09:17:21.977 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-mmioreg.txt 2024-03-04T09:17:21.979 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux.txt 2024-03-04T09:17:21.981 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/meson-dwmac.txt 2024-03-04T09:17:21.984 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ks8851.txt 2024-03-04T09:17:21.986 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ksz90x1.txt 2024-03-04T09:17:21.989 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel.txt 2024-03-04T09:17:21.991 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/moxa,moxart-mac.txt 2024-03-04T09:17:21.993 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/ 2024-03-04T09:17:21.995 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/pn544.txt 2024-03-04T09:17:21.997 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfca.txt 2024-03-04T09:17:21.999 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfcb.txt 2024-03-04T09:17:22.001 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/trf7970a.txt 2024-03-04T09:17:22.003 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/opencores-ethoc.txt 2024-03-04T09:17:22.006 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/phy.txt 2024-03-04T09:17:22.008 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/qca-qca7000-spi.txt 2024-03-04T09:17:22.010 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/rockchip-dwmac.txt 2024-03-04T09:17:22.013 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/samsung-sxgbe.txt 2024-03-04T09:17:22.015 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sh_eth.txt 2024-03-04T09:17:22.017 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc-lan91c111.txt 2024-03-04T09:17:22.019 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc911x.txt 2024-03-04T09:17:22.022 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/socfpga-dwmac.txt 2024-03-04T09:17:22.023 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sti-dwmac.txt 2024-03-04T09:17:22.026 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/stmmac.txt 2024-03-04T09:17:22.028 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-rhine.txt 2024-03-04T09:17:22.030 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-velocity.txt 2024-03-04T09:17:22.033 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ 2024-03-04T09:17:22.035 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/brcm,bcm43xx-fmac.txt 2024-03-04T09:17:22.037 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/qcom,ath10k.txt 2024-03-04T09:17:22.039 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ti,wl1251.txt 2024-03-04T09:17:22.042 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/ 2024-03-04T09:17:22.045 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/nios2.txt 2024-03-04T09:17:22.047 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/timer.txt 2024-03-04T09:17:22.049 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/ 2024-03-04T09:17:22.052 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/nvidia,nvec.txt 2024-03-04T09:17:22.055 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/open-pic.txt 2024-03-04T09:17:22.058 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/ 2024-03-04T09:17:22.060 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101aw03.txt 2024-03-04T09:17:22.062 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101xtn01.txt 2024-03-04T09:17:22.064 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b116xw03.txt 2024-03-04T09:17:22.067 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133htn01.txt 2024-03-04T09:17:22.069 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133xtn01.txt 2024-03-04T09:17:22.071 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/avic,tm070ddh03.txt 2024-03-04T09:17:22.073 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wa01a.txt 2024-03-04T09:17:22.076 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wb03.txt 2024-03-04T09:17:22.078 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et057090dhu.txt 2024-03-04T09:17:22.080 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et070080dh6.txt 2024-03-04T09:17:22.082 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,etm0700g0dh6.txt 2024-03-04T09:17:22.085 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/foxlink,fl500wvr00-a0t.txt 2024-03-04T09:17:22.087 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/giantplus,gpg482739qs5.txt 2024-03-04T09:17:22.089 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hannstar,hsd070pww1.txt 2024-03-04T09:17:22.092 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hit,tx23d38vm0caa.txt 2024-03-04T09:17:22.093 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,g121i1-l01.txt 2024-03-04T09:17:22.095 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n116bge.txt 2024-03-04T09:17:22.098 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n156bge-l21.txt 2024-03-04T09:17:22.101 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,ld070wx3-sl01.txt 2024-03-04T09:17:22.103 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lh500wx1-sd03.txt 2024-03-04T09:17:22.105 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lp129qe.txt 2024-03-04T09:17:22.107 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/panasonic,vvx10f004b00.txt 2024-03-04T09:17:22.109 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ld9040.txt 2024-03-04T09:17:22.112 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ltn101nt05.txt 2024-03-04T09:17:22.114 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,s6e8aa0.txt 2024-03-04T09:17:22.116 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/sharp,lq101r1sx01.txt 2024-03-04T09:17:22.118 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/simple-panel.txt 2024-03-04T09:17:22.121 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ 2024-03-04T09:17:22.124 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/83xx-512x-pci.txt 2024-03-04T09:17:22.126 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/designware-pcie.txt 2024-03-04T09:17:22.128 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,imx6q-pcie.txt 2024-03-04T09:17:22.130 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,pci.txt 2024-03-04T09:17:22.136 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/host-generic-pci.txt 2024-03-04T09:17:22.136 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/layerscape-pci.txt 2024-03-04T09:17:22.137 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/mvebu-pci.txt 2024-03-04T09:17:22.139 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/nvidia,tegra20-pcie.txt 2024-03-04T09:17:22.142 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-keystone.txt 2024-03-04T09:17:22.143 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-rcar-gen2.txt 2024-03-04T09:17:22.146 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci.txt 2024-03-04T09:17:22.148 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ralink,rt3883-pci.txt 2024-03-04T09:17:22.150 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/rcar-pci.txt 2024-03-04T09:17:22.152 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/samsung,exynos5440-pcie.txt 2024-03-04T09:17:22.154 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/spear13xx-pcie.txt 2024-03-04T09:17:22.157 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ti-pci.txt 2024-03-04T09:17:22.159 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/v3-v360epc-pci.txt 2024-03-04T09:17:22.161 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/versatile.txt 2024-03-04T09:17:22.163 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xgene-pci.txt 2024-03-04T09:17:22.165 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xilinx-pcie.txt 2024-03-04T09:17:22.167 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ 2024-03-04T09:17:22.170 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/apm-xgene-phy.txt 2024-03-04T09:17:22.173 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/bcm-phy.txt 2024-03-04T09:17:22.175 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-sata-phy.txt 2024-03-04T09:17:22.177 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-usb-phy.txt 2024-03-04T09:17:22.179 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/hix5hd2-phy.txt 2024-03-04T09:17:22.181 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-bindings.txt 2024-03-04T09:17:22.183 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy28lp.txt 2024-03-04T09:17:22.186 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy365x.txt 2024-03-04T09:17:22.188 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-mvebu.txt 2024-03-04T09:17:22.432 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih407-usb.txt 2024-03-04T09:17:22.434 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih41x-usb.txt 2024-03-04T09:17:22.437 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-apq8064-sata-phy.txt 2024-03-04T09:17:22.439 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-dwc3-usb-phy.txt 2024-03-04T09:17:22.441 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-ipq806x-sata-phy.txt 2024-03-04T09:17:22.444 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rcar-gen2-phy.txt 2024-03-04T09:17:22.446 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rockchip-usb-phy.txt 2024-03-04T09:17:22.449 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/samsung-phy.txt 2024-03-04T09:17:22.451 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/st-spear-miphy.txt 2024-03-04T09:17:22.453 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/sun4i-usb-phy.txt 2024-03-04T09:17:22.456 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ti-phy.txt 2024-03-04T09:17:22.458 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ 2024-03-04T09:17:22.461 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/abilis,tb10x-iomux.txt 2024-03-04T09:17:22.464 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/allwinner,sunxi-pinctrl.txt 2024-03-04T09:17:22.466 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/atmel,at91-pinctrl.txt 2024-03-04T09:17:22.468 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm11351-pinctrl.txt 2024-03-04T09:17:22.471 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm2835-gpio.txt 2024-03-04T09:17:22.473 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx-pinctrl.txt 2024-03-04T09:17:22.475 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx25-pinctrl.txt 2024-03-04T09:17:22.477 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx27-pinctrl.txt 2024-03-04T09:17:22.480 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx35-pinctrl.txt 2024-03-04T09:17:22.482 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx51-pinctrl.txt 2024-03-04T09:17:22.484 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx53-pinctrl.txt 2024-03-04T09:17:22.486 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6dl-pinctrl.txt 2024-03-04T09:17:22.489 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6q-pinctrl.txt 2024-03-04T09:17:22.491 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sl-pinctrl.txt 2024-03-04T09:17:22.493 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sx-pinctrl.txt 2024-03-04T09:17:22.495 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,mxs-pinctrl.txt 2024-03-04T09:17:22.498 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,vf610-pinctrl.txt 2024-03-04T09:17:22.501 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pdc-pinctrl.txt 2024-03-04T09:17:22.503 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pinctrl.txt 2024-03-04T09:17:22.505 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,falcon-pinumx.txt 2024-03-04T09:17:22.508 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,xway-pinumx.txt 2024-03-04T09:17:22.510 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-370-pinctrl.txt 2024-03-04T09:17:22.512 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-375-pinctrl.txt 2024-03-04T09:17:22.515 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-38x-pinctrl.txt 2024-03-04T09:17:22.517 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-xp-pinctrl.txt 2024-03-04T09:17:22.519 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,dove-pinctrl.txt 2024-03-04T09:17:22.522 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,kirkwood-pinctrl.txt 2024-03-04T09:17:22.524 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,mvebu-pinctrl.txt 2024-03-04T09:17:22.526 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,orion-pinctrl.txt 2024-03-04T09:17:22.529 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/meson,pinctrl.txt 2024-03-04T09:17:22.531 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra114-pinmux.txt 2024-03-04T09:17:22.533 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-pinmux.txt 2024-03-04T09:17:22.535 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-xusb-padctl.txt 2024-03-04T09:17:22.538 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra20-pinmux.txt 2024-03-04T09:17:22.544 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra30-pinmux.txt 2024-03-04T09:17:22.544 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-bindings.txt 2024-03-04T09:17:22.545 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-palmas.txt 2024-03-04T09:17:22.547 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-single.txt 2024-03-04T09:17:22.550 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-sirf.txt 2024-03-04T09:17:22.552 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-st.txt 2024-03-04T09:17:22.554 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-vt8500.txt 2024-03-04T09:17:22.557 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl_spear.txt 2024-03-04T09:17:22.559 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8064-pinctrl.txt 2024-03-04T09:17:22.561 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8084-pinctrl.txt 2024-03-04T09:17:22.564 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,ipq8064-pinctrl.txt 2024-03-04T09:17:22.565 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8916-pinctrl.txt 2024-03-04T09:17:22.568 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8960-pinctrl.txt 2024-03-04T09:17:22.570 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8974-pinctrl.txt 2024-03-04T09:17:22.573 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-gpio.txt 2024-03-04T09:17:22.575 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-mpp.txt 2024-03-04T09:17:22.577 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/renesas,pfc-pinctrl.txt 2024-03-04T09:17:22.579 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/rockchip,pinctrl.txt 2024-03-04T09:17:22.581 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/samsung-pinctrl.txt 2024-03-04T09:17:22.584 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,abx500.txt 2024-03-04T09:17:22.586 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,nomadik.txt 2024-03-04T09:17:22.588 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ti,omap-pinctrl.txt 2024-03-04T09:17:22.590 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/xlnx,zynq-pinctrl.txt 2024-03-04T09:17:22.593 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ 2024-03-04T09:17:22.595 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/bq2415x.txt 2024-03-04T09:17:22.598 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/isp1704.txt 2024-03-04T09:17:22.599 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ltc2941.txt 2024-03-04T09:17:22.601 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/opp.txt 2024-03-04T09:17:22.604 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power-controller.txt 2024-03-04T09:17:22.606 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power_domain.txt 2024-03-04T09:17:22.608 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/renesas,sysc-rmobile.txt 2024-03-04T09:17:22.610 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ 2024-03-04T09:17:22.612 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/keystone-reset.txt 2024-03-04T09:17:22.614 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ltc2952-poweroff.txt 2024-03-04T09:17:22.616 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/st-reset.txt 2024-03-04T09:17:22.619 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/syscon-reboot.txt 2024-03-04T09:17:22.621 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rockchip-io-domain.txt 2024-03-04T09:17:22.624 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rx51-battery.txt 2024-03-04T09:17:22.626 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/twl-charger.txt 2024-03-04T09:17:22.628 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ 2024-03-04T09:17:22.631 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/ 2024-03-04T09:17:22.633 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/btemp.txt 2024-03-04T09:17:22.635 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/chargalg.txt 2024-03-04T09:17:22.637 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/charger.txt 2024-03-04T09:17:22.640 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/fg.txt 2024-03-04T09:17:22.642 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/axxia-reset.txt 2024-03-04T09:17:22.645 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/charger-manager.txt 2024-03-04T09:17:22.647 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/gpio-charger.txt 2024-03-04T09:17:22.650 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/imx-snvs-poweroff.txt 2024-03-04T09:17:22.652 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/lp8727_charger.txt 2024-03-04T09:17:22.654 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max17042_battery.txt 2024-03-04T09:17:22.656 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max8925_batter.txt 2024-03-04T09:17:22.658 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/msm-poweroff.txt 2024-03-04T09:17:22.660 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/olpc_battery.txt 2024-03-04T09:17:22.662 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/power_supply.txt 2024-03-04T09:17:22.664 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/qnap-poweroff.txt 2024-03-04T09:17:22.667 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/restart-poweroff.txt 2024-03-04T09:17:22.669 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/sbs_sbs-battery.txt 2024-03-04T09:17:22.671 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ti,bq24735.txt 2024-03-04T09:17:22.674 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/tps65090.txt 2024-03-04T09:17:22.676 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/ 2024-03-04T09:17:22.678 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ 2024-03-04T09:17:22.680 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/akebono.txt 2024-03-04T09:17:22.682 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/cpm.txt 2024-03-04T09:17:22.684 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/emac.txt 2024-03-04T09:17:22.686 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/hsta.txt 2024-03-04T09:17:22.688 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ndfc.txt 2024-03-04T09:17:22.691 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ppc440spe-adma.txt 2024-03-04T09:17:22.693 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/reboot.txt 2024-03-04T09:17:22.695 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ 2024-03-04T09:17:22.698 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/board.txt 2024-03-04T09:17:22.700 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cache_sram.txt 2024-03-04T09:17:22.702 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ccf.txt 2024-03-04T09:17:22.704 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/ 2024-03-04T09:17:22.706 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm.txt 2024-03-04T09:17:22.709 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/ 2024-03-04T09:17:22.711 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/brg.txt 2024-03-04T09:17:22.713 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/i2c.txt 2024-03-04T09:17:22.716 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/pic.txt 2024-03-04T09:17:22.718 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/usb.txt 2024-03-04T09:17:22.721 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/gpio.txt 2024-03-04T09:17:22.724 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/network.txt 2024-03-04T09:17:22.726 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe.txt 2024-03-04T09:17:22.728 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ 2024-03-04T09:17:22.730 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/firmware.txt 2024-03-04T09:17:22.732 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/par_io.txt 2024-03-04T09:17:22.735 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/pincfg.txt 2024-03-04T09:17:22.737 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ucc.txt 2024-03-04T09:17:22.739 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/usb.txt 2024-03-04T09:17:22.742 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/serial.txt 2024-03-04T09:17:22.748 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpus.txt 2024-03-04T09:17:22.748 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dcsr.txt 2024-03-04T09:17:22.750 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/diu.txt 2024-03-04T09:17:22.752 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dma.txt 2024-03-04T09:17:22.754 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ecm.txt 2024-03-04T09:17:22.756 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/fman.txt 2024-03-04T09:17:22.759 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/gtm.txt 2024-03-04T09:17:22.761 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/guts.txt 2024-03-04T09:17:22.763 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/interlaken-lac.txt 2024-03-04T09:17:22.766 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/l2cache.txt 2024-03-04T09:17:22.768 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/lbc.txt 2024-03-04T09:17:22.770 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcm.txt 2024-03-04T09:17:22.772 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcu-mpc8349emitx.txt 2024-03-04T09:17:22.774 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mem-ctrlr.txt 2024-03-04T09:17:22.777 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5121-psc.txt 2024-03-04T09:17:22.779 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5200.txt 2024-03-04T09:17:22.781 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-msgr.txt 2024-03-04T09:17:22.784 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-timer.txt 2024-03-04T09:17:22.786 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic.txt 2024-03-04T09:17:22.790 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/msi-pic.txt 2024-03-04T09:17:22.791 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pamu.txt 2024-03-04T09:17:22.794 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pmc.txt 2024-03-04T09:17:22.796 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/raideng.txt 2024-03-04T09:17:22.798 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio-rmu.txt 2024-03-04T09:17:22.801 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio.txt 2024-03-04T09:17:22.803 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/ 2024-03-04T09:17:22.806 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/gamecube.txt 2024-03-04T09:17:22.809 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/wii.txt 2024-03-04T09:17:22.811 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/ 2024-03-04T09:17:22.814 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/pps-gpio.txt 2024-03-04T09:17:22.816 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ 2024-03-04T09:17:22.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:17:22 smithi082 ceph-mon[32880]: pgmap v54: 129 pgs: 129 active+clean; 92 MiB data, 588 MiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 1024 KiB/s wr, 115 op/s 2024-03-04T09:17:22.819 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-hlcdc-pwm.txt 2024-03-04T09:17:22.822 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-pwm.txt 2024-03-04T09:17:22.824 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-tcb-pwm.txt 2024-03-04T09:17:22.826 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/bcm-kona-pwm.txt 2024-03-04T09:17:22.828 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/cirrus,clps711x-pwm.txt 2024-03-04T09:17:22.831 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/img-pwm.txt 2024-03-04T09:17:22.833 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/imx-pwm.txt 2024-03-04T09:17:22.835 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/lpc32xx-pwm.txt 2024-03-04T09:17:22.838 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/mxs-pwm.txt 2024-03-04T09:17:22.840 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nvidia,tegra20-pwm.txt 2024-03-04T09:17:22.842 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nxp,pca9685-pwm.txt 2024-03-04T09:17:22.844 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-bcm2835.txt 2024-03-04T09:17:22.847 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-fsl-ftm.txt 2024-03-04T09:17:22.849 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-lp3943.txt 2024-03-04T09:17:22.851 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-rockchip.txt 2024-03-04T09:17:22.854 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-samsung.txt 2024-03-04T09:17:22.855 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-st.txt 2024-03-04T09:17:22.857 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-sun4i.txt 2024-03-04T09:17:22.860 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiecap.txt 2024-03-04T09:17:22.862 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiehrpwm.txt 2024-03-04T09:17:22.864 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tipwmss.txt 2024-03-04T09:17:22.872 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm.txt 2024-03-04T09:17:22.875 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pxa-pwm.txt 2024-03-04T09:17:22.877 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/renesas,tpu-pwm.txt 2024-03-04T09:17:22.879 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/spear-pwm.txt 2024-03-04T09:17:22.881 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwm.txt 2024-03-04T09:17:22.883 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwmled.txt 2024-03-04T09:17:22.885 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/vt8500-pwm.txt 2024-03-04T09:17:22.887 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/ 2024-03-04T09:17:22.890 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/regmap.txt 2024-03-04T09:17:22.892 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ 2024-03-04T09:17:22.895 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm800.txt 2024-03-04T09:17:22.898 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm860x.txt 2024-03-04T09:17:22.900 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/act8865-regulator.txt 2024-03-04T09:17:22.902 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/anatop-regulator.txt 2024-03-04T09:17:22.905 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/as3722-regulator.txt 2024-03-04T09:17:22.907 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9210.txt 2024-03-04T09:17:22.909 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9211.txt 2024-03-04T09:17:22.910 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fan53555.txt 2024-03-04T09:17:22.912 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fixed-regulator.txt 2024-03-04T09:17:22.915 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/gpio-regulator.txt 2024-03-04T09:17:22.917 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/isl9305.txt 2024-03-04T09:17:22.919 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/lp872x.txt 2024-03-04T09:17:22.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:17:22 smithi190 ceph-mon[36341]: pgmap v54: 129 pgs: 129 active+clean; 92 MiB data, 588 MiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 1024 KiB/s wr, 115 op/s 2024-03-04T09:17:22.921 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ltc3589.txt 2024-03-04T09:17:22.923 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max1586-regulator.txt 2024-03-04T09:17:22.926 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max77802.txt 2024-03-04T09:17:22.928 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8660.txt 2024-03-04T09:17:22.928 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:17:22 smithi102 ceph-mon[36220]: pgmap v54: 129 pgs: 129 active+clean; 92 MiB data, 588 MiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 1024 KiB/s wr, 115 op/s 2024-03-04T09:17:22.930 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8907.txt 2024-03-04T09:17:22.932 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8925-regulator.txt 2024-03-04T09:17:22.935 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8952.txt 2024-03-04T09:17:22.937 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8973-regulator.txt 2024-03-04T09:17:22.939 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8997-regulator.txt 2024-03-04T09:17:22.941 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/mt6397-regulator.txt 2024-03-04T09:17:22.944 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/palmas-pmic.txt 2024-03-04T09:17:22.946 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pbias-regulator.txt 2024-03-04T09:17:22.948 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pfuze100.txt 2024-03-04T09:17:22.950 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pwm-regulator.txt 2024-03-04T09:17:22.956 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/regulator.txt 2024-03-04T09:17:22.956 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/s5m8767-regulator.txt 2024-03-04T09:17:22.957 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/sky81452-regulator.txt 2024-03-04T09:17:22.960 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ti-abb-regulator.txt 2024-03-04T09:17:22.962 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps51632-regulator.txt 2024-03-04T09:17:22.964 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps62360-regulator.txt 2024-03-04T09:17:22.966 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65090.txt 2024-03-04T09:17:22.968 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65217.txt 2024-03-04T09:17:22.971 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65218.txt 2024-03-04T09:17:22.973 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps6586x.txt 2024-03-04T09:17:22.975 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/twl-regulator.txt 2024-03-04T09:17:22.977 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/vexpress.txt 2024-03-04T09:17:22.980 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/ 2024-03-04T09:17:22.983 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/reserved-memory.txt 2024-03-04T09:17:22.985 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/ 2024-03-04T09:17:22.987 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/allwinner,sunxi-clock-reset.txt 2024-03-04T09:17:22.989 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/fsl,imx-src.txt 2024-03-04T09:17:22.991 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/reset.txt 2024-03-04T09:17:22.994 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/sirf,rstc.txt 2024-03-04T09:17:22.996 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/socfpga-reset.txt 2024-03-04T09:17:22.998 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-picophyreset.txt 2024-03-04T09:17:23.001 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-powerdown.txt 2024-03-04T09:17:23.003 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-softreset.txt 2024-03-04T09:17:23.006 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/resource-names.txt 2024-03-04T09:17:23.008 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/ 2024-03-04T09:17:23.010 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/apm,rng.txt 2024-03-04T09:17:23.012 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/brcm,bcm2835.txt 2024-03-04T09:17:23.015 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/qcom,prng.txt 2024-03-04T09:17:23.017 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/ 2024-03-04T09:17:23.020 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/armada-380-rtc.txt 2024-03-04T09:17:23.023 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91rm9200-rtc.txt 2024-03-04T09:17:23.025 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91sam9-rtc.txt 2024-03-04T09:17:23.027 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dallas,ds1339.txt 2024-03-04T09:17:23.029 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dw-apb.txt 2024-03-04T09:17:23.032 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/haoyu,hym8563.txt 2024-03-04T09:17:23.034 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/imxdi-rtc.txt 2024-03-04T09:17:23.036 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/isil,isl12057.txt 2024-03-04T09:17:23.038 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/lpc32xx-rtc.txt 2024-03-04T09:17:23.040 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/maxim,ds1742.txt 2024-03-04T09:17:23.042 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/moxa,moxart-rtc.txt 2024-03-04T09:17:23.045 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nvidia,tegra20-rtc.txt 2024-03-04T09:17:23.047 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nxp,rtc-2123.txt 2024-03-04T09:17:23.049 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/olpc-xo1-rtc.txt 2024-03-04T09:17:23.051 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/orion-rtc.txt 2024-03-04T09:17:23.053 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/pxa-rtc.txt 2024-03-04T09:17:23.056 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-cmos.txt 2024-03-04T09:17:23.057 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-omap.txt 2024-03-04T09:17:23.060 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-opal.txt 2024-03-04T09:17:23.062 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-palmas.txt 2024-03-04T09:17:23.064 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/s3c-rtc.txt 2024-03-04T09:17:23.066 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sa1100-rtc.txt 2024-03-04T09:17:23.071 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/snvs-rtc.txt 2024-03-04T09:17:23.072 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/spear-rtc.txt 2024-03-04T09:17:23.073 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/stmp3xxx-rtc.txt 2024-03-04T09:17:23.075 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sun6i-rtc.txt 2024-03-04T09:17:23.078 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sunxi-rtc.txt 2024-03-04T09:17:23.080 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/twl-rtc.txt 2024-03-04T09:17:23.082 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/via,vt8500-rtc.txt 2024-03-04T09:17:23.084 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/xgene-rtc.txt 2024-03-04T09:17:23.086 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/ 2024-03-04T09:17:23.089 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/ 2024-03-04T09:17:23.091 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/st33zp24-i2c.txt 2024-03-04T09:17:23.094 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/ 2024-03-04T09:17:23.097 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/8250.txt 2024-03-04T09:17:23.099 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_jtaguart.txt 2024-03-04T09:17:23.102 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_uart.txt 2024-03-04T09:17:23.104 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/arc-uart.txt 2024-03-04T09:17:23.106 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/atmel-usart.txt 2024-03-04T09:17:23.109 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/axis,etraxfs-uart.txt 2024-03-04T09:17:23.111 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/bcm63xx-uart.txt 2024-03-04T09:17:23.113 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cavium-uart.txt 2024-03-04T09:17:23.116 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cdns,uart.txt 2024-03-04T09:17:23.118 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cirrus,clps711x-uart.txt 2024-03-04T09:17:23.120 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/digicolor-usart.txt 2024-03-04T09:17:23.123 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/efm32-uart.txt 2024-03-04T09:17:23.125 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-imx-uart.txt 2024-03-04T09:17:23.127 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-lpuart.txt 2024-03-04T09:17:23.130 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-mxs-auart.txt 2024-03-04T09:17:23.132 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/lantiq_asc.txt 2024-03-04T09:17:23.134 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/maxim,max310x.txt 2024-03-04T09:17:23.136 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl,pxa-ssp.txt 2024-03-04T09:17:23.138 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl-serial.txt 2024-03-04T09:17:23.140 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mtk-uart.txt 2024-03-04T09:17:23.143 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nvidia,tegra20-hsuart.txt 2024-03-04T09:17:23.145 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp,sc16is7xx.txt 2024-03-04T09:17:23.147 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp-lpc32xx-hsuart.txt 2024-03-04T09:17:23.149 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/omap_serial.txt 2024-03-04T09:17:23.151 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/pl011.txt 2024-03-04T09:17:23.153 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qca,ar9330-uart.txt 2024-03-04T09:17:23.156 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uart.txt 2024-03-04T09:17:23.158 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uartdm.txt 2024-03-04T09:17:23.160 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/renesas,sci-serial.txt 2024-03-04T09:17:23.162 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/rs485.txt 2024-03-04T09:17:23.164 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/samsung_uart.txt 2024-03-04T09:17:23.167 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sirf-uart.txt 2024-03-04T09:17:23.169 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/snps-dw-apb-uart.txt 2024-03-04T09:17:23.171 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sprd-uart.txt 2024-03-04T09:17:23.174 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/st-asc.txt 2024-03-04T09:17:23.176 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/vt8500-uart.txt 2024-03-04T09:17:23.178 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/ 2024-03-04T09:17:23.181 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/allwinner,sun4i-ps2.txt 2024-03-04T09:17:23.184 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/altera_ps2.txt 2024-03-04T09:17:23.186 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/olpc,ap-sp.txt 2024-03-04T09:17:23.188 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/snps-arc_ps2.txt 2024-03-04T09:17:23.191 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ 2024-03-04T09:17:23.194 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/ 2024-03-04T09:17:23.196 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman-portals.txt 2024-03-04T09:17:23.198 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman.txt 2024-03-04T09:17:23.200 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman-portals.txt 2024-03-04T09:17:23.202 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman.txt 2024-03-04T09:17:23.205 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/ 2024-03-04T09:17:23.207 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/qcom,gsbi.txt 2024-03-04T09:17:23.209 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/ 2024-03-04T09:17:23.212 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-dma.txt 2024-03-04T09:17:23.214 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-qmss.txt 2024-03-04T09:17:23.216 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ 2024-03-04T09:17:23.219 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,adau1701.txt 2024-03-04T09:17:23.222 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-i2s.txt 2024-03-04T09:17:23.223 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-spdif-tx.txt 2024-03-04T09:17:23.225 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,ssm2602.txt 2024-03-04T09:17:23.228 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4104.txt 2024-03-04T09:17:23.230 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4554.c 2024-03-04T09:17:23.232 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4642.txt 2024-03-04T09:17:23.234 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak5386.txt 2024-03-04T09:17:23.236 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5623.txt 2024-03-04T09:17:23.238 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5632.txt 2024-03-04T09:17:23.240 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/armada-370db-audio.txt 2024-03-04T09:17:23.243 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/arndale.txt 2024-03-04T09:17:23.244 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-at91sam9g20ek-wm8731-audio.txt 2024-03-04T09:17:23.247 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-sam9x5-wm8731-audio.txt 2024-03-04T09:17:23.249 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-wm8904.txt 2024-03-04T09:17:23.251 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel_ac97c.txt 2024-03-04T09:17:23.253 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/bcm2835-i2s.txt 2024-03-04T09:17:23.255 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cdns,xtfpga-i2s.txt 2024-03-04T09:17:23.257 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs35l32.txt 2024-03-04T09:17:23.260 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4265.txt 2024-03-04T09:17:23.262 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4270.txt 2024-03-04T09:17:23.264 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4271.txt 2024-03-04T09:17:23.266 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l52.txt 2024-03-04T09:17:23.269 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l56.txt 2024-03-04T09:17:23.271 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l73.txt 2024-03-04T09:17:23.274 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42xx8.txt 2024-03-04T09:17:23.276 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/da9055.txt 2024-03-04T09:17:23.278 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-evm-audio.txt 2024-03-04T09:17:23.281 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-mcasp-audio.txt 2024-03-04T09:17:23.283 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/designware-i2s.txt 2024-03-04T09:17:23.285 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/es8328.txt 2024-03-04T09:17:23.288 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/eukrea-tlv320.txt 2024-03-04T09:17:23.290 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,asrc.txt 2024-03-04T09:17:23.292 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,esai.txt 2024-03-04T09:17:23.294 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,spdif.txt 2024-03-04T09:17:23.297 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,ssi.txt 2024-03-04T09:17:23.299 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-asoc-card.txt 2024-03-04T09:17:23.301 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-sai.txt 2024-03-04T09:17:23.303 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/hdmi.txt 2024-03-04T09:17:23.305 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-es8328.txt 2024-03-04T09:17:23.308 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-sgtl5000.txt 2024-03-04T09:17:23.310 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-spdif.txt 2024-03-04T09:17:23.312 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-wm8962.txt 2024-03-04T09:17:23.314 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audmux.txt 2024-03-04T09:17:23.316 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ingenic,jz4740-i2s.txt 2024-03-04T09:17:23.318 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98090.txt 2024-03-04T09:17:23.321 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98095.txt 2024-03-04T09:17:23.323 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98357a.txt 2024-03-04T09:17:23.325 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa-ssp.txt 2024-03-04T09:17:23.327 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa2xx-pcm.txt 2024-03-04T09:17:23.329 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mvebu-audio.txt 2024-03-04T09:17:23.332 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-audio-sgtl5000.txt 2024-03-04T09:17:23.334 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-saif.txt 2024-03-04T09:17:23.336 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nokia,rx51.txt 2024-03-04T09:17:23.338 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-alc5632.txt 2024-03-04T09:17:23.340 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-max98090.txt 2024-03-04T09:17:23.343 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5640.txt 2024-03-04T09:17:23.345 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5677.txt 2024-03-04T09:17:23.347 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-trimslice.txt 2024-03-04T09:17:23.349 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8753.txt 2024-03-04T09:17:23.351 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8903.txt 2024-03-04T09:17:23.354 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm9712.txt 2024-03-04T09:17:23.356 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-ac97.txt 2024-03-04T09:17:23.358 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-das.txt 2024-03-04T09:17:23.360 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-i2s.txt 2024-03-04T09:17:23.363 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-ahub.txt 2024-03-04T09:17:23.365 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-hda.txt 2024-03-04T09:17:23.367 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-i2s.txt 2024-03-04T09:17:23.369 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-abe-twl6040.txt 2024-03-04T09:17:23.372 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-dmic.txt 2024-03-04T09:17:23.374 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcbsp.txt 2024-03-04T09:17:23.376 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcpdm.txt 2024-03-04T09:17:23.378 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-twl4030.txt 2024-03-04T09:17:23.381 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm1792a.txt 2024-03-04T09:17:23.383 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm512x.txt 2024-03-04T09:17:23.385 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,fsi.txt 2024-03-04T09:17:23.387 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,rsnd.txt 2024-03-04T09:17:23.390 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rockchip-i2s.txt 2024-03-04T09:17:23.392 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5631.txt 2024-03-04T09:17:23.394 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5640.txt 2024-03-04T09:17:23.396 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5677.txt 2024-03-04T09:17:23.398 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,odroidx2-max98090.txt 2024-03-04T09:17:23.400 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,smdk-wm8994.txt 2024-03-04T09:17:23.402 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung-i2s.txt 2024-03-04T09:17:23.405 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sgtl5000.txt 2024-03-04T09:17:23.407 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/simple-card.txt 2024-03-04T09:17:23.409 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-codec.txt 2024-03-04T09:17:23.412 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-port.txt 2024-03-04T09:17:23.414 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio.txt 2024-03-04T09:17:23.416 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-usp.txt 2024-03-04T09:17:23.418 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/snow.txt 2024-03-04T09:17:23.421 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/soc-ac97link.txt 2024-03-04T09:17:23.423 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-receiver.txt 2024-03-04T09:17:23.425 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-transmitter.txt 2024-03-04T09:17:23.427 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm2518.txt 2024-03-04T09:17:23.429 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm4567.txt 2024-03-04T09:17:23.432 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta32x.txt 2024-03-04T09:17:23.434 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta350.txt 2024-03-04T09:17:23.437 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tas2552.txt 2024-03-04T09:17:23.439 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tdm-slot.txt 2024-03-04T09:17:23.441 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,pcm1681.txt 2024-03-04T09:17:23.443 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,tas5086.txt 2024-03-04T09:17:23.445 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic31xx.txt 2024-03-04T09:17:23.447 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic32x4.txt 2024-03-04T09:17:23.450 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic3x.txt 2024-03-04T09:17:23.452 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tpa6130a2.txt 2024-03-04T09:17:23.455 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ts3a227e.txt 2024-03-04T09:17:23.457 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-mop500.txt 2024-03-04T09:17:23.459 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-msp.txt 2024-03-04T09:17:23.462 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/widgets.txt 2024-03-04T09:17:23.464 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8510.txt 2024-03-04T09:17:23.466 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8523.txt 2024-03-04T09:17:23.468 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8580.txt 2024-03-04T09:17:23.471 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8711.txt 2024-03-04T09:17:23.473 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8728.txt 2024-03-04T09:17:23.475 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8731.txt 2024-03-04T09:17:23.477 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8737.txt 2024-03-04T09:17:23.479 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8741.txt 2024-03-04T09:17:23.482 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8750.txt 2024-03-04T09:17:23.484 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8753.txt 2024-03-04T09:17:23.486 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8770.txt 2024-03-04T09:17:23.488 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8776.txt 2024-03-04T09:17:23.490 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8804.txt 2024-03-04T09:17:23.492 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8903.txt 2024-03-04T09:17:23.494 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8904.txt 2024-03-04T09:17:23.497 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8960.txt 2024-03-04T09:17:23.499 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8962.txt 2024-03-04T09:17:23.501 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8994.txt 2024-03-04T09:17:23.503 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ 2024-03-04T09:17:23.506 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/brcm,bcm2835-spi.txt 2024-03-04T09:17:23.508 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/efm32-spi.txt 2024-03-04T09:17:23.510 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-imx-cspi.txt 2024-03-04T09:17:23.512 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-spi.txt 2024-03-04T09:17:23.514 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/mxs-spi.txt 2024-03-04T09:17:23.517 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra114-spi.txt 2024-03-04T09:17:23.518 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-sflash.txt 2024-03-04T09:17:23.521 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-slink.txt 2024-03-04T09:17:23.523 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/omap-spi.txt 2024-03-04T09:17:23.525 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/qcom,spi-qup.txt 2024-03-04T09:17:23.527 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-hspi.txt 2024-03-04T09:17:23.529 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-msiof.txt 2024-03-04T09:17:23.532 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/snps,dw-apb-ssi.txt 2024-03-04T09:17:23.534 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-bus.txt 2024-03-04T09:17:23.536 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-cadence.txt 2024-03-04T09:17:23.539 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-davinci.txt 2024-03-04T09:17:23.541 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-dw.txt 2024-03-04T09:17:23.543 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-fsl-dspi.txt 2024-03-04T09:17:23.545 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-gpio.txt 2024-03-04T09:17:23.548 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-img-spfi.txt 2024-03-04T09:17:23.550 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-meson.txt 2024-03-04T09:17:23.552 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-octeon.txt 2024-03-04T09:17:23.554 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-orion.txt 2024-03-04T09:17:23.556 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rockchip.txt 2024-03-04T09:17:23.559 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rspi.txt 2024-03-04T09:17:23.561 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-samsung.txt 2024-03-04T09:17:23.563 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sc18is602.txt 2024-03-04T09:17:23.566 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sirf.txt 2024-03-04T09:17:23.568 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-st-ssc.txt 2024-03-04T09:17:23.573 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun4i.txt 2024-03-04T09:17:23.573 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun6i.txt 2024-03-04T09:17:23.574 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-xtensa-xtfpga.txt 2024-03-04T09:17:23.576 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_altera.txt 2024-03-04T09:17:23.579 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_atmel.txt 2024-03-04T09:17:23.725 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_oc_tiny.txt 2024-03-04T09:17:23.727 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_pl022.txt 2024-03-04T09:17:23.729 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ti_qspi.txt 2024-03-04T09:17:23.731 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/ 2024-03-04T09:17:23.734 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/qcom,spmi-pmic-arb.txt 2024-03-04T09:17:23.736 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/spmi.txt 2024-03-04T09:17:23.738 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/ 2024-03-04T09:17:23.740 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/ 2024-03-04T09:17:23.742 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/ 2024-03-04T09:17:23.744 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/lpc32xx-adc.txt 2024-03-04T09:17:23.746 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/mxs-lradc.txt 2024-03-04T09:17:23.749 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/spear-adc.txt 2024-03-04T09:17:23.751 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/submitting-patches.txt 2024-03-04T09:17:23.755 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ 2024-03-04T09:17:23.757 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/armada-thermal.txt 2024-03-04T09:17:23.760 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/db8500-thermal.txt 2024-03-04T09:17:23.763 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/dove-thermal.txt 2024-03-04T09:17:23.765 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/exynos-thermal.txt 2024-03-04T09:17:23.767 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/imx-thermal.txt 2024-03-04T09:17:23.769 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/kirkwood-thermal.txt 2024-03-04T09:17:23.771 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rcar-thermal.txt 2024-03-04T09:17:23.773 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rockchip-thermal.txt 2024-03-04T09:17:23.776 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/spear-thermal.txt 2024-03-04T09:17:23.777 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/st-thermal.txt 2024-03-04T09:17:23.779 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/tegra-soctherm.txt 2024-03-04T09:17:23.782 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/thermal.txt 2024-03-04T09:17:23.784 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ti_soc_thermal.txt 2024-03-04T09:17:23.787 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ 2024-03-04T09:17:23.789 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun4i-timer.txt 2024-03-04T09:17:23.791 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun5i-a13-hstimer.txt 2024-03-04T09:17:23.794 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/amlogic,meson6-timer.txt 2024-03-04T09:17:23.796 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/arm,sp804.txt 2024-03-04T09:17:23.798 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/brcm,bcm2835-system-timer.txt 2024-03-04T09:17:23.801 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cadence,ttc-timer.txt 2024-03-04T09:17:23.803 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cirrus,clps711x-timer.txt 2024-03-04T09:17:23.805 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/digicolor-timer.txt 2024-03-04T09:17:23.807 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/energymicro,efm32-timer.txt 2024-03-04T09:17:23.809 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,ftm-timer.txt 2024-03-04T09:17:23.811 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,imxgpt.txt 2024-03-04T09:17:23.813 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/lsi,zevio-timer.txt 2024-03-04T09:17:23.816 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,armada-370-xp-timer.txt 2024-03-04T09:17:23.817 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,orion-timer.txt 2024-03-04T09:17:23.820 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/mediatek,mtk-timer.txt 2024-03-04T09:17:23.822 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/moxa,moxart-timer.txt 2024-03-04T09:17:23.824 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra20-timer.txt 2024-03-04T09:17:23.826 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra30-timer.txt 2024-03-04T09:17:23.828 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,cmt.txt 2024-03-04T09:17:23.831 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,mtu2.txt 2024-03-04T09:17:23.833 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,tmu.txt 2024-03-04T09:17:23.835 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/rockchip,rk3288-timer.txt 2024-03-04T09:17:23.837 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/samsung,exynos4210-mct.txt 2024-03-04T09:17:23.839 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/stericsson-u300-apptimer.txt 2024-03-04T09:17:23.842 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ti,keystone-timer.txt 2024-03-04T09:17:23.844 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ 2024-03-04T09:17:23.846 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ufshcd-pltfrm.txt 2024-03-04T09:17:23.849 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/unittest.txt 2024-03-04T09:17:23.852 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ 2024-03-04T09:17:23.853 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/am33xx-usb.txt 2024-03-04T09:17:23.856 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/atmel-usb.txt 2024-03-04T09:17:23.858 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-imx.txt 2024-03-04T09:17:23.860 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-qcom.txt 2024-03-04T09:17:23.862 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-usb2.txt 2024-03-04T09:17:23.864 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-zevio.txt 2024-03-04T09:17:23.866 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc2.txt 2024-03-04T09:17:23.868 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3-st.txt 2024-03-04T09:17:23.874 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3.txt 2024-03-04T09:17:23.877 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-omap.txt 2024-03-04T09:17:23.879 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-orion.txt 2024-03-04T09:17:23.881 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-st.txt 2024-03-04T09:17:23.883 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/exynos-usb.txt 2024-03-04T09:17:23.885 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/fsl-usb.txt 2024-03-04T09:17:23.888 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/generic.txt 2024-03-04T09:17:23.890 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/gr-udc.txt 2024-03-04T09:17:23.892 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/isp1301.txt 2024-03-04T09:17:23.894 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-phy.txt 2024-03-04T09:17:23.896 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-usb.txt 2024-03-04T09:17:23.898 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/lpc32xx-udc.txt 2024-03-04T09:17:23.901 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/msm-hsusb.txt 2024-03-04T09:17:23.903 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/mxs-phy.txt 2024-03-04T09:17:23.905 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-ehci.txt 2024-03-04T09:17:23.907 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-usb-phy.txt 2024-03-04T09:17:23.909 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-nxp.txt 2024-03-04T09:17:23.912 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-omap3.txt 2024-03-04T09:17:23.914 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-st.txt 2024-03-04T09:17:23.916 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/omap-usb.txt 2024-03-04T09:17:23.919 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/pxa-usb.txt 2024-03-04T09:17:23.921 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/qcom,dwc3.txt 2024-03-04T09:17:23.923 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/renesas_usbhs.txt 2024-03-04T09:17:23.925 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-hsotg.txt 2024-03-04T09:17:23.927 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-usbphy.txt 2024-03-04T09:17:23.930 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/spear-usb.txt 2024-03-04T09:17:23.932 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/twlxxxx-usb.txt 2024-03-04T09:17:23.934 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/udc-xilinx.txt 2024-03-04T09:17:23.937 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ehci.txt 2024-03-04T09:17:23.939 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-nop-xceiv.txt 2024-03-04T09:17:23.941 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ohci.txt 2024-03-04T09:17:23.943 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-uhci.txt 2024-03-04T09:17:23.945 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-xhci.txt 2024-03-04T09:17:23.947 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb3503.txt 2024-03-04T09:17:23.949 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usbmisc-imx.txt 2024-03-04T09:17:23.952 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ux500-usb.txt 2024-03-04T09:17:23.954 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/vendor-prefixes.txt 2024-03-04T09:17:23.957 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ 2024-03-04T09:17:23.959 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7123.txt 2024-03-04T09:17:23.961 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7511.txt 2024-03-04T09:17:23.964 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/analog-tv-connector.txt 2024-03-04T09:17:23.966 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/arm,pl11x.txt 2024-03-04T09:17:23.968 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/atmel,lcdc.txt 2024-03-04T09:17:23.970 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/ 2024-03-04T09:17:23.972 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/88pm860x.txt 2024-03-04T09:17:23.975 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/gpio-backlight.txt 2024-03-04T09:17:23.977 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/lp855x.txt 2024-03-04T09:17:23.979 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/max8925-backlight.txt 2024-03-04T09:17:23.983 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/pwm-backlight.txt 2024-03-04T09:17:23.984 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/tps65217-backlight.txt 2024-03-04T09:17:23.986 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ 2024-03-04T09:17:23.989 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ps8622.txt 2024-03-04T09:17:23.992 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ptn3460.txt 2024-03-04T09:17:23.993 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/cirrus,clps711x-fb.txt 2024-03-04T09:17:23.996 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/display-timing.txt 2024-03-04T09:17:23.998 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dvi-connector.txt 2024-03-04T09:17:24.000 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dw_hdmi-rockchip.txt 2024-03-04T09:17:24.002 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos7-decon.txt 2024-03-04T09:17:24.005 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dp.txt 2024-03-04T09:17:24.007 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dsim.txt 2024-03-04T09:17:24.009 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmi.txt 2024-03-04T09:17:24.012 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiddc.txt 2024-03-04T09:17:24.013 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiphy.txt 2024-03-04T09:17:24.016 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_mixer.txt 2024-03-04T09:17:24.018 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/fsl,imx-fb.txt 2024-03-04T09:17:24.020 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/hdmi-connector.txt 2024-03-04T09:17:24.022 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/lgphilips,lb035q02.txt 2024-03-04T09:17:24.024 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dpi.txt 2024-03-04T09:17:24.027 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dsi-cm.txt 2024-03-04T09:17:24.029 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/renesas,du.txt 2024-03-04T09:17:24.031 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-drm.txt 2024-03-04T09:17:24.033 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-vop.txt 2024-03-04T09:17:24.035 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/samsung-fimd.txt 2024-03-04T09:17:24.038 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sharp,ls037v7dw01.txt 2024-03-04T09:17:24.040 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer-sunxi.txt 2024-03-04T09:17:24.042 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer.txt 2024-03-04T09:17:24.045 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sony,acx565akm.txt 2024-03-04T09:17:24.047 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1289fb.txt 2024-03-04T09:17:24.049 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1307fb.txt 2024-03-04T09:17:24.051 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/thine,thc63lvdm83d 2024-03-04T09:17:24.054 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,dra7-dss.txt 2024-03-04T09:17:24.056 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap-dss.txt 2024-03-04T09:17:24.058 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap2-dss.txt 2024-03-04T09:17:24.062 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap3-dss.txt 2024-03-04T09:17:24.067 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap4-dss.txt 2024-03-04T09:17:24.071 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap5-dss.txt 2024-03-04T09:17:24.075 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,opa362.txt 2024-03-04T09:17:24.079 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tfp410.txt 2024-03-04T09:17:24.081 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tpd12s015.txt 2024-03-04T09:17:24.083 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/toppoly,td028ttec1.txt 2024-03-04T09:17:24.086 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/tpo,td043mtea1.txt 2024-03-04T09:17:24.089 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/vga-connector.txt 2024-03-04T09:17:24.091 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/via,vt8500-fb.txt 2024-03-04T09:17:24.094 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,prizm-ge-rops.txt 2024-03-04T09:17:24.096 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,wm8505-fb.txt 2024-03-04T09:17:24.099 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/ 2024-03-04T09:17:24.102 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/mmio.txt 2024-03-04T09:17:24.105 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/ 2024-03-04T09:17:24.107 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/fsl-imx-owire.txt 2024-03-04T09:17:24.110 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/omap-hdq.txt 2024-03-04T09:17:24.112 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/w1-gpio.txt 2024-03-04T09:17:24.115 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ 2024-03-04T09:17:24.118 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-at91rm9200-wdt.txt 2024-03-04T09:17:24.122 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-wdt.txt 2024-03-04T09:17:24.125 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/brcm,bcm2835-pm-wdog.txt 2024-03-04T09:17:24.127 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/cadence-wdt.txt 2024-03-04T09:17:24.129 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/davinci-wdt.txt 2024-03-04T09:17:24.131 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/dw_wdt.txt 2024-03-04T09:17:24.134 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/fsl-imx-wdt.txt 2024-03-04T09:17:24.136 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/gpio-wdt.txt 2024-03-04T09:17:24.138 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/imgpdc-wdt.txt 2024-03-04T09:17:24.141 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ingenic,jz4740-wdt.txt 2024-03-04T09:17:24.144 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/marvel.txt 2024-03-04T09:17:24.146 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/men-a021-wdt.txt 2024-03-04T09:17:24.149 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/meson6-wdt.txt 2024-03-04T09:17:24.151 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/moxa,moxart-watchdog.txt 2024-03-04T09:17:24.154 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/mtk-wdt.txt 2024-03-04T09:17:24.156 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/of-xilinx-wdt.txt 2024-03-04T09:17:24.158 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/omap-wdt.txt 2024-03-04T09:17:24.160 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/pnx4008-wdt.txt 2024-03-04T09:17:24.162 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qca-ar7130-wdt.txt 2024-03-04T09:17:24.165 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qcom-wdt.txt 2024-03-04T09:17:24.167 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/rt2880-wdt.txt 2024-03-04T09:17:24.169 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/samsung-wdt.txt 2024-03-04T09:17:24.171 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sirfsoc_wdt.txt 2024-03-04T09:17:24.173 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/stericsson-coh901327.txt 2024-03-04T09:17:24.175 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sunxi-wdt.txt 2024-03-04T09:17:24.177 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/twl4030-wdt.txt 2024-03-04T09:17:24.180 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ 2024-03-04T09:17:24.182 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ce4100.txt 2024-03-04T09:17:24.185 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/interrupt.txt 2024-03-04T09:17:24.187 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/timer.txt 2024-03-04T09:17:24.191 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/xilinx.txt 2024-03-04T09:17:24.192 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/ 2024-03-04T09:17:24.195 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/xillybus.txt 2024-03-04T09:17:24.198 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/booting-without-of.txt 2024-03-04T09:17:24.204 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/changesets.txt 2024-03-04T09:17:24.225 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/dynamic-resolution-notes.txt 2024-03-04T09:17:24.234 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/of_selftest.txt 2024-03-04T09:17:24.244 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/overlay-notes.txt 2024-03-04T09:17:24.252 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/todo.txt 2024-03-04T09:17:24.262 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/devicetree/usage-model.txt 2024-03-04T09:17:24.271 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/digsig.txt 2024-03-04T09:17:24.280 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/dma-buf-sharing.txt 2024-03-04T09:17:24.283 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/dmaengine/ 2024-03-04T09:17:24.285 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/dmaengine/00-INDEX 2024-03-04T09:17:24.286 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/dmaengine/client.txt 2024-03-04T09:17:24.289 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/dmaengine/dmatest.txt 2024-03-04T09:17:24.291 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/dmaengine/provider.txt 2024-03-04T09:17:24.293 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/dontdiff 2024-03-04T09:17:24.296 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/driver-model/ 2024-03-04T09:17:24.297 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/driver-model/binding.txt 2024-03-04T09:17:24.299 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/driver-model/bus.txt 2024-03-04T09:17:24.301 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/driver-model/class.txt 2024-03-04T09:17:24.303 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/driver-model/design-patterns.txt 2024-03-04T09:17:24.306 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/driver-model/device.txt 2024-03-04T09:17:24.308 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/driver-model/devres.txt 2024-03-04T09:17:24.310 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/driver-model/driver.txt 2024-03-04T09:17:24.313 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/driver-model/overview.txt 2024-03-04T09:17:24.315 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/driver-model/platform.txt 2024-03-04T09:17:24.317 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/driver-model/porting.txt 2024-03-04T09:17:24.320 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/dvb/ 2024-03-04T09:17:24.322 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/dvb/README.dvb-usb 2024-03-04T09:17:24.324 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/dvb/avermedia.txt 2024-03-04T09:17:24.327 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/dvb/bt8xx.txt 2024-03-04T09:17:24.329 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/dvb/cards.txt 2024-03-04T09:17:24.331 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/dvb/ci.txt 2024-03-04T09:17:24.334 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/dvb/contributors.txt 2024-03-04T09:17:24.336 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/dvb/faq.txt 2024-03-04T09:17:24.338 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/dvb/get_dvb_firmware 2024-03-04T09:17:24.341 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/dvb/lmedm04.txt 2024-03-04T09:17:24.343 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/dvb/opera-firmware.txt 2024-03-04T09:17:24.345 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/dvb/readme.txt 2024-03-04T09:17:24.347 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/dvb/technisat.txt 2024-03-04T09:17:24.350 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/dvb/ttusb-dec.txt 2024-03-04T09:17:24.351 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/dvb/udev.txt 2024-03-04T09:17:24.353 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/dynamic-debug-howto.txt 2024-03-04T09:17:24.356 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/early-userspace/ 2024-03-04T09:17:24.358 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/early-userspace/README 2024-03-04T09:17:24.360 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/early-userspace/buffer-format.txt 2024-03-04T09:17:24.362 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/edac.txt 2024-03-04T09:17:24.365 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/efi-stub.txt 2024-03-04T09:17:24.367 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/eisa.txt 2024-03-04T09:17:24.369 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/email-clients.txt 2024-03-04T09:17:24.372 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/extcon/ 2024-03-04T09:17:24.374 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/extcon/porting-android-switch-class 2024-03-04T09:17:24.376 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/fault-injection/ 2024-03-04T09:17:24.378 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/fault-injection/fault-injection.txt 2024-03-04T09:17:24.381 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/fault-injection/notifier-error-inject.txt 2024-03-04T09:17:24.383 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/fault-injection/provoke-crashes.txt 2024-03-04T09:17:24.385 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/fb/ 2024-03-04T09:17:24.388 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/fb/00-INDEX 2024-03-04T09:17:24.390 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/fb/api.txt 2024-03-04T09:17:24.393 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/fb/arkfb.txt 2024-03-04T09:17:24.395 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/fb/aty128fb.txt 2024-03-04T09:17:24.399 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/fb/cirrusfb.txt 2024-03-04T09:17:24.400 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/fb/cmap_xfbdev.txt 2024-03-04T09:17:24.402 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/fb/deferred_io.txt 2024-03-04T09:17:24.404 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/fb/efifb.txt 2024-03-04T09:17:24.407 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/fb/ep93xx-fb.txt 2024-03-04T09:17:24.409 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/fb/fbcon.txt 2024-03-04T09:17:24.411 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/fb/framebuffer.txt 2024-03-04T09:17:24.414 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/fb/gxfb.txt 2024-03-04T09:17:24.416 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/fb/intel810.txt 2024-03-04T09:17:24.419 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/fb/intelfb.txt 2024-03-04T09:17:24.421 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/fb/internals.txt 2024-03-04T09:17:24.423 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/fb/lxfb.txt 2024-03-04T09:17:24.425 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/fb/matroxfb.txt 2024-03-04T09:17:24.428 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/fb/metronomefb.txt 2024-03-04T09:17:24.430 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/fb/modedb.txt 2024-03-04T09:17:24.433 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/fb/pvr2fb.txt 2024-03-04T09:17:24.436 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/fb/pxafb.txt 2024-03-04T09:17:24.438 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/fb/s3fb.txt 2024-03-04T09:17:24.440 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/fb/sa1100fb.txt 2024-03-04T09:17:24.442 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/fb/sh7760fb.txt 2024-03-04T09:17:24.444 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/fb/sisfb.txt 2024-03-04T09:17:24.447 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/fb/sm501.txt 2024-03-04T09:17:24.449 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/fb/sstfb.txt 2024-03-04T09:17:24.452 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/fb/tgafb.txt 2024-03-04T09:17:24.454 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/fb/tridentfb.txt 2024-03-04T09:17:24.456 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/fb/udlfb.txt 2024-03-04T09:17:24.459 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/fb/uvesafb.txt 2024-03-04T09:17:24.462 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/fb/vesafb.txt 2024-03-04T09:17:24.465 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/fb/viafb.modes 2024-03-04T09:17:24.468 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/fb/viafb.txt 2024-03-04T09:17:24.471 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/fb/vt8623fb.txt 2024-03-04T09:17:24.474 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/ 2024-03-04T09:17:24.476 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/.gitignore 2024-03-04T09:17:24.479 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/00-INDEX 2024-03-04T09:17:24.482 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/9p.txt 2024-03-04T09:17:24.485 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/Locking 2024-03-04T09:17:24.488 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/Makefile 2024-03-04T09:17:24.491 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/adfs.txt 2024-03-04T09:17:24.494 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/affs.txt 2024-03-04T09:17:24.497 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/afs.txt 2024-03-04T09:17:24.501 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/autofs4-mount-control.txt 2024-03-04T09:17:24.504 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/autofs4.txt 2024-03-04T09:17:24.508 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/automount-support.txt 2024-03-04T09:17:24.510 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/befs.txt 2024-03-04T09:17:24.513 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/bfs.txt 2024-03-04T09:17:24.515 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/btrfs.txt 2024-03-04T09:17:24.518 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/caching/ 2024-03-04T09:17:24.520 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/caching/backend-api.txt 2024-03-04T09:17:24.524 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/caching/cachefiles.txt 2024-03-04T09:17:24.527 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/caching/fscache.txt 2024-03-04T09:17:24.530 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/caching/netfs-api.txt 2024-03-04T09:17:24.533 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/caching/object.txt 2024-03-04T09:17:24.536 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/caching/operations.txt 2024-03-04T09:17:24.537 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/ceph.txt 2024-03-04T09:17:24.541 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/cifs/ 2024-03-04T09:17:24.543 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/cifs/AUTHORS 2024-03-04T09:17:24.545 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/cifs/CHANGES 2024-03-04T09:17:24.549 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/cifs/README 2024-03-04T09:17:24.553 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/cifs/TODO 2024-03-04T09:17:24.555 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/cifs/cifs.txt 2024-03-04T09:17:24.558 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/cifs/winucase_convert.pl 2024-03-04T09:17:24.560 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/coda.txt 2024-03-04T09:17:24.563 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/configfs/ 2024-03-04T09:17:24.565 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/configfs/Makefile 2024-03-04T09:17:24.568 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs.txt 2024-03-04T09:17:24.570 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_explicit.c 2024-03-04T09:17:24.573 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_macros.c 2024-03-04T09:17:24.576 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/cramfs.txt 2024-03-04T09:17:24.579 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/dax.txt 2024-03-04T09:17:24.581 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/debugfs.txt 2024-03-04T09:17:24.583 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/devpts.txt 2024-03-04T09:17:24.585 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/directory-locking 2024-03-04T09:17:24.588 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/dlmfs.txt 2024-03-04T09:17:24.590 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/dnotify.txt 2024-03-04T09:17:24.592 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/dnotify_test.c 2024-03-04T09:17:24.594 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/ecryptfs.txt 2024-03-04T09:17:24.596 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/efivarfs.txt 2024-03-04T09:17:24.598 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/exofs.txt 2024-03-04T09:17:24.604 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/ext2.txt 2024-03-04T09:17:24.604 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/ext3.txt 2024-03-04T09:17:24.605 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/ext4.txt 2024-03-04T09:17:24.608 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/f2fs.txt 2024-03-04T09:17:24.611 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/fiemap.txt 2024-03-04T09:17:24.613 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/files.txt 2024-03-04T09:17:24.615 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/fuse.txt 2024-03-04T09:17:24.618 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/gfs2-glocks.txt 2024-03-04T09:17:24.620 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/gfs2-uevents.txt 2024-03-04T09:17:24.622 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/gfs2.txt 2024-03-04T09:17:24.624 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/hfs.txt 2024-03-04T09:17:24.626 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/hfsplus.txt 2024-03-04T09:17:24.629 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/hpfs.txt 2024-03-04T09:17:24.631 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/inotify.txt 2024-03-04T09:17:24.634 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/isofs.txt 2024-03-04T09:17:24.636 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/jfs.txt 2024-03-04T09:17:24.638 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/locks.txt 2024-03-04T09:17:24.641 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/logfs.txt 2024-03-04T09:17:24.643 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/mandatory-locking.txt 2024-03-04T09:17:24.645 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/ncpfs.txt 2024-03-04T09:17:24.648 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/nfs/ 2024-03-04T09:17:24.650 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/nfs/00-INDEX 2024-03-04T09:17:24.653 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/nfs/Exporting 2024-03-04T09:17:24.655 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/nfs/fault_injection.txt 2024-03-04T09:17:24.657 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/nfs/idmapper.txt 2024-03-04T09:17:24.659 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/nfs/knfsd-stats.txt 2024-03-04T09:17:24.661 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs-rdma.txt 2024-03-04T09:17:24.663 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs.txt 2024-03-04T09:17:24.666 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs41-server.txt 2024-03-04T09:17:24.668 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsd-admin-interfaces.txt 2024-03-04T09:17:24.670 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsroot.txt 2024-03-04T09:17:24.673 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs-block-server.txt 2024-03-04T09:17:24.675 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs.txt 2024-03-04T09:17:24.677 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-cache.txt 2024-03-04T09:17:24.679 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-server-gss.txt 2024-03-04T09:17:24.681 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/nilfs2.txt 2024-03-04T09:17:24.684 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/ntfs.txt 2024-03-04T09:17:24.687 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/ocfs2.txt 2024-03-04T09:17:24.688 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/omfs.txt 2024-03-04T09:17:24.690 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/overlayfs.txt 2024-03-04T09:17:24.693 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/path-lookup.txt 2024-03-04T09:17:24.695 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/ 2024-03-04T09:17:24.697 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/design_notes.txt 2024-03-04T09:17:24.699 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/info.txt 2024-03-04T09:17:24.702 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/network_protocol.txt 2024-03-04T09:17:24.704 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/porting 2024-03-04T09:17:24.707 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/proc.txt 2024-03-04T09:17:24.711 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/qnx6.txt 2024-03-04T09:17:24.713 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/quota.txt 2024-03-04T09:17:24.716 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/ramfs-rootfs-initramfs.txt 2024-03-04T09:17:24.718 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/relay.txt 2024-03-04T09:17:24.721 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/romfs.txt 2024-03-04T09:17:24.721 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:17:24 smithi190 ceph-mon[36341]: pgmap v55: 129 pgs: 129 active+clean; 92 MiB data, 588 MiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 468 KiB/s wr, 63 op/s 2024-03-04T09:17:24.723 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/seq_file.txt 2024-03-04T09:17:24.725 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/sharedsubtree.txt 2024-03-04T09:17:24.728 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/spufs.txt 2024-03-04T09:17:24.730 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:17:24 smithi102 ceph-mon[36220]: pgmap v55: 129 pgs: 129 active+clean; 92 MiB data, 588 MiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 468 KiB/s wr, 63 op/s 2024-03-04T09:17:24.731 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/squashfs.txt 2024-03-04T09:17:24.733 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/sysfs-pci.txt 2024-03-04T09:17:24.734 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/sysfs-tagging.txt 2024-03-04T09:17:24.737 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/sysfs.txt 2024-03-04T09:17:24.739 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/sysv-fs.txt 2024-03-04T09:17:24.742 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/tmpfs.txt 2024-03-04T09:17:24.744 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/ubifs.txt 2024-03-04T09:17:24.746 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/udf.txt 2024-03-04T09:17:24.748 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/ufs.txt 2024-03-04T09:17:24.750 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/vfat.txt 2024-03-04T09:17:24.753 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/vfs.txt 2024-03-04T09:17:24.756 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/xfs-delayed-logging-design.txt 2024-03-04T09:17:24.759 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/xfs-self-describing-metadata.txt 2024-03-04T09:17:24.762 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/filesystems/xfs.txt 2024-03-04T09:17:24.765 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/firmware_class/ 2024-03-04T09:17:24.767 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/firmware_class/README 2024-03-04T09:17:24.769 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/firmware_class/hotplug-script 2024-03-04T09:17:24.770 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/flexible-arrays.txt 2024-03-04T09:17:24.773 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/fmc/ 2024-03-04T09:17:24.776 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/fmc/00-INDEX 2024-03-04T09:17:24.778 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/fmc/API.txt 2024-03-04T09:17:24.780 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/fmc/FMC-and-SDB.txt 2024-03-04T09:17:24.782 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/fmc/carrier.txt 2024-03-04T09:17:24.785 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/fmc/fmc-chardev.txt 2024-03-04T09:17:24.787 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/fmc/fmc-fakedev.txt 2024-03-04T09:17:24.789 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/fmc/fmc-trivial.txt 2024-03-04T09:17:24.791 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/fmc/fmc-write-eeprom.txt 2024-03-04T09:17:24.793 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/fmc/identifiers.txt 2024-03-04T09:17:24.795 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/fmc/mezzanine.txt 2024-03-04T09:17:24.798 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/fmc/parameters.txt 2024-03-04T09:17:24.800 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/frv/ 2024-03-04T09:17:24.803 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/frv/README.txt 2024-03-04T09:17:24.805 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/frv/atomic-ops.txt 2024-03-04T09:17:24.806 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/frv/booting.txt 2024-03-04T09:17:24.809 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/frv/clock.txt 2024-03-04T09:17:24.811 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/frv/configuring.txt 2024-03-04T09:17:24.813 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/frv/features.txt 2024-03-04T09:17:24.815 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/frv/gdbinit 2024-03-04T09:17:24.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:17:24 smithi082 ceph-mon[32880]: pgmap v55: 129 pgs: 129 active+clean; 92 MiB data, 588 MiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 468 KiB/s wr, 63 op/s 2024-03-04T09:17:24.817 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/frv/gdbstub.txt 2024-03-04T09:17:24.820 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/frv/kernel-ABI.txt 2024-03-04T09:17:24.823 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/frv/mmu-layout.txt 2024-03-04T09:17:24.824 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/futex-requeue-pi.txt 2024-03-04T09:17:24.827 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/gcov.txt 2024-03-04T09:17:24.830 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/gdb-kernel-debugging.txt 2024-03-04T09:17:24.832 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/gpio/ 2024-03-04T09:17:24.834 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/gpio/00-INDEX 2024-03-04T09:17:24.836 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/gpio/board.txt 2024-03-04T09:17:24.839 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/gpio/consumer.txt 2024-03-04T09:17:24.841 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/gpio/driver.txt 2024-03-04T09:17:24.843 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/gpio/gpio-legacy.txt 2024-03-04T09:17:24.846 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/gpio/gpio.txt 2024-03-04T09:17:24.848 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/gpio/sysfs.txt 2024-03-04T09:17:24.851 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hid/ 2024-03-04T09:17:24.854 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hid/hid-sensor.txt 2024-03-04T09:17:24.856 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hid/hid-transport.txt 2024-03-04T09:17:24.858 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hid/hiddev.txt 2024-03-04T09:17:24.861 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hid/hidraw.txt 2024-03-04T09:17:24.863 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hid/uhid.txt 2024-03-04T09:17:24.866 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/highuid.txt 2024-03-04T09:17:24.868 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hsi.txt 2024-03-04T09:17:24.870 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hw_random.txt 2024-03-04T09:17:24.872 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/ 2024-03-04T09:17:24.874 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/ab8500 2024-03-04T09:17:24.878 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/abituguru 2024-03-04T09:17:24.880 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/abituguru-datasheet 2024-03-04T09:17:24.883 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/abituguru3 2024-03-04T09:17:24.885 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/abx500 2024-03-04T09:17:24.887 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/acpi_power_meter 2024-03-04T09:17:24.889 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/ad7314 2024-03-04T09:17:24.891 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/adc128d818 2024-03-04T09:17:24.893 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/adm1021 2024-03-04T09:17:24.895 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/adm1025 2024-03-04T09:17:24.898 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/adm1026 2024-03-04T09:17:24.900 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/adm1031 2024-03-04T09:17:24.902 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/adm1275 2024-03-04T09:17:24.904 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/adm9240 2024-03-04T09:17:24.906 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/ads1015 2024-03-04T09:17:24.908 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/ads7828 2024-03-04T09:17:24.910 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/adt7410 2024-03-04T09:17:24.912 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/adt7411 2024-03-04T09:17:24.915 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/adt7462 2024-03-04T09:17:24.917 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/adt7470 2024-03-04T09:17:24.918 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/adt7475 2024-03-04T09:17:24.921 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/amc6821 2024-03-04T09:17:24.923 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/asb100 2024-03-04T09:17:24.925 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/asc7621 2024-03-04T09:17:24.927 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/coretemp 2024-03-04T09:17:24.929 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/da9052 2024-03-04T09:17:24.932 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/da9055 2024-03-04T09:17:24.933 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/dme1737 2024-03-04T09:17:24.936 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/ds1621 2024-03-04T09:17:24.938 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/ds620 2024-03-04T09:17:24.940 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/emc1403 2024-03-04T09:17:24.942 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/emc2103 2024-03-04T09:17:24.944 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/emc6w201 2024-03-04T09:17:24.946 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/f71805f 2024-03-04T09:17:24.948 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/f71882fg 2024-03-04T09:17:24.951 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/fam15h_power 2024-03-04T09:17:24.953 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/g760a 2024-03-04T09:17:24.955 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/g762 2024-03-04T09:17:24.957 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/gl518sm 2024-03-04T09:17:24.959 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/hih6130 2024-03-04T09:17:24.961 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/htu21 2024-03-04T09:17:24.963 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/hwmon-kernel-api.txt 2024-03-04T09:17:24.966 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/ibmaem 2024-03-04T09:17:24.968 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/ibmpowernv 2024-03-04T09:17:24.970 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/ina209 2024-03-04T09:17:24.973 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/ina2xx 2024-03-04T09:17:24.975 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/it87 2024-03-04T09:17:24.977 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/jc42 2024-03-04T09:17:24.979 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/k10temp 2024-03-04T09:17:24.981 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/k8temp 2024-03-04T09:17:24.984 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/lineage-pem 2024-03-04T09:17:24.986 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/lm25066 2024-03-04T09:17:24.988 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/lm63 2024-03-04T09:17:24.990 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/lm70 2024-03-04T09:17:24.992 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/lm73 2024-03-04T09:17:24.994 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/lm75 2024-03-04T09:17:24.996 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/lm77 2024-03-04T09:17:24.998 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/lm78 2024-03-04T09:17:25.001 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/lm80 2024-03-04T09:17:25.003 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/lm83 2024-03-04T09:17:25.005 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/lm85 2024-03-04T09:17:25.007 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/lm87 2024-03-04T09:17:25.009 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/lm90 2024-03-04T09:17:25.011 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/lm92 2024-03-04T09:17:25.016 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/lm93 2024-03-04T09:17:25.016 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/lm95234 2024-03-04T09:17:25.018 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/lm95245 2024-03-04T09:17:25.020 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/ltc2945 2024-03-04T09:17:25.022 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/ltc2978 2024-03-04T09:17:25.024 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/ltc4151 2024-03-04T09:17:25.026 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/ltc4215 2024-03-04T09:17:25.028 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/ltc4245 2024-03-04T09:17:25.030 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/ltc4260 2024-03-04T09:17:25.032 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/ltc4261 2024-03-04T09:17:25.034 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/max16064 2024-03-04T09:17:25.036 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/max16065 2024-03-04T09:17:25.038 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/max1619 2024-03-04T09:17:25.041 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/max1668 2024-03-04T09:17:25.043 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/max197 2024-03-04T09:17:25.045 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/max34440 2024-03-04T09:17:25.047 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/max6639 2024-03-04T09:17:25.049 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/max6642 2024-03-04T09:17:25.050 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/max6650 2024-03-04T09:17:25.052 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/max6697 2024-03-04T09:17:25.055 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/max8688 2024-03-04T09:17:25.057 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/mc13783-adc 2024-03-04T09:17:25.059 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/mcp3021 2024-03-04T09:17:25.060 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/menf21bmc 2024-03-04T09:17:25.062 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/nct6683 2024-03-04T09:17:25.064 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/nct6775 2024-03-04T09:17:25.067 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/nct7802 2024-03-04T09:17:25.069 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/ntc_thermistor 2024-03-04T09:17:25.072 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/pc87360 2024-03-04T09:17:25.074 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/pc87427 2024-03-04T09:17:25.076 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/pcf8591 2024-03-04T09:17:25.078 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/pmbus 2024-03-04T09:17:25.081 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/pmbus-core 2024-03-04T09:17:25.083 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/powr1220 2024-03-04T09:17:25.085 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/pwm-fan 2024-03-04T09:17:25.087 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/sch5627 2024-03-04T09:17:25.089 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/sch5636 2024-03-04T09:17:25.092 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/sht15 2024-03-04T09:17:25.094 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/sht21 2024-03-04T09:17:25.096 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/shtc1 2024-03-04T09:17:25.098 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/sis5595 2024-03-04T09:17:25.100 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/smm665 2024-03-04T09:17:25.103 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/smsc47b397 2024-03-04T09:17:25.105 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/smsc47m1 2024-03-04T09:17:25.107 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/smsc47m192 2024-03-04T09:17:25.109 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/submitting-patches 2024-03-04T09:17:25.112 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/sysfs-interface 2024-03-04T09:17:25.114 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/thmc50 2024-03-04T09:17:25.116 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/tmp102 2024-03-04T09:17:25.118 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/tmp103 2024-03-04T09:17:25.121 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/tmp401 2024-03-04T09:17:25.123 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/tmp421 2024-03-04T09:17:25.125 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/tps40422 2024-03-04T09:17:25.127 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/twl4030-madc-hwmon 2024-03-04T09:17:25.129 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/ucd9000 2024-03-04T09:17:25.132 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/ucd9200 2024-03-04T09:17:25.134 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/userspace-tools 2024-03-04T09:17:25.136 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/vexpress 2024-03-04T09:17:25.138 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/via686a 2024-03-04T09:17:25.140 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/vt1211 2024-03-04T09:17:25.142 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/w83627ehf 2024-03-04T09:17:25.145 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/w83627hf 2024-03-04T09:17:25.147 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/w83781d 2024-03-04T09:17:25.149 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/w83791d 2024-03-04T09:17:25.151 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/w83792d 2024-03-04T09:17:25.153 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/w83793 2024-03-04T09:17:25.155 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/w83795 2024-03-04T09:17:25.158 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/w83l785ts 2024-03-04T09:17:25.160 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/w83l786ng 2024-03-04T09:17:25.162 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/wm831x 2024-03-04T09:17:25.164 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/wm8350 2024-03-04T09:17:25.166 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwmon/zl6100 2024-03-04T09:17:25.168 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/hwspinlock.txt 2024-03-04T09:17:25.171 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/i2c/ 2024-03-04T09:17:25.173 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/i2c/busses/ 2024-03-04T09:17:25.175 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1535 2024-03-04T09:17:25.178 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1563 2024-03-04T09:17:25.180 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali15x3 2024-03-04T09:17:25.182 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd756 2024-03-04T09:17:25.184 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd8111 2024-03-04T09:17:25.186 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-diolan-u2c 2024-03-04T09:17:25.188 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-i801 2024-03-04T09:17:25.190 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ismt 2024-03-04T09:17:25.192 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-nforce2 2024-03-04T09:17:25.195 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ocores 2024-03-04T09:17:25.197 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport 2024-03-04T09:17:25.199 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport-light 2024-03-04T09:17:25.201 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-pca-isa 2024-03-04T09:17:25.203 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-piix4 2024-03-04T09:17:25.205 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis5595 2024-03-04T09:17:25.207 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis630 2024-03-04T09:17:25.210 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis96x 2024-03-04T09:17:25.212 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-taos-evm 2024-03-04T09:17:25.214 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-via 2024-03-04T09:17:25.216 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-viapro 2024-03-04T09:17:25.219 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/i2c/busses/scx200_acb 2024-03-04T09:17:25.220 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/i2c/dev-interface 2024-03-04T09:17:25.223 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/i2c/fault-codes 2024-03-04T09:17:25.225 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/i2c/functionality 2024-03-04T09:17:25.227 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/i2c/i2c-protocol 2024-03-04T09:17:25.230 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/i2c/i2c-stub 2024-03-04T09:17:25.232 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/i2c/instantiating-devices 2024-03-04T09:17:25.234 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/i2c/muxes/ 2024-03-04T09:17:25.236 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/i2c/muxes/i2c-mux-gpio 2024-03-04T09:17:25.238 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/i2c/old-module-parameters 2024-03-04T09:17:25.240 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/i2c/smbus-protocol 2024-03-04T09:17:25.243 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/i2c/summary 2024-03-04T09:17:25.244 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/i2c/ten-bit-addresses 2024-03-04T09:17:25.247 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/i2c/upgrading-clients 2024-03-04T09:17:25.248 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/i2c/writing-clients 2024-03-04T09:17:25.251 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/i2o/ 2024-03-04T09:17:25.253 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/i2o/README 2024-03-04T09:17:25.255 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/i2o/ioctl 2024-03-04T09:17:25.257 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ia64/ 2024-03-04T09:17:25.259 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ia64/.gitignore 2024-03-04T09:17:25.261 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ia64/IRQ-redir.txt 2024-03-04T09:17:25.263 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ia64/Makefile 2024-03-04T09:17:25.266 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ia64/README 2024-03-04T09:17:25.267 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ia64/aliasing-test.c 2024-03-04T09:17:25.269 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ia64/aliasing.txt 2024-03-04T09:17:25.272 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ia64/efirtc.txt 2024-03-04T09:17:25.274 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ia64/err_inject.txt 2024-03-04T09:17:25.277 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ia64/fsys.txt 2024-03-04T09:17:25.279 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ia64/mca.txt 2024-03-04T09:17:25.282 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ia64/serial.txt 2024-03-04T09:17:25.284 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ia64/xen.txt 2024-03-04T09:17:25.286 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ide/ 2024-03-04T09:17:25.288 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ide/00-INDEX 2024-03-04T09:17:25.290 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-cd.1994-2004 2024-03-04T09:17:25.292 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-floppy.1996-2002 2024-03-04T09:17:25.294 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-tape.1995-2002 2024-03-04T09:17:25.297 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ide/ide-tape.txt 2024-03-04T09:17:25.299 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ide/ide.txt 2024-03-04T09:17:25.301 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ide/warm-plug-howto.txt 2024-03-04T09:17:25.303 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/infiniband/ 2024-03-04T09:17:25.306 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/infiniband/core_locking.txt 2024-03-04T09:17:25.307 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/infiniband/ipoib.txt 2024-03-04T09:17:25.310 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/infiniband/sysfs.txt 2024-03-04T09:17:25.312 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/infiniband/user_mad.txt 2024-03-04T09:17:25.314 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/infiniband/user_verbs.txt 2024-03-04T09:17:25.316 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/init.txt 2024-03-04T09:17:25.319 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/initrd.txt 2024-03-04T09:17:25.322 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/input/ 2024-03-04T09:17:25.324 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/input/alps.txt 2024-03-04T09:17:25.327 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/input/amijoy.txt 2024-03-04T09:17:25.330 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/input/appletouch.txt 2024-03-04T09:17:25.332 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/input/atarikbd.txt 2024-03-04T09:17:25.335 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/input/bcm5974.txt 2024-03-04T09:17:25.337 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/input/cd32.txt 2024-03-04T09:17:25.338 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/input/cma3000_d0x.txt 2024-03-04T09:17:25.341 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/input/cs461x.txt 2024-03-04T09:17:25.343 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/input/edt-ft5x06.txt 2024-03-04T09:17:25.345 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/input/elantech.txt 2024-03-04T09:17:25.348 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/input/event-codes.txt 2024-03-04T09:17:25.350 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/input/ff.txt 2024-03-04T09:17:25.352 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/input/gamepad.txt 2024-03-04T09:17:25.355 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/input/gameport-programming.txt 2024-03-04T09:17:25.356 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/input/gpio-tilt.txt 2024-03-04T09:17:25.359 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/input/iforce-protocol.txt 2024-03-04T09:17:25.361 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/input/input-programming.txt 2024-03-04T09:17:25.363 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/input/input.txt 2024-03-04T09:17:25.365 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/input/interactive.fig 2024-03-04T09:17:25.367 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/input/joystick-api.txt 2024-03-04T09:17:25.370 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/input/joystick-parport.txt 2024-03-04T09:17:25.373 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/input/joystick.txt 2024-03-04T09:17:25.375 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/input/multi-touch-protocol.txt 2024-03-04T09:17:25.378 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/input/notifier.txt 2024-03-04T09:17:25.379 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/input/ntrig.txt 2024-03-04T09:17:25.382 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/input/rotary-encoder.txt 2024-03-04T09:17:25.384 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/input/sentelic.txt 2024-03-04T09:17:25.387 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/input/shape.fig 2024-03-04T09:17:25.389 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/input/walkera0701.txt 2024-03-04T09:17:25.391 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/input/xpad.txt 2024-03-04T09:17:25.394 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/input/yealink.txt 2024-03-04T09:17:25.396 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/intel_txt.txt 2024-03-04T09:17:25.399 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/io-mapping.txt 2024-03-04T09:17:25.400 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/io_ordering.txt 2024-03-04T09:17:25.403 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ioctl/ 2024-03-04T09:17:25.404 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ioctl/00-INDEX 2024-03-04T09:17:25.407 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ioctl/botching-up-ioctls.txt 2024-03-04T09:17:25.409 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ioctl/cdrom.txt 2024-03-04T09:17:25.412 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ioctl/hdio.txt 2024-03-04T09:17:25.414 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ioctl/ioctl-decoding.txt 2024-03-04T09:17:25.417 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ioctl/ioctl-number.txt 2024-03-04T09:17:25.419 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/iostats.txt 2024-03-04T09:17:25.421 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/irqflags-tracing.txt 2024-03-04T09:17:25.423 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/isapnp.txt 2024-03-04T09:17:25.425 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/isdn/ 2024-03-04T09:17:25.428 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/isdn/00-INDEX 2024-03-04T09:17:25.430 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/isdn/CREDITS 2024-03-04T09:17:25.432 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/isdn/HiSax.cert 2024-03-04T09:17:25.434 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/isdn/INTERFACE 2024-03-04T09:17:25.437 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.CAPI 2024-03-04T09:17:25.439 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.fax 2024-03-04T09:17:25.441 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/isdn/README 2024-03-04T09:17:25.444 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/isdn/README.FAQ 2024-03-04T09:17:25.446 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/isdn/README.HiSax 2024-03-04T09:17:25.448 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/isdn/README.act2000 2024-03-04T09:17:25.450 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/isdn/README.audio 2024-03-04T09:17:25.453 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/isdn/README.avmb1 2024-03-04T09:17:25.455 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/isdn/README.concap 2024-03-04T09:17:25.457 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/isdn/README.diversion 2024-03-04T09:17:25.460 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/isdn/README.fax 2024-03-04T09:17:25.462 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/isdn/README.gigaset 2024-03-04T09:17:25.465 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/isdn/README.hfc-pci 2024-03-04T09:17:25.467 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/isdn/README.hysdn 2024-03-04T09:17:25.470 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/isdn/README.icn 2024-03-04T09:17:25.472 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/isdn/README.mISDN 2024-03-04T09:17:25.474 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/isdn/README.pcbit 2024-03-04T09:17:25.476 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/isdn/README.sc 2024-03-04T09:17:25.478 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/isdn/README.syncppp 2024-03-04T09:17:25.480 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/isdn/README.x25 2024-03-04T09:17:25.482 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/isdn/syncPPP.FAQ 2024-03-04T09:17:25.485 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ja_JP/ 2024-03-04T09:17:25.488 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ja_JP/HOWTO 2024-03-04T09:17:25.491 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ja_JP/SubmitChecklist 2024-03-04T09:17:25.493 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ja_JP/SubmittingPatches 2024-03-04T09:17:25.496 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ja_JP/stable_api_nonsense.txt 2024-03-04T09:17:25.499 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ja_JP/stable_kernel_rules.txt 2024-03-04T09:17:25.501 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/java.txt 2024-03-04T09:17:25.504 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/kasan.txt 2024-03-04T09:17:25.506 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/kbuild/ 2024-03-04T09:17:25.508 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/kbuild/00-INDEX 2024-03-04T09:17:25.510 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/kbuild/headers_install.txt 2024-03-04T09:17:25.512 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/kbuild/kbuild.txt 2024-03-04T09:17:25.515 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/kbuild/kconfig-language.txt 2024-03-04T09:17:25.517 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/kbuild/kconfig.txt 2024-03-04T09:17:25.520 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/kbuild/makefiles.txt 2024-03-04T09:17:25.523 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/kbuild/modules.txt 2024-03-04T09:17:25.526 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/kdump/ 2024-03-04T09:17:25.529 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/kdump/gdbmacros.txt 2024-03-04T09:17:25.531 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/kdump/kdump.txt 2024-03-04T09:17:25.533 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/kernel-doc-nano-HOWTO.txt 2024-03-04T09:17:25.536 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/kernel-docs.txt 2024-03-04T09:17:25.539 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/kernel-parameters.txt 2024-03-04T09:17:25.543 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/kernel-per-CPU-kthreads.txt 2024-03-04T09:17:25.546 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/kmemcheck.txt 2024-03-04T09:17:25.549 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/kmemleak.txt 2024-03-04T09:17:25.553 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ko_KR/ 2024-03-04T09:17:25.557 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ko_KR/HOWTO 2024-03-04T09:17:25.561 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ko_KR/stable_api_nonsense.txt 2024-03-04T09:17:25.563 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/kobject.txt 2024-03-04T09:17:25.567 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/kprobes.txt 2024-03-04T09:17:25.570 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/kref.txt 2024-03-04T09:17:25.573 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/kselftest.txt 2024-03-04T09:17:25.575 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/laptops/ 2024-03-04T09:17:25.578 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/laptops/.gitignore 2024-03-04T09:17:25.581 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/laptops/00-INDEX 2024-03-04T09:17:25.584 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/laptops/Makefile 2024-03-04T09:17:25.586 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/laptops/asus-laptop.txt 2024-03-04T09:17:25.589 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/laptops/disk-shock-protection.txt 2024-03-04T09:17:25.592 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/laptops/dslm.c 2024-03-04T09:17:25.595 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/laptops/freefall.c 2024-03-04T09:17:25.597 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/laptops/laptop-mode.txt 2024-03-04T09:17:25.600 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/laptops/sony-laptop.txt 2024-03-04T09:17:25.603 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/laptops/sonypi.txt 2024-03-04T09:17:25.605 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/laptops/thinkpad-acpi.txt 2024-03-04T09:17:25.608 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/laptops/toshiba_haps.txt 2024-03-04T09:17:25.610 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ldm.txt 2024-03-04T09:17:25.613 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/leds/ 2024-03-04T09:17:25.615 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/leds/00-INDEX 2024-03-04T09:17:25.618 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/leds/leds-blinkm.txt 2024-03-04T09:17:25.620 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/leds/leds-class.txt 2024-03-04T09:17:25.622 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/leds/leds-lm3556.txt 2024-03-04T09:17:25.627 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/leds/leds-lp3944.txt 2024-03-04T09:17:25.628 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/leds/leds-lp5521.txt 2024-03-04T09:17:25.630 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/leds/leds-lp5523.txt 2024-03-04T09:17:25.634 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/leds/leds-lp5562.txt 2024-03-04T09:17:25.636 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/leds/leds-lp55xx.txt 2024-03-04T09:17:25.638 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/leds/ledtrig-oneshot.txt 2024-03-04T09:17:25.641 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/leds/ledtrig-transient.txt 2024-03-04T09:17:25.644 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/local_ops.txt 2024-03-04T09:17:25.646 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/locking/ 2024-03-04T09:17:25.649 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/locking/00-INDEX 2024-03-04T09:17:25.651 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/locking/lglock.txt 2024-03-04T09:17:25.654 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/locking/lockdep-design.txt 2024-03-04T09:17:25.656 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/locking/lockstat.txt 2024-03-04T09:17:25.659 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/locking/locktorture.txt 2024-03-04T09:17:25.661 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/locking/mutex-design.txt 2024-03-04T09:17:25.664 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/locking/rt-mutex-design.txt 2024-03-04T09:17:25.667 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/locking/rt-mutex.txt 2024-03-04T09:17:25.669 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/locking/spinlocks.txt 2024-03-04T09:17:25.672 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/locking/ww-mutex-design.txt 2024-03-04T09:17:25.674 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/lockup-watchdogs.txt 2024-03-04T09:17:25.677 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/logo.gif 2024-03-04T09:17:25.679 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/logo.txt 2024-03-04T09:17:25.681 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/lzo.txt 2024-03-04T09:17:25.684 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/m68k/ 2024-03-04T09:17:25.687 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/m68k/00-INDEX 2024-03-04T09:17:25.690 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/m68k/README.buddha 2024-03-04T09:17:25.692 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/m68k/kernel-options.txt 2024-03-04T09:17:25.696 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/magic-number.txt 2024-03-04T09:17:25.698 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/mailbox.txt 2024-03-04T09:17:25.701 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/md.txt 2024-03-04T09:17:25.704 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/media-framework.txt 2024-03-04T09:17:25.706 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/memory-barriers.txt 2024-03-04T09:17:25.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:17:25 smithi082 ceph-mon[32880]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:17:25.819 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/memory-devices/ 2024-03-04T09:17:25.821 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/memory-devices/ti-emif.txt 2024-03-04T09:17:25.823 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/memory-hotplug.txt 2024-03-04T09:17:25.826 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/metag/ 2024-03-04T09:17:25.828 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/metag/00-INDEX 2024-03-04T09:17:25.830 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/metag/kernel-ABI.txt 2024-03-04T09:17:25.833 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/mic/ 2024-03-04T09:17:25.835 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/mic/Makefile 2024-03-04T09:17:25.838 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/mic/mic_overview.txt 2024-03-04T09:17:25.840 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/mic/mpssd/ 2024-03-04T09:17:25.842 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/mic/mpssd/.gitignore 2024-03-04T09:17:25.845 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/mic/mpssd/Makefile 2024-03-04T09:17:25.848 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/mic/mpssd/micctrl 2024-03-04T09:17:25.849 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/mic/mpssd/mpss 2024-03-04T09:17:25.851 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.c 2024-03-04T09:17:25.855 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.h 2024-03-04T09:17:25.857 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/mic/mpssd/sysfs.c 2024-03-04T09:17:25.859 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/mips/ 2024-03-04T09:17:25.862 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/mips/00-INDEX 2024-03-04T09:17:25.864 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/mips/AU1xxx_IDE.README 2024-03-04T09:17:25.866 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/misc-devices/ 2024-03-04T09:17:25.868 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/misc-devices/Makefile 2024-03-04T09:17:25.871 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/misc-devices/ad525x_dpot.txt 2024-03-04T09:17:25.873 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/misc-devices/apds990x.txt 2024-03-04T09:17:25.875 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/misc-devices/bh1770glc.txt 2024-03-04T09:17:25.881 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/misc-devices/c2port.txt 2024-03-04T09:17:25.883 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/misc-devices/eeprom 2024-03-04T09:17:25.885 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/misc-devices/ics932s401 2024-03-04T09:17:25.887 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/misc-devices/isl29003 2024-03-04T09:17:25.889 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/misc-devices/lis3lv02d 2024-03-04T09:17:25.891 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/misc-devices/max6875 2024-03-04T09:17:25.894 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/misc-devices/mei/ 2024-03-04T09:17:25.896 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/misc-devices/mei/.gitignore 2024-03-04T09:17:25.898 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/misc-devices/mei/Makefile 2024-03-04T09:17:25.900 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/misc-devices/mei/TODO 2024-03-04T09:17:25.902 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-amt-version.c 2024-03-04T09:17:25.904 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-client-bus.txt 2024-03-04T09:17:25.907 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei.txt 2024-03-04T09:17:25.909 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/misc-devices/spear-pcie-gadget.txt 2024-03-04T09:17:25.912 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/mmc/ 2024-03-04T09:17:25.914 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/mmc/00-INDEX 2024-03-04T09:17:25.915 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/mmc/mmc-async-req.txt 2024-03-04T09:17:25.918 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-attrs.txt 2024-03-04T09:17:25.920 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-parts.txt 2024-03-04T09:17:25.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:17:25 smithi190 ceph-mon[36341]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:17:25.922 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/mn10300/ 2024-03-04T09:17:25.925 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/mn10300/ABI.txt 2024-03-04T09:17:25.927 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/mn10300/compartmentalisation.txt 2024-03-04T09:17:25.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:17:25 smithi102 ceph-mon[36220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:17:25.930 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/module-signing.txt 2024-03-04T09:17:25.932 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/mono.txt 2024-03-04T09:17:25.934 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/mtd/ 2024-03-04T09:17:25.937 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/mtd/nand/ 2024-03-04T09:17:25.938 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/mtd/nand/pxa3xx-nand.txt 2024-03-04T09:17:25.941 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/mtd/nand_ecc.txt 2024-03-04T09:17:25.944 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/mtd/spi-nor.txt 2024-03-04T09:17:25.946 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/namespaces/ 2024-03-04T09:17:25.949 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/namespaces/compatibility-list.txt 2024-03-04T09:17:25.951 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/namespaces/resource-control.txt 2024-03-04T09:17:25.953 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/netlabel/ 2024-03-04T09:17:25.956 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/netlabel/00-INDEX 2024-03-04T09:17:25.958 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/netlabel/cipso_ipv4.txt 2024-03-04T09:17:25.960 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/netlabel/draft-ietf-cipso-ipsecurity-01.txt 2024-03-04T09:17:25.963 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/netlabel/introduction.txt 2024-03-04T09:17:25.965 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/netlabel/lsm_interface.txt 2024-03-04T09:17:25.967 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/ 2024-03-04T09:17:25.970 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/00-INDEX 2024-03-04T09:17:25.972 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/3c509.txt 2024-03-04T09:17:25.974 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/6pack.txt 2024-03-04T09:17:25.976 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/LICENSE.qla3xxx 2024-03-04T09:17:25.978 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlcnic 2024-03-04T09:17:25.981 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlge 2024-03-04T09:17:25.983 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/Makefile 2024-03-04T09:17:25.985 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/PLIP.txt 2024-03-04T09:17:25.988 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/README.ipw2100 2024-03-04T09:17:25.990 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/README.ipw2200 2024-03-04T09:17:25.992 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/README.sb1000 2024-03-04T09:17:25.995 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/alias.txt 2024-03-04T09:17:25.997 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/altera_tse.txt 2024-03-04T09:17:25.999 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/arcnet-hardware.txt 2024-03-04T09:17:26.003 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/arcnet.txt 2024-03-04T09:17:26.006 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/atm.txt 2024-03-04T09:17:26.008 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/ax25.txt 2024-03-04T09:17:26.010 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/batman-adv.txt 2024-03-04T09:17:26.012 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/baycom.txt 2024-03-04T09:17:26.014 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/bonding.txt 2024-03-04T09:17:26.019 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/bridge.txt 2024-03-04T09:17:26.021 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/caif/ 2024-03-04T09:17:26.023 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/caif/Linux-CAIF.txt 2024-03-04T09:17:26.026 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/caif/README 2024-03-04T09:17:26.028 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/caif/spi_porting.txt 2024-03-04T09:17:26.030 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/can.txt 2024-03-04T09:17:26.034 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/cdc_mbim.txt 2024-03-04T09:17:26.039 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/cops.txt 2024-03-04T09:17:26.040 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/cs89x0.txt 2024-03-04T09:17:26.041 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/cxacru-cf.py 2024-03-04T09:17:26.043 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/cxacru.txt 2024-03-04T09:17:26.045 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/cxgb.txt 2024-03-04T09:17:26.048 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/dccp.txt 2024-03-04T09:17:26.050 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/dctcp.txt 2024-03-04T09:17:26.052 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/de4x5.txt 2024-03-04T09:17:26.055 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/decnet.txt 2024-03-04T09:17:26.057 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/dl2k.txt 2024-03-04T09:17:26.060 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/dm9000.txt 2024-03-04T09:17:26.062 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/dmfe.txt 2024-03-04T09:17:26.064 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/dns_resolver.txt 2024-03-04T09:17:26.066 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/driver.txt 2024-03-04T09:17:26.069 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/e100.txt 2024-03-04T09:17:26.071 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/e1000.txt 2024-03-04T09:17:26.073 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/e1000e.txt 2024-03-04T09:17:26.075 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/eql.txt 2024-03-04T09:17:26.078 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/fib_trie.txt 2024-03-04T09:17:26.080 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/filter.txt 2024-03-04T09:17:26.083 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/fore200e.txt 2024-03-04T09:17:26.085 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/framerelay.txt 2024-03-04T09:17:26.088 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/gen_stats.txt 2024-03-04T09:17:26.090 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/generic-hdlc.txt 2024-03-04T09:17:26.092 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/generic_netlink.txt 2024-03-04T09:17:26.094 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/gianfar.txt 2024-03-04T09:17:26.096 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/i40e.txt 2024-03-04T09:17:26.098 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/i40evf.txt 2024-03-04T09:17:26.100 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/ieee802154.txt 2024-03-04T09:17:26.102 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/igb.txt 2024-03-04T09:17:26.104 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/igbvf.txt 2024-03-04T09:17:26.106 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/ip-sysctl.txt 2024-03-04T09:17:26.110 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/ip_dynaddr.txt 2024-03-04T09:17:26.111 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/ipddp.txt 2024-03-04T09:17:26.114 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/iphase.txt 2024-03-04T09:17:26.116 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/ipsec.txt 2024-03-04T09:17:26.118 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/ipv6.txt 2024-03-04T09:17:26.121 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/ipvlan.txt 2024-03-04T09:17:26.122 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/ipvs-sysctl.txt 2024-03-04T09:17:26.125 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/irda.txt 2024-03-04T09:17:26.126 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/ixgb.txt 2024-03-04T09:17:26.129 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/ixgbe.txt 2024-03-04T09:17:26.131 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/ixgbevf.txt 2024-03-04T09:17:26.133 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/l2tp.txt 2024-03-04T09:17:26.136 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/lapb-module.txt 2024-03-04T09:17:26.138 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/ltpc.txt 2024-03-04T09:17:26.140 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/mac80211-auth-assoc-deauth.txt 2024-03-04T09:17:26.142 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/mac80211-injection.txt 2024-03-04T09:17:26.144 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/ 2024-03-04T09:17:26.146 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/README 2024-03-04T09:17:26.148 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/hostapd.conf 2024-03-04T09:17:26.150 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/wpa_supplicant.conf 2024-03-04T09:17:26.153 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/multiqueue.txt 2024-03-04T09:17:26.155 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/netconsole.txt 2024-03-04T09:17:26.157 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/netdev-FAQ.txt 2024-03-04T09:17:26.159 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/netdev-features.txt 2024-03-04T09:17:26.162 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/netdevices.txt 2024-03-04T09:17:26.164 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/netif-msg.txt 2024-03-04T09:17:26.166 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/netlink_mmap.txt 2024-03-04T09:17:26.169 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/nf_conntrack-sysctl.txt 2024-03-04T09:17:26.171 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/nfc.txt 2024-03-04T09:17:26.173 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/openvswitch.txt 2024-03-04T09:17:26.176 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/operstates.txt 2024-03-04T09:17:26.178 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/packet_mmap.txt 2024-03-04T09:17:26.180 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/phonet.txt 2024-03-04T09:17:26.183 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/phy.txt 2024-03-04T09:17:26.185 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/pktgen.txt 2024-03-04T09:17:26.188 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/policy-routing.txt 2024-03-04T09:17:26.190 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/ppp_generic.txt 2024-03-04T09:17:26.192 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/proc_net_tcp.txt 2024-03-04T09:17:26.194 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/radiotap-headers.txt 2024-03-04T09:17:26.196 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/ray_cs.txt 2024-03-04T09:17:26.198 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/rds.txt 2024-03-04T09:17:26.201 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/regulatory.txt 2024-03-04T09:17:26.203 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/rxrpc.txt 2024-03-04T09:17:26.206 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/s2io.txt 2024-03-04T09:17:26.207 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/scaling.txt 2024-03-04T09:17:26.210 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/sctp.txt 2024-03-04T09:17:26.212 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/secid.txt 2024-03-04T09:17:26.214 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/skfp.txt 2024-03-04T09:17:26.217 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/smc9.txt 2024-03-04T09:17:26.219 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/spider_net.txt 2024-03-04T09:17:26.221 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/stmmac.txt 2024-03-04T09:17:26.224 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/switchdev.txt 2024-03-04T09:17:26.225 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/tc-actions-env-rules.txt 2024-03-04T09:17:26.227 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/tcp-thin.txt 2024-03-04T09:17:26.230 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/tcp.txt 2024-03-04T09:17:26.232 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/team.txt 2024-03-04T09:17:26.234 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/timestamping.txt 2024-03-04T09:17:26.236 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/timestamping/ 2024-03-04T09:17:26.239 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/timestamping/.gitignore 2024-03-04T09:17:26.241 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/timestamping/Makefile 2024-03-04T09:17:26.243 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/timestamping/hwtstamp_config.c 2024-03-04T09:17:26.244 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/timestamping/timestamping.c 2024-03-04T09:17:26.247 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/timestamping/txtimestamp.c 2024-03-04T09:17:26.249 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/tlan.txt 2024-03-04T09:17:26.251 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/tproxy.txt 2024-03-04T09:17:26.254 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/tuntap.txt 2024-03-04T09:17:26.256 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/udplite.txt 2024-03-04T09:17:26.258 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/vortex.txt 2024-03-04T09:17:26.261 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/vxge.txt 2024-03-04T09:17:26.263 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/vxlan.txt 2024-03-04T09:17:26.265 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/x25-iface.txt 2024-03-04T09:17:26.267 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/x25.txt 2024-03-04T09:17:26.269 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/xfrm_proc.txt 2024-03-04T09:17:26.270 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/xfrm_sync.txt 2024-03-04T09:17:26.272 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/xfrm_sysctl.txt 2024-03-04T09:17:26.274 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/networking/z8530drv.txt 2024-03-04T09:17:26.277 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/nfc/ 2024-03-04T09:17:26.279 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/nfc/nfc-hci.txt 2024-03-04T09:17:26.282 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/nfc/nfc-pn544.txt 2024-03-04T09:17:26.284 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/nios2/ 2024-03-04T09:17:26.286 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/nios2/README 2024-03-04T09:17:26.289 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/nommu-mmap.txt 2024-03-04T09:17:26.292 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/numastat.txt 2024-03-04T09:17:26.294 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/oops-tracing.txt 2024-03-04T09:17:26.296 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/padata.txt 2024-03-04T09:17:26.299 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/parisc/ 2024-03-04T09:17:26.301 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/parisc/00-INDEX 2024-03-04T09:17:26.303 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/parisc/debugging 2024-03-04T09:17:26.305 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/parisc/registers 2024-03-04T09:17:26.308 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/parport-lowlevel.txt 2024-03-04T09:17:26.311 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/parport.txt 2024-03-04T09:17:26.313 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/pcmcia/ 2024-03-04T09:17:26.315 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/pcmcia/.gitignore 2024-03-04T09:17:26.317 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/pcmcia/Makefile 2024-03-04T09:17:26.319 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/pcmcia/crc32hash.c 2024-03-04T09:17:26.321 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/pcmcia/devicetable.txt 2024-03-04T09:17:26.323 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/pcmcia/driver-changes.txt 2024-03-04T09:17:26.325 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/pcmcia/driver.txt 2024-03-04T09:17:26.327 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/pcmcia/locking.txt 2024-03-04T09:17:26.329 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/percpu-rw-semaphore.txt 2024-03-04T09:17:26.332 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/phy.txt 2024-03-04T09:17:26.334 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/phy/ 2024-03-04T09:17:26.336 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/phy/samsung-usb2.txt 2024-03-04T09:17:26.338 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/pi-futex.txt 2024-03-04T09:17:26.340 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/pinctrl.txt 2024-03-04T09:17:26.344 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/platform/ 2024-03-04T09:17:26.345 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/platform/x86-laptop-drivers.txt 2024-03-04T09:17:26.348 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/pnp.txt 2024-03-04T09:17:26.351 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/power/ 2024-03-04T09:17:26.352 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/power/00-INDEX 2024-03-04T09:17:26.354 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/power/apm-acpi.txt 2024-03-04T09:17:26.356 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/power/basic-pm-debugging.txt 2024-03-04T09:17:26.359 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/power/charger-manager.txt 2024-03-04T09:17:26.361 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/power/devices.txt 2024-03-04T09:17:26.364 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/power/drivers-testing.txt 2024-03-04T09:17:26.366 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/power/freezing-of-tasks.txt 2024-03-04T09:17:26.369 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/power/interface.txt 2024-03-04T09:17:26.371 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/power/notifiers.txt 2024-03-04T09:17:26.373 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/power/opp.txt 2024-03-04T09:17:26.375 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/power/pci.txt 2024-03-04T09:17:26.378 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/power/pm_qos_interface.txt 2024-03-04T09:17:26.381 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/power/power_supply_class.txt 2024-03-04T09:17:26.383 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/power/powercap/ 2024-03-04T09:17:26.385 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/power/powercap/powercap.txt 2024-03-04T09:17:26.387 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/power/regulator/ 2024-03-04T09:17:26.389 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/power/regulator/consumer.txt 2024-03-04T09:17:26.391 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/power/regulator/design.txt 2024-03-04T09:17:26.393 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/power/regulator/machine.txt 2024-03-04T09:17:26.396 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/power/regulator/overview.txt 2024-03-04T09:17:26.398 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/power/regulator/regulator.txt 2024-03-04T09:17:26.400 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/power/runtime_pm.txt 2024-03-04T09:17:26.404 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/power/s2ram.txt 2024-03-04T09:17:26.406 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/power/states.txt 2024-03-04T09:17:26.408 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/power/suspend-and-cpuhotplug.txt 2024-03-04T09:17:26.411 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/power/suspend-and-interrupts.txt 2024-03-04T09:17:26.413 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/power/swsusp-and-swap-files.txt 2024-03-04T09:17:26.415 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/power/swsusp-dmcrypt.txt 2024-03-04T09:17:26.417 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/power/swsusp.txt 2024-03-04T09:17:26.419 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/power/tricks.txt 2024-03-04T09:17:26.421 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/power/userland-swsusp.txt 2024-03-04T09:17:26.424 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/power/video.txt 2024-03-04T09:17:26.426 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/powerpc/ 2024-03-04T09:17:26.428 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/powerpc/00-INDEX 2024-03-04T09:17:26.430 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/powerpc/bootwrapper.txt 2024-03-04T09:17:26.432 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/powerpc/cpu_families.txt 2024-03-04T09:17:26.435 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/powerpc/cpu_features.txt 2024-03-04T09:17:26.437 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/powerpc/cxl.txt 2024-03-04T09:17:26.439 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/powerpc/eeh-pci-error-recovery.txt 2024-03-04T09:17:26.442 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/powerpc/firmware-assisted-dump.txt 2024-03-04T09:17:26.444 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/powerpc/hvcs.txt 2024-03-04T09:17:26.447 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/powerpc/mpc52xx.txt 2024-03-04T09:17:26.451 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/powerpc/pmu-ebb.txt 2024-03-04T09:17:26.452 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/powerpc/ptrace.txt 2024-03-04T09:17:26.453 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/powerpc/qe_firmware.txt 2024-03-04T09:17:26.456 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/powerpc/transactional_memory.txt 2024-03-04T09:17:26.458 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/pps/ 2024-03-04T09:17:26.460 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/pps/pps.txt 2024-03-04T09:17:26.463 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/prctl/ 2024-03-04T09:17:26.465 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/prctl/.gitignore 2024-03-04T09:17:26.467 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/prctl/Makefile 2024-03-04T09:17:26.470 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-ctxt-sw-stress-test.c 2024-03-04T09:17:26.472 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-on-off-stress-test.c 2024-03-04T09:17:26.474 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-test.c 2024-03-04T09:17:26.476 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/prctl/no_new_privs.txt 2024-03-04T09:17:26.478 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/prctl/seccomp_filter.txt 2024-03-04T09:17:26.481 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/preempt-locking.txt 2024-03-04T09:17:26.483 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/printk-formats.txt 2024-03-04T09:17:26.485 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/pti/ 2024-03-04T09:17:26.488 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/pti/pti_intel_mid.txt 2024-03-04T09:17:26.490 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ptp/ 2024-03-04T09:17:26.493 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ptp/.gitignore 2024-03-04T09:17:26.495 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ptp/Makefile 2024-03-04T09:17:26.497 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ptp/ptp.txt 2024-03-04T09:17:26.499 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ptp/testptp.c 2024-03-04T09:17:26.502 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ptp/testptp.mk 2024-03-04T09:17:26.504 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/pwm.txt 2024-03-04T09:17:26.507 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/ramoops.txt 2024-03-04T09:17:26.509 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/rapidio/ 2024-03-04T09:17:26.510 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/rapidio/rapidio.txt 2024-03-04T09:17:26.513 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/rapidio/sysfs.txt 2024-03-04T09:17:26.515 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/rapidio/tsi721.txt 2024-03-04T09:17:26.517 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/rbtree.txt 2024-03-04T09:17:26.520 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/remoteproc.txt 2024-03-04T09:17:26.522 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/rfkill.txt 2024-03-04T09:17:26.524 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/robust-futex-ABI.txt 2024-03-04T09:17:26.526 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/robust-futexes.txt 2024-03-04T09:17:26.529 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/rpmsg.txt 2024-03-04T09:17:26.531 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/rtc.txt 2024-03-04T09:17:26.533 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/s390/ 2024-03-04T09:17:26.535 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/s390/00-INDEX 2024-03-04T09:17:26.538 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/s390/3270.ChangeLog 2024-03-04T09:17:26.540 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/s390/3270.txt 2024-03-04T09:17:26.542 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/s390/CommonIO 2024-03-04T09:17:26.545 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/s390/DASD 2024-03-04T09:17:26.547 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/s390/Debugging390.txt 2024-03-04T09:17:26.551 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/s390/cds.txt 2024-03-04T09:17:26.553 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/s390/config3270.sh 2024-03-04T09:17:26.554 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/s390/driver-model.txt 2024-03-04T09:17:26.557 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/s390/kvm.txt 2024-03-04T09:17:26.560 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/s390/monreader.txt 2024-03-04T09:17:26.562 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/s390/qeth.txt 2024-03-04T09:17:26.564 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/s390/s390dbf.txt 2024-03-04T09:17:26.567 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/s390/zfcpdump.txt 2024-03-04T09:17:26.569 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scheduler/ 2024-03-04T09:17:26.571 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scheduler/00-INDEX 2024-03-04T09:17:26.573 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scheduler/completion.txt 2024-03-04T09:17:26.575 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scheduler/sched-arch.txt 2024-03-04T09:17:26.577 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scheduler/sched-bwc.txt 2024-03-04T09:17:26.580 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scheduler/sched-deadline.txt 2024-03-04T09:17:26.582 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scheduler/sched-design-CFS.txt 2024-03-04T09:17:26.585 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scheduler/sched-domains.txt 2024-03-04T09:17:26.587 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scheduler/sched-nice-design.txt 2024-03-04T09:17:26.589 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scheduler/sched-rt-group.txt 2024-03-04T09:17:26.591 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scheduler/sched-stats.txt 2024-03-04T09:17:26.593 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/ 2024-03-04T09:17:26.596 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/00-INDEX 2024-03-04T09:17:26.597 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/53c700.txt 2024-03-04T09:17:26.600 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/BusLogic.txt 2024-03-04T09:17:26.603 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.1992-1997 2024-03-04T09:17:26.606 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.arcmsr 2024-03-04T09:17:26.607 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ips 2024-03-04T09:17:26.610 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.lpfc 2024-03-04T09:17:26.613 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid 2024-03-04T09:17:26.615 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid_sas 2024-03-04T09:17:26.618 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ncr53c8xx 2024-03-04T09:17:26.620 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx 2024-03-04T09:17:26.623 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx_2 2024-03-04T09:17:26.625 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/FlashPoint.txt 2024-03-04T09:17:26.627 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/LICENSE.FlashPoint 2024-03-04T09:17:26.629 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla2xxx 2024-03-04T09:17:26.632 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla4xxx 2024-03-04T09:17:26.634 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/Mylex.txt 2024-03-04T09:17:26.636 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/NinjaSCSI.txt 2024-03-04T09:17:26.638 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/aacraid.txt 2024-03-04T09:17:26.640 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/advansys.txt 2024-03-04T09:17:26.643 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/aha152x.txt 2024-03-04T09:17:26.645 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/aic79xx.txt 2024-03-04T09:17:26.647 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/aic7xxx.txt 2024-03-04T09:17:26.650 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/arcmsr_spec.txt 2024-03-04T09:17:26.652 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/bfa.txt 2024-03-04T09:17:26.655 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/bnx2fc.txt 2024-03-04T09:17:26.660 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/cxgb3i.txt 2024-03-04T09:17:26.660 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/dc395x.txt 2024-03-04T09:17:26.661 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/dpti.txt 2024-03-04T09:17:26.664 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/dtc3x80.txt 2024-03-04T09:17:26.666 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/g_NCR5380.txt 2024-03-04T09:17:26.668 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/hpsa.txt 2024-03-04T09:17:26.670 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/hptiop.txt 2024-03-04T09:17:26.672 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/in2000.txt 2024-03-04T09:17:26.674 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/libsas.txt 2024-03-04T09:17:26.677 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/link_power_management_policy.txt 2024-03-04T09:17:26.678 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/lpfc.txt 2024-03-04T09:17:26.680 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/megaraid.txt 2024-03-04T09:17:26.683 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/ncr53c8xx.txt 2024-03-04T09:17:26.686 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/osd.txt 2024-03-04T09:17:26.688 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/osst.txt 2024-03-04T09:17:26.690 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/ppa.txt 2024-03-04T09:17:26.693 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/qlogicfas.txt 2024-03-04T09:17:26.695 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/scsi-changer.txt 2024-03-04T09:17:26.697 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/scsi-generic.txt 2024-03-04T09:17:26.700 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/scsi-parameters.txt 2024-03-04T09:17:26.702 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/scsi.txt 2024-03-04T09:17:26.704 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/scsi_eh.txt 2024-03-04T09:17:26.707 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/scsi_fc_transport.txt 2024-03-04T09:17:26.709 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/scsi_mid_low_api.txt 2024-03-04T09:17:26.712 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/ 2024-03-04T09:17:26.714 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/Makefile 2024-03-04T09:17:26.716 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/rport_state_diagram.dot 2024-03-04T09:17:26.718 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/st.txt 2024-03-04T09:17:26.722 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/sym53c500_cs.txt 2024-03-04T09:17:26.724 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/sym53c8xx_2.txt 2024-03-04T09:17:26.727 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/tmscsim.txt 2024-03-04T09:17:26.729 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/ufs.txt 2024-03-04T09:17:26.732 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/scsi/wd719x.txt 2024-03-04T09:17:26.734 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/security/ 2024-03-04T09:17:26.737 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/security/00-INDEX 2024-03-04T09:17:26.739 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/security/IMA-templates.txt 2024-03-04T09:17:26.741 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/security/LSM.txt 2024-03-04T09:17:26.743 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/security/SELinux.txt 2024-03-04T09:17:26.745 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/security/Smack.txt 2024-03-04T09:17:26.748 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/security/Yama.txt 2024-03-04T09:17:26.750 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/security/apparmor.txt 2024-03-04T09:17:26.753 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/security/credentials.txt 2024-03-04T09:17:26.756 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/security/keys-ecryptfs.txt 2024-03-04T09:17:26.758 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/security/keys-request-key.txt 2024-03-04T09:17:26.761 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/security/keys-trusted-encrypted.txt 2024-03-04T09:17:26.763 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/security/keys.txt 2024-03-04T09:17:26.767 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/security/tomoyo.txt 2024-03-04T09:17:26.769 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/serial-console.txt 2024-03-04T09:17:26.772 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/serial/ 2024-03-04T09:17:26.773 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/serial/00-INDEX 2024-03-04T09:17:26.776 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/serial/README.cycladesZ 2024-03-04T09:17:26.777 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/serial/driver 2024-03-04T09:17:26.780 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/serial/moxa-smartio 2024-03-04T09:17:26.783 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/serial/n_gsm.txt 2024-03-04T09:17:26.785 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/serial/rocket.txt 2024-03-04T09:17:26.788 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/serial/serial-rs485.txt 2024-03-04T09:17:26.790 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/serial/tty.txt 2024-03-04T09:17:26.792 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sgi-ioc4.txt 2024-03-04T09:17:26.795 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sh/ 2024-03-04T09:17:26.797 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sh/new-machine.txt 2024-03-04T09:17:26.799 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sh/register-banks.txt 2024-03-04T09:17:26.801 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/smsc_ece1099.txt 2024-03-04T09:17:26.804 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/ 2024-03-04T09:17:26.806 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/alsa/ 2024-03-04T09:17:26.808 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/alsa/ALSA-Configuration.txt 2024-03-04T09:17:26.812 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/alsa/Audigy-mixer.txt 2024-03-04T09:17:26.815 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/alsa/Audiophile-Usb.txt 2024-03-04T09:17:26.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:17:26 smithi082 ceph-mon[32880]: pgmap v56: 129 pgs: 129 active+clean; 100 MiB data, 654 MiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 1.3 MiB/s wr, 204 op/s 2024-03-04T09:17:26.817 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/alsa/Bt87x.txt 2024-03-04T09:17:26.819 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/alsa/CMIPCI.txt 2024-03-04T09:17:26.821 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/alsa/Channel-Mapping-API.txt 2024-03-04T09:17:26.824 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/alsa/ControlNames.txt 2024-03-04T09:17:26.826 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Controls.txt 2024-03-04T09:17:26.828 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Models.txt 2024-03-04T09:17:26.831 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio.txt 2024-03-04T09:17:26.834 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/alsa/Joystick.txt 2024-03-04T09:17:26.836 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/alsa/MIXART.txt 2024-03-04T09:17:26.838 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/alsa/OSS-Emulation.txt 2024-03-04T09:17:26.840 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/alsa/Procfile.txt 2024-03-04T09:17:26.843 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/alsa/README.maya44 2024-03-04T09:17:26.845 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/alsa/SB-Live-mixer.txt 2024-03-04T09:17:26.848 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/alsa/VIA82xx-mixer.txt 2024-03-04T09:17:26.850 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/alsa/alsa-parameters.txt 2024-03-04T09:17:26.852 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/alsa/compress_offload.txt 2024-03-04T09:17:26.854 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/alsa/emu10k1-jack.txt 2024-03-04T09:17:26.856 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/alsa/hda_codec.txt 2024-03-04T09:17:26.859 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/alsa/hdspm.txt 2024-03-04T09:17:26.861 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/alsa/powersave.txt 2024-03-04T09:17:26.863 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/alsa/seq_oss.html 2024-03-04T09:17:26.866 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/alsa/serial-u16550.txt 2024-03-04T09:17:26.870 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/alsa/soc/ 2024-03-04T09:17:26.870 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DAI.txt 2024-03-04T09:17:26.872 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DPCM.txt 2024-03-04T09:17:26.874 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/alsa/soc/clocking.txt 2024-03-04T09:17:26.877 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/alsa/soc/codec.txt 2024-03-04T09:17:26.879 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/alsa/soc/dapm.txt 2024-03-04T09:17:26.898 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/alsa/soc/jack.txt 2024-03-04T09:17:26.900 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/alsa/soc/machine.txt 2024-03-04T09:17:26.904 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/alsa/soc/overview.txt 2024-03-04T09:17:26.905 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/alsa/soc/platform.txt 2024-03-04T09:17:26.908 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/alsa/soc/pops_clicks.txt 2024-03-04T09:17:26.910 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/oss/ 2024-03-04T09:17:26.913 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/oss/ALS 2024-03-04T09:17:26.916 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/oss/AudioExcelDSP16 2024-03-04T09:17:26.918 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/oss/CMI8330 2024-03-04T09:17:26.920 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/oss/ESS 2024-03-04T09:17:26.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:17:26 smithi190 ceph-mon[36341]: pgmap v56: 129 pgs: 129 active+clean; 100 MiB data, 654 MiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 1.3 MiB/s wr, 204 op/s 2024-03-04T09:17:26.922 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/oss/ESS1868 2024-03-04T09:17:26.924 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/oss/Introduction 2024-03-04T09:17:26.927 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/oss/MultiSound 2024-03-04T09:17:26.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:17:26 smithi102 ceph-mon[36220]: pgmap v56: 129 pgs: 129 active+clean; 100 MiB data, 654 MiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 1.3 MiB/s wr, 204 op/s 2024-03-04T09:17:26.930 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/oss/OPL3 2024-03-04T09:17:26.932 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/oss/Opti 2024-03-04T09:17:26.935 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/oss/PAS16 2024-03-04T09:17:26.937 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/oss/PSS 2024-03-04T09:17:26.939 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/oss/PSS-updates 2024-03-04T09:17:26.942 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/oss/README.OSS 2024-03-04T09:17:26.945 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/oss/README.modules 2024-03-04T09:17:26.948 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/oss/README.ymfsb 2024-03-04T09:17:26.950 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/oss/SoundPro 2024-03-04T09:17:26.953 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/oss/Soundblaster 2024-03-04T09:17:26.955 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/oss/Tropez+ 2024-03-04T09:17:26.957 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/oss/VIBRA16 2024-03-04T09:17:26.960 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/oss/WaveArtist 2024-03-04T09:17:26.963 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/oss/btaudio 2024-03-04T09:17:26.965 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/oss/mwave 2024-03-04T09:17:26.967 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/oss/oss-parameters.txt 2024-03-04T09:17:26.969 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sound/oss/ultrasound 2024-03-04T09:17:26.971 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sparse.txt 2024-03-04T09:17:26.975 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/spi/ 2024-03-04T09:17:26.976 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/spi/.gitignore 2024-03-04T09:17:26.978 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/spi/00-INDEX 2024-03-04T09:17:26.981 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/spi/Makefile 2024-03-04T09:17:26.983 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/spi/butterfly 2024-03-04T09:17:26.985 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/spi/ep93xx_spi 2024-03-04T09:17:26.988 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/spi/pxa2xx 2024-03-04T09:17:26.990 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/spi/spi-lm70llp 2024-03-04T09:17:26.992 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/spi/spi-sc18is602 2024-03-04T09:17:26.994 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/spi/spi-summary 2024-03-04T09:17:26.998 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/spi/spidev 2024-03-04T09:17:27.000 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/spi/spidev_fdx.c 2024-03-04T09:17:27.002 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/spi/spidev_test.c 2024-03-04T09:17:27.004 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/stable_api_nonsense.txt 2024-03-04T09:17:27.007 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/stable_kernel_rules.txt 2024-03-04T09:17:27.008 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/static-keys.txt 2024-03-04T09:17:27.011 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/svga.txt 2024-03-04T09:17:27.013 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sysctl/ 2024-03-04T09:17:27.015 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sysctl/00-INDEX 2024-03-04T09:17:27.018 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sysctl/README 2024-03-04T09:17:27.020 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sysctl/abi.txt 2024-03-04T09:17:27.022 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sysctl/fs.txt 2024-03-04T09:17:27.024 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sysctl/kernel.txt 2024-03-04T09:17:27.027 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sysctl/net.txt 2024-03-04T09:17:27.030 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sysctl/sunrpc.txt 2024-03-04T09:17:27.031 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sysctl/vm.txt 2024-03-04T09:17:27.034 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sysfs-rules.txt 2024-03-04T09:17:27.037 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/sysrq.txt 2024-03-04T09:17:27.040 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/target/ 2024-03-04T09:17:27.042 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.py 2024-03-04T09:17:27.045 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.txt 2024-03-04T09:17:27.048 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/target/tcmu-design.txt 2024-03-04T09:17:27.050 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/thermal/ 2024-03-04T09:17:27.053 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/thermal/cpu-cooling-api.txt 2024-03-04T09:17:27.055 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal 2024-03-04T09:17:27.057 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal_emulation 2024-03-04T09:17:27.059 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/thermal/intel_powerclamp.txt 2024-03-04T09:17:27.061 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/thermal/nouveau_thermal 2024-03-04T09:17:27.063 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/thermal/sysfs-api.txt 2024-03-04T09:17:27.066 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/thermal/x86_pkg_temperature_thermal 2024-03-04T09:17:27.068 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/this_cpu_ops.txt 2024-03-04T09:17:27.071 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/timers/ 2024-03-04T09:17:27.252 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/timers/.gitignore 2024-03-04T09:17:27.255 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/timers/00-INDEX 2024-03-04T09:17:27.257 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/timers/Makefile 2024-03-04T09:17:27.259 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/timers/NO_HZ.txt 2024-03-04T09:17:27.262 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/timers/highres.txt 2024-03-04T09:17:27.268 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/timers/hpet.txt 2024-03-04T09:17:27.268 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/timers/hpet_example.c 2024-03-04T09:17:27.268 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/timers/hrtimers.txt 2024-03-04T09:17:27.270 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/timers/timekeeping.txt 2024-03-04T09:17:27.273 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/timers/timer_stats.txt 2024-03-04T09:17:27.275 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/timers/timers-howto.txt 2024-03-04T09:17:27.277 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/tpm/ 2024-03-04T09:17:27.279 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/tpm/xen-tpmfront.txt 2024-03-04T09:17:27.281 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/trace/ 2024-03-04T09:17:27.284 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/trace/coresight.txt 2024-03-04T09:17:27.286 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/trace/events-kmem.txt 2024-03-04T09:17:27.288 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/trace/events-nmi.txt 2024-03-04T09:17:27.290 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/trace/events-power.txt 2024-03-04T09:17:27.292 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/trace/events.txt 2024-03-04T09:17:27.295 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/trace/ftrace-design.txt 2024-03-04T09:17:27.298 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/trace/ftrace.txt 2024-03-04T09:17:27.302 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/trace/function-graph-fold.vim 2024-03-04T09:17:27.303 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/trace/kprobetrace.txt 2024-03-04T09:17:27.306 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/trace/mmiotrace.txt 2024-03-04T09:17:27.308 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/trace/postprocess/ 2024-03-04T09:17:27.311 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-pagealloc-postprocess.pl 2024-03-04T09:17:27.313 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-vmscan-postprocess.pl 2024-03-04T09:17:27.316 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/trace/ring-buffer-design.txt 2024-03-04T09:17:27.319 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/trace/tracepoint-analysis.txt 2024-03-04T09:17:27.321 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/trace/tracepoints.txt 2024-03-04T09:17:27.324 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/trace/uprobetracer.txt 2024-03-04T09:17:27.326 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/unaligned-memory-access.txt 2024-03-04T09:17:27.329 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/unicode.txt 2024-03-04T09:17:27.331 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/unshare.txt 2024-03-04T09:17:27.333 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/usb/ 2024-03-04T09:17:27.335 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/usb/CREDITS 2024-03-04T09:17:27.337 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/usb/URB.txt 2024-03-04T09:17:27.339 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/usb/WUSB-Design-overview.txt 2024-03-04T09:17:27.341 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/usb/acm.txt 2024-03-04T09:17:27.344 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/usb/anchors.txt 2024-03-04T09:17:27.346 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/usb/authorization.txt 2024-03-04T09:17:27.348 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/usb/bulk-streams.txt 2024-03-04T09:17:27.350 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/usb/callbacks.txt 2024-03-04T09:17:27.352 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/usb/chipidea.txt 2024-03-04T09:17:27.354 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/usb/dma.txt 2024-03-04T09:17:27.357 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/usb/dwc3.txt 2024-03-04T09:17:27.359 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/usb/ehci.txt 2024-03-04T09:17:27.361 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/usb/error-codes.txt 2024-03-04T09:17:27.364 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/usb/functionfs.txt 2024-03-04T09:17:27.365 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/usb/gadget-testing.txt 2024-03-04T09:17:27.368 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/usb/gadget_configfs.txt 2024-03-04T09:17:27.370 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/usb/gadget_hid.txt 2024-03-04T09:17:27.373 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/usb/gadget_multi.txt 2024-03-04T09:17:27.375 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/usb/gadget_printer.txt 2024-03-04T09:17:27.378 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/usb/gadget_serial.txt 2024-03-04T09:17:27.380 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/usb/hotplug.txt 2024-03-04T09:17:27.382 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/usb/iuu_phoenix.txt 2024-03-04T09:17:27.384 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/usb/linux-cdc-acm.inf 2024-03-04T09:17:27.386 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/usb/linux.inf 2024-03-04T09:17:27.388 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/usb/mass-storage.txt 2024-03-04T09:17:27.390 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/usb/misc_usbsevseg.txt 2024-03-04T09:17:27.392 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/usb/mtouchusb.txt 2024-03-04T09:17:27.394 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/usb/ohci.txt 2024-03-04T09:17:27.396 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/usb/persist.txt 2024-03-04T09:17:27.398 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/usb/power-management.txt 2024-03-04T09:17:27.401 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/usb/proc_usb_info.txt 2024-03-04T09:17:27.403 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/usb/rio.txt 2024-03-04T09:17:27.405 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/usb/usb-help.txt 2024-03-04T09:17:27.407 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/usb/usb-serial.txt 2024-03-04T09:17:27.410 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/usb/usbmon.txt 2024-03-04T09:17:27.412 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/usb/wusb-cbaf 2024-03-04T09:17:27.414 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/vDSO/ 2024-03-04T09:17:27.417 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/vDSO/.gitignore 2024-03-04T09:17:27.419 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/vDSO/Makefile 2024-03-04T09:17:27.420 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/vDSO/parse_vdso.c 2024-03-04T09:17:27.423 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/vDSO/vdso_standalone_test_x86.c 2024-03-04T09:17:27.425 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/vDSO/vdso_test.c 2024-03-04T09:17:27.427 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/vfio.txt 2024-03-04T09:17:27.430 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/vgaarbiter.txt 2024-03-04T09:17:27.433 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video-output.txt 2024-03-04T09:17:27.434 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/ 2024-03-04T09:17:27.437 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/4CCs.txt 2024-03-04T09:17:27.439 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/API.html 2024-03-04T09:17:27.441 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.au0828 2024-03-04T09:17:27.443 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.bttv 2024-03-04T09:17:27.445 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx23885 2024-03-04T09:17:27.447 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx88 2024-03-04T09:17:27.449 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.em28xx 2024-03-04T09:17:27.451 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.ivtv 2024-03-04T09:17:27.453 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7134 2024-03-04T09:17:27.455 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7164 2024-03-04T09:17:27.458 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tm6000 2024-03-04T09:17:27.460 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tuner 2024-03-04T09:17:27.462 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.usbvision 2024-03-04T09:17:27.465 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/Makefile 2024-03-04T09:17:27.467 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/README.cpia2 2024-03-04T09:17:27.471 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/README.cx88 2024-03-04T09:17:27.472 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/README.davinci-vpbe 2024-03-04T09:17:27.473 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/README.ir 2024-03-04T09:17:27.476 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/README.ivtv 2024-03-04T09:17:27.478 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/README.pvrusb2 2024-03-04T09:17:27.480 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/README.saa7134 2024-03-04T09:17:27.482 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/Zoran 2024-03-04T09:17:27.485 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/bttv/ 2024-03-04T09:17:27.487 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/bttv/CONTRIBUTORS 2024-03-04T09:17:27.488 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/bttv/Cards 2024-03-04T09:17:27.491 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/bttv/ICs 2024-03-04T09:17:27.493 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/bttv/Insmod-options 2024-03-04T09:17:27.496 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/bttv/MAKEDEV 2024-03-04T09:17:27.498 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modprobe.conf 2024-03-04T09:17:27.500 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modules.conf 2024-03-04T09:17:27.502 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/bttv/PROBLEMS 2024-03-04T09:17:27.504 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/bttv/README 2024-03-04T09:17:27.506 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.WINVIEW 2024-03-04T09:17:27.508 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.freeze 2024-03-04T09:17:27.511 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.quirks 2024-03-04T09:17:27.512 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/bttv/Sound-FAQ 2024-03-04T09:17:27.515 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/bttv/Specs 2024-03-04T09:17:27.516 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/bttv/THANKS 2024-03-04T09:17:27.519 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/bttv/Tuners 2024-03-04T09:17:27.521 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/cafe_ccic 2024-03-04T09:17:27.524 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/cpia2_overview.txt 2024-03-04T09:17:27.526 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/cx18.txt 2024-03-04T09:17:27.528 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/ 2024-03-04T09:17:27.530 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.hm12 2024-03-04T09:17:27.533 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.vbi 2024-03-04T09:17:27.535 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-calling.txt 2024-03-04T09:17:27.537 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-api.txt 2024-03-04T09:17:27.539 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-regs.txt 2024-03-04T09:17:27.542 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-dma.txt 2024-03-04T09:17:27.544 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-encoder-api.txt 2024-03-04T09:17:27.546 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-memory.txt 2024-03-04T09:17:27.549 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-osd-api.txt 2024-03-04T09:17:27.551 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-upload.txt 2024-03-04T09:17:27.553 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/cx88/ 2024-03-04T09:17:27.556 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/cx88/hauppauge-wintv-cx88-ir.txt 2024-03-04T09:17:27.560 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/extract_xc3028.pl 2024-03-04T09:17:27.562 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/fimc.txt 2024-03-04T09:17:27.564 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/gspca.txt 2024-03-04T09:17:27.566 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/hauppauge-wintv-cx88-ir.txt 2024-03-04T09:17:27.568 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/lifeview.txt 2024-03-04T09:17:27.570 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/meye.txt 2024-03-04T09:17:27.573 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/not-in-cx2388x-datasheet.txt 2024-03-04T09:17:27.575 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/omap3isp.txt 2024-03-04T09:17:27.577 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/omap4_camera.txt 2024-03-04T09:17:27.579 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/pxa_camera.txt 2024-03-04T09:17:27.581 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/radiotrack.txt 2024-03-04T09:17:27.584 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/sh_mobile_ceu_camera.txt 2024-03-04T09:17:27.585 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/si470x.txt 2024-03-04T09:17:27.588 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/si4713.txt 2024-03-04T09:17:27.590 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/si476x.txt 2024-03-04T09:17:27.592 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/soc-camera.txt 2024-03-04T09:17:27.594 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/uvcvideo.txt 2024-03-04T09:17:27.596 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/v4l2-controls.txt 2024-03-04T09:17:27.599 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/v4l2-framework.txt 2024-03-04T09:17:27.603 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/v4l2-pci-skeleton.c 2024-03-04T09:17:27.605 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/videobuf 2024-03-04T09:17:27.608 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/vivid.txt 2024-03-04T09:17:27.612 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/video4linux/zr364xx.txt 2024-03-04T09:17:27.613 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/virtual/ 2024-03-04T09:17:27.616 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/virtual/00-INDEX 2024-03-04T09:17:27.618 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/virtual/kvm/ 2024-03-04T09:17:27.619 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/virtual/kvm/00-INDEX 2024-03-04T09:17:27.621 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/virtual/kvm/api.txt 2024-03-04T09:17:27.625 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/virtual/kvm/cpuid.txt 2024-03-04T09:17:27.627 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/ 2024-03-04T09:17:27.629 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/README 2024-03-04T09:17:27.632 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/arm-vgic.txt 2024-03-04T09:17:27.634 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/mpic.txt 2024-03-04T09:17:27.636 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/s390_flic.txt 2024-03-04T09:17:27.638 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vfio.txt 2024-03-04T09:17:27.641 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vm.txt 2024-03-04T09:17:27.643 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/xics.txt 2024-03-04T09:17:27.645 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/virtual/kvm/hypercalls.txt 2024-03-04T09:17:27.648 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/virtual/kvm/locking.txt 2024-03-04T09:17:27.650 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/virtual/kvm/mmu.txt 2024-03-04T09:17:27.653 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/virtual/kvm/msr.txt 2024-03-04T09:17:27.655 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/virtual/kvm/nested-vmx.txt 2024-03-04T09:17:27.657 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/virtual/kvm/ppc-pv.txt 2024-03-04T09:17:27.659 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/virtual/kvm/review-checklist.txt 2024-03-04T09:17:27.661 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/virtual/kvm/s390-diag.txt 2024-03-04T09:17:27.664 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/virtual/kvm/timekeeping.txt 2024-03-04T09:17:27.666 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/virtual/paravirt_ops.txt 2024-03-04T09:17:27.669 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/virtual/uml/ 2024-03-04T09:17:27.671 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/virtual/uml/UserModeLinux-HOWTO.txt 2024-03-04T09:17:27.676 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/vm/ 2024-03-04T09:17:27.680 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/vm/.gitignore 2024-03-04T09:17:27.682 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/vm/00-INDEX 2024-03-04T09:17:27.684 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/vm/active_mm.txt 2024-03-04T09:17:27.686 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/vm/balance 2024-03-04T09:17:27.688 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/vm/cleancache.txt 2024-03-04T09:17:27.691 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/vm/frontswap.txt 2024-03-04T09:17:27.694 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/vm/highmem.txt 2024-03-04T09:17:27.696 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/vm/hugetlbpage.txt 2024-03-04T09:17:27.699 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/vm/hwpoison.txt 2024-03-04T09:17:27.701 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/vm/ksm.txt 2024-03-04T09:17:27.703 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/vm/numa 2024-03-04T09:17:27.706 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/vm/numa_memory_policy.txt 2024-03-04T09:17:27.709 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/vm/overcommit-accounting 2024-03-04T09:17:27.711 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/vm/page_migration 2024-03-04T09:17:27.713 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/vm/page_owner.txt 2024-03-04T09:17:27.715 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/vm/pagemap.txt 2024-03-04T09:17:27.718 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/vm/remap_file_pages.txt 2024-03-04T09:17:27.720 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/vm/slub.txt 2024-03-04T09:17:27.723 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/vm/soft-dirty.txt 2024-03-04T09:17:27.725 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/vm/split_page_table_lock 2024-03-04T09:17:27.728 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/vm/transhuge.txt 2024-03-04T09:17:27.730 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/vm/unevictable-lru.txt 2024-03-04T09:17:27.732 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/vm/zswap.txt 2024-03-04T09:17:27.734 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/vme_api.txt 2024-03-04T09:17:27.737 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/volatile-considered-harmful.txt 2024-03-04T09:17:27.739 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/w1/ 2024-03-04T09:17:27.742 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/w1/00-INDEX 2024-03-04T09:17:27.743 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/w1/masters/ 2024-03-04T09:17:27.745 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/w1/masters/00-INDEX 2024-03-04T09:17:27.747 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/w1/masters/ds2482 2024-03-04T09:17:27.749 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/w1/masters/ds2490 2024-03-04T09:17:27.752 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/w1/masters/mxc-w1 2024-03-04T09:17:27.754 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/w1/masters/omap-hdq 2024-03-04T09:17:27.756 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/w1/masters/w1-gpio 2024-03-04T09:17:27.758 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/w1/slaves/ 2024-03-04T09:17:27.761 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/w1/slaves/00-INDEX 2024-03-04T09:17:27.763 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2406 2024-03-04T09:17:27.765 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2423 2024-03-04T09:17:27.767 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds28e04 2024-03-04T09:17:27.769 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/w1/slaves/w1_therm 2024-03-04T09:17:27.772 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/w1/w1.generic 2024-03-04T09:17:27.774 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/w1/w1.netlink 2024-03-04T09:17:27.776 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/watchdog/ 2024-03-04T09:17:27.779 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/watchdog/Makefile 2024-03-04T09:17:27.782 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/watchdog/convert_drivers_to_kernel_api.txt 2024-03-04T09:17:27.783 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/watchdog/hpwdt.txt 2024-03-04T09:17:27.785 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/watchdog/pcwd-watchdog.txt 2024-03-04T09:17:27.789 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/watchdog/src/ 2024-03-04T09:17:27.790 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/watchdog/src/.gitignore 2024-03-04T09:17:27.792 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/watchdog/src/Makefile 2024-03-04T09:17:27.794 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-simple.c 2024-03-04T09:17:27.796 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-test.c 2024-03-04T09:17:27.800 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/watchdog/watchdog-api.txt 2024-03-04T09:17:27.802 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/watchdog/watchdog-kernel-api.txt 2024-03-04T09:17:27.804 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/watchdog/watchdog-parameters.txt 2024-03-04T09:17:27.806 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/watchdog/wdt.txt 2024-03-04T09:17:27.808 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/wimax/ 2024-03-04T09:17:27.810 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/wimax/README.i2400m 2024-03-04T09:17:27.813 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/wimax/README.wimax 2024-03-04T09:17:27.815 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/workqueue.txt 2024-03-04T09:17:27.817 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/x86/ 2024-03-04T09:17:27.819 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/x86/00-INDEX 2024-03-04T09:17:27.821 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/x86/boot.txt 2024-03-04T09:17:27.824 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/x86/early-microcode.txt 2024-03-04T09:17:27.826 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/x86/earlyprintk.txt 2024-03-04T09:17:27.828 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/x86/entry_64.txt 2024-03-04T09:17:27.831 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/x86/exception-tables.txt 2024-03-04T09:17:27.833 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/x86/i386/ 2024-03-04T09:17:27.835 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/x86/i386/IO-APIC.txt 2024-03-04T09:17:27.837 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/x86/intel_mpx.txt 2024-03-04T09:17:27.840 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/x86/mtrr.txt 2024-03-04T09:17:27.842 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/x86/pat.txt 2024-03-04T09:17:27.845 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/x86/tlb.txt 2024-03-04T09:17:27.847 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/x86/usb-legacy-support.txt 2024-03-04T09:17:27.849 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/x86/x86_64/ 2024-03-04T09:17:27.851 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/x86/x86_64/00-INDEX 2024-03-04T09:17:27.853 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/x86/x86_64/boot-options.txt 2024-03-04T09:17:27.855 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/x86/x86_64/cpu-hotplug-spec 2024-03-04T09:17:27.858 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/x86/x86_64/fake-numa-for-cpusets 2024-03-04T09:17:27.859 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/x86/x86_64/kernel-stacks 2024-03-04T09:17:27.862 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/x86/x86_64/machinecheck 2024-03-04T09:17:27.864 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/x86/x86_64/mm.txt 2024-03-04T09:17:27.866 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/x86/x86_64/uefi.txt 2024-03-04T09:17:27.868 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/x86/zero-page.txt 2024-03-04T09:17:27.870 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/xillybus.txt 2024-03-04T09:17:27.873 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/xtensa/ 2024-03-04T09:17:27.875 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/xtensa/atomctl.txt 2024-03-04T09:17:27.880 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/xtensa/mmu.txt 2024-03-04T09:17:27.880 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/xz.txt 2024-03-04T09:17:27.882 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/zh_CN/ 2024-03-04T09:17:27.883 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/zh_CN/CodingStyle 2024-03-04T09:17:27.886 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/zh_CN/HOWTO 2024-03-04T09:17:27.888 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/zh_CN/IRQ.txt 2024-03-04T09:17:27.890 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/zh_CN/SecurityBugs 2024-03-04T09:17:27.893 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingDrivers 2024-03-04T09:17:27.895 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingPatches 2024-03-04T09:17:27.913 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/zh_CN/arm/ 2024-03-04T09:17:27.916 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/zh_CN/arm/Booting 2024-03-04T09:17:27.919 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/zh_CN/arm/kernel_user_helpers.txt 2024-03-04T09:17:27.921 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/zh_CN/arm64/ 2024-03-04T09:17:27.924 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/zh_CN/arm64/booting.txt 2024-03-04T09:17:27.926 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/zh_CN/arm64/memory.txt 2024-03-04T09:17:27.929 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/zh_CN/arm64/tagged-pointers.txt 2024-03-04T09:17:27.931 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/zh_CN/basic_profiling.txt 2024-03-04T09:17:27.934 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/zh_CN/email-clients.txt 2024-03-04T09:17:27.936 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/ 2024-03-04T09:17:27.939 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/sysfs.txt 2024-03-04T09:17:27.941 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/zh_CN/gpio.txt 2024-03-04T09:17:27.945 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/zh_CN/io_ordering.txt 2024-03-04T09:17:27.947 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/zh_CN/magic-number.txt 2024-03-04T09:17:27.949 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/zh_CN/oops-tracing.txt 2024-03-04T09:17:27.952 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/zh_CN/sparse.txt 2024-03-04T09:17:27.954 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/zh_CN/stable_api_nonsense.txt 2024-03-04T09:17:27.956 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/zh_CN/stable_kernel_rules.txt 2024-03-04T09:17:27.958 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/ 2024-03-04T09:17:27.960 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/omap3isp.txt 2024-03-04T09:17:27.964 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/v4l2-framework.txt 2024-03-04T09:17:27.966 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/zh_CN/volatile-considered-harmful.txt 2024-03-04T09:17:27.969 INFO:tasks.workunit.client.0.smithi082.stdout:linux-4.0.5/Documentation/zorro.txt 2024-03-04T09:17:28.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:17:28 smithi082 ceph-mon[32880]: pgmap v57: 129 pgs: 129 active+clean; 100 MiB data, 654 MiB used, 1.0 TiB / 1.0 TiB avail; 595 KiB/s rd, 1.1 MiB/s wr, 166 op/s 2024-03-04T09:17:28.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:17:28 smithi190 ceph-mon[36341]: pgmap v57: 129 pgs: 129 active+clean; 100 MiB data, 654 MiB used, 1.0 TiB / 1.0 TiB avail; 595 KiB/s rd, 1.1 MiB/s wr, 166 op/s 2024-03-04T09:17:28.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:17:28 smithi102 ceph-mon[36220]: pgmap v57: 129 pgs: 129 active+clean; 100 MiB data, 654 MiB used, 1.0 TiB / 1.0 TiB avail; 595 KiB/s rd, 1.1 MiB/s wr, 166 op/s 2024-03-04T09:17:30.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:17:30 smithi082 ceph-mon[32880]: pgmap v58: 129 pgs: 129 active+clean; 100 MiB data, 654 MiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 1.1 MiB/s wr, 166 op/s 2024-03-04T09:17:30.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:17:30 smithi190 ceph-mon[36341]: pgmap v58: 129 pgs: 129 active+clean; 100 MiB data, 654 MiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 1.1 MiB/s wr, 166 op/s 2024-03-04T09:17:30.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:17:30 smithi102 ceph-mon[36220]: pgmap v58: 129 pgs: 129 active+clean; 100 MiB data, 654 MiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 1.1 MiB/s wr, 166 op/s 2024-03-04T09:17:32.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:17:32 smithi082 ceph-mon[32880]: pgmap v59: 129 pgs: 129 active+clean; 114 MiB data, 674 MiB used, 1.0 TiB / 1.0 TiB avail; 1004 KiB/s rd, 2.3 MiB/s wr, 259 op/s 2024-03-04T09:17:32.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:17:32 smithi082 ceph-mon[32880]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:17:32.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:17:32 smithi190 ceph-mon[36341]: pgmap v59: 129 pgs: 129 active+clean; 114 MiB data, 674 MiB used, 1.0 TiB / 1.0 TiB avail; 1004 KiB/s rd, 2.3 MiB/s wr, 259 op/s 2024-03-04T09:17:32.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:17:32 smithi190 ceph-mon[36341]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:17:32.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:17:32 smithi102 ceph-mon[36220]: pgmap v59: 129 pgs: 129 active+clean; 114 MiB data, 674 MiB used, 1.0 TiB / 1.0 TiB avail; 1004 KiB/s rd, 2.3 MiB/s wr, 259 op/s 2024-03-04T09:17:32.930 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:17:32 smithi102 ceph-mon[36220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:17:33.559 INFO:tasks.workunit.client.0.smithi082.stderr:+ tar cf doc.tar linux-4.0.5 2024-03-04T09:17:34.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:17:34 smithi082 ceph-mon[32880]: pgmap v60: 129 pgs: 129 active+clean; 114 MiB data, 674 MiB used, 1.0 TiB / 1.0 TiB avail; 771 KiB/s rd, 2.0 MiB/s wr, 234 op/s 2024-03-04T09:17:34.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:17:34 smithi190 ceph-mon[36341]: pgmap v60: 129 pgs: 129 active+clean; 114 MiB data, 674 MiB used, 1.0 TiB / 1.0 TiB avail; 771 KiB/s rd, 2.0 MiB/s wr, 234 op/s 2024-03-04T09:17:34.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:17:34 smithi102 ceph-mon[36220]: pgmap v60: 129 pgs: 129 active+clean; 114 MiB data, 674 MiB used, 1.0 TiB / 1.0 TiB avail; 771 KiB/s rd, 2.0 MiB/s wr, 234 op/s 2024-03-04T09:17:35.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:17:35 smithi082 ceph-mon[32880]: pgmap v61: 129 pgs: 129 active+clean; 118 MiB data, 678 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.4 MiB/s wr, 255 op/s 2024-03-04T09:17:35.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:17:35 smithi190 ceph-mon[36341]: pgmap v61: 129 pgs: 129 active+clean; 118 MiB data, 678 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.4 MiB/s wr, 255 op/s 2024-03-04T09:17:35.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:17:35 smithi102 ceph-mon[36220]: pgmap v61: 129 pgs: 129 active+clean; 118 MiB data, 678 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.4 MiB/s wr, 255 op/s 2024-03-04T09:17:37.328 INFO:tasks.workunit.client.0.smithi082.stderr:+ tar xf doc.tar 2024-03-04T09:17:38.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:17:38 smithi190 ceph-mon[36341]: pgmap v62: 129 pgs: 129 active+clean; 118 MiB data, 678 MiB used, 1.0 TiB / 1.0 TiB avail; 756 KiB/s rd, 1.6 MiB/s wr, 114 op/s 2024-03-04T09:17:38.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:17:38 smithi102 ceph-mon[36220]: pgmap v62: 129 pgs: 129 active+clean; 118 MiB data, 678 MiB used, 1.0 TiB / 1.0 TiB avail; 756 KiB/s rd, 1.6 MiB/s wr, 114 op/s 2024-03-04T09:17:38.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:17:38 smithi082 ceph-mon[32880]: pgmap v62: 129 pgs: 129 active+clean; 118 MiB data, 678 MiB used, 1.0 TiB / 1.0 TiB avail; 756 KiB/s rd, 1.6 MiB/s wr, 114 op/s 2024-03-04T09:17:40.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:17:40 smithi190 ceph-mon[36341]: pgmap v63: 129 pgs: 129 active+clean; 118 MiB data, 678 MiB used, 1.0 TiB / 1.0 TiB avail; 756 KiB/s rd, 1.6 MiB/s wr, 114 op/s 2024-03-04T09:17:40.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:17:40 smithi102 ceph-mon[36220]: pgmap v63: 129 pgs: 129 active+clean; 118 MiB data, 678 MiB used, 1.0 TiB / 1.0 TiB avail; 756 KiB/s rd, 1.6 MiB/s wr, 114 op/s 2024-03-04T09:17:40.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:17:40 smithi082 ceph-mon[32880]: pgmap v63: 129 pgs: 129 active+clean; 118 MiB data, 678 MiB used, 1.0 TiB / 1.0 TiB avail; 756 KiB/s rd, 1.6 MiB/s wr, 114 op/s 2024-03-04T09:17:42.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:17:42 smithi190 ceph-mon[36341]: pgmap v64: 129 pgs: 129 active+clean; 144 MiB data, 699 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.8 MiB/s wr, 189 op/s 2024-03-04T09:17:42.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:17:42 smithi102 ceph-mon[36220]: pgmap v64: 129 pgs: 129 active+clean; 144 MiB data, 699 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.8 MiB/s wr, 189 op/s 2024-03-04T09:17:42.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:17:42 smithi082 ceph-mon[32880]: pgmap v64: 129 pgs: 129 active+clean; 144 MiB data, 699 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.8 MiB/s wr, 189 op/s 2024-03-04T09:17:44.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:17:44 smithi190 ceph-mon[36341]: pgmap v65: 129 pgs: 129 active+clean; 144 MiB data, 699 MiB used, 1.0 TiB / 1.0 TiB avail; 708 KiB/s rd, 2.6 MiB/s wr, 96 op/s 2024-03-04T09:17:44.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:17:44 smithi102 ceph-mon[36220]: pgmap v65: 129 pgs: 129 active+clean; 144 MiB data, 699 MiB used, 1.0 TiB / 1.0 TiB avail; 708 KiB/s rd, 2.6 MiB/s wr, 96 op/s 2024-03-04T09:17:44.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:17:44 smithi082 ceph-mon[32880]: pgmap v65: 129 pgs: 129 active+clean; 144 MiB data, 699 MiB used, 1.0 TiB / 1.0 TiB avail; 708 KiB/s rd, 2.6 MiB/s wr, 96 op/s 2024-03-04T09:17:46.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:17:46 smithi190 ceph-mon[36341]: pgmap v66: 129 pgs: 129 active+clean; 149 MiB data, 678 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.2 MiB/s wr, 236 op/s 2024-03-04T09:17:46.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:17:46 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:17:46.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:17:46 smithi102 ceph-mon[36220]: pgmap v66: 129 pgs: 129 active+clean; 149 MiB data, 678 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.2 MiB/s wr, 236 op/s 2024-03-04T09:17:46.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:17:46 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:17:46.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:17:46 smithi082 ceph-mon[32880]: pgmap v66: 129 pgs: 129 active+clean; 149 MiB data, 678 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.2 MiB/s wr, 236 op/s 2024-03-04T09:17:46.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:17:46 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:17:48.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:17:47 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:17:48.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:17:47 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:17:48.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:17:47 smithi082 ceph-mon[32880]: pgmap v67: 129 pgs: 129 active+clean; 149 MiB data, 678 MiB used, 1.0 TiB / 1.0 TiB avail; 825 KiB/s rd, 2.8 MiB/s wr, 215 op/s 2024-03-04T09:17:48.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:17:47 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:17:48.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:17:47 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:17:48.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:17:47 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:17:48.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:17:47 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:17:48.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:17:47 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:17:48.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:17:47 smithi190 ceph-mon[36341]: pgmap v67: 129 pgs: 129 active+clean; 149 MiB data, 678 MiB used, 1.0 TiB / 1.0 TiB avail; 825 KiB/s rd, 2.8 MiB/s wr, 215 op/s 2024-03-04T09:17:48.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:17:47 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:17:48.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:17:47 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:17:48.171 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:17:47 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:17:48.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:17:47 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:17:48.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:17:47 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:17:48.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:17:47 smithi102 ceph-mon[36220]: pgmap v67: 129 pgs: 129 active+clean; 149 MiB data, 678 MiB used, 1.0 TiB / 1.0 TiB avail; 825 KiB/s rd, 2.8 MiB/s wr, 215 op/s 2024-03-04T09:17:48.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:17:47 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:17:48.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:17:47 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:17:48.179 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:17:47 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:17:50.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:17:50 smithi190 ceph-mon[36341]: pgmap v68: 129 pgs: 129 active+clean; 149 MiB data, 678 MiB used, 1.0 TiB / 1.0 TiB avail; 825 KiB/s rd, 2.8 MiB/s wr, 215 op/s 2024-03-04T09:17:50.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:17:50 smithi102 ceph-mon[36220]: pgmap v68: 129 pgs: 129 active+clean; 149 MiB data, 678 MiB used, 1.0 TiB / 1.0 TiB avail; 825 KiB/s rd, 2.8 MiB/s wr, 215 op/s 2024-03-04T09:17:50.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:17:50 smithi082 ceph-mon[32880]: pgmap v68: 129 pgs: 129 active+clean; 149 MiB data, 678 MiB used, 1.0 TiB / 1.0 TiB avail; 825 KiB/s rd, 2.8 MiB/s wr, 215 op/s 2024-03-04T09:17:52.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:17:52 smithi190 ceph-mon[36341]: pgmap v69: 129 pgs: 129 active+clean; 156 MiB data, 715 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.5 MiB/s wr, 332 op/s 2024-03-04T09:17:52.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:17:52 smithi102 ceph-mon[36220]: pgmap v69: 129 pgs: 129 active+clean; 156 MiB data, 715 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.5 MiB/s wr, 332 op/s 2024-03-04T09:17:52.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:17:52 smithi082 ceph-mon[32880]: pgmap v69: 129 pgs: 129 active+clean; 156 MiB data, 715 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.5 MiB/s wr, 332 op/s 2024-03-04T09:17:54.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:17:54 smithi190 ceph-mon[36341]: pgmap v70: 129 pgs: 129 active+clean; 156 MiB data, 715 MiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 1.2 MiB/s wr, 257 op/s 2024-03-04T09:17:54.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:17:54 smithi102 ceph-mon[36220]: pgmap v70: 129 pgs: 129 active+clean; 156 MiB data, 715 MiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 1.2 MiB/s wr, 257 op/s 2024-03-04T09:17:54.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:17:54 smithi082 ceph-mon[32880]: pgmap v70: 129 pgs: 129 active+clean; 156 MiB data, 715 MiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 1.2 MiB/s wr, 257 op/s 2024-03-04T09:17:56.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:17:56 smithi190 ceph-mon[36341]: pgmap v71: 129 pgs: 129 active+clean; 164 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.1 MiB/s wr, 401 op/s 2024-03-04T09:17:56.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:17:56 smithi102 ceph-mon[36220]: pgmap v71: 129 pgs: 129 active+clean; 164 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.1 MiB/s wr, 401 op/s 2024-03-04T09:17:56.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:17:56 smithi082 ceph-mon[32880]: pgmap v71: 129 pgs: 129 active+clean; 164 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.1 MiB/s wr, 401 op/s 2024-03-04T09:17:58.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:17:58 smithi190 ceph-mon[36341]: pgmap v72: 129 pgs: 129 active+clean; 164 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 898 KiB/s rd, 1.6 MiB/s wr, 261 op/s 2024-03-04T09:17:58.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:17:58 smithi102 ceph-mon[36220]: pgmap v72: 129 pgs: 129 active+clean; 164 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 898 KiB/s rd, 1.6 MiB/s wr, 261 op/s 2024-03-04T09:17:58.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:17:58 smithi082 ceph-mon[32880]: pgmap v72: 129 pgs: 129 active+clean; 164 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 898 KiB/s rd, 1.6 MiB/s wr, 261 op/s 2024-03-04T09:18:00.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:18:00 smithi190 ceph-mon[36341]: pgmap v73: 129 pgs: 129 active+clean; 164 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 898 KiB/s rd, 1.6 MiB/s wr, 261 op/s 2024-03-04T09:18:00.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:18:00 smithi102 ceph-mon[36220]: pgmap v73: 129 pgs: 129 active+clean; 164 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 898 KiB/s rd, 1.6 MiB/s wr, 261 op/s 2024-03-04T09:18:00.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:18:00 smithi082 ceph-mon[32880]: pgmap v73: 129 pgs: 129 active+clean; 164 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 898 KiB/s rd, 1.6 MiB/s wr, 261 op/s 2024-03-04T09:18:02.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:18:02 smithi190 ceph-mon[36341]: pgmap v74: 129 pgs: 129 active+clean; 166 MiB data, 708 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 415 op/s 2024-03-04T09:18:02.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:18:02 smithi102 ceph-mon[36220]: pgmap v74: 129 pgs: 129 active+clean; 166 MiB data, 708 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 415 op/s 2024-03-04T09:18:02.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:18:02 smithi082 ceph-mon[32880]: pgmap v74: 129 pgs: 129 active+clean; 166 MiB data, 708 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 415 op/s 2024-03-04T09:18:04.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:18:04 smithi190 ceph-mon[36341]: pgmap v75: 129 pgs: 129 active+clean; 166 MiB data, 708 MiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 1.7 MiB/s wr, 297 op/s 2024-03-04T09:18:04.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:18:04 smithi102 ceph-mon[36220]: pgmap v75: 129 pgs: 129 active+clean; 166 MiB data, 708 MiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 1.7 MiB/s wr, 297 op/s 2024-03-04T09:18:04.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:18:04 smithi082 ceph-mon[32880]: pgmap v75: 129 pgs: 129 active+clean; 166 MiB data, 708 MiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 1.7 MiB/s wr, 297 op/s 2024-03-04T09:18:06.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:18:06 smithi190 ceph-mon[36341]: pgmap v76: 129 pgs: 129 active+clean; 176 MiB data, 745 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.6 MiB/s wr, 430 op/s 2024-03-04T09:18:06.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:18:06 smithi102 ceph-mon[36220]: pgmap v76: 129 pgs: 129 active+clean; 176 MiB data, 745 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.6 MiB/s wr, 430 op/s 2024-03-04T09:18:06.819 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:18:06 smithi082 ceph-mon[32880]: pgmap v76: 129 pgs: 129 active+clean; 176 MiB data, 745 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.6 MiB/s wr, 430 op/s 2024-03-04T09:18:07.251 INFO:tasks.workunit.client.0.smithi082.stderr:+ sync 2024-03-04T09:18:08.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:18:08 smithi102 ceph-mon[36220]: pgmap v77: 129 pgs: 129 active+clean; 176 MiB data, 745 MiB used, 1.0 TiB / 1.0 TiB avail; 999 KiB/s rd, 1.7 MiB/s wr, 286 op/s 2024-03-04T09:18:08.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:18:08 smithi082 ceph-mon[32880]: pgmap v77: 129 pgs: 129 active+clean; 176 MiB data, 745 MiB used, 1.0 TiB / 1.0 TiB avail; 999 KiB/s rd, 1.7 MiB/s wr, 286 op/s 2024-03-04T09:18:08.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:18:08 smithi190 ceph-mon[36341]: pgmap v77: 129 pgs: 129 active+clean; 176 MiB data, 745 MiB used, 1.0 TiB / 1.0 TiB avail; 999 KiB/s rd, 1.7 MiB/s wr, 286 op/s 2024-03-04T09:18:10.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:18:10 smithi102 ceph-mon[36220]: pgmap v78: 129 pgs: 129 active+clean; 176 MiB data, 745 MiB used, 1.0 TiB / 1.0 TiB avail; 999 KiB/s rd, 1.7 MiB/s wr, 286 op/s 2024-03-04T09:18:10.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:18:10 smithi082 ceph-mon[32880]: pgmap v78: 129 pgs: 129 active+clean; 176 MiB data, 745 MiB used, 1.0 TiB / 1.0 TiB avail; 999 KiB/s rd, 1.7 MiB/s wr, 286 op/s 2024-03-04T09:18:10.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:18:10 smithi190 ceph-mon[36341]: pgmap v78: 129 pgs: 129 active+clean; 176 MiB data, 745 MiB used, 1.0 TiB / 1.0 TiB avail; 999 KiB/s rd, 1.7 MiB/s wr, 286 op/s 2024-03-04T09:18:11.341 INFO:tasks.workunit.client.0.smithi082.stderr:+ tar c linux-4.0.5 2024-03-04T09:18:12.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:18:12 smithi102 ceph-mon[36220]: pgmap v79: 129 pgs: 129 active+clean; 183 MiB data, 783 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.4 MiB/s wr, 375 op/s 2024-03-04T09:18:12.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:18:12 smithi082 ceph-mon[32880]: pgmap v79: 129 pgs: 129 active+clean; 183 MiB data, 783 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.4 MiB/s wr, 375 op/s 2024-03-04T09:18:12.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:18:12 smithi190 ceph-mon[36341]: pgmap v79: 129 pgs: 129 active+clean; 183 MiB data, 783 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.4 MiB/s wr, 375 op/s 2024-03-04T09:18:13.310 INFO:tasks.workunit.client.0.smithi082.stderr:+ rm -rf linux-4.0.5 2024-03-04T09:18:14.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:18:14 smithi102 ceph-mon[36220]: pgmap v80: 129 pgs: 129 active+clean; 183 MiB data, 783 MiB used, 1.0 TiB / 1.0 TiB avail; 1007 KiB/s rd, 1.6 MiB/s wr, 221 op/s 2024-03-04T09:18:14.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:18:14 smithi082 ceph-mon[32880]: pgmap v80: 129 pgs: 129 active+clean; 183 MiB data, 783 MiB used, 1.0 TiB / 1.0 TiB avail; 1007 KiB/s rd, 1.6 MiB/s wr, 221 op/s 2024-03-04T09:18:14.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:18:14 smithi190 ceph-mon[36341]: pgmap v80: 129 pgs: 129 active+clean; 183 MiB data, 783 MiB used, 1.0 TiB / 1.0 TiB avail; 1007 KiB/s rd, 1.6 MiB/s wr, 221 op/s 2024-03-04T09:18:16.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:18:16 smithi082 ceph-mon[32880]: pgmap v81: 129 pgs: 129 active+clean; 187 MiB data, 790 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 246 op/s 2024-03-04T09:18:16.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:18:16 smithi190 ceph-mon[36341]: pgmap v81: 129 pgs: 129 active+clean; 187 MiB data, 790 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 246 op/s 2024-03-04T09:18:16.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:18:16 smithi102 ceph-mon[36220]: pgmap v81: 129 pgs: 129 active+clean; 187 MiB data, 790 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 246 op/s 2024-03-04T09:18:17.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:18:17 smithi082 ceph-mon[32880]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:18:17.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:18:17 smithi190 ceph-mon[36341]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:18:17.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:18:17 smithi102 ceph-mon[36220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:18:18.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:18:18 smithi082 ceph-mon[32880]: pgmap v82: 129 pgs: 129 active+clean; 187 MiB data, 790 MiB used, 1.0 TiB / 1.0 TiB avail; 672 KiB/s rd, 985 KiB/s wr, 113 op/s 2024-03-04T09:18:18.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:18:18 smithi082 ceph-mon[32880]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:18:18.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:18:18 smithi190 ceph-mon[36341]: pgmap v82: 129 pgs: 129 active+clean; 187 MiB data, 790 MiB used, 1.0 TiB / 1.0 TiB avail; 672 KiB/s rd, 985 KiB/s wr, 113 op/s 2024-03-04T09:18:18.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:18:18 smithi190 ceph-mon[36341]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:18:18.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:18:18 smithi102 ceph-mon[36220]: pgmap v82: 129 pgs: 129 active+clean; 187 MiB data, 790 MiB used, 1.0 TiB / 1.0 TiB avail; 672 KiB/s rd, 985 KiB/s wr, 113 op/s 2024-03-04T09:18:18.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:18:18 smithi102 ceph-mon[36220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:18:20.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:18:20 smithi082 ceph-mon[32880]: pgmap v83: 129 pgs: 129 active+clean; 187 MiB data, 790 MiB used, 1.0 TiB / 1.0 TiB avail; 672 KiB/s rd, 985 KiB/s wr, 113 op/s 2024-03-04T09:18:20.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:18:20 smithi190 ceph-mon[36341]: pgmap v83: 129 pgs: 129 active+clean; 187 MiB data, 790 MiB used, 1.0 TiB / 1.0 TiB avail; 672 KiB/s rd, 985 KiB/s wr, 113 op/s 2024-03-04T09:18:20.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:18:20 smithi102 ceph-mon[36220]: pgmap v83: 129 pgs: 129 active+clean; 187 MiB data, 790 MiB used, 1.0 TiB / 1.0 TiB avail; 672 KiB/s rd, 985 KiB/s wr, 113 op/s 2024-03-04T09:18:22.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:18:22 smithi082 ceph-mon[32880]: pgmap v84: 129 pgs: 129 active+clean; 194 MiB data, 846 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 222 op/s 2024-03-04T09:18:22.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:18:22 smithi190 ceph-mon[36341]: pgmap v84: 129 pgs: 129 active+clean; 194 MiB data, 846 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 222 op/s 2024-03-04T09:18:22.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:18:22 smithi102 ceph-mon[36220]: pgmap v84: 129 pgs: 129 active+clean; 194 MiB data, 846 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 222 op/s 2024-03-04T09:18:24.722 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:18:24 smithi190 ceph-mon[36341]: pgmap v85: 129 pgs: 129 active+clean; 194 MiB data, 846 MiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 919 KiB/s wr, 133 op/s 2024-03-04T09:18:24.730 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:18:24 smithi102 ceph-mon[36220]: pgmap v85: 129 pgs: 129 active+clean; 194 MiB data, 846 MiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 919 KiB/s wr, 133 op/s 2024-03-04T09:18:24.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:18:24 smithi082 ceph-mon[32880]: pgmap v85: 129 pgs: 129 active+clean; 194 MiB data, 846 MiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 919 KiB/s wr, 133 op/s 2024-03-04T09:18:25.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:18:25 smithi082 ceph-mon[32880]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:18:25.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:18:25 smithi190 ceph-mon[36341]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:18:25.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:18:25 smithi102 ceph-mon[36220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:18:26.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:18:26 smithi082 ceph-mon[32880]: pgmap v86: 129 pgs: 129 active+clean; 200 MiB data, 907 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 247 op/s 2024-03-04T09:18:26.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:18:26 smithi190 ceph-mon[36341]: pgmap v86: 129 pgs: 129 active+clean; 200 MiB data, 907 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 247 op/s 2024-03-04T09:18:26.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:18:26 smithi102 ceph-mon[36220]: pgmap v86: 129 pgs: 129 active+clean; 200 MiB data, 907 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 247 op/s 2024-03-04T09:18:27.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:18:27 smithi082 ceph-mon[32880]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:18:27.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:18:27 smithi190 ceph-mon[36341]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:18:27.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:18:27 smithi102 ceph-mon[36220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:18:28.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:18:28 smithi082 ceph-mon[32880]: pgmap v87: 129 pgs: 129 active+clean; 200 MiB data, 907 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 222 op/s 2024-03-04T09:18:28.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:18:28 smithi082 ceph-mon[32880]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:18:28.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:18:28 smithi190 ceph-mon[36341]: pgmap v87: 129 pgs: 129 active+clean; 200 MiB data, 907 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 222 op/s 2024-03-04T09:18:28.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:18:28 smithi190 ceph-mon[36341]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:18:28.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:18:28 smithi102 ceph-mon[36220]: pgmap v87: 129 pgs: 129 active+clean; 200 MiB data, 907 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 222 op/s 2024-03-04T09:18:28.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:18:28 smithi102 ceph-mon[36220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:18:30.427 INFO:tasks.workunit.client.0.smithi082.stderr:+ tar xf doc.tar 2024-03-04T09:18:30.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:18:30 smithi082 ceph-mon[32880]: pgmap v88: 129 pgs: 129 active+clean; 200 MiB data, 907 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 222 op/s 2024-03-04T09:18:30.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:18:30 smithi190 ceph-mon[36341]: pgmap v88: 129 pgs: 129 active+clean; 200 MiB data, 907 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 222 op/s 2024-03-04T09:18:30.930 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:18:30 smithi102 ceph-mon[36220]: pgmap v88: 129 pgs: 129 active+clean; 200 MiB data, 907 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 222 op/s 2024-03-04T09:18:32.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:18:32 smithi082 ceph-mon[32880]: pgmap v89: 129 pgs: 129 active+clean; 203 MiB data, 893 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 349 op/s 2024-03-04T09:18:32.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:18:32 smithi190 ceph-mon[36341]: pgmap v89: 129 pgs: 129 active+clean; 203 MiB data, 893 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 349 op/s 2024-03-04T09:18:32.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:18:32 smithi102 ceph-mon[36220]: pgmap v89: 129 pgs: 129 active+clean; 203 MiB data, 893 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 349 op/s 2024-03-04T09:18:33.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:18:33 smithi082 ceph-mon[32880]: pgmap v90: 129 pgs: 129 active+clean; 203 MiB data, 893 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 240 op/s 2024-03-04T09:18:33.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:18:33 smithi190 ceph-mon[36341]: pgmap v90: 129 pgs: 129 active+clean; 203 MiB data, 893 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 240 op/s 2024-03-04T09:18:33.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:18:33 smithi102 ceph-mon[36220]: pgmap v90: 129 pgs: 129 active+clean; 203 MiB data, 893 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 240 op/s 2024-03-04T09:18:36.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:18:36 smithi190 ceph-mon[36341]: pgmap v91: 129 pgs: 129 active+clean; 207 MiB data, 962 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 444 op/s 2024-03-04T09:18:36.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:18:36 smithi102 ceph-mon[36220]: pgmap v91: 129 pgs: 129 active+clean; 207 MiB data, 962 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 444 op/s 2024-03-04T09:18:36.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:18:36 smithi082 ceph-mon[32880]: pgmap v91: 129 pgs: 129 active+clean; 207 MiB data, 962 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 444 op/s 2024-03-04T09:18:38.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:18:38 smithi190 ceph-mon[36341]: pgmap v92: 129 pgs: 129 active+clean; 207 MiB data, 962 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 330 op/s 2024-03-04T09:18:38.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:18:38 smithi102 ceph-mon[36220]: pgmap v92: 129 pgs: 129 active+clean; 207 MiB data, 962 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 330 op/s 2024-03-04T09:18:38.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:18:38 smithi082 ceph-mon[32880]: pgmap v92: 129 pgs: 129 active+clean; 207 MiB data, 962 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 330 op/s 2024-03-04T09:18:40.670 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:18:40 smithi190 ceph-mon[36341]: pgmap v93: 129 pgs: 129 active+clean; 207 MiB data, 962 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 330 op/s 2024-03-04T09:18:40.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:18:40 smithi102 ceph-mon[36220]: pgmap v93: 129 pgs: 129 active+clean; 207 MiB data, 962 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 330 op/s 2024-03-04T09:18:40.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:18:40 smithi082 ceph-mon[32880]: pgmap v93: 129 pgs: 129 active+clean; 207 MiB data, 962 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 330 op/s 2024-03-04T09:18:42.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:18:42 smithi190 ceph-mon[36341]: pgmap v94: 129 pgs: 129 active+clean; 224 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.7 MiB/s wr, 468 op/s 2024-03-04T09:18:42.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:18:42 smithi102 ceph-mon[36220]: pgmap v94: 129 pgs: 129 active+clean; 224 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.7 MiB/s wr, 468 op/s 2024-03-04T09:18:42.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:18:42 smithi082 ceph-mon[32880]: pgmap v94: 129 pgs: 129 active+clean; 224 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.7 MiB/s wr, 468 op/s 2024-03-04T09:18:43.214 INFO:tasks.workunit.client.0.smithi082.stderr:+ sync 2024-03-04T09:18:44.645 INFO:tasks.workunit.client.0.smithi082.stderr:+ tar c linux-4.0.5 2024-03-04T09:18:44.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:18:44 smithi102 ceph-mon[36220]: pgmap v95: 129 pgs: 129 active+clean; 224 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 906 KiB/s rd, 2.2 MiB/s wr, 342 op/s 2024-03-04T09:18:44.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:18:44 smithi082 ceph-mon[32880]: pgmap v95: 129 pgs: 129 active+clean; 224 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 906 KiB/s rd, 2.2 MiB/s wr, 342 op/s 2024-03-04T09:18:44.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:18:44 smithi190 ceph-mon[36341]: pgmap v95: 129 pgs: 129 active+clean; 224 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 906 KiB/s rd, 2.2 MiB/s wr, 342 op/s 2024-03-04T09:18:45.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:18:45 smithi102 ceph-mon[36220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:18:45.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:18:45 smithi082 ceph-mon[32880]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:18:45.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:18:45 smithi190 ceph-mon[36341]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:18:46.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:18:46 smithi082 ceph-mon[32880]: pgmap v96: 129 pgs: 129 active+clean; 234 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.1 MiB/s wr, 420 op/s 2024-03-04T09:18:46.853 INFO:tasks.workunit.client.0.smithi082.stdout:Ok 2024-03-04T09:18:46.854 INFO:tasks.workunit.client.0.smithi082.stderr:+ echo Ok 2024-03-04T09:18:46.855 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-04T09:18:46.855 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-04T09:18:46.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:18:46 smithi190 ceph-mon[36341]: pgmap v96: 129 pgs: 129 active+clean; 234 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.1 MiB/s wr, 420 op/s 2024-03-04T09:18:46.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:18:46 smithi102 ceph-mon[36220]: pgmap v96: 129 pgs: 129 active+clean; 234 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.1 MiB/s wr, 420 op/s 2024-03-04T09:18:48.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:18:48 smithi082 ceph-mon[32880]: pgmap v97: 129 pgs: 129 active+clean; 234 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 868 KiB/s rd, 2.4 MiB/s wr, 216 op/s 2024-03-04T09:18:48.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:18:48 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:18:48.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:18:48 smithi190 ceph-mon[36341]: pgmap v97: 129 pgs: 129 active+clean; 234 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 868 KiB/s rd, 2.4 MiB/s wr, 216 op/s 2024-03-04T09:18:48.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:18:48 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:18:48.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:18:48 smithi102 ceph-mon[36220]: pgmap v97: 129 pgs: 129 active+clean; 234 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 868 KiB/s rd, 2.4 MiB/s wr, 216 op/s 2024-03-04T09:18:48.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:18:48 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:18:49.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:18:49 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:18:49.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:18:49 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:18:49.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:18:49 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:18:49.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:18:49 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:18:49.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:18:49 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:18:49.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:18:49 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:18:49.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:18:49 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:18:49.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:18:49 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:18:49.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:18:49 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:18:50.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:18:50 smithi082 ceph-mon[32880]: pgmap v98: 129 pgs: 129 active+clean; 234 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 868 KiB/s rd, 2.4 MiB/s wr, 216 op/s 2024-03-04T09:18:50.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:18:50 smithi190 ceph-mon[36341]: pgmap v98: 129 pgs: 129 active+clean; 234 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 868 KiB/s rd, 2.4 MiB/s wr, 216 op/s 2024-03-04T09:18:50.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:18:50 smithi102 ceph-mon[36220]: pgmap v98: 129 pgs: 129 active+clean; 234 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 868 KiB/s rd, 2.4 MiB/s wr, 216 op/s 2024-03-04T09:18:52.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:18:52 smithi082 ceph-mon[32880]: pgmap v99: 129 pgs: 129 active+clean; 239 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.9 MiB/s wr, 268 op/s 2024-03-04T09:18:52.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:18:52 smithi082 ceph-mon[32880]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:18:52.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:18:52 smithi190 ceph-mon[36341]: pgmap v99: 129 pgs: 129 active+clean; 239 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.9 MiB/s wr, 268 op/s 2024-03-04T09:18:52.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:18:52 smithi190 ceph-mon[36341]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:18:52.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:18:52 smithi102 ceph-mon[36220]: pgmap v99: 129 pgs: 129 active+clean; 239 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.9 MiB/s wr, 268 op/s 2024-03-04T09:18:52.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:18:52 smithi102 ceph-mon[36220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:18:53.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:18:53 smithi082 ceph-mon[32880]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:18:53.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:18:53 smithi190 ceph-mon[36341]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:18:53.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:18:53 smithi102 ceph-mon[36220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:18:54.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:18:54 smithi082 ceph-mon[32880]: pgmap v100: 129 pgs: 129 active+clean; 239 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 889 KiB/s rd, 1.4 MiB/s wr, 130 op/s 2024-03-04T09:18:54.821 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:18:54 smithi190 ceph-mon[36341]: pgmap v100: 129 pgs: 129 active+clean; 239 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 889 KiB/s rd, 1.4 MiB/s wr, 130 op/s 2024-03-04T09:18:54.829 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:18:54 smithi102 ceph-mon[36220]: pgmap v100: 129 pgs: 129 active+clean; 239 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 889 KiB/s rd, 1.4 MiB/s wr, 130 op/s 2024-03-04T09:18:56.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:18:56 smithi082 ceph-mon[32880]: pgmap v101: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.0 MiB/s wr, 281 op/s 2024-03-04T09:18:56.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:18:56 smithi190 ceph-mon[36341]: pgmap v101: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.0 MiB/s wr, 281 op/s 2024-03-04T09:18:56.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:18:56 smithi102 ceph-mon[36220]: pgmap v101: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.0 MiB/s wr, 281 op/s 2024-03-04T09:18:58.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:18:58 smithi082 ceph-mon[32880]: pgmap v102: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 995 KiB/s rd, 1.0 MiB/s wr, 203 op/s 2024-03-04T09:18:58.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:18:58 smithi082 ceph-mon[32880]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:18:58.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:18:58 smithi190 ceph-mon[36341]: pgmap v102: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 995 KiB/s rd, 1.0 MiB/s wr, 203 op/s 2024-03-04T09:18:58.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:18:58 smithi190 ceph-mon[36341]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:18:58.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:18:58 smithi102 ceph-mon[36220]: pgmap v102: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 995 KiB/s rd, 1.0 MiB/s wr, 203 op/s 2024-03-04T09:18:58.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:18:58 smithi102 ceph-mon[36220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:19:00.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:19:00 smithi082 ceph-mon[32880]: pgmap v103: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 995 KiB/s rd, 1.0 MiB/s wr, 203 op/s 2024-03-04T09:19:00.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:19:00 smithi190 ceph-mon[36341]: pgmap v103: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 995 KiB/s rd, 1.0 MiB/s wr, 203 op/s 2024-03-04T09:19:00.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:19:00 smithi102 ceph-mon[36220]: pgmap v103: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 995 KiB/s rd, 1.0 MiB/s wr, 203 op/s 2024-03-04T09:19:02.288 INFO:tasks.workunit:Stopping ['fs/norstats'] on client.0... 2024-03-04T09:19:02.289 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-03-04T09:19:02.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:19:02 smithi082 ceph-mon[32880]: pgmap v104: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 354 op/s 2024-03-04T09:19:02.583 DEBUG:teuthology.parallel:result is None 2024-03-04T09:19:02.583 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-03-04T09:19:02.621 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-03-04T09:19:02.621 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-03-04T09:19:02.632 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-03-04T09:19:02.632 INFO:teuthology.task.exec:Executing custom commands... 2024-03-04T09:19:02.632 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi082.front.sepia.ceph.com 2024-03-04T09:19:02.632 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-03-04T09:19:02.689 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-03-04T09:19:02.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:19:02 smithi190 ceph-mon[36341]: pgmap v104: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 354 op/s 2024-03-04T09:19:02.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:19:02 smithi102 ceph-mon[36220]: pgmap v104: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 354 op/s 2024-03-04T09:19:04.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:19:04 smithi082 ceph-mon[32880]: pgmap v105: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 302 op/s 2024-03-04T09:19:04.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:19:04 smithi190 ceph-mon[36341]: pgmap v105: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 302 op/s 2024-03-04T09:19:04.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:19:04 smithi102 ceph-mon[36220]: pgmap v105: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 302 op/s 2024-03-04T09:19:06.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:19:06 smithi082 ceph-mon[32880]: pgmap v106: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 401 op/s 2024-03-04T09:19:06.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:19:06 smithi190 ceph-mon[36341]: pgmap v106: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 401 op/s 2024-03-04T09:19:06.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:19:06 smithi102 ceph-mon[36220]: pgmap v106: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 401 op/s 2024-03-04T09:19:08.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:19:08 smithi082 ceph-mon[32880]: pgmap v107: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 924 KiB/s rd, 906 KiB/s wr, 249 op/s 2024-03-04T09:19:08.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:19:08 smithi190 ceph-mon[36341]: pgmap v107: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 924 KiB/s rd, 906 KiB/s wr, 249 op/s 2024-03-04T09:19:08.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:19:08 smithi102 ceph-mon[36220]: pgmap v107: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 924 KiB/s rd, 906 KiB/s wr, 249 op/s 2024-03-04T09:19:09.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:19:09 smithi082 ceph-mon[32880]: pgmap v108: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 924 KiB/s rd, 906 KiB/s wr, 249 op/s 2024-03-04T09:19:09.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:19:09 smithi190 ceph-mon[36341]: pgmap v108: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 924 KiB/s rd, 906 KiB/s wr, 249 op/s 2024-03-04T09:19:09.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:19:09 smithi102 ceph-mon[36220]: pgmap v108: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 924 KiB/s rd, 906 KiB/s wr, 249 op/s 2024-03-04T09:19:12.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:19:12 smithi102 ceph-mon[36220]: pgmap v109: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 931 KiB/s rd, 911 KiB/s wr, 255 op/s 2024-03-04T09:19:12.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:19:12 smithi082 ceph-mon[32880]: pgmap v109: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 931 KiB/s rd, 911 KiB/s wr, 255 op/s 2024-03-04T09:19:12.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:19:12 smithi190 ceph-mon[36341]: pgmap v109: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 931 KiB/s rd, 911 KiB/s wr, 255 op/s 2024-03-04T09:19:14.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:19:14 smithi102 ceph-mon[36220]: pgmap v110: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 351 KiB/s wr, 104 op/s 2024-03-04T09:19:14.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:19:14 smithi082 ceph-mon[32880]: pgmap v110: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 351 KiB/s wr, 104 op/s 2024-03-04T09:19:14.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:19:14 smithi190 ceph-mon[36341]: pgmap v110: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 351 KiB/s wr, 104 op/s 2024-03-04T09:19:16.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:19:16 smithi102 ceph-mon[36220]: pgmap v111: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 355 KiB/s wr, 109 op/s 2024-03-04T09:19:16.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:19:16 smithi082 ceph-mon[32880]: pgmap v111: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 355 KiB/s wr, 109 op/s 2024-03-04T09:19:16.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:19:16 smithi190 ceph-mon[36341]: pgmap v111: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 355 KiB/s wr, 109 op/s 2024-03-04T09:19:18.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:19:18 smithi082 ceph-mon[32880]: pgmap v112: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.7 KiB/s wr, 11 op/s 2024-03-04T09:19:18.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:19:18 smithi190 ceph-mon[36341]: pgmap v112: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.7 KiB/s wr, 11 op/s 2024-03-04T09:19:18.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:19:18 smithi102 ceph-mon[36220]: pgmap v112: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.7 KiB/s wr, 11 op/s 2024-03-04T09:19:20.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:19:20 smithi082 ceph-mon[32880]: pgmap v113: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.7 KiB/s wr, 11 op/s 2024-03-04T09:19:20.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:19:20 smithi190 ceph-mon[36341]: pgmap v113: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.7 KiB/s wr, 11 op/s 2024-03-04T09:19:20.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:19:20 smithi102 ceph-mon[36220]: pgmap v113: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.7 KiB/s wr, 11 op/s 2024-03-04T09:19:22.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:19:22 smithi082 ceph-mon[32880]: pgmap v114: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.0 KiB/s wr, 16 op/s 2024-03-04T09:19:22.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:19:22 smithi190 ceph-mon[36341]: pgmap v114: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.0 KiB/s wr, 16 op/s 2024-03-04T09:19:22.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:19:22 smithi102 ceph-mon[36220]: pgmap v114: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.0 KiB/s wr, 16 op/s 2024-03-04T09:19:24.723 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:19:24 smithi190 ceph-mon[36341]: pgmap v115: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.7 KiB/s wr, 9 op/s 2024-03-04T09:19:24.731 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:19:24 smithi102 ceph-mon[36220]: pgmap v115: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.7 KiB/s wr, 9 op/s 2024-03-04T09:19:24.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:19:24 smithi082 ceph-mon[32880]: pgmap v115: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.7 KiB/s wr, 9 op/s 2024-03-04T09:19:26.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:19:26 smithi082 ceph-mon[32880]: pgmap v116: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.2 KiB/s wr, 14 op/s 2024-03-04T09:19:26.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:19:26 smithi190 ceph-mon[36341]: pgmap v116: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.2 KiB/s wr, 14 op/s 2024-03-04T09:19:26.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:19:26 smithi102 ceph-mon[36220]: pgmap v116: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.2 KiB/s wr, 14 op/s 2024-03-04T09:19:28.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:19:28 smithi082 ceph-mon[32880]: pgmap v117: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 9 op/s 2024-03-04T09:19:28.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:19:28 smithi190 ceph-mon[36341]: pgmap v117: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 9 op/s 2024-03-04T09:19:28.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:19:28 smithi102 ceph-mon[36220]: pgmap v117: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 9 op/s 2024-03-04T09:19:30.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:19:30 smithi082 ceph-mon[32880]: pgmap v118: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 9 op/s 2024-03-04T09:19:30.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:19:30 smithi190 ceph-mon[36341]: pgmap v118: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 9 op/s 2024-03-04T09:19:30.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:19:30 smithi102 ceph-mon[36220]: pgmap v118: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 9 op/s 2024-03-04T09:19:32.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:19:32 smithi082 ceph-mon[32880]: pgmap v119: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 767 B/s wr, 13 op/s 2024-03-04T09:19:32.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:19:32 smithi190 ceph-mon[36341]: pgmap v119: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 767 B/s wr, 13 op/s 2024-03-04T09:19:32.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:19:32 smithi102 ceph-mon[36220]: pgmap v119: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 767 B/s wr, 13 op/s 2024-03-04T09:19:34.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:19:34 smithi082 ceph-mon[32880]: pgmap v120: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 426 B/s wr, 8 op/s 2024-03-04T09:19:34.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:19:34 smithi190 ceph-mon[36341]: pgmap v120: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 426 B/s wr, 8 op/s 2024-03-04T09:19:34.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:19:34 smithi102 ceph-mon[36220]: pgmap v120: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 426 B/s wr, 8 op/s 2024-03-04T09:19:36.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:19:36 smithi082 ceph-mon[32880]: pgmap v121: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 426 B/s wr, 12 op/s 2024-03-04T09:19:36.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:19:36 smithi190 ceph-mon[36341]: pgmap v121: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 426 B/s wr, 12 op/s 2024-03-04T09:19:36.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:19:36 smithi102 ceph-mon[36220]: pgmap v121: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 426 B/s wr, 12 op/s 2024-03-04T09:19:38.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:19:38 smithi082 ceph-mon[32880]: pgmap v122: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:19:38.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:19:38 smithi190 ceph-mon[36341]: pgmap v122: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:19:38.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:19:38 smithi102 ceph-mon[36220]: pgmap v122: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:19:40.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:19:40 smithi082 ceph-mon[32880]: pgmap v123: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:19:40.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:19:40 smithi190 ceph-mon[36341]: pgmap v123: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:19:40.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:19:40 smithi102 ceph-mon[36220]: pgmap v123: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:19:42.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:19:42 smithi082 ceph-mon[32880]: pgmap v124: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:19:42.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:19:42 smithi190 ceph-mon[36341]: pgmap v124: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:19:42.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:19:42 smithi102 ceph-mon[36220]: pgmap v124: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:19:44.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:19:44 smithi082 ceph-mon[32880]: pgmap v125: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:19:44.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:19:44 smithi190 ceph-mon[36341]: pgmap v125: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:19:44.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:19:44 smithi102 ceph-mon[36220]: pgmap v125: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:19:46.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:19:46 smithi082 ceph-mon[32880]: pgmap v126: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:19:46.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:19:46 smithi190 ceph-mon[36341]: pgmap v126: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:19:46.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:19:46 smithi102 ceph-mon[36220]: pgmap v126: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:19:47.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:19:47 smithi082 ceph-mon[32880]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:19:47.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:19:47 smithi190 ceph-mon[36341]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:19:47.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:19:47 smithi102 ceph-mon[36220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:19:48.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:19:48 smithi082 ceph-mon[32880]: pgmap v127: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:19:48.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:19:48 smithi190 ceph-mon[36341]: pgmap v127: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:19:48.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:19:48 smithi102 ceph-mon[36220]: pgmap v127: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:19:49.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:19:49 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:19:49.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:19:49 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:19:49.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:19:49 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:19:49.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:19:49 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:19:49.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:19:49 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:19:49.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:19:49 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:19:49.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:19:49 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:19:49.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:19:49 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:19:49.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:19:49 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:19:49.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:19:49 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:19:49.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:19:49 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:19:49.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:19:49 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:19:50.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:19:50 smithi082 ceph-mon[32880]: pgmap v128: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:19:50.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:19:50 smithi190 ceph-mon[36341]: pgmap v128: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:19:50.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:19:50 smithi102 ceph-mon[36220]: pgmap v128: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:19:52.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:19:52 smithi082 ceph-mon[32880]: pgmap v129: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:19:52.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:19:52 smithi190 ceph-mon[36341]: pgmap v129: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:19:52.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:19:52 smithi102 ceph-mon[36220]: pgmap v129: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:19:53.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:19:53 smithi082 ceph-mon[32880]: pgmap v130: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:19:53.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:19:53 smithi190 ceph-mon[36341]: pgmap v130: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:19:53.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:19:53 smithi102 ceph-mon[36220]: pgmap v130: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:19:56.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:19:56 smithi082 ceph-mon[32880]: pgmap v131: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:19:56.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:19:56 smithi190 ceph-mon[36341]: pgmap v131: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:19:56.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:19:56 smithi102 ceph-mon[36220]: pgmap v131: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:19:58.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:19:58 smithi082 ceph-mon[32880]: pgmap v132: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:19:58.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:19:58 smithi190 ceph-mon[36341]: pgmap v132: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:19:58.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:19:58 smithi102 ceph-mon[36220]: pgmap v132: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:20:00.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:20:00 smithi082 ceph-mon[32880]: pgmap v133: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:20:00.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:20:00 smithi082 ceph-mon[32880]: overall HEALTH_OK 2024-03-04T09:20:00.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:20:00 smithi190 ceph-mon[36341]: pgmap v133: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:20:00.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:20:00 smithi190 ceph-mon[36341]: overall HEALTH_OK 2024-03-04T09:20:00.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:20:00 smithi102 ceph-mon[36220]: pgmap v133: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:20:00.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:20:00 smithi102 ceph-mon[36220]: overall HEALTH_OK 2024-03-04T09:20:02.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:20:02 smithi082 ceph-mon[32880]: pgmap v134: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-03-04T09:20:02.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:20:02 smithi082 ceph-mon[32880]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:20:02.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:20:02 smithi190 ceph-mon[36341]: pgmap v134: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-03-04T09:20:02.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:20:02 smithi190 ceph-mon[36341]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:20:02.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:20:02 smithi102 ceph-mon[36220]: pgmap v134: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-03-04T09:20:02.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:20:02 smithi102 ceph-mon[36220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:20:04.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:20:04 smithi082 ceph-mon[32880]: pgmap v135: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-03-04T09:20:04.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:20:04 smithi190 ceph-mon[36341]: pgmap v135: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-03-04T09:20:04.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:20:04 smithi102 ceph-mon[36220]: pgmap v135: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-03-04T09:20:06.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:20:06 smithi082 ceph-mon[32880]: pgmap v136: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-03-04T09:20:06.924 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:20:06 smithi190 ceph-mon[36341]: pgmap v136: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-03-04T09:20:06.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:20:06 smithi102 ceph-mon[36220]: pgmap v136: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-03-04T09:20:08.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:20:08 smithi082 ceph-mon[32880]: pgmap v137: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-03-04T09:20:08.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:20:08 smithi190 ceph-mon[36341]: pgmap v137: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-03-04T09:20:08.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:20:08 smithi102 ceph-mon[36220]: pgmap v137: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-03-04T09:20:10.821 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:20:10 smithi082 ceph-mon[32880]: pgmap v138: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-03-04T09:20:10.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:20:10 smithi190 ceph-mon[36341]: pgmap v138: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-03-04T09:20:10.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:20:10 smithi102 ceph-mon[36220]: pgmap v138: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-03-04T09:20:12.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:20:12 smithi082 ceph-mon[32880]: pgmap v139: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-03-04T09:20:12.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:20:12 smithi190 ceph-mon[36341]: pgmap v139: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-03-04T09:20:12.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:20:12 smithi102 ceph-mon[36220]: pgmap v139: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-03-04T09:20:14.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:20:14 smithi082 ceph-mon[32880]: pgmap v140: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 170 B/s wr, 8 op/s 2024-03-04T09:20:14.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:20:14 smithi190 ceph-mon[36341]: pgmap v140: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 170 B/s wr, 8 op/s 2024-03-04T09:20:14.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:20:14 smithi102 ceph-mon[36220]: pgmap v140: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 170 B/s wr, 8 op/s 2024-03-04T09:20:16.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:20:16 smithi082 ceph-mon[32880]: pgmap v141: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 170 B/s wr, 12 op/s 2024-03-04T09:20:16.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:20:16 smithi190 ceph-mon[36341]: pgmap v141: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 170 B/s wr, 12 op/s 2024-03-04T09:20:16.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:20:16 smithi102 ceph-mon[36220]: pgmap v141: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 170 B/s wr, 12 op/s 2024-03-04T09:20:18.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:20:18 smithi082 ceph-mon[32880]: pgmap v142: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-03-04T09:20:18.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:20:18 smithi190 ceph-mon[36341]: pgmap v142: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-03-04T09:20:18.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:20:18 smithi102 ceph-mon[36220]: pgmap v142: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-03-04T09:20:20.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:20:20 smithi082 ceph-mon[32880]: pgmap v143: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-03-04T09:20:20.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:20:20 smithi190 ceph-mon[36341]: pgmap v143: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-03-04T09:20:20.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:20:20 smithi102 ceph-mon[36220]: pgmap v143: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-03-04T09:20:22.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:20:22 smithi082 ceph-mon[32880]: pgmap v144: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2024-03-04T09:20:22.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:20:22 smithi190 ceph-mon[36341]: pgmap v144: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2024-03-04T09:20:22.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:20:22 smithi102 ceph-mon[36220]: pgmap v144: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2024-03-04T09:20:24.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:20:24 smithi082 ceph-mon[32880]: pgmap v145: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:20:24.922 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:20:24 smithi190 ceph-mon[36341]: pgmap v145: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:20:24.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:20:24 smithi102 ceph-mon[36220]: pgmap v145: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:20:26.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:20:26 smithi082 ceph-mon[32880]: pgmap v146: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:20:26.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:20:26 smithi190 ceph-mon[36341]: pgmap v146: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:20:26.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:20:26 smithi102 ceph-mon[36220]: pgmap v146: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:20:28.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:20:28 smithi082 ceph-mon[32880]: pgmap v147: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:20:28.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:20:28 smithi190 ceph-mon[36341]: pgmap v147: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:20:28.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:20:28 smithi102 ceph-mon[36220]: pgmap v147: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:20:30.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:20:30 smithi082 ceph-mon[32880]: pgmap v148: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:20:30.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:20:30 smithi190 ceph-mon[36341]: pgmap v148: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:20:30.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:20:30 smithi102 ceph-mon[36220]: pgmap v148: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:20:32.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:20:32 smithi082 ceph-mon[32880]: pgmap v149: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:20:32.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:20:32 smithi082 ceph-mon[32880]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:20:32.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:20:32 smithi190 ceph-mon[36341]: pgmap v149: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:20:32.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:20:32 smithi190 ceph-mon[36341]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:20:32.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:20:32 smithi102 ceph-mon[36220]: pgmap v149: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:20:32.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:20:32 smithi102 ceph-mon[36220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:20:33.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:20:33 smithi082 ceph-mon[32880]: pgmap v150: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:20:33.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:20:33 smithi190 ceph-mon[36341]: pgmap v150: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:20:33.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:20:33 smithi102 ceph-mon[36220]: pgmap v150: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:20:36.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:20:36 smithi082 ceph-mon[32880]: pgmap v151: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:20:36.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:20:36 smithi082 ceph-mon[32880]: evicting unresponsive client smithi082:x (15525), after 303.831 seconds 2024-03-04T09:20:36.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:20:36 smithi082 ceph-mon[32880]: Evicting (and blocklisting) client session 15525 (172.21.15.82:0/406948853) 2024-03-04T09:20:36.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:20:36 smithi082 ceph-mon[32880]: from='mds.? [v2:172.21.15.102:6838/35424130,v1:172.21.15.102:6839/35424130]' entity='mds.b' cmd=[{"prefix":"osd blocklist", "blocklistop":"add","addr":"172.21.15.82:0/406948853"}]: dispatch 2024-03-04T09:20:36.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:20:36 smithi082 ceph-mon[32880]: from='mds.? ' entity='mds.b' cmd=[{"prefix":"osd blocklist", "blocklistop":"add","addr":"172.21.15.82:0/406948853"}]: dispatch 2024-03-04T09:20:36.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:20:36 smithi190 ceph-mon[36341]: pgmap v151: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:20:36.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:20:36 smithi190 ceph-mon[36341]: evicting unresponsive client smithi082:x (15525), after 303.831 seconds 2024-03-04T09:20:36.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:20:36 smithi190 ceph-mon[36341]: Evicting (and blocklisting) client session 15525 (172.21.15.82:0/406948853) 2024-03-04T09:20:36.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:20:36 smithi190 ceph-mon[36341]: from='mds.? [v2:172.21.15.102:6838/35424130,v1:172.21.15.102:6839/35424130]' entity='mds.b' cmd=[{"prefix":"osd blocklist", "blocklistop":"add","addr":"172.21.15.82:0/406948853"}]: dispatch 2024-03-04T09:20:36.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:20:36 smithi190 ceph-mon[36341]: from='mds.? ' entity='mds.b' cmd=[{"prefix":"osd blocklist", "blocklistop":"add","addr":"172.21.15.82:0/406948853"}]: dispatch 2024-03-04T09:20:36.930 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:20:36 smithi102 ceph-mon[36220]: pgmap v151: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:20:36.930 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:20:36 smithi102 ceph-mon[36220]: evicting unresponsive client smithi082:x (15525), after 303.831 seconds 2024-03-04T09:20:36.930 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:20:36 smithi102 ceph-mon[36220]: Evicting (and blocklisting) client session 15525 (172.21.15.82:0/406948853) 2024-03-04T09:20:36.930 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:20:36 smithi102 ceph-mon[36220]: from='mds.? [v2:172.21.15.102:6838/35424130,v1:172.21.15.102:6839/35424130]' entity='mds.b' cmd=[{"prefix":"osd blocklist", "blocklistop":"add","addr":"172.21.15.82:0/406948853"}]: dispatch 2024-03-04T09:20:36.930 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:20:36 smithi102 ceph-mon[36220]: from='mds.? ' entity='mds.b' cmd=[{"prefix":"osd blocklist", "blocklistop":"add","addr":"172.21.15.82:0/406948853"}]: dispatch 2024-03-04T09:20:37.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:20:37 smithi082 ceph-mon[32880]: from='mds.? ' entity='mds.b' cmd='[{"prefix":"osd blocklist", "blocklistop":"add","addr":"172.21.15.82:0/406948853"}]': finished 2024-03-04T09:20:37.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:20:37 smithi082 ceph-mon[32880]: osdmap e96: 12 total, 12 up, 12 in 2024-03-04T09:20:37.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:20:37 smithi190 ceph-mon[36341]: from='mds.? ' entity='mds.b' cmd='[{"prefix":"osd blocklist", "blocklistop":"add","addr":"172.21.15.82:0/406948853"}]': finished 2024-03-04T09:20:37.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:20:37 smithi190 ceph-mon[36341]: osdmap e96: 12 total, 12 up, 12 in 2024-03-04T09:20:37.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:20:37 smithi102 ceph-mon[36220]: from='mds.? ' entity='mds.b' cmd='[{"prefix":"osd blocklist", "blocklistop":"add","addr":"172.21.15.82:0/406948853"}]': finished 2024-03-04T09:20:37.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:20:37 smithi102 ceph-mon[36220]: osdmap e96: 12 total, 12 up, 12 in 2024-03-04T09:20:38.819 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:20:38 smithi082 ceph-mon[32880]: pgmap v153: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-03-04T09:20:38.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:20:38 smithi190 ceph-mon[36341]: pgmap v153: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-03-04T09:20:38.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:20:38 smithi102 ceph-mon[36220]: pgmap v153: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-03-04T09:20:40.819 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:20:40 smithi082 ceph-mon[32880]: pgmap v154: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-03-04T09:20:40.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:20:40 smithi190 ceph-mon[36341]: pgmap v154: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-03-04T09:20:40.930 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:20:40 smithi102 ceph-mon[36220]: pgmap v154: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-03-04T09:20:42.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:20:42 smithi082 ceph-mon[32880]: pgmap v155: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2024-03-04T09:20:42.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:20:42 smithi082 ceph-mon[32880]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:20:42.923 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:20:42 smithi190 ceph-mon[36341]: pgmap v155: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2024-03-04T09:20:42.924 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:20:42 smithi190 ceph-mon[36341]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:20:42.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:20:42 smithi102 ceph-mon[36220]: pgmap v155: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2024-03-04T09:20:42.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:20:42 smithi102 ceph-mon[36220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:20:43.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:20:43 smithi082 ceph-mon[32880]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:20:43.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:20:43 smithi190 ceph-mon[36341]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:20:43.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:20:43 smithi102 ceph-mon[36220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:20:44.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:20:44 smithi082 ceph-mon[32880]: pgmap v156: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2024-03-04T09:20:44.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:20:44 smithi190 ceph-mon[36341]: pgmap v156: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2024-03-04T09:20:44.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:20:44 smithi102 ceph-mon[36220]: pgmap v156: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2024-03-04T09:20:46.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:20:46 smithi082 ceph-mon[32880]: pgmap v157: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2024-03-04T09:20:46.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:20:46 smithi190 ceph-mon[36341]: pgmap v157: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2024-03-04T09:20:46.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:20:46 smithi102 ceph-mon[36220]: pgmap v157: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2024-03-04T09:20:48.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:20:48 smithi082 ceph-mon[32880]: pgmap v158: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 280 B/s wr, 9 op/s 2024-03-04T09:20:48.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:20:48 smithi190 ceph-mon[36341]: pgmap v158: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 280 B/s wr, 9 op/s 2024-03-04T09:20:48.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:20:48 smithi102 ceph-mon[36220]: pgmap v158: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 280 B/s wr, 9 op/s 2024-03-04T09:20:49.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:20:49 smithi082 ceph-mon[32880]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:20:49.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:20:49 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:20:49.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:20:49 smithi190 ceph-mon[36341]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:20:49.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:20:49 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:20:49.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:20:49 smithi102 ceph-mon[36220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:20:49.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:20:49 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:20:50.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:20:50 smithi082 ceph-mon[32880]: pgmap v159: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-03-04T09:20:50.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:20:50 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:20:50.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:20:50 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:20:50.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:20:50 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:20:50.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:20:50 smithi190 ceph-mon[36341]: pgmap v159: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-03-04T09:20:50.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:20:50 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:20:50.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:20:50 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:20:50.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:20:50 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:20:50.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:20:50 smithi102 ceph-mon[36220]: pgmap v159: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-03-04T09:20:50.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:20:50 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:20:50.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:20:50 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:20:50.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:20:50 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:20:51.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:20:51 smithi082 ceph-mon[32880]: pgmap v160: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-03-04T09:20:51.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:20:51 smithi190 ceph-mon[36341]: pgmap v160: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-03-04T09:20:51.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:20:51 smithi102 ceph-mon[36220]: pgmap v160: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-03-04T09:20:52.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:20:52 smithi082 ceph-mon[32880]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:20:52.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:20:52 smithi190 ceph-mon[36341]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:20:52.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:20:52 smithi102 ceph-mon[36220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:20:53.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:20:53 smithi082 ceph-mon[32880]: pgmap v161: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:20:53.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:20:53 smithi190 ceph-mon[36341]: pgmap v161: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:20:53.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:20:53 smithi102 ceph-mon[36220]: pgmap v161: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:20:56.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:20:56 smithi082 ceph-mon[32880]: pgmap v162: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:20:56.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:20:56 smithi190 ceph-mon[36341]: pgmap v162: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:20:56.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:20:56 smithi102 ceph-mon[36220]: pgmap v162: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:20:58.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:20:58 smithi082 ceph-mon[32880]: pgmap v163: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:20:58.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:20:58 smithi082 ceph-mon[32880]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:20:58.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:20:58 smithi190 ceph-mon[36341]: pgmap v163: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:20:58.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:20:58 smithi190 ceph-mon[36341]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:20:58.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:20:58 smithi102 ceph-mon[36220]: pgmap v163: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:20:58.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:20:58 smithi102 ceph-mon[36220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:21:00.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:21:00 smithi082 ceph-mon[32880]: pgmap v164: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:21:00.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:21:00 smithi190 ceph-mon[36341]: pgmap v164: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:21:00.932 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:21:00 smithi102 ceph-mon[36220]: pgmap v164: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:21:02.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:21:02 smithi082 ceph-mon[32880]: pgmap v165: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-03-04T09:21:02.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:21:02 smithi190 ceph-mon[36341]: pgmap v165: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-03-04T09:21:02.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:21:02 smithi102 ceph-mon[36220]: pgmap v165: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-03-04T09:21:03.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:21:03 smithi082 ceph-mon[32880]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:21:03.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:21:03 smithi190 ceph-mon[36341]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:21:03.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:21:03 smithi102 ceph-mon[36220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:21:04.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:21:04 smithi082 ceph-mon[32880]: pgmap v166: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-03-04T09:21:04.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:21:04 smithi190 ceph-mon[36341]: pgmap v166: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-03-04T09:21:04.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:21:04 smithi102 ceph-mon[36220]: pgmap v166: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-03-04T09:21:06.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:21:06 smithi082 ceph-mon[32880]: pgmap v167: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-03-04T09:21:06.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:21:06 smithi190 ceph-mon[36341]: pgmap v167: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-03-04T09:21:06.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:21:06 smithi102 ceph-mon[36220]: pgmap v167: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-03-04T09:21:07.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:21:07 smithi082 ceph-mon[32880]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:21:07.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:21:07 smithi190 ceph-mon[36341]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:21:07.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:21:07 smithi102 ceph-mon[36220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:21:08.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:21:08 smithi082 ceph-mon[32880]: pgmap v168: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-03-04T09:21:08.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:21:08 smithi190 ceph-mon[36341]: pgmap v168: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-03-04T09:21:08.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:21:08 smithi102 ceph-mon[36220]: pgmap v168: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-03-04T09:21:09.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:21:09 smithi082 ceph-mon[32880]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:21:09.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:21:09 smithi190 ceph-mon[36341]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:21:09.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:21:09 smithi102 ceph-mon[36220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:21:10.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:21:10 smithi082 ceph-mon[32880]: pgmap v169: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-03-04T09:21:10.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:21:10 smithi190 ceph-mon[36341]: pgmap v169: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-03-04T09:21:10.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:21:10 smithi102 ceph-mon[36220]: pgmap v169: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-03-04T09:21:11.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:21:11 smithi082 ceph-mon[32880]: pgmap v170: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-03-04T09:21:11.920 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:21:11 smithi190 ceph-mon[36341]: pgmap v170: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-03-04T09:21:11.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:21:11 smithi102 ceph-mon[36220]: pgmap v170: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-03-04T09:21:14.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:21:14 smithi082 ceph-mon[32880]: pgmap v171: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 170 B/s wr, 8 op/s 2024-03-04T09:21:14.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:21:14 smithi190 ceph-mon[36341]: pgmap v171: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 170 B/s wr, 8 op/s 2024-03-04T09:21:14.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:21:14 smithi102 ceph-mon[36220]: pgmap v171: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 170 B/s wr, 8 op/s 2024-03-04T09:21:16.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:21:16 smithi082 ceph-mon[32880]: pgmap v172: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 170 B/s wr, 12 op/s 2024-03-04T09:21:16.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:21:16 smithi190 ceph-mon[36341]: pgmap v172: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 170 B/s wr, 12 op/s 2024-03-04T09:21:16.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:21:16 smithi102 ceph-mon[36220]: pgmap v172: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 170 B/s wr, 12 op/s 2024-03-04T09:21:18.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:21:18 smithi082 ceph-mon[32880]: pgmap v173: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-03-04T09:21:18.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:21:18 smithi190 ceph-mon[36341]: pgmap v173: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-03-04T09:21:18.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:21:18 smithi102 ceph-mon[36220]: pgmap v173: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-03-04T09:21:20.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:21:20 smithi082 ceph-mon[32880]: pgmap v174: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-03-04T09:21:20.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:21:20 smithi082 ceph-mon[32880]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:21:20.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:21:20 smithi190 ceph-mon[36341]: pgmap v174: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-03-04T09:21:20.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:21:20 smithi190 ceph-mon[36341]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:21:20.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:21:20 smithi102 ceph-mon[36220]: pgmap v174: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-03-04T09:21:20.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:21:20 smithi102 ceph-mon[36220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:21:22.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:21:22 smithi082 ceph-mon[32880]: pgmap v175: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2024-03-04T09:21:22.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:21:22 smithi190 ceph-mon[36341]: pgmap v175: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2024-03-04T09:21:22.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:21:22 smithi102 ceph-mon[36220]: pgmap v175: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2024-03-04T09:21:23.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:21:23 smithi082 ceph-mon[32880]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:21:23.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:21:23 smithi190 ceph-mon[36341]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:21:23.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:21:23 smithi102 ceph-mon[36220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:21:24.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:21:24 smithi082 ceph-mon[32880]: pgmap v176: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:21:24.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:21:24 smithi190 ceph-mon[36341]: pgmap v176: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:21:24.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:21:24 smithi102 ceph-mon[36220]: pgmap v176: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:21:25.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:21:25 smithi082 ceph-mon[32880]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:21:25.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:21:25 smithi190 ceph-mon[36341]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:21:25.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:21:25 smithi102 ceph-mon[36220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:21:26.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:21:26 smithi082 ceph-mon[32880]: pgmap v177: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:21:26.822 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:21:26 smithi190 ceph-mon[36341]: pgmap v177: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:21:26.830 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:21:26 smithi102 ceph-mon[36220]: pgmap v177: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:21:27.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:21:27 smithi082 ceph-mon[32880]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:21:27.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:21:27 smithi082 ceph-mon[32880]: pgmap v178: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:21:27.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:21:27 smithi190 ceph-mon[36341]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:21:27.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:21:27 smithi190 ceph-mon[36341]: pgmap v178: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:21:27.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:21:27 smithi102 ceph-mon[36220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:21:27.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:21:27 smithi102 ceph-mon[36220]: pgmap v178: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:21:30.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:21:30 smithi082 ceph-mon[32880]: pgmap v179: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:21:30.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:21:30 smithi190 ceph-mon[36341]: pgmap v179: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:21:30.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:21:30 smithi102 ceph-mon[36220]: pgmap v179: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:21:32.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:21:32 smithi082 ceph-mon[32880]: pgmap v180: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:21:32.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:21:32 smithi190 ceph-mon[36341]: pgmap v180: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:21:32.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:21:32 smithi102 ceph-mon[36220]: pgmap v180: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:21:34.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:21:34 smithi082 ceph-mon[32880]: pgmap v181: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:21:34.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:21:34 smithi190 ceph-mon[36341]: pgmap v181: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:21:34.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:21:34 smithi102 ceph-mon[36220]: pgmap v181: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:21:35.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:21:35 smithi082 ceph-mon[32880]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:21:35.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:21:35 smithi190 ceph-mon[36341]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:21:35.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:21:35 smithi102 ceph-mon[36220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:21:36.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:21:36 smithi082 ceph-mon[32880]: pgmap v182: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:21:36.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:21:36 smithi190 ceph-mon[36341]: pgmap v182: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:21:36.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:21:36 smithi102 ceph-mon[36220]: pgmap v182: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:21:38.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:21:38 smithi082 ceph-mon[32880]: pgmap v183: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:21:38.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:21:38 smithi190 ceph-mon[36341]: pgmap v183: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:21:38.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:21:38 smithi102 ceph-mon[36220]: pgmap v183: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:21:40.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:21:40 smithi082 ceph-mon[32880]: pgmap v184: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:21:40.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:21:40 smithi190 ceph-mon[36341]: pgmap v184: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:21:40.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:21:40 smithi102 ceph-mon[36220]: pgmap v184: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:21:42.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:21:42 smithi082 ceph-mon[32880]: pgmap v185: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:21:42.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:21:42 smithi190 ceph-mon[36341]: pgmap v185: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:21:42.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:21:42 smithi102 ceph-mon[36220]: pgmap v185: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:21:44.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:21:44 smithi082 ceph-mon[32880]: pgmap v186: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:21:44.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:21:44 smithi082 ceph-mon[32880]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:21:44.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:21:44 smithi190 ceph-mon[36341]: pgmap v186: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:21:44.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:21:44 smithi190 ceph-mon[36341]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:21:44.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:21:44 smithi102 ceph-mon[36220]: pgmap v186: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:21:44.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:21:44 smithi102 ceph-mon[36220]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-03-04T09:21:46.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:21:46 smithi082 ceph-mon[32880]: pgmap v187: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:21:46.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:21:46 smithi190 ceph-mon[36341]: pgmap v187: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:21:46.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:21:46 smithi102 ceph-mon[36220]: pgmap v187: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:21:48.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:21:48 smithi082 ceph-mon[32880]: pgmap v188: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:21:48.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:21:48 smithi190 ceph-mon[36341]: pgmap v188: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:21:48.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:21:48 smithi102 ceph-mon[36220]: pgmap v188: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:21:49.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:21:49 smithi082 ceph-mon[32880]: pgmap v189: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:21:49.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:21:49 smithi190 ceph-mon[36341]: pgmap v189: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:21:49.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:21:49 smithi102 ceph-mon[36220]: pgmap v189: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:21:50.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:21:50 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:21:50.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:21:50 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:21:50.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:21:50 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:21:51.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:21:51 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:21:51.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:21:51 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:21:51.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:21:51 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:21:51.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:21:51 smithi082 ceph-mon[32880]: pgmap v190: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:21:51.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:21:51 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:21:51.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:21:51 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:21:51.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:21:51 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:21:51.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:21:51 smithi190 ceph-mon[36341]: pgmap v190: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:21:51.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:21:51 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:21:51.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:21:51 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:21:51.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:21:51 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:21:51.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:21:51 smithi102 ceph-mon[36220]: pgmap v190: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:21:54.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:21:54 smithi082 ceph-mon[32880]: pgmap v191: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:21:54.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:21:54 smithi190 ceph-mon[36341]: pgmap v191: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:21:54.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:21:54 smithi102 ceph-mon[36220]: pgmap v191: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:21:56.723 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:21:56 smithi190 ceph-mon[36341]: pgmap v192: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:21:56.731 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:21:56 smithi102 ceph-mon[36220]: pgmap v192: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:21:56.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:21:56 smithi082 ceph-mon[32880]: pgmap v192: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:21:58.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:21:58 smithi082 ceph-mon[32880]: pgmap v193: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:21:58.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:21:58 smithi190 ceph-mon[36341]: pgmap v193: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:21:58.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:21:58 smithi102 ceph-mon[36220]: pgmap v193: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:22:00.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:22:00 smithi082 ceph-mon[32880]: pgmap v194: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:22:00.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:22:00 smithi190 ceph-mon[36341]: pgmap v194: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:22:00.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:22:00 smithi102 ceph-mon[36220]: pgmap v194: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:22:02.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:22:02 smithi082 ceph-mon[32880]: pgmap v195: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-03-04T09:22:02.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:22:02 smithi190 ceph-mon[36341]: pgmap v195: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-03-04T09:22:02.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:22:02 smithi102 ceph-mon[36220]: pgmap v195: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-03-04T09:22:04.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:22:04 smithi082 ceph-mon[32880]: pgmap v196: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-03-04T09:22:04.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:22:04 smithi190 ceph-mon[36341]: pgmap v196: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-03-04T09:22:04.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:22:04 smithi102 ceph-mon[36220]: pgmap v196: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-03-04T09:22:06.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:22:06 smithi082 ceph-mon[32880]: pgmap v197: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 29 op/s 2024-03-04T09:22:06.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:22:06 smithi190 ceph-mon[36341]: pgmap v197: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 29 op/s 2024-03-04T09:22:06.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:22:06 smithi102 ceph-mon[36220]: pgmap v197: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 29 op/s 2024-03-04T09:22:07.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:22:07 smithi082 ceph-mon[32880]: osdmap e97: 12 total, 12 up, 12 in 2024-03-04T09:22:07.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:22:07 smithi190 ceph-mon[36341]: osdmap e97: 12 total, 12 up, 12 in 2024-03-04T09:22:07.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:22:07 smithi102 ceph-mon[36220]: osdmap e97: 12 total, 12 up, 12 in 2024-03-04T09:22:08.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:22:08 smithi082 ceph-mon[32880]: pgmap v199: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-03-04T09:22:08.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:22:08 smithi190 ceph-mon[36341]: pgmap v199: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-03-04T09:22:08.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:22:08 smithi102 ceph-mon[36220]: pgmap v199: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-03-04T09:22:10.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:22:10 smithi082 ceph-mon[32880]: pgmap v200: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-03-04T09:22:10.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:22:10 smithi190 ceph-mon[36341]: pgmap v200: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-03-04T09:22:10.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:22:10 smithi102 ceph-mon[36220]: pgmap v200: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-03-04T09:22:12.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:22:12 smithi082 ceph-mon[32880]: pgmap v201: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 27 KiB/s wr, 16 op/s 2024-03-04T09:22:12.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:22:12 smithi190 ceph-mon[36341]: pgmap v201: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 27 KiB/s wr, 16 op/s 2024-03-04T09:22:12.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:22:12 smithi102 ceph-mon[36220]: pgmap v201: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 27 KiB/s wr, 16 op/s 2024-03-04T09:22:14.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:22:14 smithi190 ceph-mon[36341]: osdmap e98: 12 total, 12 up, 12 in 2024-03-04T09:22:14.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:22:14 smithi190 ceph-mon[36341]: pgmap v203: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2024-03-04T09:22:14.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:22:14 smithi102 ceph-mon[36220]: osdmap e98: 12 total, 12 up, 12 in 2024-03-04T09:22:14.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:22:14 smithi102 ceph-mon[36220]: pgmap v203: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2024-03-04T09:22:14.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:22:14 smithi082 ceph-mon[32880]: osdmap e98: 12 total, 12 up, 12 in 2024-03-04T09:22:14.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:22:14 smithi082 ceph-mon[32880]: pgmap v203: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2024-03-04T09:22:16.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:22:16 smithi082 ceph-mon[32880]: pgmap v204: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2024-03-04T09:22:16.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:22:16 smithi190 ceph-mon[36341]: pgmap v204: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2024-03-04T09:22:16.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:22:16 smithi102 ceph-mon[36220]: pgmap v204: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2024-03-04T09:22:18.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:22:18 smithi082 ceph-mon[32880]: pgmap v205: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-03-04T09:22:18.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:22:18 smithi190 ceph-mon[36341]: pgmap v205: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-03-04T09:22:18.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:22:18 smithi102 ceph-mon[36220]: pgmap v205: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-03-04T09:22:20.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:22:20 smithi082 ceph-mon[32880]: pgmap v206: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-03-04T09:22:20.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:22:20 smithi190 ceph-mon[36341]: pgmap v206: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-03-04T09:22:20.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:22:20 smithi102 ceph-mon[36220]: pgmap v206: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-03-04T09:22:22.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:22:22 smithi082 ceph-mon[32880]: pgmap v207: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-03-04T09:22:22.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:22:22 smithi190 ceph-mon[36341]: pgmap v207: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-03-04T09:22:22.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:22:22 smithi102 ceph-mon[36220]: pgmap v207: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-03-04T09:22:24.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:22:24 smithi082 ceph-mon[32880]: pgmap v208: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 99 B/s wr, 9 op/s 2024-03-04T09:22:24.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:22:24 smithi190 ceph-mon[36341]: pgmap v208: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 99 B/s wr, 9 op/s 2024-03-04T09:22:24.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:22:24 smithi102 ceph-mon[36220]: pgmap v208: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 99 B/s wr, 9 op/s 2024-03-04T09:22:26.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:22:26 smithi082 ceph-mon[32880]: pgmap v209: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2024-03-04T09:22:26.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:22:26 smithi190 ceph-mon[36341]: pgmap v209: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2024-03-04T09:22:26.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:22:26 smithi102 ceph-mon[36220]: pgmap v209: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2024-03-04T09:22:28.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:22:28 smithi082 ceph-mon[32880]: pgmap v210: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:22:28.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:22:28 smithi190 ceph-mon[36341]: pgmap v210: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:22:28.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:22:28 smithi102 ceph-mon[36220]: pgmap v210: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:22:30.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:22:30 smithi082 ceph-mon[32880]: pgmap v211: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:22:30.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:22:30 smithi190 ceph-mon[36341]: pgmap v211: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:22:30.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:22:30 smithi102 ceph-mon[36220]: pgmap v211: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:22:32.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:22:32 smithi082 ceph-mon[32880]: pgmap v212: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:22:32.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:22:32 smithi190 ceph-mon[36341]: pgmap v212: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:22:32.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:22:32 smithi102 ceph-mon[36220]: pgmap v212: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:22:34.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:22:34 smithi082 ceph-mon[32880]: pgmap v213: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:22:34.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:22:34 smithi190 ceph-mon[36341]: pgmap v213: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:22:34.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:22:34 smithi102 ceph-mon[36220]: pgmap v213: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:22:36.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:22:36 smithi082 ceph-mon[32880]: pgmap v214: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:22:36.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:22:36 smithi190 ceph-mon[36341]: pgmap v214: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:22:36.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:22:36 smithi102 ceph-mon[36220]: pgmap v214: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:22:38.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:22:38 smithi082 ceph-mon[32880]: pgmap v215: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:22:38.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:22:38 smithi190 ceph-mon[36341]: pgmap v215: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:22:38.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:22:38 smithi102 ceph-mon[36220]: pgmap v215: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:22:40.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:22:40 smithi082 ceph-mon[32880]: pgmap v216: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:22:40.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:22:40 smithi190 ceph-mon[36341]: pgmap v216: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:22:40.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:22:40 smithi102 ceph-mon[36220]: pgmap v216: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:22:42.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:22:42 smithi082 ceph-mon[32880]: pgmap v217: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:22:42.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:22:42 smithi190 ceph-mon[36341]: pgmap v217: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:22:42.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:22:42 smithi102 ceph-mon[36220]: pgmap v217: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:22:44.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:22:44 smithi082 ceph-mon[32880]: pgmap v218: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:22:44.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:22:44 smithi190 ceph-mon[36341]: pgmap v218: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:22:44.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:22:44 smithi102 ceph-mon[36220]: pgmap v218: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:22:46.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:22:46 smithi082 ceph-mon[32880]: pgmap v219: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:22:46.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:22:46 smithi190 ceph-mon[36341]: pgmap v219: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:22:46.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:22:46 smithi102 ceph-mon[36220]: pgmap v219: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:22:47.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:22:47 smithi082 ceph-mon[32880]: pgmap v220: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:22:47.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:22:47 smithi190 ceph-mon[36341]: pgmap v220: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:22:47.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:22:47 smithi102 ceph-mon[36220]: pgmap v220: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:22:50.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:22:50 smithi082 ceph-mon[32880]: pgmap v221: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:22:50.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:22:50 smithi190 ceph-mon[36341]: pgmap v221: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:22:50.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:22:50 smithi102 ceph-mon[36220]: pgmap v221: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:22:51.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:22:51 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:22:51.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:22:51 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:22:51.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:22:51 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:22:52.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:22:52 smithi082 ceph-mon[32880]: pgmap v222: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:22:52.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:22:52 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:22:52.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:22:52 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:22:52.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:22:52 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:22:52.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:22:52 smithi190 ceph-mon[36341]: pgmap v222: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:22:52.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:22:52 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:22:52.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:22:52 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:22:52.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:22:52 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:22:52.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:22:52 smithi102 ceph-mon[36220]: pgmap v222: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:22:52.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:22:52 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:22:52.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:22:52 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:22:52.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:22:52 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:22:54.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:22:54 smithi082 ceph-mon[32880]: pgmap v223: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:22:54.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:22:54 smithi190 ceph-mon[36341]: pgmap v223: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:22:54.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:22:54 smithi102 ceph-mon[36220]: pgmap v223: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:22:56.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:22:56 smithi082 ceph-mon[32880]: pgmap v224: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:22:56.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:22:56 smithi190 ceph-mon[36341]: pgmap v224: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:22:56.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:22:56 smithi102 ceph-mon[36220]: pgmap v224: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:22:58.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:22:58 smithi082 ceph-mon[32880]: pgmap v225: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:22:58.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:22:58 smithi190 ceph-mon[36341]: pgmap v225: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:22:58.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:22:58 smithi102 ceph-mon[36220]: pgmap v225: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:23:00.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:23:00 smithi082 ceph-mon[32880]: pgmap v226: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:23:00.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:23:00 smithi190 ceph-mon[36341]: pgmap v226: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:23:00.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:23:00 smithi102 ceph-mon[36220]: pgmap v226: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:23:02.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:23:02 smithi082 ceph-mon[32880]: pgmap v227: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:23:02.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:23:02 smithi190 ceph-mon[36341]: pgmap v227: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:23:02.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:23:02 smithi102 ceph-mon[36220]: pgmap v227: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:23:04.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:23:04 smithi082 ceph-mon[32880]: pgmap v228: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:23:04.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:23:04 smithi190 ceph-mon[36341]: pgmap v228: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:23:04.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:23:04 smithi102 ceph-mon[36220]: pgmap v228: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:23:06.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:23:06 smithi082 ceph-mon[32880]: pgmap v229: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-03-04T09:23:06.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:23:06 smithi190 ceph-mon[36341]: pgmap v229: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-03-04T09:23:06.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:23:06 smithi102 ceph-mon[36220]: pgmap v229: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-03-04T09:23:07.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:23:07 smithi082 ceph-mon[32880]: osdmap e99: 12 total, 12 up, 12 in 2024-03-04T09:23:07.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:23:07 smithi082 ceph-mon[32880]: pgmap v231: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-03-04T09:23:07.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:23:07 smithi190 ceph-mon[36341]: osdmap e99: 12 total, 12 up, 12 in 2024-03-04T09:23:07.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:23:07 smithi190 ceph-mon[36341]: pgmap v231: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-03-04T09:23:07.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:23:07 smithi102 ceph-mon[36220]: osdmap e99: 12 total, 12 up, 12 in 2024-03-04T09:23:07.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:23:07 smithi102 ceph-mon[36220]: pgmap v231: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-03-04T09:23:10.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:23:10 smithi082 ceph-mon[32880]: pgmap v232: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-03-04T09:23:10.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:23:10 smithi190 ceph-mon[36341]: pgmap v232: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-03-04T09:23:10.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:23:10 smithi102 ceph-mon[36220]: pgmap v232: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-03-04T09:23:12.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:23:12 smithi082 ceph-mon[32880]: pgmap v233: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-03-04T09:23:12.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:23:12 smithi190 ceph-mon[36341]: pgmap v233: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-03-04T09:23:12.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:23:12 smithi102 ceph-mon[36220]: pgmap v233: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-03-04T09:23:14.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:23:14 smithi190 ceph-mon[36341]: osdmap e100: 12 total, 12 up, 12 in 2024-03-04T09:23:14.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:23:14 smithi190 ceph-mon[36341]: pgmap v235: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2024-03-04T09:23:14.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:23:14 smithi102 ceph-mon[36220]: osdmap e100: 12 total, 12 up, 12 in 2024-03-04T09:23:14.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:23:14 smithi102 ceph-mon[36220]: pgmap v235: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2024-03-04T09:23:14.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:23:14 smithi082 ceph-mon[32880]: osdmap e100: 12 total, 12 up, 12 in 2024-03-04T09:23:14.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:23:14 smithi082 ceph-mon[32880]: pgmap v235: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2024-03-04T09:23:16.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:23:16 smithi082 ceph-mon[32880]: pgmap v236: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2024-03-04T09:23:16.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:23:16 smithi190 ceph-mon[36341]: pgmap v236: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2024-03-04T09:23:16.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:23:16 smithi102 ceph-mon[36220]: pgmap v236: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2024-03-04T09:23:18.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:23:18 smithi082 ceph-mon[32880]: pgmap v237: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-03-04T09:23:18.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:23:18 smithi190 ceph-mon[36341]: pgmap v237: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-03-04T09:23:18.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:23:18 smithi102 ceph-mon[36220]: pgmap v237: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-03-04T09:23:20.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:23:20 smithi082 ceph-mon[32880]: pgmap v238: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-03-04T09:23:20.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:23:20 smithi190 ceph-mon[36341]: pgmap v238: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-03-04T09:23:20.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:23:20 smithi102 ceph-mon[36220]: pgmap v238: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-03-04T09:23:22.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:23:22 smithi082 ceph-mon[32880]: pgmap v239: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-03-04T09:23:22.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:23:22 smithi190 ceph-mon[36341]: pgmap v239: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-03-04T09:23:22.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:23:22 smithi102 ceph-mon[36220]: pgmap v239: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-03-04T09:23:24.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:23:24 smithi082 ceph-mon[32880]: pgmap v240: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 99 B/s wr, 9 op/s 2024-03-04T09:23:24.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:23:24 smithi190 ceph-mon[36341]: pgmap v240: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 99 B/s wr, 9 op/s 2024-03-04T09:23:24.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:23:24 smithi102 ceph-mon[36220]: pgmap v240: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 99 B/s wr, 9 op/s 2024-03-04T09:23:26.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:23:26 smithi082 ceph-mon[32880]: pgmap v241: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2024-03-04T09:23:26.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:23:26 smithi190 ceph-mon[36341]: pgmap v241: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2024-03-04T09:23:26.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:23:26 smithi102 ceph-mon[36220]: pgmap v241: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2024-03-04T09:23:28.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:23:28 smithi082 ceph-mon[32880]: pgmap v242: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:23:28.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:23:28 smithi190 ceph-mon[36341]: pgmap v242: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:23:28.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:23:28 smithi102 ceph-mon[36220]: pgmap v242: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:23:30.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:23:30 smithi082 ceph-mon[32880]: pgmap v243: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:23:30.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:23:30 smithi190 ceph-mon[36341]: pgmap v243: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:23:30.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:23:30 smithi102 ceph-mon[36220]: pgmap v243: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:23:32.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:23:32 smithi082 ceph-mon[32880]: pgmap v244: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:23:32.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:23:32 smithi190 ceph-mon[36341]: pgmap v244: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:23:32.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:23:32 smithi102 ceph-mon[36220]: pgmap v244: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:23:34.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:23:34 smithi190 ceph-mon[36341]: pgmap v245: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:23:34.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:23:34 smithi102 ceph-mon[36220]: pgmap v245: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:23:34.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:23:34 smithi082 ceph-mon[32880]: pgmap v245: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:23:36.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:23:36 smithi082 ceph-mon[32880]: pgmap v246: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:23:36.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:23:36 smithi190 ceph-mon[36341]: pgmap v246: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:23:36.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:23:36 smithi102 ceph-mon[36220]: pgmap v246: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:23:38.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:23:38 smithi082 ceph-mon[32880]: pgmap v247: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:23:38.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:23:38 smithi190 ceph-mon[36341]: pgmap v247: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:23:38.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:23:38 smithi102 ceph-mon[36220]: pgmap v247: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:23:40.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:23:40 smithi082 ceph-mon[32880]: pgmap v248: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:23:40.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:23:40 smithi190 ceph-mon[36341]: pgmap v248: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:23:40.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:23:40 smithi102 ceph-mon[36220]: pgmap v248: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:23:42.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:23:42 smithi082 ceph-mon[32880]: pgmap v249: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:23:42.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:23:42 smithi190 ceph-mon[36341]: pgmap v249: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:23:42.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:23:42 smithi102 ceph-mon[36220]: pgmap v249: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:23:44.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:23:44 smithi082 ceph-mon[32880]: pgmap v250: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:23:44.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:23:44 smithi190 ceph-mon[36341]: pgmap v250: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:23:44.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:23:44 smithi102 ceph-mon[36220]: pgmap v250: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:23:46.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:23:46 smithi082 ceph-mon[32880]: pgmap v251: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:23:46.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:23:46 smithi190 ceph-mon[36341]: pgmap v251: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:23:46.932 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:23:46 smithi102 ceph-mon[36220]: pgmap v251: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:23:48.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:23:48 smithi082 ceph-mon[32880]: pgmap v252: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:23:48.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:23:48 smithi190 ceph-mon[36341]: pgmap v252: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:23:48.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:23:48 smithi102 ceph-mon[36220]: pgmap v252: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:23:50.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:23:50 smithi082 ceph-mon[32880]: pgmap v253: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:23:50.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:23:50 smithi190 ceph-mon[36341]: pgmap v253: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:23:50.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:23:50 smithi102 ceph-mon[36220]: pgmap v253: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:23:52.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:23:52 smithi082 ceph-mon[32880]: pgmap v254: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:23:52.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:23:52 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:23:52.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:23:52 smithi190 ceph-mon[36341]: pgmap v254: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:23:52.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:23:52 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:23:52.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:23:52 smithi102 ceph-mon[36220]: pgmap v254: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:23:52.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:23:52 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:23:53.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:23:53 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:23:53.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:23:53 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:23:53.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:23:53 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:23:53.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:23:53 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:23:53.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:23:53 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:23:53.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:23:53 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:23:53.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:23:53 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:23:53.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:23:53 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:23:53.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:23:53 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:23:54.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:23:54 smithi082 ceph-mon[32880]: pgmap v255: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:23:54.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:23:54 smithi190 ceph-mon[36341]: pgmap v255: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:23:54.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:23:54 smithi102 ceph-mon[36220]: pgmap v255: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:23:56.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:23:56 smithi082 ceph-mon[32880]: pgmap v256: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:23:56.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:23:56 smithi190 ceph-mon[36341]: pgmap v256: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:23:56.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:23:56 smithi102 ceph-mon[36220]: pgmap v256: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:23:57.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:23:57 smithi082 ceph-mon[32880]: pgmap v257: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:23:57.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:23:57 smithi190 ceph-mon[36341]: pgmap v257: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:23:57.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:23:57 smithi102 ceph-mon[36220]: pgmap v257: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:24:00.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:24:00 smithi082 ceph-mon[32880]: pgmap v258: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:24:00.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:24:00 smithi190 ceph-mon[36341]: pgmap v258: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:24:00.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:24:00 smithi102 ceph-mon[36220]: pgmap v258: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:24:02.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:24:02 smithi082 ceph-mon[32880]: pgmap v259: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:24:02.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:24:02 smithi190 ceph-mon[36341]: pgmap v259: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:24:02.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:24:02 smithi102 ceph-mon[36220]: pgmap v259: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:24:04.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:24:04 smithi082 ceph-mon[32880]: pgmap v260: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:24:04.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:24:04 smithi190 ceph-mon[36341]: pgmap v260: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:24:04.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:24:04 smithi102 ceph-mon[36220]: pgmap v260: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:24:06.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:24:06 smithi082 ceph-mon[32880]: pgmap v261: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-03-04T09:24:06.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:24:06 smithi190 ceph-mon[36341]: pgmap v261: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-03-04T09:24:06.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:24:06 smithi102 ceph-mon[36220]: pgmap v261: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-03-04T09:24:07.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:24:07 smithi082 ceph-mon[32880]: osdmap e101: 12 total, 12 up, 12 in 2024-03-04T09:24:07.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:24:07 smithi190 ceph-mon[36341]: osdmap e101: 12 total, 12 up, 12 in 2024-03-04T09:24:07.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:24:07 smithi102 ceph-mon[36220]: osdmap e101: 12 total, 12 up, 12 in 2024-03-04T09:24:08.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:24:08 smithi082 ceph-mon[32880]: pgmap v263: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-03-04T09:24:08.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:24:08 smithi190 ceph-mon[36341]: pgmap v263: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-03-04T09:24:08.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:24:08 smithi102 ceph-mon[36220]: pgmap v263: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-03-04T09:24:09.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:24:09 smithi190 ceph-mon[36341]: pgmap v264: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-03-04T09:24:09.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:24:09 smithi102 ceph-mon[36220]: pgmap v264: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-03-04T09:24:10.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:24:09 smithi082 ceph-mon[32880]: pgmap v264: 129 pgs: 129 active+clean; 240 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-03-04T09:24:12.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:24:12 smithi082 ceph-mon[32880]: pgmap v265: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-03-04T09:24:12.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:24:12 smithi190 ceph-mon[36341]: pgmap v265: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-03-04T09:24:12.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:24:12 smithi102 ceph-mon[36220]: pgmap v265: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-03-04T09:24:14.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:24:14 smithi190 ceph-mon[36341]: osdmap e102: 12 total, 12 up, 12 in 2024-03-04T09:24:14.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:24:14 smithi190 ceph-mon[36341]: pgmap v267: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2024-03-04T09:24:14.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:24:14 smithi102 ceph-mon[36220]: osdmap e102: 12 total, 12 up, 12 in 2024-03-04T09:24:14.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:24:14 smithi102 ceph-mon[36220]: pgmap v267: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2024-03-04T09:24:14.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:24:14 smithi082 ceph-mon[32880]: osdmap e102: 12 total, 12 up, 12 in 2024-03-04T09:24:14.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:24:14 smithi082 ceph-mon[32880]: pgmap v267: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2024-03-04T09:24:16.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:24:16 smithi082 ceph-mon[32880]: pgmap v268: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2024-03-04T09:24:16.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:24:16 smithi190 ceph-mon[36341]: pgmap v268: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2024-03-04T09:24:16.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:24:16 smithi102 ceph-mon[36220]: pgmap v268: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 229 B/s wr, 11 op/s 2024-03-04T09:24:18.819 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:24:18 smithi082 ceph-mon[32880]: pgmap v269: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-03-04T09:24:18.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:24:18 smithi190 ceph-mon[36341]: pgmap v269: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-03-04T09:24:18.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:24:18 smithi102 ceph-mon[36220]: pgmap v269: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-03-04T09:24:20.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:24:20 smithi082 ceph-mon[32880]: pgmap v270: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-03-04T09:24:20.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:24:20 smithi190 ceph-mon[36341]: pgmap v270: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-03-04T09:24:20.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:24:20 smithi102 ceph-mon[36220]: pgmap v270: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-03-04T09:24:22.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:24:22 smithi082 ceph-mon[32880]: pgmap v271: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-03-04T09:24:22.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:24:22 smithi190 ceph-mon[36341]: pgmap v271: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-03-04T09:24:22.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:24:22 smithi102 ceph-mon[36220]: pgmap v271: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-03-04T09:24:24.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:24:24 smithi082 ceph-mon[32880]: pgmap v272: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 99 B/s wr, 9 op/s 2024-03-04T09:24:24.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:24:24 smithi190 ceph-mon[36341]: pgmap v272: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 99 B/s wr, 9 op/s 2024-03-04T09:24:24.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:24:24 smithi102 ceph-mon[36220]: pgmap v272: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 99 B/s wr, 9 op/s 2024-03-04T09:24:26.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:24:26 smithi082 ceph-mon[32880]: pgmap v273: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2024-03-04T09:24:26.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:24:26 smithi190 ceph-mon[36341]: pgmap v273: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2024-03-04T09:24:26.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:24:26 smithi102 ceph-mon[36220]: pgmap v273: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2024-03-04T09:24:28.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:24:28 smithi082 ceph-mon[32880]: pgmap v274: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:24:28.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:24:28 smithi190 ceph-mon[36341]: pgmap v274: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:24:28.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:24:28 smithi102 ceph-mon[36220]: pgmap v274: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:24:29.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:24:29 smithi190 ceph-mon[36341]: pgmap v275: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:24:29.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:24:29 smithi102 ceph-mon[36220]: pgmap v275: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:24:30.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:24:29 smithi082 ceph-mon[32880]: pgmap v275: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:24:32.770 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:24:32 smithi082 ceph-mon[32880]: pgmap v276: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:24:32.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:24:32 smithi190 ceph-mon[36341]: pgmap v276: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:24:32.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:24:32 smithi102 ceph-mon[36220]: pgmap v276: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:24:34.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:24:34 smithi082 ceph-mon[32880]: pgmap v277: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:24:34.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:24:34 smithi190 ceph-mon[36341]: pgmap v277: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:24:34.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:24:34 smithi102 ceph-mon[36220]: pgmap v277: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:24:36.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:24:36 smithi082 ceph-mon[32880]: pgmap v278: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:24:36.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:24:36 smithi190 ceph-mon[36341]: pgmap v278: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:24:36.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:24:36 smithi102 ceph-mon[36220]: pgmap v278: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:24:38.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:24:38 smithi082 ceph-mon[32880]: pgmap v279: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:24:38.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:24:38 smithi190 ceph-mon[36341]: pgmap v279: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:24:38.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:24:38 smithi102 ceph-mon[36220]: pgmap v279: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:24:40.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:24:40 smithi082 ceph-mon[32880]: pgmap v280: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:24:40.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:24:40 smithi190 ceph-mon[36341]: pgmap v280: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:24:40.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:24:40 smithi102 ceph-mon[36220]: pgmap v280: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:24:42.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:24:42 smithi082 ceph-mon[32880]: pgmap v281: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:24:42.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:24:42 smithi190 ceph-mon[36341]: pgmap v281: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:24:42.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:24:42 smithi102 ceph-mon[36220]: pgmap v281: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:24:44.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:24:44 smithi082 ceph-mon[32880]: pgmap v282: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:24:44.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:24:44 smithi190 ceph-mon[36341]: pgmap v282: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:24:44.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:24:44 smithi102 ceph-mon[36220]: pgmap v282: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:24:46.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:24:46 smithi082 ceph-mon[32880]: pgmap v283: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:24:46.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:24:46 smithi190 ceph-mon[36341]: pgmap v283: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:24:46.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:24:46 smithi102 ceph-mon[36220]: pgmap v283: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:24:47.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:24:47 smithi082 ceph-mon[32880]: pgmap v284: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:24:47.928 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:24:47 smithi190 ceph-mon[36341]: pgmap v284: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:24:47.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:24:47 smithi102 ceph-mon[36220]: pgmap v284: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:24:50.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:24:50 smithi082 ceph-mon[32880]: pgmap v285: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:24:50.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:24:50 smithi190 ceph-mon[36341]: pgmap v285: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:24:50.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:24:50 smithi102 ceph-mon[36220]: pgmap v285: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:24:52.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:24:52 smithi082 ceph-mon[32880]: pgmap v286: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:24:52.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:24:52 smithi190 ceph-mon[36341]: pgmap v286: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:24:52.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:24:52 smithi102 ceph-mon[36220]: pgmap v286: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:24:53.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:24:53 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:24:53.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:24:53 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:24:53.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:24:53 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:24:53.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:24:53 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:24:53.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:24:53 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:24:53.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:24:53 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:24:53.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:24:53 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:24:53.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:24:53 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:24:53.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:24:53 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:24:53.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:24:53 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:24:53.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:24:53 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:24:53.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:24:53 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:24:54.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:24:54 smithi082 ceph-mon[32880]: pgmap v287: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:24:54.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:24:54 smithi190 ceph-mon[36341]: pgmap v287: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:24:54.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:24:54 smithi102 ceph-mon[36220]: pgmap v287: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:24:55.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:24:55 smithi190 ceph-mon[36341]: pgmap v288: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:24:55.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:24:55 smithi102 ceph-mon[36220]: pgmap v288: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:24:56.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:24:55 smithi082 ceph-mon[32880]: pgmap v288: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:24:58.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:24:58 smithi082 ceph-mon[32880]: pgmap v289: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:24:58.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:24:58 smithi190 ceph-mon[36341]: pgmap v289: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:24:58.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:24:58 smithi102 ceph-mon[36220]: pgmap v289: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:25:00.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:00 smithi082 ceph-mon[32880]: pgmap v290: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:25:00.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:00 smithi190 ceph-mon[36341]: pgmap v290: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:25:00.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:00 smithi102 ceph-mon[36220]: pgmap v290: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:25:02.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:02 smithi082 ceph-mon[32880]: pgmap v291: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:25:02.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:02 smithi190 ceph-mon[36341]: pgmap v291: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:25:02.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:02 smithi102 ceph-mon[36220]: pgmap v291: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:25:04.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:04 smithi190 ceph-mon[36341]: pgmap v292: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:25:04.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:04 smithi102 ceph-mon[36220]: pgmap v292: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:25:04.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:04 smithi082 ceph-mon[32880]: pgmap v292: 129 pgs: 129 active+clean; 120 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:25:06.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:06 smithi082 ceph-mon[32880]: pgmap v293: 129 pgs: 129 active+clean; 120 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-03-04T09:25:06.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:06 smithi190 ceph-mon[36341]: pgmap v293: 129 pgs: 129 active+clean; 120 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-03-04T09:25:06.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:06 smithi102 ceph-mon[36220]: pgmap v293: 129 pgs: 129 active+clean; 120 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-03-04T09:25:08.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:08 smithi082 ceph-mon[32880]: pgmap v294: 129 pgs: 129 active+clean; 120 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-03-04T09:25:08.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:08 smithi190 ceph-mon[36341]: pgmap v294: 129 pgs: 129 active+clean; 120 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-03-04T09:25:08.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:08 smithi102 ceph-mon[36220]: pgmap v294: 129 pgs: 129 active+clean; 120 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-03-04T09:25:10.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:10 smithi082 ceph-mon[32880]: pgmap v295: 129 pgs: 129 active+clean; 120 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-03-04T09:25:10.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:10 smithi190 ceph-mon[36341]: pgmap v295: 129 pgs: 129 active+clean; 120 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-03-04T09:25:10.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:10 smithi102 ceph-mon[36220]: pgmap v295: 129 pgs: 129 active+clean; 120 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-03-04T09:25:12.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:12 smithi082 ceph-mon[32880]: pgmap v296: 129 pgs: 129 active+clean; 120 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-03-04T09:25:12.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:12 smithi082 ceph-mon[32880]: osdmap e103: 12 total, 12 up, 12 in 2024-03-04T09:25:12.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:12 smithi190 ceph-mon[36341]: pgmap v296: 129 pgs: 129 active+clean; 120 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-03-04T09:25:12.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:12 smithi190 ceph-mon[36341]: osdmap e103: 12 total, 12 up, 12 in 2024-03-04T09:25:12.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:12 smithi102 ceph-mon[36220]: pgmap v296: 129 pgs: 129 active+clean; 120 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-03-04T09:25:12.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:12 smithi102 ceph-mon[36220]: osdmap e103: 12 total, 12 up, 12 in 2024-03-04T09:25:13.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:13 smithi082 ceph-mon[32880]: pgmap v298: 129 pgs: 129 active+clean; 120 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-03-04T09:25:13.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:13 smithi190 ceph-mon[36341]: pgmap v298: 129 pgs: 129 active+clean; 120 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-03-04T09:25:13.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:13 smithi102 ceph-mon[36220]: pgmap v298: 129 pgs: 129 active+clean; 120 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-03-04T09:25:16.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:16 smithi082 ceph-mon[32880]: pgmap v299: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-03-04T09:25:16.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:16 smithi190 ceph-mon[36341]: pgmap v299: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-03-04T09:25:16.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:16 smithi102 ceph-mon[36220]: pgmap v299: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-03-04T09:25:18.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:18 smithi082 ceph-mon[32880]: pgmap v300: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-03-04T09:25:18.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:18 smithi082 ceph-mon[32880]: osdmap e104: 12 total, 12 up, 12 in 2024-03-04T09:25:18.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:18 smithi190 ceph-mon[36341]: pgmap v300: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-03-04T09:25:18.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:18 smithi190 ceph-mon[36341]: osdmap e104: 12 total, 12 up, 12 in 2024-03-04T09:25:18.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:18 smithi102 ceph-mon[36220]: pgmap v300: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-03-04T09:25:18.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:18 smithi102 ceph-mon[36220]: osdmap e104: 12 total, 12 up, 12 in 2024-03-04T09:25:20.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:20 smithi082 ceph-mon[32880]: pgmap v302: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2024-03-04T09:25:20.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:20 smithi190 ceph-mon[36341]: pgmap v302: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2024-03-04T09:25:20.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:20 smithi102 ceph-mon[36220]: pgmap v302: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2024-03-04T09:25:22.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:22 smithi082 ceph-mon[32880]: pgmap v303: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 309 B/s wr, 10 op/s 2024-03-04T09:25:22.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:22 smithi190 ceph-mon[36341]: pgmap v303: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 309 B/s wr, 10 op/s 2024-03-04T09:25:22.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:22 smithi102 ceph-mon[36220]: pgmap v303: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 309 B/s wr, 10 op/s 2024-03-04T09:25:24.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:24 smithi082 ceph-mon[32880]: pgmap v304: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2024-03-04T09:25:24.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:24 smithi190 ceph-mon[36341]: pgmap v304: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2024-03-04T09:25:24.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:24 smithi102 ceph-mon[36220]: pgmap v304: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2024-03-04T09:25:25.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:25 smithi082 ceph-mon[32880]: pgmap v305: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2024-03-04T09:25:25.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:25 smithi190 ceph-mon[36341]: pgmap v305: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2024-03-04T09:25:25.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:25 smithi102 ceph-mon[36220]: pgmap v305: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2024-03-04T09:25:28.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:28 smithi082 ceph-mon[32880]: pgmap v306: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2024-03-04T09:25:28.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:28 smithi190 ceph-mon[36341]: pgmap v306: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2024-03-04T09:25:28.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:28 smithi102 ceph-mon[36220]: pgmap v306: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2024-03-04T09:25:30.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:30 smithi082 ceph-mon[32880]: pgmap v307: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 180 B/s wr, 9 op/s 2024-03-04T09:25:30.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:30 smithi190 ceph-mon[36341]: pgmap v307: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 180 B/s wr, 9 op/s 2024-03-04T09:25:30.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:30 smithi102 ceph-mon[36220]: pgmap v307: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 180 B/s wr, 9 op/s 2024-03-04T09:25:32.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:32 smithi082 ceph-mon[32880]: pgmap v308: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2024-03-04T09:25:32.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:32 smithi190 ceph-mon[36341]: pgmap v308: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2024-03-04T09:25:32.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:32 smithi102 ceph-mon[36220]: pgmap v308: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2024-03-04T09:25:33.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:33 smithi190 ceph-mon[36341]: pgmap v309: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:25:34.141 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:33 smithi082 ceph-mon[32880]: pgmap v309: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:25:34.142 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:33 smithi102 ceph-mon[36220]: pgmap v309: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:25:36.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:36 smithi082 ceph-mon[32880]: pgmap v310: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:25:36.923 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:36 smithi190 ceph-mon[36341]: pgmap v310: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:25:36.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:36 smithi102 ceph-mon[36220]: pgmap v310: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:25:38.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:38 smithi082 ceph-mon[32880]: pgmap v311: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:25:38.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:38 smithi190 ceph-mon[36341]: pgmap v311: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:25:38.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:38 smithi102 ceph-mon[36220]: pgmap v311: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:25:40.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:40 smithi082 ceph-mon[32880]: pgmap v312: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:25:40.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:40 smithi190 ceph-mon[36341]: pgmap v312: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:25:40.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:40 smithi102 ceph-mon[36220]: pgmap v312: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:25:41.762 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-03-04T09:25:41.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:41.880+0000 7fed6c38c640 1 -- 172.21.15.82:0/997556448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed64100720 msgr2=0x7fed64100ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:25:41.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:41.880+0000 7fed6c38c640 1 --2- 172.21.15.82:0/997556448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed64100720 0x7fed64100ba0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fed54009930 tx=0x7fed5402bc30 comp rx=0 tx=0).stop 2024-03-04T09:25:41.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:41.880+0000 7fed6c38c640 1 -- 172.21.15.82:0/997556448 shutdown_connections 2024-03-04T09:25:41.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:41.880+0000 7fed6c38c640 1 --2- 172.21.15.82:0/997556448 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed641010e0 0x7fed6410d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:41.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:41.880+0000 7fed6c38c640 1 --2- 172.21.15.82:0/997556448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed64100720 0x7fed64100ba0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:41.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:41.880+0000 7fed6c38c640 1 --2- 172.21.15.82:0/997556448 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed64106600 0x7fed641069e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:41.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:41.880+0000 7fed6c38c640 1 -- 172.21.15.82:0/997556448 >> 172.21.15.82:0/997556448 conn(0x7fed64077330 msgr2=0x7fed64077740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:25:41.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:41.880+0000 7fed6c38c640 1 -- 172.21.15.82:0/997556448 shutdown_connections 2024-03-04T09:25:41.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:41.880+0000 7fed6c38c640 1 -- 172.21.15.82:0/997556448 wait complete. 2024-03-04T09:25:41.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:41.881+0000 7fed6c38c640 1 Processor -- start 2024-03-04T09:25:41.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:41.881+0000 7fed6c38c640 1 -- start start 2024-03-04T09:25:41.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:41.881+0000 7fed6c38c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed64100720 0x7fed64197de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:25:41.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:41.881+0000 7fed6c38c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed641010e0 0x7fed64198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:25:41.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:41.881+0000 7fed6c38c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed64106600 0x7fed6419c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:25:41.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:41.881+0000 7fed6c38c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed64110930 con 0x7fed64100720 2024-03-04T09:25:41.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:41.881+0000 7fed6c38c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed641107b0 con 0x7fed641010e0 2024-03-04T09:25:41.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:41.881+0000 7fed6c38c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed64110ab0 con 0x7fed64106600 2024-03-04T09:25:41.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:41.881+0000 7fed6a128640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed64100720 0x7fed64197de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:25:41.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:41.881+0000 7fed6a128640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed64100720 0x7fed64197de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39320/0 (socket says 172.21.15.82:39320) 2024-03-04T09:25:41.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:41.881+0000 7fed6a128640 1 -- 172.21.15.82:0/1594978386 learned_addr learned my addr 172.21.15.82:0/1594978386 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:25:41.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:41.881+0000 7fed6a929640 1 --2- 172.21.15.82:0/1594978386 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed64106600 0x7fed6419c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:25:41.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:41.881+0000 7fed69927640 1 --2- 172.21.15.82:0/1594978386 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed641010e0 0x7fed64198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:25:41.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:41.882+0000 7fed6a128640 1 -- 172.21.15.82:0/1594978386 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed64106600 msgr2=0x7fed6419c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:25:41.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:41.882+0000 7fed6a128640 1 --2- 172.21.15.82:0/1594978386 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed64106600 0x7fed6419c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:41.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:41.882+0000 7fed6a128640 1 -- 172.21.15.82:0/1594978386 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed641010e0 msgr2=0x7fed64198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:25:41.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:41.882+0000 7fed6a128640 1 --2- 172.21.15.82:0/1594978386 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed641010e0 0x7fed64198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:41.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:41.882+0000 7fed6a128640 1 -- 172.21.15.82:0/1594978386 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed6419cdd0 con 0x7fed64100720 2024-03-04T09:25:41.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:41.882+0000 7fed6a128640 1 --2- 172.21.15.82:0/1594978386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed64100720 0x7fed64197de0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fed6000e9f0 tx=0x7fed6000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:25:41.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:41.882+0000 7fed5b7fe640 1 -- 172.21.15.82:0/1594978386 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed6000cd80 con 0x7fed64100720 2024-03-04T09:25:41.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:41.882+0000 7fed5b7fe640 1 -- 172.21.15.82:0/1594978386 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fed60010900 con 0x7fed64100720 2024-03-04T09:25:41.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:41.882+0000 7fed6c38c640 1 -- 172.21.15.82:0/1594978386 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed6419d0c0 con 0x7fed64100720 2024-03-04T09:25:41.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:41.882+0000 7fed5b7fe640 1 -- 172.21.15.82:0/1594978386 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed600189e0 con 0x7fed64100720 2024-03-04T09:25:41.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:41.882+0000 7fed6c38c640 1 -- 172.21.15.82:0/1594978386 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed641a4950 con 0x7fed64100720 2024-03-04T09:25:41.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:41.883+0000 7fed6c38c640 1 -- 172.21.15.82:0/1594978386 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed64101be0 con 0x7fed64100720 2024-03-04T09:25:41.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:41.884+0000 7fed5b7fe640 1 -- 172.21.15.82:0/1594978386 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 136887+0+0 (secure 0 0 0) 0x7fed60010ab0 con 0x7fed64100720 2024-03-04T09:25:41.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:41.885+0000 7fed5b7fe640 1 --2- 172.21.15.82:0/1594978386 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7fed500a1f90 0x7fed500a4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:25:41.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:41.885+0000 7fed69927640 1 --2- 172.21.15.82:0/1594978386 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7fed500a1f90 0x7fed500a4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:25:41.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:41.885+0000 7fed5b7fe640 1 -- 172.21.15.82:0/1594978386 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 9568+0+0 (secure 0 0 0) 0x7fed600cedb0 con 0x7fed64100720 2024-03-04T09:25:41.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:41.885+0000 7fed69927640 1 --2- 172.21.15.82:0/1594978386 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7fed500a1f90 0x7fed500a4450 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fed54000c00 tx=0x7fed54005fd0 comp rx=0 tx=0).ready entity=mgr.15543 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:25:41.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:41.889+0000 7fed5b7fe640 1 -- 172.21.15.82:0/1594978386 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fed6009b440 con 0x7fed64100720 2024-03-04T09:25:41.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:41 smithi190 ceph-mon[36341]: pgmap v313: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:25:41.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:41 smithi102 ceph-mon[36220]: pgmap v313: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:25:42.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:41 smithi082 ceph-mon[32880]: pgmap v313: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:25:42.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.084+0000 7fed6c38c640 1 -- 172.21.15.82:0/1594978386 --> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) v1 -- 0x7fed64104270 con 0x7fed500a1f90 2024-03-04T09:25:42.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.090+0000 7fed5b7fe640 1 -- 172.21.15.82:0/1594978386 <== mgr.15543 v2:172.21.15.82:6800/662455866 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+350 (secure 0 0 0) 0x7fed64104270 con 0x7fed500a1f90 2024-03-04T09:25:42.087 INFO:teuthology.orchestra.run.smithi082.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-03-04T00:00:00", "created": "2024-03-04T09:15:40", "first": "2024-03-04T09:16:00", "last": "2024-03-04T09:25:00", "last_pruned": "2024-03-04T09:25:00", "created_count": 10, "pruned_count": 4, "active": true} 2024-03-04T09:25:42.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.092+0000 7fed6c38c640 1 -- 172.21.15.82:0/1594978386 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7fed500a1f90 msgr2=0x7fed500a4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:25:42.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.092+0000 7fed6c38c640 1 --2- 172.21.15.82:0/1594978386 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7fed500a1f90 0x7fed500a4450 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fed54000c00 tx=0x7fed54005fd0 comp rx=0 tx=0).stop 2024-03-04T09:25:42.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.092+0000 7fed6c38c640 1 -- 172.21.15.82:0/1594978386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed64100720 msgr2=0x7fed64197de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:25:42.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.092+0000 7fed6c38c640 1 --2- 172.21.15.82:0/1594978386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed64100720 0x7fed64197de0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fed6000e9f0 tx=0x7fed6000eeb0 comp rx=0 tx=0).stop 2024-03-04T09:25:42.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.092+0000 7fed6c38c640 1 -- 172.21.15.82:0/1594978386 shutdown_connections 2024-03-04T09:25:42.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.092+0000 7fed6c38c640 1 --2- 172.21.15.82:0/1594978386 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7fed500a1f90 0x7fed500a4450 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:42.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.092+0000 7fed6c38c640 1 --2- 172.21.15.82:0/1594978386 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed64106600 0x7fed6419c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:42.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.092+0000 7fed6c38c640 1 --2- 172.21.15.82:0/1594978386 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed641010e0 0x7fed64198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:42.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.092+0000 7fed6c38c640 1 --2- 172.21.15.82:0/1594978386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed64100720 0x7fed64197de0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:42.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.092+0000 7fed6c38c640 1 -- 172.21.15.82:0/1594978386 >> 172.21.15.82:0/1594978386 conn(0x7fed64077330 msgr2=0x7fed640ff920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:25:42.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.093+0000 7fed6c38c640 1 -- 172.21.15.82:0/1594978386 shutdown_connections 2024-03-04T09:25:42.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.093+0000 7fed6c38c640 1 -- 172.21.15.82:0/1594978386 wait complete. 2024-03-04T09:25:42.099 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-03-04T09:25:42.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.207+0000 7f7f0b95e640 1 -- 172.21.15.82:0/3778363271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f0406a790 msgr2=0x7f7f0410e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:25:42.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.207+0000 7f7f0b95e640 1 --2- 172.21.15.82:0/3778363271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f0406a790 0x7f7f0410e430 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f7efc009ca0 tx=0x7f7efc02c0f0 comp rx=0 tx=0).stop 2024-03-04T09:25:42.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.207+0000 7f7f0b95e640 1 -- 172.21.15.82:0/3778363271 shutdown_connections 2024-03-04T09:25:42.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.207+0000 7f7f0b95e640 1 --2- 172.21.15.82:0/3778363271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f0406a790 0x7f7f0410e430 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:42.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.207+0000 7f7f0b95e640 1 --2- 172.21.15.82:0/3778363271 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f04069dd0 0x7f7f0406a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:42.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.207+0000 7f7f0b95e640 1 --2- 172.21.15.82:0/3778363271 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f041076b0 0x7f7f04107a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:42.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.207+0000 7f7f0b95e640 1 -- 172.21.15.82:0/3778363271 >> 172.21.15.82:0/3778363271 conn(0x7f7f040772a0 msgr2=0x7f7f040776b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:25:42.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.208+0000 7f7f0b95e640 1 -- 172.21.15.82:0/3778363271 shutdown_connections 2024-03-04T09:25:42.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.208+0000 7f7f0b95e640 1 -- 172.21.15.82:0/3778363271 wait complete. 2024-03-04T09:25:42.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.208+0000 7f7f0b95e640 1 Processor -- start 2024-03-04T09:25:42.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.208+0000 7f7f0b95e640 1 -- start start 2024-03-04T09:25:42.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.208+0000 7f7f0b95e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f04069dd0 0x7f7f0419d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:25:42.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.208+0000 7f7f0b95e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f0406a790 0x7f7f0419de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:25:42.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.208+0000 7f7f0b95e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f041076b0 0x7f7f04197b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:25:42.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.208+0000 7f7f0b95e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f04111980 con 0x7f7f041076b0 2024-03-04T09:25:42.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.208+0000 7f7f0b95e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f04111800 con 0x7f7f0406a790 2024-03-04T09:25:42.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.208+0000 7f7f0b95e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f04111b00 con 0x7f7f04069dd0 2024-03-04T09:25:42.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.208+0000 7f7f09efb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f041076b0 0x7f7f04197b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:25:42.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.208+0000 7f7f096fa640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f04069dd0 0x7f7f0419d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:25:42.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.208+0000 7f7f09efb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f041076b0 0x7f7f04197b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39332/0 (socket says 172.21.15.82:39332) 2024-03-04T09:25:42.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.208+0000 7f7f08ef9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f0406a790 0x7f7f0419de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:25:42.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.208+0000 7f7f096fa640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f04069dd0 0x7f7f0419d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.82:41098/0 (socket says 172.21.15.82:41098) 2024-03-04T09:25:42.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.208+0000 7f7f09efb640 1 -- 172.21.15.82:0/3621883172 learned_addr learned my addr 172.21.15.82:0/3621883172 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:25:42.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.209+0000 7f7f09efb640 1 -- 172.21.15.82:0/3621883172 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f04069dd0 msgr2=0x7f7f0419d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:25:42.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.209+0000 7f7f09efb640 1 --2- 172.21.15.82:0/3621883172 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f04069dd0 0x7f7f0419d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:42.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.209+0000 7f7f09efb640 1 -- 172.21.15.82:0/3621883172 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f0406a790 msgr2=0x7f7f0419de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:25:42.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.209+0000 7f7f09efb640 1 --2- 172.21.15.82:0/3621883172 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f0406a790 0x7f7f0419de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:42.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.209+0000 7f7f09efb640 1 -- 172.21.15.82:0/3621883172 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f04198280 con 0x7f7f041076b0 2024-03-04T09:25:42.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.209+0000 7f7f09efb640 1 --2- 172.21.15.82:0/3621883172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f041076b0 0x7f7f04197b00 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f7efc005cc0 tx=0x7f7efc034ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:25:42.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.209+0000 7f7efa7fc640 1 -- 172.21.15.82:0/3621883172 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc039050 con 0x7f7f041076b0 2024-03-04T09:25:42.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.209+0000 7f7efa7fc640 1 -- 172.21.15.82:0/3621883172 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f7efc03a040 con 0x7f7f041076b0 2024-03-04T09:25:42.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.209+0000 7f7f0b95e640 1 -- 172.21.15.82:0/3621883172 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f04198510 con 0x7f7f041076b0 2024-03-04T09:25:42.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.209+0000 7f7efa7fc640 1 -- 172.21.15.82:0/3621883172 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc004590 con 0x7f7f041076b0 2024-03-04T09:25:42.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.209+0000 7f7f0b95e640 1 -- 172.21.15.82:0/3621883172 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f041a4810 con 0x7f7f041076b0 2024-03-04T09:25:42.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.210+0000 7f7f0b95e640 1 -- 172.21.15.82:0/3621883172 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f04102cd0 con 0x7f7f041076b0 2024-03-04T09:25:42.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.211+0000 7f7efa7fc640 1 -- 172.21.15.82:0/3621883172 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 136887+0+0 (secure 0 0 0) 0x7f7efc003970 con 0x7f7f041076b0 2024-03-04T09:25:42.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.211+0000 7f7efa7fc640 1 --2- 172.21.15.82:0/3621883172 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f7ef00a1f90 0x7f7ef00a4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:25:42.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.212+0000 7f7f096fa640 1 --2- 172.21.15.82:0/3621883172 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f7ef00a1f90 0x7f7ef00a4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:25:42.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.212+0000 7f7efa7fc640 1 -- 172.21.15.82:0/3621883172 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 9568+0+0 (secure 0 0 0) 0x7f7efc0f0ba0 con 0x7f7f041076b0 2024-03-04T09:25:42.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.212+0000 7f7f096fa640 1 --2- 172.21.15.82:0/3621883172 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f7ef00a1f90 0x7f7ef00a4450 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7f00009bd0 tx=0x7f7f00005f90 comp rx=0 tx=0).ready entity=mgr.15543 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:25:42.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.216+0000 7f7efa7fc640 1 -- 172.21.15.82:0/3621883172 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f7efc0bd990 con 0x7f7f041076b0 2024-03-04T09:25:42.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.412+0000 7f7f0b95e640 1 -- 172.21.15.82:0/3621883172 --> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f7f040ff7d0 con 0x7f7ef00a1f90 2024-03-04T09:25:42.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.418+0000 7f7efa7fc640 1 -- 172.21.15.82:0/3621883172 <== mgr.15543 v2:172.21.15.82:6800/662455866 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+10 (secure 0 0 0) 0x7f7f040ff7d0 con 0x7f7ef00a1f90 2024-03-04T09:25:42.415 INFO:teuthology.orchestra.run.smithi082.stdout:/ 1m 6m3h 2024-03-04T09:25:42.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.420+0000 7f7f0b95e640 1 -- 172.21.15.82:0/3621883172 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f7ef00a1f90 msgr2=0x7f7ef00a4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:25:42.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.420+0000 7f7f0b95e640 1 --2- 172.21.15.82:0/3621883172 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f7ef00a1f90 0x7f7ef00a4450 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7f00009bd0 tx=0x7f7f00005f90 comp rx=0 tx=0).stop 2024-03-04T09:25:42.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.420+0000 7f7f0b95e640 1 -- 172.21.15.82:0/3621883172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f041076b0 msgr2=0x7f7f04197b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:25:42.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.420+0000 7f7f0b95e640 1 --2- 172.21.15.82:0/3621883172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f041076b0 0x7f7f04197b00 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f7efc005cc0 tx=0x7f7efc034ac0 comp rx=0 tx=0).stop 2024-03-04T09:25:42.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.420+0000 7f7f0b95e640 1 -- 172.21.15.82:0/3621883172 shutdown_connections 2024-03-04T09:25:42.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.420+0000 7f7f0b95e640 1 --2- 172.21.15.82:0/3621883172 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f7ef00a1f90 0x7f7ef00a4450 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:42.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.420+0000 7f7f0b95e640 1 --2- 172.21.15.82:0/3621883172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f041076b0 0x7f7f04197b00 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:42.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.420+0000 7f7f0b95e640 1 --2- 172.21.15.82:0/3621883172 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f0406a790 0x7f7f0419de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:42.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.420+0000 7f7f0b95e640 1 --2- 172.21.15.82:0/3621883172 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f04069dd0 0x7f7f0419d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:42.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.420+0000 7f7f0b95e640 1 -- 172.21.15.82:0/3621883172 >> 172.21.15.82:0/3621883172 conn(0x7f7f040772a0 msgr2=0x7f7f040ff0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:25:42.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.420+0000 7f7f0b95e640 1 -- 172.21.15.82:0/3621883172 shutdown_connections 2024-03-04T09:25:42.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.420+0000 7f7f0b95e640 1 -- 172.21.15.82:0/3621883172 wait complete. 2024-03-04T09:25:42.427 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-03-04T09:25:42.438 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T09:25:42.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.543+0000 7f8c51972640 1 -- 172.21.15.82:0/1694131113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c4c107660 msgr2=0x7f8c4c107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:25:42.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.543+0000 7f8c51972640 1 --2- 172.21.15.82:0/1694131113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c4c107660 0x7f8c4c107a40 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c009900 tx=0x7f8c3c02bc30 comp rx=0 tx=0).stop 2024-03-04T09:25:42.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.543+0000 7f8c51972640 1 -- 172.21.15.82:0/1694131113 shutdown_connections 2024-03-04T09:25:42.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.543+0000 7f8c51972640 1 --2- 172.21.15.82:0/1694131113 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8c4c101f60 0x7f8c4c10e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:42.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.543+0000 7f8c51972640 1 --2- 172.21.15.82:0/1694131113 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c4c1015a0 0x7f8c4c101a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:42.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.543+0000 7f8c51972640 1 --2- 172.21.15.82:0/1694131113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c4c107660 0x7f8c4c107a40 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:42.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.543+0000 7f8c51972640 1 -- 172.21.15.82:0/1694131113 >> 172.21.15.82:0/1694131113 conn(0x7f8c4c0fd010 msgr2=0x7f8c4c0ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:25:42.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.543+0000 7f8c51972640 1 -- 172.21.15.82:0/1694131113 shutdown_connections 2024-03-04T09:25:42.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.543+0000 7f8c51972640 1 -- 172.21.15.82:0/1694131113 wait complete. 2024-03-04T09:25:42.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.544+0000 7f8c51972640 1 Processor -- start 2024-03-04T09:25:42.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.544+0000 7f8c51972640 1 -- start start 2024-03-04T09:25:42.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.544+0000 7f8c51972640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c4c1015a0 0x7f8c4c197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:25:42.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.544+0000 7f8c51972640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8c4c101f60 0x7f8c4c198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:25:42.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.544+0000 7f8c51972640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c4c107660 0x7f8c4c19c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:25:42.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.544+0000 7f8c51972640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4c111930 con 0x7f8c4c107660 2024-03-04T09:25:42.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.544+0000 7f8c51972640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4c1117b0 con 0x7f8c4c1015a0 2024-03-04T09:25:42.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.544+0000 7f8c51972640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4c111ab0 con 0x7f8c4c101f60 2024-03-04T09:25:42.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.544+0000 7f8c4b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c4c107660 0x7f8c4c19c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:25:42.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.544+0000 7f8c4b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c4c107660 0x7f8c4c19c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39350/0 (socket says 172.21.15.82:39350) 2024-03-04T09:25:42.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.544+0000 7f8c4b7fe640 1 -- 172.21.15.82:0/2603135183 learned_addr learned my addr 172.21.15.82:0/2603135183 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:25:42.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.544+0000 7f8c43fff640 1 --2- 172.21.15.82:0/2603135183 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8c4c101f60 0x7f8c4c198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:25:42.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.544+0000 7f8c4affd640 1 --2- 172.21.15.82:0/2603135183 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c4c1015a0 0x7f8c4c197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:25:42.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.544+0000 7f8c4b7fe640 1 -- 172.21.15.82:0/2603135183 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8c4c101f60 msgr2=0x7f8c4c198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:25:42.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.544+0000 7f8c4b7fe640 1 --2- 172.21.15.82:0/2603135183 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8c4c101f60 0x7f8c4c198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:42.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.544+0000 7f8c4b7fe640 1 -- 172.21.15.82:0/2603135183 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c4c1015a0 msgr2=0x7f8c4c197df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:25:42.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.544+0000 7f8c4b7fe640 1 --2- 172.21.15.82:0/2603135183 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c4c1015a0 0x7f8c4c197df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:42.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.544+0000 7f8c4b7fe640 1 -- 172.21.15.82:0/2603135183 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c4c19cde0 con 0x7f8c4c107660 2024-03-04T09:25:42.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.545+0000 7f8c4b7fe640 1 --2- 172.21.15.82:0/2603135183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c4c107660 0x7f8c4c19c6b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f8c4400eb10 tx=0x7f8c4400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:25:42.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.545+0000 7f8c50970640 1 -- 172.21.15.82:0/2603135183 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c44004b20 con 0x7f8c4c107660 2024-03-04T09:25:42.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.545+0000 7f8c50970640 1 -- 172.21.15.82:0/2603135183 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f8c44004cc0 con 0x7f8c4c107660 2024-03-04T09:25:42.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.545+0000 7f8c51972640 1 -- 172.21.15.82:0/2603135183 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c4c19d0d0 con 0x7f8c4c107660 2024-03-04T09:25:42.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.545+0000 7f8c50970640 1 -- 172.21.15.82:0/2603135183 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c44010700 con 0x7f8c4c107660 2024-03-04T09:25:42.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.545+0000 7f8c51972640 1 -- 172.21.15.82:0/2603135183 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c4c1a4960 con 0x7f8c4c107660 2024-03-04T09:25:42.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.546+0000 7f8c51972640 1 -- 172.21.15.82:0/2603135183 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c4c068810 con 0x7f8c4c107660 2024-03-04T09:25:42.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.547+0000 7f8c50970640 1 -- 172.21.15.82:0/2603135183 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 136887+0+0 (secure 0 0 0) 0x7f8c44004e70 con 0x7f8c4c107660 2024-03-04T09:25:42.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.547+0000 7f8c50970640 1 --2- 172.21.15.82:0/2603135183 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f8c380a1ef0 0x7f8c380a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:25:42.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.547+0000 7f8c50970640 1 -- 172.21.15.82:0/2603135183 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 9568+0+0 (secure 0 0 0) 0x7f8c440cecf0 con 0x7f8c4c107660 2024-03-04T09:25:42.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.547+0000 7f8c4affd640 1 --2- 172.21.15.82:0/2603135183 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f8c380a1ef0 0x7f8c380a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:25:42.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.548+0000 7f8c4affd640 1 --2- 172.21.15.82:0/2603135183 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f8c380a1ef0 0x7f8c380a43b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c006010 tx=0x7f8c3c005dd0 comp rx=0 tx=0).ready entity=mgr.15543 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:25:42.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.551+0000 7f8c50970640 1 -- 172.21.15.82:0/2603135183 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f8c44053280 con 0x7f8c4c107660 2024-03-04T09:25:42.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.728+0000 7f8c51972640 1 -- 172.21.15.82:0/2603135183 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c4c1094c0 con 0x7f8c4c107660 2024-03-04T09:25:42.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.729+0000 7f8c50970640 1 -- 172.21.15.82:0/2603135183 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) v1 ==== 74+0+25384 (secure 0 0 0) 0x7f8c4409b9d0 con 0x7f8c4c107660 2024-03-04T09:25:42.726 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:25:42.727 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":104,"fsid":"2e533fc8-da06-11ee-95c6-87774f69a715","created":"2024-03-04T09:05:16.488249+0000","modified":"2024-03-04T09:25:18.166323+0000","last_up_change":"2024-03-04T09:12:22.308711+0000","last_in_change":"2024-03-04T09:12:02.548212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T09:08:36.508257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T09:13:07.981726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T09:13:09.289799+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":103,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-04T09:13:13.008516+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":103,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"085b5c4b-ede9-4d0d-b994-50c89d991012","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6803","nonce":709655235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6805","nonce":709655235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6809","nonce":709655235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6807","nonce":709655235}]},"public_addr":"172.21.15.82:6803/709655235","cluster_addr":"172.21.15.82:6805/709655235","heartbeat_back_addr":"172.21.15.82:6809/709655235","heartbeat_front_addr":"172.21.15.82:6807/709655235","state":["exists","up"]},{"osd":1,"uuid":"e4dd7079-333e-4bcf-b3af-11fb082a5af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6801","nonce":270721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6803","nonce":270721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6807","nonce":270721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6805","nonce":270721212}]},"public_addr":"172.21.15.102:6801/270721212","cluster_addr":"172.21.15.102:6803/270721212","heartbeat_back_addr":"172.21.15.102:6807/270721212","heartbeat_front_addr":"172.21.15.102:6805/270721212","state":["exists","up"]},{"osd":2,"uuid":"6fed5fd6-dc82-497f-9d69-c10a5e5802da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6801","nonce":946410459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6803","nonce":946410459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6807","nonce":946410459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6805","nonce":946410459}]},"public_addr":"172.21.15.190:6801/946410459","cluster_addr":"172.21.15.190:6803/946410459","heartbeat_back_addr":"172.21.15.190:6807/946410459","heartbeat_front_addr":"172.21.15.190:6805/946410459","state":["exists","up"]},{"osd":3,"uuid":"91ccbdc3-3da6-4d39-8a89-3a7b7bb4adc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6811","nonce":980870924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6813","nonce":980870924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6817","nonce":980870924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6815","nonce":980870924}]},"public_addr":"172.21.15.82:6811/980870924","cluster_addr":"172.21.15.82:6813/980870924","heartbeat_back_addr":"172.21.15.82:6817/980870924","heartbeat_front_addr":"172.21.15.82:6815/980870924","state":["exists","up"]},{"osd":4,"uuid":"dbb9d486-5daa-4819-bbed-04fc76ca473e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6809","nonce":1229627753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6811","nonce":1229627753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6815","nonce":1229627753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6813","nonce":1229627753}]},"public_addr":"172.21.15.102:6809/1229627753","cluster_addr":"172.21.15.102:6811/1229627753","heartbeat_back_addr":"172.21.15.102:6815/1229627753","heartbeat_front_addr":"172.21.15.102:6813/1229627753","state":["exists","up"]},{"osd":5,"uuid":"6b50127b-df2b-4c95-8e53-9d42b40273fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6809","nonce":2171194148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6811","nonce":2171194148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6815","nonce":2171194148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6813","nonce":2171194148}]},"public_addr":"172.21.15.190:6809/2171194148","cluster_addr":"172.21.15.190:6811/2171194148","heartbeat_back_addr":"172.21.15.190:6815/2171194148","heartbeat_front_addr":"172.21.15.190:6813/2171194148","state":["exists","up"]},{"osd":6,"uuid":"e72bebb0-5939-4210-950a-41c25c23c62f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6819","nonce":454436959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6821","nonce":454436959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6825","nonce":454436959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6823","nonce":454436959}]},"public_addr":"172.21.15.82:6819/454436959","cluster_addr":"172.21.15.82:6821/454436959","heartbeat_back_addr":"172.21.15.82:6825/454436959","heartbeat_front_addr":"172.21.15.82:6823/454436959","state":["exists","up"]},{"osd":7,"uuid":"72f83f97-f496-4503-8284-6a7b8f99a6f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6817","nonce":2745057274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6819","nonce":2745057274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6823","nonce":2745057274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6821","nonce":2745057274}]},"public_addr":"172.21.15.102:6817/2745057274","cluster_addr":"172.21.15.102:6819/2745057274","heartbeat_back_addr":"172.21.15.102:6823/2745057274","heartbeat_front_addr":"172.21.15.102:6821/2745057274","state":["exists","up"]},{"osd":8,"uuid":"92c9109d-6ebb-4c50-9944-28cd7b2f9c0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6817","nonce":1679683516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6819","nonce":1679683516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6823","nonce":1679683516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6821","nonce":1679683516}]},"public_addr":"172.21.15.190:6817/1679683516","cluster_addr":"172.21.15.190:6819/1679683516","heartbeat_back_addr":"172.21.15.190:6823/1679683516","heartbeat_front_addr":"172.21.15.190:6821/1679683516","state":["exists","up"]},{"osd":9,"uuid":"a3cfce03-0148-475d-bf55-b8284ae1cad2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6827","nonce":1777272933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6829","nonce":1777272933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6833","nonce":1777272933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6831","nonce":1777272933}]},"public_addr":"172.21.15.82:6827/1777272933","cluster_addr":"172.21.15.82:6829/1777272933","heartbeat_back_addr":"172.21.15.82:6833/1777272933","heartbeat_front_addr":"172.21.15.82:6831/1777272933","state":["exists","up"]},{"osd":10,"uuid":"db156ccf-4396-43cb-b69a-bb9095b94b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6825","nonce":1012784035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6827","nonce":1012784035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6831","nonce":1012784035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6829","nonce":1012784035}]},"public_addr":"172.21.15.102:6825/1012784035","cluster_addr":"172.21.15.102:6827/1012784035","heartbeat_back_addr":"172.21.15.102:6831/1012784035","heartbeat_front_addr":"172.21.15.102:6829/1012784035","state":["exists","up"]},{"osd":11,"uuid":"b4d52576-f5b4-479f-8ff6-8fdba4635ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6825","nonce":144700355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6827","nonce":144700355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6831","nonce":144700355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6829","nonce":144700355}]},"public_addr":"172.21.15.190:6825/144700355","cluster_addr":"172.21.15.190:6827/144700355","heartbeat_back_addr":"172.21.15.190:6831/144700355","heartbeat_front_addr":"172.21.15.190:6829/144700355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:07:47.007772+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:09.944738+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:33.183567+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:58.302023+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:09:23.042488+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:09:47.616009+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:10:13.122887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:10:38.584530+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:03.473453+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:29.847105+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:55.152195+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:12:20.401765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/984630078":"2024-03-05T09:06:12.169231+0000","172.21.15.82:6800/3291527077":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/3757201752":"2024-03-05T09:06:12.169231+0000","172.21.15.82:0/1846720385":"2024-03-05T09:05:44.913099+0000","172.21.15.82:6801/3291527077":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/2402774828":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/2876711373":"2024-03-05T09:15:39.302003+0000","172.21.15.82:0/735262841":"2024-03-05T09:05:44.913099+0000","172.21.15.82:6801/1901539016":"2024-03-05T09:06:12.169231+0000","172.21.15.82:0/1124105204":"2024-03-05T09:06:12.169231+0000","172.21.15.82:6800/1901539016":"2024-03-05T09:06:12.169231+0000","172.21.15.82:0/566891801":"2024-03-05T09:15:39.302003+0000","172.21.15.82:0/3558395162":"2024-03-05T09:15:39.302003+0000","172.21.15.82:0/406948853":"2024-03-04T10:20:35.560456+0000","172.21.15.82:6800/1278635224":"2024-03-05T09:15:39.302003+0000","172.21.15.82:6801/1278635224":"2024-03-05T09:15:39.302003+0000","172.21.15.82:0/2438787300":"2024-03-05T09:15:39.302003+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]},{"pool":4,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T09:25:42.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.731+0000 7f8c51972640 1 -- 172.21.15.82:0/2603135183 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f8c380a1ef0 msgr2=0x7f8c380a43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:25:42.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.731+0000 7f8c51972640 1 --2- 172.21.15.82:0/2603135183 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f8c380a1ef0 0x7f8c380a43b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c006010 tx=0x7f8c3c005dd0 comp rx=0 tx=0).stop 2024-03-04T09:25:42.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.731+0000 7f8c51972640 1 -- 172.21.15.82:0/2603135183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c4c107660 msgr2=0x7f8c4c19c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:25:42.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.731+0000 7f8c51972640 1 --2- 172.21.15.82:0/2603135183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c4c107660 0x7f8c4c19c6b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f8c4400eb10 tx=0x7f8c4400c2d0 comp rx=0 tx=0).stop 2024-03-04T09:25:42.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.731+0000 7f8c51972640 1 -- 172.21.15.82:0/2603135183 shutdown_connections 2024-03-04T09:25:42.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.731+0000 7f8c51972640 1 --2- 172.21.15.82:0/2603135183 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f8c380a1ef0 0x7f8c380a43b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:42.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.731+0000 7f8c51972640 1 --2- 172.21.15.82:0/2603135183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c4c107660 0x7f8c4c19c6b0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:42.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.731+0000 7f8c51972640 1 --2- 172.21.15.82:0/2603135183 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8c4c101f60 0x7f8c4c198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:42.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.731+0000 7f8c51972640 1 --2- 172.21.15.82:0/2603135183 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c4c1015a0 0x7f8c4c197df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:42.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.731+0000 7f8c51972640 1 -- 172.21.15.82:0/2603135183 >> 172.21.15.82:0/2603135183 conn(0x7f8c4c0fd010 msgr2=0x7f8c4c0fe760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:25:42.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.731+0000 7f8c51972640 1 -- 172.21.15.82:0/2603135183 shutdown_connections 2024-03-04T09:25:42.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.731+0000 7f8c51972640 1 -- 172.21.15.82:0/2603135183 wait complete. 2024-03-04T09:25:42.738 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:42 smithi082 ceph-mon[32880]: from='client.15639 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:25:42.738 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:42 smithi082 ceph-mon[32880]: from='client.15645 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:25:42.739 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T09:08:36.508257+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-04T09:13:07.981726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-04T09:13:09.289799+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '103', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 103, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-04T09:13:13.008516+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '103', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 103, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-04T09:25:42.740 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-04T09:25:42.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.849+0000 7f32136fa640 1 -- 172.21.15.82:0/2920536454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f320c100440 msgr2=0x7f320c1008c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:25:42.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.849+0000 7f32136fa640 1 --2- 172.21.15.82:0/2920536454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f320c100440 0x7f320c1008c0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f31fc009930 tx=0x7f31fc02bc30 comp rx=0 tx=0).stop 2024-03-04T09:25:42.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.849+0000 7f32136fa640 1 -- 172.21.15.82:0/2920536454 shutdown_connections 2024-03-04T09:25:42.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.849+0000 7f32136fa640 1 --2- 172.21.15.82:0/2920536454 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f320c100e00 0x7f320c10d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:42.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.849+0000 7f32136fa640 1 --2- 172.21.15.82:0/2920536454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f320c100440 0x7f320c1008c0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:42.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.849+0000 7f32136fa640 1 --2- 172.21.15.82:0/2920536454 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f320c1064e0 0x7f320c1068c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:42.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.849+0000 7f32136fa640 1 -- 172.21.15.82:0/2920536454 >> 172.21.15.82:0/2920536454 conn(0x7f320c0775d0 msgr2=0x7f320c0779e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:25:42.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.850+0000 7f32136fa640 1 -- 172.21.15.82:0/2920536454 shutdown_connections 2024-03-04T09:25:42.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.850+0000 7f32136fa640 1 -- 172.21.15.82:0/2920536454 wait complete. 2024-03-04T09:25:42.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.850+0000 7f32136fa640 1 Processor -- start 2024-03-04T09:25:42.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.850+0000 7f32136fa640 1 -- start start 2024-03-04T09:25:42.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.850+0000 7f32136fa640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f320c100440 0x7f320c198c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:25:42.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.850+0000 7f32136fa640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f320c100e00 0x7f320c1991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:25:42.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.850+0000 7f32136fa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f320c1064e0 0x7f320c1a3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:25:42.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.850+0000 7f32136fa640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f320c110830 con 0x7f320c1064e0 2024-03-04T09:25:42.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.850+0000 7f32136fa640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f320c1106b0 con 0x7f320c100e00 2024-03-04T09:25:42.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.850+0000 7f32136fa640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f320c1109b0 con 0x7f320c100440 2024-03-04T09:25:42.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.850+0000 7f3211c97640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f320c1064e0 0x7f320c1a3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:25:42.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.850+0000 7f3211c97640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f320c1064e0 0x7f320c1a3d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39366/0 (socket says 172.21.15.82:39366) 2024-03-04T09:25:42.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.850+0000 7f3211c97640 1 -- 172.21.15.82:0/466701216 learned_addr learned my addr 172.21.15.82:0/466701216 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:25:42.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.850+0000 7f3211496640 1 --2- 172.21.15.82:0/466701216 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f320c100440 0x7f320c198c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:25:42.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.850+0000 7f3210c95640 1 --2- 172.21.15.82:0/466701216 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f320c100e00 0x7f320c1991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:25:42.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.851+0000 7f3211c97640 1 -- 172.21.15.82:0/466701216 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f320c100440 msgr2=0x7f320c198c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:25:42.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.851+0000 7f3211c97640 1 --2- 172.21.15.82:0/466701216 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f320c100440 0x7f320c198c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:42.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.851+0000 7f3211c97640 1 -- 172.21.15.82:0/466701216 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f320c100e00 msgr2=0x7f320c1991d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:25:42.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.851+0000 7f3211c97640 1 --2- 172.21.15.82:0/466701216 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f320c100e00 0x7f320c1991d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:42.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.851+0000 7f3211c97640 1 -- 172.21.15.82:0/466701216 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f320c1a4250 con 0x7f320c1064e0 2024-03-04T09:25:42.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.851+0000 7f3211c97640 1 --2- 172.21.15.82:0/466701216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f320c1064e0 0x7f320c1a3d10 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f320400e970 tx=0x7f320400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:25:42.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.851+0000 7f32027fc640 1 -- 172.21.15.82:0/466701216 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320400ccc0 con 0x7f320c1064e0 2024-03-04T09:25:42.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.851+0000 7f32136fa640 1 -- 172.21.15.82:0/466701216 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f320c1a4420 con 0x7f320c1064e0 2024-03-04T09:25:42.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.851+0000 7f32027fc640 1 -- 172.21.15.82:0/466701216 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f320400ce60 con 0x7f320c1064e0 2024-03-04T09:25:42.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.851+0000 7f32027fc640 1 -- 172.21.15.82:0/466701216 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3204010430 con 0x7f320c1064e0 2024-03-04T09:25:42.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.851+0000 7f32136fa640 1 -- 172.21.15.82:0/466701216 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f320c1a4940 con 0x7f320c1064e0 2024-03-04T09:25:42.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.852+0000 7f32136fa640 1 -- 172.21.15.82:0/466701216 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f320c0683c0 con 0x7f320c1064e0 2024-03-04T09:25:42.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.853+0000 7f32027fc640 1 -- 172.21.15.82:0/466701216 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 136887+0+0 (secure 0 0 0) 0x7f3204005000 con 0x7f320c1064e0 2024-03-04T09:25:42.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.854+0000 7f32027fc640 1 --2- 172.21.15.82:0/466701216 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f31f80a1ef0 0x7f31f80a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:25:42.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.854+0000 7f3211496640 1 --2- 172.21.15.82:0/466701216 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f31f80a1ef0 0x7f31f80a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:25:42.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.854+0000 7f32027fc640 1 -- 172.21.15.82:0/466701216 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 9568+0+0 (secure 0 0 0) 0x7f32040ce9c0 con 0x7f320c1064e0 2024-03-04T09:25:42.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.854+0000 7f3211496640 1 --2- 172.21.15.82:0/466701216 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f31f80a1ef0 0x7f31f80a43b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3208005fd0 tx=0x7f3208009500 comp rx=0 tx=0).ready entity=mgr.15543 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:25:42.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:42.858+0000 7f32027fc640 1 -- 172.21.15.82:0/466701216 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f320409b6a0 con 0x7f320c1064e0 2024-03-04T09:25:42.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:42 smithi190 ceph-mon[36341]: from='client.15639 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:25:42.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:42 smithi190 ceph-mon[36341]: from='client.15645 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:25:42.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:42 smithi102 ceph-mon[36220]: from='client.15639 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:25:42.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:42 smithi102 ceph-mon[36220]: from='client.15645 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-04T09:25:43.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.031+0000 7f32136fa640 1 -- 172.21.15.82:0/466701216 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f320c1089d0 con 0x7f320c1064e0 2024-03-04T09:25:43.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.032+0000 7f32027fc640 1 -- 172.21.15.82:0/466701216 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v104) v1 ==== 93+0+10 (secure 0 0 0) 0x7f320409afa0 con 0x7f320c1064e0 2024-03-04T09:25:43.028 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-03-04T09:25:43.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.033+0000 7f32136fa640 1 -- 172.21.15.82:0/466701216 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f31f80a1ef0 msgr2=0x7f31f80a43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:25:43.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.033+0000 7f32136fa640 1 --2- 172.21.15.82:0/466701216 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f31f80a1ef0 0x7f31f80a43b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3208005fd0 tx=0x7f3208009500 comp rx=0 tx=0).stop 2024-03-04T09:25:43.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.033+0000 7f32136fa640 1 -- 172.21.15.82:0/466701216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f320c1064e0 msgr2=0x7f320c1a3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:25:43.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.033+0000 7f32136fa640 1 --2- 172.21.15.82:0/466701216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f320c1064e0 0x7f320c1a3d10 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f320400e970 tx=0x7f320400ed70 comp rx=0 tx=0).stop 2024-03-04T09:25:43.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.034+0000 7f32136fa640 1 -- 172.21.15.82:0/466701216 shutdown_connections 2024-03-04T09:25:43.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.034+0000 7f32136fa640 1 --2- 172.21.15.82:0/466701216 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f31f80a1ef0 0x7f31f80a43b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:43.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.034+0000 7f32136fa640 1 --2- 172.21.15.82:0/466701216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f320c1064e0 0x7f320c1a3d10 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:43.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.034+0000 7f32136fa640 1 --2- 172.21.15.82:0/466701216 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f320c100e00 0x7f320c1991d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:43.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.034+0000 7f32136fa640 1 --2- 172.21.15.82:0/466701216 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f320c100440 0x7f320c198c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:43.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.034+0000 7f32136fa640 1 -- 172.21.15.82:0/466701216 >> 172.21.15.82:0/466701216 conn(0x7f320c0775d0 msgr2=0x7f320c102cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:25:43.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.034+0000 7f32136fa640 1 -- 172.21.15.82:0/466701216 shutdown_connections 2024-03-04T09:25:43.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.034+0000 7f32136fa640 1 -- 172.21.15.82:0/466701216 wait complete. 2024-03-04T09:25:43.041 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-04T09:25:43.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.149+0000 7f0a6712b640 1 -- 172.21.15.82:0/2522611099 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0a601065d0 msgr2=0x7f0a601069b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:25:43.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.149+0000 7f0a6712b640 1 --2- 172.21.15.82:0/2522611099 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0a601065d0 0x7f0a601069b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0a58009890 tx=0x7f0a5802bb70 comp rx=0 tx=0).stop 2024-03-04T09:25:43.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.149+0000 7f0a6712b640 1 -- 172.21.15.82:0/2522611099 shutdown_connections 2024-03-04T09:25:43.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.149+0000 7f0a6712b640 1 --2- 172.21.15.82:0/2522611099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a60100ed0 0x7f0a6010d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:43.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.149+0000 7f0a6712b640 1 --2- 172.21.15.82:0/2522611099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0a60100510 0x7f0a60100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:43.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.149+0000 7f0a6712b640 1 --2- 172.21.15.82:0/2522611099 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0a601065d0 0x7f0a601069b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:43.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.149+0000 7f0a6712b640 1 -- 172.21.15.82:0/2522611099 >> 172.21.15.82:0/2522611099 conn(0x7f0a60077630 msgr2=0x7f0a60077a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:25:43.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.149+0000 7f0a6712b640 1 -- 172.21.15.82:0/2522611099 shutdown_connections 2024-03-04T09:25:43.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.149+0000 7f0a6712b640 1 -- 172.21.15.82:0/2522611099 wait complete. 2024-03-04T09:25:43.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.149+0000 7f0a6712b640 1 Processor -- start 2024-03-04T09:25:43.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.149+0000 7f0a6712b640 1 -- start start 2024-03-04T09:25:43.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.150+0000 7f0a6712b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0a60100510 0x7f0a60198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:25:43.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.150+0000 7f0a6712b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0a60100ed0 0x7f0a60199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:25:43.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.150+0000 7f0a6712b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a601065d0 0x7f0a601a3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:25:43.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.150+0000 7f0a6712b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a60110850 con 0x7f0a601065d0 2024-03-04T09:25:43.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.150+0000 7f0a6712b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a601106d0 con 0x7f0a60100ed0 2024-03-04T09:25:43.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.150+0000 7f0a6712b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a601109d0 con 0x7f0a60100510 2024-03-04T09:25:43.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.150+0000 7f0a656c8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a601065d0 0x7f0a601a3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:25:43.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.150+0000 7f0a64ec7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0a60100510 0x7f0a60198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:25:43.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.150+0000 7f0a5ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0a60100ed0 0x7f0a60199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:25:43.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.150+0000 7f0a656c8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a601065d0 0x7f0a601a3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39388/0 (socket says 172.21.15.82:39388) 2024-03-04T09:25:43.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.150+0000 7f0a64ec7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0a60100510 0x7f0a60198d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.82:41150/0 (socket says 172.21.15.82:41150) 2024-03-04T09:25:43.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.150+0000 7f0a656c8640 1 -- 172.21.15.82:0/4173472577 learned_addr learned my addr 172.21.15.82:0/4173472577 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:25:43.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.150+0000 7f0a5ffff640 1 -- 172.21.15.82:0/4173472577 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0a60100510 msgr2=0x7f0a60198d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:25:43.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.150+0000 7f0a5ffff640 1 --2- 172.21.15.82:0/4173472577 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0a60100510 0x7f0a60198d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:43.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.150+0000 7f0a5ffff640 1 -- 172.21.15.82:0/4173472577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a601065d0 msgr2=0x7f0a601a3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:25:43.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.150+0000 7f0a5ffff640 1 --2- 172.21.15.82:0/4173472577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a601065d0 0x7f0a601a3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:43.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.150+0000 7f0a5ffff640 1 -- 172.21.15.82:0/4173472577 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a601a4310 con 0x7f0a60100ed0 2024-03-04T09:25:43.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.150+0000 7f0a656c8640 1 --2- 172.21.15.82:0/4173472577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a601065d0 0x7f0a601a3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:25:43.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.150+0000 7f0a5ffff640 1 --2- 172.21.15.82:0/4173472577 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0a60100ed0 0x7f0a60199290 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0a50009fd0 tx=0x7f0a5000eed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:25:43.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.150+0000 7f0a5dffb640 1 -- 172.21.15.82:0/4173472577 <== mon.2 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5000cde0 con 0x7f0a60100ed0 2024-03-04T09:25:43.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.150+0000 7f0a6712b640 1 -- 172.21.15.82:0/4173472577 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a601a44e0 con 0x7f0a60100ed0 2024-03-04T09:25:43.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.150+0000 7f0a5dffb640 1 -- 172.21.15.82:0/4173472577 <== mon.2 v2:172.21.15.102:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f0a50005020 con 0x7f0a60100ed0 2024-03-04T09:25:43.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.150+0000 7f0a5dffb640 1 -- 172.21.15.82:0/4173472577 <== mon.2 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a50010670 con 0x7f0a60100ed0 2024-03-04T09:25:43.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.151+0000 7f0a6712b640 1 -- 172.21.15.82:0/4173472577 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a601a4a30 con 0x7f0a60100ed0 2024-03-04T09:25:43.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.151+0000 7f0a6712b640 1 -- 172.21.15.82:0/4173472577 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a60068810 con 0x7f0a60100ed0 2024-03-04T09:25:43.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.153+0000 7f0a5dffb640 1 -- 172.21.15.82:0/4173472577 <== mon.2 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 25) v1 ==== 136887+0+0 (secure 0 0 0) 0x7f0a500051d0 con 0x7f0a60100ed0 2024-03-04T09:25:43.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.153+0000 7f0a5dffb640 1 --2- 172.21.15.82:0/4173472577 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f0a4c0a1ef0 0x7f0a4c0a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:25:43.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.153+0000 7f0a5dffb640 1 -- 172.21.15.82:0/4173472577 <== mon.2 v2:172.21.15.102:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 9568+0+0 (secure 0 0 0) 0x7f0a500ced50 con 0x7f0a60100ed0 2024-03-04T09:25:43.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.153+0000 7f0a64ec7640 1 --2- 172.21.15.82:0/4173472577 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f0a4c0a1ef0 0x7f0a4c0a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:25:43.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.154+0000 7f0a64ec7640 1 --2- 172.21.15.82:0/4173472577 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f0a4c0a1ef0 0x7f0a4c0a43b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0a58005b60 tx=0x7f0a58005a90 comp rx=0 tx=0).ready entity=mgr.15543 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:25:43.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.158+0000 7f0a5dffb640 1 -- 172.21.15.82:0/4173472577 <== mon.2 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f0a5009ba30 con 0x7f0a60100ed0 2024-03-04T09:25:43.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.334+0000 7f0a6712b640 1 -- 172.21.15.82:0/4173472577 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0a601089c0 con 0x7f0a60100ed0 2024-03-04T09:25:43.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.334+0000 7f0a5dffb640 1 -- 172.21.15.82:0/4173472577 <== mon.2 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v104) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0a5009b330 con 0x7f0a60100ed0 2024-03-04T09:25:43.331 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-03-04T09:25:43.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.336+0000 7f0a6712b640 1 -- 172.21.15.82:0/4173472577 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f0a4c0a1ef0 msgr2=0x7f0a4c0a43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:25:43.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.336+0000 7f0a6712b640 1 --2- 172.21.15.82:0/4173472577 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f0a4c0a1ef0 0x7f0a4c0a43b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0a58005b60 tx=0x7f0a58005a90 comp rx=0 tx=0).stop 2024-03-04T09:25:43.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.336+0000 7f0a6712b640 1 -- 172.21.15.82:0/4173472577 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0a60100ed0 msgr2=0x7f0a60199290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:25:43.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.336+0000 7f0a6712b640 1 --2- 172.21.15.82:0/4173472577 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0a60100ed0 0x7f0a60199290 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0a50009fd0 tx=0x7f0a5000eed0 comp rx=0 tx=0).stop 2024-03-04T09:25:43.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.337+0000 7f0a6712b640 1 -- 172.21.15.82:0/4173472577 shutdown_connections 2024-03-04T09:25:43.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.337+0000 7f0a6712b640 1 --2- 172.21.15.82:0/4173472577 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f0a4c0a1ef0 0x7f0a4c0a43b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:43.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.337+0000 7f0a6712b640 1 --2- 172.21.15.82:0/4173472577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a601065d0 0x7f0a601a3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:43.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.337+0000 7f0a6712b640 1 --2- 172.21.15.82:0/4173472577 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0a60100ed0 0x7f0a60199290 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:43.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.337+0000 7f0a6712b640 1 --2- 172.21.15.82:0/4173472577 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0a60100510 0x7f0a60198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:43.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.337+0000 7f0a6712b640 1 -- 172.21.15.82:0/4173472577 >> 172.21.15.82:0/4173472577 conn(0x7f0a60077630 msgr2=0x7f0a600ff250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:25:43.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.337+0000 7f0a6712b640 1 -- 172.21.15.82:0/4173472577 shutdown_connections 2024-03-04T09:25:43.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.337+0000 7f0a6712b640 1 -- 172.21.15.82:0/4173472577 wait complete. 2024-03-04T09:25:43.344 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-04T09:25:43.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.451+0000 7f4d6e442640 1 -- 172.21.15.82:0/4026598314 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4d68100440 msgr2=0x7f4d681008c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:25:43.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.451+0000 7f4d6e442640 1 --2- 172.21.15.82:0/4026598314 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4d68100440 0x7f4d681008c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4d58009890 tx=0x7f4d5802bb70 comp rx=0 tx=0).stop 2024-03-04T09:25:43.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.451+0000 7f4d6e442640 1 -- 172.21.15.82:0/4026598314 shutdown_connections 2024-03-04T09:25:43.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.451+0000 7f4d6e442640 1 --2- 172.21.15.82:0/4026598314 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d68100e00 0x7f4d6810d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:43.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.451+0000 7f4d6e442640 1 --2- 172.21.15.82:0/4026598314 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4d68100440 0x7f4d681008c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:43.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.451+0000 7f4d6e442640 1 --2- 172.21.15.82:0/4026598314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d681064e0 0x7f4d681068c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:43.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.451+0000 7f4d6e442640 1 -- 172.21.15.82:0/4026598314 >> 172.21.15.82:0/4026598314 conn(0x7f4d680775d0 msgr2=0x7f4d680779e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:25:43.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.451+0000 7f4d6e442640 1 -- 172.21.15.82:0/4026598314 shutdown_connections 2024-03-04T09:25:43.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.451+0000 7f4d6e442640 1 -- 172.21.15.82:0/4026598314 wait complete. 2024-03-04T09:25:43.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.452+0000 7f4d6e442640 1 Processor -- start 2024-03-04T09:25:43.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.452+0000 7f4d6e442640 1 -- start start 2024-03-04T09:25:43.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.452+0000 7f4d6e442640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d68100440 0x7f4d68198cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:25:43.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.452+0000 7f4d6e442640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d68100e00 0x7f4d68199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:25:43.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.452+0000 7f4d6e442640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4d681064e0 0x7f4d681a3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:25:43.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.452+0000 7f4d6e442640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d681107e0 con 0x7f4d68100e00 2024-03-04T09:25:43.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.452+0000 7f4d6e442640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d68110660 con 0x7f4d68100440 2024-03-04T09:25:43.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.452+0000 7f4d6e442640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d68110960 con 0x7f4d681064e0 2024-03-04T09:25:43.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.452+0000 7f4d677fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d68100e00 0x7f4d68199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:25:43.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.452+0000 7f4d677fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d68100e00 0x7f4d68199200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39398/0 (socket says 172.21.15.82:39398) 2024-03-04T09:25:43.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.452+0000 7f4d677fe640 1 -- 172.21.15.82:0/2813767128 learned_addr learned my addr 172.21.15.82:0/2813767128 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:25:43.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.452+0000 7f4d67fff640 1 --2- 172.21.15.82:0/2813767128 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d68100440 0x7f4d68198cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:25:43.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.453+0000 7f4d6c9df640 1 --2- 172.21.15.82:0/2813767128 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4d681064e0 0x7f4d681a3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:25:43.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.453+0000 7f4d677fe640 1 -- 172.21.15.82:0/2813767128 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4d681064e0 msgr2=0x7f4d681a3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:25:43.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.453+0000 7f4d677fe640 1 --2- 172.21.15.82:0/2813767128 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4d681064e0 0x7f4d681a3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:43.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.453+0000 7f4d677fe640 1 -- 172.21.15.82:0/2813767128 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d68100440 msgr2=0x7f4d68198cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:25:43.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.453+0000 7f4d677fe640 1 --2- 172.21.15.82:0/2813767128 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d68100440 0x7f4d68198cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:43.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.453+0000 7f4d677fe640 1 -- 172.21.15.82:0/2813767128 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d681a4280 con 0x7f4d68100e00 2024-03-04T09:25:43.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.453+0000 7f4d677fe640 1 --2- 172.21.15.82:0/2813767128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d68100e00 0x7f4d68199200 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f4d58000c00 tx=0x7f4d58034f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:25:43.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.453+0000 7f4d657fa640 1 -- 172.21.15.82:0/2813767128 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d58039050 con 0x7f4d68100e00 2024-03-04T09:25:43.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.453+0000 7f4d6e442640 1 -- 172.21.15.82:0/2813767128 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d681a4450 con 0x7f4d68100e00 2024-03-04T09:25:43.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.453+0000 7f4d657fa640 1 -- 172.21.15.82:0/2813767128 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f4d58045070 con 0x7f4d68100e00 2024-03-04T09:25:43.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.453+0000 7f4d657fa640 1 -- 172.21.15.82:0/2813767128 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d58003e50 con 0x7f4d68100e00 2024-03-04T09:25:43.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.453+0000 7f4d6e442640 1 -- 172.21.15.82:0/2813767128 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d681a4910 con 0x7f4d68100e00 2024-03-04T09:25:43.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.454+0000 7f4d6e442640 1 -- 172.21.15.82:0/2813767128 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d680683c0 con 0x7f4d68100e00 2024-03-04T09:25:43.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.455+0000 7f4d657fa640 1 -- 172.21.15.82:0/2813767128 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 136887+0+0 (secure 0 0 0) 0x7f4d580035f0 con 0x7f4d68100e00 2024-03-04T09:25:43.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.456+0000 7f4d657fa640 1 --2- 172.21.15.82:0/2813767128 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f4d500a1ef0 0x7f4d500a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:25:43.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.456+0000 7f4d67fff640 1 --2- 172.21.15.82:0/2813767128 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f4d500a1ef0 0x7f4d500a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:25:43.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.456+0000 7f4d657fa640 1 -- 172.21.15.82:0/2813767128 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 9568+0+0 (secure 0 0 0) 0x7f4d580f01c0 con 0x7f4d68100e00 2024-03-04T09:25:43.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.456+0000 7f4d67fff640 1 --2- 172.21.15.82:0/2813767128 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f4d500a1ef0 0x7f4d500a43b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c005fd0 tx=0x7f4d5c009260 comp rx=0 tx=0).ready entity=mgr.15543 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:25:43.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.459+0000 7f4d657fa640 1 -- 172.21.15.82:0/2813767128 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f4d5804e020 con 0x7f4d68100e00 2024-03-04T09:25:43.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.632+0000 7f4d6e442640 1 -- 172.21.15.82:0/2813767128 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4d681089d0 con 0x7f4d68100e00 2024-03-04T09:25:43.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.632+0000 7f4d657fa640 1 -- 172.21.15.82:0/2813767128 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v104) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4d580bcfb0 con 0x7f4d68100e00 2024-03-04T09:25:43.629 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2024-03-04T09:25:43.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.634+0000 7f4d6e442640 1 -- 172.21.15.82:0/2813767128 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f4d500a1ef0 msgr2=0x7f4d500a43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:25:43.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.634+0000 7f4d6e442640 1 --2- 172.21.15.82:0/2813767128 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f4d500a1ef0 0x7f4d500a43b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c005fd0 tx=0x7f4d5c009260 comp rx=0 tx=0).stop 2024-03-04T09:25:43.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.634+0000 7f4d6e442640 1 -- 172.21.15.82:0/2813767128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d68100e00 msgr2=0x7f4d68199200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:25:43.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.634+0000 7f4d6e442640 1 --2- 172.21.15.82:0/2813767128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d68100e00 0x7f4d68199200 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f4d58000c00 tx=0x7f4d58034f00 comp rx=0 tx=0).stop 2024-03-04T09:25:43.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.635+0000 7f4d6e442640 1 -- 172.21.15.82:0/2813767128 shutdown_connections 2024-03-04T09:25:43.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.635+0000 7f4d6e442640 1 --2- 172.21.15.82:0/2813767128 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f4d500a1ef0 0x7f4d500a43b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:43.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.635+0000 7f4d6e442640 1 --2- 172.21.15.82:0/2813767128 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4d681064e0 0x7f4d681a3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:43.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.635+0000 7f4d6e442640 1 --2- 172.21.15.82:0/2813767128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d68100e00 0x7f4d68199200 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:43.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.635+0000 7f4d6e442640 1 --2- 172.21.15.82:0/2813767128 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d68100440 0x7f4d68198cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:43.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.635+0000 7f4d6e442640 1 -- 172.21.15.82:0/2813767128 >> 172.21.15.82:0/2813767128 conn(0x7f4d680775d0 msgr2=0x7f4d68102d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:25:43.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.635+0000 7f4d6e442640 1 -- 172.21.15.82:0/2813767128 shutdown_connections 2024-03-04T09:25:43.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.635+0000 7f4d6e442640 1 -- 172.21.15.82:0/2813767128 wait complete. 2024-03-04T09:25:43.642 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-04T09:25:43.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.749+0000 7f06e0c66640 1 -- 172.21.15.82:0/2645908148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06dc101f60 msgr2=0x7f06dc10e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:25:43.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.749+0000 7f06e0c66640 1 --2- 172.21.15.82:0/2645908148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06dc101f60 0x7f06dc10e420 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f06d4009900 tx=0x7f06d402bc30 comp rx=0 tx=0).stop 2024-03-04T09:25:43.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.749+0000 7f06e0c66640 1 -- 172.21.15.82:0/2645908148 shutdown_connections 2024-03-04T09:25:43.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.749+0000 7f06e0c66640 1 --2- 172.21.15.82:0/2645908148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06dc101f60 0x7f06dc10e420 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:43.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.749+0000 7f06e0c66640 1 --2- 172.21.15.82:0/2645908148 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f06dc1015a0 0x7f06dc101a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:43.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.749+0000 7f06e0c66640 1 --2- 172.21.15.82:0/2645908148 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06dc107660 0x7f06dc107a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:43.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.749+0000 7f06e0c66640 1 -- 172.21.15.82:0/2645908148 >> 172.21.15.82:0/2645908148 conn(0x7f06dc0fd010 msgr2=0x7f06dc0ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:25:43.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.750+0000 7f06e0c66640 1 -- 172.21.15.82:0/2645908148 shutdown_connections 2024-03-04T09:25:43.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.750+0000 7f06e0c66640 1 -- 172.21.15.82:0/2645908148 wait complete. 2024-03-04T09:25:43.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.750+0000 7f06e0c66640 1 Processor -- start 2024-03-04T09:25:43.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.750+0000 7f06e0c66640 1 -- start start 2024-03-04T09:25:43.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.750+0000 7f06e0c66640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06dc1015a0 0x7f06dc197d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:25:43.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.750+0000 7f06e0c66640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f06dc101f60 0x7f06dc1982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:25:43.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.750+0000 7f06e0c66640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06dc107660 0x7f06dc19c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:25:43.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.750+0000 7f06e0c66640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc111970 con 0x7f06dc107660 2024-03-04T09:25:43.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.750+0000 7f06e0c66640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc1117f0 con 0x7f06dc101f60 2024-03-04T09:25:43.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.750+0000 7f06e0c66640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc111af0 con 0x7f06dc1015a0 2024-03-04T09:25:43.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.751+0000 7f06dad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06dc107660 0x7f06dc19c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:25:43.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.751+0000 7f06d9d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f06dc101f60 0x7f06dc1982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:25:43.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.751+0000 7f06da59c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06dc1015a0 0x7f06dc197d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:25:43.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.751+0000 7f06dad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06dc107660 0x7f06dc19c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39412/0 (socket says 172.21.15.82:39412) 2024-03-04T09:25:43.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.751+0000 7f06dad9d640 1 -- 172.21.15.82:0/861544019 learned_addr learned my addr 172.21.15.82:0/861544019 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:25:43.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.751+0000 7f06dad9d640 1 -- 172.21.15.82:0/861544019 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06dc1015a0 msgr2=0x7f06dc197d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:25:43.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.751+0000 7f06dad9d640 1 --2- 172.21.15.82:0/861544019 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06dc1015a0 0x7f06dc197d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:43.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.751+0000 7f06dad9d640 1 -- 172.21.15.82:0/861544019 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f06dc101f60 msgr2=0x7f06dc1982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:25:43.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.751+0000 7f06dad9d640 1 --2- 172.21.15.82:0/861544019 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f06dc101f60 0x7f06dc1982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:43.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.751+0000 7f06dad9d640 1 -- 172.21.15.82:0/861544019 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06dc19cd30 con 0x7f06dc107660 2024-03-04T09:25:43.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.751+0000 7f06d9d9b640 1 --2- 172.21.15.82:0/861544019 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f06dc101f60 0x7f06dc1982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:25:43.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.751+0000 7f06dad9d640 1 --2- 172.21.15.82:0/861544019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06dc107660 0x7f06dc19c600 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f06d4036040 tx=0x7f06d402cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:25:43.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.751+0000 7f06cb7fe640 1 -- 172.21.15.82:0/861544019 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d4043020 con 0x7f06dc107660 2024-03-04T09:25:43.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.751+0000 7f06cb7fe640 1 -- 172.21.15.82:0/861544019 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f06d4004250 con 0x7f06dc107660 2024-03-04T09:25:43.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.751+0000 7f06e0c66640 1 -- 172.21.15.82:0/861544019 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06dc19cfc0 con 0x7f06dc107660 2024-03-04T09:25:43.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.751+0000 7f06cb7fe640 1 -- 172.21.15.82:0/861544019 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d4003970 con 0x7f06dc107660 2024-03-04T09:25:43.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.751+0000 7f06e0c66640 1 -- 172.21.15.82:0/861544019 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06dc1a48b0 con 0x7f06dc107660 2024-03-04T09:25:43.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.752+0000 7f06e0c66640 1 -- 172.21.15.82:0/861544019 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06dc068810 con 0x7f06dc107660 2024-03-04T09:25:43.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.753+0000 7f06cb7fe640 1 -- 172.21.15.82:0/861544019 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 136887+0+0 (secure 0 0 0) 0x7f06d4046020 con 0x7f06dc107660 2024-03-04T09:25:43.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.754+0000 7f06cb7fe640 1 --2- 172.21.15.82:0/861544019 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f06c40a1ef0 0x7f06c40a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:25:43.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.754+0000 7f06da59c640 1 --2- 172.21.15.82:0/861544019 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f06c40a1ef0 0x7f06c40a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:25:43.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.754+0000 7f06cb7fe640 1 -- 172.21.15.82:0/861544019 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 9568+0+0 (secure 0 0 0) 0x7f06d40efe80 con 0x7f06dc107660 2024-03-04T09:25:43.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.754+0000 7f06da59c640 1 --2- 172.21.15.82:0/861544019 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f06c40a1ef0 0x7f06c40a43b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f06cc005fd0 tx=0x7f06cc009500 comp rx=0 tx=0).ready entity=mgr.15543 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:25:43.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.758+0000 7f06cb7fe640 1 -- 172.21.15.82:0/861544019 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f06d404d070 con 0x7f06dc107660 2024-03-04T09:25:43.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:43 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/2603135183' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:25:43.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:43 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/466701216' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-04T09:25:43.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:43 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/4173472577' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-04T09:25:43.922 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:43 smithi190 ceph-mon[36341]: pgmap v314: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:25:43.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:43 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/2603135183' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:25:43.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:43 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/466701216' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-04T09:25:43.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:43 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/4173472577' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-04T09:25:43.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:43 smithi102 ceph-mon[36220]: pgmap v314: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:25:43.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.933+0000 7f06e0c66640 1 -- 172.21.15.82:0/861544019 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f06dc109a50 con 0x7f06dc107660 2024-03-04T09:25:43.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.934+0000 7f06cb7fe640 1 -- 172.21.15.82:0/861544019 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v104) v1 ==== 103+0+11 (secure 0 0 0) 0x7f06d40bcc70 con 0x7f06dc107660 2024-03-04T09:25:43.930 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-03-04T09:25:43.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.936+0000 7f06e0c66640 1 -- 172.21.15.82:0/861544019 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f06c40a1ef0 msgr2=0x7f06c40a43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:25:43.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.936+0000 7f06e0c66640 1 --2- 172.21.15.82:0/861544019 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f06c40a1ef0 0x7f06c40a43b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f06cc005fd0 tx=0x7f06cc009500 comp rx=0 tx=0).stop 2024-03-04T09:25:43.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.936+0000 7f06e0c66640 1 -- 172.21.15.82:0/861544019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06dc107660 msgr2=0x7f06dc19c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:25:43.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.936+0000 7f06e0c66640 1 --2- 172.21.15.82:0/861544019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06dc107660 0x7f06dc19c600 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f06d4036040 tx=0x7f06d402cac0 comp rx=0 tx=0).stop 2024-03-04T09:25:43.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.936+0000 7f06e0c66640 1 -- 172.21.15.82:0/861544019 shutdown_connections 2024-03-04T09:25:43.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.936+0000 7f06e0c66640 1 --2- 172.21.15.82:0/861544019 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f06c40a1ef0 0x7f06c40a43b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:43.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.936+0000 7f06e0c66640 1 --2- 172.21.15.82:0/861544019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06dc107660 0x7f06dc19c600 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:43.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.936+0000 7f06e0c66640 1 --2- 172.21.15.82:0/861544019 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f06dc101f60 0x7f06dc1982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:43.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.936+0000 7f06e0c66640 1 --2- 172.21.15.82:0/861544019 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06dc1015a0 0x7f06dc197d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:43.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.936+0000 7f06e0c66640 1 -- 172.21.15.82:0/861544019 >> 172.21.15.82:0/861544019 conn(0x7f06dc0fd010 msgr2=0x7f06dc0fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:25:43.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.936+0000 7f06e0c66640 1 -- 172.21.15.82:0/861544019 shutdown_connections 2024-03-04T09:25:43.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:43.936+0000 7f06e0c66640 1 -- 172.21.15.82:0/861544019 wait complete. 2024-03-04T09:25:43.942 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:43 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/2603135183' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:25:43.942 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:43 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/466701216' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-04T09:25:43.942 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:43 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/4173472577' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-04T09:25:43.942 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:43 smithi082 ceph-mon[32880]: pgmap v314: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:25:43.943 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-03-04T09:25:44.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:44.047+0000 7f5f44955640 1 -- 172.21.15.82:0/3086908988 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5f40106660 msgr2=0x7f5f40106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:25:44.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:44.047+0000 7f5f44955640 1 --2- 172.21.15.82:0/3086908988 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5f40106660 0x7f5f40106a40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5f30009930 tx=0x7f5f3002bc30 comp rx=0 tx=0).stop 2024-03-04T09:25:44.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:44.048+0000 7f5f44955640 1 -- 172.21.15.82:0/3086908988 shutdown_connections 2024-03-04T09:25:44.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:44.048+0000 7f5f44955640 1 --2- 172.21.15.82:0/3086908988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f40100e90 0x7f5f4010d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:44.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:44.048+0000 7f5f44955640 1 --2- 172.21.15.82:0/3086908988 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f401004d0 0x7f5f40100950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:44.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:44.048+0000 7f5f44955640 1 --2- 172.21.15.82:0/3086908988 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5f40106660 0x7f5f40106a40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:44.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:44.048+0000 7f5f44955640 1 -- 172.21.15.82:0/3086908988 >> 172.21.15.82:0/3086908988 conn(0x7f5f400775d0 msgr2=0x7f5f400779e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:25:44.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:44.048+0000 7f5f44955640 1 -- 172.21.15.82:0/3086908988 shutdown_connections 2024-03-04T09:25:44.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:44.048+0000 7f5f44955640 1 -- 172.21.15.82:0/3086908988 wait complete. 2024-03-04T09:25:44.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:44.048+0000 7f5f44955640 1 Processor -- start 2024-03-04T09:25:44.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:44.048+0000 7f5f44955640 1 -- start start 2024-03-04T09:25:44.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:44.048+0000 7f5f44955640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f401004d0 0x7f5f40198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:25:44.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:44.048+0000 7f5f44955640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5f40100e90 0x7f5f40199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:25:44.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:44.048+0000 7f5f44955640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f40106660 0x7f5f401a3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:25:44.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:44.048+0000 7f5f44955640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f40110880 con 0x7f5f40106660 2024-03-04T09:25:44.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:44.048+0000 7f5f44955640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f40110700 con 0x7f5f401004d0 2024-03-04T09:25:44.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:44.048+0000 7f5f44955640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f40110a00 con 0x7f5f40100e90 2024-03-04T09:25:44.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:44.049+0000 7f5f3ed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f40106660 0x7f5f401a3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:25:44.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:44.049+0000 7f5f3ed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f40106660 0x7f5f401a3d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39430/0 (socket says 172.21.15.82:39430) 2024-03-04T09:25:44.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:44.049+0000 7f5f3ed9d640 1 -- 172.21.15.82:0/1477568538 learned_addr learned my addr 172.21.15.82:0/1477568538 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:25:44.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:44.049+0000 7f5f37fff640 1 --2- 172.21.15.82:0/1477568538 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5f40100e90 0x7f5f40199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:25:44.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:44.049+0000 7f5f3e59c640 1 --2- 172.21.15.82:0/1477568538 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f401004d0 0x7f5f40198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:25:44.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:44.049+0000 7f5f3ed9d640 1 -- 172.21.15.82:0/1477568538 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5f40100e90 msgr2=0x7f5f40199240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:25:44.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:44.049+0000 7f5f3ed9d640 1 --2- 172.21.15.82:0/1477568538 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5f40100e90 0x7f5f40199240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:44.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:44.049+0000 7f5f3ed9d640 1 -- 172.21.15.82:0/1477568538 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f401004d0 msgr2=0x7f5f40198d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:25:44.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:44.049+0000 7f5f3ed9d640 1 --2- 172.21.15.82:0/1477568538 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f401004d0 0x7f5f40198d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:44.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:44.049+0000 7f5f3ed9d640 1 -- 172.21.15.82:0/1477568538 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f401a42c0 con 0x7f5f40106660 2024-03-04T09:25:44.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:44.049+0000 7f5f3ed9d640 1 --2- 172.21.15.82:0/1477568538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f40106660 0x7f5f401a3d80 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f5f3800eb10 tx=0x7f5f3800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:25:44.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:44.049+0000 7f5f377fe640 1 -- 172.21.15.82:0/1477568538 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f38004b20 con 0x7f5f40106660 2024-03-04T09:25:44.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:44.049+0000 7f5f44955640 1 -- 172.21.15.82:0/1477568538 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f401a4490 con 0x7f5f40106660 2024-03-04T09:25:44.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:44.049+0000 7f5f377fe640 1 -- 172.21.15.82:0/1477568538 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f5f38004cc0 con 0x7f5f40106660 2024-03-04T09:25:44.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:44.049+0000 7f5f377fe640 1 -- 172.21.15.82:0/1477568538 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f38010700 con 0x7f5f40106660 2024-03-04T09:25:44.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:44.049+0000 7f5f44955640 1 -- 172.21.15.82:0/1477568538 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f401a4990 con 0x7f5f40106660 2024-03-04T09:25:44.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:44.050+0000 7f5f44955640 1 -- 172.21.15.82:0/1477568538 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f400683c0 con 0x7f5f40106660 2024-03-04T09:25:44.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:44.051+0000 7f5f377fe640 1 -- 172.21.15.82:0/1477568538 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 136887+0+0 (secure 0 0 0) 0x7f5f38004e70 con 0x7f5f40106660 2024-03-04T09:25:44.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:44.052+0000 7f5f377fe640 1 --2- 172.21.15.82:0/1477568538 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f5f2c0a1ef0 0x7f5f2c0a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:25:44.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:44.052+0000 7f5f3e59c640 1 --2- 172.21.15.82:0/1477568538 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f5f2c0a1ef0 0x7f5f2c0a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:25:44.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:44.052+0000 7f5f377fe640 1 -- 172.21.15.82:0/1477568538 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 9568+0+0 (secure 0 0 0) 0x7f5f380cead0 con 0x7f5f40106660 2024-03-04T09:25:44.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:44.053+0000 7f5f3e59c640 1 --2- 172.21.15.82:0/1477568538 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f5f2c0a1ef0 0x7f5f2c0a43b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5f30000c00 tx=0x7f5f30005fd0 comp rx=0 tx=0).ready entity=mgr.15543 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:25:44.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:44.057+0000 7f5f377fe640 1 -- 172.21.15.82:0/1477568538 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f5f3809b7b0 con 0x7f5f40106660 2024-03-04T09:25:44.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:44.277+0000 7f5f44955640 1 -- 172.21.15.82:0/1477568538 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7f5f401089c0 con 0x7f5f40106660 2024-03-04T09:25:44.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:44.285+0000 7f5f377fe640 1 -- 172.21.15.82:0/1477568538 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v25) v1 ==== 81+0+736925 (secure 0 0 0) 0x7f5f3809b0b0 con 0x7f5f40106660 2024-03-04T09:25:44.291 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:25:44.292 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-04T09:25:44.292 INFO:teuthology.orchestra.run.smithi082.stdout: "epoch": 25, 2024-03-04T09:25:44.292 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.292 INFO:teuthology.orchestra.run.smithi082.stdout: "active_gid": 15543, 2024-03-04T09:25:44.292 INFO:teuthology.orchestra.run.smithi082.stdout: "active_name": "x", 2024-03-04T09:25:44.292 INFO:teuthology.orchestra.run.smithi082.stdout: "active_addrs": { 2024-03-04T09:25:44.292 INFO:teuthology.orchestra.run.smithi082.stdout: "addrvec": [ 2024-03-04T09:25:44.292 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:44.292 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v2", 2024-03-04T09:25:44.292 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "172.21.15.82:6800", 2024-03-04T09:25:44.292 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 662455866 2024-03-04T09:25:44.293 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.293 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:44.293 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v1", 2024-03-04T09:25:44.293 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "172.21.15.82:6801", 2024-03-04T09:25:44.293 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 662455866 2024-03-04T09:25:44.293 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.293 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-03-04T09:25:44.293 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.293 INFO:teuthology.orchestra.run.smithi082.stdout: "active_addr": "172.21.15.82:6801/662455866", 2024-03-04T09:25:44.293 INFO:teuthology.orchestra.run.smithi082.stdout: "active_change": "2024-03-04T09:15:39.302242+0000", 2024-03-04T09:25:44.293 INFO:teuthology.orchestra.run.smithi082.stdout: "active_mgr_features": 4540701547738038271, 2024-03-04T09:25:44.293 INFO:teuthology.orchestra.run.smithi082.stdout: "available": true, 2024-03-04T09:25:44.293 INFO:teuthology.orchestra.run.smithi082.stdout: "standbys": [ 2024-03-04T09:25:44.293 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:44.293 INFO:teuthology.orchestra.run.smithi082.stdout: "gid": 15537, 2024-03-04T09:25:44.294 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "y", 2024-03-04T09:25:44.294 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr_features": 4540701547738038271, 2024-03-04T09:25:44.294 INFO:teuthology.orchestra.run.smithi082.stdout: "available_modules": [ 2024-03-04T09:25:44.294 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:44.294 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "alerts", 2024-03-04T09:25:44.294 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:44.294 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:44.294 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:44.294 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-03-04T09:25:44.294 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-03-04T09:25:44.294 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:44.294 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.294 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.294 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-03-04T09:25:44.295 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.295 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.295 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.295 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How frequently to reexamine health status", 2024-03-04T09:25:44.295 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.295 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.295 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.295 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.295 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:44.295 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:44.295 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.295 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.295 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.296 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.296 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.296 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.296 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.296 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.296 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.296 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.296 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.296 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.296 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.296 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.296 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.296 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.296 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.297 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.297 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.297 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:44.297 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:44.297 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.297 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.297 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.297 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.297 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.297 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.297 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.297 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.297 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.297 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.298 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.298 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.298 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:44.298 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:44.298 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.298 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.298 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.298 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:44.298 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.298 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.298 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.298 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.298 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.299 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.299 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.299 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.299 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.299 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.299 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.299 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.299 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.299 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.299 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.299 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:44.299 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:44.299 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.299 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.300 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.300 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.300 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.300 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.300 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.300 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.300 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.300 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.300 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.300 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.300 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_destination": { 2024-03-04T09:25:44.300 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_destination", 2024-03-04T09:25:44.300 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.300 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.300 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.301 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.301 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.301 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.301 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.301 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Email address to send alerts to", 2024-03-04T09:25:44.301 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.301 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.301 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.301 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.301 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_from_name": { 2024-03-04T09:25:44.301 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_from_name", 2024-03-04T09:25:44.301 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.301 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.301 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.301 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "Ceph", 2024-03-04T09:25:44.302 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.302 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.302 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.302 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Email From: name", 2024-03-04T09:25:44.302 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.302 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.302 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.302 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.302 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_host": { 2024-03-04T09:25:44.302 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_host", 2024-03-04T09:25:44.302 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.302 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.302 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.302 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.302 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.303 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.303 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.303 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SMTP server", 2024-03-04T09:25:44.303 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.303 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.303 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.303 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.303 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_password": { 2024-03-04T09:25:44.303 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_password", 2024-03-04T09:25:44.303 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.303 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.303 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.303 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.304 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.304 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.304 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.304 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Password to authenticate with", 2024-03-04T09:25:44.304 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.304 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.304 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.304 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.304 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_port": { 2024-03-04T09:25:44.304 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_port", 2024-03-04T09:25:44.304 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.304 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.304 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.304 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "465", 2024-03-04T09:25:44.305 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.305 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.305 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.305 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SMTP port", 2024-03-04T09:25:44.305 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.305 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.305 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.305 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.305 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_sender": { 2024-03-04T09:25:44.305 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_sender", 2024-03-04T09:25:44.305 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.305 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.305 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.305 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.306 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.306 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.306 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.306 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SMTP envelope sender", 2024-03-04T09:25:44.306 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.306 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.306 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.306 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.306 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_ssl": { 2024-03-04T09:25:44.306 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_ssl", 2024-03-04T09:25:44.306 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.306 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.306 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.307 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.307 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.307 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.307 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.307 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use SSL to connect to SMTP server", 2024-03-04T09:25:44.307 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.307 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.307 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.307 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.307 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_user": { 2024-03-04T09:25:44.307 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_user", 2024-03-04T09:25:44.307 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.307 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.307 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.308 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.308 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.308 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.308 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.308 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "User to authenticate as", 2024-03-04T09:25:44.308 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.308 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.308 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.308 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.308 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.308 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.308 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:44.309 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "balancer", 2024-03-04T09:25:44.309 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:44.309 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:44.309 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:44.309 INFO:teuthology.orchestra.run.smithi082.stdout: "active": { 2024-03-04T09:25:44.309 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "active", 2024-03-04T09:25:44.309 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.309 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.309 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.309 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.309 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.309 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.309 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.309 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "automatically balance PGs across cluster", 2024-03-04T09:25:44.309 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.310 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.310 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.310 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.310 INFO:teuthology.orchestra.run.smithi082.stdout: "begin_time": { 2024-03-04T09:25:44.310 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "begin_time", 2024-03-04T09:25:44.310 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.310 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.310 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.310 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0000", 2024-03-04T09:25:44.310 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.310 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.310 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.310 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "beginning time of day to automatically balance", 2024-03-04T09:25:44.310 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-03-04T09:25:44.311 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.311 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.311 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.311 INFO:teuthology.orchestra.run.smithi082.stdout: "begin_weekday": { 2024-03-04T09:25:44.311 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "begin_weekday", 2024-03-04T09:25:44.311 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-03-04T09:25:44.311 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.311 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.311 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-03-04T09:25:44.311 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "0", 2024-03-04T09:25:44.311 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "6", 2024-03-04T09:25:44.311 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.311 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-03-04T09:25:44.311 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-03-04T09:25:44.312 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.312 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.312 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.312 INFO:teuthology.orchestra.run.smithi082.stdout: "crush_compat_max_iterations": { 2024-03-04T09:25:44.312 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crush_compat_max_iterations", 2024-03-04T09:25:44.312 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-03-04T09:25:44.312 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.312 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.312 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "25", 2024-03-04T09:25:44.312 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-03-04T09:25:44.312 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "250", 2024-03-04T09:25:44.312 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.312 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-03-04T09:25:44.312 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.313 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.313 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.313 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.313 INFO:teuthology.orchestra.run.smithi082.stdout: "crush_compat_metrics": { 2024-03-04T09:25:44.313 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crush_compat_metrics", 2024-03-04T09:25:44.313 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.313 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.313 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.313 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "pgs,objects,bytes", 2024-03-04T09:25:44.313 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.313 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.313 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.313 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-03-04T09:25:44.313 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-03-04T09:25:44.314 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.314 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.314 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.314 INFO:teuthology.orchestra.run.smithi082.stdout: "crush_compat_step": { 2024-03-04T09:25:44.314 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crush_compat_step", 2024-03-04T09:25:44.314 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-03-04T09:25:44.314 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.314 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.314 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0.5", 2024-03-04T09:25:44.314 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "0.001", 2024-03-04T09:25:44.314 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "0.999", 2024-03-04T09:25:44.314 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.314 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "aggressiveness of optimization", 2024-03-04T09:25:44.314 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-03-04T09:25:44.315 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.315 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.315 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.315 INFO:teuthology.orchestra.run.smithi082.stdout: "end_time": { 2024-03-04T09:25:44.315 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "end_time", 2024-03-04T09:25:44.315 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.315 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.315 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.315 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "2359", 2024-03-04T09:25:44.315 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.315 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.315 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.315 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "ending time of day to automatically balance", 2024-03-04T09:25:44.315 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-03-04T09:25:44.316 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.316 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.316 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.316 INFO:teuthology.orchestra.run.smithi082.stdout: "end_weekday": { 2024-03-04T09:25:44.316 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "end_weekday", 2024-03-04T09:25:44.316 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-03-04T09:25:44.316 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.316 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.316 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-03-04T09:25:44.316 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "0", 2024-03-04T09:25:44.316 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "6", 2024-03-04T09:25:44.316 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.316 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-03-04T09:25:44.317 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-03-04T09:25:44.317 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.317 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.317 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.317 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:44.317 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:44.317 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.317 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.317 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.317 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.317 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.317 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.317 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.317 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.318 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.318 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.318 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.318 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.318 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.318 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.318 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.318 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.318 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.318 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.318 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.318 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:44.318 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:44.318 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.318 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.318 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.319 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.319 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.319 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.319 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.319 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.319 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.319 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.319 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.319 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.319 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:44.319 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:44.319 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.319 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.320 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.320 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:44.320 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.320 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.320 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.320 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.320 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.320 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.320 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.320 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.320 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.320 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.320 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.320 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.321 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.321 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.321 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.321 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:44.321 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:44.321 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.321 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.321 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.321 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.321 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.321 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.321 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.321 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.321 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.322 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.322 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.322 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.322 INFO:teuthology.orchestra.run.smithi082.stdout: "min_score": { 2024-03-04T09:25:44.322 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "min_score", 2024-03-04T09:25:44.322 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-03-04T09:25:44.322 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.322 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.322 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-03-04T09:25:44.322 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.322 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.322 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.322 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-03-04T09:25:44.323 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.323 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.323 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.323 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.323 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": { 2024-03-04T09:25:44.323 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mode", 2024-03-04T09:25:44.323 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.323 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.323 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.323 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "upmap", 2024-03-04T09:25:44.323 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.323 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.323 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.323 INFO:teuthology.orchestra.run.smithi082.stdout: "crush-compat", 2024-03-04T09:25:44.324 INFO:teuthology.orchestra.run.smithi082.stdout: "none", 2024-03-04T09:25:44.324 INFO:teuthology.orchestra.run.smithi082.stdout: "read", 2024-03-04T09:25:44.324 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap", 2024-03-04T09:25:44.324 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap-read" 2024-03-04T09:25:44.324 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.324 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Balancer mode", 2024-03-04T09:25:44.324 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.324 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.324 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.324 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.324 INFO:teuthology.orchestra.run.smithi082.stdout: "pool_ids": { 2024-03-04T09:25:44.324 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pool_ids", 2024-03-04T09:25:44.324 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.325 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.325 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.325 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.325 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.325 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.325 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.325 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-03-04T09:25:44.325 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.325 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.325 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.326 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.326 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-03-04T09:25:44.326 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-03-04T09:25:44.326 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:44.326 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.326 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.326 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-03-04T09:25:44.326 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.326 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.326 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.326 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-03-04T09:25:44.326 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.326 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.326 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.327 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.327 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap_max_deviation": { 2024-03-04T09:25:44.327 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "upmap_max_deviation", 2024-03-04T09:25:44.327 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.327 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.327 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.327 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-03-04T09:25:44.327 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-03-04T09:25:44.327 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.327 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.327 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "deviation below which no optimization is attempted", 2024-03-04T09:25:44.327 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-03-04T09:25:44.327 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.328 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.328 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.328 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap_max_optimizations": { 2024-03-04T09:25:44.328 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "upmap_max_optimizations", 2024-03-04T09:25:44.328 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-03-04T09:25:44.328 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.328 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.328 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-03-04T09:25:44.328 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.328 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.328 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.328 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-03-04T09:25:44.329 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.329 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.329 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.329 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.329 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.329 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.329 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:44.329 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cephadm", 2024-03-04T09:25:44.329 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:44.329 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:44.329 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:44.329 INFO:teuthology.orchestra.run.smithi082.stdout: "agent_down_multiplier": { 2024-03-04T09:25:44.330 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "agent_down_multiplier", 2024-03-04T09:25:44.330 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-03-04T09:25:44.330 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.330 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.330 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "3.0", 2024-03-04T09:25:44.330 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.330 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.330 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.330 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-03-04T09:25:44.330 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.330 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.330 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.330 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.330 INFO:teuthology.orchestra.run.smithi082.stdout: "agent_refresh_rate": { 2024-03-04T09:25:44.331 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "agent_refresh_rate", 2024-03-04T09:25:44.331 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:44.331 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.331 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.331 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "20", 2024-03-04T09:25:44.331 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.331 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.331 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.331 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-03-04T09:25:44.331 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.331 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.331 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.331 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.331 INFO:teuthology.orchestra.run.smithi082.stdout: "agent_starting_port": { 2024-03-04T09:25:44.332 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "agent_starting_port", 2024-03-04T09:25:44.332 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.332 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.332 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.332 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "4721", 2024-03-04T09:25:44.332 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.332 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.332 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.332 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-03-04T09:25:44.332 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.332 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.332 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.333 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.333 INFO:teuthology.orchestra.run.smithi082.stdout: "allow_ptrace": { 2024-03-04T09:25:44.333 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "allow_ptrace", 2024-03-04T09:25:44.333 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.333 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.333 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.333 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.333 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.333 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.333 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.333 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-03-04T09:25:44.333 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-03-04T09:25:44.333 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.333 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.334 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.334 INFO:teuthology.orchestra.run.smithi082.stdout: "autotune_interval": { 2024-03-04T09:25:44.334 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "autotune_interval", 2024-03-04T09:25:44.334 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:44.334 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.334 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.334 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-03-04T09:25:44.334 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.334 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.334 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.334 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to autotune daemon memory", 2024-03-04T09:25:44.334 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.334 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.334 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.335 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.335 INFO:teuthology.orchestra.run.smithi082.stdout: "autotune_memory_target_ratio": { 2024-03-04T09:25:44.335 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "autotune_memory_target_ratio", 2024-03-04T09:25:44.335 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-03-04T09:25:44.335 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.335 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.335 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0.7", 2024-03-04T09:25:44.335 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.335 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.335 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.335 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-03-04T09:25:44.335 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.335 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.335 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.336 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.336 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm_log_destination": { 2024-03-04T09:25:44.336 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cephadm_log_destination", 2024-03-04T09:25:44.336 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.336 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.336 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.336 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.336 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.336 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.336 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.336 INFO:teuthology.orchestra.run.smithi082.stdout: "file", 2024-03-04T09:25:44.336 INFO:teuthology.orchestra.run.smithi082.stdout: "file,syslog", 2024-03-04T09:25:44.336 INFO:teuthology.orchestra.run.smithi082.stdout: "syslog" 2024-03-04T09:25:44.337 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.337 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-03-04T09:25:44.337 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.337 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.337 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.337 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.337 INFO:teuthology.orchestra.run.smithi082.stdout: "cgroups_split": { 2024-03-04T09:25:44.337 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cgroups_split", 2024-03-04T09:25:44.337 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.337 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.337 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.337 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.337 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.337 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.337 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.338 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-03-04T09:25:44.338 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.338 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.338 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.338 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.338 INFO:teuthology.orchestra.run.smithi082.stdout: "config_checks_enabled": { 2024-03-04T09:25:44.338 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "config_checks_enabled", 2024-03-04T09:25:44.338 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.338 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.338 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.338 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.338 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.338 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.338 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.338 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-03-04T09:25:44.339 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.339 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.339 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.339 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.339 INFO:teuthology.orchestra.run.smithi082.stdout: "config_dashboard": { 2024-03-04T09:25:44.339 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "config_dashboard", 2024-03-04T09:25:44.339 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.339 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.339 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.339 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.339 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.339 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.339 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.339 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-03-04T09:25:44.339 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.340 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.340 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.340 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.340 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_alertmanager": { 2024-03-04T09:25:44.340 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_alertmanager", 2024-03-04T09:25:44.340 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.340 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.340 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.340 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-03-04T09:25:44.340 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.340 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.340 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.340 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-03-04T09:25:44.340 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.341 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.341 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.341 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.341 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_base": { 2024-03-04T09:25:44.341 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_base", 2024-03-04T09:25:44.341 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.341 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.341 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.341 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/ceph", 2024-03-04T09:25:44.341 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.341 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.341 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.341 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Container image name, without the tag", 2024-03-04T09:25:44.341 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.341 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.341 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.342 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.342 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_elasticsearch": { 2024-03-04T09:25:44.342 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_elasticsearch", 2024-03-04T09:25:44.342 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.342 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.342 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.342 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-03-04T09:25:44.342 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.342 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.342 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.342 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "elasticsearch container image", 2024-03-04T09:25:44.342 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.342 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.342 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.342 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.343 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_grafana": { 2024-03-04T09:25:44.343 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_grafana", 2024-03-04T09:25:44.343 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.343 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.343 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.343 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.12", 2024-03-04T09:25:44.343 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.343 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.343 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.343 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-03-04T09:25:44.343 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.349 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.349 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.349 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.349 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_haproxy": { 2024-03-04T09:25:44.349 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_haproxy", 2024-03-04T09:25:44.349 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.350 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.350 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.350 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-03-04T09:25:44.350 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.350 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.351 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.351 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "HAproxy container image", 2024-03-04T09:25:44.351 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.351 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.351 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.351 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.351 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_jaeger_agent": { 2024-03-04T09:25:44.351 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_jaeger_agent", 2024-03-04T09:25:44.351 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.351 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.351 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.351 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-03-04T09:25:44.351 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.351 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.352 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.352 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Jaeger agent container image", 2024-03-04T09:25:44.352 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.352 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.352 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.352 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.352 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_jaeger_collector": { 2024-03-04T09:25:44.352 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_jaeger_collector", 2024-03-04T09:25:44.352 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.352 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.352 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.352 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-03-04T09:25:44.352 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.353 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.353 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.353 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Jaeger collector container image", 2024-03-04T09:25:44.353 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.353 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.353 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.353 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.353 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_jaeger_query": { 2024-03-04T09:25:44.353 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_jaeger_query", 2024-03-04T09:25:44.353 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.353 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.353 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.353 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-03-04T09:25:44.353 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.354 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.354 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.354 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Jaeger query container image", 2024-03-04T09:25:44.354 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.354 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.354 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.354 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.354 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_keepalived": { 2024-03-04T09:25:44.354 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_keepalived", 2024-03-04T09:25:44.354 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.354 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.354 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.354 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-03-04T09:25:44.354 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.355 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.355 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.355 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Keepalived container image", 2024-03-04T09:25:44.355 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.355 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.355 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.355 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.355 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_loki": { 2024-03-04T09:25:44.355 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_loki", 2024-03-04T09:25:44.355 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.355 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.355 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.355 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-03-04T09:25:44.355 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.355 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.356 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.356 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Loki container image", 2024-03-04T09:25:44.356 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.356 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.356 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.356 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.356 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_node_exporter": { 2024-03-04T09:25:44.356 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_node_exporter", 2024-03-04T09:25:44.356 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.356 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.357 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.357 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-03-04T09:25:44.357 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.357 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.357 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.357 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-03-04T09:25:44.357 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.357 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.357 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.357 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.357 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_nvmeof": { 2024-03-04T09:25:44.358 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_nvmeof", 2024-03-04T09:25:44.358 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.358 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.358 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.358 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/nvmeof:latest", 2024-03-04T09:25:44.358 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.358 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.358 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.358 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Nvme-of container image", 2024-03-04T09:25:44.358 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.358 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.358 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.358 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.358 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_prometheus": { 2024-03-04T09:25:44.359 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_prometheus", 2024-03-04T09:25:44.359 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.359 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.359 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.359 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-03-04T09:25:44.359 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.359 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.359 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.359 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-03-04T09:25:44.359 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.359 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.359 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.359 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.359 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_promtail": { 2024-03-04T09:25:44.360 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_promtail", 2024-03-04T09:25:44.360 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.360 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.360 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.360 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-03-04T09:25:44.360 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.360 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.360 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.360 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Promtail container image", 2024-03-04T09:25:44.360 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.360 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.360 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.360 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.360 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_snmp_gateway": { 2024-03-04T09:25:44.361 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_snmp_gateway", 2024-03-04T09:25:44.361 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.361 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.361 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.361 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-03-04T09:25:44.361 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.361 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.361 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.361 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SNMP Gateway container image", 2024-03-04T09:25:44.361 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.361 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.361 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.361 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.361 INFO:teuthology.orchestra.run.smithi082.stdout: "container_init": { 2024-03-04T09:25:44.362 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_init", 2024-03-04T09:25:44.362 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.362 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.362 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.362 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.362 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.362 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.362 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.362 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Run podman/docker with `--init`", 2024-03-04T09:25:44.362 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.362 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.362 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.362 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.362 INFO:teuthology.orchestra.run.smithi082.stdout: "daemon_cache_timeout": { 2024-03-04T09:25:44.363 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "daemon_cache_timeout", 2024-03-04T09:25:44.363 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:44.363 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.363 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.363 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-03-04T09:25:44.363 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.363 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.363 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.363 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-03-04T09:25:44.363 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.363 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.363 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.363 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.364 INFO:teuthology.orchestra.run.smithi082.stdout: "default_cephadm_command_timeout": { 2024-03-04T09:25:44.364 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "default_cephadm_command_timeout", 2024-03-04T09:25:44.364 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.364 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.364 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.364 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "900", 2024-03-04T09:25:44.364 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.364 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.364 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.364 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-03-04T09:25:44.364 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.364 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.364 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.365 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.365 INFO:teuthology.orchestra.run.smithi082.stdout: "default_registry": { 2024-03-04T09:25:44.365 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "default_registry", 2024-03-04T09:25:44.365 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.365 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.365 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.365 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io", 2024-03-04T09:25:44.365 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.365 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.365 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.365 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-03-04T09:25:44.365 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.365 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.365 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.365 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.366 INFO:teuthology.orchestra.run.smithi082.stdout: "device_cache_timeout": { 2024-03-04T09:25:44.366 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "device_cache_timeout", 2024-03-04T09:25:44.366 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:44.366 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.366 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.366 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "1800", 2024-03-04T09:25:44.366 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.366 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.366 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.366 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "seconds to cache device inventory", 2024-03-04T09:25:44.366 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.366 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.366 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.366 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.366 INFO:teuthology.orchestra.run.smithi082.stdout: "device_enhanced_scan": { 2024-03-04T09:25:44.367 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "device_enhanced_scan", 2024-03-04T09:25:44.367 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.367 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.367 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.367 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.367 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.367 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.367 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.367 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use libstoragemgmt during device scans", 2024-03-04T09:25:44.367 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.367 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.367 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.367 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.367 INFO:teuthology.orchestra.run.smithi082.stdout: "facts_cache_timeout": { 2024-03-04T09:25:44.368 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "facts_cache_timeout", 2024-03-04T09:25:44.368 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:44.368 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.368 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.368 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-03-04T09:25:44.368 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.368 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.368 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.368 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "seconds to cache host facts data", 2024-03-04T09:25:44.368 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.368 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.368 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.368 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.369 INFO:teuthology.orchestra.run.smithi082.stdout: "host_check_interval": { 2024-03-04T09:25:44.369 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "host_check_interval", 2024-03-04T09:25:44.369 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:44.369 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.369 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.369 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-03-04T09:25:44.369 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.369 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.369 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.369 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to perform a host check", 2024-03-04T09:25:44.369 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.369 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.369 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.369 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.369 INFO:teuthology.orchestra.run.smithi082.stdout: "hw_monitoring": { 2024-03-04T09:25:44.370 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "hw_monitoring", 2024-03-04T09:25:44.370 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.370 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.370 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.370 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.370 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.370 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.370 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.370 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-03-04T09:25:44.370 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.370 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.370 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.370 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.371 INFO:teuthology.orchestra.run.smithi082.stdout: "inventory_list_all": { 2024-03-04T09:25:44.371 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "inventory_list_all", 2024-03-04T09:25:44.371 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.371 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.371 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.371 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.371 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.371 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.371 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.371 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-03-04T09:25:44.371 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.371 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.371 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.371 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.372 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:44.372 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:44.372 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.372 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.372 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.372 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.372 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.372 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.372 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.372 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.372 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.372 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.372 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.372 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.373 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.373 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.373 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.373 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.373 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.373 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.373 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.373 INFO:teuthology.orchestra.run.smithi082.stdout: "log_refresh_metadata": { 2024-03-04T09:25:44.373 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_refresh_metadata", 2024-03-04T09:25:44.373 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.373 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.373 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.373 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.373 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.374 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.374 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.374 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-03-04T09:25:44.374 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.374 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.374 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.374 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.374 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:44.374 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:44.374 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.374 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.374 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.374 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.374 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.374 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.375 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.375 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-03-04T09:25:44.375 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.375 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.375 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.375 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.375 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:44.375 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:44.375 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.375 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.375 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.375 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:44.375 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.376 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.376 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.376 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.376 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.376 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.376 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.376 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.376 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.376 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.376 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.376 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.376 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.376 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.377 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.377 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:44.377 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:44.377 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.377 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.377 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.377 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.377 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.377 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.377 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.377 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.377 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.377 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.377 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.377 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.377 INFO:teuthology.orchestra.run.smithi082.stdout: "manage_etc_ceph_ceph_conf": { 2024-03-04T09:25:44.378 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-03-04T09:25:44.378 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.378 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.378 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.378 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.378 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.378 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.378 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.378 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-03-04T09:25:44.378 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.378 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.378 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.378 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.378 INFO:teuthology.orchestra.run.smithi082.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-03-04T09:25:44.379 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-03-04T09:25:44.379 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.379 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.379 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.379 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "*", 2024-03-04T09:25:44.379 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.379 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.379 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.379 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-03-04T09:25:44.379 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.379 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.379 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.379 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.380 INFO:teuthology.orchestra.run.smithi082.stdout: "max_count_per_host": { 2024-03-04T09:25:44.380 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_count_per_host", 2024-03-04T09:25:44.380 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.380 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.380 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.380 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-03-04T09:25:44.380 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.380 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.380 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.380 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "max number of daemons per service per host", 2024-03-04T09:25:44.380 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.380 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.380 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.380 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.381 INFO:teuthology.orchestra.run.smithi082.stdout: "max_osd_draining_count": { 2024-03-04T09:25:44.381 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_osd_draining_count", 2024-03-04T09:25:44.381 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.381 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.381 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.381 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-03-04T09:25:44.381 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.381 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.381 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.381 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-03-04T09:25:44.381 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.381 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.381 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.381 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.381 INFO:teuthology.orchestra.run.smithi082.stdout: "migration_current": { 2024-03-04T09:25:44.382 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "migration_current", 2024-03-04T09:25:44.382 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.382 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.382 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.382 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.382 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.382 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.382 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.382 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "internal - do not modify", 2024-03-04T09:25:44.382 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.382 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.382 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.382 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.382 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": { 2024-03-04T09:25:44.382 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mode", 2024-03-04T09:25:44.383 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.383 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.383 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.383 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "root", 2024-03-04T09:25:44.383 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.383 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.383 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.383 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm-package", 2024-03-04T09:25:44.383 INFO:teuthology.orchestra.run.smithi082.stdout: "root" 2024-03-04T09:25:44.383 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.383 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "mode for remote execution of cephadm", 2024-03-04T09:25:44.383 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.383 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.383 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.383 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.384 INFO:teuthology.orchestra.run.smithi082.stdout: "oob_default_addr": { 2024-03-04T09:25:44.384 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "oob_default_addr", 2024-03-04T09:25:44.384 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.384 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.384 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.384 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "169.254.1.1", 2024-03-04T09:25:44.384 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.384 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.384 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.384 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Default address for RedFish API (oob management).", 2024-03-04T09:25:44.384 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.384 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.384 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.384 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.385 INFO:teuthology.orchestra.run.smithi082.stdout: "prometheus_alerts_path": { 2024-03-04T09:25:44.385 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "prometheus_alerts_path", 2024-03-04T09:25:44.385 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.385 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.385 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.385 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-03-04T09:25:44.385 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.385 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.385 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.385 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-03-04T09:25:44.385 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.385 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.385 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.385 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.386 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_insecure": { 2024-03-04T09:25:44.386 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_insecure", 2024-03-04T09:25:44.386 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.386 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.386 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.386 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.386 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.386 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.386 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.386 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-03-04T09:25:44.386 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.386 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.386 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.386 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.387 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_password": { 2024-03-04T09:25:44.387 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_password", 2024-03-04T09:25:44.387 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.387 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.387 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.387 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.387 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.387 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.387 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.387 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-03-04T09:25:44.387 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.387 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.387 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.387 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.388 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_url": { 2024-03-04T09:25:44.388 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_url", 2024-03-04T09:25:44.388 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.388 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.388 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.388 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.388 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.388 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.388 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.388 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-03-04T09:25:44.388 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.388 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.388 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.389 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.389 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_username": { 2024-03-04T09:25:44.389 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_username", 2024-03-04T09:25:44.389 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.389 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.389 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.389 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.389 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.389 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.389 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.389 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-03-04T09:25:44.389 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.389 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.390 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.390 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.390 INFO:teuthology.orchestra.run.smithi082.stdout: "secure_monitoring_stack": { 2024-03-04T09:25:44.390 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "secure_monitoring_stack", 2024-03-04T09:25:44.390 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.390 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.390 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.390 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.390 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.390 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.390 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.390 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-03-04T09:25:44.390 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.390 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.391 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.391 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.391 INFO:teuthology.orchestra.run.smithi082.stdout: "service_discovery_port": { 2024-03-04T09:25:44.391 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "service_discovery_port", 2024-03-04T09:25:44.391 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.391 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.391 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.391 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8765", 2024-03-04T09:25:44.391 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.391 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.391 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.391 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "cephadm service discovery port", 2024-03-04T09:25:44.391 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.391 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.391 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.392 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.392 INFO:teuthology.orchestra.run.smithi082.stdout: "ssh_config_file": { 2024-03-04T09:25:44.392 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssh_config_file", 2024-03-04T09:25:44.392 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.392 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.392 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.392 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.392 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.392 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.392 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.392 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-03-04T09:25:44.392 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.392 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.393 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.393 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.393 INFO:teuthology.orchestra.run.smithi082.stdout: "use_agent": { 2024-03-04T09:25:44.393 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "use_agent", 2024-03-04T09:25:44.393 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.393 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.393 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.393 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.393 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.393 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.393 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.393 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-03-04T09:25:44.393 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.393 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.394 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.394 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.394 INFO:teuthology.orchestra.run.smithi082.stdout: "use_repo_digest": { 2024-03-04T09:25:44.394 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "use_repo_digest", 2024-03-04T09:25:44.394 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.394 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.394 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.394 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.394 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.394 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.394 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.394 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-03-04T09:25:44.394 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.395 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.395 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.395 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.395 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_on_failed_host_check": { 2024-03-04T09:25:44.395 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_on_failed_host_check", 2024-03-04T09:25:44.395 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.395 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.395 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.395 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.395 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.395 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.395 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.395 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise a health warning if the host check fails", 2024-03-04T09:25:44.395 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.396 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.396 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.396 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.396 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_on_stray_daemons": { 2024-03-04T09:25:44.396 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_on_stray_daemons", 2024-03-04T09:25:44.396 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.396 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.396 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.396 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.396 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.396 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.396 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.396 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-03-04T09:25:44.397 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.397 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.397 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.397 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.397 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_on_stray_hosts": { 2024-03-04T09:25:44.397 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_on_stray_hosts", 2024-03-04T09:25:44.397 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.397 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.397 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.397 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.397 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.397 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.397 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.397 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-03-04T09:25:44.397 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.398 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.398 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.398 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.398 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.398 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.398 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:44.398 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crash", 2024-03-04T09:25:44.398 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:44.398 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:44.398 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:44.398 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:44.398 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:44.398 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.398 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.399 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.399 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.399 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.399 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.399 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.399 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.399 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.399 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.399 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.399 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.399 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.399 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.399 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.399 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.399 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.400 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.400 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.400 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:44.400 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:44.400 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.400 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.400 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.400 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.400 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.400 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.400 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.400 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.400 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.401 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.401 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.401 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.401 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:44.401 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:44.401 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.401 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.401 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.401 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:44.401 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.401 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.401 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.401 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.402 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.402 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.402 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.402 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.402 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.402 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.402 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.402 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.402 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.402 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.402 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.402 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:44.402 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:44.402 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.403 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.403 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.403 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.403 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.403 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.403 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.403 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.403 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.403 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.403 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.403 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.403 INFO:teuthology.orchestra.run.smithi082.stdout: "retain_interval": { 2024-03-04T09:25:44.403 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "retain_interval", 2024-03-04T09:25:44.404 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:44.404 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.404 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.404 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "31536000", 2024-03-04T09:25:44.404 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.404 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.404 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.404 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how long to retain crashes before pruning them", 2024-03-04T09:25:44.404 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.404 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.404 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.404 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.404 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_recent_interval": { 2024-03-04T09:25:44.404 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_recent_interval", 2024-03-04T09:25:44.405 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:44.405 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.405 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.405 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "1209600", 2024-03-04T09:25:44.405 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.405 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.405 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.405 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "time interval in which to warn about recent crashes", 2024-03-04T09:25:44.405 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.405 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.405 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.405 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.405 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.405 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.406 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:44.406 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "dashboard", 2024-03-04T09:25:44.406 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:44.406 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:44.406 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:44.406 INFO:teuthology.orchestra.run.smithi082.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-03-04T09:25:44.406 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-03-04T09:25:44.406 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.406 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.406 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.407 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-03-04T09:25:44.407 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.407 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.407 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.407 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.407 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.407 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.407 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.407 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.408 INFO:teuthology.orchestra.run.smithi082.stdout: "ALERTMANAGER_API_HOST": { 2024-03-04T09:25:44.408 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ALERTMANAGER_API_HOST", 2024-03-04T09:25:44.408 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.408 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.408 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.408 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.408 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.408 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.409 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.409 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.409 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.409 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.409 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.409 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.409 INFO:teuthology.orchestra.run.smithi082.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-03-04T09:25:44.409 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-03-04T09:25:44.410 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.410 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.410 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.410 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.410 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.410 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.410 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.410 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.410 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.411 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.411 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.411 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.411 INFO:teuthology.orchestra.run.smithi082.stdout: "AUDIT_API_ENABLED": { 2024-03-04T09:25:44.411 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "AUDIT_API_ENABLED", 2024-03-04T09:25:44.411 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.411 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.411 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.412 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.412 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.412 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.412 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.412 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.412 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.412 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.413 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.413 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.413 INFO:teuthology.orchestra.run.smithi082.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-03-04T09:25:44.413 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-03-04T09:25:44.413 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.413 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.413 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.413 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.414 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.414 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.414 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.414 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.414 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.414 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.414 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.414 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.415 INFO:teuthology.orchestra.run.smithi082.stdout: "ENABLE_BROWSABLE_API": { 2024-03-04T09:25:44.415 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ENABLE_BROWSABLE_API", 2024-03-04T09:25:44.415 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.415 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.415 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.415 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.416 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.416 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.416 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.416 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.416 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.416 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.416 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.416 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.416 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-03-04T09:25:44.416 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-03-04T09:25:44.416 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.416 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.417 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.417 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.417 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.417 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.417 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.417 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.417 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.417 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.417 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.417 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.417 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-03-04T09:25:44.417 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-03-04T09:25:44.418 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.418 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.418 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.418 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.418 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.418 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.418 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.419 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.419 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.419 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.419 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.419 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.419 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-03-04T09:25:44.419 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-03-04T09:25:44.420 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.420 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.420 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.420 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.420 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.420 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.420 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.421 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.421 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.421 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.421 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.421 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.421 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-03-04T09:25:44.421 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-03-04T09:25:44.422 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.422 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.422 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.422 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.422 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.422 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.422 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.423 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.423 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.423 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.423 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.423 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.423 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_NFS": { 2024-03-04T09:25:44.423 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-03-04T09:25:44.423 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.424 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.424 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.424 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.424 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.424 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.424 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.425 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.425 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.425 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.425 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.425 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.425 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_RBD": { 2024-03-04T09:25:44.425 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-03-04T09:25:44.426 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.426 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.426 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.426 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.426 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.426 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.426 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.426 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.426 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.426 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.426 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.426 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.427 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_RGW": { 2024-03-04T09:25:44.427 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-03-04T09:25:44.427 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.427 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.427 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.427 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.427 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.427 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.427 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.428 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.428 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.428 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.428 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.428 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.428 INFO:teuthology.orchestra.run.smithi082.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-03-04T09:25:44.428 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-03-04T09:25:44.428 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.428 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.428 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.428 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.428 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.428 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.429 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.429 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.429 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.429 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.429 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.429 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.429 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_PASSWORD": { 2024-03-04T09:25:44.429 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_PASSWORD", 2024-03-04T09:25:44.429 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.429 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.429 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.429 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "admin", 2024-03-04T09:25:44.429 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.429 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.430 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.430 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.430 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.430 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.430 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.430 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.430 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-03-04T09:25:44.430 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-03-04T09:25:44.430 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.430 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.430 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.430 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.430 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.431 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.431 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.431 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.431 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.431 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.431 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.431 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.431 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_URL": { 2024-03-04T09:25:44.431 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_URL", 2024-03-04T09:25:44.431 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.431 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.431 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.431 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.431 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.431 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.432 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.432 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.432 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.432 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.432 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.432 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.432 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_USERNAME": { 2024-03-04T09:25:44.432 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_USERNAME", 2024-03-04T09:25:44.432 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.432 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.432 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.432 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "admin", 2024-03-04T09:25:44.432 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.433 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.433 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.433 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.433 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.433 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.433 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.433 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.433 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-03-04T09:25:44.433 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-03-04T09:25:44.433 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.433 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.433 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.433 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.433 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.434 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.434 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.434 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.434 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.434 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.434 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.434 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.434 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-03-04T09:25:44.434 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-03-04T09:25:44.434 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.434 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.434 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.434 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.434 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.435 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.435 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.435 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.435 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.435 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.435 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.435 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.435 INFO:teuthology.orchestra.run.smithi082.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-03-04T09:25:44.435 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-03-04T09:25:44.435 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.435 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.435 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.435 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.435 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.435 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.436 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.436 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.436 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.436 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.436 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.436 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.436 INFO:teuthology.orchestra.run.smithi082.stdout: "ISSUE_TRACKER_API_KEY": { 2024-03-04T09:25:44.436 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-03-04T09:25:44.436 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.436 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.436 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.436 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.436 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.437 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.437 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.437 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.437 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.437 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.437 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.437 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.437 INFO:teuthology.orchestra.run.smithi082.stdout: "PROMETHEUS_API_HOST": { 2024-03-04T09:25:44.437 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PROMETHEUS_API_HOST", 2024-03-04T09:25:44.437 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.437 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.437 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.437 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.437 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.438 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.438 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.438 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.438 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.438 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.438 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.438 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.438 INFO:teuthology.orchestra.run.smithi082.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-03-04T09:25:44.438 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-03-04T09:25:44.438 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.438 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.438 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.438 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.438 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.438 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.439 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.439 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.439 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.439 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.439 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.439 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.439 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-03-04T09:25:44.439 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-03-04T09:25:44.439 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.439 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.439 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.439 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.439 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.439 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.439 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.440 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.440 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.440 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.440 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.440 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.440 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-03-04T09:25:44.440 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-03-04T09:25:44.440 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.440 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.440 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.440 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.440 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.440 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.440 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.441 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.441 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.441 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.441 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.441 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.441 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-03-04T09:25:44.441 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-03-04T09:25:44.441 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.441 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.441 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.441 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.441 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.441 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.441 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.442 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.442 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.442 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.442 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.442 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.442 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-03-04T09:25:44.442 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-03-04T09:25:44.442 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.442 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.442 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.442 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.442 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.442 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.442 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.442 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.443 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.443 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.443 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.443 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.443 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-03-04T09:25:44.443 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-03-04T09:25:44.443 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.443 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.443 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.443 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.443 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.443 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.443 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.443 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.443 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.444 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.444 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.444 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.444 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-03-04T09:25:44.444 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-03-04T09:25:44.444 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.444 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.444 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.444 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.444 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.444 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.444 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.444 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.444 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.445 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.445 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.445 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.445 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-03-04T09:25:44.445 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-03-04T09:25:44.445 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.445 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.445 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.445 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.445 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.445 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.445 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.445 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.445 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.445 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.446 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.446 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.446 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_ENABLED": { 2024-03-04T09:25:44.446 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_ENABLED", 2024-03-04T09:25:44.446 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.446 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.446 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.446 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.446 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.446 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.446 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.446 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.446 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.446 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-03-04T09:25:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-03-04T09:25:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-03-04T09:25:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-03-04T09:25:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-03-04T09:25:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-03-04T09:25:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.449 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.449 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-03-04T09:25:44.449 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-03-04T09:25:44.449 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.449 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.449 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.449 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8", 2024-03-04T09:25:44.449 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.449 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.449 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.449 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.449 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.449 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.449 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.450 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.450 INFO:teuthology.orchestra.run.smithi082.stdout: "REST_REQUESTS_TIMEOUT": { 2024-03-04T09:25:44.450 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-03-04T09:25:44.450 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.450 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.450 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.450 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "45", 2024-03-04T09:25:44.450 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.450 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.450 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.450 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.450 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.450 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.450 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.451 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.451 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_ACCESS_KEY": { 2024-03-04T09:25:44.451 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_ACCESS_KEY", 2024-03-04T09:25:44.451 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.451 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.451 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.451 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.451 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.451 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.451 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.451 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.451 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.451 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.451 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.451 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.452 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-03-04T09:25:44.452 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-03-04T09:25:44.452 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.452 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.452 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.452 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "admin", 2024-03-04T09:25:44.452 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.452 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.452 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.452 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.452 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.452 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.452 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.452 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.453 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_SECRET_KEY": { 2024-03-04T09:25:44.453 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_SECRET_KEY", 2024-03-04T09:25:44.453 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.453 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.453 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.453 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.453 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.453 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.453 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.453 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.453 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.453 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.453 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.453 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.454 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_SSL_VERIFY": { 2024-03-04T09:25:44.454 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_SSL_VERIFY", 2024-03-04T09:25:44.454 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.454 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.454 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.454 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.454 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.454 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.454 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.454 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.454 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.454 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.454 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.454 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.455 INFO:teuthology.orchestra.run.smithi082.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-03-04T09:25:44.455 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-03-04T09:25:44.455 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.455 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.455 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.455 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-03-04T09:25:44.455 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.455 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.455 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.455 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.455 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.455 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.455 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.455 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.456 INFO:teuthology.orchestra.run.smithi082.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-03-04T09:25:44.456 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-03-04T09:25:44.456 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.456 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.456 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.456 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-03-04T09:25:44.456 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.456 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.456 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.456 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.456 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.456 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.456 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-03-04T09:25:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-03-04T09:25:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-03-04T09:25:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.458 INFO:teuthology.orchestra.run.smithi082.stdout: "cross_origin_url": { 2024-03-04T09:25:44.458 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cross_origin_url", 2024-03-04T09:25:44.458 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.458 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.458 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.458 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.458 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.458 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.458 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.458 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.458 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.458 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.458 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.458 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: "crt_file": { 2024-03-04T09:25:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crt_file", 2024-03-04T09:25:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: "debug": { 2024-03-04T09:25:44.460 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "debug", 2024-03-04T09:25:44.460 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.460 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.460 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.460 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.460 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.460 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.460 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.460 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Enable/disable debug options", 2024-03-04T09:25:44.460 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.460 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.460 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.460 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.460 INFO:teuthology.orchestra.run.smithi082.stdout: "jwt_token_ttl": { 2024-03-04T09:25:44.461 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "jwt_token_ttl", 2024-03-04T09:25:44.461 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.461 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.461 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.461 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "28800", 2024-03-04T09:25:44.461 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.461 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.461 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.461 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.461 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.461 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.461 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.461 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.461 INFO:teuthology.orchestra.run.smithi082.stdout: "key_file": { 2024-03-04T09:25:44.461 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "key_file", 2024-03-04T09:25:44.462 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.462 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.462 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.462 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.462 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.462 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.462 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.462 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.462 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.462 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.462 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.462 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.462 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:44.462 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:44.463 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.463 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.463 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.463 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.463 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.463 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.463 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.463 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.463 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.463 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.463 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.463 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.463 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.463 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.464 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.464 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.464 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.464 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.464 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.464 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:44.464 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:44.464 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.464 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.464 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.464 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.464 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.464 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.465 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.465 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.465 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.465 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.465 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.465 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.465 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:44.465 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:44.465 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.465 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.465 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.465 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:44.465 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.465 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.465 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.466 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.466 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.466 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.466 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.466 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.466 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.466 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.466 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.466 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.466 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.466 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.466 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.466 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:44.467 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:44.467 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.467 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.467 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.467 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.467 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.467 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.467 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.467 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.467 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.467 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.467 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.467 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.467 INFO:teuthology.orchestra.run.smithi082.stdout: "motd": { 2024-03-04T09:25:44.468 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "motd", 2024-03-04T09:25:44.468 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.468 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.468 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.468 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.468 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.468 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.468 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.468 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "The message of the day", 2024-03-04T09:25:44.468 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.468 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.468 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.468 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.468 INFO:teuthology.orchestra.run.smithi082.stdout: "redirect_resolve_ip_addr": { 2024-03-04T09:25:44.469 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "redirect_resolve_ip_addr", 2024-03-04T09:25:44.469 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.469 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.469 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.469 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.469 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.469 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.469 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.469 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.469 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.469 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.469 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.469 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.469 INFO:teuthology.orchestra.run.smithi082.stdout: "server_addr": { 2024-03-04T09:25:44.470 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_addr", 2024-03-04T09:25:44.470 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.470 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.470 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.470 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "::", 2024-03-04T09:25:44.470 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.470 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.470 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.470 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.470 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.470 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.470 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.470 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.470 INFO:teuthology.orchestra.run.smithi082.stdout: "server_port": { 2024-03-04T09:25:44.471 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_port", 2024-03-04T09:25:44.471 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.471 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.471 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.471 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8080", 2024-03-04T09:25:44.471 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.471 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.471 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.471 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.471 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.471 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.471 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.471 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.471 INFO:teuthology.orchestra.run.smithi082.stdout: "ssl": { 2024-03-04T09:25:44.471 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssl", 2024-03-04T09:25:44.472 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.472 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.472 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.472 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.472 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.472 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.472 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.472 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.472 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.472 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.472 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.472 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.472 INFO:teuthology.orchestra.run.smithi082.stdout: "ssl_server_port": { 2024-03-04T09:25:44.472 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssl_server_port", 2024-03-04T09:25:44.473 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.473 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.473 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.473 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8443", 2024-03-04T09:25:44.473 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.473 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.473 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.473 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.473 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.473 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.473 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.473 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.473 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_behaviour": { 2024-03-04T09:25:44.473 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_behaviour", 2024-03-04T09:25:44.473 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.474 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.474 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.474 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "redirect", 2024-03-04T09:25:44.474 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.474 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.474 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.474 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.474 INFO:teuthology.orchestra.run.smithi082.stdout: "redirect" 2024-03-04T09:25:44.474 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.474 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.474 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.474 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.474 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.474 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.474 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_error_status_code": { 2024-03-04T09:25:44.474 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_error_status_code", 2024-03-04T09:25:44.475 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.475 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.475 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.475 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "500", 2024-03-04T09:25:44.475 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "400", 2024-03-04T09:25:44.475 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "599", 2024-03-04T09:25:44.475 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.475 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.475 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.475 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.475 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.475 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.475 INFO:teuthology.orchestra.run.smithi082.stdout: "url_prefix": { 2024-03-04T09:25:44.476 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "url_prefix", 2024-03-04T09:25:44.476 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.476 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.476 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.476 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.476 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.476 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.476 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.476 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.476 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.476 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.476 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.476 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.477 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.477 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.477 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:44.477 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "devicehealth", 2024-03-04T09:25:44.477 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:44.477 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:44.477 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:44.477 INFO:teuthology.orchestra.run.smithi082.stdout: "enable_monitoring": { 2024-03-04T09:25:44.477 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enable_monitoring", 2024-03-04T09:25:44.477 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.477 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.477 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.477 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.477 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.478 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.478 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.478 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "monitor device health metrics", 2024-03-04T09:25:44.478 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.478 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.478 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.478 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.478 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:44.478 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:44.478 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.478 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.478 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.478 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.478 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.478 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.479 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.479 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.479 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.479 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.479 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.479 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.479 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.479 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.479 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.479 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.479 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.479 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.479 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.479 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:44.479 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:44.480 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.480 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.480 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.480 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.480 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.480 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.480 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.480 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.480 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.480 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.480 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.480 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.480 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:44.480 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:44.481 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.481 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.481 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.481 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:44.481 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.481 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.481 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.481 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.481 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.481 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.481 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.483 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.483 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.483 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.483 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.483 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.483 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.483 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.483 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.483 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:44.483 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:44.483 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.484 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.484 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.484 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.484 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.484 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.484 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.484 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.484 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.484 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.484 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.484 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.484 INFO:teuthology.orchestra.run.smithi082.stdout: "mark_out_threshold": { 2024-03-04T09:25:44.484 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mark_out_threshold", 2024-03-04T09:25:44.484 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:44.485 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.485 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.485 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "2419200", 2024-03-04T09:25:44.485 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.485 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.485 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.485 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-03-04T09:25:44.485 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.485 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.485 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.485 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.485 INFO:teuthology.orchestra.run.smithi082.stdout: "pool_name": { 2024-03-04T09:25:44.485 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pool_name", 2024-03-04T09:25:44.486 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.486 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.486 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.486 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "device_health_metrics", 2024-03-04T09:25:44.486 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.486 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.486 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.486 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "name of pool in which to store device health metrics", 2024-03-04T09:25:44.486 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.486 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.486 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.486 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.486 INFO:teuthology.orchestra.run.smithi082.stdout: "retention_period": { 2024-03-04T09:25:44.486 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "retention_period", 2024-03-04T09:25:44.486 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:44.486 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.487 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.487 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "15552000", 2024-03-04T09:25:44.487 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.487 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.487 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.487 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how long to retain device health metrics", 2024-03-04T09:25:44.487 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.487 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.487 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.487 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.487 INFO:teuthology.orchestra.run.smithi082.stdout: "scrape_frequency": { 2024-03-04T09:25:44.487 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "scrape_frequency", 2024-03-04T09:25:44.487 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:44.487 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.487 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.487 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "86400", 2024-03-04T09:25:44.488 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.488 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.488 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.488 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to scrape device health metrics", 2024-03-04T09:25:44.488 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.488 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.488 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.488 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.488 INFO:teuthology.orchestra.run.smithi082.stdout: "self_heal": { 2024-03-04T09:25:44.488 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "self_heal", 2024-03-04T09:25:44.488 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.488 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.488 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.488 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.489 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.489 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.489 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.489 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-03-04T09:25:44.489 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.489 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.489 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.489 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.489 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-03-04T09:25:44.489 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-03-04T09:25:44.489 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:44.489 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.489 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.489 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-03-04T09:25:44.490 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.490 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.490 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.490 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to wake up and check device health", 2024-03-04T09:25:44.490 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.490 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.490 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.490 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.490 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_threshold": { 2024-03-04T09:25:44.490 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_threshold", 2024-03-04T09:25:44.490 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:44.490 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.490 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.491 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "7257600", 2024-03-04T09:25:44.491 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.491 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.491 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.491 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-03-04T09:25:44.491 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.491 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.491 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.491 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.491 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.491 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.491 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:44.491 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "diskprediction_local", 2024-03-04T09:25:44.492 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:44.492 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:44.492 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:44.492 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:44.492 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:44.492 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.492 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.492 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.492 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.492 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.492 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.492 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.492 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.492 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.493 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.493 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.493 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.493 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.493 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.493 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.493 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.493 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.493 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.493 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.493 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:44.493 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:44.493 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.493 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.494 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.494 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.494 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.494 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.494 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.494 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.494 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.494 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.494 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.494 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.494 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:44.494 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:44.494 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.494 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.495 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.495 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:44.495 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.495 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.495 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.495 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.495 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.495 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.495 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.495 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.495 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.495 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.495 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.495 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.496 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.496 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.496 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.496 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:44.496 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:44.496 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.496 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.496 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.496 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.496 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.496 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.496 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.496 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.496 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.496 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.497 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.497 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.497 INFO:teuthology.orchestra.run.smithi082.stdout: "predict_interval": { 2024-03-04T09:25:44.497 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "predict_interval", 2024-03-04T09:25:44.497 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.497 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.497 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.497 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "86400", 2024-03-04T09:25:44.497 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.497 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.497 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.497 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.497 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.497 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.498 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.498 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.498 INFO:teuthology.orchestra.run.smithi082.stdout: "predictor_model": { 2024-03-04T09:25:44.498 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "predictor_model", 2024-03-04T09:25:44.498 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.498 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.498 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.498 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "prophetstor", 2024-03-04T09:25:44.498 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.498 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.498 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.498 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.498 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.498 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.499 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.499 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.499 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-03-04T09:25:44.499 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-03-04T09:25:44.499 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.499 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.499 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.499 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-03-04T09:25:44.499 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.499 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.499 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.499 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.499 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.499 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.499 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.500 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.500 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.500 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.500 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:44.500 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "influx", 2024-03-04T09:25:44.500 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": false, 2024-03-04T09:25:44.500 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "influxdb python module not found", 2024-03-04T09:25:44.500 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:44.500 INFO:teuthology.orchestra.run.smithi082.stdout: "batch_size": { 2024-03-04T09:25:44.500 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "batch_size", 2024-03-04T09:25:44.500 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.500 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.500 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.500 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5000", 2024-03-04T09:25:44.500 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.501 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.501 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.501 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-03-04T09:25:44.501 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.501 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.501 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.501 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.501 INFO:teuthology.orchestra.run.smithi082.stdout: "database": { 2024-03-04T09:25:44.501 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "database", 2024-03-04T09:25:44.501 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.501 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.501 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.501 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "ceph", 2024-03-04T09:25:44.501 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.501 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.502 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.502 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-03-04T09:25:44.502 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.502 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.502 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.502 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.502 INFO:teuthology.orchestra.run.smithi082.stdout: "hostname": { 2024-03-04T09:25:44.502 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "hostname", 2024-03-04T09:25:44.502 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.502 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.502 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.502 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.502 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.502 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.503 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.503 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "InfluxDB server hostname", 2024-03-04T09:25:44.503 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.503 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.503 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.503 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.503 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-03-04T09:25:44.503 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-03-04T09:25:44.503 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:44.503 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.503 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.503 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "30", 2024-03-04T09:25:44.503 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "5", 2024-03-04T09:25:44.503 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.504 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.504 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-03-04T09:25:44.504 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.504 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.504 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.504 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.504 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:44.504 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:44.504 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.504 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.504 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.504 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.505 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.505 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.505 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.505 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.505 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.505 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.505 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.505 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.505 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.505 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.505 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.505 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.505 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.505 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.505 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.506 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:44.506 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:44.506 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.506 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.506 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.506 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.506 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.506 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.506 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.506 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.506 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.506 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.506 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.506 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.507 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:44.507 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:44.507 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.507 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.507 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.507 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:44.507 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.507 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.507 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.507 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.507 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.507 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.507 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.508 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.508 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.508 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.508 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.508 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.508 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.508 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.508 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.508 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:44.508 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:44.508 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.508 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.508 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.508 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.509 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.509 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.509 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.509 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.509 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.509 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.509 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.509 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.509 INFO:teuthology.orchestra.run.smithi082.stdout: "password": { 2024-03-04T09:25:44.509 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "password", 2024-03-04T09:25:44.509 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.509 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.509 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.509 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.510 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.510 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.510 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.510 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "password of InfluxDB server user", 2024-03-04T09:25:44.510 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.510 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.510 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.510 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.510 INFO:teuthology.orchestra.run.smithi082.stdout: "port": { 2024-03-04T09:25:44.510 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "port", 2024-03-04T09:25:44.510 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.510 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.510 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.510 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8086", 2024-03-04T09:25:44.511 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.511 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.511 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.511 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "InfluxDB server port", 2024-03-04T09:25:44.511 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.511 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.511 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.511 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.511 INFO:teuthology.orchestra.run.smithi082.stdout: "ssl": { 2024-03-04T09:25:44.511 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssl", 2024-03-04T09:25:44.511 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.511 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.511 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.511 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "false", 2024-03-04T09:25:44.512 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.512 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.512 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.512 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-03-04T09:25:44.512 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.512 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.512 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.512 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.512 INFO:teuthology.orchestra.run.smithi082.stdout: "threads": { 2024-03-04T09:25:44.512 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "threads", 2024-03-04T09:25:44.512 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.512 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.512 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.512 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-03-04T09:25:44.513 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-03-04T09:25:44.513 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "32", 2024-03-04T09:25:44.513 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.513 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-03-04T09:25:44.513 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.513 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.513 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.513 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.513 INFO:teuthology.orchestra.run.smithi082.stdout: "username": { 2024-03-04T09:25:44.513 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "username", 2024-03-04T09:25:44.513 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.513 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.513 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.513 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.514 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.514 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.514 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.514 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "username of InfluxDB server user", 2024-03-04T09:25:44.514 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.514 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.514 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.514 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.514 INFO:teuthology.orchestra.run.smithi082.stdout: "verify_ssl": { 2024-03-04T09:25:44.514 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "verify_ssl", 2024-03-04T09:25:44.514 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.514 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.514 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.514 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "true", 2024-03-04T09:25:44.515 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.515 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.515 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.515 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-03-04T09:25:44.515 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.515 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.515 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.515 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.515 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.515 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.515 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:44.515 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "insights", 2024-03-04T09:25:44.515 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:44.515 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:44.516 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:44.516 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:44.516 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:44.516 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.516 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.516 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.516 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.516 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.516 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.516 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.516 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.516 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.516 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.516 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.516 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.517 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.517 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.517 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.517 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.517 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.517 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.517 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.517 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:44.517 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:44.517 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.517 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.517 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.518 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.518 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.518 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.518 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.518 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.518 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.518 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.518 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.518 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.518 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:44.518 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:44.518 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.518 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.518 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.518 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:44.519 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.519 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.519 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.519 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.519 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.519 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.519 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.519 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.519 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.519 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.519 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.519 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.519 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.519 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.519 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.520 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:44.520 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:44.520 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.520 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.520 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.520 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.520 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.520 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.520 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.520 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.520 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.520 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.520 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.521 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.521 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.521 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.521 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:44.521 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "iostat", 2024-03-04T09:25:44.521 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:44.521 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:44.521 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:44.521 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:44.521 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:44.521 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.521 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.521 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.521 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.522 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.522 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.522 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.522 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.522 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.522 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.522 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.522 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.522 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.522 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.522 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.522 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.522 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.522 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.522 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.523 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:44.523 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:44.523 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.523 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.523 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.523 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.523 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.523 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.523 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.523 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.523 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.523 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.523 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.523 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.523 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:44.524 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:44.524 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.524 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.524 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.524 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:44.524 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.524 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.524 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.524 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.524 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.524 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.524 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.524 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.524 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.525 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.525 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.525 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.525 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.525 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.525 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.525 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:44.525 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:44.525 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.525 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.525 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.525 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.525 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.525 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.526 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.526 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.526 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.526 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.526 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.526 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.526 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.526 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.526 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:44.526 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "k8sevents", 2024-03-04T09:25:44.526 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:44.526 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:44.526 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:44.526 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_event_retention_days": { 2024-03-04T09:25:44.526 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ceph_event_retention_days", 2024-03-04T09:25:44.527 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.527 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.527 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.527 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "7", 2024-03-04T09:25:44.527 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.527 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.527 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.527 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Days to hold ceph event information within local cache", 2024-03-04T09:25:44.527 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.527 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.527 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.527 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.527 INFO:teuthology.orchestra.run.smithi082.stdout: "config_check_secs": { 2024-03-04T09:25:44.527 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "config_check_secs", 2024-03-04T09:25:44.527 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.528 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.528 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.528 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-03-04T09:25:44.528 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "10", 2024-03-04T09:25:44.528 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.528 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.528 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-03-04T09:25:44.528 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.528 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.528 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.528 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.528 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:44.528 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:44.528 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.528 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.529 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.529 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.529 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.529 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.529 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.529 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.529 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.529 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.529 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.529 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.529 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.529 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.529 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.529 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.529 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.530 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.530 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.530 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:44.530 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:44.530 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.530 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.530 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.530 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.530 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.530 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.530 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.530 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.530 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.531 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.531 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.531 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.531 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:44.531 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:44.531 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.531 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.531 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.531 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:44.531 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.531 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.531 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.531 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.531 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.531 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.532 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.532 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.532 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.532 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.532 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.532 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.532 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.532 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.532 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.532 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:44.532 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:44.532 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.532 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.533 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.533 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.533 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.533 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.533 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.533 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.533 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.533 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.533 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.533 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.533 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.533 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.533 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:44.533 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "localpool", 2024-03-04T09:25:44.533 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:44.533 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:44.534 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:44.534 INFO:teuthology.orchestra.run.smithi082.stdout: "failure_domain": { 2024-03-04T09:25:44.534 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "failure_domain", 2024-03-04T09:25:44.534 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.534 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.534 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.534 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "host", 2024-03-04T09:25:44.534 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.534 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.534 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.534 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "failure domain for any created local pool", 2024-03-04T09:25:44.534 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-03-04T09:25:44.534 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.534 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.535 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.535 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:44.535 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:44.535 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.535 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.535 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.535 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.535 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.535 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.535 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.535 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.535 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.535 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.535 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.536 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.536 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.536 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.536 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.536 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.536 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.536 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.536 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.536 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:44.536 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:44.536 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.536 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.536 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.536 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.536 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.537 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.537 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.537 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.537 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.537 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.537 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.537 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.537 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:44.537 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:44.537 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.537 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.537 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.537 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:44.537 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.537 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.538 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.538 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.538 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.538 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.538 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.538 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.538 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.538 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.538 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.538 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.538 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.538 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.538 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.538 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:44.539 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:44.539 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.539 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.539 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.539 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.539 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.539 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.539 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.539 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.539 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.539 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.539 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.539 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.539 INFO:teuthology.orchestra.run.smithi082.stdout: "min_size": { 2024-03-04T09:25:44.539 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "min_size", 2024-03-04T09:25:44.540 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.540 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.540 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.540 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.540 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.540 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.540 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.540 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "default min_size for any created local pool", 2024-03-04T09:25:44.540 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-03-04T09:25:44.540 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.540 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.540 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.540 INFO:teuthology.orchestra.run.smithi082.stdout: "num_rep": { 2024-03-04T09:25:44.540 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "num_rep", 2024-03-04T09:25:44.541 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.541 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.541 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.541 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "3", 2024-03-04T09:25:44.541 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.541 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.541 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.541 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "default replica count for any created local pool", 2024-03-04T09:25:44.541 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.541 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.541 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.541 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.541 INFO:teuthology.orchestra.run.smithi082.stdout: "pg_num": { 2024-03-04T09:25:44.541 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pg_num", 2024-03-04T09:25:44.541 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.542 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.542 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.542 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "128", 2024-03-04T09:25:44.542 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.542 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.542 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.542 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "default pg_num for any created local pool", 2024-03-04T09:25:44.542 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.542 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.542 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.542 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.542 INFO:teuthology.orchestra.run.smithi082.stdout: "prefix": { 2024-03-04T09:25:44.542 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "prefix", 2024-03-04T09:25:44.542 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.542 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.543 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.543 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.543 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.543 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.543 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.543 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "name prefix for any created local pool", 2024-03-04T09:25:44.543 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.543 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.543 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.543 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.543 INFO:teuthology.orchestra.run.smithi082.stdout: "subtree": { 2024-03-04T09:25:44.543 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "subtree", 2024-03-04T09:25:44.543 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.544 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.544 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.544 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "rack", 2024-03-04T09:25:44.544 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.544 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.544 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.544 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "CRUSH level for which to create a local pool", 2024-03-04T09:25:44.544 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-03-04T09:25:44.544 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.544 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.544 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.544 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.544 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.544 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:44.545 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mds_autoscaler", 2024-03-04T09:25:44.545 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:44.545 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:44.545 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:44.545 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:44.545 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:44.545 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.545 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.545 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.545 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.545 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.545 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.545 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.545 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.545 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.546 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.546 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.546 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.546 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.546 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.546 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.546 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.546 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.546 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.546 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.546 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:44.546 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:44.546 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.546 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.547 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.547 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.547 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.547 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.547 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.547 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.547 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.547 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.547 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.547 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.547 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:44.547 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:44.547 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.547 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.549 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.549 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.549 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.549 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:44.549 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:44.549 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.549 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.549 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.549 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.549 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.549 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.549 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.549 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.549 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.550 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.550 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.550 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.550 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.550 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.550 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:44.550 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mirroring", 2024-03-04T09:25:44.550 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:44.550 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:44.550 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:44.550 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:44.550 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:44.550 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.550 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.550 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.551 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.551 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.551 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.551 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.551 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.551 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.551 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.551 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.551 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.551 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.551 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.551 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.551 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.551 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.552 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.552 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.552 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:44.552 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:44.552 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.552 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.552 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.552 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.552 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.552 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.552 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.552 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.552 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.552 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.553 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.553 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.553 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:44.553 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:44.553 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.553 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.553 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.553 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:44.553 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.553 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.553 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.553 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.553 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.553 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.553 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.554 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.554 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.554 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.554 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.554 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.554 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.554 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.554 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.554 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:44.554 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:44.554 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.554 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.554 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.554 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.554 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.555 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.555 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.555 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.555 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.555 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.555 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.555 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.555 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.555 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.555 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:44.555 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "nfs", 2024-03-04T09:25:44.555 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:44.555 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:44.555 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:44.556 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:44.556 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:44.556 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.556 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.556 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.556 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.556 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.556 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.556 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.556 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.556 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.556 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.556 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.556 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.556 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.557 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.557 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.557 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.557 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.557 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.557 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.557 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:44.557 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:44.557 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.557 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.557 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.557 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.557 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.558 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.558 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.558 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.558 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.558 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.558 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.558 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.558 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:44.558 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:44.558 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.558 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.558 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.558 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:44.558 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.558 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:44.560 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.560 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.560 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.560 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.560 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.560 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.560 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.560 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.560 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.560 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.560 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.560 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.560 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "orchestrator", 2024-03-04T09:25:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: "fail_fs": { 2024-03-04T09:25:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "fail_fs", 2024-03-04T09:25:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.562 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-03-04T09:25:44.562 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.562 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.562 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.562 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.562 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:44.562 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:44.562 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.562 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.562 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.562 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.562 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.562 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.562 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.563 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.563 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.563 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.563 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.563 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.563 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.563 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.563 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.563 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.563 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.563 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.563 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.563 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:44.563 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:44.564 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.564 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.564 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.564 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.564 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.564 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.564 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.564 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.564 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.564 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.564 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.564 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.564 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:44.564 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:44.565 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.565 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.565 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.565 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:44.565 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.565 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.565 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.565 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.565 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.565 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.565 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.565 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.565 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.565 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.566 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.566 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.566 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.566 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.566 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.566 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:44.566 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:44.566 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.566 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.566 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.566 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.566 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.566 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.566 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.566 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.567 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.567 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.567 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.567 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.567 INFO:teuthology.orchestra.run.smithi082.stdout: "orchestrator": { 2024-03-04T09:25:44.567 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "orchestrator", 2024-03-04T09:25:44.567 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.567 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.567 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.567 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.567 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.567 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.567 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.567 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm", 2024-03-04T09:25:44.567 INFO:teuthology.orchestra.run.smithi082.stdout: "rook", 2024-03-04T09:25:44.568 INFO:teuthology.orchestra.run.smithi082.stdout: "test_orchestrator" 2024-03-04T09:25:44.568 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.568 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Orchestrator backend", 2024-03-04T09:25:44.568 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.568 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.568 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.568 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.568 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.568 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.568 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:44.568 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "osd_perf_query", 2024-03-04T09:25:44.569 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:44.569 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:44.569 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:44.569 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:44.569 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:44.569 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.569 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.569 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.569 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.569 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.569 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.569 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.569 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.569 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.570 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.570 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.570 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.570 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.570 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.570 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.570 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.570 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.570 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.570 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.570 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:44.570 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:44.570 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.570 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.571 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.571 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.571 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.571 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.571 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.571 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.571 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.571 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.571 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.571 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.571 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:44.571 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:44.571 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.572 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.572 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.572 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:44.572 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.572 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.572 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.572 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.572 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.572 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.572 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.572 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.572 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.572 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.573 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.573 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.573 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.573 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.573 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.573 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:44.573 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:44.573 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.573 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.573 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.573 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.573 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.573 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.573 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.573 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.574 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.574 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.574 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.574 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.574 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.574 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.574 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:44.574 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "osd_support", 2024-03-04T09:25:44.574 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:44.574 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:44.574 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:44.574 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:44.574 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:44.574 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.575 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.575 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.575 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.575 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.575 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.575 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.576 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.576 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.576 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.576 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.576 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.576 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.576 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.576 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.576 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.576 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.577 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.577 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.577 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:44.577 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:44.577 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.577 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.577 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.578 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.578 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.578 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.578 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.578 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.578 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.578 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.579 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.579 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.579 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:44.579 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:44.579 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.579 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.579 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.579 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:44.579 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.579 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.579 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.579 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.580 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.580 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.580 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.580 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.580 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.580 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.580 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.580 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.581 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.581 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.581 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.581 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:44.581 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:44.581 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.581 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.581 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.581 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.581 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.582 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.582 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.582 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.582 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.582 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.582 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.582 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.582 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.582 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.582 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:44.582 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pg_autoscaler", 2024-03-04T09:25:44.583 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:44.583 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:44.583 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:44.583 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:44.583 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:44.583 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.583 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.584 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.584 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.584 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.584 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.584 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.584 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.584 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.584 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.584 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.584 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.584 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.584 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.584 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.585 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.585 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.585 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.585 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.585 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:44.585 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:44.585 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.585 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.585 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.585 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.585 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.585 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.585 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.585 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.586 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.586 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.586 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.586 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.586 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:44.586 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:44.586 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.586 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.586 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.586 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:44.586 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.587 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.587 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.587 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.587 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.587 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.587 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.587 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.587 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.587 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.587 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.587 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.587 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.587 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.587 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.588 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:44.588 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:44.588 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.588 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.588 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.588 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.588 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.588 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.588 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.588 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.588 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.588 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.589 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.589 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.589 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-03-04T09:25:44.589 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-03-04T09:25:44.589 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:44.589 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.589 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.589 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-03-04T09:25:44.589 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.589 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.589 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.589 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.589 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.589 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.590 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.590 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.590 INFO:teuthology.orchestra.run.smithi082.stdout: "threshold": { 2024-03-04T09:25:44.590 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "threshold", 2024-03-04T09:25:44.590 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-03-04T09:25:44.590 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.590 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.590 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "3.0", 2024-03-04T09:25:44.590 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1.0", 2024-03-04T09:25:44.590 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.590 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.590 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "scaling threshold", 2024-03-04T09:25:44.590 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-03-04T09:25:44.590 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.591 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.591 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.591 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.591 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.591 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:44.591 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "progress", 2024-03-04T09:25:44.591 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:44.591 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:44.591 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:44.591 INFO:teuthology.orchestra.run.smithi082.stdout: "allow_pg_recovery_event": { 2024-03-04T09:25:44.591 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "allow_pg_recovery_event", 2024-03-04T09:25:44.591 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.591 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.591 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.591 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.592 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.592 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.592 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.592 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "allow the module to show pg recovery progress", 2024-03-04T09:25:44.592 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.592 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.592 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.592 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.592 INFO:teuthology.orchestra.run.smithi082.stdout: "enabled": { 2024-03-04T09:25:44.592 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enabled", 2024-03-04T09:25:44.592 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.592 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.592 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.593 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.593 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.593 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.593 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.593 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.593 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.593 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.593 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.593 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.593 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:44.593 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:44.593 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.593 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.593 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.595 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.595 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:44.595 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:44.595 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.595 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.595 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.595 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.595 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.595 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.595 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.595 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.595 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.595 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.595 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.595 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.596 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:44.596 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:44.596 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.596 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.596 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.596 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:44.596 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.596 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.596 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.596 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.596 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.596 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.596 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.596 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.597 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.597 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.597 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.597 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.597 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.597 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.597 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.597 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:44.597 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:44.597 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.597 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.597 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.597 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.597 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.597 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.598 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.598 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.598 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.598 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.598 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.598 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.598 INFO:teuthology.orchestra.run.smithi082.stdout: "max_completed_events": { 2024-03-04T09:25:44.598 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_completed_events", 2024-03-04T09:25:44.598 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.598 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.598 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.598 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "50", 2024-03-04T09:25:44.598 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.598 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.599 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.599 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "number of past completed events to remember", 2024-03-04T09:25:44.599 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.599 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.599 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.599 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.599 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-03-04T09:25:44.599 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-03-04T09:25:44.599 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:44.599 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.602 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.602 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-03-04T09:25:44.602 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.602 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.602 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.602 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how long the module is going to sleep", 2024-03-04T09:25:44.603 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.603 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.603 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.603 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.603 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.603 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.603 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:44.603 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "prometheus", 2024-03-04T09:25:44.603 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:44.603 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:44.603 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:44.603 INFO:teuthology.orchestra.run.smithi082.stdout: "cache": { 2024-03-04T09:25:44.603 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cache", 2024-03-04T09:25:44.603 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.604 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.604 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.604 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.604 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.604 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.604 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.604 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.604 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.604 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.605 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.605 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.605 INFO:teuthology.orchestra.run.smithi082.stdout: "exclude_perf_counters": { 2024-03-04T09:25:44.605 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "exclude_perf_counters", 2024-03-04T09:25:44.605 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.605 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.605 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.605 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.605 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.605 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.605 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.605 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-03-04T09:25:44.606 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-03-04T09:25:44.606 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.606 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.606 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.606 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:44.606 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:44.607 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.607 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.607 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.607 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.607 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.607 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.607 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.608 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.608 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.608 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.608 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.608 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.608 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.608 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.608 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.608 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.608 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.608 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.608 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.609 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:44.609 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:44.609 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.609 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.609 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.609 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.609 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.609 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.609 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.609 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.609 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.609 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.609 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.610 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.610 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:44.610 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:44.610 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.610 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.610 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.610 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:44.610 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.610 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.610 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.610 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.610 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.611 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.611 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.611 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.611 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.611 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.611 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.611 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.611 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.611 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.611 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.611 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:44.611 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:44.611 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.611 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.612 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.612 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.612 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.612 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.612 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.612 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.612 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.612 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.612 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.612 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.612 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_stats_pools": { 2024-03-04T09:25:44.613 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_stats_pools", 2024-03-04T09:25:44.613 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.613 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.613 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.613 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.613 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.613 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.613 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.613 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.613 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.614 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.614 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.614 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.614 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_stats_pools_refresh_interval": { 2024-03-04T09:25:44.614 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-03-04T09:25:44.614 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.614 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.614 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.614 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "300", 2024-03-04T09:25:44.614 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.615 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.615 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.615 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.615 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.615 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.615 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.616 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.616 INFO:teuthology.orchestra.run.smithi082.stdout: "scrape_interval": { 2024-03-04T09:25:44.616 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "scrape_interval", 2024-03-04T09:25:44.616 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-03-04T09:25:44.616 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.616 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.616 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "15.0", 2024-03-04T09:25:44.616 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.616 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.617 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.617 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.617 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.617 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.617 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.617 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.617 INFO:teuthology.orchestra.run.smithi082.stdout: "server_addr": { 2024-03-04T09:25:44.617 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_addr", 2024-03-04T09:25:44.617 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.617 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.617 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.617 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "::", 2024-03-04T09:25:44.618 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.618 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.618 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.618 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-03-04T09:25:44.618 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.618 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.618 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.619 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.619 INFO:teuthology.orchestra.run.smithi082.stdout: "server_port": { 2024-03-04T09:25:44.619 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_port", 2024-03-04T09:25:44.619 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.619 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.619 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.619 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "9283", 2024-03-04T09:25:44.619 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.619 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.619 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.619 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-03-04T09:25:44.619 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.619 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.620 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.620 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.620 INFO:teuthology.orchestra.run.smithi082.stdout: "stale_cache_strategy": { 2024-03-04T09:25:44.620 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "stale_cache_strategy", 2024-03-04T09:25:44.620 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.620 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.620 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.620 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "log", 2024-03-04T09:25:44.620 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.620 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.620 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.620 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.621 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.621 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.621 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.621 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.621 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_behaviour": { 2024-03-04T09:25:44.621 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_behaviour", 2024-03-04T09:25:44.621 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.621 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.621 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.621 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "default", 2024-03-04T09:25:44.621 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.621 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.622 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.622 INFO:teuthology.orchestra.run.smithi082.stdout: "default", 2024-03-04T09:25:44.622 INFO:teuthology.orchestra.run.smithi082.stdout: "error" 2024-03-04T09:25:44.622 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.622 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.622 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.622 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.622 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.622 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.623 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_error_status_code": { 2024-03-04T09:25:44.623 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_error_status_code", 2024-03-04T09:25:44.623 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.623 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.623 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.623 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "500", 2024-03-04T09:25:44.623 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "400", 2024-03-04T09:25:44.623 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "599", 2024-03-04T09:25:44.623 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.623 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.623 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.623 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.623 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.624 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.624 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.624 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.624 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:44.624 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_support", 2024-03-04T09:25:44.624 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:44.624 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:44.624 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:44.624 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:44.624 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:44.624 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.624 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.625 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.625 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.625 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.625 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.625 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.625 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.625 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.625 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.625 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.625 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.625 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.625 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.625 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.626 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.626 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.626 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.626 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.626 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:44.626 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:44.626 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.626 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.626 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.626 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.626 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.626 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.626 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.626 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.626 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.627 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.627 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.627 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.627 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:44.627 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:44.627 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.627 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.627 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.627 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:44.627 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.627 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.627 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.627 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.627 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.628 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.628 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.628 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.628 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.628 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.628 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.628 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.628 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.628 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.628 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.628 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:44.628 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:44.629 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.629 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.629 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.629 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.629 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.629 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.629 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.629 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.629 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.629 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.629 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.629 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.629 INFO:teuthology.orchestra.run.smithi082.stdout: "max_concurrent_snap_create": { 2024-03-04T09:25:44.629 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_concurrent_snap_create", 2024-03-04T09:25:44.629 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.630 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.630 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.630 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-03-04T09:25:44.630 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.630 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.630 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.630 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.630 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.630 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.630 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.630 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.630 INFO:teuthology.orchestra.run.smithi082.stdout: "mirror_snapshot_schedule": { 2024-03-04T09:25:44.630 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mirror_snapshot_schedule", 2024-03-04T09:25:44.630 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.630 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.631 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.631 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.631 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.631 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.631 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.631 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.631 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.631 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.631 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.631 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.631 INFO:teuthology.orchestra.run.smithi082.stdout: "trash_purge_schedule": { 2024-03-04T09:25:44.631 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "trash_purge_schedule", 2024-03-04T09:25:44.632 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.632 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.632 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.632 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.632 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.632 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.632 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.632 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.632 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.632 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.632 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.632 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.632 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.632 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.633 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:44.633 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "restful", 2024-03-04T09:25:44.633 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:44.633 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:44.633 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:44.633 INFO:teuthology.orchestra.run.smithi082.stdout: "enable_auth": { 2024-03-04T09:25:44.633 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enable_auth", 2024-03-04T09:25:44.633 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.633 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.633 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.633 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.633 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.634 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.634 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.634 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.634 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.634 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.634 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.634 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.634 INFO:teuthology.orchestra.run.smithi082.stdout: "key_file": { 2024-03-04T09:25:44.634 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "key_file", 2024-03-04T09:25:44.634 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.634 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.634 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.635 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.635 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.635 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.635 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.635 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.635 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.635 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.635 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.636 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.636 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:44.636 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:44.636 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.636 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.636 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.636 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.636 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.636 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.636 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.636 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.636 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.636 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.636 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.637 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.637 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.637 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.637 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.637 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.637 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.637 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.637 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.637 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:44.637 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:44.638 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.638 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.638 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.638 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.638 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.638 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.638 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.638 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.638 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.638 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.639 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.639 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.639 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:44.639 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:44.639 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.639 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.639 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.639 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:44.639 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.639 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.639 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.640 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.640 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.640 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.640 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.640 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.640 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.640 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.640 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.640 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.640 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.640 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.640 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.640 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:44.641 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:44.641 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.641 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.641 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.641 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.641 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.641 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.641 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.641 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.642 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.642 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.642 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.642 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.642 INFO:teuthology.orchestra.run.smithi082.stdout: "server_addr": { 2024-03-04T09:25:44.642 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_addr", 2024-03-04T09:25:44.642 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.642 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.642 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.642 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.643 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.643 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.643 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.643 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.643 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.643 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.643 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.643 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.643 INFO:teuthology.orchestra.run.smithi082.stdout: "server_port": { 2024-03-04T09:25:44.643 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_port", 2024-03-04T09:25:44.643 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.644 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.644 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.644 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.644 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.644 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.644 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.644 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.644 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.644 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.644 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.644 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.644 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.645 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.645 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:44.645 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rgw", 2024-03-04T09:25:44.645 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:44.645 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:44.645 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:44.645 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:44.645 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:44.645 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.645 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.646 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.646 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.646 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.646 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.646 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.646 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.646 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.646 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.646 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.646 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.646 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.646 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.646 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.646 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.646 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.647 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.647 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.647 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:44.647 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:44.647 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.647 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.647 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.647 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.647 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.647 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.647 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.647 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.647 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.647 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.647 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.648 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.648 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:44.648 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:44.648 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.648 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.648 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.648 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:44.648 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.648 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.648 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.648 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.648 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.649 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.649 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.649 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.649 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.649 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.649 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.649 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.649 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.649 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.649 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.649 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:44.649 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:44.649 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.649 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.649 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.650 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.650 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.650 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.650 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.650 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.650 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.650 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.650 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.650 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.650 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.650 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.650 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:44.650 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rook", 2024-03-04T09:25:44.650 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:44.651 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:44.651 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:44.651 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:44.651 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:44.651 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.651 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.651 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.651 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.651 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.651 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.651 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.651 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.651 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.652 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.652 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.652 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.652 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.652 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.652 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.652 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.652 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.652 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.652 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.652 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:44.652 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:44.653 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.653 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.653 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.653 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.653 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.653 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.653 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.653 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.653 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.653 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.653 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.653 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.653 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:44.653 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:44.654 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.654 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.654 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.654 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:44.654 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.654 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.654 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.654 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.654 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.654 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.655 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.655 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.655 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.655 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.655 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.655 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.655 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.655 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.655 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.655 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:44.655 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:44.655 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.655 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.655 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.656 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.656 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.656 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.656 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.656 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.656 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.656 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.656 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.656 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.656 INFO:teuthology.orchestra.run.smithi082.stdout: "storage_class": { 2024-03-04T09:25:44.656 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "storage_class", 2024-03-04T09:25:44.656 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.656 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.657 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.657 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "local", 2024-03-04T09:25:44.657 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.657 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.657 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.657 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-03-04T09:25:44.657 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.657 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.657 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.657 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.657 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.657 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.657 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:44.658 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "selftest", 2024-03-04T09:25:44.658 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:44.658 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:44.658 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:44.658 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:44.658 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:44.658 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.658 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.658 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.658 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.658 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.658 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.658 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.658 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.659 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.659 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.659 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.659 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.659 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.659 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.659 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.659 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.659 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.659 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.659 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.660 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:44.660 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:44.660 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.660 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.660 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.660 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.660 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.660 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.660 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.660 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.660 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.660 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.660 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.660 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.661 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:44.661 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:44.661 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.661 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.661 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.661 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:44.661 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.661 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.661 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.661 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.661 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.661 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.662 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.662 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.662 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.662 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.662 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.662 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.662 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.662 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.662 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.662 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:44.662 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:44.662 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.662 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.662 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.663 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.663 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.663 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.663 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.663 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.663 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.663 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.663 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.663 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.663 INFO:teuthology.orchestra.run.smithi082.stdout: "roption1": { 2024-03-04T09:25:44.663 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "roption1", 2024-03-04T09:25:44.664 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.664 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.664 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.664 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.664 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.664 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.664 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.664 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.664 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.664 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.664 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.664 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.664 INFO:teuthology.orchestra.run.smithi082.stdout: "roption2": { 2024-03-04T09:25:44.665 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "roption2", 2024-03-04T09:25:44.665 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.665 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.665 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.665 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "xyz", 2024-03-04T09:25:44.665 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.665 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.665 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.665 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.665 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.665 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.665 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.666 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.666 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption1": { 2024-03-04T09:25:44.666 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption1", 2024-03-04T09:25:44.666 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.666 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.666 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.666 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.666 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.666 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.666 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.666 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.666 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.666 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.666 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.667 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.667 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption2": { 2024-03-04T09:25:44.667 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption2", 2024-03-04T09:25:44.667 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.667 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.667 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.667 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.667 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.667 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.667 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.667 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.667 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.667 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.667 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.667 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.667 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption3": { 2024-03-04T09:25:44.668 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption3", 2024-03-04T09:25:44.668 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-03-04T09:25:44.668 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.668 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.668 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.668 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.668 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.668 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.668 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.668 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.668 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.668 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.668 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.669 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption4": { 2024-03-04T09:25:44.669 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption4", 2024-03-04T09:25:44.669 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.669 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.669 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.669 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.669 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.669 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.669 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.669 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.669 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.669 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.669 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.669 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.670 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption5": { 2024-03-04T09:25:44.670 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption5", 2024-03-04T09:25:44.670 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.670 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.670 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.670 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.670 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.670 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.670 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.670 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.670 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.670 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.670 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.670 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.670 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption6": { 2024-03-04T09:25:44.671 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption6", 2024-03-04T09:25:44.671 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.671 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.671 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.671 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.671 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.671 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.672 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.672 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.672 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.672 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.672 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.672 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.672 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption7": { 2024-03-04T09:25:44.672 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption7", 2024-03-04T09:25:44.672 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.672 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.672 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.673 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.673 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-03-04T09:25:44.673 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "42", 2024-03-04T09:25:44.673 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.673 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.673 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.673 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.673 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.673 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.673 INFO:teuthology.orchestra.run.smithi082.stdout: "testkey": { 2024-03-04T09:25:44.673 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "testkey", 2024-03-04T09:25:44.673 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.674 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.674 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.674 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.674 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.675 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.675 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.675 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.675 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.675 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.675 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.675 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.675 INFO:teuthology.orchestra.run.smithi082.stdout: "testlkey": { 2024-03-04T09:25:44.675 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "testlkey", 2024-03-04T09:25:44.675 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.675 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.676 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.676 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.676 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.676 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.676 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.676 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.677 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.677 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.677 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.677 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.678 INFO:teuthology.orchestra.run.smithi082.stdout: "testnewline": { 2024-03-04T09:25:44.678 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "testnewline", 2024-03-04T09:25:44.678 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.678 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.678 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.678 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.678 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.678 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.678 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.678 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.678 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.679 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.679 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.679 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.679 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.679 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.679 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:44.680 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snap_schedule", 2024-03-04T09:25:44.680 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:44.680 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:44.680 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:44.681 INFO:teuthology.orchestra.run.smithi082.stdout: "allow_m_granularity": { 2024-03-04T09:25:44.681 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "allow_m_granularity", 2024-03-04T09:25:44.681 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.681 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.681 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.682 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.682 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.682 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.682 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.682 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "allow minute scheduled snapshots", 2024-03-04T09:25:44.682 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.683 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.683 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.683 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.683 INFO:teuthology.orchestra.run.smithi082.stdout: "dump_on_update": { 2024-03-04T09:25:44.683 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "dump_on_update", 2024-03-04T09:25:44.683 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.683 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.683 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.683 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.683 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.683 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.683 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.684 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "dump database to debug log on update", 2024-03-04T09:25:44.684 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.684 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.684 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.684 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.684 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:44.684 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:44.684 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.684 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.684 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.684 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.684 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.684 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.684 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.687 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.687 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.687 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.687 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.687 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.687 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.687 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.687 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.687 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.687 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.687 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.688 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.688 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:44.688 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:44.688 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.688 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.688 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.688 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.688 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.688 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.689 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.689 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.689 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.689 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.689 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.689 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.689 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:44.689 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:44.689 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.689 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.689 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.689 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:44.689 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.690 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.690 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.690 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.690 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.690 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.690 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.690 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.690 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.690 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.690 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.690 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.690 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.690 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.690 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.691 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:44.691 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:44.691 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.691 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.691 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.691 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.691 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.691 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.691 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.691 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.691 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.692 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.692 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.692 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.692 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.692 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.692 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:44.692 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "stats", 2024-03-04T09:25:44.692 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:44.692 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:44.692 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:44.692 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:44.692 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:44.693 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.693 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.693 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.693 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.693 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.693 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.693 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.693 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.693 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.693 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.694 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.694 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.694 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.694 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.694 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.694 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.694 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.694 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.694 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.694 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:44.694 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:44.694 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.695 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.695 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.695 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.695 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.695 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.696 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.696 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.696 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.696 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.696 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.696 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.697 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:44.697 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:44.697 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.697 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.697 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.697 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:44.698 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.698 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.698 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.698 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.698 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.699 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.699 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.699 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.699 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.699 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.699 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.700 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.700 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.700 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.700 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.700 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:44.701 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:44.701 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.701 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.701 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.701 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.701 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.702 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.702 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.702 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.702 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.702 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.703 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.703 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.703 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.703 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.703 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:44.703 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "status", 2024-03-04T09:25:44.704 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:44.704 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:44.704 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:44.704 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:44.704 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:44.705 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.705 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.705 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.705 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.705 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.706 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.706 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.706 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.706 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.706 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.706 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.707 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.707 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.707 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.707 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.707 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.707 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.707 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.707 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.708 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:44.708 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:44.708 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.708 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.709 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.709 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.709 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.709 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.709 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.710 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.710 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.710 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.711 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.711 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.711 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:44.711 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:44.711 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.712 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.712 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.712 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:44.712 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.713 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.713 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.713 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.713 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.713 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.714 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.714 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.714 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.714 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.714 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.714 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.714 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.714 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.714 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.715 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:44.715 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:44.715 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.715 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.715 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.715 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.715 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.715 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.715 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.716 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.716 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.716 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.716 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.716 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.716 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.716 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.717 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:44.717 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "telegraf", 2024-03-04T09:25:44.717 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:44.717 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:44.717 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:44.717 INFO:teuthology.orchestra.run.smithi082.stdout: "address": { 2024-03-04T09:25:44.717 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "address", 2024-03-04T09:25:44.717 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.717 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.717 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.717 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-03-04T09:25:44.717 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.717 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.718 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.718 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.718 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.718 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.718 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.718 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.718 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-03-04T09:25:44.718 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-03-04T09:25:44.718 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:44.718 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.718 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.718 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "15", 2024-03-04T09:25:44.718 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.718 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.718 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.719 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.719 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.719 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.719 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.719 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.719 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:44.719 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:44.719 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.719 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.719 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.719 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.719 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.719 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.719 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.719 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.720 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.720 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.720 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.720 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.720 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.720 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.720 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.720 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.720 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.720 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.720 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.720 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:44.720 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:44.720 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.721 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.721 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.721 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.721 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.721 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.721 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.721 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.721 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.721 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.721 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.721 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.721 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:44.722 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:44.722 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.722 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.722 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.722 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:44.722 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.722 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.722 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.722 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.722 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.722 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.722 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.722 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.722 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.722 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.723 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.723 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.723 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.723 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.723 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.723 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:44.723 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:44.723 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.723 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.723 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.723 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.724 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.724 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.724 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.724 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.724 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.724 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.724 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.724 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.724 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.724 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.724 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:44.724 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "telemetry", 2024-03-04T09:25:44.724 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:44.724 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:44.725 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:44.725 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_basic": { 2024-03-04T09:25:44.725 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_basic", 2024-03-04T09:25:44.725 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.725 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.725 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.725 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.725 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.725 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.725 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.725 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share basic cluster information (size, version)", 2024-03-04T09:25:44.726 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.726 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.726 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.726 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.726 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_crash": { 2024-03-04T09:25:44.726 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_crash", 2024-03-04T09:25:44.726 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.726 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.726 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.726 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.726 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.727 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.727 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.727 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-03-04T09:25:44.727 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.727 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.727 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.727 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.728 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_device": { 2024-03-04T09:25:44.728 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_device", 2024-03-04T09:25:44.728 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.728 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.728 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.728 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.728 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.729 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.729 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.729 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-03-04T09:25:44.729 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.729 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.729 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.729 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.729 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_ident": { 2024-03-04T09:25:44.729 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_ident", 2024-03-04T09:25:44.729 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.729 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.729 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.730 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.730 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.730 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.730 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.730 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-03-04T09:25:44.730 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.730 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.730 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.730 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.730 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_perf": { 2024-03-04T09:25:44.730 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_perf", 2024-03-04T09:25:44.730 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.730 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.730 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.731 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.731 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.731 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.731 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.731 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share various performance metrics of a cluster", 2024-03-04T09:25:44.731 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.731 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.731 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.731 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.731 INFO:teuthology.orchestra.run.smithi082.stdout: "contact": { 2024-03-04T09:25:44.731 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "contact", 2024-03-04T09:25:44.731 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.731 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.731 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.731 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.731 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.732 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.732 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.732 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.732 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.732 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.732 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.732 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.732 INFO:teuthology.orchestra.run.smithi082.stdout: "description": { 2024-03-04T09:25:44.732 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "description", 2024-03-04T09:25:44.732 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.732 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.732 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.732 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.733 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.733 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.733 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.733 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.733 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.733 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.733 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.733 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.733 INFO:teuthology.orchestra.run.smithi082.stdout: "device_url": { 2024-03-04T09:25:44.733 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "device_url", 2024-03-04T09:25:44.733 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.733 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.733 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.733 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-03-04T09:25:44.733 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.734 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.734 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.734 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.734 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.734 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.734 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.734 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.734 INFO:teuthology.orchestra.run.smithi082.stdout: "enabled": { 2024-03-04T09:25:44.734 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enabled", 2024-03-04T09:25:44.734 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.734 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.734 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.734 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.734 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.734 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.734 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.735 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.735 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.735 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.735 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.735 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.735 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-03-04T09:25:44.735 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-03-04T09:25:44.735 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.735 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.735 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.735 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "24", 2024-03-04T09:25:44.735 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "8", 2024-03-04T09:25:44.735 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.735 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.735 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.735 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.736 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.736 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.736 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.736 INFO:teuthology.orchestra.run.smithi082.stdout: "last_opt_revision": { 2024-03-04T09:25:44.736 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "last_opt_revision", 2024-03-04T09:25:44.736 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.736 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.736 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.736 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "1", 2024-03-04T09:25:44.736 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.736 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.736 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.737 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.737 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.737 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.737 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.737 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.737 INFO:teuthology.orchestra.run.smithi082.stdout: "leaderboard": { 2024-03-04T09:25:44.737 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "leaderboard", 2024-03-04T09:25:44.737 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.737 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.737 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.737 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.737 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.737 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.737 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.737 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.738 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.738 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.738 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.738 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.738 INFO:teuthology.orchestra.run.smithi082.stdout: "leaderboard_description": { 2024-03-04T09:25:44.738 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "leaderboard_description", 2024-03-04T09:25:44.738 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.738 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.738 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.738 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.738 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.738 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.738 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.738 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.738 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.739 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.739 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.739 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.739 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:44.739 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:44.739 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.739 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.739 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.739 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.739 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.739 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.739 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.739 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.739 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.739 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.739 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.740 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.740 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.740 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.740 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.740 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.740 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.740 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.740 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.740 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:44.740 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:44.740 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.740 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.740 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.740 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.740 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.741 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.741 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.741 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.741 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.741 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.741 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.741 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.741 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:44.741 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:44.741 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.742 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.742 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.742 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:44.742 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.742 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.742 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.742 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.742 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.742 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.742 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.742 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.742 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.743 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.743 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.743 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.743 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.743 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.743 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.743 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:44.743 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:44.743 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.743 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.743 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.743 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.743 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.744 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.744 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.744 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.744 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.744 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.744 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.744 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.744 INFO:teuthology.orchestra.run.smithi082.stdout: "organization": { 2024-03-04T09:25:44.744 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "organization", 2024-03-04T09:25:44.744 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.744 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.744 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.744 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.744 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.744 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.745 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.745 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.745 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.745 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.745 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.745 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.745 INFO:teuthology.orchestra.run.smithi082.stdout: "proxy": { 2024-03-04T09:25:44.745 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "proxy", 2024-03-04T09:25:44.745 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.745 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.746 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.746 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.746 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.746 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.746 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.746 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.746 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.746 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.746 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.746 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.746 INFO:teuthology.orchestra.run.smithi082.stdout: "url": { 2024-03-04T09:25:44.746 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "url", 2024-03-04T09:25:44.746 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.747 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.747 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.747 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-03-04T09:25:44.747 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.747 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.747 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.747 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.747 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.747 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.747 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.748 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.748 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.748 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.748 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:44.748 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "test_orchestrator", 2024-03-04T09:25:44.748 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:44.748 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:44.748 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:44.748 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:44.748 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:44.748 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.748 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.748 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.749 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.749 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.749 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.749 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.749 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.749 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.749 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.749 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.749 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.749 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.750 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.750 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.750 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.750 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.750 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.750 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.750 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:44.750 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:44.750 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.750 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.750 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.750 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.750 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.751 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.751 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.751 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.751 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.751 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.751 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.751 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.751 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:44.751 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:44.751 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.751 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.752 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.752 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:44.752 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.752 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.752 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.752 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.752 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.752 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.752 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.752 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.753 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.753 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.753 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.753 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.753 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.753 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.753 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.753 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:44.753 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:44.753 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.754 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.754 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.754 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.754 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.754 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.754 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.754 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.754 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.754 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.754 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.754 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.754 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.754 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.754 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:44.755 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "volumes", 2024-03-04T09:25:44.755 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:44.755 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:44.755 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:44.755 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:44.755 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:44.755 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.755 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.755 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.755 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.755 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.755 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.755 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.756 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.756 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.756 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.756 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.756 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.756 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.756 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.756 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.756 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.756 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.756 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.756 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.756 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:44.756 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:44.757 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.757 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.757 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.757 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.757 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.757 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.757 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.757 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.757 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.757 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.757 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.757 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.757 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:44.757 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:44.758 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.758 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.758 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.758 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:44.758 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.758 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.758 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.758 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.758 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.758 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.758 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.758 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.759 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.759 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.759 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.759 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.759 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.759 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.759 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.759 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:44.759 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:44.759 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.759 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.759 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.760 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.760 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.760 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.760 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.760 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.760 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.760 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.760 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.760 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.760 INFO:teuthology.orchestra.run.smithi082.stdout: "max_concurrent_clones": { 2024-03-04T09:25:44.760 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_concurrent_clones", 2024-03-04T09:25:44.760 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.760 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.760 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.760 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "4", 2024-03-04T09:25:44.761 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.761 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.761 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.761 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Number of asynchronous cloner threads", 2024-03-04T09:25:44.761 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.761 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.761 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.761 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.761 INFO:teuthology.orchestra.run.smithi082.stdout: "periodic_async_work": { 2024-03-04T09:25:44.761 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "periodic_async_work", 2024-03-04T09:25:44.761 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.762 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.762 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.762 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.762 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.762 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.762 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.762 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Periodically check for async work", 2024-03-04T09:25:44.762 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.762 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.762 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.762 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.762 INFO:teuthology.orchestra.run.smithi082.stdout: "snapshot_clone_delay": { 2024-03-04T09:25:44.762 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snapshot_clone_delay", 2024-03-04T09:25:44.763 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.763 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.763 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.763 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-03-04T09:25:44.763 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.763 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.763 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.763 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-03-04T09:25:44.763 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.763 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.763 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.763 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.763 INFO:teuthology.orchestra.run.smithi082.stdout: "snapshot_clone_no_wait": { 2024-03-04T09:25:44.763 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snapshot_clone_no_wait", 2024-03-04T09:25:44.764 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.764 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.764 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.764 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.764 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.764 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.764 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.764 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-03-04T09:25:44.765 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.765 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.765 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.765 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.765 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.765 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.765 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:44.765 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix", 2024-03-04T09:25:44.765 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:44.765 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:44.765 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:44.765 INFO:teuthology.orchestra.run.smithi082.stdout: "discovery_interval": { 2024-03-04T09:25:44.765 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "discovery_interval", 2024-03-04T09:25:44.765 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-03-04T09:25:44.766 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.766 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.766 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "100", 2024-03-04T09:25:44.766 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.766 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.766 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.766 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.766 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.766 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.766 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.766 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.766 INFO:teuthology.orchestra.run.smithi082.stdout: "identifier": { 2024-03-04T09:25:44.767 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "identifier", 2024-03-04T09:25:44.767 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.767 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.767 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.767 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.767 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.767 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.767 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.767 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.767 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.767 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.767 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.768 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.768 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-03-04T09:25:44.768 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-03-04T09:25:44.768 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:44.768 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.768 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.768 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-03-04T09:25:44.768 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.768 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.768 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.768 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.768 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.768 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.768 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.768 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.769 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:44.769 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:44.769 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.769 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.769 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.769 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.769 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.769 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.769 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.769 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.769 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.769 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.769 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.769 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.769 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.770 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.770 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.770 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.770 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.770 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.770 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.770 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:44.770 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:44.770 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.770 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.770 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.770 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.770 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.771 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.771 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.771 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.771 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.771 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.771 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.771 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.771 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:44.771 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:44.771 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.771 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.771 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.771 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:44.771 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.771 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.771 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.771 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.772 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.772 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.772 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.772 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.772 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.772 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.772 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.772 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.772 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.772 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.772 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.773 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:44.773 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:44.773 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.773 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.773 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.773 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.773 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.773 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.773 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.773 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.773 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.774 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.774 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.774 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.774 INFO:teuthology.orchestra.run.smithi082.stdout: "zabbix_host": { 2024-03-04T09:25:44.774 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix_host", 2024-03-04T09:25:44.774 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.774 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.774 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.774 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.774 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.774 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.774 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.774 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.774 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.774 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.775 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.775 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.775 INFO:teuthology.orchestra.run.smithi082.stdout: "zabbix_port": { 2024-03-04T09:25:44.775 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix_port", 2024-03-04T09:25:44.775 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.775 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.775 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.775 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10051", 2024-03-04T09:25:44.775 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.775 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.775 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.775 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.775 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.775 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.776 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.776 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.776 INFO:teuthology.orchestra.run.smithi082.stdout: "zabbix_sender": { 2024-03-04T09:25:44.776 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix_sender", 2024-03-04T09:25:44.776 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.776 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.776 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.776 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-03-04T09:25:44.776 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.776 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.776 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.776 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.776 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.776 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.776 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.777 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.777 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.777 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.777 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-03-04T09:25:44.777 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.777 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:44.777 INFO:teuthology.orchestra.run.smithi082.stdout: "gid": 25327, 2024-03-04T09:25:44.777 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "z", 2024-03-04T09:25:44.777 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr_features": 4540701547738038271, 2024-03-04T09:25:44.777 INFO:teuthology.orchestra.run.smithi082.stdout: "available_modules": [ 2024-03-04T09:25:44.777 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:44.777 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "alerts", 2024-03-04T09:25:44.777 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:44.777 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:44.777 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:44.778 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-03-04T09:25:44.778 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-03-04T09:25:44.778 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:44.778 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.778 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.778 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-03-04T09:25:44.778 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.778 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.778 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.778 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How frequently to reexamine health status", 2024-03-04T09:25:44.778 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.778 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.778 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.778 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.778 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:44.779 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:44.779 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.779 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.779 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.779 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.779 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.779 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.779 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.779 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.780 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.780 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.780 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.780 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.780 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.780 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.780 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.780 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.780 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.780 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.780 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.780 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:44.780 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:44.780 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.781 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.781 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.781 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.781 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.781 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.781 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.781 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.781 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.781 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.781 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.782 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.782 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:44.782 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:44.782 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.782 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.782 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.782 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:44.782 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.782 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.782 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.782 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.782 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.782 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.782 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.782 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.783 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.783 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.783 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.783 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.783 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.783 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.783 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.783 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:44.783 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:44.783 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.784 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.784 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.784 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.784 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.784 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.784 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.784 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.784 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.784 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.784 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.784 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.784 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_destination": { 2024-03-04T09:25:44.785 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_destination", 2024-03-04T09:25:44.785 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.785 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.785 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.785 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.785 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.785 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.785 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.785 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Email address to send alerts to", 2024-03-04T09:25:44.785 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.786 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.786 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.786 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.786 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_from_name": { 2024-03-04T09:25:44.786 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_from_name", 2024-03-04T09:25:44.786 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.786 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.786 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.786 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "Ceph", 2024-03-04T09:25:44.786 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.786 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.786 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.786 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Email From: name", 2024-03-04T09:25:44.787 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.787 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.787 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.787 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.787 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_host": { 2024-03-04T09:25:44.787 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_host", 2024-03-04T09:25:44.787 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.787 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.787 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.787 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.787 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.788 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.788 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.788 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SMTP server", 2024-03-04T09:25:44.788 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.788 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.788 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.788 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.788 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_password": { 2024-03-04T09:25:44.788 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_password", 2024-03-04T09:25:44.788 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.788 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.789 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.789 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.789 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.789 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.789 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.789 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Password to authenticate with", 2024-03-04T09:25:44.789 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.789 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.789 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.789 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.789 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_port": { 2024-03-04T09:25:44.789 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_port", 2024-03-04T09:25:44.789 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.789 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.789 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.790 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "465", 2024-03-04T09:25:44.790 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.790 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.790 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.790 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SMTP port", 2024-03-04T09:25:44.790 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.790 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.790 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.790 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.790 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_sender": { 2024-03-04T09:25:44.790 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_sender", 2024-03-04T09:25:44.790 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.790 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.790 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.790 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.791 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.791 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.791 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.791 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SMTP envelope sender", 2024-03-04T09:25:44.791 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.791 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.791 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.791 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.791 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_ssl": { 2024-03-04T09:25:44.791 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_ssl", 2024-03-04T09:25:44.791 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.791 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.791 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.791 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.791 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.792 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.792 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.792 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use SSL to connect to SMTP server", 2024-03-04T09:25:44.792 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.792 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.792 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.792 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.792 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_user": { 2024-03-04T09:25:44.792 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_user", 2024-03-04T09:25:44.792 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.792 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.792 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.793 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.793 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.793 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.793 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.793 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "User to authenticate as", 2024-03-04T09:25:44.793 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.793 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.793 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.793 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.793 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.793 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.793 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:44.793 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "balancer", 2024-03-04T09:25:44.794 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:44.794 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:44.794 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:44.794 INFO:teuthology.orchestra.run.smithi082.stdout: "active": { 2024-03-04T09:25:44.794 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "active", 2024-03-04T09:25:44.794 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.794 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.794 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.794 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.795 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.795 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.795 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.795 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "automatically balance PGs across cluster", 2024-03-04T09:25:44.795 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.795 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.795 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.795 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.795 INFO:teuthology.orchestra.run.smithi082.stdout: "begin_time": { 2024-03-04T09:25:44.795 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "begin_time", 2024-03-04T09:25:44.796 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.796 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.796 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.796 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0000", 2024-03-04T09:25:44.796 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.796 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.796 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.796 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "beginning time of day to automatically balance", 2024-03-04T09:25:44.796 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-03-04T09:25:44.796 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.796 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.796 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.797 INFO:teuthology.orchestra.run.smithi082.stdout: "begin_weekday": { 2024-03-04T09:25:44.797 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "begin_weekday", 2024-03-04T09:25:44.797 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-03-04T09:25:44.797 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.797 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.797 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-03-04T09:25:44.797 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "0", 2024-03-04T09:25:44.797 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "6", 2024-03-04T09:25:44.797 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.797 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-03-04T09:25:44.797 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-03-04T09:25:44.797 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.797 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.798 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.798 INFO:teuthology.orchestra.run.smithi082.stdout: "crush_compat_max_iterations": { 2024-03-04T09:25:44.798 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crush_compat_max_iterations", 2024-03-04T09:25:44.798 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-03-04T09:25:44.798 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.798 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.798 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "25", 2024-03-04T09:25:44.798 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-03-04T09:25:44.798 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "250", 2024-03-04T09:25:44.798 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.798 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-03-04T09:25:44.798 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.798 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.798 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.799 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.799 INFO:teuthology.orchestra.run.smithi082.stdout: "crush_compat_metrics": { 2024-03-04T09:25:44.799 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crush_compat_metrics", 2024-03-04T09:25:44.799 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.799 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.799 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.799 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "pgs,objects,bytes", 2024-03-04T09:25:44.799 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.799 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.799 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.800 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-03-04T09:25:44.800 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-03-04T09:25:44.800 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.800 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.800 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.800 INFO:teuthology.orchestra.run.smithi082.stdout: "crush_compat_step": { 2024-03-04T09:25:44.800 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crush_compat_step", 2024-03-04T09:25:44.800 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-03-04T09:25:44.800 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.801 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.801 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0.5", 2024-03-04T09:25:44.801 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "0.001", 2024-03-04T09:25:44.801 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "0.999", 2024-03-04T09:25:44.801 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.801 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "aggressiveness of optimization", 2024-03-04T09:25:44.801 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-03-04T09:25:44.801 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.801 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.801 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.801 INFO:teuthology.orchestra.run.smithi082.stdout: "end_time": { 2024-03-04T09:25:44.801 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "end_time", 2024-03-04T09:25:44.801 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.802 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.802 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.802 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "2359", 2024-03-04T09:25:44.802 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.802 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.802 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.802 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "ending time of day to automatically balance", 2024-03-04T09:25:44.802 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-03-04T09:25:44.802 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.802 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.802 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.802 INFO:teuthology.orchestra.run.smithi082.stdout: "end_weekday": { 2024-03-04T09:25:44.802 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "end_weekday", 2024-03-04T09:25:44.802 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-03-04T09:25:44.803 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.803 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.803 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-03-04T09:25:44.803 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "0", 2024-03-04T09:25:44.803 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "6", 2024-03-04T09:25:44.803 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.803 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-03-04T09:25:44.803 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-03-04T09:25:44.803 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.803 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.803 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.803 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:44.803 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:44.803 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.803 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.803 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.804 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.804 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.804 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.804 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.804 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.804 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.804 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.804 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.804 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.804 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.804 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.804 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.804 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.804 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.805 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.805 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.805 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:44.805 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:44.805 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.805 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.805 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.805 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.805 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.805 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.806 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.806 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.806 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.806 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.806 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.806 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.806 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:44.806 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:44.806 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.806 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.806 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.806 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:44.806 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.807 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.807 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.807 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.807 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.807 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.807 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.807 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.807 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.807 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.807 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.807 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.807 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.807 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.807 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.807 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:44.808 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:44.808 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.808 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.808 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.808 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.808 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.808 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.808 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.808 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.808 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.808 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.808 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.808 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.808 INFO:teuthology.orchestra.run.smithi082.stdout: "min_score": { 2024-03-04T09:25:44.808 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "min_score", 2024-03-04T09:25:44.809 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-03-04T09:25:44.809 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.809 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.809 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-03-04T09:25:44.809 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.809 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.809 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.809 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-03-04T09:25:44.809 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.809 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.809 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.809 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.809 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": { 2024-03-04T09:25:44.809 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mode", 2024-03-04T09:25:44.810 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.810 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.810 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.810 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "upmap", 2024-03-04T09:25:44.810 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.810 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.810 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.810 INFO:teuthology.orchestra.run.smithi082.stdout: "crush-compat", 2024-03-04T09:25:44.810 INFO:teuthology.orchestra.run.smithi082.stdout: "none", 2024-03-04T09:25:44.810 INFO:teuthology.orchestra.run.smithi082.stdout: "read", 2024-03-04T09:25:44.810 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap", 2024-03-04T09:25:44.810 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap-read" 2024-03-04T09:25:44.810 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.810 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Balancer mode", 2024-03-04T09:25:44.811 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.811 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.811 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.811 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.811 INFO:teuthology.orchestra.run.smithi082.stdout: "pool_ids": { 2024-03-04T09:25:44.811 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pool_ids", 2024-03-04T09:25:44.811 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.811 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.811 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.811 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.811 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.811 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.811 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.811 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-03-04T09:25:44.812 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.812 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.812 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.812 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.812 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-03-04T09:25:44.812 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-03-04T09:25:44.812 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:44.812 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.812 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.812 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-03-04T09:25:44.812 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.812 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.812 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.812 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-03-04T09:25:44.813 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.813 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.813 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.813 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.813 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap_max_deviation": { 2024-03-04T09:25:44.813 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "upmap_max_deviation", 2024-03-04T09:25:44.813 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.813 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.813 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.814 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-03-04T09:25:44.814 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-03-04T09:25:44.814 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.814 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.814 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "deviation below which no optimization is attempted", 2024-03-04T09:25:44.814 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-03-04T09:25:44.814 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.814 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.814 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.814 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap_max_optimizations": { 2024-03-04T09:25:44.814 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "upmap_max_optimizations", 2024-03-04T09:25:44.814 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-03-04T09:25:44.814 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.814 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.815 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-03-04T09:25:44.815 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.815 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.815 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.815 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-03-04T09:25:44.815 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.815 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.816 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.816 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.816 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.816 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.816 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:44.816 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cephadm", 2024-03-04T09:25:44.816 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:44.816 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:44.816 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:44.816 INFO:teuthology.orchestra.run.smithi082.stdout: "agent_down_multiplier": { 2024-03-04T09:25:44.817 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "agent_down_multiplier", 2024-03-04T09:25:44.817 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-03-04T09:25:44.817 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.817 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.817 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "3.0", 2024-03-04T09:25:44.817 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.817 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.817 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.817 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-03-04T09:25:44.817 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.817 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.817 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.818 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.818 INFO:teuthology.orchestra.run.smithi082.stdout: "agent_refresh_rate": { 2024-03-04T09:25:44.818 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "agent_refresh_rate", 2024-03-04T09:25:44.818 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:44.818 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.818 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.818 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "20", 2024-03-04T09:25:44.818 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.818 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.818 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.818 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-03-04T09:25:44.818 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.818 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.818 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.818 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.818 INFO:teuthology.orchestra.run.smithi082.stdout: "agent_starting_port": { 2024-03-04T09:25:44.819 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "agent_starting_port", 2024-03-04T09:25:44.819 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.819 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.819 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.819 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "4721", 2024-03-04T09:25:44.819 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.819 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.819 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.819 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-03-04T09:25:44.819 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.819 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.819 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.819 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.819 INFO:teuthology.orchestra.run.smithi082.stdout: "allow_ptrace": { 2024-03-04T09:25:44.819 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "allow_ptrace", 2024-03-04T09:25:44.820 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.820 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.820 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.820 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.820 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.820 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.820 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.820 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-03-04T09:25:44.820 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-03-04T09:25:44.821 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.821 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.821 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.821 INFO:teuthology.orchestra.run.smithi082.stdout: "autotune_interval": { 2024-03-04T09:25:44.821 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "autotune_interval", 2024-03-04T09:25:44.821 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:44.821 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.821 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.821 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-03-04T09:25:44.821 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.822 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.822 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.822 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to autotune daemon memory", 2024-03-04T09:25:44.822 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.822 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.822 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.822 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.822 INFO:teuthology.orchestra.run.smithi082.stdout: "autotune_memory_target_ratio": { 2024-03-04T09:25:44.822 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "autotune_memory_target_ratio", 2024-03-04T09:25:44.822 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-03-04T09:25:44.822 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.822 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.823 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0.7", 2024-03-04T09:25:44.823 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.823 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.823 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.823 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-03-04T09:25:44.823 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.823 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.823 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.823 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.823 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm_log_destination": { 2024-03-04T09:25:44.824 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cephadm_log_destination", 2024-03-04T09:25:44.824 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.824 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.824 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.824 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.824 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.824 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.824 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.824 INFO:teuthology.orchestra.run.smithi082.stdout: "file", 2024-03-04T09:25:44.824 INFO:teuthology.orchestra.run.smithi082.stdout: "file,syslog", 2024-03-04T09:25:44.824 INFO:teuthology.orchestra.run.smithi082.stdout: "syslog" 2024-03-04T09:25:44.825 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.825 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-03-04T09:25:44.825 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.825 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.825 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.825 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.825 INFO:teuthology.orchestra.run.smithi082.stdout: "cgroups_split": { 2024-03-04T09:25:44.825 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cgroups_split", 2024-03-04T09:25:44.825 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.825 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.825 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.826 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.826 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.826 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.826 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.826 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-03-04T09:25:44.826 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.826 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.826 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.826 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.826 INFO:teuthology.orchestra.run.smithi082.stdout: "config_checks_enabled": { 2024-03-04T09:25:44.826 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "config_checks_enabled", 2024-03-04T09:25:44.827 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.827 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.827 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.827 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.827 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.827 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.827 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.827 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-03-04T09:25:44.827 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.827 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.827 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.827 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.827 INFO:teuthology.orchestra.run.smithi082.stdout: "config_dashboard": { 2024-03-04T09:25:44.827 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "config_dashboard", 2024-03-04T09:25:44.827 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.828 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.828 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.828 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.828 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.828 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.828 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.828 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-03-04T09:25:44.828 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.828 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.829 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.829 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.829 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_alertmanager": { 2024-03-04T09:25:44.829 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_alertmanager", 2024-03-04T09:25:44.829 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.829 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.829 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.829 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-03-04T09:25:44.829 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.830 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.830 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.830 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-03-04T09:25:44.830 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.830 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.830 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.830 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.830 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_base": { 2024-03-04T09:25:44.830 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_base", 2024-03-04T09:25:44.830 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.830 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.830 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.830 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/ceph", 2024-03-04T09:25:44.831 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.831 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.831 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.831 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Container image name, without the tag", 2024-03-04T09:25:44.831 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.831 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.831 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.831 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.831 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_elasticsearch": { 2024-03-04T09:25:44.831 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_elasticsearch", 2024-03-04T09:25:44.831 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.832 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.832 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.832 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-03-04T09:25:44.832 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.832 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.832 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.832 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "elasticsearch container image", 2024-03-04T09:25:44.832 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.832 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.832 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.832 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.832 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_grafana": { 2024-03-04T09:25:44.832 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_grafana", 2024-03-04T09:25:44.832 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.833 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.833 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.833 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.12", 2024-03-04T09:25:44.833 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.833 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.833 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.833 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-03-04T09:25:44.833 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.833 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.833 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.833 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.833 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_haproxy": { 2024-03-04T09:25:44.834 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_haproxy", 2024-03-04T09:25:44.834 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.834 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.834 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.834 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-03-04T09:25:44.834 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.834 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.834 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.834 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "HAproxy container image", 2024-03-04T09:25:44.834 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.834 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.834 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.834 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.834 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_jaeger_agent": { 2024-03-04T09:25:44.835 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_jaeger_agent", 2024-03-04T09:25:44.835 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.835 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.835 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.835 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-03-04T09:25:44.835 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.835 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.835 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.835 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Jaeger agent container image", 2024-03-04T09:25:44.835 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.835 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.835 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.835 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.836 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_jaeger_collector": { 2024-03-04T09:25:44.836 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_jaeger_collector", 2024-03-04T09:25:44.836 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.836 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.836 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.836 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-03-04T09:25:44.836 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.836 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.836 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.836 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Jaeger collector container image", 2024-03-04T09:25:44.836 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.837 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.837 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.837 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.837 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_jaeger_query": { 2024-03-04T09:25:44.837 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_jaeger_query", 2024-03-04T09:25:44.837 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.837 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.837 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.837 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-03-04T09:25:44.838 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.838 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.838 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.838 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Jaeger query container image", 2024-03-04T09:25:44.838 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.838 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.838 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.838 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.838 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_keepalived": { 2024-03-04T09:25:44.838 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_keepalived", 2024-03-04T09:25:44.838 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.838 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.838 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.838 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-03-04T09:25:44.838 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.839 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.839 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.839 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Keepalived container image", 2024-03-04T09:25:44.839 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.839 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.839 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.839 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.839 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_loki": { 2024-03-04T09:25:44.839 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_loki", 2024-03-04T09:25:44.839 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.839 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.839 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.839 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-03-04T09:25:44.839 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.840 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.840 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.840 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Loki container image", 2024-03-04T09:25:44.840 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.840 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.840 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.840 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.840 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_node_exporter": { 2024-03-04T09:25:44.840 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_node_exporter", 2024-03-04T09:25:44.840 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.840 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.840 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.840 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-03-04T09:25:44.840 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.841 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.841 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.841 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-03-04T09:25:44.841 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.841 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.841 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.841 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.841 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_nvmeof": { 2024-03-04T09:25:44.841 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_nvmeof", 2024-03-04T09:25:44.841 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.841 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.841 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.841 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/nvmeof:latest", 2024-03-04T09:25:44.841 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.841 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.842 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.842 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Nvme-of container image", 2024-03-04T09:25:44.842 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.842 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.842 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.842 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.842 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_prometheus": { 2024-03-04T09:25:44.842 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_prometheus", 2024-03-04T09:25:44.842 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.842 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.842 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.842 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-03-04T09:25:44.842 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.842 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.843 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.843 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-03-04T09:25:44.843 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.843 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.843 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.843 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.843 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_promtail": { 2024-03-04T09:25:44.843 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_promtail", 2024-03-04T09:25:44.843 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.843 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.844 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.844 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-03-04T09:25:44.844 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.844 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.844 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.844 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Promtail container image", 2024-03-04T09:25:44.844 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.844 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.844 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.844 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.844 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_snmp_gateway": { 2024-03-04T09:25:44.844 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_snmp_gateway", 2024-03-04T09:25:44.844 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.844 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.845 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.845 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-03-04T09:25:44.845 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.845 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.845 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.845 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SNMP Gateway container image", 2024-03-04T09:25:44.845 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.845 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.845 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.845 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.845 INFO:teuthology.orchestra.run.smithi082.stdout: "container_init": { 2024-03-04T09:25:44.845 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_init", 2024-03-04T09:25:44.845 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.845 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.846 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.846 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.846 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.846 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.846 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.846 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Run podman/docker with `--init`", 2024-03-04T09:25:44.846 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.846 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.846 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.846 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.847 INFO:teuthology.orchestra.run.smithi082.stdout: "daemon_cache_timeout": { 2024-03-04T09:25:44.847 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "daemon_cache_timeout", 2024-03-04T09:25:44.847 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:44.847 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.847 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.847 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-03-04T09:25:44.847 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.847 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.847 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.847 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-03-04T09:25:44.847 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.847 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.847 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.847 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.848 INFO:teuthology.orchestra.run.smithi082.stdout: "default_cephadm_command_timeout": { 2024-03-04T09:25:44.848 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "default_cephadm_command_timeout", 2024-03-04T09:25:44.848 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.848 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.848 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.848 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "900", 2024-03-04T09:25:44.848 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.848 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.848 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.848 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-03-04T09:25:44.848 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.848 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.848 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.848 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.849 INFO:teuthology.orchestra.run.smithi082.stdout: "default_registry": { 2024-03-04T09:25:44.849 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "default_registry", 2024-03-04T09:25:44.849 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.849 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.849 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.849 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io", 2024-03-04T09:25:44.849 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.849 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.849 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.849 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-03-04T09:25:44.849 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.849 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.849 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.849 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.850 INFO:teuthology.orchestra.run.smithi082.stdout: "device_cache_timeout": { 2024-03-04T09:25:44.850 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "device_cache_timeout", 2024-03-04T09:25:44.850 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:44.850 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.850 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.850 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "1800", 2024-03-04T09:25:44.850 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.850 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.850 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.850 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "seconds to cache device inventory", 2024-03-04T09:25:44.850 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.850 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.850 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.850 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.851 INFO:teuthology.orchestra.run.smithi082.stdout: "device_enhanced_scan": { 2024-03-04T09:25:44.851 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "device_enhanced_scan", 2024-03-04T09:25:44.851 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.851 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.851 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.851 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.851 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.851 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.851 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.851 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use libstoragemgmt during device scans", 2024-03-04T09:25:44.851 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.851 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.851 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.851 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.852 INFO:teuthology.orchestra.run.smithi082.stdout: "facts_cache_timeout": { 2024-03-04T09:25:44.852 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "facts_cache_timeout", 2024-03-04T09:25:44.852 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:44.852 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.852 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.852 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-03-04T09:25:44.852 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.852 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.852 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.852 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "seconds to cache host facts data", 2024-03-04T09:25:44.852 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.852 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.853 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.853 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.853 INFO:teuthology.orchestra.run.smithi082.stdout: "host_check_interval": { 2024-03-04T09:25:44.853 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "host_check_interval", 2024-03-04T09:25:44.853 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:44.853 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.853 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.853 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-03-04T09:25:44.853 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.853 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.853 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.853 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to perform a host check", 2024-03-04T09:25:44.854 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.854 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.854 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.854 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.854 INFO:teuthology.orchestra.run.smithi082.stdout: "hw_monitoring": { 2024-03-04T09:25:44.854 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "hw_monitoring", 2024-03-04T09:25:44.854 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.854 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.854 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.854 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.854 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.855 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.855 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.855 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-03-04T09:25:44.855 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.855 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.855 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.855 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.855 INFO:teuthology.orchestra.run.smithi082.stdout: "inventory_list_all": { 2024-03-04T09:25:44.855 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "inventory_list_all", 2024-03-04T09:25:44.855 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.855 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.855 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.855 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.856 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.856 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.856 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.856 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-03-04T09:25:44.856 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.856 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.856 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.856 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.856 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:44.856 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:44.856 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.857 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.857 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.857 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.857 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.857 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.857 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.857 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.857 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.857 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.857 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.857 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.858 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.858 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.858 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.858 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.858 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.858 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.858 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.858 INFO:teuthology.orchestra.run.smithi082.stdout: "log_refresh_metadata": { 2024-03-04T09:25:44.858 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_refresh_metadata", 2024-03-04T09:25:44.858 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.858 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.858 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.859 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.859 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.859 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.859 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.859 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-03-04T09:25:44.859 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.859 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.859 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.859 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.859 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:44.859 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:44.859 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.860 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.860 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.860 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.860 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.860 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.860 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.860 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-03-04T09:25:44.860 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.860 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.860 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.860 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.860 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:44.860 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:44.860 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.861 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.861 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.861 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:44.861 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.861 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.861 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.861 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.861 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.861 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.861 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.861 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.861 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.861 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.861 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.861 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.861 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.862 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.862 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.862 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:44.862 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:44.862 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.862 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.862 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.862 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.862 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.862 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.862 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.862 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.862 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.862 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.863 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.863 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.863 INFO:teuthology.orchestra.run.smithi082.stdout: "manage_etc_ceph_ceph_conf": { 2024-03-04T09:25:44.863 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-03-04T09:25:44.863 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.863 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.863 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.863 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.863 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.863 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.863 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.863 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-03-04T09:25:44.863 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.864 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.864 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.864 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.864 INFO:teuthology.orchestra.run.smithi082.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-03-04T09:25:44.864 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-03-04T09:25:44.864 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.864 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.864 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.864 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "*", 2024-03-04T09:25:44.864 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.864 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.865 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.865 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-03-04T09:25:44.865 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.865 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.865 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.865 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.865 INFO:teuthology.orchestra.run.smithi082.stdout: "max_count_per_host": { 2024-03-04T09:25:44.865 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_count_per_host", 2024-03-04T09:25:44.865 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.865 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.865 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.866 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-03-04T09:25:44.866 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.866 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.866 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.866 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "max number of daemons per service per host", 2024-03-04T09:25:44.866 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.866 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.866 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.866 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.866 INFO:teuthology.orchestra.run.smithi082.stdout: "max_osd_draining_count": { 2024-03-04T09:25:44.866 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_osd_draining_count", 2024-03-04T09:25:44.866 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.866 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.866 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.866 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-03-04T09:25:44.867 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.867 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.867 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.867 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-03-04T09:25:44.867 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.867 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.867 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.867 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.867 INFO:teuthology.orchestra.run.smithi082.stdout: "migration_current": { 2024-03-04T09:25:44.868 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "migration_current", 2024-03-04T09:25:44.868 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.868 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.868 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.868 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.868 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.868 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.868 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.868 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "internal - do not modify", 2024-03-04T09:25:44.868 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.868 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.868 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.868 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.869 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": { 2024-03-04T09:25:44.869 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mode", 2024-03-04T09:25:44.869 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.869 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.869 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.869 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "root", 2024-03-04T09:25:44.869 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.869 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.869 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.869 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm-package", 2024-03-04T09:25:44.869 INFO:teuthology.orchestra.run.smithi082.stdout: "root" 2024-03-04T09:25:44.869 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.869 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "mode for remote execution of cephadm", 2024-03-04T09:25:44.870 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.870 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.870 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.870 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.870 INFO:teuthology.orchestra.run.smithi082.stdout: "oob_default_addr": { 2024-03-04T09:25:44.870 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "oob_default_addr", 2024-03-04T09:25:44.870 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.870 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.870 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.870 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "169.254.1.1", 2024-03-04T09:25:44.870 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.870 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.870 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.870 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Default address for RedFish API (oob management).", 2024-03-04T09:25:44.871 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.871 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.871 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.871 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.871 INFO:teuthology.orchestra.run.smithi082.stdout: "prometheus_alerts_path": { 2024-03-04T09:25:44.871 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "prometheus_alerts_path", 2024-03-04T09:25:44.871 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.871 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.871 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.871 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-03-04T09:25:44.871 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.871 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.871 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.871 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-03-04T09:25:44.872 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.872 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.872 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.872 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.872 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_insecure": { 2024-03-04T09:25:44.872 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_insecure", 2024-03-04T09:25:44.872 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.872 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.872 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.872 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.872 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.873 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.873 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.873 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-03-04T09:25:44.873 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.873 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.873 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.873 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.873 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_password": { 2024-03-04T09:25:44.873 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_password", 2024-03-04T09:25:44.873 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.873 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.873 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.873 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.873 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.874 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.874 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.874 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-03-04T09:25:44.874 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.874 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.874 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.874 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.874 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_url": { 2024-03-04T09:25:44.874 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_url", 2024-03-04T09:25:44.874 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.874 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.874 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.874 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.874 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.874 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.874 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.875 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-03-04T09:25:44.875 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.875 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.875 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.875 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.875 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_username": { 2024-03-04T09:25:44.875 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_username", 2024-03-04T09:25:44.875 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.875 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.875 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.875 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.875 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.875 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.875 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.876 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-03-04T09:25:44.876 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.876 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.876 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.876 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.876 INFO:teuthology.orchestra.run.smithi082.stdout: "secure_monitoring_stack": { 2024-03-04T09:25:44.876 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "secure_monitoring_stack", 2024-03-04T09:25:44.876 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.876 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.876 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.876 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.876 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.876 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.876 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.877 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-03-04T09:25:44.877 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.877 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.877 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.877 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.877 INFO:teuthology.orchestra.run.smithi082.stdout: "service_discovery_port": { 2024-03-04T09:25:44.877 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "service_discovery_port", 2024-03-04T09:25:44.877 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.877 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.877 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.877 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8765", 2024-03-04T09:25:44.877 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.877 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.877 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.878 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "cephadm service discovery port", 2024-03-04T09:25:44.878 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.878 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.878 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.878 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.878 INFO:teuthology.orchestra.run.smithi082.stdout: "ssh_config_file": { 2024-03-04T09:25:44.878 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssh_config_file", 2024-03-04T09:25:44.878 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.878 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.878 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.878 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.878 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.878 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.878 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.879 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-03-04T09:25:44.879 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.879 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.879 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.879 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.879 INFO:teuthology.orchestra.run.smithi082.stdout: "use_agent": { 2024-03-04T09:25:44.879 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "use_agent", 2024-03-04T09:25:44.879 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.879 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.879 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.879 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.879 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.879 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.879 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.880 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-03-04T09:25:44.880 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.880 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.880 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.880 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.880 INFO:teuthology.orchestra.run.smithi082.stdout: "use_repo_digest": { 2024-03-04T09:25:44.880 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "use_repo_digest", 2024-03-04T09:25:44.880 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.880 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.880 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.880 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.880 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.880 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.880 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.881 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-03-04T09:25:44.881 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.881 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.881 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.881 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.881 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_on_failed_host_check": { 2024-03-04T09:25:44.881 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_on_failed_host_check", 2024-03-04T09:25:44.881 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.881 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.881 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.881 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.881 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.881 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.881 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.882 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise a health warning if the host check fails", 2024-03-04T09:25:44.882 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.882 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.882 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.882 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.882 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_on_stray_daemons": { 2024-03-04T09:25:44.882 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_on_stray_daemons", 2024-03-04T09:25:44.882 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.882 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.882 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.882 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.882 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.882 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.882 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.883 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-03-04T09:25:44.883 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.883 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.883 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.883 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.883 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_on_stray_hosts": { 2024-03-04T09:25:44.883 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_on_stray_hosts", 2024-03-04T09:25:44.883 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.883 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.883 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.883 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.883 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.883 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.883 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.883 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-03-04T09:25:44.884 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.884 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.884 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.884 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.884 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.884 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.884 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:44.885 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crash", 2024-03-04T09:25:44.885 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:44.885 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:44.885 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:44.885 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:44.885 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:44.885 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.886 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.886 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.886 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.886 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.886 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.886 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.886 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.886 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.886 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.887 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.887 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.887 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.887 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.887 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.887 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.887 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.887 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.887 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.887 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:44.887 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:44.887 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.887 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.887 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.888 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.888 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.888 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.888 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.888 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.888 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.888 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.888 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.888 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.889 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:44.889 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:44.889 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.889 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.889 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.889 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:44.889 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.889 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.889 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.889 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.889 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.889 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.890 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.890 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.890 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.890 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.890 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.891 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.891 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.891 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.891 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.891 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:44.891 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:44.891 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.892 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.892 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.892 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.892 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.892 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.892 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.892 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.892 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.892 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.892 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.892 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.892 INFO:teuthology.orchestra.run.smithi082.stdout: "retain_interval": { 2024-03-04T09:25:44.892 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "retain_interval", 2024-03-04T09:25:44.893 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:44.893 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.893 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.893 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "31536000", 2024-03-04T09:25:44.893 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.893 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.893 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.893 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how long to retain crashes before pruning them", 2024-03-04T09:25:44.893 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.893 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.893 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.893 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.894 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_recent_interval": { 2024-03-04T09:25:44.894 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_recent_interval", 2024-03-04T09:25:44.894 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:44.894 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.894 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.894 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "1209600", 2024-03-04T09:25:44.894 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.894 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.894 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.894 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "time interval in which to warn about recent crashes", 2024-03-04T09:25:44.894 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.894 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.895 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.895 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.895 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.895 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.895 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:44.895 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "dashboard", 2024-03-04T09:25:44.895 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:44.895 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:44.895 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:44.895 INFO:teuthology.orchestra.run.smithi082.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-03-04T09:25:44.895 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-03-04T09:25:44.895 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.896 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.896 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.896 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-03-04T09:25:44.896 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.896 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.896 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.896 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.896 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.896 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.896 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.896 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.897 INFO:teuthology.orchestra.run.smithi082.stdout: "ALERTMANAGER_API_HOST": { 2024-03-04T09:25:44.897 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ALERTMANAGER_API_HOST", 2024-03-04T09:25:44.897 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.897 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.897 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.897 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.897 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.897 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.897 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.897 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.897 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.898 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.898 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.898 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.898 INFO:teuthology.orchestra.run.smithi082.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-03-04T09:25:44.898 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-03-04T09:25:44.898 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.898 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.898 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.898 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.898 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.898 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.898 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.898 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.898 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.898 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.899 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.899 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.899 INFO:teuthology.orchestra.run.smithi082.stdout: "AUDIT_API_ENABLED": { 2024-03-04T09:25:44.899 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "AUDIT_API_ENABLED", 2024-03-04T09:25:44.899 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.899 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.899 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.899 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.899 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.899 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.899 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.899 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.899 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.899 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.900 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.900 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.900 INFO:teuthology.orchestra.run.smithi082.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-03-04T09:25:44.900 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-03-04T09:25:44.900 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.900 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.900 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.900 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.900 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.900 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.900 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.900 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.901 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.901 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.901 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.901 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.901 INFO:teuthology.orchestra.run.smithi082.stdout: "ENABLE_BROWSABLE_API": { 2024-03-04T09:25:44.901 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ENABLE_BROWSABLE_API", 2024-03-04T09:25:44.901 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.901 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.901 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.901 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.901 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.901 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.901 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.901 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.902 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.902 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.902 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.902 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.902 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-03-04T09:25:44.902 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-03-04T09:25:44.902 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.902 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.902 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.902 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.902 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.902 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.903 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.903 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.903 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.903 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.903 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.903 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.903 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-03-04T09:25:44.903 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-03-04T09:25:44.903 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.903 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.903 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.903 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.903 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.904 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.904 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.904 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.904 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.904 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.904 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.904 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.904 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-03-04T09:25:44.904 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-03-04T09:25:44.904 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.904 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.905 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.905 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.905 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.905 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.905 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.905 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.905 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.905 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.905 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.905 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.905 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-03-04T09:25:44.905 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-03-04T09:25:44.906 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.906 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.906 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.906 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.906 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.906 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.906 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.906 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.906 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.906 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.906 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.906 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.906 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_NFS": { 2024-03-04T09:25:44.906 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-03-04T09:25:44.906 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.907 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.907 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.907 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.907 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.907 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.907 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.907 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.907 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.907 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.907 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.907 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.907 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_RBD": { 2024-03-04T09:25:44.907 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-03-04T09:25:44.908 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.908 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.908 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.908 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.908 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.908 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.908 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.908 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.908 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.908 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.908 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.908 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.908 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_RGW": { 2024-03-04T09:25:44.908 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-03-04T09:25:44.909 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.909 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.909 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.909 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.909 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.909 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.909 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.909 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.909 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.909 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.910 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.910 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.910 INFO:teuthology.orchestra.run.smithi082.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-03-04T09:25:44.910 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-03-04T09:25:44.910 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.910 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.910 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.910 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.910 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.910 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.910 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.910 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.910 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.910 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.911 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.911 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.911 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_PASSWORD": { 2024-03-04T09:25:44.911 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_PASSWORD", 2024-03-04T09:25:44.911 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.911 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.911 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.911 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "admin", 2024-03-04T09:25:44.911 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.911 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.911 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.911 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.911 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.911 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.911 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.912 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.912 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-03-04T09:25:44.912 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-03-04T09:25:44.912 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.912 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.912 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.912 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.912 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.912 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.912 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.912 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.912 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.912 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.912 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.913 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.913 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_URL": { 2024-03-04T09:25:44.913 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_URL", 2024-03-04T09:25:44.913 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.913 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.913 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.913 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.913 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.913 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.913 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.913 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.913 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.913 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.913 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.914 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.914 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_USERNAME": { 2024-03-04T09:25:44.914 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_USERNAME", 2024-03-04T09:25:44.914 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.914 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.914 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.914 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "admin", 2024-03-04T09:25:44.914 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.914 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.914 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.914 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.914 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.915 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.915 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.915 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.915 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-03-04T09:25:44.915 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-03-04T09:25:44.915 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.916 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.916 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.916 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.916 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.916 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.916 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.916 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.917 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.917 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.917 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.917 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.917 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-03-04T09:25:44.917 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-03-04T09:25:44.918 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.918 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.918 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.918 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.918 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.918 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.919 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.919 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.919 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.919 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.919 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.919 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.919 INFO:teuthology.orchestra.run.smithi082.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-03-04T09:25:44.920 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-03-04T09:25:44.920 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.920 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.920 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.920 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.920 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.921 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.921 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.921 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.921 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.921 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.921 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.921 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.922 INFO:teuthology.orchestra.run.smithi082.stdout: "ISSUE_TRACKER_API_KEY": { 2024-03-04T09:25:44.922 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-03-04T09:25:44.922 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.923 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.923 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.923 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.923 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.923 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.923 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.923 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.924 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.924 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.924 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.924 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.925 INFO:teuthology.orchestra.run.smithi082.stdout: "PROMETHEUS_API_HOST": { 2024-03-04T09:25:44.925 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PROMETHEUS_API_HOST", 2024-03-04T09:25:44.925 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.925 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.925 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.925 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.926 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.926 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.926 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.926 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.927 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.927 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.927 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.927 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.927 INFO:teuthology.orchestra.run.smithi082.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-03-04T09:25:44.928 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-03-04T09:25:44.928 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.928 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.928 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.929 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.929 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.929 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.929 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.929 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.930 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.930 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.930 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.930 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.931 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-03-04T09:25:44.931 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-03-04T09:25:44.931 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.931 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.931 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.932 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.932 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.932 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.932 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.932 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.932 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.933 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.933 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.933 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.933 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-03-04T09:25:44.933 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-03-04T09:25:44.933 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.933 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.934 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.934 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.934 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.934 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.934 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.935 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.935 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.935 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.935 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.935 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.936 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-03-04T09:25:44.936 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-03-04T09:25:44.936 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.936 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.936 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.936 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.937 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.937 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.937 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.937 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.937 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.938 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.938 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.938 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.938 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-03-04T09:25:44.938 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-03-04T09:25:44.938 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.939 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.939 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.939 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.939 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.939 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.940 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.940 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.940 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.940 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.941 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.941 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.941 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-03-04T09:25:44.941 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-03-04T09:25:44.941 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.941 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.941 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.942 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.942 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.942 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.942 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.942 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.943 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.943 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.943 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.943 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.943 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-03-04T09:25:44.943 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-03-04T09:25:44.944 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.944 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.944 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.944 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.944 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.945 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.945 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.945 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.945 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.945 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.945 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.946 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.946 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-03-04T09:25:44.946 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-03-04T09:25:44.946 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.946 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.946 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.947 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.947 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.947 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.947 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.947 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.947 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.948 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.948 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.948 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.948 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_ENABLED": { 2024-03-04T09:25:44.948 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_ENABLED", 2024-03-04T09:25:44.948 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.949 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.949 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.949 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.949 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.949 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.949 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.949 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.949 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.949 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.949 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.950 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.950 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-03-04T09:25:44.950 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-03-04T09:25:44.950 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.950 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.950 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.950 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-03-04T09:25:44.950 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.950 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.951 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.951 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.951 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.951 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.951 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.951 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.951 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-03-04T09:25:44.951 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-03-04T09:25:44.952 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.952 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.952 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.952 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-03-04T09:25:44.952 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.952 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.952 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.952 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.952 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.953 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.953 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.953 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.953 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-03-04T09:25:44.953 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-03-04T09:25:44.953 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.953 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.953 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.953 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8", 2024-03-04T09:25:44.954 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.954 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.954 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.954 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.954 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.954 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.954 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.954 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.954 INFO:teuthology.orchestra.run.smithi082.stdout: "REST_REQUESTS_TIMEOUT": { 2024-03-04T09:25:44.955 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-03-04T09:25:44.955 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.955 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.955 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.955 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "45", 2024-03-04T09:25:44.955 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.955 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.955 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.955 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.955 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.955 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.955 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.955 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.955 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_ACCESS_KEY": { 2024-03-04T09:25:44.955 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_ACCESS_KEY", 2024-03-04T09:25:44.955 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.956 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.956 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.956 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.956 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.956 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.956 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.956 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.956 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.956 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.956 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.956 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.956 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-03-04T09:25:44.956 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-03-04T09:25:44.957 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.957 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.957 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.957 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "admin", 2024-03-04T09:25:44.957 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.957 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.957 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.957 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.957 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.957 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.958 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.958 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.958 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_SECRET_KEY": { 2024-03-04T09:25:44.958 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_SECRET_KEY", 2024-03-04T09:25:44.958 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.958 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.958 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.958 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.958 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.958 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.958 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.959 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.959 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.959 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.959 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.959 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.959 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_SSL_VERIFY": { 2024-03-04T09:25:44.959 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_SSL_VERIFY", 2024-03-04T09:25:44.959 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.960 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.960 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.960 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.960 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.960 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.960 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.960 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.960 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.960 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.961 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.961 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.961 INFO:teuthology.orchestra.run.smithi082.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-03-04T09:25:44.961 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-03-04T09:25:44.961 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.961 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.961 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.961 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-03-04T09:25:44.961 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.962 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.962 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.962 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.962 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.962 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.962 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.962 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.962 INFO:teuthology.orchestra.run.smithi082.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-03-04T09:25:44.962 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-03-04T09:25:44.962 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.962 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.962 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.962 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-03-04T09:25:44.963 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.963 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.963 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.963 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.963 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.963 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.963 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.964 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.964 INFO:teuthology.orchestra.run.smithi082.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-03-04T09:25:44.964 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-03-04T09:25:44.964 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.964 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.964 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.964 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-03-04T09:25:44.964 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.964 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.964 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.965 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.965 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.965 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.965 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.965 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.965 INFO:teuthology.orchestra.run.smithi082.stdout: "cross_origin_url": { 2024-03-04T09:25:44.965 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cross_origin_url", 2024-03-04T09:25:44.965 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.965 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.965 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.965 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.966 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.966 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.966 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.966 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.966 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.966 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.966 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.966 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.966 INFO:teuthology.orchestra.run.smithi082.stdout: "crt_file": { 2024-03-04T09:25:44.966 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crt_file", 2024-03-04T09:25:44.966 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.966 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.966 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.967 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.967 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.967 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.967 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.967 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.967 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.967 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.967 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.967 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.967 INFO:teuthology.orchestra.run.smithi082.stdout: "debug": { 2024-03-04T09:25:44.967 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "debug", 2024-03-04T09:25:44.967 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.967 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.967 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.968 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.968 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.968 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.968 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.968 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Enable/disable debug options", 2024-03-04T09:25:44.968 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.968 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.968 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.968 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.968 INFO:teuthology.orchestra.run.smithi082.stdout: "jwt_token_ttl": { 2024-03-04T09:25:44.968 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "jwt_token_ttl", 2024-03-04T09:25:44.968 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.969 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.969 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.969 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "28800", 2024-03-04T09:25:44.969 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.969 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.969 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.969 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.969 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.969 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.969 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.969 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.969 INFO:teuthology.orchestra.run.smithi082.stdout: "key_file": { 2024-03-04T09:25:44.969 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "key_file", 2024-03-04T09:25:44.969 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.969 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.970 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.970 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.970 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.970 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.970 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.970 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.970 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.970 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.970 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.970 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.970 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:44.970 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:44.970 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.970 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.970 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.971 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.971 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.971 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.971 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.971 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.971 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.971 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.971 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.971 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.971 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.971 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.971 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.971 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.971 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.971 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.972 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.972 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:44.972 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:44.972 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.972 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.972 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.972 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.972 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.972 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.972 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.972 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.972 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.972 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.972 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.973 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.973 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:44.973 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:44.973 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.973 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.973 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.973 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:44.973 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.973 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.974 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.974 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.974 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.974 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.974 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.974 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.974 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.974 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.974 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.974 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.974 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.974 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.974 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.975 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:44.975 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:44.975 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.975 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.975 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.975 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.975 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.975 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.975 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.975 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.975 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.975 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.975 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.976 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.976 INFO:teuthology.orchestra.run.smithi082.stdout: "motd": { 2024-03-04T09:25:44.976 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "motd", 2024-03-04T09:25:44.976 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.976 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.976 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.976 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.976 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.976 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.976 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.976 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "The message of the day", 2024-03-04T09:25:44.976 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.977 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.977 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.977 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.977 INFO:teuthology.orchestra.run.smithi082.stdout: "redirect_resolve_ip_addr": { 2024-03-04T09:25:44.977 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "redirect_resolve_ip_addr", 2024-03-04T09:25:44.977 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.977 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.977 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.977 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.977 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.977 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.977 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.977 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.977 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.978 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.978 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.978 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.978 INFO:teuthology.orchestra.run.smithi082.stdout: "server_addr": { 2024-03-04T09:25:44.978 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_addr", 2024-03-04T09:25:44.978 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.978 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.978 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.978 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "::", 2024-03-04T09:25:44.978 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.978 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.978 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.978 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.979 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.979 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.979 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.979 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.979 INFO:teuthology.orchestra.run.smithi082.stdout: "server_port": { 2024-03-04T09:25:44.979 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_port", 2024-03-04T09:25:44.979 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.979 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.979 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.979 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8080", 2024-03-04T09:25:44.980 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.980 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.980 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.980 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.980 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.980 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.980 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.980 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.980 INFO:teuthology.orchestra.run.smithi082.stdout: "ssl": { 2024-03-04T09:25:44.981 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssl", 2024-03-04T09:25:44.981 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.981 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.981 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.981 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.981 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.981 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.981 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.981 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.981 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.981 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.981 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.981 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.981 INFO:teuthology.orchestra.run.smithi082.stdout: "ssl_server_port": { 2024-03-04T09:25:44.982 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssl_server_port", 2024-03-04T09:25:44.982 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.982 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.982 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.982 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8443", 2024-03-04T09:25:44.982 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.982 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.982 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.982 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.982 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.982 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.982 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.982 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.982 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_behaviour": { 2024-03-04T09:25:44.983 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_behaviour", 2024-03-04T09:25:44.983 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.983 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.983 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.983 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "redirect", 2024-03-04T09:25:44.983 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.983 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.983 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.983 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.983 INFO:teuthology.orchestra.run.smithi082.stdout: "redirect" 2024-03-04T09:25:44.983 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.983 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.983 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.983 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.983 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.984 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.984 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_error_status_code": { 2024-03-04T09:25:44.984 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_error_status_code", 2024-03-04T09:25:44.984 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:44.984 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.984 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.984 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "500", 2024-03-04T09:25:44.984 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "400", 2024-03-04T09:25:44.984 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "599", 2024-03-04T09:25:44.984 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.984 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.984 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.984 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.984 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.985 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.985 INFO:teuthology.orchestra.run.smithi082.stdout: "url_prefix": { 2024-03-04T09:25:44.985 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "url_prefix", 2024-03-04T09:25:44.985 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.985 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.985 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:44.985 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.985 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.985 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.985 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.985 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.985 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.985 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.986 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.986 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.986 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:44.986 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.986 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:44.986 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "devicehealth", 2024-03-04T09:25:44.986 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:44.986 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:44.986 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:44.986 INFO:teuthology.orchestra.run.smithi082.stdout: "enable_monitoring": { 2024-03-04T09:25:44.986 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enable_monitoring", 2024-03-04T09:25:44.986 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.986 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.986 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.986 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.987 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.987 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.987 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.987 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "monitor device health metrics", 2024-03-04T09:25:44.987 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.987 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.987 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.987 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.987 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:44.987 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:44.987 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.987 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.987 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.987 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:44.987 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.988 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.988 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.988 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.988 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.988 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.988 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.988 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.988 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.988 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.988 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.988 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.988 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.988 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.989 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.989 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:44.989 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:44.989 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.989 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.989 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.989 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.989 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.989 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.989 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.989 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.989 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.990 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.990 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.990 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.990 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:44.990 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:44.990 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.990 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.990 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.990 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:44.990 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.990 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.990 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:44.990 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:44.990 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:44.991 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:44.991 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:44.991 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:44.991 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:44.991 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:44.991 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.991 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.991 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.991 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.991 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.991 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:44.991 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:44.991 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.991 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.991 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.992 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:44.992 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.992 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.992 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.992 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:44.992 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.992 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.992 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.992 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.992 INFO:teuthology.orchestra.run.smithi082.stdout: "mark_out_threshold": { 2024-03-04T09:25:44.992 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mark_out_threshold", 2024-03-04T09:25:44.992 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:44.992 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.993 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.993 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "2419200", 2024-03-04T09:25:44.993 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.993 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.993 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.993 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-03-04T09:25:44.993 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.993 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.993 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.993 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.993 INFO:teuthology.orchestra.run.smithi082.stdout: "pool_name": { 2024-03-04T09:25:44.993 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pool_name", 2024-03-04T09:25:44.993 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:44.994 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.994 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.994 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "device_health_metrics", 2024-03-04T09:25:44.994 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.994 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.994 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.994 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "name of pool in which to store device health metrics", 2024-03-04T09:25:44.994 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.994 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.994 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.995 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.995 INFO:teuthology.orchestra.run.smithi082.stdout: "retention_period": { 2024-03-04T09:25:44.995 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "retention_period", 2024-03-04T09:25:44.995 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:44.995 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.995 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.995 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "15552000", 2024-03-04T09:25:44.995 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.995 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.995 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.995 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how long to retain device health metrics", 2024-03-04T09:25:44.995 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.995 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.995 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.996 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.996 INFO:teuthology.orchestra.run.smithi082.stdout: "scrape_frequency": { 2024-03-04T09:25:44.996 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "scrape_frequency", 2024-03-04T09:25:44.996 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:44.996 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.996 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.996 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "86400", 2024-03-04T09:25:44.996 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.996 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.996 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.996 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to scrape device health metrics", 2024-03-04T09:25:44.997 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.997 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.997 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.997 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.997 INFO:teuthology.orchestra.run.smithi082.stdout: "self_heal": { 2024-03-04T09:25:44.997 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "self_heal", 2024-03-04T09:25:44.997 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:44.997 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.997 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.998 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:44.998 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.998 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.998 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.998 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-03-04T09:25:44.998 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.998 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.998 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.998 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.998 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-03-04T09:25:44.998 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-03-04T09:25:44.998 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:44.998 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:44.998 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:44.998 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-03-04T09:25:44.999 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:44.999 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:44.999 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:44.999 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to wake up and check device health", 2024-03-04T09:25:44.999 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:44.999 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:44.999 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:44.999 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:44.999 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_threshold": { 2024-03-04T09:25:44.999 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_threshold", 2024-03-04T09:25:45.000 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:45.000 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.000 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.000 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "7257600", 2024-03-04T09:25:45.000 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.000 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.000 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.000 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-03-04T09:25:45.000 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.000 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.000 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.001 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.001 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.001 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.001 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.001 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "diskprediction_local", 2024-03-04T09:25:45.001 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.001 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.001 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.001 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.001 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.001 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.001 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.002 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.002 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.002 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.002 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.002 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.002 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.002 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.002 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.002 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.002 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.002 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.003 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.003 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.003 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.003 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.003 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.003 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.003 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.003 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.003 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.003 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.003 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.003 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.004 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.004 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.004 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.004 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.004 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.004 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.004 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.004 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.004 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.004 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.004 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.005 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.005 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.005 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.005 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.005 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.005 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.005 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.005 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.005 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.005 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.005 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.005 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.005 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.005 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.005 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.006 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.006 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.006 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.006 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.006 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.006 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.006 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.006 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.006 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.006 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.006 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.006 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.006 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.006 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.006 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.007 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.007 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.007 INFO:teuthology.orchestra.run.smithi082.stdout: "predict_interval": { 2024-03-04T09:25:45.007 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "predict_interval", 2024-03-04T09:25:45.007 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.007 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.007 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.007 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "86400", 2024-03-04T09:25:45.007 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.007 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.007 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.007 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.007 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.007 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.008 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.008 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.008 INFO:teuthology.orchestra.run.smithi082.stdout: "predictor_model": { 2024-03-04T09:25:45.008 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "predictor_model", 2024-03-04T09:25:45.008 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.008 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.008 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.008 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "prophetstor", 2024-03-04T09:25:45.008 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.008 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.008 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.008 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.009 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.009 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.009 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.009 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.009 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-03-04T09:25:45.009 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-03-04T09:25:45.009 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.009 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.009 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.009 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-03-04T09:25:45.009 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.009 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.009 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.009 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.010 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.010 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.010 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.010 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.010 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.010 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.010 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.010 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "influx", 2024-03-04T09:25:45.010 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": false, 2024-03-04T09:25:45.010 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "influxdb python module not found", 2024-03-04T09:25:45.010 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.010 INFO:teuthology.orchestra.run.smithi082.stdout: "batch_size": { 2024-03-04T09:25:45.011 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "batch_size", 2024-03-04T09:25:45.011 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.011 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.011 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.011 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5000", 2024-03-04T09:25:45.011 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.011 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.011 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.011 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-03-04T09:25:45.011 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.011 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.011 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.011 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.011 INFO:teuthology.orchestra.run.smithi082.stdout: "database": { 2024-03-04T09:25:45.011 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "database", 2024-03-04T09:25:45.012 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.012 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.012 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.012 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "ceph", 2024-03-04T09:25:45.012 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.012 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.012 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.012 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-03-04T09:25:45.012 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.012 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.012 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.012 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.013 INFO:teuthology.orchestra.run.smithi082.stdout: "hostname": { 2024-03-04T09:25:45.013 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "hostname", 2024-03-04T09:25:45.013 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.013 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.013 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.013 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.013 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.013 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.013 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.013 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "InfluxDB server hostname", 2024-03-04T09:25:45.013 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.014 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.014 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.014 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.014 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-03-04T09:25:45.014 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-03-04T09:25:45.014 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:45.014 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.014 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.015 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "30", 2024-03-04T09:25:45.015 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "5", 2024-03-04T09:25:45.015 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.015 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.015 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-03-04T09:25:45.015 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.015 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.015 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.015 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.015 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.015 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.016 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.016 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.016 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.016 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.016 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.016 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.016 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.016 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.016 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.016 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.016 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.016 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.016 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.017 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.017 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.017 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.017 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.017 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.017 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.017 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.017 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.017 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.017 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.018 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.018 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.018 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.018 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.018 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.018 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.018 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.018 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.018 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.018 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.019 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.019 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.019 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.019 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.019 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.019 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.019 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.019 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.019 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.019 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.019 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.019 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.019 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.020 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.020 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.020 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.020 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.020 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.020 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.020 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.020 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.020 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.020 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.020 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.020 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.020 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.021 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.021 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.021 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.021 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.021 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.021 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.021 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.021 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.021 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.021 INFO:teuthology.orchestra.run.smithi082.stdout: "password": { 2024-03-04T09:25:45.021 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "password", 2024-03-04T09:25:45.021 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.021 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.021 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.021 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.022 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.022 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.022 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.022 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "password of InfluxDB server user", 2024-03-04T09:25:45.022 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.022 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.022 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.022 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.022 INFO:teuthology.orchestra.run.smithi082.stdout: "port": { 2024-03-04T09:25:45.022 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "port", 2024-03-04T09:25:45.022 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.022 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.023 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.023 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8086", 2024-03-04T09:25:45.023 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.023 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.023 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.023 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "InfluxDB server port", 2024-03-04T09:25:45.023 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.023 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.023 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.024 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.024 INFO:teuthology.orchestra.run.smithi082.stdout: "ssl": { 2024-03-04T09:25:45.024 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssl", 2024-03-04T09:25:45.024 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.024 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.024 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.024 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "false", 2024-03-04T09:25:45.024 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.024 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.024 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.024 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-03-04T09:25:45.024 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.024 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.025 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.025 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.025 INFO:teuthology.orchestra.run.smithi082.stdout: "threads": { 2024-03-04T09:25:45.025 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "threads", 2024-03-04T09:25:45.025 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.025 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.025 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.025 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-03-04T09:25:45.025 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-03-04T09:25:45.025 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "32", 2024-03-04T09:25:45.025 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.025 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-03-04T09:25:45.025 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.026 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.026 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.026 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.026 INFO:teuthology.orchestra.run.smithi082.stdout: "username": { 2024-03-04T09:25:45.026 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "username", 2024-03-04T09:25:45.026 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.026 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.026 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.026 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.026 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.026 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.026 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.026 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "username of InfluxDB server user", 2024-03-04T09:25:45.026 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.026 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.027 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.027 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.027 INFO:teuthology.orchestra.run.smithi082.stdout: "verify_ssl": { 2024-03-04T09:25:45.027 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "verify_ssl", 2024-03-04T09:25:45.027 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.027 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.027 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.027 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "true", 2024-03-04T09:25:45.027 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.027 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.027 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.027 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-03-04T09:25:45.028 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.028 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.028 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.028 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.028 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.028 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.028 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.028 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "insights", 2024-03-04T09:25:45.028 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.028 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.028 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.028 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.028 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.028 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.029 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.029 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.029 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.029 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.029 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.029 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.029 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.029 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.029 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.029 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.030 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.030 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.030 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.030 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.030 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.030 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.030 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.030 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.030 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.030 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.030 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.031 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.031 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.031 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.031 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.031 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.031 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.031 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.031 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.031 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.031 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.032 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.032 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.032 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.032 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.032 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.032 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.032 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.032 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.032 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.033 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.033 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.033 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.033 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.033 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.033 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.033 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.033 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.033 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.033 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.033 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.033 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.033 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.033 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.033 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.034 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.034 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.034 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.034 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.034 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.034 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.034 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.034 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.034 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.034 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.035 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.035 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.035 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.035 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.035 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.035 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "iostat", 2024-03-04T09:25:45.035 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.035 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.035 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.035 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.035 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.035 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.035 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.035 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.036 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.036 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.036 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.036 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.036 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.036 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.036 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.037 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.037 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.037 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.037 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.037 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.037 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.037 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.037 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.037 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.037 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.038 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.038 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.038 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.038 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.038 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.038 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.038 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.038 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.038 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.038 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.039 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.039 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.039 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.039 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.039 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.039 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.039 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.039 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.039 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.039 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.039 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.039 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.040 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.040 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.040 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.040 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.040 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.040 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.040 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.040 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.040 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.040 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.040 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.040 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.040 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.040 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.041 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.041 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.041 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.041 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.041 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.041 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.041 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.041 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.041 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.041 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.041 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.041 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.041 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.041 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.041 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.042 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "k8sevents", 2024-03-04T09:25:45.042 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.042 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.042 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.042 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_event_retention_days": { 2024-03-04T09:25:45.042 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ceph_event_retention_days", 2024-03-04T09:25:45.042 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.042 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.042 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.042 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "7", 2024-03-04T09:25:45.042 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.042 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.042 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.042 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Days to hold ceph event information within local cache", 2024-03-04T09:25:45.042 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.043 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.043 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.043 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.043 INFO:teuthology.orchestra.run.smithi082.stdout: "config_check_secs": { 2024-03-04T09:25:45.043 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "config_check_secs", 2024-03-04T09:25:45.043 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.043 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.043 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.043 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-03-04T09:25:45.043 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "10", 2024-03-04T09:25:45.043 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.043 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.043 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-03-04T09:25:45.043 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.044 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.044 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.044 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.044 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.044 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.044 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.044 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.044 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.044 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.044 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.044 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.044 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.044 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.044 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.045 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.045 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.045 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.045 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.045 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.045 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.045 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.045 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.045 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.046 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.046 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.046 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.046 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.046 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.046 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.046 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.046 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.046 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.046 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.047 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.047 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.047 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.047 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.047 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.047 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.047 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.048 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.048 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.048 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.048 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.048 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.048 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.048 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.048 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.048 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.048 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.049 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.049 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.049 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.049 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.049 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.049 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.049 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.049 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.049 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.049 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.049 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.049 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.049 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.049 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.049 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.050 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.050 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.050 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.050 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.050 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.050 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.050 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.050 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.050 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.050 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.050 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.050 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "localpool", 2024-03-04T09:25:45.051 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.051 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.051 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.051 INFO:teuthology.orchestra.run.smithi082.stdout: "failure_domain": { 2024-03-04T09:25:45.051 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "failure_domain", 2024-03-04T09:25:45.051 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.051 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.051 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.051 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "host", 2024-03-04T09:25:45.051 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.051 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.051 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.051 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "failure domain for any created local pool", 2024-03-04T09:25:45.051 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-03-04T09:25:45.052 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.052 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.052 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.052 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.052 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.052 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.052 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.052 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.052 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.052 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.052 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.053 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.053 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.053 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.053 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.053 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.053 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.053 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.053 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.053 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.053 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.055 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.055 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.055 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.055 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.055 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.055 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.055 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.055 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.055 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.055 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.055 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.055 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.055 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.055 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.056 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.056 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.056 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.056 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.056 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.056 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.056 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.056 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.056 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.056 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.056 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.056 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.056 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.057 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.057 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.057 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.057 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.057 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.057 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.057 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.057 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.057 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.057 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.057 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.057 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.057 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.057 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.058 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.058 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.058 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.058 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.058 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.058 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.058 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.058 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.058 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.058 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.058 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.058 INFO:teuthology.orchestra.run.smithi082.stdout: "min_size": { 2024-03-04T09:25:45.058 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "min_size", 2024-03-04T09:25:45.058 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.059 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.059 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.059 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.059 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.059 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.059 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.059 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "default min_size for any created local pool", 2024-03-04T09:25:45.059 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-03-04T09:25:45.059 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.059 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.059 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.060 INFO:teuthology.orchestra.run.smithi082.stdout: "num_rep": { 2024-03-04T09:25:45.060 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "num_rep", 2024-03-04T09:25:45.060 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.060 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.060 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.060 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "3", 2024-03-04T09:25:45.060 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.060 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.060 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.060 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "default replica count for any created local pool", 2024-03-04T09:25:45.060 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.060 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.060 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.060 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.061 INFO:teuthology.orchestra.run.smithi082.stdout: "pg_num": { 2024-03-04T09:25:45.061 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pg_num", 2024-03-04T09:25:45.061 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.061 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.061 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.061 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "128", 2024-03-04T09:25:45.061 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.061 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.061 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.061 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "default pg_num for any created local pool", 2024-03-04T09:25:45.061 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.061 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.061 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.061 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.061 INFO:teuthology.orchestra.run.smithi082.stdout: "prefix": { 2024-03-04T09:25:45.062 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "prefix", 2024-03-04T09:25:45.062 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.062 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.062 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.062 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.062 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.062 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.062 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.062 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "name prefix for any created local pool", 2024-03-04T09:25:45.062 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.062 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.062 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.062 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.062 INFO:teuthology.orchestra.run.smithi082.stdout: "subtree": { 2024-03-04T09:25:45.063 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "subtree", 2024-03-04T09:25:45.063 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.063 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.063 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.063 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "rack", 2024-03-04T09:25:45.063 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.063 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.063 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.063 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "CRUSH level for which to create a local pool", 2024-03-04T09:25:45.063 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-03-04T09:25:45.063 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.063 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.063 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.063 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.063 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.064 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.064 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mds_autoscaler", 2024-03-04T09:25:45.064 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.064 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.064 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.064 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.064 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.064 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.064 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.064 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.064 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.064 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.064 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.065 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.065 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.065 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.065 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.065 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.065 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.065 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.065 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.065 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.065 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.065 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.066 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.066 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.066 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.066 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.066 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.066 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.066 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.066 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.066 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.066 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.066 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.067 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.067 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.067 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.067 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.067 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.067 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.067 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.067 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.067 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.067 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.067 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.067 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.068 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.068 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.068 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.068 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.068 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.068 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.068 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.068 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.068 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.069 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.069 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.069 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.069 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.069 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.069 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.069 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.069 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.069 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.069 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.069 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.069 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.069 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.070 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.070 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.070 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.070 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.070 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.070 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.070 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.070 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.070 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.070 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mirroring", 2024-03-04T09:25:45.070 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.070 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.070 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.071 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.071 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.071 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.071 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.071 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.071 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.071 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.071 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.071 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.071 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.071 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.072 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.072 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.072 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.072 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.072 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.072 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.072 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.072 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.072 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.072 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.072 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.072 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.073 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.073 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.073 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.073 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.073 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.073 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.073 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.073 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.073 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.073 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.074 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.074 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.074 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.074 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.074 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.074 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.074 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.074 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.074 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.074 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.075 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.075 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.075 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.075 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.075 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.075 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.075 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.075 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.075 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.075 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.075 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.076 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.076 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.076 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.076 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.076 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.076 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.076 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.076 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.076 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.076 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.076 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.077 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.077 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.077 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.077 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.077 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.077 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.077 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.077 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.077 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "nfs", 2024-03-04T09:25:45.077 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.077 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.077 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.078 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.078 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.078 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.078 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.078 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.078 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.078 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.078 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.078 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.078 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.078 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.078 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.078 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.078 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.078 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.078 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.079 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.079 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.079 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.079 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.079 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.079 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.079 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.079 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.079 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.079 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.079 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.079 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.079 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.079 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.080 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.080 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.080 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.080 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.080 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.080 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.080 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.080 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.080 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.080 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.080 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.080 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.080 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.081 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.081 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.081 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.081 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.081 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.081 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.081 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.081 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.081 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.081 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.081 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.081 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.081 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.081 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.081 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.082 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.082 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.082 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.082 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.082 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.082 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.082 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.082 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.083 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.083 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.083 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.083 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.083 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.083 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.083 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.083 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "orchestrator", 2024-03-04T09:25:45.083 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.084 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.084 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.084 INFO:teuthology.orchestra.run.smithi082.stdout: "fail_fs": { 2024-03-04T09:25:45.084 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "fail_fs", 2024-03-04T09:25:45.084 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.084 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.084 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.084 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.084 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.084 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.085 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.085 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-03-04T09:25:45.085 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.085 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.085 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.085 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.085 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.085 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.085 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.085 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.085 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.085 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.086 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.086 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.086 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.086 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.086 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.086 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.086 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.086 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.086 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.087 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.087 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.087 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.087 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.087 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.087 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.087 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.087 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.087 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.087 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.087 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.088 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.088 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.088 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.088 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.088 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.088 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.088 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.088 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.088 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.088 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.088 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.089 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.089 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.089 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.089 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.089 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.089 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.089 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.089 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.089 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.089 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.090 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.090 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.090 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.090 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.090 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.090 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.090 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.090 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.090 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.090 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.090 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.091 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.091 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.091 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.091 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.091 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.091 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.091 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.091 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.091 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.092 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.092 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.092 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.092 INFO:teuthology.orchestra.run.smithi082.stdout: "orchestrator": { 2024-03-04T09:25:45.092 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "orchestrator", 2024-03-04T09:25:45.092 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.092 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.092 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.092 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.092 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.092 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.092 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.093 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm", 2024-03-04T09:25:45.093 INFO:teuthology.orchestra.run.smithi082.stdout: "rook", 2024-03-04T09:25:45.093 INFO:teuthology.orchestra.run.smithi082.stdout: "test_orchestrator" 2024-03-04T09:25:45.093 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.093 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Orchestrator backend", 2024-03-04T09:25:45.093 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.093 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.093 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.093 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.093 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.093 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.093 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.094 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "osd_perf_query", 2024-03-04T09:25:45.094 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.094 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.094 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.094 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.094 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.094 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.094 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.094 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.094 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.094 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.095 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.095 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.095 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.095 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.095 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.095 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.095 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.095 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.095 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.095 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.095 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.095 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.095 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.095 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.096 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.096 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.096 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.096 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.096 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.096 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.096 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.096 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.096 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.096 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.096 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.096 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.096 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.096 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.097 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.097 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.097 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.097 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.097 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.097 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.097 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.097 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.097 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.097 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.097 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.097 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.097 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.097 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.098 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.098 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.098 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.098 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.098 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.098 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.098 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.098 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.098 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.098 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.098 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.098 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.098 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.099 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.099 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.099 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.099 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.099 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.099 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.099 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.099 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.099 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.099 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.099 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.099 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "osd_support", 2024-03-04T09:25:45.099 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.099 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.100 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.100 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.100 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.100 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.100 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.100 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.100 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.100 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.100 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.100 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.100 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.100 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.100 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.101 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.101 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.101 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.101 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.101 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.101 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.101 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.101 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.101 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.101 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.101 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.101 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.101 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.101 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.102 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.102 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.102 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.102 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.102 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.102 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.102 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.102 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.102 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.102 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.102 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.102 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.102 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.102 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.103 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.103 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.103 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.103 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.103 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.103 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.103 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.103 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.103 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.103 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.103 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.103 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.104 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.104 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.104 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.104 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.104 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.104 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.104 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.104 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.104 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.104 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.104 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.105 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.105 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.105 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.105 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.105 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.105 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.105 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.105 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.105 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.106 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.106 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pg_autoscaler", 2024-03-04T09:25:45.106 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.106 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.106 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.106 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.106 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.106 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.106 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.106 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.106 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.107 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.107 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.107 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.107 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.107 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.107 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.107 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.107 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.107 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.107 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.107 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.107 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.107 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.107 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.107 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.108 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.108 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.108 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.108 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.108 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.108 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.108 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.108 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.109 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.109 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.109 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.109 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.109 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.110 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.110 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.110 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.110 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.110 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.110 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.110 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.111 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.111 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.111 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.111 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.111 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.111 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.111 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.111 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.111 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.111 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.111 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.112 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.112 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.112 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.112 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.112 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.112 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.112 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.112 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.112 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.112 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.112 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.112 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.113 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.113 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.113 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.113 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.113 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.113 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.113 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-03-04T09:25:45.113 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-03-04T09:25:45.113 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:45.113 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.113 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.113 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-03-04T09:25:45.114 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.114 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.114 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.114 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.114 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.114 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.114 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.114 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.114 INFO:teuthology.orchestra.run.smithi082.stdout: "threshold": { 2024-03-04T09:25:45.114 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "threshold", 2024-03-04T09:25:45.114 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-03-04T09:25:45.114 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.114 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.114 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "3.0", 2024-03-04T09:25:45.115 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1.0", 2024-03-04T09:25:45.115 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.115 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.115 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "scaling threshold", 2024-03-04T09:25:45.115 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-03-04T09:25:45.115 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.115 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.115 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.115 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.115 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.115 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.116 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "progress", 2024-03-04T09:25:45.116 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.116 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.116 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.116 INFO:teuthology.orchestra.run.smithi082.stdout: "allow_pg_recovery_event": { 2024-03-04T09:25:45.116 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "allow_pg_recovery_event", 2024-03-04T09:25:45.116 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.116 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.116 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.116 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.116 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.116 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.116 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.116 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "allow the module to show pg recovery progress", 2024-03-04T09:25:45.117 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.117 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.117 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.117 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.117 INFO:teuthology.orchestra.run.smithi082.stdout: "enabled": { 2024-03-04T09:25:45.117 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enabled", 2024-03-04T09:25:45.117 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.117 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.117 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.117 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:45.117 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.117 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.117 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.117 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.117 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.118 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.118 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.118 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.118 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.118 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.118 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.118 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.118 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.118 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.118 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.118 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.118 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.119 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.119 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.119 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.119 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.119 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.119 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.119 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.119 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.119 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.119 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.119 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.119 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.120 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.120 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.120 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.120 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.120 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.120 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.120 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.120 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.120 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.120 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.120 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.120 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.121 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.121 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.121 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.121 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.121 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.121 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.121 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.121 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.121 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.121 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.121 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.121 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.122 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.122 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.122 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.122 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.122 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.122 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.122 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.122 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.122 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.122 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.122 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.122 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.122 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.122 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.123 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.123 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.123 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.123 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.123 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.123 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.123 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.123 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.123 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.123 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.123 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.123 INFO:teuthology.orchestra.run.smithi082.stdout: "max_completed_events": { 2024-03-04T09:25:45.123 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_completed_events", 2024-03-04T09:25:45.124 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.124 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.124 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.124 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "50", 2024-03-04T09:25:45.124 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.124 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.124 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.124 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "number of past completed events to remember", 2024-03-04T09:25:45.124 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.124 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.125 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.125 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.125 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-03-04T09:25:45.125 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-03-04T09:25:45.125 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:45.125 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.125 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.125 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-03-04T09:25:45.125 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.125 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.125 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.125 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how long the module is going to sleep", 2024-03-04T09:25:45.125 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.125 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.126 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.126 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.126 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.126 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.126 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.126 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "prometheus", 2024-03-04T09:25:45.126 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.126 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.126 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.127 INFO:teuthology.orchestra.run.smithi082.stdout: "cache": { 2024-03-04T09:25:45.127 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cache", 2024-03-04T09:25:45.127 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.127 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.127 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.127 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:45.127 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.127 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.127 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.127 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.127 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.127 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.127 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.127 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.127 INFO:teuthology.orchestra.run.smithi082.stdout: "exclude_perf_counters": { 2024-03-04T09:25:45.128 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "exclude_perf_counters", 2024-03-04T09:25:45.128 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.128 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.128 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.128 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:45.128 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.128 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.128 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.128 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-03-04T09:25:45.128 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-03-04T09:25:45.129 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.129 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.129 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.129 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.129 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.129 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.129 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.129 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.129 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.129 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.129 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.129 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.129 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.130 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.130 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.130 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.130 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.130 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.130 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.130 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.130 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.130 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.130 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.130 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.130 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.130 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.131 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.131 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.131 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.131 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.131 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.131 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.131 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.131 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.131 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.131 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.131 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.131 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.131 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.131 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.132 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.132 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.132 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.132 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.132 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.132 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.132 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.132 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.132 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.132 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.132 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.133 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.133 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.133 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.133 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.133 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.133 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.134 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.134 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.134 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.134 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.134 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.134 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.134 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.134 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.134 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.135 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.135 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.135 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.135 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.135 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.135 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.135 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.135 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_stats_pools": { 2024-03-04T09:25:45.135 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_stats_pools", 2024-03-04T09:25:45.135 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.135 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.135 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.135 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.135 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.135 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.136 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.136 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.136 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.136 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.136 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.136 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.136 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_stats_pools_refresh_interval": { 2024-03-04T09:25:45.136 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-03-04T09:25:45.136 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.136 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.136 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.136 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "300", 2024-03-04T09:25:45.136 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.136 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.137 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.137 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.137 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.137 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.137 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.137 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.137 INFO:teuthology.orchestra.run.smithi082.stdout: "scrape_interval": { 2024-03-04T09:25:45.137 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "scrape_interval", 2024-03-04T09:25:45.137 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-03-04T09:25:45.137 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.137 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.137 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "15.0", 2024-03-04T09:25:45.137 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.137 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.138 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.138 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.138 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.138 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.138 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.138 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.138 INFO:teuthology.orchestra.run.smithi082.stdout: "server_addr": { 2024-03-04T09:25:45.138 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_addr", 2024-03-04T09:25:45.138 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.138 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.138 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.138 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "::", 2024-03-04T09:25:45.138 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.138 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.138 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.139 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-03-04T09:25:45.139 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.139 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.139 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.139 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.139 INFO:teuthology.orchestra.run.smithi082.stdout: "server_port": { 2024-03-04T09:25:45.139 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_port", 2024-03-04T09:25:45.139 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.139 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.139 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.139 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "9283", 2024-03-04T09:25:45.140 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.140 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.140 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.140 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-03-04T09:25:45.140 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.140 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.140 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.140 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.140 INFO:teuthology.orchestra.run.smithi082.stdout: "stale_cache_strategy": { 2024-03-04T09:25:45.140 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "stale_cache_strategy", 2024-03-04T09:25:45.140 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.140 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.141 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.141 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "log", 2024-03-04T09:25:45.141 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.141 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.141 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.141 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.141 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.141 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.141 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.141 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.141 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_behaviour": { 2024-03-04T09:25:45.141 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_behaviour", 2024-03-04T09:25:45.141 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.142 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.142 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.142 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "default", 2024-03-04T09:25:45.142 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.142 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.142 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.142 INFO:teuthology.orchestra.run.smithi082.stdout: "default", 2024-03-04T09:25:45.142 INFO:teuthology.orchestra.run.smithi082.stdout: "error" 2024-03-04T09:25:45.142 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.142 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.142 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.142 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.142 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.142 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.143 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_error_status_code": { 2024-03-04T09:25:45.143 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_error_status_code", 2024-03-04T09:25:45.143 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.143 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.143 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.143 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "500", 2024-03-04T09:25:45.143 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "400", 2024-03-04T09:25:45.143 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "599", 2024-03-04T09:25:45.143 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.143 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.143 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.143 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.143 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.143 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.144 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.144 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.144 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.144 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_support", 2024-03-04T09:25:45.144 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.145 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.145 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.145 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.145 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.145 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.145 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.145 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.145 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.145 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.145 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.145 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.145 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.146 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.146 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.146 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.146 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.146 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.146 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.146 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.146 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.147 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.147 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.147 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.147 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.147 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.147 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.148 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.148 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.148 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.148 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.148 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.148 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.148 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.149 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.149 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.149 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.149 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.149 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.149 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.149 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.149 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.149 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.149 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.149 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.149 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.149 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.150 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.150 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.150 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.150 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.150 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.150 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.150 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.150 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.150 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.150 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.150 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.150 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.151 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.151 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.151 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.151 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.151 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.151 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.151 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.151 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.151 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.151 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.151 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.152 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.152 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.152 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.152 INFO:teuthology.orchestra.run.smithi082.stdout: "max_concurrent_snap_create": { 2024-03-04T09:25:45.152 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_concurrent_snap_create", 2024-03-04T09:25:45.152 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.152 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.152 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.152 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-03-04T09:25:45.152 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.152 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.153 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.153 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.153 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.153 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.153 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.153 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.153 INFO:teuthology.orchestra.run.smithi082.stdout: "mirror_snapshot_schedule": { 2024-03-04T09:25:45.153 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mirror_snapshot_schedule", 2024-03-04T09:25:45.153 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.153 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.153 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.153 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.153 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.154 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.154 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.154 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.154 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.154 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.154 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.154 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.154 INFO:teuthology.orchestra.run.smithi082.stdout: "trash_purge_schedule": { 2024-03-04T09:25:45.154 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "trash_purge_schedule", 2024-03-04T09:25:45.154 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.154 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.154 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.155 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.155 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.155 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.155 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.155 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.155 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.155 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.155 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.155 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.155 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.155 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.155 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.156 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "restful", 2024-03-04T09:25:45.156 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.156 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.156 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.156 INFO:teuthology.orchestra.run.smithi082.stdout: "enable_auth": { 2024-03-04T09:25:45.156 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enable_auth", 2024-03-04T09:25:45.156 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.156 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.156 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.156 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:45.156 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.157 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.157 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.157 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.157 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.157 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.157 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.157 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.157 INFO:teuthology.orchestra.run.smithi082.stdout: "key_file": { 2024-03-04T09:25:45.157 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "key_file", 2024-03-04T09:25:45.158 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.158 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.158 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.158 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.158 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.158 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.158 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.158 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.158 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.158 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.158 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.159 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.159 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.159 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.159 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.159 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.159 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.159 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.159 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.159 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.159 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.159 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.159 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.159 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.160 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.160 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.160 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.160 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.160 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.160 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.160 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.160 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.160 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.160 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.160 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.160 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.160 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.161 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.161 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.161 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.161 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.161 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.161 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.161 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.161 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.161 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.161 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.161 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.161 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.162 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.162 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.162 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.162 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.162 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.162 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.162 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.162 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.162 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.162 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.162 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.162 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.162 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.162 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.162 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.162 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.163 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.163 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.163 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.163 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.163 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.163 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.163 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.163 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.163 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.163 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.163 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.163 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.163 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.163 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.164 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.164 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.164 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.164 INFO:teuthology.orchestra.run.smithi082.stdout: "server_addr": { 2024-03-04T09:25:45.164 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_addr", 2024-03-04T09:25:45.164 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.164 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.164 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.164 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.164 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.164 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.164 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.164 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.165 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.165 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.165 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.165 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.165 INFO:teuthology.orchestra.run.smithi082.stdout: "server_port": { 2024-03-04T09:25:45.165 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_port", 2024-03-04T09:25:45.165 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.165 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.165 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.165 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.165 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.165 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.166 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.166 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.166 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.166 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.166 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.166 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.166 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.166 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.166 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.166 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rgw", 2024-03-04T09:25:45.166 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.167 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.167 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.167 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.167 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.167 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.167 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.167 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.168 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.168 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.168 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.168 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.168 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.168 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.168 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.168 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.169 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.169 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.169 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.169 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.169 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.169 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.169 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.169 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.169 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.169 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.169 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.169 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.169 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.169 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.170 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.170 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.170 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.170 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.170 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.170 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.170 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.170 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.170 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.170 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.171 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.171 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.171 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.171 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.171 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.172 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.172 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.172 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.172 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.172 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.172 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.173 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.173 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.173 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.173 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.173 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.173 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.173 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.173 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.174 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.174 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.174 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.174 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.174 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.174 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.174 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.174 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.174 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.175 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.175 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.175 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.175 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.175 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.175 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.175 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.175 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.175 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rook", 2024-03-04T09:25:45.175 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.175 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.175 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.176 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.176 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.176 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.176 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.176 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.176 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.176 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.176 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.176 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.176 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.177 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.177 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.177 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.177 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.177 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.177 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.177 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.177 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.177 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.177 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.177 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.177 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.177 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.178 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.178 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.178 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.178 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.178 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.178 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.178 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.178 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.178 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.178 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.178 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.178 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.178 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.179 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.179 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.179 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.179 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.179 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.179 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.179 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.179 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.179 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.179 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.179 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.179 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.179 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.180 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.180 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.180 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.180 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.180 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.180 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.180 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.180 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.180 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.180 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.181 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.181 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.181 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.181 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.181 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.181 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.181 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.181 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.181 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.181 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.182 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.182 INFO:teuthology.orchestra.run.smithi082.stdout: "storage_class": { 2024-03-04T09:25:45.182 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "storage_class", 2024-03-04T09:25:45.182 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.182 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.182 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.182 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "local", 2024-03-04T09:25:45.182 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.182 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.182 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.182 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-03-04T09:25:45.182 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.182 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.183 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.183 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.183 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.183 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.183 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.183 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "selftest", 2024-03-04T09:25:45.183 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.183 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.183 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.183 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.184 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.184 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.184 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.184 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.184 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.184 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.184 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.184 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.184 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.184 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.184 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.185 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.185 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.185 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.185 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.185 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.185 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.185 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.185 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.185 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.185 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.185 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.186 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.186 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.186 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.186 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.186 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.186 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.186 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.186 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.186 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.186 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.186 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.186 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.186 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.186 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.187 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.187 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.187 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.187 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.187 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.187 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.187 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.187 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.187 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.187 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.187 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.188 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.188 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.188 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.188 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.188 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.188 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.188 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.188 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.188 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.188 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.188 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.188 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.188 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.188 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.189 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.189 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.189 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.189 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.189 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.189 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.189 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.189 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.189 INFO:teuthology.orchestra.run.smithi082.stdout: "roption1": { 2024-03-04T09:25:45.189 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "roption1", 2024-03-04T09:25:45.189 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.189 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.189 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.189 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.189 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.190 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.190 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.190 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.190 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.190 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.190 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.190 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.190 INFO:teuthology.orchestra.run.smithi082.stdout: "roption2": { 2024-03-04T09:25:45.190 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "roption2", 2024-03-04T09:25:45.191 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.191 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.191 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.191 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "xyz", 2024-03-04T09:25:45.191 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.191 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.191 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.191 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.191 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.191 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.191 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.191 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.191 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption1": { 2024-03-04T09:25:45.191 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption1", 2024-03-04T09:25:45.191 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.192 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.192 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.192 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.192 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.192 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.192 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.192 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.192 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.192 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.192 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.192 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.192 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption2": { 2024-03-04T09:25:45.192 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption2", 2024-03-04T09:25:45.193 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.193 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.193 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.193 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.193 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.193 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.193 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.193 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.193 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.193 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.193 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.193 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.193 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption3": { 2024-03-04T09:25:45.193 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption3", 2024-03-04T09:25:45.194 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-03-04T09:25:45.194 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.194 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.194 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.194 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.194 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.194 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.194 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.194 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.194 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.194 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.195 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.195 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption4": { 2024-03-04T09:25:45.195 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption4", 2024-03-04T09:25:45.195 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.195 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.195 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.195 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.195 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.195 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.195 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.195 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.195 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.196 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.196 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.196 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.196 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption5": { 2024-03-04T09:25:45.196 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption5", 2024-03-04T09:25:45.196 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.196 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.196 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.196 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.196 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.196 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.196 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.197 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.197 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.197 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.197 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.197 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.197 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption6": { 2024-03-04T09:25:45.197 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption6", 2024-03-04T09:25:45.197 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.197 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.197 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.197 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:45.197 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.197 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.198 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.198 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.198 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.198 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.198 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.198 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.198 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption7": { 2024-03-04T09:25:45.198 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption7", 2024-03-04T09:25:45.198 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.198 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.198 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.198 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.198 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-03-04T09:25:45.199 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "42", 2024-03-04T09:25:45.199 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.199 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.199 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.199 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.199 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.199 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.199 INFO:teuthology.orchestra.run.smithi082.stdout: "testkey": { 2024-03-04T09:25:45.199 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "testkey", 2024-03-04T09:25:45.199 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.199 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.200 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.200 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.200 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.200 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.200 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.200 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.200 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.200 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.200 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.200 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.200 INFO:teuthology.orchestra.run.smithi082.stdout: "testlkey": { 2024-03-04T09:25:45.200 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "testlkey", 2024-03-04T09:25:45.200 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.200 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.201 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.201 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.201 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.201 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.201 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.201 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.201 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.201 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.201 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.202 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.202 INFO:teuthology.orchestra.run.smithi082.stdout: "testnewline": { 2024-03-04T09:25:45.202 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "testnewline", 2024-03-04T09:25:45.202 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.202 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.202 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.202 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.202 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.202 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.202 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.202 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.202 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.202 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.202 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.202 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.203 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.203 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.203 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.203 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snap_schedule", 2024-03-04T09:25:45.203 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.203 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.203 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.203 INFO:teuthology.orchestra.run.smithi082.stdout: "allow_m_granularity": { 2024-03-04T09:25:45.203 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "allow_m_granularity", 2024-03-04T09:25:45.203 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.203 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.203 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.204 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.204 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.204 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.204 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.204 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "allow minute scheduled snapshots", 2024-03-04T09:25:45.205 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.205 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.205 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.205 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.205 INFO:teuthology.orchestra.run.smithi082.stdout: "dump_on_update": { 2024-03-04T09:25:45.205 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "dump_on_update", 2024-03-04T09:25:45.206 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.206 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.206 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.206 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.206 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.207 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.207 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.207 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "dump database to debug log on update", 2024-03-04T09:25:45.207 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.207 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.207 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.208 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.208 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.208 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.208 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.208 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.208 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.209 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.209 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.209 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.209 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.209 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.210 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.210 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.210 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.210 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.210 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.210 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.211 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.211 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.211 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.211 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.212 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.212 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.212 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.212 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.212 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.213 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.213 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.213 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.213 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.213 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.214 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.214 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.214 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.214 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.214 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.214 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.215 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.215 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.215 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.215 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.215 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.216 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.216 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.216 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.217 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.217 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.217 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.217 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.217 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.217 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.218 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.218 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.218 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.218 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.219 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.219 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.219 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.219 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.220 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.220 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.220 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.220 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.221 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.221 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.221 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.221 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.221 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.222 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.222 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.222 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.222 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.222 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.223 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.223 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "stats", 2024-03-04T09:25:45.223 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.223 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.223 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.223 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.224 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.224 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.224 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.224 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.224 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.225 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.225 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.225 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.225 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.225 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.225 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.226 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.226 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.226 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.226 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.226 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.226 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.227 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.227 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.227 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.227 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.227 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.227 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.227 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.228 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.228 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.228 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.228 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.228 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.228 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.228 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.228 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.228 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.228 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.228 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.228 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.228 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.228 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.229 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.229 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.229 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.229 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.229 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.229 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.229 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.229 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.229 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.229 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.229 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.229 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.230 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.230 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.230 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.230 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.230 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.230 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.230 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.230 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.230 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.230 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.230 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.230 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.230 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.231 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.231 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.231 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.231 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.231 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.231 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.231 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.231 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.231 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.231 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "status", 2024-03-04T09:25:45.231 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.231 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.231 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.232 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.232 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.232 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.232 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.232 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.232 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.232 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.232 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.232 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.232 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.232 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.233 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.233 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.233 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.233 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.233 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.233 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.233 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.233 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.233 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.233 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.233 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.233 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.233 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.233 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.234 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.234 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.234 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.234 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.234 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.234 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.234 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.234 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.234 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.234 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.234 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.234 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.234 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.235 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.235 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.235 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.235 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.235 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.235 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.235 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.235 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.235 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.235 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.235 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.235 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.235 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.235 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.236 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.236 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.236 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.236 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.236 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.236 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.236 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.236 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.236 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.236 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.236 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.236 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.236 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.237 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.237 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.237 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.237 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.237 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.237 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.237 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.237 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.237 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "telegraf", 2024-03-04T09:25:45.237 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.237 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.237 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.237 INFO:teuthology.orchestra.run.smithi082.stdout: "address": { 2024-03-04T09:25:45.237 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "address", 2024-03-04T09:25:45.238 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.238 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.238 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.238 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-03-04T09:25:45.238 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.238 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.238 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.238 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.238 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.238 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.238 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.238 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.238 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-03-04T09:25:45.238 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-03-04T09:25:45.238 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:45.239 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.239 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.239 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "15", 2024-03-04T09:25:45.239 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.239 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.239 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.239 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.239 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.239 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.239 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.239 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.239 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.239 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.239 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.239 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.240 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.240 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.240 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.240 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.240 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.240 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.240 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.240 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.240 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.240 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.240 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.240 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.240 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.240 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.241 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.241 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.241 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.241 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.241 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.241 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.241 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.241 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.241 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.241 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.241 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.241 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.241 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.242 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.242 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.242 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.242 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.242 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.242 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.242 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.242 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.242 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.242 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.242 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.242 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.242 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.242 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.243 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.243 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.243 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.243 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.243 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.243 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.243 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.243 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.243 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.243 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.243 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.243 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.243 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.243 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.244 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.244 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.244 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.244 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.244 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.244 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.244 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.244 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.244 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.244 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.244 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.244 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.244 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.245 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.245 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "telemetry", 2024-03-04T09:25:45.245 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.245 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.245 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.245 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_basic": { 2024-03-04T09:25:45.245 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_basic", 2024-03-04T09:25:45.245 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.245 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.245 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.245 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:45.245 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.245 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.245 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.246 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share basic cluster information (size, version)", 2024-03-04T09:25:45.246 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.246 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.246 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.246 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.246 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_crash": { 2024-03-04T09:25:45.246 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_crash", 2024-03-04T09:25:45.246 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.246 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.246 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.246 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:45.246 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.246 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.247 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.247 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-03-04T09:25:45.247 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.247 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.247 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.247 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.247 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_device": { 2024-03-04T09:25:45.247 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_device", 2024-03-04T09:25:45.247 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.247 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.247 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.247 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:45.247 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.247 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.247 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.248 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-03-04T09:25:45.248 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.248 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.248 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.248 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.248 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_ident": { 2024-03-04T09:25:45.248 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_ident", 2024-03-04T09:25:45.248 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.248 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.248 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.248 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.248 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.248 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.249 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.249 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-03-04T09:25:45.249 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.249 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.249 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.249 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.249 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_perf": { 2024-03-04T09:25:45.249 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_perf", 2024-03-04T09:25:45.249 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.249 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.249 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.250 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.250 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.250 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.250 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.250 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share various performance metrics of a cluster", 2024-03-04T09:25:45.250 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.250 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.250 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.250 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.250 INFO:teuthology.orchestra.run.smithi082.stdout: "contact": { 2024-03-04T09:25:45.250 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "contact", 2024-03-04T09:25:45.250 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.250 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.250 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.250 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.250 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.251 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.251 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.251 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.251 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.251 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.251 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.251 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.251 INFO:teuthology.orchestra.run.smithi082.stdout: "description": { 2024-03-04T09:25:45.251 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "description", 2024-03-04T09:25:45.251 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.252 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.252 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.252 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.252 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.252 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.252 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.252 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.252 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.252 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.252 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.252 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.252 INFO:teuthology.orchestra.run.smithi082.stdout: "device_url": { 2024-03-04T09:25:45.252 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "device_url", 2024-03-04T09:25:45.253 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.253 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.253 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.253 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-03-04T09:25:45.253 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.253 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.253 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.253 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.253 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.253 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.253 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.254 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.254 INFO:teuthology.orchestra.run.smithi082.stdout: "enabled": { 2024-03-04T09:25:45.254 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enabled", 2024-03-04T09:25:45.254 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.254 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.254 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.254 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.254 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.254 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.254 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.254 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.254 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.254 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.254 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.255 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.255 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-03-04T09:25:45.255 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-03-04T09:25:45.255 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.255 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.255 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.255 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "24", 2024-03-04T09:25:45.255 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "8", 2024-03-04T09:25:45.255 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.255 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.255 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.255 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.256 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.256 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.256 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.256 INFO:teuthology.orchestra.run.smithi082.stdout: "last_opt_revision": { 2024-03-04T09:25:45.256 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "last_opt_revision", 2024-03-04T09:25:45.256 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.256 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.256 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.256 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "1", 2024-03-04T09:25:45.256 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.256 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.256 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.257 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.257 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.257 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.257 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.257 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.257 INFO:teuthology.orchestra.run.smithi082.stdout: "leaderboard": { 2024-03-04T09:25:45.257 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "leaderboard", 2024-03-04T09:25:45.257 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.257 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.257 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.257 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.257 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.257 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.257 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.258 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.258 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.258 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.258 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.258 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.258 INFO:teuthology.orchestra.run.smithi082.stdout: "leaderboard_description": { 2024-03-04T09:25:45.258 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "leaderboard_description", 2024-03-04T09:25:45.258 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.258 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.258 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.258 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.258 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.258 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.259 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.259 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.259 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.259 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.259 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.259 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.259 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.259 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.259 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.259 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.259 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.259 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.259 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.259 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.259 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.260 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.260 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.260 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.260 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.260 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.260 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.260 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.260 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.260 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.260 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.260 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.260 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.260 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.260 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.260 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.261 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.261 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.261 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.261 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.261 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.261 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.261 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.261 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.261 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.261 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.261 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.261 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.261 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.261 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.261 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.262 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.262 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.262 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.262 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.262 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.262 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.262 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.262 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.262 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.262 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.262 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.262 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.262 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.263 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.263 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.263 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.263 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.263 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.263 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.263 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.263 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.263 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.263 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.263 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.263 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.263 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.264 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.264 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.264 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.264 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.264 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.264 INFO:teuthology.orchestra.run.smithi082.stdout: "organization": { 2024-03-04T09:25:45.264 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "organization", 2024-03-04T09:25:45.264 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.264 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.264 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.264 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.264 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.264 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.264 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.265 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.265 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.265 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.265 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.265 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.265 INFO:teuthology.orchestra.run.smithi082.stdout: "proxy": { 2024-03-04T09:25:45.265 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "proxy", 2024-03-04T09:25:45.265 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.265 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.265 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.265 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.265 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.265 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.265 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.266 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.266 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.266 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.266 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.266 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.266 INFO:teuthology.orchestra.run.smithi082.stdout: "url": { 2024-03-04T09:25:45.266 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "url", 2024-03-04T09:25:45.266 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.266 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.266 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.266 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-03-04T09:25:45.266 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.266 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.266 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.267 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.267 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.267 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.267 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.267 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.267 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.267 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.267 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.267 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "test_orchestrator", 2024-03-04T09:25:45.267 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.267 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.267 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.268 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.268 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.268 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.268 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.268 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.268 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.268 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.268 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.268 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.268 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.268 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.268 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.268 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.268 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.268 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.269 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.269 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.269 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.269 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.269 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.269 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.269 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.269 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.269 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.269 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.269 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.269 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.270 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.270 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.270 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.270 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.270 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.270 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.270 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.270 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.270 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.270 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.270 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.270 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.270 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.270 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.270 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.271 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.271 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.271 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.271 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.271 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.271 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.271 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.271 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.271 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.271 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.271 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.271 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.271 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.271 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.272 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.272 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.272 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.272 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.272 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.272 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.272 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.272 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.272 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.272 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.272 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.272 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.272 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.272 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.273 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.273 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.273 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.273 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "volumes", 2024-03-04T09:25:45.273 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.273 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.273 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.273 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.273 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.273 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.273 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.273 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.273 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.273 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.273 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.274 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.274 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.274 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.274 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.274 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.274 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.274 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.274 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.274 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.274 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.274 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.274 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.274 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.274 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.274 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.275 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.275 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.275 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.275 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.275 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.275 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.275 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.275 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.275 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.275 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.275 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.275 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.275 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.275 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.275 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.276 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.276 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.276 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.276 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.276 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.276 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.276 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.276 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.276 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.276 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.276 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.276 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.276 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.276 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.276 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.277 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.277 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.277 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.277 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.277 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.277 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.277 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.277 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.277 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.277 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.277 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.277 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.277 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.277 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.277 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.278 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.278 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.278 INFO:teuthology.orchestra.run.smithi082.stdout: "max_concurrent_clones": { 2024-03-04T09:25:45.278 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_concurrent_clones", 2024-03-04T09:25:45.278 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.278 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.278 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.278 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "4", 2024-03-04T09:25:45.278 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.278 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.278 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.278 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Number of asynchronous cloner threads", 2024-03-04T09:25:45.278 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.278 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.279 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.279 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.279 INFO:teuthology.orchestra.run.smithi082.stdout: "periodic_async_work": { 2024-03-04T09:25:45.279 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "periodic_async_work", 2024-03-04T09:25:45.279 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.279 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.279 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.279 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.279 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.279 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.279 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.279 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Periodically check for async work", 2024-03-04T09:25:45.279 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.279 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.279 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.280 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.280 INFO:teuthology.orchestra.run.smithi082.stdout: "snapshot_clone_delay": { 2024-03-04T09:25:45.280 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snapshot_clone_delay", 2024-03-04T09:25:45.280 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.280 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.280 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.280 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-03-04T09:25:45.280 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.280 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.280 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.280 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-03-04T09:25:45.280 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.280 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.280 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.281 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.281 INFO:teuthology.orchestra.run.smithi082.stdout: "snapshot_clone_no_wait": { 2024-03-04T09:25:45.281 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snapshot_clone_no_wait", 2024-03-04T09:25:45.281 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.281 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.281 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.281 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:45.281 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.281 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.281 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.281 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-03-04T09:25:45.281 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.281 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.281 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.281 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.282 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.282 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.282 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.282 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix", 2024-03-04T09:25:45.282 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.282 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.282 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.282 INFO:teuthology.orchestra.run.smithi082.stdout: "discovery_interval": { 2024-03-04T09:25:45.282 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "discovery_interval", 2024-03-04T09:25:45.282 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-03-04T09:25:45.282 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.282 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.282 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "100", 2024-03-04T09:25:45.282 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.282 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.283 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.283 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.283 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.283 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.283 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.283 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.283 INFO:teuthology.orchestra.run.smithi082.stdout: "identifier": { 2024-03-04T09:25:45.283 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "identifier", 2024-03-04T09:25:45.283 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.283 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.284 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.284 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.284 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.284 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.284 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.284 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.284 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.284 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.284 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.284 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.284 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-03-04T09:25:45.284 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-03-04T09:25:45.284 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:45.284 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.285 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.285 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-03-04T09:25:45.285 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.285 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.285 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.285 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.285 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.285 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.285 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.285 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.285 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.285 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.286 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.286 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.286 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.286 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.286 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.286 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.286 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.286 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.286 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.286 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.286 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.286 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.287 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.287 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.287 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.287 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.287 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.287 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.287 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.287 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.287 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.287 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.287 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.287 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.287 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.287 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.287 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.287 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.288 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.288 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.288 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.288 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.288 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.288 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.288 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.288 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.288 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.288 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.288 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.288 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.288 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.288 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.289 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.289 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.289 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.289 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.289 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.289 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.289 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.289 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.289 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.289 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.289 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.289 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.289 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.289 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.289 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.290 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.290 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.290 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.290 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.290 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.290 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.290 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.290 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.290 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.290 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.290 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.290 INFO:teuthology.orchestra.run.smithi082.stdout: "zabbix_host": { 2024-03-04T09:25:45.290 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix_host", 2024-03-04T09:25:45.290 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.290 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.291 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.291 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.291 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.291 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.291 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.291 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.291 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.291 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.291 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.291 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.291 INFO:teuthology.orchestra.run.smithi082.stdout: "zabbix_port": { 2024-03-04T09:25:45.291 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix_port", 2024-03-04T09:25:45.291 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.292 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.292 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.292 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10051", 2024-03-04T09:25:45.292 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.292 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.292 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.292 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.292 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.292 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.292 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.292 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.292 INFO:teuthology.orchestra.run.smithi082.stdout: "zabbix_sender": { 2024-03-04T09:25:45.292 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix_sender", 2024-03-04T09:25:45.292 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.292 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.293 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.293 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-03-04T09:25:45.293 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.293 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.293 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.293 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.293 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.293 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.293 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.293 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.293 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.293 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.293 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-03-04T09:25:45.294 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.294 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.294 INFO:teuthology.orchestra.run.smithi082.stdout: "modules": [ 2024-03-04T09:25:45.294 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm", 2024-03-04T09:25:45.294 INFO:teuthology.orchestra.run.smithi082.stdout: "dashboard", 2024-03-04T09:25:45.294 INFO:teuthology.orchestra.run.smithi082.stdout: "iostat", 2024-03-04T09:25:45.294 INFO:teuthology.orchestra.run.smithi082.stdout: "nfs", 2024-03-04T09:25:45.294 INFO:teuthology.orchestra.run.smithi082.stdout: "restful", 2024-03-04T09:25:45.294 INFO:teuthology.orchestra.run.smithi082.stdout: "snap_schedule" 2024-03-04T09:25:45.294 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.295 INFO:teuthology.orchestra.run.smithi082.stdout: "available_modules": [ 2024-03-04T09:25:45.295 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.295 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "alerts", 2024-03-04T09:25:45.295 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.295 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.295 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.295 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-03-04T09:25:45.295 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-03-04T09:25:45.295 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:45.295 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.295 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.295 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-03-04T09:25:45.296 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.296 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.296 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.296 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How frequently to reexamine health status", 2024-03-04T09:25:45.296 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.296 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.296 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.296 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.296 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.296 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.296 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.296 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.297 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.297 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.297 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.297 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.297 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.297 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.297 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.297 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.297 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.297 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.297 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.297 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.297 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.297 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.297 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.298 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.298 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.298 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.298 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.298 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.298 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.298 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.298 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.298 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.298 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.298 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.298 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.298 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.298 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.298 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.299 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.299 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.299 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.299 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.299 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.299 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.299 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.299 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.299 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.299 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.299 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.299 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.299 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.299 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.300 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.300 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.300 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.300 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.300 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.300 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.300 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.300 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.300 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.300 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.300 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.300 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.300 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.300 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.301 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.301 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.301 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.301 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.301 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.301 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.301 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.301 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.301 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_destination": { 2024-03-04T09:25:45.301 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_destination", 2024-03-04T09:25:45.301 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.302 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.302 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.302 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.302 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.302 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.302 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.302 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Email address to send alerts to", 2024-03-04T09:25:45.302 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.302 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.302 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.302 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.302 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_from_name": { 2024-03-04T09:25:45.302 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_from_name", 2024-03-04T09:25:45.302 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.302 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.303 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.303 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "Ceph", 2024-03-04T09:25:45.303 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.303 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.303 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.303 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Email From: name", 2024-03-04T09:25:45.303 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.303 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.303 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.303 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.303 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_host": { 2024-03-04T09:25:45.303 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_host", 2024-03-04T09:25:45.304 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.304 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.304 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.304 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.304 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.304 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.304 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.304 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SMTP server", 2024-03-04T09:25:45.304 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.304 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.304 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.304 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.304 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_password": { 2024-03-04T09:25:45.305 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_password", 2024-03-04T09:25:45.305 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.305 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.305 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.305 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.305 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.305 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.305 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.305 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Password to authenticate with", 2024-03-04T09:25:45.305 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.305 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.305 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.305 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.305 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_port": { 2024-03-04T09:25:45.306 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_port", 2024-03-04T09:25:45.306 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.306 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.306 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.306 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "465", 2024-03-04T09:25:45.306 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.306 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.306 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.306 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SMTP port", 2024-03-04T09:25:45.306 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.306 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.306 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.307 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.307 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_sender": { 2024-03-04T09:25:45.307 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_sender", 2024-03-04T09:25:45.307 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.307 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.307 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.307 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.307 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.307 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.307 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.307 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SMTP envelope sender", 2024-03-04T09:25:45.307 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.307 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.307 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.308 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.308 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_ssl": { 2024-03-04T09:25:45.308 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_ssl", 2024-03-04T09:25:45.308 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.308 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.308 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.308 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:45.308 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.308 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.308 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.308 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use SSL to connect to SMTP server", 2024-03-04T09:25:45.308 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.308 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.309 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.309 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.309 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_user": { 2024-03-04T09:25:45.309 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_user", 2024-03-04T09:25:45.309 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.309 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.309 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.309 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.309 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.309 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.309 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.309 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "User to authenticate as", 2024-03-04T09:25:45.309 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.309 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.310 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.310 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.310 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.310 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.310 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.310 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "balancer", 2024-03-04T09:25:45.310 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.310 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.310 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.310 INFO:teuthology.orchestra.run.smithi082.stdout: "active": { 2024-03-04T09:25:45.310 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "active", 2024-03-04T09:25:45.310 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.310 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.311 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.311 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:45.311 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.311 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.311 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.311 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "automatically balance PGs across cluster", 2024-03-04T09:25:45.311 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.311 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.311 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.311 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.311 INFO:teuthology.orchestra.run.smithi082.stdout: "begin_time": { 2024-03-04T09:25:45.311 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "begin_time", 2024-03-04T09:25:45.311 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.311 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.311 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.311 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0000", 2024-03-04T09:25:45.312 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.312 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.312 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.312 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "beginning time of day to automatically balance", 2024-03-04T09:25:45.312 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-03-04T09:25:45.312 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.312 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.312 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.312 INFO:teuthology.orchestra.run.smithi082.stdout: "begin_weekday": { 2024-03-04T09:25:45.312 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "begin_weekday", 2024-03-04T09:25:45.312 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-03-04T09:25:45.312 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.312 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.312 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-03-04T09:25:45.313 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "0", 2024-03-04T09:25:45.313 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "6", 2024-03-04T09:25:45.313 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.313 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-03-04T09:25:45.313 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-03-04T09:25:45.313 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.313 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.313 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.313 INFO:teuthology.orchestra.run.smithi082.stdout: "crush_compat_max_iterations": { 2024-03-04T09:25:45.313 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crush_compat_max_iterations", 2024-03-04T09:25:45.313 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-03-04T09:25:45.313 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.313 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.313 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "25", 2024-03-04T09:25:45.313 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-03-04T09:25:45.313 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "250", 2024-03-04T09:25:45.314 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.314 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-03-04T09:25:45.314 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.314 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.314 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.314 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.314 INFO:teuthology.orchestra.run.smithi082.stdout: "crush_compat_metrics": { 2024-03-04T09:25:45.314 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crush_compat_metrics", 2024-03-04T09:25:45.314 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.314 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.314 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.314 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "pgs,objects,bytes", 2024-03-04T09:25:45.314 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.314 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.314 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.315 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-03-04T09:25:45.315 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-03-04T09:25:45.315 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.315 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.315 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.315 INFO:teuthology.orchestra.run.smithi082.stdout: "crush_compat_step": { 2024-03-04T09:25:45.315 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crush_compat_step", 2024-03-04T09:25:45.315 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-03-04T09:25:45.315 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.315 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.315 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0.5", 2024-03-04T09:25:45.315 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "0.001", 2024-03-04T09:25:45.315 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "0.999", 2024-03-04T09:25:45.315 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.315 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "aggressiveness of optimization", 2024-03-04T09:25:45.316 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-03-04T09:25:45.316 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.316 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.316 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.316 INFO:teuthology.orchestra.run.smithi082.stdout: "end_time": { 2024-03-04T09:25:45.316 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "end_time", 2024-03-04T09:25:45.316 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.316 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.316 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.316 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "2359", 2024-03-04T09:25:45.316 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.316 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.316 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.316 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "ending time of day to automatically balance", 2024-03-04T09:25:45.317 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-03-04T09:25:45.317 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.317 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.317 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.317 INFO:teuthology.orchestra.run.smithi082.stdout: "end_weekday": { 2024-03-04T09:25:45.317 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "end_weekday", 2024-03-04T09:25:45.317 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-03-04T09:25:45.317 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.317 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.317 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-03-04T09:25:45.317 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "0", 2024-03-04T09:25:45.317 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "6", 2024-03-04T09:25:45.317 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.317 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-03-04T09:25:45.318 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-03-04T09:25:45.318 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.318 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.318 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.318 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.318 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.318 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.318 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.318 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.318 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.318 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.318 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.318 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.318 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.319 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.319 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.319 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.319 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.319 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.319 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.319 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.319 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.319 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.319 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.319 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.319 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.319 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.319 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.319 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.319 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.320 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.320 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.320 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.320 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.320 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.320 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.320 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.320 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.320 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.320 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.320 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.320 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.320 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.320 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.321 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.321 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.321 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.321 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.321 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.321 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.321 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.321 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.321 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.321 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.321 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.321 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.321 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.321 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.321 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.322 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.322 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.322 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.322 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.322 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.322 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.322 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.322 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.322 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.322 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.322 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.323 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.323 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.323 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.323 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.323 INFO:teuthology.orchestra.run.smithi082.stdout: "min_score": { 2024-03-04T09:25:45.323 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "min_score", 2024-03-04T09:25:45.323 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-03-04T09:25:45.323 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.323 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.323 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-03-04T09:25:45.323 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.323 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.323 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.323 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-03-04T09:25:45.323 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.324 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.324 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.324 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.324 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": { 2024-03-04T09:25:45.324 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mode", 2024-03-04T09:25:45.324 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.324 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.324 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.324 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "upmap", 2024-03-04T09:25:45.324 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.324 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.324 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.325 INFO:teuthology.orchestra.run.smithi082.stdout: "crush-compat", 2024-03-04T09:25:45.325 INFO:teuthology.orchestra.run.smithi082.stdout: "none", 2024-03-04T09:25:45.325 INFO:teuthology.orchestra.run.smithi082.stdout: "read", 2024-03-04T09:25:45.325 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap", 2024-03-04T09:25:45.325 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap-read" 2024-03-04T09:25:45.325 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.325 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Balancer mode", 2024-03-04T09:25:45.325 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.325 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.325 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.325 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.326 INFO:teuthology.orchestra.run.smithi082.stdout: "pool_ids": { 2024-03-04T09:25:45.326 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pool_ids", 2024-03-04T09:25:45.326 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.326 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.326 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.326 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.326 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.326 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.326 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.326 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-03-04T09:25:45.326 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.326 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.326 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.327 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.327 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-03-04T09:25:45.327 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-03-04T09:25:45.327 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:45.327 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.327 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.327 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-03-04T09:25:45.327 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.327 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.327 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.327 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-03-04T09:25:45.327 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.328 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.328 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.328 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.328 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap_max_deviation": { 2024-03-04T09:25:45.328 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "upmap_max_deviation", 2024-03-04T09:25:45.328 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.328 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.328 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.328 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-03-04T09:25:45.328 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-03-04T09:25:45.328 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.328 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.328 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "deviation below which no optimization is attempted", 2024-03-04T09:25:45.329 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-03-04T09:25:45.329 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.329 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.329 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.329 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap_max_optimizations": { 2024-03-04T09:25:45.329 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "upmap_max_optimizations", 2024-03-04T09:25:45.329 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-03-04T09:25:45.329 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.329 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.329 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-03-04T09:25:45.329 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.329 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.330 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.330 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-03-04T09:25:45.330 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.330 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.330 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.330 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.330 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.330 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.330 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.330 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cephadm", 2024-03-04T09:25:45.330 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.331 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.331 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.331 INFO:teuthology.orchestra.run.smithi082.stdout: "agent_down_multiplier": { 2024-03-04T09:25:45.331 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "agent_down_multiplier", 2024-03-04T09:25:45.331 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-03-04T09:25:45.331 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.331 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.331 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "3.0", 2024-03-04T09:25:45.331 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.331 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.331 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.331 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-03-04T09:25:45.331 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.331 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.332 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.332 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.332 INFO:teuthology.orchestra.run.smithi082.stdout: "agent_refresh_rate": { 2024-03-04T09:25:45.332 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "agent_refresh_rate", 2024-03-04T09:25:45.332 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:45.332 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.332 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.332 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "20", 2024-03-04T09:25:45.332 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.332 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.332 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.332 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-03-04T09:25:45.332 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.332 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.333 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.333 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.333 INFO:teuthology.orchestra.run.smithi082.stdout: "agent_starting_port": { 2024-03-04T09:25:45.333 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "agent_starting_port", 2024-03-04T09:25:45.333 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.333 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.333 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.333 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "4721", 2024-03-04T09:25:45.333 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.333 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.333 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.333 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-03-04T09:25:45.333 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.333 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.334 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.334 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.334 INFO:teuthology.orchestra.run.smithi082.stdout: "allow_ptrace": { 2024-03-04T09:25:45.334 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "allow_ptrace", 2024-03-04T09:25:45.334 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.334 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.334 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.334 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.334 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.334 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.334 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.334 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-03-04T09:25:45.334 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-03-04T09:25:45.334 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.334 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.335 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.335 INFO:teuthology.orchestra.run.smithi082.stdout: "autotune_interval": { 2024-03-04T09:25:45.335 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "autotune_interval", 2024-03-04T09:25:45.335 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:45.335 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.335 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.335 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-03-04T09:25:45.335 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.335 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.335 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.335 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to autotune daemon memory", 2024-03-04T09:25:45.335 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.335 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.335 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.336 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.336 INFO:teuthology.orchestra.run.smithi082.stdout: "autotune_memory_target_ratio": { 2024-03-04T09:25:45.336 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "autotune_memory_target_ratio", 2024-03-04T09:25:45.336 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-03-04T09:25:45.336 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.336 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.336 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0.7", 2024-03-04T09:25:45.336 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.336 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.336 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.336 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-03-04T09:25:45.336 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.336 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.337 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.337 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.337 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm_log_destination": { 2024-03-04T09:25:45.337 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cephadm_log_destination", 2024-03-04T09:25:45.337 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.337 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.337 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.337 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.337 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.337 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.337 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.337 INFO:teuthology.orchestra.run.smithi082.stdout: "file", 2024-03-04T09:25:45.337 INFO:teuthology.orchestra.run.smithi082.stdout: "file,syslog", 2024-03-04T09:25:45.338 INFO:teuthology.orchestra.run.smithi082.stdout: "syslog" 2024-03-04T09:25:45.338 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.338 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-03-04T09:25:45.338 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.338 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.338 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.338 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.338 INFO:teuthology.orchestra.run.smithi082.stdout: "cgroups_split": { 2024-03-04T09:25:45.338 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cgroups_split", 2024-03-04T09:25:45.338 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.338 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.338 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.338 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:45.338 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.338 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.339 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.339 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-03-04T09:25:45.339 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.339 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.339 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.339 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.339 INFO:teuthology.orchestra.run.smithi082.stdout: "config_checks_enabled": { 2024-03-04T09:25:45.339 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "config_checks_enabled", 2024-03-04T09:25:45.339 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.339 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.339 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.339 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.340 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.340 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.340 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.340 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-03-04T09:25:45.340 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.340 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.340 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.340 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.340 INFO:teuthology.orchestra.run.smithi082.stdout: "config_dashboard": { 2024-03-04T09:25:45.340 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "config_dashboard", 2024-03-04T09:25:45.340 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.340 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.340 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.340 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:45.341 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.341 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.341 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.341 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-03-04T09:25:45.341 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.341 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.341 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.341 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.341 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_alertmanager": { 2024-03-04T09:25:45.341 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_alertmanager", 2024-03-04T09:25:45.341 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.341 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.341 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.342 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-03-04T09:25:45.342 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.342 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.342 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.342 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-03-04T09:25:45.342 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.342 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.342 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.342 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.342 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_base": { 2024-03-04T09:25:45.342 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_base", 2024-03-04T09:25:45.342 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.342 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.343 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.343 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/ceph", 2024-03-04T09:25:45.343 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.343 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.343 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.343 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Container image name, without the tag", 2024-03-04T09:25:45.343 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.343 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.343 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.343 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.343 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_elasticsearch": { 2024-03-04T09:25:45.343 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_elasticsearch", 2024-03-04T09:25:45.344 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.344 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.344 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.344 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-03-04T09:25:45.344 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.344 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.344 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.344 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "elasticsearch container image", 2024-03-04T09:25:45.344 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.344 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.344 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.344 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.344 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_grafana": { 2024-03-04T09:25:45.344 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_grafana", 2024-03-04T09:25:45.345 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.345 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.345 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.345 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.12", 2024-03-04T09:25:45.345 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.345 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.345 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.345 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-03-04T09:25:45.345 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.345 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.345 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.345 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.345 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_haproxy": { 2024-03-04T09:25:45.346 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_haproxy", 2024-03-04T09:25:45.346 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.346 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.346 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.346 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-03-04T09:25:45.346 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.346 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.346 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.346 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "HAproxy container image", 2024-03-04T09:25:45.346 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.346 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.346 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.346 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.346 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_jaeger_agent": { 2024-03-04T09:25:45.346 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_jaeger_agent", 2024-03-04T09:25:45.347 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.347 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.347 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.347 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-03-04T09:25:45.347 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.347 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.347 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.347 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Jaeger agent container image", 2024-03-04T09:25:45.347 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.347 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.347 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.347 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.347 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_jaeger_collector": { 2024-03-04T09:25:45.347 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_jaeger_collector", 2024-03-04T09:25:45.347 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.348 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.348 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.348 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-03-04T09:25:45.348 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.348 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.348 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.348 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Jaeger collector container image", 2024-03-04T09:25:45.348 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.348 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.348 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.348 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.348 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_jaeger_query": { 2024-03-04T09:25:45.349 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_jaeger_query", 2024-03-04T09:25:45.349 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.349 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.349 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.349 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-03-04T09:25:45.349 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.349 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.349 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.349 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Jaeger query container image", 2024-03-04T09:25:45.349 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.349 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.349 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.349 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.349 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_keepalived": { 2024-03-04T09:25:45.349 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_keepalived", 2024-03-04T09:25:45.350 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.350 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.350 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.350 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-03-04T09:25:45.350 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.350 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.350 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.350 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Keepalived container image", 2024-03-04T09:25:45.350 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.350 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.350 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.350 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.350 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_loki": { 2024-03-04T09:25:45.350 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_loki", 2024-03-04T09:25:45.350 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.351 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.351 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.351 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-03-04T09:25:45.351 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.351 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.351 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.351 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Loki container image", 2024-03-04T09:25:45.351 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.351 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.351 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.351 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.351 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_node_exporter": { 2024-03-04T09:25:45.351 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_node_exporter", 2024-03-04T09:25:45.351 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.352 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.352 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.352 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-03-04T09:25:45.352 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.352 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.352 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.352 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-03-04T09:25:45.352 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.352 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.352 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.352 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.352 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_nvmeof": { 2024-03-04T09:25:45.353 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_nvmeof", 2024-03-04T09:25:45.353 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.353 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.353 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.353 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/nvmeof:latest", 2024-03-04T09:25:45.353 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.353 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.353 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.353 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Nvme-of container image", 2024-03-04T09:25:45.353 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.353 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.353 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.353 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.353 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_prometheus": { 2024-03-04T09:25:45.353 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_prometheus", 2024-03-04T09:25:45.354 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.354 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.354 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.354 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-03-04T09:25:45.354 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.354 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.354 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.354 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-03-04T09:25:45.354 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.354 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.354 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.354 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.354 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_promtail": { 2024-03-04T09:25:45.354 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_promtail", 2024-03-04T09:25:45.354 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.355 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.355 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.355 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-03-04T09:25:45.355 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.355 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.355 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.355 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Promtail container image", 2024-03-04T09:25:45.355 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.355 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.355 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.355 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.355 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_snmp_gateway": { 2024-03-04T09:25:45.355 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_snmp_gateway", 2024-03-04T09:25:45.355 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.355 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.356 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.356 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-03-04T09:25:45.356 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.356 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.356 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.356 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SNMP Gateway container image", 2024-03-04T09:25:45.356 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.356 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.356 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.356 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.356 INFO:teuthology.orchestra.run.smithi082.stdout: "container_init": { 2024-03-04T09:25:45.356 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_init", 2024-03-04T09:25:45.356 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.356 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.356 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.357 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:45.357 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.357 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.357 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.357 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Run podman/docker with `--init`", 2024-03-04T09:25:45.357 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.357 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.357 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.357 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.357 INFO:teuthology.orchestra.run.smithi082.stdout: "daemon_cache_timeout": { 2024-03-04T09:25:45.357 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "daemon_cache_timeout", 2024-03-04T09:25:45.358 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:45.358 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.358 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.358 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-03-04T09:25:45.358 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.358 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.358 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.358 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-03-04T09:25:45.358 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.358 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.358 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.358 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.358 INFO:teuthology.orchestra.run.smithi082.stdout: "default_cephadm_command_timeout": { 2024-03-04T09:25:45.358 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "default_cephadm_command_timeout", 2024-03-04T09:25:45.359 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.359 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.359 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.359 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "900", 2024-03-04T09:25:45.359 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.359 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.359 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.359 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-03-04T09:25:45.359 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.359 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.359 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.359 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.360 INFO:teuthology.orchestra.run.smithi082.stdout: "default_registry": { 2024-03-04T09:25:45.360 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "default_registry", 2024-03-04T09:25:45.360 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.360 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.360 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.360 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io", 2024-03-04T09:25:45.360 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.360 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.360 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.360 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-03-04T09:25:45.360 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.361 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.361 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.361 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.361 INFO:teuthology.orchestra.run.smithi082.stdout: "device_cache_timeout": { 2024-03-04T09:25:45.361 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "device_cache_timeout", 2024-03-04T09:25:45.361 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:45.361 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.361 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.361 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "1800", 2024-03-04T09:25:45.361 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.361 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.361 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.361 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "seconds to cache device inventory", 2024-03-04T09:25:45.362 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.362 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.362 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.362 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.362 INFO:teuthology.orchestra.run.smithi082.stdout: "device_enhanced_scan": { 2024-03-04T09:25:45.362 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "device_enhanced_scan", 2024-03-04T09:25:45.362 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.362 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.362 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.362 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.362 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.362 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.363 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.363 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use libstoragemgmt during device scans", 2024-03-04T09:25:45.363 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.363 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.363 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.363 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.363 INFO:teuthology.orchestra.run.smithi082.stdout: "facts_cache_timeout": { 2024-03-04T09:25:45.363 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "facts_cache_timeout", 2024-03-04T09:25:45.363 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:45.363 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.363 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.363 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-03-04T09:25:45.363 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.364 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.364 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.364 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "seconds to cache host facts data", 2024-03-04T09:25:45.364 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.364 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.364 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.364 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.364 INFO:teuthology.orchestra.run.smithi082.stdout: "host_check_interval": { 2024-03-04T09:25:45.364 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "host_check_interval", 2024-03-04T09:25:45.364 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:45.364 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.364 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.364 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-03-04T09:25:45.365 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.365 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.365 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.365 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to perform a host check", 2024-03-04T09:25:45.365 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.365 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.365 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.365 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.365 INFO:teuthology.orchestra.run.smithi082.stdout: "hw_monitoring": { 2024-03-04T09:25:45.365 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "hw_monitoring", 2024-03-04T09:25:45.365 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.365 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.365 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.365 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.366 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.366 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.366 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.366 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-03-04T09:25:45.366 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.366 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.366 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.366 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.366 INFO:teuthology.orchestra.run.smithi082.stdout: "inventory_list_all": { 2024-03-04T09:25:45.366 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "inventory_list_all", 2024-03-04T09:25:45.366 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.366 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.366 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.366 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.366 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.366 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.367 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.367 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-03-04T09:25:45.367 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.367 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.367 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.367 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.367 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.367 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.367 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.367 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.367 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.367 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.368 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.368 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.368 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.368 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.368 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.368 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.368 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.368 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.368 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.368 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.368 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.369 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.369 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.369 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.369 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.369 INFO:teuthology.orchestra.run.smithi082.stdout: "log_refresh_metadata": { 2024-03-04T09:25:45.369 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_refresh_metadata", 2024-03-04T09:25:45.369 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.369 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.369 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.369 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.369 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.369 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.369 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.369 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-03-04T09:25:45.369 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.370 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.370 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.370 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.370 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.370 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.370 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.370 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.370 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.370 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:45.370 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.370 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.370 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.370 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-03-04T09:25:45.370 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.370 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.371 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.371 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.371 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.371 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.371 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.371 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.371 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.371 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.371 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.371 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.371 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.371 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.371 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.371 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.371 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.372 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.372 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.372 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.372 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.372 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.372 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.372 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.372 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.372 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.372 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.372 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.372 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.372 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.372 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.373 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.373 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.373 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.373 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.373 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.373 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.373 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.373 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.373 INFO:teuthology.orchestra.run.smithi082.stdout: "manage_etc_ceph_ceph_conf": { 2024-03-04T09:25:45.373 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-03-04T09:25:45.373 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.374 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.374 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.374 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.374 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.374 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.374 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.374 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-03-04T09:25:45.374 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.374 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.374 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.374 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.374 INFO:teuthology.orchestra.run.smithi082.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-03-04T09:25:45.374 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-03-04T09:25:45.374 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.375 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.375 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.375 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "*", 2024-03-04T09:25:45.375 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.375 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.375 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.375 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-03-04T09:25:45.375 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.375 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.375 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.375 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.375 INFO:teuthology.orchestra.run.smithi082.stdout: "max_count_per_host": { 2024-03-04T09:25:45.375 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_count_per_host", 2024-03-04T09:25:45.375 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.376 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.376 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.376 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-03-04T09:25:45.376 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.376 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.376 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.376 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "max number of daemons per service per host", 2024-03-04T09:25:45.376 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.376 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.376 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.376 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.376 INFO:teuthology.orchestra.run.smithi082.stdout: "max_osd_draining_count": { 2024-03-04T09:25:45.376 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_osd_draining_count", 2024-03-04T09:25:45.377 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.377 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.377 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.377 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-03-04T09:25:45.377 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.377 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.377 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.377 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-03-04T09:25:45.377 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.377 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.377 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.377 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.377 INFO:teuthology.orchestra.run.smithi082.stdout: "migration_current": { 2024-03-04T09:25:45.377 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "migration_current", 2024-03-04T09:25:45.378 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.378 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.378 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.378 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.378 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.378 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.378 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.378 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "internal - do not modify", 2024-03-04T09:25:45.378 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.378 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.378 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.378 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.378 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": { 2024-03-04T09:25:45.379 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mode", 2024-03-04T09:25:45.379 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.379 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.379 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.379 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "root", 2024-03-04T09:25:45.379 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.379 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.379 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.379 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm-package", 2024-03-04T09:25:45.379 INFO:teuthology.orchestra.run.smithi082.stdout: "root" 2024-03-04T09:25:45.379 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.379 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "mode for remote execution of cephadm", 2024-03-04T09:25:45.379 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.379 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.380 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.380 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.380 INFO:teuthology.orchestra.run.smithi082.stdout: "oob_default_addr": { 2024-03-04T09:25:45.380 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "oob_default_addr", 2024-03-04T09:25:45.380 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.380 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.380 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.380 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "169.254.1.1", 2024-03-04T09:25:45.380 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.380 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.380 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.380 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Default address for RedFish API (oob management).", 2024-03-04T09:25:45.381 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.381 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.381 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.381 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.381 INFO:teuthology.orchestra.run.smithi082.stdout: "prometheus_alerts_path": { 2024-03-04T09:25:45.381 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "prometheus_alerts_path", 2024-03-04T09:25:45.381 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.381 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.381 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.381 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-03-04T09:25:45.381 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.381 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.381 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.381 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-03-04T09:25:45.381 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.382 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.382 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.382 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.382 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_insecure": { 2024-03-04T09:25:45.382 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_insecure", 2024-03-04T09:25:45.382 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.382 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.382 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.382 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.382 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.382 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.382 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.382 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-03-04T09:25:45.383 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.383 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.383 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.383 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.383 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_password": { 2024-03-04T09:25:45.383 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_password", 2024-03-04T09:25:45.383 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.383 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.383 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.383 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.383 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.383 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.383 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.383 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-03-04T09:25:45.384 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.384 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.384 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.384 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.384 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_url": { 2024-03-04T09:25:45.384 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_url", 2024-03-04T09:25:45.384 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.384 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.384 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.384 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.384 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.384 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.384 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.384 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-03-04T09:25:45.384 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.385 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.385 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.385 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.385 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_username": { 2024-03-04T09:25:45.385 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_username", 2024-03-04T09:25:45.385 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.385 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.385 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.385 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.385 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.385 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.385 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.385 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-03-04T09:25:45.385 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.386 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.386 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.386 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.386 INFO:teuthology.orchestra.run.smithi082.stdout: "secure_monitoring_stack": { 2024-03-04T09:25:45.386 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "secure_monitoring_stack", 2024-03-04T09:25:45.386 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.386 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.386 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.387 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.387 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.387 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.387 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.387 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-03-04T09:25:45.387 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.387 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.387 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.387 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.387 INFO:teuthology.orchestra.run.smithi082.stdout: "service_discovery_port": { 2024-03-04T09:25:45.387 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "service_discovery_port", 2024-03-04T09:25:45.388 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.388 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.388 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.388 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8765", 2024-03-04T09:25:45.388 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.388 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.388 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.388 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "cephadm service discovery port", 2024-03-04T09:25:45.388 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.388 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.388 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.388 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.388 INFO:teuthology.orchestra.run.smithi082.stdout: "ssh_config_file": { 2024-03-04T09:25:45.388 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssh_config_file", 2024-03-04T09:25:45.389 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.389 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.389 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.389 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.389 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.389 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.389 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.389 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-03-04T09:25:45.389 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.389 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.389 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.389 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.389 INFO:teuthology.orchestra.run.smithi082.stdout: "use_agent": { 2024-03-04T09:25:45.389 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "use_agent", 2024-03-04T09:25:45.390 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.390 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.390 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.390 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.390 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.390 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.390 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.390 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-03-04T09:25:45.390 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.390 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.390 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.390 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.390 INFO:teuthology.orchestra.run.smithi082.stdout: "use_repo_digest": { 2024-03-04T09:25:45.390 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "use_repo_digest", 2024-03-04T09:25:45.391 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.391 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.391 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.391 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:45.391 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.391 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.391 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.391 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-03-04T09:25:45.391 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.391 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.391 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.391 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.391 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_on_failed_host_check": { 2024-03-04T09:25:45.391 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_on_failed_host_check", 2024-03-04T09:25:45.391 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.392 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.392 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.392 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:45.392 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.392 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.392 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.392 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise a health warning if the host check fails", 2024-03-04T09:25:45.392 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.392 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.392 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.392 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.392 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_on_stray_daemons": { 2024-03-04T09:25:45.392 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_on_stray_daemons", 2024-03-04T09:25:45.392 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.393 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.393 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.393 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:45.393 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.393 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.393 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.393 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-03-04T09:25:45.393 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.393 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.393 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.393 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.393 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_on_stray_hosts": { 2024-03-04T09:25:45.393 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_on_stray_hosts", 2024-03-04T09:25:45.393 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.394 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.394 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.394 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:45.394 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.394 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.394 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.394 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-03-04T09:25:45.394 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.394 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.394 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.394 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.394 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.394 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.395 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.395 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crash", 2024-03-04T09:25:45.395 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.395 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.395 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.395 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.395 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.395 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.395 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.395 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.396 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.396 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.396 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.396 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.396 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.396 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.396 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.396 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.396 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.396 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.396 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.396 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.397 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.397 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.397 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.397 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.397 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.397 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.397 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.397 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.397 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.397 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.398 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.398 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.398 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.398 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.398 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.398 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.398 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.398 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.398 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.398 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.398 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.398 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.398 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.398 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.399 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.399 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.399 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.399 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.399 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.399 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.399 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.399 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.399 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.399 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.400 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.400 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.400 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.400 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.400 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.400 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.400 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.400 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.400 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.400 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.400 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.400 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.400 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.401 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.401 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.401 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.401 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.401 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.401 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.401 INFO:teuthology.orchestra.run.smithi082.stdout: "retain_interval": { 2024-03-04T09:25:45.401 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "retain_interval", 2024-03-04T09:25:45.401 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:45.401 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.401 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.402 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "31536000", 2024-03-04T09:25:45.402 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.402 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.402 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.402 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how long to retain crashes before pruning them", 2024-03-04T09:25:45.402 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.402 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.402 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.402 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.402 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_recent_interval": { 2024-03-04T09:25:45.402 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_recent_interval", 2024-03-04T09:25:45.402 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:45.403 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.403 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.403 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "1209600", 2024-03-04T09:25:45.403 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.403 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.403 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.403 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "time interval in which to warn about recent crashes", 2024-03-04T09:25:45.403 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.403 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.403 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.403 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.403 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.404 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.404 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.404 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "dashboard", 2024-03-04T09:25:45.404 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.404 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.404 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.404 INFO:teuthology.orchestra.run.smithi082.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-03-04T09:25:45.404 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-03-04T09:25:45.404 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.404 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.404 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.404 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-03-04T09:25:45.404 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.405 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.405 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.405 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.405 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.405 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.405 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.405 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.405 INFO:teuthology.orchestra.run.smithi082.stdout: "ALERTMANAGER_API_HOST": { 2024-03-04T09:25:45.405 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ALERTMANAGER_API_HOST", 2024-03-04T09:25:45.405 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.405 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.405 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.405 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.406 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.406 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.406 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.406 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.406 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.406 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.406 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.406 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.406 INFO:teuthology.orchestra.run.smithi082.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-03-04T09:25:45.406 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-03-04T09:25:45.406 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.406 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.406 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.406 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:45.406 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.407 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.407 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.407 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.407 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.407 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.407 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.407 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.407 INFO:teuthology.orchestra.run.smithi082.stdout: "AUDIT_API_ENABLED": { 2024-03-04T09:25:45.407 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "AUDIT_API_ENABLED", 2024-03-04T09:25:45.407 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.407 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.407 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.407 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.407 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.408 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.408 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.408 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.408 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.408 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.408 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.408 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.408 INFO:teuthology.orchestra.run.smithi082.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-03-04T09:25:45.408 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-03-04T09:25:45.408 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.408 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.408 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.409 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:45.409 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.409 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.409 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.409 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.409 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.409 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.409 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.409 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.409 INFO:teuthology.orchestra.run.smithi082.stdout: "ENABLE_BROWSABLE_API": { 2024-03-04T09:25:45.409 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ENABLE_BROWSABLE_API", 2024-03-04T09:25:45.409 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.409 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.409 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.409 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:45.410 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.410 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.410 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.410 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.410 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.410 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.410 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.410 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.410 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-03-04T09:25:45.410 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-03-04T09:25:45.410 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.410 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.410 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.411 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:45.411 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.411 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.411 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.411 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.411 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.411 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.411 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.411 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.411 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-03-04T09:25:45.411 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-03-04T09:25:45.411 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.411 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.412 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.412 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:45.412 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.412 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.412 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.412 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.412 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.412 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.412 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.412 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.412 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-03-04T09:25:45.412 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-03-04T09:25:45.412 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.412 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.413 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.413 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:45.413 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.413 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.413 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.413 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.413 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.413 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.413 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.413 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.413 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-03-04T09:25:45.413 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-03-04T09:25:45.414 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.414 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.414 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.414 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:45.414 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.414 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.414 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.414 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.414 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.414 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.414 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.414 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.414 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_NFS": { 2024-03-04T09:25:45.414 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-03-04T09:25:45.415 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.415 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.415 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.415 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:45.415 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.415 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.415 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.415 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.415 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.415 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.415 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.415 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.416 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_RBD": { 2024-03-04T09:25:45.416 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-03-04T09:25:45.416 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.416 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.416 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.416 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:45.416 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.416 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.416 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.416 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.416 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.416 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.416 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.416 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.417 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_RGW": { 2024-03-04T09:25:45.417 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-03-04T09:25:45.417 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.417 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.417 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.417 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:45.417 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.417 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.417 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.417 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.417 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.417 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.417 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.417 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.417 INFO:teuthology.orchestra.run.smithi082.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-03-04T09:25:45.418 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-03-04T09:25:45.418 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.418 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.418 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.418 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.418 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.418 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.418 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.418 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.418 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.418 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.418 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.418 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.419 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_PASSWORD": { 2024-03-04T09:25:45.419 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_PASSWORD", 2024-03-04T09:25:45.419 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.419 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.419 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.419 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "admin", 2024-03-04T09:25:45.419 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.419 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.419 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.419 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.419 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.419 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.419 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.419 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.419 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-03-04T09:25:45.420 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-03-04T09:25:45.420 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.420 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.420 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.420 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:45.420 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.420 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.420 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.420 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.420 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.420 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.420 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.420 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.421 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_URL": { 2024-03-04T09:25:45.421 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_URL", 2024-03-04T09:25:45.421 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.421 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.421 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.421 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.421 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.421 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.421 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.421 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.421 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.421 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.421 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.421 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.421 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_USERNAME": { 2024-03-04T09:25:45.422 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_USERNAME", 2024-03-04T09:25:45.422 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.422 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.422 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.422 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "admin", 2024-03-04T09:25:45.422 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.422 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.422 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.422 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.422 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.422 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.422 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.422 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.422 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-03-04T09:25:45.422 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-03-04T09:25:45.423 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.423 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.423 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.423 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.423 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.423 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.423 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.423 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.423 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.423 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.423 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.423 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.423 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-03-04T09:25:45.423 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-03-04T09:25:45.424 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.424 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.424 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.424 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.424 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.424 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.424 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.424 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.424 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.424 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.424 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.424 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.424 INFO:teuthology.orchestra.run.smithi082.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-03-04T09:25:45.424 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-03-04T09:25:45.425 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.425 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.425 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.425 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:45.425 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.425 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.425 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.425 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.425 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.425 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.425 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.425 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.425 INFO:teuthology.orchestra.run.smithi082.stdout: "ISSUE_TRACKER_API_KEY": { 2024-03-04T09:25:45.425 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-03-04T09:25:45.426 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.426 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.426 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.426 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.426 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.426 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.426 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.426 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.426 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.426 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.426 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.426 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.426 INFO:teuthology.orchestra.run.smithi082.stdout: "PROMETHEUS_API_HOST": { 2024-03-04T09:25:45.426 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PROMETHEUS_API_HOST", 2024-03-04T09:25:45.426 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.426 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.427 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.427 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.427 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.427 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.427 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.427 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.427 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.427 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.427 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.427 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.427 INFO:teuthology.orchestra.run.smithi082.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-03-04T09:25:45.427 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-03-04T09:25:45.427 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.428 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.428 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.428 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:45.428 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.428 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.428 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.428 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.428 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.428 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.428 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.428 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.428 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-03-04T09:25:45.428 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-03-04T09:25:45.429 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.429 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.429 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.429 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.429 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.429 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.429 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.429 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.429 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.429 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.429 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.429 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.429 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-03-04T09:25:45.429 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-03-04T09:25:45.430 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.430 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.430 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.430 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.430 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.430 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.430 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.430 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.430 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.430 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.430 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.430 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.430 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-03-04T09:25:45.430 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-03-04T09:25:45.431 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.431 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.431 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.431 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:45.431 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.431 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.431 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.431 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.431 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.431 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.431 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.431 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.431 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-03-04T09:25:45.431 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-03-04T09:25:45.431 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.432 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.432 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.432 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:45.432 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.432 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.432 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.432 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.432 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.432 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.432 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.433 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.433 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-03-04T09:25:45.433 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-03-04T09:25:45.433 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.433 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.433 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.433 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.433 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.433 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.433 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.433 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.433 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.433 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.433 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.434 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.434 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-03-04T09:25:45.434 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-03-04T09:25:45.434 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.434 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.434 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.434 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.434 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.434 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.434 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.434 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.435 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.435 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.435 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.435 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.435 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-03-04T09:25:45.435 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-03-04T09:25:45.435 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.435 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.435 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.435 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.435 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.435 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.435 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.436 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.436 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.436 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.436 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.436 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.436 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_ENABLED": { 2024-03-04T09:25:45.436 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_ENABLED", 2024-03-04T09:25:45.436 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.436 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.436 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.437 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:45.437 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.437 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.437 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.437 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.437 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.437 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.437 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.437 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.437 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-03-04T09:25:45.437 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-03-04T09:25:45.437 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.437 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.438 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.438 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-03-04T09:25:45.438 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.438 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.438 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.438 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.438 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.438 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.438 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.438 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.438 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-03-04T09:25:45.438 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-03-04T09:25:45.438 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.438 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.439 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.439 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-03-04T09:25:45.439 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.439 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.439 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.439 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.439 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.439 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.439 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.439 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.439 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-03-04T09:25:45.439 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-03-04T09:25:45.439 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.439 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.439 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.439 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8", 2024-03-04T09:25:45.440 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.440 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.440 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.440 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.440 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.440 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.440 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.440 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.440 INFO:teuthology.orchestra.run.smithi082.stdout: "REST_REQUESTS_TIMEOUT": { 2024-03-04T09:25:45.440 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-03-04T09:25:45.440 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.440 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.440 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.440 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "45", 2024-03-04T09:25:45.441 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.441 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.441 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.441 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.441 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.441 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.441 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.441 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.441 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_ACCESS_KEY": { 2024-03-04T09:25:45.441 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_ACCESS_KEY", 2024-03-04T09:25:45.441 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.441 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.441 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.441 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.442 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.442 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.442 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.442 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.442 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.442 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.442 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.442 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.442 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-03-04T09:25:45.442 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-03-04T09:25:45.442 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.442 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.442 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.442 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "admin", 2024-03-04T09:25:45.442 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.443 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.443 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.443 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.443 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.443 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.443 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.443 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.443 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_SECRET_KEY": { 2024-03-04T09:25:45.443 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_SECRET_KEY", 2024-03-04T09:25:45.443 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.443 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.443 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.443 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.443 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.443 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.443 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.444 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.444 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.444 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.444 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.444 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.444 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_SSL_VERIFY": { 2024-03-04T09:25:45.444 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_SSL_VERIFY", 2024-03-04T09:25:45.444 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.444 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.444 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.444 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:45.444 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.444 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.444 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.445 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.445 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.445 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.445 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.445 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.445 INFO:teuthology.orchestra.run.smithi082.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-03-04T09:25:45.445 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-03-04T09:25:45.445 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.445 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.445 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.445 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-03-04T09:25:45.445 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.445 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.445 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.446 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.446 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.446 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.446 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.446 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.446 INFO:teuthology.orchestra.run.smithi082.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-03-04T09:25:45.446 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-03-04T09:25:45.446 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.446 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.446 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.446 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-03-04T09:25:45.446 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.447 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.447 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.447 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.447 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.447 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.447 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.447 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.447 INFO:teuthology.orchestra.run.smithi082.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-03-04T09:25:45.447 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-03-04T09:25:45.447 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.447 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.447 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.447 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-03-04T09:25:45.448 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.448 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.448 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.448 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.448 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.448 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.448 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.448 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.448 INFO:teuthology.orchestra.run.smithi082.stdout: "cross_origin_url": { 2024-03-04T09:25:45.448 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cross_origin_url", 2024-03-04T09:25:45.448 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.448 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.448 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.448 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.449 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.449 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.449 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.449 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.449 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.449 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.449 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.449 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.449 INFO:teuthology.orchestra.run.smithi082.stdout: "crt_file": { 2024-03-04T09:25:45.449 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crt_file", 2024-03-04T09:25:45.449 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.449 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.449 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.450 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.450 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.450 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.450 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.450 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.450 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.450 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.450 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.450 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.450 INFO:teuthology.orchestra.run.smithi082.stdout: "debug": { 2024-03-04T09:25:45.450 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "debug", 2024-03-04T09:25:45.450 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.450 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.450 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.450 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.451 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.451 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.451 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.451 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Enable/disable debug options", 2024-03-04T09:25:45.451 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.451 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.451 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.451 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.451 INFO:teuthology.orchestra.run.smithi082.stdout: "jwt_token_ttl": { 2024-03-04T09:25:45.451 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "jwt_token_ttl", 2024-03-04T09:25:45.451 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.451 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.451 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.452 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "28800", 2024-03-04T09:25:45.452 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.452 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.452 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.452 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.452 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.452 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.452 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.452 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.452 INFO:teuthology.orchestra.run.smithi082.stdout: "key_file": { 2024-03-04T09:25:45.452 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "key_file", 2024-03-04T09:25:45.452 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.452 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.453 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.453 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.453 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.453 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.453 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.453 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.453 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.453 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.453 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.453 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.453 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.453 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.453 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.453 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.454 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.454 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.454 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.454 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.454 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.454 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.454 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.454 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.454 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.454 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.454 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.454 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.454 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.454 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.455 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.455 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.455 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.455 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.455 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.455 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.455 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.455 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.455 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.455 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.455 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.455 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.455 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.455 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.455 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.456 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.456 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.456 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.456 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.456 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.456 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.456 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.456 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.456 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.456 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.456 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.456 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.456 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.456 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.457 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.457 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.457 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.457 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.457 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.457 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.457 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.457 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.457 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.457 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.457 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.457 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.457 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.457 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.457 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.457 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.458 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.458 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.458 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.458 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.458 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.458 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.458 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.458 INFO:teuthology.orchestra.run.smithi082.stdout: "motd": { 2024-03-04T09:25:45.458 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "motd", 2024-03-04T09:25:45.458 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.458 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.458 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.458 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.458 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.458 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.459 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.459 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "The message of the day", 2024-03-04T09:25:45.459 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.459 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.459 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.459 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.459 INFO:teuthology.orchestra.run.smithi082.stdout: "redirect_resolve_ip_addr": { 2024-03-04T09:25:45.459 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "redirect_resolve_ip_addr", 2024-03-04T09:25:45.459 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.459 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.459 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.459 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.459 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.459 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.459 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.459 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.460 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.460 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.460 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.460 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.460 INFO:teuthology.orchestra.run.smithi082.stdout: "server_addr": { 2024-03-04T09:25:45.460 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_addr", 2024-03-04T09:25:45.460 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.460 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.460 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.460 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "::", 2024-03-04T09:25:45.460 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.460 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.460 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.460 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.460 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.461 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.461 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.461 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.461 INFO:teuthology.orchestra.run.smithi082.stdout: "server_port": { 2024-03-04T09:25:45.461 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_port", 2024-03-04T09:25:45.461 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.461 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.461 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.461 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8080", 2024-03-04T09:25:45.461 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.461 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.461 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.461 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.461 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.461 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.462 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.462 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.462 INFO:teuthology.orchestra.run.smithi082.stdout: "ssl": { 2024-03-04T09:25:45.462 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssl", 2024-03-04T09:25:45.462 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.462 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.462 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.462 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:45.462 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.462 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.462 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.462 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.462 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.462 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.462 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.463 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.463 INFO:teuthology.orchestra.run.smithi082.stdout: "ssl_server_port": { 2024-03-04T09:25:45.463 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssl_server_port", 2024-03-04T09:25:45.463 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.463 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.463 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.463 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8443", 2024-03-04T09:25:45.463 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.463 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.463 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.463 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.463 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.463 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.463 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.463 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.463 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_behaviour": { 2024-03-04T09:25:45.464 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_behaviour", 2024-03-04T09:25:45.464 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.464 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.464 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.464 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "redirect", 2024-03-04T09:25:45.464 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.464 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.464 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.464 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.464 INFO:teuthology.orchestra.run.smithi082.stdout: "redirect" 2024-03-04T09:25:45.464 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.464 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.464 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.464 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.465 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.465 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.465 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_error_status_code": { 2024-03-04T09:25:45.465 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_error_status_code", 2024-03-04T09:25:45.465 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.465 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.465 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.465 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "500", 2024-03-04T09:25:45.465 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "400", 2024-03-04T09:25:45.465 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "599", 2024-03-04T09:25:45.465 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.465 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.465 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.465 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.465 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.465 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.466 INFO:teuthology.orchestra.run.smithi082.stdout: "url_prefix": { 2024-03-04T09:25:45.466 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "url_prefix", 2024-03-04T09:25:45.466 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.466 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.466 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.466 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.466 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.466 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.466 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.466 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.466 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.466 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.466 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.466 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.467 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.467 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.467 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.467 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "devicehealth", 2024-03-04T09:25:45.467 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.467 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.467 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.467 INFO:teuthology.orchestra.run.smithi082.stdout: "enable_monitoring": { 2024-03-04T09:25:45.467 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enable_monitoring", 2024-03-04T09:25:45.467 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.468 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.468 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.468 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:45.468 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.468 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.468 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.468 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "monitor device health metrics", 2024-03-04T09:25:45.468 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.468 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.468 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.468 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.468 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.468 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.468 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.468 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.469 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.469 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.469 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.469 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.469 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.469 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.469 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.469 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.469 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.469 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.469 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.469 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.470 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.470 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.470 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.470 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.470 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.470 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.470 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.470 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.470 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.470 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.470 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.471 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.471 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.471 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.471 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.471 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.471 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.471 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.471 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.471 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.471 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.471 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.471 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.471 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.472 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.472 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.472 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.472 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.472 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.472 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.472 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.472 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.472 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.472 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.472 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.472 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.472 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.473 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.473 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.473 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.473 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.473 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.473 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.473 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.473 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.473 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.473 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.473 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.473 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.474 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.474 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.474 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.474 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.474 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.474 INFO:teuthology.orchestra.run.smithi082.stdout: "mark_out_threshold": { 2024-03-04T09:25:45.474 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mark_out_threshold", 2024-03-04T09:25:45.474 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:45.474 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.474 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.474 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "2419200", 2024-03-04T09:25:45.474 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.474 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.475 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.475 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-03-04T09:25:45.475 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.475 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.475 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.475 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.475 INFO:teuthology.orchestra.run.smithi082.stdout: "pool_name": { 2024-03-04T09:25:45.475 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pool_name", 2024-03-04T09:25:45.475 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.475 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.475 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.476 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "device_health_metrics", 2024-03-04T09:25:45.476 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.476 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.476 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.476 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "name of pool in which to store device health metrics", 2024-03-04T09:25:45.476 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.476 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.476 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.476 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.476 INFO:teuthology.orchestra.run.smithi082.stdout: "retention_period": { 2024-03-04T09:25:45.476 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "retention_period", 2024-03-04T09:25:45.476 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:45.476 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.477 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.477 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "15552000", 2024-03-04T09:25:45.477 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.477 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.477 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.477 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how long to retain device health metrics", 2024-03-04T09:25:45.477 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.477 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.477 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.477 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.477 INFO:teuthology.orchestra.run.smithi082.stdout: "scrape_frequency": { 2024-03-04T09:25:45.477 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "scrape_frequency", 2024-03-04T09:25:45.477 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:45.477 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.477 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.478 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "86400", 2024-03-04T09:25:45.478 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.478 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.478 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.478 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to scrape device health metrics", 2024-03-04T09:25:45.478 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.478 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.478 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.478 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.478 INFO:teuthology.orchestra.run.smithi082.stdout: "self_heal": { 2024-03-04T09:25:45.478 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "self_heal", 2024-03-04T09:25:45.478 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.478 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.478 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.479 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:45.479 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.479 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.479 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.479 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-03-04T09:25:45.479 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.479 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.479 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.479 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.479 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-03-04T09:25:45.479 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-03-04T09:25:45.479 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:45.479 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.479 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.479 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-03-04T09:25:45.480 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.480 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.480 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.480 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to wake up and check device health", 2024-03-04T09:25:45.480 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.480 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.480 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.480 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.480 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_threshold": { 2024-03-04T09:25:45.480 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_threshold", 2024-03-04T09:25:45.480 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:45.480 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.480 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.480 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "7257600", 2024-03-04T09:25:45.481 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.481 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.481 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.481 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-03-04T09:25:45.481 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.481 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.481 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.481 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.481 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.481 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.481 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.481 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "diskprediction_local", 2024-03-04T09:25:45.481 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.482 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.482 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.482 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.482 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.482 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.482 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.482 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.482 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.482 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.482 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.482 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.482 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.482 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.483 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.483 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.483 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.483 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.483 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.483 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.483 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.483 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.483 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.483 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.483 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.483 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.483 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.483 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.483 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.484 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.484 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.484 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.484 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.484 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.484 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.484 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.484 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.484 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.484 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.484 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.484 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.485 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.485 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.485 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.485 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.485 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.485 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.485 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.485 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.485 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.485 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.485 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.485 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.485 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.485 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.485 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.486 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.486 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.486 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.486 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.486 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.486 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.486 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.486 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.486 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.486 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.486 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.486 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.486 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.487 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.487 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.487 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.487 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.487 INFO:teuthology.orchestra.run.smithi082.stdout: "predict_interval": { 2024-03-04T09:25:45.487 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "predict_interval", 2024-03-04T09:25:45.487 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.487 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.487 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.487 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "86400", 2024-03-04T09:25:45.487 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.487 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.487 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.487 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.488 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.488 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.488 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.488 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.488 INFO:teuthology.orchestra.run.smithi082.stdout: "predictor_model": { 2024-03-04T09:25:45.488 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "predictor_model", 2024-03-04T09:25:45.488 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.488 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.488 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.488 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "prophetstor", 2024-03-04T09:25:45.488 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.488 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.488 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.488 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.489 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.489 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.489 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.489 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.489 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-03-04T09:25:45.489 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-03-04T09:25:45.489 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.489 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.489 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.489 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-03-04T09:25:45.489 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.489 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.489 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.489 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.490 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.490 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.490 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.490 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.490 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.490 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.490 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.490 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "influx", 2024-03-04T09:25:45.490 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": false, 2024-03-04T09:25:45.490 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "influxdb python module not found", 2024-03-04T09:25:45.490 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.490 INFO:teuthology.orchestra.run.smithi082.stdout: "batch_size": { 2024-03-04T09:25:45.490 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "batch_size", 2024-03-04T09:25:45.490 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.490 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.490 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.491 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5000", 2024-03-04T09:25:45.491 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.491 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.491 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.491 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-03-04T09:25:45.491 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.491 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.491 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.491 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.491 INFO:teuthology.orchestra.run.smithi082.stdout: "database": { 2024-03-04T09:25:45.491 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "database", 2024-03-04T09:25:45.491 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.491 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.491 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.491 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "ceph", 2024-03-04T09:25:45.492 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.492 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.492 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.492 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-03-04T09:25:45.492 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.492 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.492 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.492 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.492 INFO:teuthology.orchestra.run.smithi082.stdout: "hostname": { 2024-03-04T09:25:45.492 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "hostname", 2024-03-04T09:25:45.492 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.492 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.492 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.492 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.492 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.493 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.493 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.493 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "InfluxDB server hostname", 2024-03-04T09:25:45.493 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.493 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.493 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.493 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.493 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-03-04T09:25:45.493 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-03-04T09:25:45.493 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:45.493 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.493 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.493 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "30", 2024-03-04T09:25:45.493 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "5", 2024-03-04T09:25:45.493 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.494 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.494 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-03-04T09:25:45.494 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.494 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.494 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.494 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.494 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.494 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.494 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.494 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.494 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.494 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.494 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.495 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.495 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.495 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.495 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.495 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.495 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.495 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.495 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.495 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.495 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.495 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.495 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.496 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.496 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.496 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.496 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.496 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.496 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.496 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.496 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.496 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.496 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.496 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.496 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.496 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.496 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.497 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.497 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.497 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.497 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.497 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.497 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.497 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.497 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.497 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.497 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.497 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.497 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.497 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.497 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.497 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.498 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.498 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.498 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.498 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.498 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.498 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.498 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.498 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.498 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.498 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.498 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.498 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.498 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.498 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.498 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.499 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.499 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.499 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.499 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.499 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.499 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.499 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.499 INFO:teuthology.orchestra.run.smithi082.stdout: "password": { 2024-03-04T09:25:45.499 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "password", 2024-03-04T09:25:45.499 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.499 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.499 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.499 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.499 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.499 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.500 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.500 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "password of InfluxDB server user", 2024-03-04T09:25:45.500 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.500 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.500 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.500 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.500 INFO:teuthology.orchestra.run.smithi082.stdout: "port": { 2024-03-04T09:25:45.500 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "port", 2024-03-04T09:25:45.500 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.500 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.500 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.500 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8086", 2024-03-04T09:25:45.500 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.500 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.501 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.501 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "InfluxDB server port", 2024-03-04T09:25:45.501 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.501 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.501 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.501 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.501 INFO:teuthology.orchestra.run.smithi082.stdout: "ssl": { 2024-03-04T09:25:45.501 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssl", 2024-03-04T09:25:45.501 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.501 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.501 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.501 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "false", 2024-03-04T09:25:45.501 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.501 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.501 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.502 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-03-04T09:25:45.502 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.502 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.502 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.502 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.502 INFO:teuthology.orchestra.run.smithi082.stdout: "threads": { 2024-03-04T09:25:45.502 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "threads", 2024-03-04T09:25:45.502 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.502 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.502 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.503 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-03-04T09:25:45.503 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-03-04T09:25:45.503 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "32", 2024-03-04T09:25:45.503 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.503 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-03-04T09:25:45.503 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.503 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.503 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.503 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.503 INFO:teuthology.orchestra.run.smithi082.stdout: "username": { 2024-03-04T09:25:45.503 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "username", 2024-03-04T09:25:45.503 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.503 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.503 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.504 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.504 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.504 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.504 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.504 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "username of InfluxDB server user", 2024-03-04T09:25:45.504 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.504 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.504 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.504 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.505 INFO:teuthology.orchestra.run.smithi082.stdout: "verify_ssl": { 2024-03-04T09:25:45.505 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "verify_ssl", 2024-03-04T09:25:45.505 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.505 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.505 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.505 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "true", 2024-03-04T09:25:45.505 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.505 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.505 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.505 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-03-04T09:25:45.505 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.505 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.505 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.505 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.505 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.506 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.506 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.506 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "insights", 2024-03-04T09:25:45.506 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.506 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.506 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.506 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.506 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.506 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.506 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.506 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.506 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.507 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.507 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.507 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.507 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.507 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.507 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.507 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.507 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.507 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.507 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.507 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.507 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.508 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.508 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.508 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.508 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.508 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.508 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.508 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.508 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.508 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.508 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.509 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.509 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.509 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.509 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.509 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.509 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.509 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.509 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.509 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.511 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.511 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.511 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.511 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.511 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.511 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.511 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.511 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.512 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.512 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.512 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.512 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.512 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.512 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.512 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.512 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.512 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.512 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.512 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.512 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.512 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.512 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.512 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.513 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.513 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.513 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.513 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.513 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.513 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.513 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.513 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.513 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.513 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.513 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.513 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.513 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.513 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "iostat", 2024-03-04T09:25:45.514 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.514 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.514 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.514 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.514 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.514 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.514 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.514 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.514 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.514 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.514 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.515 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.515 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.515 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.515 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.515 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.515 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.515 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.515 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.515 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.515 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.515 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.515 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.515 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.515 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.515 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.516 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.516 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.516 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.516 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.516 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.516 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.516 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.516 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.516 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.516 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.516 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.516 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.516 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.516 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.517 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.517 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.517 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.517 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.517 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.517 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.517 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.517 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.517 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.517 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.517 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.517 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.517 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.517 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.518 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.518 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.518 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.518 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.518 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.518 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.518 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.518 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.518 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.518 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.518 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.518 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.518 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.518 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.519 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.519 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.519 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.519 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.519 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.519 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.519 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.519 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.519 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "k8sevents", 2024-03-04T09:25:45.519 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.519 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.519 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.519 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_event_retention_days": { 2024-03-04T09:25:45.519 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ceph_event_retention_days", 2024-03-04T09:25:45.520 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.520 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.520 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.520 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "7", 2024-03-04T09:25:45.520 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.520 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.520 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.520 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Days to hold ceph event information within local cache", 2024-03-04T09:25:45.520 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.520 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.520 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.520 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.520 INFO:teuthology.orchestra.run.smithi082.stdout: "config_check_secs": { 2024-03-04T09:25:45.521 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "config_check_secs", 2024-03-04T09:25:45.521 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.521 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.521 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.521 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-03-04T09:25:45.521 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "10", 2024-03-04T09:25:45.521 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.521 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.521 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-03-04T09:25:45.521 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.521 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.521 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.521 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.521 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.522 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.522 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.522 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.522 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.522 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.522 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.522 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.522 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.522 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.522 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.522 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.522 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.523 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.523 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.523 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.523 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.523 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.523 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.523 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.523 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.523 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.523 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.523 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.523 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.523 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.524 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.524 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.524 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.524 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.524 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.524 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.524 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.524 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.524 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.524 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.525 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.525 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.525 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.525 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.525 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.525 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.525 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.525 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.526 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.526 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.526 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.526 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.526 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.526 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.526 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.526 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.526 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.527 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.527 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.527 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.527 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.527 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.527 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.527 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.527 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.527 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.528 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.528 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.528 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.528 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.528 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.528 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.528 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.528 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.529 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.529 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.529 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.529 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "localpool", 2024-03-04T09:25:45.529 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.529 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.529 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.529 INFO:teuthology.orchestra.run.smithi082.stdout: "failure_domain": { 2024-03-04T09:25:45.529 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "failure_domain", 2024-03-04T09:25:45.529 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.529 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.530 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.530 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "host", 2024-03-04T09:25:45.530 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.530 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.530 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.530 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "failure domain for any created local pool", 2024-03-04T09:25:45.530 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-03-04T09:25:45.530 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.530 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.530 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.531 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.531 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.531 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.531 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.531 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.531 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.531 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.531 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.531 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.531 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.531 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.532 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.532 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.532 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.532 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.532 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.532 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.532 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.532 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.532 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.532 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.533 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.533 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.533 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.533 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.533 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.533 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.533 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.533 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.533 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.533 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.533 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.533 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.534 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.534 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.534 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.534 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.534 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.534 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.534 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.534 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.534 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.534 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.534 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.535 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.535 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.535 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.535 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.535 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.535 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.535 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.535 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.535 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.535 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.535 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.535 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.535 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.536 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.536 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.536 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.536 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.536 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.536 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.536 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.536 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.536 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.536 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.536 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.536 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.537 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.537 INFO:teuthology.orchestra.run.smithi082.stdout: "min_size": { 2024-03-04T09:25:45.537 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "min_size", 2024-03-04T09:25:45.537 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.537 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.537 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.537 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.537 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.537 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.537 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.537 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "default min_size for any created local pool", 2024-03-04T09:25:45.537 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-03-04T09:25:45.538 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.538 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.538 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.538 INFO:teuthology.orchestra.run.smithi082.stdout: "num_rep": { 2024-03-04T09:25:45.538 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "num_rep", 2024-03-04T09:25:45.538 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.538 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.538 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.538 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "3", 2024-03-04T09:25:45.538 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.538 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.539 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.539 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "default replica count for any created local pool", 2024-03-04T09:25:45.539 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.539 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.539 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.539 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.539 INFO:teuthology.orchestra.run.smithi082.stdout: "pg_num": { 2024-03-04T09:25:45.539 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pg_num", 2024-03-04T09:25:45.539 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.539 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.539 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.540 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "128", 2024-03-04T09:25:45.540 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.540 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.540 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.540 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "default pg_num for any created local pool", 2024-03-04T09:25:45.541 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.541 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.541 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.541 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.541 INFO:teuthology.orchestra.run.smithi082.stdout: "prefix": { 2024-03-04T09:25:45.541 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "prefix", 2024-03-04T09:25:45.541 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.541 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.541 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.541 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.541 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.541 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.542 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.542 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "name prefix for any created local pool", 2024-03-04T09:25:45.542 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.542 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.542 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.542 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.542 INFO:teuthology.orchestra.run.smithi082.stdout: "subtree": { 2024-03-04T09:25:45.543 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "subtree", 2024-03-04T09:25:45.543 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.543 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.543 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.543 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "rack", 2024-03-04T09:25:45.543 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.543 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.543 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.543 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "CRUSH level for which to create a local pool", 2024-03-04T09:25:45.543 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-03-04T09:25:45.543 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.544 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.544 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.544 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.544 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.544 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.544 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mds_autoscaler", 2024-03-04T09:25:45.544 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.545 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.545 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.545 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.545 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.545 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.545 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.545 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.545 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.546 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.546 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.546 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.546 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.546 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.546 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.546 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.546 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.547 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.547 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.547 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.547 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.547 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.547 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.547 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.547 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.547 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.548 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.548 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.548 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.548 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.548 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.548 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.548 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.549 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.549 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.549 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.549 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.549 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.549 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.549 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.549 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.549 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.549 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.550 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.550 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.550 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.550 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.550 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.550 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.550 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.550 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.550 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.550 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.550 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.550 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.550 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.551 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.551 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.551 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.551 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.551 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.551 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.551 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.551 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.551 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.551 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.552 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.552 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.552 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.552 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.552 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.552 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.552 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.552 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.552 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.552 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.552 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mirroring", 2024-03-04T09:25:45.553 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.553 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.553 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.553 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.553 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.553 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.553 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.553 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.553 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.553 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.553 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.554 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.554 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.554 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.554 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.554 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.554 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.554 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.554 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.554 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.554 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.554 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.554 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.554 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.555 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.555 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.555 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.555 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.555 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.555 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.555 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.555 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.555 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.555 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.555 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.555 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.556 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.556 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.556 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.556 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.556 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.556 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.556 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.556 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.556 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.556 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.556 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.557 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.557 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.557 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.557 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.557 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.557 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.557 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.557 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.558 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.558 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.558 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.558 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.558 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.558 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.558 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.558 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.559 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.559 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.559 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.559 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.559 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.559 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.559 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.559 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.559 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.559 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.559 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.560 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.560 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.560 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "nfs", 2024-03-04T09:25:45.560 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.560 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.560 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.560 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.560 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.560 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.560 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.561 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.561 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.561 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.561 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.561 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.561 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.561 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.561 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.561 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.561 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.562 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.562 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.562 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.562 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.562 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.562 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.562 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.562 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.562 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.562 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.562 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.562 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.562 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.563 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.563 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.563 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.563 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.563 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.563 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.563 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.563 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.564 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.564 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.564 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.564 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.564 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.564 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.564 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.564 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.564 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.564 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.564 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.565 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.565 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.565 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.565 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.565 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.565 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.565 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.565 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.565 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.566 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.566 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.566 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.566 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.566 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.566 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.566 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.566 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.566 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.566 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.566 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.566 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.566 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.567 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.567 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.567 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.567 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.567 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.567 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "orchestrator", 2024-03-04T09:25:45.567 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.567 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.567 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.567 INFO:teuthology.orchestra.run.smithi082.stdout: "fail_fs": { 2024-03-04T09:25:45.567 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "fail_fs", 2024-03-04T09:25:45.567 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.568 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.568 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.568 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.568 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.568 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.568 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.568 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-03-04T09:25:45.568 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.568 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.568 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.568 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.569 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.569 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.569 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.569 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.569 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.569 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.569 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.569 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.569 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.569 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.569 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.569 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.569 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.570 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.570 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.570 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.570 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.570 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.570 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.570 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.570 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.570 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.570 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.570 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.570 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.571 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.571 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.571 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.571 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.571 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.571 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.571 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.571 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.571 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.571 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.571 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.571 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.572 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.572 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.572 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.572 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.572 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.572 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.572 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.572 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.572 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.572 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.572 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.573 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.573 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.573 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.573 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.573 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.573 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.573 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.573 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.573 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.573 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.573 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.573 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.574 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.574 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.574 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.574 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.574 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.574 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.574 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.574 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.574 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.574 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.574 INFO:teuthology.orchestra.run.smithi082.stdout: "orchestrator": { 2024-03-04T09:25:45.574 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "orchestrator", 2024-03-04T09:25:45.575 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.575 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.575 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.575 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.575 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.575 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.575 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.575 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm", 2024-03-04T09:25:45.575 INFO:teuthology.orchestra.run.smithi082.stdout: "rook", 2024-03-04T09:25:45.575 INFO:teuthology.orchestra.run.smithi082.stdout: "test_orchestrator" 2024-03-04T09:25:45.575 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.575 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Orchestrator backend", 2024-03-04T09:25:45.576 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.576 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.576 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.576 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.576 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.576 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.576 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.576 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "osd_perf_query", 2024-03-04T09:25:45.576 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.576 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.576 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.577 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.577 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.577 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.577 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.577 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.577 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.577 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.577 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.577 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.577 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.577 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.577 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.578 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.578 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.578 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.578 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.578 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.578 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.578 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.578 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.579 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.579 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.579 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.579 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.579 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.579 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.579 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.579 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.579 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.579 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.579 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.579 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.580 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.580 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.580 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.580 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.580 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.580 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.580 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.580 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.581 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.581 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.581 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.581 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.581 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.581 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.581 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.581 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.581 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.581 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.581 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.581 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.582 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.582 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.582 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.582 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.582 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.582 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.582 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.582 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.582 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.583 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.583 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.583 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.583 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.583 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.583 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.583 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.583 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.583 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.583 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.583 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.584 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.584 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "osd_support", 2024-03-04T09:25:45.584 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.584 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.584 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.584 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.584 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.584 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.585 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.585 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.585 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.585 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.585 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.585 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.585 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.585 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.585 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.585 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.585 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.586 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.586 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.586 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.586 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.586 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.586 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.586 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.586 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.586 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.587 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.587 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.587 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.587 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.587 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.587 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.587 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.587 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.587 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.587 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.587 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.588 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.588 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.588 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.588 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.588 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.588 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.588 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.588 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.588 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.588 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.588 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.589 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.589 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.589 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.589 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.589 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.589 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.589 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.589 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.589 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.589 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.589 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.589 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.590 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.590 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.590 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.590 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.590 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.590 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.590 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.590 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.590 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.590 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.590 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.590 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.590 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.591 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.591 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.591 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.591 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pg_autoscaler", 2024-03-04T09:25:45.591 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.591 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.591 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.591 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.591 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.591 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.591 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.592 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.592 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.592 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.592 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.592 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.592 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.592 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.592 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.592 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.592 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.593 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.593 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.593 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.593 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.593 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.593 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.593 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.593 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.593 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.593 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.594 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.594 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.594 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.594 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.594 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.594 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.594 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.594 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.594 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.594 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.594 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.594 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.595 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.595 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.595 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.595 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.595 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.595 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.595 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.595 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.595 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.595 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.596 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.596 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.596 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.596 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.596 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.596 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.596 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.596 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.596 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.596 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.596 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.596 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.597 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.597 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.597 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.597 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.597 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.597 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.597 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.597 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.597 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.597 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.597 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.597 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.598 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-03-04T09:25:45.598 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-03-04T09:25:45.598 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:45.598 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.598 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.598 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-03-04T09:25:45.598 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.598 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.598 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.599 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.599 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.599 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.599 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.599 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.599 INFO:teuthology.orchestra.run.smithi082.stdout: "threshold": { 2024-03-04T09:25:45.599 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "threshold", 2024-03-04T09:25:45.599 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-03-04T09:25:45.599 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.599 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.600 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "3.0", 2024-03-04T09:25:45.600 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1.0", 2024-03-04T09:25:45.600 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.600 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.600 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "scaling threshold", 2024-03-04T09:25:45.600 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-03-04T09:25:45.600 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.600 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.600 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.600 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.600 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.600 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.601 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "progress", 2024-03-04T09:25:45.601 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.601 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.601 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.601 INFO:teuthology.orchestra.run.smithi082.stdout: "allow_pg_recovery_event": { 2024-03-04T09:25:45.601 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "allow_pg_recovery_event", 2024-03-04T09:25:45.601 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.601 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.601 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.601 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.601 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.601 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.602 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.602 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "allow the module to show pg recovery progress", 2024-03-04T09:25:45.602 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.602 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.602 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.602 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.602 INFO:teuthology.orchestra.run.smithi082.stdout: "enabled": { 2024-03-04T09:25:45.602 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enabled", 2024-03-04T09:25:45.602 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.602 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.602 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.602 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:45.603 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.603 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.603 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.603 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.603 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.603 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.603 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.603 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.603 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.603 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.603 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.604 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.604 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.604 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.604 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.604 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.604 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.604 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.604 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.604 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.604 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.604 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.604 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.605 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.605 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.605 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.605 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.605 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.605 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.605 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.605 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.605 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.605 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.605 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.605 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.606 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.606 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.606 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.606 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.606 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.606 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.606 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.606 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.606 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.606 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.606 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.607 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.607 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.607 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.607 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.607 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.607 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.607 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.607 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.607 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.607 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.607 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.607 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.608 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.608 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.608 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.608 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.608 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.608 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.608 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.608 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.608 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.608 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.608 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.609 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.609 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.609 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.609 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.609 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.609 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.609 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.609 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.609 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.609 INFO:teuthology.orchestra.run.smithi082.stdout: "max_completed_events": { 2024-03-04T09:25:45.609 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_completed_events", 2024-03-04T09:25:45.609 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.609 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.609 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.610 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "50", 2024-03-04T09:25:45.610 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.610 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.610 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.610 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "number of past completed events to remember", 2024-03-04T09:25:45.610 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.610 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.610 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.610 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.610 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-03-04T09:25:45.610 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-03-04T09:25:45.610 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:45.611 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.611 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.611 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-03-04T09:25:45.611 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.611 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.611 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.611 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how long the module is going to sleep", 2024-03-04T09:25:45.611 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.611 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.611 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.611 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.611 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.612 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.612 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.612 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "prometheus", 2024-03-04T09:25:45.612 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.612 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.612 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.612 INFO:teuthology.orchestra.run.smithi082.stdout: "cache": { 2024-03-04T09:25:45.612 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cache", 2024-03-04T09:25:45.612 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.612 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.612 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.612 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:45.613 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.613 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.613 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.613 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.613 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.613 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.613 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.614 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.614 INFO:teuthology.orchestra.run.smithi082.stdout: "exclude_perf_counters": { 2024-03-04T09:25:45.614 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "exclude_perf_counters", 2024-03-04T09:25:45.614 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.614 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.614 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.614 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:45.614 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.614 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.614 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.614 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-03-04T09:25:45.614 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-03-04T09:25:45.614 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.615 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.615 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.615 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.615 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.615 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.615 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.615 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.615 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.616 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.616 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.616 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.616 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.616 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.616 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.616 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.616 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.616 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.616 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.617 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.617 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.617 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.617 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.617 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.617 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.617 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.617 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.617 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.617 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.618 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.618 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.618 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.618 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.618 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.618 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.618 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.618 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.619 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.619 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.619 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.619 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.619 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.619 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.619 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.619 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.619 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.619 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.620 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.620 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.620 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.620 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.620 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.620 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.620 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.620 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.620 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.621 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.621 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.621 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.621 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.621 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.621 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.621 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.621 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.621 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.622 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.622 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.622 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.622 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.622 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.622 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.622 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.622 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.622 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_stats_pools": { 2024-03-04T09:25:45.622 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_stats_pools", 2024-03-04T09:25:45.622 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.623 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.623 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.623 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.623 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.623 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.623 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.623 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.623 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.623 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.623 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.623 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.624 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_stats_pools_refresh_interval": { 2024-03-04T09:25:45.624 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-03-04T09:25:45.624 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.624 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.624 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.624 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "300", 2024-03-04T09:25:45.624 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.624 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.624 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.624 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.624 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.624 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.625 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.625 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.625 INFO:teuthology.orchestra.run.smithi082.stdout: "scrape_interval": { 2024-03-04T09:25:45.625 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "scrape_interval", 2024-03-04T09:25:45.625 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-03-04T09:25:45.625 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.625 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.625 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "15.0", 2024-03-04T09:25:45.625 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.625 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.625 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.626 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.626 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.626 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.626 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.626 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.626 INFO:teuthology.orchestra.run.smithi082.stdout: "server_addr": { 2024-03-04T09:25:45.626 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_addr", 2024-03-04T09:25:45.626 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.627 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.627 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.627 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "::", 2024-03-04T09:25:45.627 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.627 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.627 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.627 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-03-04T09:25:45.627 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.627 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.628 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.628 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.628 INFO:teuthology.orchestra.run.smithi082.stdout: "server_port": { 2024-03-04T09:25:45.628 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_port", 2024-03-04T09:25:45.628 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.628 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.628 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.628 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "9283", 2024-03-04T09:25:45.628 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.628 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.628 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.629 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-03-04T09:25:45.629 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.629 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.629 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.629 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.629 INFO:teuthology.orchestra.run.smithi082.stdout: "stale_cache_strategy": { 2024-03-04T09:25:45.629 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "stale_cache_strategy", 2024-03-04T09:25:45.629 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.629 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.629 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.630 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "log", 2024-03-04T09:25:45.630 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.630 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.630 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.630 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.630 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.630 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.630 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.630 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.630 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_behaviour": { 2024-03-04T09:25:45.631 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_behaviour", 2024-03-04T09:25:45.631 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.631 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.631 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.631 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "default", 2024-03-04T09:25:45.631 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.631 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.631 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.631 INFO:teuthology.orchestra.run.smithi082.stdout: "default", 2024-03-04T09:25:45.631 INFO:teuthology.orchestra.run.smithi082.stdout: "error" 2024-03-04T09:25:45.632 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.632 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.632 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.632 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.632 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.632 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.632 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_error_status_code": { 2024-03-04T09:25:45.632 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_error_status_code", 2024-03-04T09:25:45.632 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.632 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.633 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.633 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "500", 2024-03-04T09:25:45.633 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "400", 2024-03-04T09:25:45.633 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "599", 2024-03-04T09:25:45.633 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.633 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.633 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.633 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.633 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.633 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.633 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.634 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.634 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.634 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_support", 2024-03-04T09:25:45.634 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.634 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.634 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.634 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.634 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.634 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.634 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.634 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.635 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.635 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.635 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.635 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.635 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.635 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.635 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.635 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.635 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.635 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.636 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.636 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.636 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.636 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.636 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.636 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.636 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.636 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.636 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.637 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.637 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.637 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.637 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.637 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.637 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.637 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.637 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.637 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.638 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.638 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.638 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.638 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.638 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.638 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.638 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.638 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.638 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.638 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.639 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.639 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.639 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.639 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.639 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.639 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.639 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.639 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.639 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.639 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.639 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.640 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.640 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.640 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.640 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.640 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.640 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.640 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.640 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.640 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.640 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.640 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.641 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.641 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.641 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.641 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.641 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.641 INFO:teuthology.orchestra.run.smithi082.stdout: "max_concurrent_snap_create": { 2024-03-04T09:25:45.641 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_concurrent_snap_create", 2024-03-04T09:25:45.641 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.641 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.641 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.641 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-03-04T09:25:45.641 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.641 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.642 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.642 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.642 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.642 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.642 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.642 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.642 INFO:teuthology.orchestra.run.smithi082.stdout: "mirror_snapshot_schedule": { 2024-03-04T09:25:45.642 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mirror_snapshot_schedule", 2024-03-04T09:25:45.642 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.642 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.642 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.643 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.643 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.643 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.643 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.643 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.643 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.643 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.643 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.643 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.643 INFO:teuthology.orchestra.run.smithi082.stdout: "trash_purge_schedule": { 2024-03-04T09:25:45.643 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "trash_purge_schedule", 2024-03-04T09:25:45.643 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.644 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.644 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.644 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.644 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.644 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.644 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.644 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.644 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.644 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.644 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.644 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.645 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.645 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.645 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.645 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "restful", 2024-03-04T09:25:45.645 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.645 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.645 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.645 INFO:teuthology.orchestra.run.smithi082.stdout: "enable_auth": { 2024-03-04T09:25:45.645 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enable_auth", 2024-03-04T09:25:45.645 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.645 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.645 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.646 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:45.646 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.646 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.646 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.646 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.646 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.646 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.646 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.646 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.646 INFO:teuthology.orchestra.run.smithi082.stdout: "key_file": { 2024-03-04T09:25:45.646 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "key_file", 2024-03-04T09:25:45.646 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.647 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.647 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.647 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.647 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.647 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.647 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.647 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.647 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.647 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.647 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.647 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.647 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.648 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.648 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.648 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.648 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.648 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.648 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.648 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.648 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.648 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.648 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.648 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.649 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.649 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.649 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.649 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.649 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.649 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.649 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.649 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.649 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.649 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.649 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.649 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.650 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.650 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.650 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.650 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.650 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.650 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.650 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.650 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.650 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.650 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.650 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.650 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.651 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.651 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.651 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.651 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.651 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.651 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.652 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.652 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.652 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.652 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.652 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.652 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.652 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.652 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.652 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.652 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.652 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.653 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.653 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.653 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.653 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.653 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.653 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.653 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.653 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.653 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.654 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.654 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.654 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.654 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.654 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.654 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.655 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.655 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.655 INFO:teuthology.orchestra.run.smithi082.stdout: "server_addr": { 2024-03-04T09:25:45.655 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_addr", 2024-03-04T09:25:45.655 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.655 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.655 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.655 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.655 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.655 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.656 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.656 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.656 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.656 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.656 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.656 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.657 INFO:teuthology.orchestra.run.smithi082.stdout: "server_port": { 2024-03-04T09:25:45.657 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_port", 2024-03-04T09:25:45.657 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.657 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.657 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.657 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.657 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.657 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.657 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.657 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.658 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.658 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.658 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.658 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.658 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.658 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.658 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.658 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rgw", 2024-03-04T09:25:45.659 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.659 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.659 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.659 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.659 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.659 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.659 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.660 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.660 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.660 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.660 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.660 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.660 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.660 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.660 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.660 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.660 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.661 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.661 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.661 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.661 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.661 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.661 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.661 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.661 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.661 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.661 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.661 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.661 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.662 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.662 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.662 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.662 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.662 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.662 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.662 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.662 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.662 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.662 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.662 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.662 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.662 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.663 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.663 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.663 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.663 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.663 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.663 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.663 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.663 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.663 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.663 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.663 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.664 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.664 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.664 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.664 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.664 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.664 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.664 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.664 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.664 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.664 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.664 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.665 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.665 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.665 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.665 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.665 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.665 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.665 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.665 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.665 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.666 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.666 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.666 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.666 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rook", 2024-03-04T09:25:45.666 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.666 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.666 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.666 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.666 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.666 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.666 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.666 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.666 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.667 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.667 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.667 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.667 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.667 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.667 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.667 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.667 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.668 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.668 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.668 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.668 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.668 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.668 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.668 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.668 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.668 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.668 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.669 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.669 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.669 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.669 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.669 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.669 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.669 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.669 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.669 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.669 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.670 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.670 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.670 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.670 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.670 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.670 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.670 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.670 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.670 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.671 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.671 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.671 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.671 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.671 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.671 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.671 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.671 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.671 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.671 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.671 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.671 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.672 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.672 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.672 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.672 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.672 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.672 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.672 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.673 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.673 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.673 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.673 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.673 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.673 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.673 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.673 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.673 INFO:teuthology.orchestra.run.smithi082.stdout: "storage_class": { 2024-03-04T09:25:45.673 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "storage_class", 2024-03-04T09:25:45.673 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.673 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.674 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.674 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "local", 2024-03-04T09:25:45.674 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.674 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.674 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.674 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-03-04T09:25:45.674 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.674 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.674 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.674 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.675 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.675 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.675 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.675 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "selftest", 2024-03-04T09:25:45.675 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.675 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.675 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.675 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.675 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.675 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.675 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.675 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.676 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.676 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.676 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.676 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.676 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.676 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.676 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.676 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.676 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.676 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.676 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.676 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.677 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.677 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.677 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.677 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.677 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.677 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.677 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.677 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.677 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.677 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.677 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.678 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.678 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.678 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.678 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.678 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.678 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.678 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.678 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.678 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.678 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.678 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.678 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.679 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.679 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.679 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.679 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.679 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.679 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.679 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.679 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.679 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.679 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.679 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.679 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.679 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.680 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.680 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.680 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.680 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.680 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.680 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.680 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.680 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.680 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.680 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.680 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.681 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.681 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.681 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.681 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.681 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.681 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.681 INFO:teuthology.orchestra.run.smithi082.stdout: "roption1": { 2024-03-04T09:25:45.681 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "roption1", 2024-03-04T09:25:45.681 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.681 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.681 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.681 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.681 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.682 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.682 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.682 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.682 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.682 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.682 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.682 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.682 INFO:teuthology.orchestra.run.smithi082.stdout: "roption2": { 2024-03-04T09:25:45.682 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "roption2", 2024-03-04T09:25:45.682 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.683 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.683 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.683 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "xyz", 2024-03-04T09:25:45.683 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.683 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.683 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.683 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.683 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.683 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.683 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.684 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.684 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption1": { 2024-03-04T09:25:45.684 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption1", 2024-03-04T09:25:45.684 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.684 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.684 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.684 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.684 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.684 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.684 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.684 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.684 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.685 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.685 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.685 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.685 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption2": { 2024-03-04T09:25:45.685 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption2", 2024-03-04T09:25:45.685 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.685 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.685 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.685 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.685 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.685 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.685 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.686 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.686 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.686 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.686 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.686 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.686 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption3": { 2024-03-04T09:25:45.686 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption3", 2024-03-04T09:25:45.686 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-03-04T09:25:45.686 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.686 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.687 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.687 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.687 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.687 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.687 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.687 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.687 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.687 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.687 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.688 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption4": { 2024-03-04T09:25:45.688 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption4", 2024-03-04T09:25:45.688 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.688 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.688 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.688 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.688 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.688 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.688 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.688 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.688 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.688 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.689 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.689 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.689 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption5": { 2024-03-04T09:25:45.689 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption5", 2024-03-04T09:25:45.689 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.689 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.689 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.689 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.690 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.690 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.690 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.690 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.690 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.690 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.690 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.690 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.690 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption6": { 2024-03-04T09:25:45.690 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption6", 2024-03-04T09:25:45.690 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.690 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.691 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.691 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:45.691 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.691 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.691 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.691 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.691 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.691 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.692 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.692 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.692 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption7": { 2024-03-04T09:25:45.692 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption7", 2024-03-04T09:25:45.692 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.692 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.692 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.692 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.692 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-03-04T09:25:45.692 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "42", 2024-03-04T09:25:45.692 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.692 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.693 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.693 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.693 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.693 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.693 INFO:teuthology.orchestra.run.smithi082.stdout: "testkey": { 2024-03-04T09:25:45.693 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "testkey", 2024-03-04T09:25:45.693 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.693 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.694 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.694 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.694 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.694 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.694 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.694 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.694 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.694 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.694 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.694 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.694 INFO:teuthology.orchestra.run.smithi082.stdout: "testlkey": { 2024-03-04T09:25:45.695 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "testlkey", 2024-03-04T09:25:45.695 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.695 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.695 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.695 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.695 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.695 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.695 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.695 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.696 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.696 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.696 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.696 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.696 INFO:teuthology.orchestra.run.smithi082.stdout: "testnewline": { 2024-03-04T09:25:45.696 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "testnewline", 2024-03-04T09:25:45.696 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.696 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.696 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.696 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.696 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.697 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.697 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.697 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.697 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.697 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.697 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.697 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.697 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.697 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.697 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.697 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snap_schedule", 2024-03-04T09:25:45.697 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.698 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.698 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.698 INFO:teuthology.orchestra.run.smithi082.stdout: "allow_m_granularity": { 2024-03-04T09:25:45.698 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "allow_m_granularity", 2024-03-04T09:25:45.698 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.698 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.698 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.698 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.698 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.698 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.698 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.698 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "allow minute scheduled snapshots", 2024-03-04T09:25:45.698 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.699 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.699 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.699 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.699 INFO:teuthology.orchestra.run.smithi082.stdout: "dump_on_update": { 2024-03-04T09:25:45.699 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "dump_on_update", 2024-03-04T09:25:45.699 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.699 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.699 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.699 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.699 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.699 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.699 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.700 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "dump database to debug log on update", 2024-03-04T09:25:45.700 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.700 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.700 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.700 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.700 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.700 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.700 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.700 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.700 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.700 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.700 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.700 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.701 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.701 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.701 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.701 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.701 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.701 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.701 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.701 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.701 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.701 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.701 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.701 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.701 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.701 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.702 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.702 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.702 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.702 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.702 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.702 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.702 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.702 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.702 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.702 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.702 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.702 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.702 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.703 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.703 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.703 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.703 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.703 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.703 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.703 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.703 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.703 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.703 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.704 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.704 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.704 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.704 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.704 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.704 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.704 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.704 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.704 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.704 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.705 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.705 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.705 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.705 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.705 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.705 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.705 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.705 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.705 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.705 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.705 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.705 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.706 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.706 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.706 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.706 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.706 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.706 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.706 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "stats", 2024-03-04T09:25:45.706 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.706 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.706 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.707 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.707 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.707 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.707 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.707 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.707 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.707 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.707 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.707 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.707 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.708 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.708 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.708 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.708 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.708 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.708 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.708 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.708 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.708 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.709 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.709 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.709 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.709 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.709 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.709 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.709 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.709 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.709 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.709 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.709 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.709 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.709 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.710 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.710 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.710 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.710 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.710 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.710 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.710 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.710 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.710 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.710 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.710 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.711 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.711 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.711 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.711 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.711 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.711 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.711 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.711 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.711 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.711 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.711 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.712 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.712 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.712 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.712 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.712 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.712 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.712 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.712 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.712 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.712 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.712 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.713 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.713 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.713 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.713 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.713 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.713 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.713 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.713 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.713 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "status", 2024-03-04T09:25:45.713 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.713 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.714 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.714 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.714 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.714 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.714 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.714 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.714 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.714 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.714 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.714 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.714 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.714 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.715 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.715 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.715 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.715 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.715 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.715 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.715 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.715 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.715 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.715 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.715 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.715 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.716 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.716 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.716 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.716 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.716 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.716 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.716 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.716 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.716 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.716 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.716 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.717 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.717 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.717 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.717 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.717 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.717 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.717 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.717 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.717 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.717 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.717 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.717 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.718 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.718 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.718 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.719 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.719 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.720 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.720 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.720 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.720 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.720 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.720 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.720 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.720 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.720 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.720 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.720 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.720 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.721 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.721 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.721 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.721 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.721 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.721 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.721 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.721 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.721 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.721 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.721 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "telegraf", 2024-03-04T09:25:45.721 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.722 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.722 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.722 INFO:teuthology.orchestra.run.smithi082.stdout: "address": { 2024-03-04T09:25:45.722 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "address", 2024-03-04T09:25:45.722 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.722 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.722 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.722 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-03-04T09:25:45.722 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.722 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.722 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.722 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.722 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.723 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.723 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.723 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.723 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-03-04T09:25:45.723 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-03-04T09:25:45.723 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:45.723 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.723 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.723 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "15", 2024-03-04T09:25:45.723 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.723 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.724 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.724 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.724 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.724 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.724 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.724 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.724 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.724 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.724 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.724 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.724 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.725 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.725 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.725 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.725 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.725 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.725 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.725 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.725 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.725 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.725 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.725 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.725 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.726 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.726 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.726 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.726 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.726 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.726 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.726 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.726 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.726 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.726 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.726 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.726 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.727 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.727 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.727 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.727 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.727 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.727 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.727 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.727 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.727 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.727 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.728 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.728 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.728 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.728 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.728 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.728 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.728 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.728 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.728 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.728 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.728 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.729 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.729 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.729 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.729 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.729 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.729 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.729 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.729 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.729 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.729 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.730 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.730 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.730 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.730 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.730 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.730 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.730 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.730 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.730 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.731 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.731 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.731 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.731 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.731 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "telemetry", 2024-03-04T09:25:45.731 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.731 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.731 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.731 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_basic": { 2024-03-04T09:25:45.731 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_basic", 2024-03-04T09:25:45.731 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.731 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.731 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.732 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:45.732 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.732 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.732 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.732 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share basic cluster information (size, version)", 2024-03-04T09:25:45.732 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.732 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.733 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.733 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.733 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_crash": { 2024-03-04T09:25:45.733 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_crash", 2024-03-04T09:25:45.733 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.733 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.733 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.733 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:45.733 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.733 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.733 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.733 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-03-04T09:25:45.734 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.734 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.734 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.734 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.734 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_device": { 2024-03-04T09:25:45.734 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_device", 2024-03-04T09:25:45.734 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.734 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.734 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.734 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:45.735 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.735 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.735 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.735 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-03-04T09:25:45.735 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.735 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.735 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.735 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.735 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_ident": { 2024-03-04T09:25:45.736 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_ident", 2024-03-04T09:25:45.736 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.736 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.736 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.736 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.736 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.736 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.736 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.736 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-03-04T09:25:45.736 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.736 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.737 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.737 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.737 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_perf": { 2024-03-04T09:25:45.737 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_perf", 2024-03-04T09:25:45.737 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.737 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.737 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.737 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.737 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.737 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.737 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.738 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share various performance metrics of a cluster", 2024-03-04T09:25:45.738 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.738 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.738 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.738 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.738 INFO:teuthology.orchestra.run.smithi082.stdout: "contact": { 2024-03-04T09:25:45.738 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "contact", 2024-03-04T09:25:45.738 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.738 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.738 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.738 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.739 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.739 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.739 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.739 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.739 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.739 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.739 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.739 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.739 INFO:teuthology.orchestra.run.smithi082.stdout: "description": { 2024-03-04T09:25:45.739 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "description", 2024-03-04T09:25:45.739 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.740 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.740 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.740 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.740 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.740 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.740 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.740 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.740 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.740 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.740 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.740 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.741 INFO:teuthology.orchestra.run.smithi082.stdout: "device_url": { 2024-03-04T09:25:45.741 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "device_url", 2024-03-04T09:25:45.741 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.741 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.741 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.741 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-03-04T09:25:45.741 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.741 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.741 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.741 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.742 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.742 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.742 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.742 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.742 INFO:teuthology.orchestra.run.smithi082.stdout: "enabled": { 2024-03-04T09:25:45.742 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enabled", 2024-03-04T09:25:45.742 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.742 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.742 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.742 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.742 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.742 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.743 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.743 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.743 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.743 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.743 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.743 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.743 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-03-04T09:25:45.743 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-03-04T09:25:45.743 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.743 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.744 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.744 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "24", 2024-03-04T09:25:45.744 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "8", 2024-03-04T09:25:45.744 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.744 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.744 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.744 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.744 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.744 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.744 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.744 INFO:teuthology.orchestra.run.smithi082.stdout: "last_opt_revision": { 2024-03-04T09:25:45.745 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "last_opt_revision", 2024-03-04T09:25:45.745 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.745 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.745 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.745 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "1", 2024-03-04T09:25:45.745 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.745 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.745 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.745 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.746 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.746 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.746 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.746 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.746 INFO:teuthology.orchestra.run.smithi082.stdout: "leaderboard": { 2024-03-04T09:25:45.746 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "leaderboard", 2024-03-04T09:25:45.746 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.746 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.746 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.746 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.747 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.747 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.747 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.747 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.747 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.747 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.747 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.747 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.747 INFO:teuthology.orchestra.run.smithi082.stdout: "leaderboard_description": { 2024-03-04T09:25:45.747 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "leaderboard_description", 2024-03-04T09:25:45.747 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.748 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.748 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.748 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.748 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.748 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.748 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.748 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.748 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.748 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.749 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.749 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.749 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.749 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.749 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.749 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.749 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.749 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.749 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.749 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.750 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.750 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.750 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.750 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.750 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.750 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.750 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.750 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.750 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.750 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.750 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.750 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.751 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.751 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.751 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.751 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.751 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.751 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.751 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.751 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.751 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.752 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.752 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.752 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.752 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.752 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.752 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.752 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.752 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.752 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.752 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.752 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.753 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.753 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.753 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.753 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.753 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.753 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.753 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.753 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.753 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.753 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.753 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.753 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.753 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.754 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.754 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.754 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.754 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.754 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.754 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.754 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.754 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.754 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.754 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.754 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.755 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.755 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.755 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.755 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.755 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.755 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.755 INFO:teuthology.orchestra.run.smithi082.stdout: "organization": { 2024-03-04T09:25:45.755 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "organization", 2024-03-04T09:25:45.755 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.755 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.755 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.755 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.756 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.756 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.756 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.756 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.756 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.756 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.756 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.756 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.756 INFO:teuthology.orchestra.run.smithi082.stdout: "proxy": { 2024-03-04T09:25:45.756 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "proxy", 2024-03-04T09:25:45.756 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.756 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.756 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.757 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.757 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.757 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.757 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.757 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.757 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.757 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.757 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.757 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.757 INFO:teuthology.orchestra.run.smithi082.stdout: "url": { 2024-03-04T09:25:45.757 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "url", 2024-03-04T09:25:45.757 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.758 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.758 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.758 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-03-04T09:25:45.758 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.758 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.758 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.758 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.758 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.758 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.758 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.758 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.758 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.759 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.759 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.759 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "test_orchestrator", 2024-03-04T09:25:45.759 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.759 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.759 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.759 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.759 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.759 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.759 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.759 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.759 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.760 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.760 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.760 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.760 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.760 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.760 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.760 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.760 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.760 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.760 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.760 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.761 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.761 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.761 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.761 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.761 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.761 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.761 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.761 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.761 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.761 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.761 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.762 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.762 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.762 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.762 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.762 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.762 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.763 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.763 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.763 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.763 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.763 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.763 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.763 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.763 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.763 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.763 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.763 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.764 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.764 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.764 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.764 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.764 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.764 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.764 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.764 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.765 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.765 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.765 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.765 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.765 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.765 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.765 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.766 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.766 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.766 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.766 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.766 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.766 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.766 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.766 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.766 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.766 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.766 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.767 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.767 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.767 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "volumes", 2024-03-04T09:25:45.767 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.767 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.767 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.768 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.768 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.768 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.768 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.768 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.768 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.768 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.768 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.768 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.769 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.769 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.769 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.769 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.769 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.769 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.770 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.770 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.770 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.770 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.770 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.770 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.770 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.771 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.771 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.771 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.771 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.771 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.771 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.771 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.771 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.771 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.771 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.772 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.772 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.772 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.772 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.772 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.772 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.772 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.772 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.772 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.772 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.772 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.772 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.773 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.773 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.773 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.773 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.773 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.773 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.773 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.773 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.773 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.773 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.773 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.774 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.774 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.774 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.774 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.774 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.774 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.774 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.774 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.774 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.774 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.774 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.774 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.775 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.775 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.775 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.775 INFO:teuthology.orchestra.run.smithi082.stdout: "max_concurrent_clones": { 2024-03-04T09:25:45.775 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_concurrent_clones", 2024-03-04T09:25:45.775 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.775 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.775 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.775 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "4", 2024-03-04T09:25:45.775 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.775 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.775 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.775 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Number of asynchronous cloner threads", 2024-03-04T09:25:45.776 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.776 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.776 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.776 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.776 INFO:teuthology.orchestra.run.smithi082.stdout: "periodic_async_work": { 2024-03-04T09:25:45.776 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "periodic_async_work", 2024-03-04T09:25:45.776 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.776 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.777 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.777 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.777 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.777 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.777 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.777 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Periodically check for async work", 2024-03-04T09:25:45.777 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.777 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.777 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.777 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.777 INFO:teuthology.orchestra.run.smithi082.stdout: "snapshot_clone_delay": { 2024-03-04T09:25:45.778 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snapshot_clone_delay", 2024-03-04T09:25:45.778 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.778 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.778 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.778 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-03-04T09:25:45.778 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.778 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.778 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.778 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-03-04T09:25:45.778 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.778 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.778 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.779 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.779 INFO:teuthology.orchestra.run.smithi082.stdout: "snapshot_clone_no_wait": { 2024-03-04T09:25:45.779 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snapshot_clone_no_wait", 2024-03-04T09:25:45.779 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.779 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.779 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.779 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-04T09:25:45.779 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.779 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.779 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.780 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-03-04T09:25:45.780 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.780 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.780 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.780 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.780 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.780 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.780 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.780 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix", 2024-03-04T09:25:45.780 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-04T09:25:45.780 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-04T09:25:45.781 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-04T09:25:45.781 INFO:teuthology.orchestra.run.smithi082.stdout: "discovery_interval": { 2024-03-04T09:25:45.781 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "discovery_interval", 2024-03-04T09:25:45.781 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-03-04T09:25:45.781 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.781 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.781 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "100", 2024-03-04T09:25:45.781 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.781 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.781 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.781 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.782 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.782 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.782 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.782 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.782 INFO:teuthology.orchestra.run.smithi082.stdout: "identifier": { 2024-03-04T09:25:45.782 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "identifier", 2024-03-04T09:25:45.782 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.782 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.782 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.782 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.782 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.782 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.782 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.783 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.783 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.783 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.783 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.783 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.783 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-03-04T09:25:45.783 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-03-04T09:25:45.783 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-04T09:25:45.783 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.783 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.783 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-03-04T09:25:45.784 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.784 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.784 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.784 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.784 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.784 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.784 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.784 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.784 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-04T09:25:45.784 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-04T09:25:45.784 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.784 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.785 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.785 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.785 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.785 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.785 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.785 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.785 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.785 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.785 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.785 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.785 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.786 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.786 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.786 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.786 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.786 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.786 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.786 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-04T09:25:45.786 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-04T09:25:45.786 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.786 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.786 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.787 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.787 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.787 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.787 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.787 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.787 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.787 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.787 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.787 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.787 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-04T09:25:45.787 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-04T09:25:45.788 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.788 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.788 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.788 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-04T09:25:45.788 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.788 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.788 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-04T09:25:45.788 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-04T09:25:45.788 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-04T09:25:45.788 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-04T09:25:45.788 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-04T09:25:45.788 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-04T09:25:45.789 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-04T09:25:45.789 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.789 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.789 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.789 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.789 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.789 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.789 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-04T09:25:45.789 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-04T09:25:45.790 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-04T09:25:45.790 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.790 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-04T09:25:45.790 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-04T09:25:45.790 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.790 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.790 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.790 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.790 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.790 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.790 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.791 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.791 INFO:teuthology.orchestra.run.smithi082.stdout: "zabbix_host": { 2024-03-04T09:25:45.791 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix_host", 2024-03-04T09:25:45.791 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.791 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.791 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.791 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-04T09:25:45.791 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.791 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.791 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.791 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.792 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.792 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.792 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.792 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.792 INFO:teuthology.orchestra.run.smithi082.stdout: "zabbix_port": { 2024-03-04T09:25:45.792 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix_port", 2024-03-04T09:25:45.792 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-04T09:25:45.792 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.792 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.792 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10051", 2024-03-04T09:25:45.792 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.792 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.793 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.793 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.793 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.793 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.793 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.793 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.793 INFO:teuthology.orchestra.run.smithi082.stdout: "zabbix_sender": { 2024-03-04T09:25:45.793 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix_sender", 2024-03-04T09:25:45.793 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-04T09:25:45.793 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-04T09:25:45.793 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-04T09:25:45.793 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-03-04T09:25:45.794 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-04T09:25:45.794 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-04T09:25:45.794 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-04T09:25:45.794 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-04T09:25:45.794 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-04T09:25:45.794 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-04T09:25:45.794 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-04T09:25:45.794 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.794 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.794 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.794 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.794 INFO:teuthology.orchestra.run.smithi082.stdout: "services": { 2024-03-04T09:25:45.794 INFO:teuthology.orchestra.run.smithi082.stdout: "dashboard": "https://172.21.15.82:8443/" 2024-03-04T09:25:45.795 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.795 INFO:teuthology.orchestra.run.smithi082.stdout: "always_on_modules": { 2024-03-04T09:25:45.795 INFO:teuthology.orchestra.run.smithi082.stdout: "octopus": [ 2024-03-04T09:25:45.795 INFO:teuthology.orchestra.run.smithi082.stdout: "balancer", 2024-03-04T09:25:45.795 INFO:teuthology.orchestra.run.smithi082.stdout: "crash", 2024-03-04T09:25:45.795 INFO:teuthology.orchestra.run.smithi082.stdout: "devicehealth", 2024-03-04T09:25:45.795 INFO:teuthology.orchestra.run.smithi082.stdout: "orchestrator", 2024-03-04T09:25:45.795 INFO:teuthology.orchestra.run.smithi082.stdout: "pg_autoscaler", 2024-03-04T09:25:45.795 INFO:teuthology.orchestra.run.smithi082.stdout: "progress", 2024-03-04T09:25:45.795 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_support", 2024-03-04T09:25:45.795 INFO:teuthology.orchestra.run.smithi082.stdout: "status", 2024-03-04T09:25:45.795 INFO:teuthology.orchestra.run.smithi082.stdout: "telemetry", 2024-03-04T09:25:45.796 INFO:teuthology.orchestra.run.smithi082.stdout: "volumes" 2024-03-04T09:25:45.796 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.796 INFO:teuthology.orchestra.run.smithi082.stdout: "pacific": [ 2024-03-04T09:25:45.796 INFO:teuthology.orchestra.run.smithi082.stdout: "balancer", 2024-03-04T09:25:45.796 INFO:teuthology.orchestra.run.smithi082.stdout: "crash", 2024-03-04T09:25:45.796 INFO:teuthology.orchestra.run.smithi082.stdout: "devicehealth", 2024-03-04T09:25:45.796 INFO:teuthology.orchestra.run.smithi082.stdout: "orchestrator", 2024-03-04T09:25:45.796 INFO:teuthology.orchestra.run.smithi082.stdout: "pg_autoscaler", 2024-03-04T09:25:45.796 INFO:teuthology.orchestra.run.smithi082.stdout: "progress", 2024-03-04T09:25:45.796 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_support", 2024-03-04T09:25:45.796 INFO:teuthology.orchestra.run.smithi082.stdout: "status", 2024-03-04T09:25:45.797 INFO:teuthology.orchestra.run.smithi082.stdout: "telemetry", 2024-03-04T09:25:45.797 INFO:teuthology.orchestra.run.smithi082.stdout: "volumes" 2024-03-04T09:25:45.797 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.797 INFO:teuthology.orchestra.run.smithi082.stdout: "quincy": [ 2024-03-04T09:25:45.797 INFO:teuthology.orchestra.run.smithi082.stdout: "balancer", 2024-03-04T09:25:45.797 INFO:teuthology.orchestra.run.smithi082.stdout: "crash", 2024-03-04T09:25:45.797 INFO:teuthology.orchestra.run.smithi082.stdout: "devicehealth", 2024-03-04T09:25:45.797 INFO:teuthology.orchestra.run.smithi082.stdout: "orchestrator", 2024-03-04T09:25:45.797 INFO:teuthology.orchestra.run.smithi082.stdout: "pg_autoscaler", 2024-03-04T09:25:45.798 INFO:teuthology.orchestra.run.smithi082.stdout: "progress", 2024-03-04T09:25:45.798 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_support", 2024-03-04T09:25:45.798 INFO:teuthology.orchestra.run.smithi082.stdout: "status", 2024-03-04T09:25:45.798 INFO:teuthology.orchestra.run.smithi082.stdout: "telemetry", 2024-03-04T09:25:45.798 INFO:teuthology.orchestra.run.smithi082.stdout: "volumes" 2024-03-04T09:25:45.798 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.798 INFO:teuthology.orchestra.run.smithi082.stdout: "reef": [ 2024-03-04T09:25:45.798 INFO:teuthology.orchestra.run.smithi082.stdout: "balancer", 2024-03-04T09:25:45.798 INFO:teuthology.orchestra.run.smithi082.stdout: "crash", 2024-03-04T09:25:45.798 INFO:teuthology.orchestra.run.smithi082.stdout: "devicehealth", 2024-03-04T09:25:45.798 INFO:teuthology.orchestra.run.smithi082.stdout: "orchestrator", 2024-03-04T09:25:45.798 INFO:teuthology.orchestra.run.smithi082.stdout: "pg_autoscaler", 2024-03-04T09:25:45.799 INFO:teuthology.orchestra.run.smithi082.stdout: "progress", 2024-03-04T09:25:45.799 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_support", 2024-03-04T09:25:45.799 INFO:teuthology.orchestra.run.smithi082.stdout: "status", 2024-03-04T09:25:45.799 INFO:teuthology.orchestra.run.smithi082.stdout: "telemetry", 2024-03-04T09:25:45.799 INFO:teuthology.orchestra.run.smithi082.stdout: "volumes" 2024-03-04T09:25:45.799 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-04T09:25:45.799 INFO:teuthology.orchestra.run.smithi082.stdout: "squid": [ 2024-03-04T09:25:45.799 INFO:teuthology.orchestra.run.smithi082.stdout: "balancer", 2024-03-04T09:25:45.799 INFO:teuthology.orchestra.run.smithi082.stdout: "crash", 2024-03-04T09:25:45.799 INFO:teuthology.orchestra.run.smithi082.stdout: "devicehealth", 2024-03-04T09:25:45.800 INFO:teuthology.orchestra.run.smithi082.stdout: "orchestrator", 2024-03-04T09:25:45.800 INFO:teuthology.orchestra.run.smithi082.stdout: "pg_autoscaler", 2024-03-04T09:25:45.800 INFO:teuthology.orchestra.run.smithi082.stdout: "progress", 2024-03-04T09:25:45.800 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_support", 2024-03-04T09:25:45.800 INFO:teuthology.orchestra.run.smithi082.stdout: "status", 2024-03-04T09:25:45.800 INFO:teuthology.orchestra.run.smithi082.stdout: "telemetry", 2024-03-04T09:25:45.800 INFO:teuthology.orchestra.run.smithi082.stdout: "volumes" 2024-03-04T09:25:45.800 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-03-04T09:25:45.800 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.800 INFO:teuthology.orchestra.run.smithi082.stdout: "last_failure_osd_epoch": 95, 2024-03-04T09:25:45.801 INFO:teuthology.orchestra.run.smithi082.stdout: "active_clients": [ 2024-03-04T09:25:45.801 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.801 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "devicehealth", 2024-03-04T09:25:45.801 INFO:teuthology.orchestra.run.smithi082.stdout: "addrvec": [ 2024-03-04T09:25:45.801 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.801 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v2", 2024-03-04T09:25:45.801 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "172.21.15.82:0", 2024-03-04T09:25:45.801 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 1108071936 2024-03-04T09:25:45.801 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.801 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-03-04T09:25:45.801 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.801 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.801 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "libcephsqlite", 2024-03-04T09:25:45.802 INFO:teuthology.orchestra.run.smithi082.stdout: "addrvec": [ 2024-03-04T09:25:45.802 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.802 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v2", 2024-03-04T09:25:45.802 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "172.21.15.82:0", 2024-03-04T09:25:45.802 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 383693632 2024-03-04T09:25:45.802 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.802 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-03-04T09:25:45.802 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.802 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.802 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_support", 2024-03-04T09:25:45.802 INFO:teuthology.orchestra.run.smithi082.stdout: "addrvec": [ 2024-03-04T09:25:45.802 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.802 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v2", 2024-03-04T09:25:45.803 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "172.21.15.82:0", 2024-03-04T09:25:45.803 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 2972858428 2024-03-04T09:25:45.803 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.803 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-03-04T09:25:45.803 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.803 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.803 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snap_schedule", 2024-03-04T09:25:45.803 INFO:teuthology.orchestra.run.smithi082.stdout: "addrvec": [ 2024-03-04T09:25:45.803 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.803 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v2", 2024-03-04T09:25:45.803 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "172.21.15.82:0", 2024-03-04T09:25:45.803 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 588182691 2024-03-04T09:25:45.803 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.804 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-03-04T09:25:45.804 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.804 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.804 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snap_schedule", 2024-03-04T09:25:45.804 INFO:teuthology.orchestra.run.smithi082.stdout: "addrvec": [ 2024-03-04T09:25:45.804 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.804 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v2", 2024-03-04T09:25:45.805 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "172.21.15.82:0", 2024-03-04T09:25:45.805 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 1408051375 2024-03-04T09:25:45.805 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.805 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-03-04T09:25:45.805 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:45.805 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.805 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "volumes", 2024-03-04T09:25:45.805 INFO:teuthology.orchestra.run.smithi082.stdout: "addrvec": [ 2024-03-04T09:25:45.805 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-04T09:25:45.805 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v2", 2024-03-04T09:25:45.805 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "172.21.15.82:0", 2024-03-04T09:25:45.805 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 2467971529 2024-03-04T09:25:45.806 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.806 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-03-04T09:25:45.806 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:45.806 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-03-04T09:25:45.806 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-04T09:25:45.808 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:44 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/2813767128' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-04T09:25:45.808 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:44 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/861544019' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-04T09:25:45.808 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:44 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/1477568538' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-03-04T09:25:45.808 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:44 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/2813767128' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-04T09:25:45.808 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:44 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/861544019' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-04T09:25:45.809 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:44 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/1477568538' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-03-04T09:25:45.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:44.290+0000 7f5f44955640 1 -- 172.21.15.82:0/1477568538 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f5f2c0a1ef0 msgr2=0x7f5f2c0a43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:25:45.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:44.290+0000 7f5f44955640 1 --2- 172.21.15.82:0/1477568538 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f5f2c0a1ef0 0x7f5f2c0a43b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5f30000c00 tx=0x7f5f30005fd0 comp rx=0 tx=0).stop 2024-03-04T09:25:45.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:44.290+0000 7f5f44955640 1 -- 172.21.15.82:0/1477568538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f40106660 msgr2=0x7f5f401a3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:25:45.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:44.290+0000 7f5f44955640 1 --2- 172.21.15.82:0/1477568538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f40106660 0x7f5f401a3d80 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f5f3800eb10 tx=0x7f5f3800c2d0 comp rx=0 tx=0).stop 2024-03-04T09:25:45.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:44.290+0000 7f5f44955640 1 -- 172.21.15.82:0/1477568538 shutdown_connections 2024-03-04T09:25:45.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:44.290+0000 7f5f44955640 1 --2- 172.21.15.82:0/1477568538 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f5f2c0a1ef0 0x7f5f2c0a43b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:45.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:44.290+0000 7f5f44955640 1 --2- 172.21.15.82:0/1477568538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f40106660 0x7f5f401a3d80 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:45.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:44.290+0000 7f5f44955640 1 --2- 172.21.15.82:0/1477568538 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5f40100e90 0x7f5f40199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:45.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:44.290+0000 7f5f44955640 1 --2- 172.21.15.82:0/1477568538 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f401004d0 0x7f5f40198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:25:45.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:44.290+0000 7f5f44955640 1 -- 172.21.15.82:0/1477568538 >> 172.21.15.82:0/1477568538 conn(0x7f5f400775d0 msgr2=0x7f5f400ff0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:25:45.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:44.290+0000 7f5f44955640 1 -- 172.21.15.82:0/1477568538 shutdown_connections 2024-03-04T09:25:45.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:25:44.290+0000 7f5f44955640 1 -- 172.21.15.82:0/1477568538 wait complete. 2024-03-04T09:25:45.816 DEBUG:tasks.check_counter:Getting stats from a 2024-03-04T09:25:45.817 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph daemon mds.a perf dump 2024-03-04T09:25:45.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:44 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/2813767128' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-04T09:25:45.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:44 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/861544019' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-04T09:25:45.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:44 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/1477568538' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-03-04T09:25:45.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:45 smithi190 ceph-mon[36341]: pgmap v315: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 0 B/s wr, 14 op/s 2024-03-04T09:25:45.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:45 smithi102 ceph-mon[36220]: pgmap v315: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 0 B/s wr, 14 op/s 2024-03-04T09:25:46.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:45 smithi082 ceph-mon[32880]: pgmap v315: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 0 B/s wr, 14 op/s 2024-03-04T09:25:46.067 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:25:47.836 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-04T09:25:47.836 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-0": { 2024-03-04T09:25:47.836 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 1461, 2024-03-04T09:25:47.836 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 1463, 2024-03-04T09:25:47.837 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 17973114, 2024-03-04T09:25:47.837 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 464599, 2024-03-04T09:25:47.837 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 7, 2024-03-04T09:25:47.837 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 3, 2024-03-04T09:25:47.837 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.147160452, 2024-03-04T09:25:47.837 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.047122379, 2024-03-04T09:25:47.837 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.044664226, 2024-03-04T09:25:47.837 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.042501114, 2024-03-04T09:25:47.837 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-03-04T09:25:47.837 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 1461, 2024-03-04T09:25:47.837 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.053667142, 2024-03-04T09:25:47.837 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000036733 2024-03-04T09:25:47.837 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.838 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-03-04T09:25:47.838 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:47.838 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:47.838 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:47.838 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.838 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 0, 2024-03-04T09:25:47.838 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 0 2024-03-04T09:25:47.838 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.838 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-1": { 2024-03-04T09:25:47.838 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 983, 2024-03-04T09:25:47.838 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 940, 2024-03-04T09:25:47.838 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 39588325, 2024-03-04T09:25:47.838 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 354082, 2024-03-04T09:25:47.838 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 5, 2024-03-04T09:25:47.839 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 4, 2024-03-04T09:25:47.839 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.130855989, 2024-03-04T09:25:47.839 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.033207535, 2024-03-04T09:25:47.839 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.072644881, 2024-03-04T09:25:47.839 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.028576983, 2024-03-04T09:25:47.839 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-03-04T09:25:47.839 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 940, 2024-03-04T09:25:47.839 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.035413590, 2024-03-04T09:25:47.839 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000037674 2024-03-04T09:25:47.839 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.839 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-03-04T09:25:47.839 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:47.839 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:47.839 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:47.840 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.840 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 1659936, 2024-03-04T09:25:47.840 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 127280 2024-03-04T09:25:47.840 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.840 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-2": { 2024-03-04T09:25:47.840 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 58, 2024-03-04T09:25:47.840 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 213, 2024-03-04T09:25:47.840 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 8403206, 2024-03-04T09:25:47.840 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 450608, 2024-03-04T09:25:47.840 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 7, 2024-03-04T09:25:47.840 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 5, 2024-03-04T09:25:47.840 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.020078043, 2024-03-04T09:25:47.840 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.009247788, 2024-03-04T09:25:47.841 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.007321242, 2024-03-04T09:25:47.841 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.001193263, 2024-03-04T09:25:47.841 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-03-04T09:25:47.841 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 210, 2024-03-04T09:25:47.841 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.014845374, 2024-03-04T09:25:47.841 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000070692 2024-03-04T09:25:47.841 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.841 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-03-04T09:25:47.841 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:47.841 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:47.841 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:47.841 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.841 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 320, 2024-03-04T09:25:47.842 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 432800 2024-03-04T09:25:47.842 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.842 INFO:teuthology.orchestra.run.smithi082.stdout: "cct": { 2024-03-04T09:25:47.842 INFO:teuthology.orchestra.run.smithi082.stdout: "total_workers": 1, 2024-03-04T09:25:47.842 INFO:teuthology.orchestra.run.smithi082.stdout: "unhealthy_workers": 0 2024-03-04T09:25:47.842 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.842 INFO:teuthology.orchestra.run.smithi082.stdout: "finisher-MDSRank": { 2024-03-04T09:25:47.842 INFO:teuthology.orchestra.run.smithi082.stdout: "queue_len": 0, 2024-03-04T09:25:47.842 INFO:teuthology.orchestra.run.smithi082.stdout: "complete_latency": { 2024-03-04T09:25:47.842 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 3642, 2024-03-04T09:25:47.842 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.099614949, 2024-03-04T09:25:47.842 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000027351 2024-03-04T09:25:47.842 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:47.843 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.843 INFO:teuthology.orchestra.run.smithi082.stdout: "finisher-PurgeQueue": { 2024-03-04T09:25:47.843 INFO:teuthology.orchestra.run.smithi082.stdout: "queue_len": 0, 2024-03-04T09:25:47.843 INFO:teuthology.orchestra.run.smithi082.stdout: "complete_latency": { 2024-03-04T09:25:47.843 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:47.843 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:47.843 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:47.844 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:47.844 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.844 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-03-04T09:25:47.844 INFO:teuthology.orchestra.run.smithi082.stdout: "request": 0, 2024-03-04T09:25:47.844 INFO:teuthology.orchestra.run.smithi082.stdout: "reply": 0, 2024-03-04T09:25:47.844 INFO:teuthology.orchestra.run.smithi082.stdout: "reply_latency": { 2024-03-04T09:25:47.844 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:47.844 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:47.844 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:47.844 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.844 INFO:teuthology.orchestra.run.smithi082.stdout: "slow_reply": 0, 2024-03-04T09:25:47.844 INFO:teuthology.orchestra.run.smithi082.stdout: "forward": 0, 2024-03-04T09:25:47.845 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_fetch_complete": 0, 2024-03-04T09:25:47.845 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_fetch_keys": 0, 2024-03-04T09:25:47.845 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_commit": 0, 2024-03-04T09:25:47.845 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_split": 0, 2024-03-04T09:25:47.845 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_merge": 0, 2024-03-04T09:25:47.845 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes": 11419, 2024-03-04T09:25:47.845 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_top": 0, 2024-03-04T09:25:47.845 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_bottom": 11419, 2024-03-04T09:25:47.845 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_pin_tail": 0, 2024-03-04T09:25:47.846 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_pinned": 11419, 2024-03-04T09:25:47.846 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_expired": 0, 2024-03-04T09:25:47.846 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_with_caps": 0, 2024-03-04T09:25:47.846 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": 0, 2024-03-04T09:25:47.846 INFO:teuthology.orchestra.run.smithi082.stdout: "subtrees": 1, 2024-03-04T09:25:47.846 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse": 0, 2024-03-04T09:25:47.846 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_hit": 0, 2024-03-04T09:25:47.846 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_forward": 0, 2024-03-04T09:25:47.846 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_discover": 0, 2024-03-04T09:25:47.846 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_dir_fetch": 0, 2024-03-04T09:25:47.846 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_remote_ino": 0, 2024-03-04T09:25:47.846 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_lock": 0, 2024-03-04T09:25:47.847 INFO:teuthology.orchestra.run.smithi082.stdout: "load_cent": 0, 2024-03-04T09:25:47.847 INFO:teuthology.orchestra.run.smithi082.stdout: "q": 0, 2024-03-04T09:25:47.847 INFO:teuthology.orchestra.run.smithi082.stdout: "exported": 0, 2024-03-04T09:25:47.847 INFO:teuthology.orchestra.run.smithi082.stdout: "exported_inodes": 0, 2024-03-04T09:25:47.847 INFO:teuthology.orchestra.run.smithi082.stdout: "imported": 0, 2024-03-04T09:25:47.847 INFO:teuthology.orchestra.run.smithi082.stdout: "imported_inodes": 0, 2024-03-04T09:25:47.847 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_dir_fetch": 0, 2024-03-04T09:25:47.847 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_backtrace_fetch": 0, 2024-03-04T09:25:47.847 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_peer_discover": 0, 2024-03-04T09:25:47.847 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rfiles": 0, 2024-03-04T09:25:47.847 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rbytes": 0, 2024-03-04T09:25:47.847 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rsnaps": 0, 2024-03-04T09:25:47.847 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_backtrace_fetch": 0, 2024-03-04T09:25:47.848 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_set_tag": 0, 2024-03-04T09:25:47.848 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_backtrace_repaired": 0, 2024-03-04T09:25:47.848 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_inotable_repaired": 0, 2024-03-04T09:25:47.848 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dir_inodes": 0, 2024-03-04T09:25:47.848 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dir_base_inodes": 0, 2024-03-04T09:25:47.848 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dirfrag_rstats": 0, 2024-03-04T09:25:47.848 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_file_inodes": 0, 2024-03-04T09:25:47.848 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_inode_file_caps": 0, 2024-03-04T09:25:47.848 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_revoke": 0, 2024-03-04T09:25:47.848 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_grant": 0, 2024-03-04T09:25:47.848 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_trunc": 0, 2024-03-04T09:25:47.848 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-03-04T09:25:47.848 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_flush_ack": 0, 2024-03-04T09:25:47.848 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_caps": 0, 2024-03-04T09:25:47.849 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_caps_dirty": 0, 2024-03-04T09:25:47.849 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_cap_release": 0, 2024-03-04T09:25:47.849 INFO:teuthology.orchestra.run.smithi082.stdout: "process_request_cap_release": 0 2024-03-04T09:25:47.849 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.849 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_cache": { 2024-03-04T09:25:47.849 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_update": 0, 2024-03-04T09:25:47.849 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_update_receipt": 0, 2024-03-04T09:25:47.849 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_try_discover": 0, 2024-03-04T09:25:47.849 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_send_discover": 0, 2024-03-04T09:25:47.849 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_handle_discover": 0, 2024-03-04T09:25:47.849 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays": 0, 2024-03-04T09:25:47.849 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays_delayed": 0, 2024-03-04T09:25:47.850 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays_enqueuing": 0, 2024-03-04T09:25:47.850 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_created": 0, 2024-03-04T09:25:47.850 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_enqueued": 0, 2024-03-04T09:25:47.850 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_reintegrated": 0, 2024-03-04T09:25:47.850 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_migrated": 0, 2024-03-04T09:25:47.850 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_processing": 0, 2024-03-04T09:25:47.850 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_enqueued": 0, 2024-03-04T09:25:47.850 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_prioritized": 0, 2024-03-04T09:25:47.850 INFO:teuthology.orchestra.run.smithi082.stdout: "recovery_started": 0, 2024-03-04T09:25:47.850 INFO:teuthology.orchestra.run.smithi082.stdout: "recovery_completed": 0, 2024-03-04T09:25:47.850 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_enqueue_scrub": 0, 2024-03-04T09:25:47.850 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_exportdir": 0, 2024-03-04T09:25:47.850 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_flush": 0, 2024-03-04T09:25:47.850 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_fragmentdir": 0, 2024-03-04T09:25:47.851 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_fragstats": 0, 2024-03-04T09:25:47.851 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_inodestats": 0 2024-03-04T09:25:47.851 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.851 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_log": { 2024-03-04T09:25:47.851 INFO:teuthology.orchestra.run.smithi082.stdout: "evlrg": 0, 2024-03-04T09:25:47.851 INFO:teuthology.orchestra.run.smithi082.stdout: "evadd": 0, 2024-03-04T09:25:47.851 INFO:teuthology.orchestra.run.smithi082.stdout: "evex": 0, 2024-03-04T09:25:47.851 INFO:teuthology.orchestra.run.smithi082.stdout: "evtrm": 0, 2024-03-04T09:25:47.851 INFO:teuthology.orchestra.run.smithi082.stdout: "ev": 28569, 2024-03-04T09:25:47.851 INFO:teuthology.orchestra.run.smithi082.stdout: "evexg": 0, 2024-03-04T09:25:47.851 INFO:teuthology.orchestra.run.smithi082.stdout: "evexd": 0, 2024-03-04T09:25:47.851 INFO:teuthology.orchestra.run.smithi082.stdout: "segadd": 0, 2024-03-04T09:25:47.851 INFO:teuthology.orchestra.run.smithi082.stdout: "segex": 0, 2024-03-04T09:25:47.851 INFO:teuthology.orchestra.run.smithi082.stdout: "segtrm": 0, 2024-03-04T09:25:47.851 INFO:teuthology.orchestra.run.smithi082.stdout: "seg": 39, 2024-03-04T09:25:47.852 INFO:teuthology.orchestra.run.smithi082.stdout: "segmjr": 4, 2024-03-04T09:25:47.852 INFO:teuthology.orchestra.run.smithi082.stdout: "segexg": 0, 2024-03-04T09:25:47.852 INFO:teuthology.orchestra.run.smithi082.stdout: "segexd": 0, 2024-03-04T09:25:47.852 INFO:teuthology.orchestra.run.smithi082.stdout: "expos": 4194304, 2024-03-04T09:25:47.852 INFO:teuthology.orchestra.run.smithi082.stdout: "wrpos": 67868941, 2024-03-04T09:25:47.852 INFO:teuthology.orchestra.run.smithi082.stdout: "rdpos": 67866380, 2024-03-04T09:25:47.852 INFO:teuthology.orchestra.run.smithi082.stdout: "jlat": { 2024-03-04T09:25:47.852 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:47.852 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:47.852 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:47.852 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.852 INFO:teuthology.orchestra.run.smithi082.stdout: "replayed": 28569 2024-03-04T09:25:47.852 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.852 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_mem": { 2024-03-04T09:25:47.853 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2309, 2024-03-04T09:25:47.853 INFO:teuthology.orchestra.run.smithi082.stdout: "ino+": 9645, 2024-03-04T09:25:47.853 INFO:teuthology.orchestra.run.smithi082.stdout: "ino-": 7336, 2024-03-04T09:25:47.853 INFO:teuthology.orchestra.run.smithi082.stdout: "dir": 214, 2024-03-04T09:25:47.853 INFO:teuthology.orchestra.run.smithi082.stdout: "dir+": 568, 2024-03-04T09:25:47.853 INFO:teuthology.orchestra.run.smithi082.stdout: "dir-": 354, 2024-03-04T09:25:47.853 INFO:teuthology.orchestra.run.smithi082.stdout: "dn": 11419, 2024-03-04T09:25:47.853 INFO:teuthology.orchestra.run.smithi082.stdout: "dn+": 14831, 2024-03-04T09:25:47.853 INFO:teuthology.orchestra.run.smithi082.stdout: "dn-": 3412, 2024-03-04T09:25:47.853 INFO:teuthology.orchestra.run.smithi082.stdout: "cap": 0, 2024-03-04T09:25:47.853 INFO:teuthology.orchestra.run.smithi082.stdout: "cap+": 0, 2024-03-04T09:25:47.853 INFO:teuthology.orchestra.run.smithi082.stdout: "cap-": 0, 2024-03-04T09:25:47.853 INFO:teuthology.orchestra.run.smithi082.stdout: "rss": 70416, 2024-03-04T09:25:47.853 INFO:teuthology.orchestra.run.smithi082.stdout: "heap": 215420 2024-03-04T09:25:47.854 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.854 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_server": { 2024-03-04T09:25:47.854 INFO:teuthology.orchestra.run.smithi082.stdout: "dispatch_client_request": 0, 2024-03-04T09:25:47.854 INFO:teuthology.orchestra.run.smithi082.stdout: "dispatch_server_request": 0, 2024-03-04T09:25:47.854 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_request": 0, 2024-03-04T09:25:47.854 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_session": 0, 2024-03-04T09:25:47.854 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_peer_request": 0, 2024-03-04T09:25:47.854 INFO:teuthology.orchestra.run.smithi082.stdout: "req_create_latency": { 2024-03-04T09:25:47.854 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:47.854 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:47.854 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:47.854 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.854 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getattr_latency": { 2024-03-04T09:25:47.854 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:47.855 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:47.855 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:47.855 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.855 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getfilelock_latency": { 2024-03-04T09:25:47.855 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:47.855 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:47.855 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:47.855 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.855 INFO:teuthology.orchestra.run.smithi082.stdout: "req_link_latency": { 2024-03-04T09:25:47.855 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:47.855 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:47.855 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:47.855 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.855 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookup_latency": { 2024-03-04T09:25:47.855 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:47.856 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:47.856 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:47.856 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.856 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookuphash_latency": { 2024-03-04T09:25:47.856 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:47.856 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:47.856 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:47.856 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.856 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupino_latency": { 2024-03-04T09:25:47.856 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:47.856 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:47.856 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:47.856 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.857 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupname_latency": { 2024-03-04T09:25:47.857 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:47.857 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:47.857 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:47.857 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.857 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupparent_latency": { 2024-03-04T09:25:47.857 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:47.857 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:47.857 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:47.857 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.857 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupsnap_latency": { 2024-03-04T09:25:47.857 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:47.857 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:47.857 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:47.858 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.858 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lssnap_latency": { 2024-03-04T09:25:47.858 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:47.858 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:47.858 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:47.858 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.858 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mkdir_latency": { 2024-03-04T09:25:47.858 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:47.858 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:47.859 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:47.859 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.859 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mknod_latency": { 2024-03-04T09:25:47.859 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:47.859 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:47.859 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:47.859 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.859 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mksnap_latency": { 2024-03-04T09:25:47.859 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:47.859 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:47.859 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:47.860 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.860 INFO:teuthology.orchestra.run.smithi082.stdout: "req_open_latency": { 2024-03-04T09:25:47.860 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:47.860 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:47.860 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:47.860 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.860 INFO:teuthology.orchestra.run.smithi082.stdout: "req_readdir_latency": { 2024-03-04T09:25:47.860 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:47.860 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:47.860 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:47.860 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.860 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rename_latency": { 2024-03-04T09:25:47.860 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:47.861 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:47.861 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:47.861 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.861 INFO:teuthology.orchestra.run.smithi082.stdout: "req_renamesnap_latency": { 2024-03-04T09:25:47.861 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:47.861 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:47.861 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:47.861 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.861 INFO:teuthology.orchestra.run.smithi082.stdout: "req_snapdiff_latency": { 2024-03-04T09:25:47.861 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:47.861 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:47.861 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:47.861 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.861 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmdir_latency": { 2024-03-04T09:25:47.861 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:47.862 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:47.862 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:47.862 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.862 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmsnap_latency": { 2024-03-04T09:25:47.862 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:47.862 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:47.862 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:47.862 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.862 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmxattr_latency": { 2024-03-04T09:25:47.862 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:47.863 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:47.863 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:47.863 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.863 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setattr_latency": { 2024-03-04T09:25:47.863 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:47.863 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:47.863 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:47.863 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.863 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setdirlayout_latency": { 2024-03-04T09:25:47.863 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:47.863 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:47.863 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:47.863 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.864 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setfilelock_latency": { 2024-03-04T09:25:47.864 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:47.864 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:47.864 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:47.864 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.864 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setlayout_latency": { 2024-03-04T09:25:47.864 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:47.864 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:47.864 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:47.864 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.864 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setxattr_latency": { 2024-03-04T09:25:47.864 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:47.865 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:47.865 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:47.865 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.865 INFO:teuthology.orchestra.run.smithi082.stdout: "req_symlink_latency": { 2024-03-04T09:25:47.865 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:47.865 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:47.865 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:47.865 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.865 INFO:teuthology.orchestra.run.smithi082.stdout: "req_unlink_latency": { 2024-03-04T09:25:47.865 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:47.865 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:47.865 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:47.866 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.866 INFO:teuthology.orchestra.run.smithi082.stdout: "cap_revoke_eviction": 0, 2024-03-04T09:25:47.866 INFO:teuthology.orchestra.run.smithi082.stdout: "cap_acquisition_throttle": 0, 2024-03-04T09:25:47.866 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getvxattr_latency": { 2024-03-04T09:25:47.866 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:47.866 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:47.866 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:47.866 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:47.866 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.866 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_sessions": { 2024-03-04T09:25:47.866 INFO:teuthology.orchestra.run.smithi082.stdout: "session_count": 2, 2024-03-04T09:25:47.866 INFO:teuthology.orchestra.run.smithi082.stdout: "session_add": 3, 2024-03-04T09:25:47.867 INFO:teuthology.orchestra.run.smithi082.stdout: "session_remove": 1, 2024-03-04T09:25:47.867 INFO:teuthology.orchestra.run.smithi082.stdout: "sessions_open": 3, 2024-03-04T09:25:47.867 INFO:teuthology.orchestra.run.smithi082.stdout: "sessions_stale": 0, 2024-03-04T09:25:47.867 INFO:teuthology.orchestra.run.smithi082.stdout: "total_load": 0, 2024-03-04T09:25:47.867 INFO:teuthology.orchestra.run.smithi082.stdout: "average_load": 0, 2024-03-04T09:25:47.867 INFO:teuthology.orchestra.run.smithi082.stdout: "avg_session_uptime": 2357, 2024-03-04T09:25:47.867 INFO:teuthology.orchestra.run.smithi082.stdout: "mdthresh_evicted": 0 2024-03-04T09:25:47.867 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.867 INFO:teuthology.orchestra.run.smithi082.stdout: "mempool": { 2024-03-04T09:25:47.867 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_bytes": 0, 2024-03-04T09:25:47.867 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_items": 0, 2024-03-04T09:25:47.868 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_bytes": 0, 2024-03-04T09:25:47.868 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_items": 0, 2024-03-04T09:25:47.868 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_bytes": 0, 2024-03-04T09:25:47.868 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_items": 0, 2024-03-04T09:25:47.868 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-04T09:25:47.868 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_items": 0, 2024-03-04T09:25:47.868 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-04T09:25:47.868 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_items": 0, 2024-03-04T09:25:47.868 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_bytes": 0, 2024-03-04T09:25:47.868 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_items": 0, 2024-03-04T09:25:47.868 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-04T09:25:47.869 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_items": 0, 2024-03-04T09:25:47.869 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_bytes": 0, 2024-03-04T09:25:47.869 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_items": 0, 2024-03-04T09:25:47.869 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_bytes": 0, 2024-03-04T09:25:47.869 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_items": 0, 2024-03-04T09:25:47.869 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-04T09:25:47.869 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_items": 0, 2024-03-04T09:25:47.869 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-04T09:25:47.869 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_items": 0, 2024-03-04T09:25:47.869 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_bytes": 0, 2024-03-04T09:25:47.869 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_items": 0, 2024-03-04T09:25:47.869 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_bytes": 0, 2024-03-04T09:25:47.870 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_items": 0, 2024-03-04T09:25:47.870 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-04T09:25:47.870 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_items": 0, 2024-03-04T09:25:47.870 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_bytes": 0, 2024-03-04T09:25:47.870 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_items": 0, 2024-03-04T09:25:47.870 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_bytes": 0, 2024-03-04T09:25:47.870 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_items": 0, 2024-03-04T09:25:47.870 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_bytes": 0, 2024-03-04T09:25:47.870 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_items": 0, 2024-03-04T09:25:47.870 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_bytes": 0, 2024-03-04T09:25:47.870 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_items": 0, 2024-03-04T09:25:47.871 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_bytes": 214497, 2024-03-04T09:25:47.871 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_items": 67, 2024-03-04T09:25:47.871 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_bytes": 0, 2024-03-04T09:25:47.871 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_items": 0, 2024-03-04T09:25:47.871 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_bytes": 0, 2024-03-04T09:25:47.871 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_items": 0, 2024-03-04T09:25:47.871 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_bytes": 0, 2024-03-04T09:25:47.871 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_items": 0, 2024-03-04T09:25:47.871 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_bytes": 0, 2024-03-04T09:25:47.871 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_items": 0, 2024-03-04T09:25:47.871 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_bytes": 9832, 2024-03-04T09:25:47.871 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_items": 205, 2024-03-04T09:25:47.871 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_bytes": 0, 2024-03-04T09:25:47.871 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_items": 0, 2024-03-04T09:25:47.872 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_bytes": 0, 2024-03-04T09:25:47.872 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_items": 0, 2024-03-04T09:25:47.872 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_bytes": 13276605, 2024-03-04T09:25:47.872 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_items": 121250, 2024-03-04T09:25:47.872 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_bytes": 0, 2024-03-04T09:25:47.872 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_items": 0, 2024-03-04T09:25:47.872 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_bytes": 0, 2024-03-04T09:25:47.872 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_items": 0 2024-03-04T09:25:47.872 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.872 INFO:teuthology.orchestra.run.smithi082.stdout: "objecter": { 2024-03-04T09:25:47.872 INFO:teuthology.orchestra.run.smithi082.stdout: "op_active": 0, 2024-03-04T09:25:47.872 INFO:teuthology.orchestra.run.smithi082.stdout: "op_laggy": 0, 2024-03-04T09:25:47.872 INFO:teuthology.orchestra.run.smithi082.stdout: "op_send": 2230, 2024-03-04T09:25:47.873 INFO:teuthology.orchestra.run.smithi082.stdout: "op_send_bytes": 21, 2024-03-04T09:25:47.873 INFO:teuthology.orchestra.run.smithi082.stdout: "op_resend": 3, 2024-03-04T09:25:47.873 INFO:teuthology.orchestra.run.smithi082.stdout: "op_reply": 2230, 2024-03-04T09:25:47.873 INFO:teuthology.orchestra.run.smithi082.stdout: "op_latency": { 2024-03-04T09:25:47.873 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 2230, 2024-03-04T09:25:47.873 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 1.111978244, 2024-03-04T09:25:47.873 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000498644 2024-03-04T09:25:47.873 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.873 INFO:teuthology.orchestra.run.smithi082.stdout: "op_inflight": 0, 2024-03-04T09:25:47.873 INFO:teuthology.orchestra.run.smithi082.stdout: "oplen_avg": { 2024-03-04T09:25:47.873 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 2230, 2024-03-04T09:25:47.873 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 2231 2024-03-04T09:25:47.873 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.873 INFO:teuthology.orchestra.run.smithi082.stdout: "op": 2230, 2024-03-04T09:25:47.874 INFO:teuthology.orchestra.run.smithi082.stdout: "op_r": 2230, 2024-03-04T09:25:47.874 INFO:teuthology.orchestra.run.smithi082.stdout: "op_w": 0, 2024-03-04T09:25:47.874 INFO:teuthology.orchestra.run.smithi082.stdout: "op_rmw": 0, 2024-03-04T09:25:47.874 INFO:teuthology.orchestra.run.smithi082.stdout: "op_pg": 0, 2024-03-04T09:25:47.874 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_stat": 1392, 2024-03-04T09:25:47.874 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_create": 0, 2024-03-04T09:25:47.874 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_read": 836, 2024-03-04T09:25:47.874 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_write": 0, 2024-03-04T09:25:47.874 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_writefull": 0, 2024-03-04T09:25:47.874 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_writesame": 0, 2024-03-04T09:25:47.874 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_append": 0, 2024-03-04T09:25:47.874 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_zero": 0, 2024-03-04T09:25:47.874 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_truncate": 0, 2024-03-04T09:25:47.874 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_delete": 0, 2024-03-04T09:25:47.875 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_mapext": 0, 2024-03-04T09:25:47.875 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_sparse_read": 0, 2024-03-04T09:25:47.875 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_clonerange": 0, 2024-03-04T09:25:47.875 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_getxattr": 1, 2024-03-04T09:25:47.875 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_setxattr": 0, 2024-03-04T09:25:47.875 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_cmpxattr": 0, 2024-03-04T09:25:47.875 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_rmxattr": 0, 2024-03-04T09:25:47.875 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_resetxattrs": 0, 2024-03-04T09:25:47.875 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_call": 0, 2024-03-04T09:25:47.875 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_watch": 0, 2024-03-04T09:25:47.875 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_notify": 0, 2024-03-04T09:25:47.875 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_src_cmpxattr": 0, 2024-03-04T09:25:47.875 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_pgls": 0, 2024-03-04T09:25:47.876 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_pgls_filter": 0, 2024-03-04T09:25:47.876 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_other": 0, 2024-03-04T09:25:47.876 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_active": 0, 2024-03-04T09:25:47.876 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_send": 0, 2024-03-04T09:25:47.876 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_resend": 0, 2024-03-04T09:25:47.876 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_ping": 0, 2024-03-04T09:25:47.876 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_active": 0, 2024-03-04T09:25:47.876 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_send": 0, 2024-03-04T09:25:47.876 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_resend": 0, 2024-03-04T09:25:47.876 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_active": 0, 2024-03-04T09:25:47.876 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_send": 0, 2024-03-04T09:25:47.876 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_resend": 0, 2024-03-04T09:25:47.876 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_active": 0, 2024-03-04T09:25:47.876 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_send": 0, 2024-03-04T09:25:47.876 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_resend": 0, 2024-03-04T09:25:47.877 INFO:teuthology.orchestra.run.smithi082.stdout: "command_active": 0, 2024-03-04T09:25:47.877 INFO:teuthology.orchestra.run.smithi082.stdout: "command_send": 0, 2024-03-04T09:25:47.877 INFO:teuthology.orchestra.run.smithi082.stdout: "command_resend": 0, 2024-03-04T09:25:47.877 INFO:teuthology.orchestra.run.smithi082.stdout: "map_epoch": 104, 2024-03-04T09:25:47.877 INFO:teuthology.orchestra.run.smithi082.stdout: "map_full": 0, 2024-03-04T09:25:47.877 INFO:teuthology.orchestra.run.smithi082.stdout: "map_inc": 14, 2024-03-04T09:25:47.877 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_sessions": 8, 2024-03-04T09:25:47.877 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_session_open": 8, 2024-03-04T09:25:47.877 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_session_close": 0, 2024-03-04T09:25:47.877 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_laggy": 0, 2024-03-04T09:25:47.877 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_wr": 0, 2024-03-04T09:25:47.877 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_rd": 2, 2024-03-04T09:25:47.877 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_del": 0 2024-03-04T09:25:47.878 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.878 INFO:teuthology.orchestra.run.smithi082.stdout: "oft": { 2024-03-04T09:25:47.878 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_objs": 0, 2024-03-04T09:25:47.878 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_kv_pairs": 0, 2024-03-04T09:25:47.878 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_updates": 0, 2024-03-04T09:25:47.878 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_removes": 0 2024-03-04T09:25:47.878 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.878 INFO:teuthology.orchestra.run.smithi082.stdout: "osd-slow-ops": { 2024-03-04T09:25:47.878 INFO:teuthology.orchestra.run.smithi082.stdout: "slow_ops_count": 0 2024-03-04T09:25:47.878 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.878 INFO:teuthology.orchestra.run.smithi082.stdout: "purge_queue": { 2024-03-04T09:25:47.878 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_ops": 0, 2024-03-04T09:25:47.879 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_ops_high_water": 0, 2024-03-04T09:25:47.879 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing": 0, 2024-03-04T09:25:47.879 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_high_water": 0, 2024-03-04T09:25:47.879 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executed_ops": 0, 2024-03-04T09:25:47.879 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executed": 0, 2024-03-04T09:25:47.879 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_item_in_journal": 0 2024-03-04T09:25:47.879 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.879 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-04T09:25:47.879 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-03-04T09:25:47.879 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2024-03-04T09:25:47.879 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-03-04T09:25:47.879 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 2498, 2024-03-04T09:25:47.879 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 65723358, 2024-03-04T09:25:47.879 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-03-04T09:25:47.880 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 2498, 2024-03-04T09:25:47.880 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-03-04T09:25:47.880 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-03-04T09:25:47.880 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 2498, 2024-03-04T09:25:47.880 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 65723358, 2024-03-04T09:25:47.880 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-03-04T09:25:47.880 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:47.880 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:47.880 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:47.880 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:47.880 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.880 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-objecter_bytes": { 2024-03-04T09:25:47.880 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-03-04T09:25:47.881 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2024-03-04T09:25:47.881 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-03-04T09:25:47.881 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-03-04T09:25:47.881 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-03-04T09:25:47.881 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-03-04T09:25:47.881 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-03-04T09:25:47.881 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 2230, 2024-03-04T09:25:47.881 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 63676165, 2024-03-04T09:25:47.881 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 2230, 2024-03-04T09:25:47.881 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 63676165, 2024-03-04T09:25:47.881 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-03-04T09:25:47.881 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:47.881 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:47.881 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:47.882 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:47.882 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.882 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-objecter_ops": { 2024-03-04T09:25:47.882 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-03-04T09:25:47.882 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 1024, 2024-03-04T09:25:47.882 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-03-04T09:25:47.882 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-03-04T09:25:47.882 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-03-04T09:25:47.882 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-03-04T09:25:47.882 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-03-04T09:25:47.882 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 2230, 2024-03-04T09:25:47.882 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 2230, 2024-03-04T09:25:47.883 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 2230, 2024-03-04T09:25:47.883 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 2230, 2024-03-04T09:25:47.883 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-03-04T09:25:47.883 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:47.883 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:47.883 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:47.883 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:47.883 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.883 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-write_buf_throttle": { 2024-03-04T09:25:47.883 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-03-04T09:25:47.883 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 3758096384, 2024-03-04T09:25:47.883 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-03-04T09:25:47.883 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-03-04T09:25:47.883 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-03-04T09:25:47.883 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-03-04T09:25:47.884 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-03-04T09:25:47.884 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-03-04T09:25:47.884 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-03-04T09:25:47.884 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 0, 2024-03-04T09:25:47.884 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 0, 2024-03-04T09:25:47.884 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-03-04T09:25:47.884 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:47.884 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:47.884 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:47.884 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:47.884 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:47.884 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-write_buf_throttle-0x55c85b822960": { 2024-03-04T09:25:47.884 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-03-04T09:25:47.884 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 3758096384, 2024-03-04T09:25:47.885 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-03-04T09:25:47.885 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-03-04T09:25:47.885 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-03-04T09:25:47.885 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-03-04T09:25:47.885 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-03-04T09:25:47.885 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-03-04T09:25:47.885 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-03-04T09:25:47.885 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 0, 2024-03-04T09:25:47.885 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 0, 2024-03-04T09:25:47.885 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-03-04T09:25:47.885 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:47.885 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:47.885 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:47.885 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:47.886 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:47.886 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-04T09:25:48.626 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-03-04T09:25:48.626 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-03-04T09:25:48.626 INFO:tasks.check_counter:Daemon mds.a mds.root_rsnaps=0 2024-03-04T09:25:48.627 INFO:tasks.check_counter:Daemon mds.a mds_server.req_mksnap_latency.avgcount=0 2024-03-04T09:25:48.627 INFO:tasks.check_counter:Daemon mds.a mds_server.req_rmsnap_latency.avgcount=0 2024-03-04T09:25:48.627 DEBUG:tasks.check_counter:Getting stats from d 2024-03-04T09:25:48.627 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph daemon mds.d perf dump 2024-03-04T09:25:48.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:48 smithi082 ceph-mon[32880]: pgmap v316: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-04T09:25:48.879 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:25:48.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:48 smithi190 ceph-mon[36341]: pgmap v316: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-04T09:25:48.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:48 smithi102 ceph-mon[36220]: pgmap v316: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-04T09:25:50.545 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-04T09:25:50.545 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-0": { 2024-03-04T09:25:50.545 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 222, 2024-03-04T09:25:50.545 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 212, 2024-03-04T09:25:50.545 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 1432320, 2024-03-04T09:25:50.545 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 126816, 2024-03-04T09:25:50.545 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 4, 2024-03-04T09:25:50.545 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 0, 2024-03-04T09:25:50.545 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.042368637, 2024-03-04T09:25:50.545 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.014284749, 2024-03-04T09:25:50.546 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.031491845, 2024-03-04T09:25:50.546 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.004360082, 2024-03-04T09:25:50.546 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-03-04T09:25:50.546 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 211, 2024-03-04T09:25:50.546 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.010718631, 2024-03-04T09:25:50.546 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000050799 2024-03-04T09:25:50.546 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:50.546 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-03-04T09:25:50.546 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:50.546 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:50.546 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:50.547 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:50.547 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 1432320, 2024-03-04T09:25:50.547 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 126816 2024-03-04T09:25:50.547 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:50.547 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-1": { 2024-03-04T09:25:50.547 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 6, 2024-03-04T09:25:50.547 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 164, 2024-03-04T09:25:50.547 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 3312, 2024-03-04T09:25:50.547 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 183920, 2024-03-04T09:25:50.547 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 5, 2024-03-04T09:25:50.547 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 3, 2024-03-04T09:25:50.547 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.014289627, 2024-03-04T09:25:50.548 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.009623667, 2024-03-04T09:25:50.548 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.002268123, 2024-03-04T09:25:50.548 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-04T09:25:50.548 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-03-04T09:25:50.548 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 162, 2024-03-04T09:25:50.548 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.017351189, 2024-03-04T09:25:50.548 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000107106 2024-03-04T09:25:50.548 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:50.548 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-03-04T09:25:50.548 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:50.549 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:50.549 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:50.549 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:50.549 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-03-04T09:25:50.549 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 183920 2024-03-04T09:25:50.549 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:50.549 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-2": { 2024-03-04T09:25:50.549 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 0, 2024-03-04T09:25:50.549 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 2, 2024-03-04T09:25:50.549 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 0, 2024-03-04T09:25:50.549 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 0, 2024-03-04T09:25:50.549 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 2, 2024-03-04T09:25:50.549 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 1, 2024-03-04T09:25:50.549 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.000341882, 2024-03-04T09:25:50.550 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.000000000, 2024-03-04T09:25:50.550 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.000279650, 2024-03-04T09:25:50.550 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-04T09:25:50.550 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-03-04T09:25:50.550 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:50.550 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:50.550 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:50.550 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:50.550 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-03-04T09:25:50.550 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:50.550 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:50.550 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:50.550 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:50.550 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 0, 2024-03-04T09:25:50.551 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 0 2024-03-04T09:25:50.551 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:50.551 INFO:teuthology.orchestra.run.smithi082.stdout: "cct": { 2024-03-04T09:25:50.551 INFO:teuthology.orchestra.run.smithi082.stdout: "total_workers": 0, 2024-03-04T09:25:50.551 INFO:teuthology.orchestra.run.smithi082.stdout: "unhealthy_workers": 0 2024-03-04T09:25:50.551 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:50.551 INFO:teuthology.orchestra.run.smithi082.stdout: "mempool": { 2024-03-04T09:25:50.551 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_bytes": 0, 2024-03-04T09:25:50.551 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_items": 0, 2024-03-04T09:25:50.551 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_bytes": 0, 2024-03-04T09:25:50.551 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_items": 0, 2024-03-04T09:25:50.551 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_bytes": 0, 2024-03-04T09:25:50.551 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_items": 0, 2024-03-04T09:25:50.551 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-04T09:25:50.551 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_items": 0, 2024-03-04T09:25:50.552 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-04T09:25:50.552 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_items": 0, 2024-03-04T09:25:50.552 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_bytes": 0, 2024-03-04T09:25:50.552 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_items": 0, 2024-03-04T09:25:50.552 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-04T09:25:50.553 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_items": 0, 2024-03-04T09:25:50.553 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_bytes": 0, 2024-03-04T09:25:50.553 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_items": 0, 2024-03-04T09:25:50.553 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_bytes": 0, 2024-03-04T09:25:50.553 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_items": 0, 2024-03-04T09:25:50.553 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-04T09:25:50.553 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_items": 0, 2024-03-04T09:25:50.553 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-04T09:25:50.553 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_items": 0, 2024-03-04T09:25:50.553 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_bytes": 0, 2024-03-04T09:25:50.553 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_items": 0, 2024-03-04T09:25:50.553 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_bytes": 0, 2024-03-04T09:25:50.553 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_items": 0, 2024-03-04T09:25:50.553 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-04T09:25:50.554 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_items": 0, 2024-03-04T09:25:50.554 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_bytes": 0, 2024-03-04T09:25:50.554 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_items": 0, 2024-03-04T09:25:50.554 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_bytes": 0, 2024-03-04T09:25:50.554 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_items": 0, 2024-03-04T09:25:50.554 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_bytes": 0, 2024-03-04T09:25:50.554 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_items": 0, 2024-03-04T09:25:50.554 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_bytes": 0, 2024-03-04T09:25:50.554 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_items": 0, 2024-03-04T09:25:50.554 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_bytes": 149017, 2024-03-04T09:25:50.554 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_items": 31, 2024-03-04T09:25:50.555 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_bytes": 0, 2024-03-04T09:25:50.555 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_items": 0, 2024-03-04T09:25:50.555 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_bytes": 0, 2024-03-04T09:25:50.555 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_items": 0, 2024-03-04T09:25:50.555 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_bytes": 0, 2024-03-04T09:25:50.556 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_items": 0, 2024-03-04T09:25:50.556 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_bytes": 0, 2024-03-04T09:25:50.556 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_items": 0, 2024-03-04T09:25:50.556 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_bytes": 0, 2024-03-04T09:25:50.556 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_items": 0, 2024-03-04T09:25:50.556 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_bytes": 0, 2024-03-04T09:25:50.556 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_items": 0, 2024-03-04T09:25:50.556 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_bytes": 0, 2024-03-04T09:25:50.557 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_items": 0, 2024-03-04T09:25:50.557 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_bytes": 928, 2024-03-04T09:25:50.557 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_items": 2, 2024-03-04T09:25:50.557 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_bytes": 0, 2024-03-04T09:25:50.557 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_items": 0, 2024-03-04T09:25:50.557 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_bytes": 0, 2024-03-04T09:25:50.557 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_items": 0 2024-03-04T09:25:50.557 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:50.557 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-04T09:25:50.557 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-03-04T09:25:50.557 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2024-03-04T09:25:50.557 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-03-04T09:25:50.557 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 224, 2024-03-04T09:25:50.557 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 1401009, 2024-03-04T09:25:50.558 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-03-04T09:25:50.558 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 224, 2024-03-04T09:25:50.558 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-03-04T09:25:50.558 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-03-04T09:25:50.558 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 224, 2024-03-04T09:25:50.558 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 1401009, 2024-03-04T09:25:50.558 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-03-04T09:25:50.558 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:50.558 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:50.558 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:50.558 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:50.558 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:50.558 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-04T09:25:50.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:50 smithi082 ceph-mon[32880]: pgmap v317: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-04T09:25:50.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:50 smithi190 ceph-mon[36341]: pgmap v317: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-04T09:25:50.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:50 smithi102 ceph-mon[36220]: pgmap v317: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-04T09:25:51.261 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-03-04T09:25:51.261 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-03-04T09:25:51.261 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-03-04T09:25:51.262 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-03-04T09:25:51.262 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-03-04T09:25:51.262 DEBUG:tasks.check_counter:Getting stats from g 2024-03-04T09:25:51.262 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph daemon mds.g perf dump 2024-03-04T09:25:51.506 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:25:52.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:52 smithi082 ceph-mon[32880]: pgmap v318: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 0 B/s wr, 14 op/s 2024-03-04T09:25:52.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:52 smithi190 ceph-mon[36341]: pgmap v318: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 0 B/s wr, 14 op/s 2024-03-04T09:25:52.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:52 smithi102 ceph-mon[36220]: pgmap v318: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 0 B/s wr, 14 op/s 2024-03-04T09:25:53.144 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-04T09:25:53.144 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-0": { 2024-03-04T09:25:53.144 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 735, 2024-03-04T09:25:53.144 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 737, 2024-03-04T09:25:53.144 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 246905, 2024-03-04T09:25:53.144 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 233731, 2024-03-04T09:25:53.144 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 6, 2024-03-04T09:25:53.144 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 2, 2024-03-04T09:25:53.144 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.081542961, 2024-03-04T09:25:53.144 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.035989565, 2024-03-04T09:25:53.144 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.016831517, 2024-03-04T09:25:53.145 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.019944936, 2024-03-04T09:25:53.145 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-03-04T09:25:53.145 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 735, 2024-03-04T09:25:53.145 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.035616157, 2024-03-04T09:25:53.145 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000048457 2024-03-04T09:25:53.145 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.145 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-03-04T09:25:53.145 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:53.145 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:53.145 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:53.145 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.145 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 0, 2024-03-04T09:25:53.145 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 0 2024-03-04T09:25:53.145 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.145 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-1": { 2024-03-04T09:25:53.145 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 1676, 2024-03-04T09:25:53.146 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 1635, 2024-03-04T09:25:53.146 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 8755363, 2024-03-04T09:25:53.146 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 575723, 2024-03-04T09:25:53.146 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 4, 2024-03-04T09:25:53.146 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 3, 2024-03-04T09:25:53.146 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.131473201, 2024-03-04T09:25:53.146 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.037019442, 2024-03-04T09:25:53.146 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.061298159, 2024-03-04T09:25:53.146 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.037821229, 2024-03-04T09:25:53.146 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-03-04T09:25:53.146 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 1634, 2024-03-04T09:25:53.146 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.046142351, 2024-03-04T09:25:53.146 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000028238 2024-03-04T09:25:53.147 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.147 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-03-04T09:25:53.147 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:53.147 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:53.147 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:53.147 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.147 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 1657824, 2024-03-04T09:25:53.147 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 128240 2024-03-04T09:25:53.147 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.147 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-2": { 2024-03-04T09:25:53.147 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 9, 2024-03-04T09:25:53.147 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 164, 2024-03-04T09:25:53.147 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 4660, 2024-03-04T09:25:53.147 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 436165, 2024-03-04T09:25:53.147 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 7, 2024-03-04T09:25:53.147 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 5, 2024-03-04T09:25:53.148 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.013418568, 2024-03-04T09:25:53.148 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.008469992, 2024-03-04T09:25:53.148 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.002795629, 2024-03-04T09:25:53.148 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.000068768, 2024-03-04T09:25:53.148 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-03-04T09:25:53.148 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 162, 2024-03-04T09:25:53.148 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.013046037, 2024-03-04T09:25:53.148 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000080531 2024-03-04T09:25:53.148 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.148 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-03-04T09:25:53.148 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:53.148 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:53.148 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:53.148 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.149 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-03-04T09:25:53.149 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 435200 2024-03-04T09:25:53.149 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.149 INFO:teuthology.orchestra.run.smithi082.stdout: "cct": { 2024-03-04T09:25:53.149 INFO:teuthology.orchestra.run.smithi082.stdout: "total_workers": 1, 2024-03-04T09:25:53.149 INFO:teuthology.orchestra.run.smithi082.stdout: "unhealthy_workers": 0 2024-03-04T09:25:53.149 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.149 INFO:teuthology.orchestra.run.smithi082.stdout: "finisher-MDSRank": { 2024-03-04T09:25:53.149 INFO:teuthology.orchestra.run.smithi082.stdout: "queue_len": 0, 2024-03-04T09:25:53.149 INFO:teuthology.orchestra.run.smithi082.stdout: "complete_latency": { 2024-03-04T09:25:53.149 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 3567, 2024-03-04T09:25:53.149 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.081327819, 2024-03-04T09:25:53.149 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000022800 2024-03-04T09:25:53.149 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:53.149 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.149 INFO:teuthology.orchestra.run.smithi082.stdout: "finisher-PurgeQueue": { 2024-03-04T09:25:53.150 INFO:teuthology.orchestra.run.smithi082.stdout: "queue_len": 0, 2024-03-04T09:25:53.150 INFO:teuthology.orchestra.run.smithi082.stdout: "complete_latency": { 2024-03-04T09:25:53.150 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:53.150 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:53.150 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:53.150 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:53.150 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.150 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-03-04T09:25:53.150 INFO:teuthology.orchestra.run.smithi082.stdout: "request": 0, 2024-03-04T09:25:53.150 INFO:teuthology.orchestra.run.smithi082.stdout: "reply": 0, 2024-03-04T09:25:53.150 INFO:teuthology.orchestra.run.smithi082.stdout: "reply_latency": { 2024-03-04T09:25:53.150 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:53.150 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:53.150 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:53.150 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.150 INFO:teuthology.orchestra.run.smithi082.stdout: "slow_reply": 0, 2024-03-04T09:25:53.151 INFO:teuthology.orchestra.run.smithi082.stdout: "forward": 0, 2024-03-04T09:25:53.151 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_fetch_complete": 0, 2024-03-04T09:25:53.151 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_fetch_keys": 0, 2024-03-04T09:25:53.151 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_commit": 0, 2024-03-04T09:25:53.151 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_split": 0, 2024-03-04T09:25:53.151 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_merge": 0, 2024-03-04T09:25:53.151 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes": 837, 2024-03-04T09:25:53.151 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_top": 0, 2024-03-04T09:25:53.151 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_bottom": 837, 2024-03-04T09:25:53.151 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_pin_tail": 0, 2024-03-04T09:25:53.151 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_pinned": 837, 2024-03-04T09:25:53.151 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_expired": 0, 2024-03-04T09:25:53.151 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_with_caps": 0, 2024-03-04T09:25:53.151 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": 0, 2024-03-04T09:25:53.151 INFO:teuthology.orchestra.run.smithi082.stdout: "subtrees": 1, 2024-03-04T09:25:53.151 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse": 0, 2024-03-04T09:25:53.152 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_hit": 0, 2024-03-04T09:25:53.152 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_forward": 0, 2024-03-04T09:25:53.152 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_discover": 0, 2024-03-04T09:25:53.152 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_dir_fetch": 0, 2024-03-04T09:25:53.152 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_remote_ino": 0, 2024-03-04T09:25:53.152 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_lock": 0, 2024-03-04T09:25:53.152 INFO:teuthology.orchestra.run.smithi082.stdout: "load_cent": 0, 2024-03-04T09:25:53.152 INFO:teuthology.orchestra.run.smithi082.stdout: "q": 0, 2024-03-04T09:25:53.152 INFO:teuthology.orchestra.run.smithi082.stdout: "exported": 0, 2024-03-04T09:25:53.152 INFO:teuthology.orchestra.run.smithi082.stdout: "exported_inodes": 0, 2024-03-04T09:25:53.152 INFO:teuthology.orchestra.run.smithi082.stdout: "imported": 0, 2024-03-04T09:25:53.152 INFO:teuthology.orchestra.run.smithi082.stdout: "imported_inodes": 0, 2024-03-04T09:25:53.152 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_dir_fetch": 0, 2024-03-04T09:25:53.152 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_backtrace_fetch": 0, 2024-03-04T09:25:53.152 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_peer_discover": 0, 2024-03-04T09:25:53.152 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rfiles": 0, 2024-03-04T09:25:53.153 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rbytes": 0, 2024-03-04T09:25:53.153 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rsnaps": 0, 2024-03-04T09:25:53.153 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_backtrace_fetch": 0, 2024-03-04T09:25:53.153 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_set_tag": 0, 2024-03-04T09:25:53.153 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_backtrace_repaired": 0, 2024-03-04T09:25:53.153 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_inotable_repaired": 0, 2024-03-04T09:25:53.154 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dir_inodes": 0, 2024-03-04T09:25:53.154 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dir_base_inodes": 0, 2024-03-04T09:25:53.154 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dirfrag_rstats": 0, 2024-03-04T09:25:53.154 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_file_inodes": 0, 2024-03-04T09:25:53.154 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_inode_file_caps": 0, 2024-03-04T09:25:53.154 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_revoke": 0, 2024-03-04T09:25:53.155 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_grant": 0, 2024-03-04T09:25:53.155 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_trunc": 0, 2024-03-04T09:25:53.155 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-03-04T09:25:53.155 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_flush_ack": 0, 2024-03-04T09:25:53.155 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_caps": 0, 2024-03-04T09:25:53.155 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_caps_dirty": 0, 2024-03-04T09:25:53.155 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_cap_release": 0, 2024-03-04T09:25:53.155 INFO:teuthology.orchestra.run.smithi082.stdout: "process_request_cap_release": 0 2024-03-04T09:25:53.156 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.156 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_cache": { 2024-03-04T09:25:53.156 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_update": 0, 2024-03-04T09:25:53.156 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_update_receipt": 0, 2024-03-04T09:25:53.156 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_try_discover": 0, 2024-03-04T09:25:53.156 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_send_discover": 0, 2024-03-04T09:25:53.156 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_handle_discover": 0, 2024-03-04T09:25:53.156 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays": 0, 2024-03-04T09:25:53.156 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays_delayed": 0, 2024-03-04T09:25:53.156 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays_enqueuing": 0, 2024-03-04T09:25:53.156 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_created": 0, 2024-03-04T09:25:53.156 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_enqueued": 0, 2024-03-04T09:25:53.156 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_reintegrated": 0, 2024-03-04T09:25:53.157 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_migrated": 0, 2024-03-04T09:25:53.157 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_processing": 0, 2024-03-04T09:25:53.157 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_enqueued": 0, 2024-03-04T09:25:53.157 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_prioritized": 0, 2024-03-04T09:25:53.157 INFO:teuthology.orchestra.run.smithi082.stdout: "recovery_started": 0, 2024-03-04T09:25:53.157 INFO:teuthology.orchestra.run.smithi082.stdout: "recovery_completed": 0, 2024-03-04T09:25:53.157 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_enqueue_scrub": 0, 2024-03-04T09:25:53.157 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_exportdir": 0, 2024-03-04T09:25:53.157 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_flush": 0, 2024-03-04T09:25:53.157 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_fragmentdir": 0, 2024-03-04T09:25:53.157 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_fragstats": 0, 2024-03-04T09:25:53.157 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_inodestats": 0 2024-03-04T09:25:53.157 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.157 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_log": { 2024-03-04T09:25:53.158 INFO:teuthology.orchestra.run.smithi082.stdout: "evlrg": 0, 2024-03-04T09:25:53.158 INFO:teuthology.orchestra.run.smithi082.stdout: "evadd": 0, 2024-03-04T09:25:53.158 INFO:teuthology.orchestra.run.smithi082.stdout: "evex": 0, 2024-03-04T09:25:53.158 INFO:teuthology.orchestra.run.smithi082.stdout: "evtrm": 0, 2024-03-04T09:25:53.158 INFO:teuthology.orchestra.run.smithi082.stdout: "ev": 4756, 2024-03-04T09:25:53.158 INFO:teuthology.orchestra.run.smithi082.stdout: "evexg": 0, 2024-03-04T09:25:53.158 INFO:teuthology.orchestra.run.smithi082.stdout: "evexd": 0, 2024-03-04T09:25:53.158 INFO:teuthology.orchestra.run.smithi082.stdout: "segadd": 0, 2024-03-04T09:25:53.158 INFO:teuthology.orchestra.run.smithi082.stdout: "segex": 0, 2024-03-04T09:25:53.159 INFO:teuthology.orchestra.run.smithi082.stdout: "segtrm": 0, 2024-03-04T09:25:53.159 INFO:teuthology.orchestra.run.smithi082.stdout: "seg": 7, 2024-03-04T09:25:53.159 INFO:teuthology.orchestra.run.smithi082.stdout: "segmjr": 2, 2024-03-04T09:25:53.159 INFO:teuthology.orchestra.run.smithi082.stdout: "segexg": 0, 2024-03-04T09:25:53.159 INFO:teuthology.orchestra.run.smithi082.stdout: "segexd": 0, 2024-03-04T09:25:53.159 INFO:teuthology.orchestra.run.smithi082.stdout: "expos": 4194304, 2024-03-04T09:25:53.159 INFO:teuthology.orchestra.run.smithi082.stdout: "wrpos": 10933881, 2024-03-04T09:25:53.159 INFO:teuthology.orchestra.run.smithi082.stdout: "rdpos": 10933282, 2024-03-04T09:25:53.160 INFO:teuthology.orchestra.run.smithi082.stdout: "jlat": { 2024-03-04T09:25:53.160 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:53.160 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:53.160 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:53.160 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.160 INFO:teuthology.orchestra.run.smithi082.stdout: "replayed": 4756 2024-03-04T09:25:53.160 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.160 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_mem": { 2024-03-04T09:25:53.160 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 22, 2024-03-04T09:25:53.160 INFO:teuthology.orchestra.run.smithi082.stdout: "ino+": 1033, 2024-03-04T09:25:53.160 INFO:teuthology.orchestra.run.smithi082.stdout: "ino-": 1011, 2024-03-04T09:25:53.160 INFO:teuthology.orchestra.run.smithi082.stdout: "dir": 9, 2024-03-04T09:25:53.160 INFO:teuthology.orchestra.run.smithi082.stdout: "dir+": 132, 2024-03-04T09:25:53.161 INFO:teuthology.orchestra.run.smithi082.stdout: "dir-": 123, 2024-03-04T09:25:53.161 INFO:teuthology.orchestra.run.smithi082.stdout: "dn": 837, 2024-03-04T09:25:53.161 INFO:teuthology.orchestra.run.smithi082.stdout: "dn+": 1701, 2024-03-04T09:25:53.161 INFO:teuthology.orchestra.run.smithi082.stdout: "dn-": 864, 2024-03-04T09:25:53.161 INFO:teuthology.orchestra.run.smithi082.stdout: "cap": 0, 2024-03-04T09:25:53.161 INFO:teuthology.orchestra.run.smithi082.stdout: "cap+": 0, 2024-03-04T09:25:53.161 INFO:teuthology.orchestra.run.smithi082.stdout: "cap-": 0, 2024-03-04T09:25:53.161 INFO:teuthology.orchestra.run.smithi082.stdout: "rss": 52152, 2024-03-04T09:25:53.161 INFO:teuthology.orchestra.run.smithi082.stdout: "heap": 215420 2024-03-04T09:25:53.162 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.162 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_server": { 2024-03-04T09:25:53.162 INFO:teuthology.orchestra.run.smithi082.stdout: "dispatch_client_request": 0, 2024-03-04T09:25:53.162 INFO:teuthology.orchestra.run.smithi082.stdout: "dispatch_server_request": 0, 2024-03-04T09:25:53.162 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_request": 0, 2024-03-04T09:25:53.162 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_session": 0, 2024-03-04T09:25:53.162 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_peer_request": 0, 2024-03-04T09:25:53.162 INFO:teuthology.orchestra.run.smithi082.stdout: "req_create_latency": { 2024-03-04T09:25:53.162 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:53.162 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:53.162 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:53.162 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.162 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getattr_latency": { 2024-03-04T09:25:53.162 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:53.162 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:53.162 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:53.163 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.163 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getfilelock_latency": { 2024-03-04T09:25:53.163 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:53.163 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:53.163 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:53.163 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.163 INFO:teuthology.orchestra.run.smithi082.stdout: "req_link_latency": { 2024-03-04T09:25:53.163 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:53.164 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:53.164 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:53.164 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.164 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookup_latency": { 2024-03-04T09:25:53.164 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:53.164 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:53.164 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:53.164 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.165 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookuphash_latency": { 2024-03-04T09:25:53.165 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:53.165 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:53.165 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:53.165 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.165 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupino_latency": { 2024-03-04T09:25:53.165 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:53.166 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:53.166 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:53.166 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.166 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupname_latency": { 2024-03-04T09:25:53.166 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:53.166 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:53.166 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:53.166 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.166 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupparent_latency": { 2024-03-04T09:25:53.167 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:53.167 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:53.167 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:53.167 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.167 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupsnap_latency": { 2024-03-04T09:25:53.167 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:53.167 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:53.167 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:53.168 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.168 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lssnap_latency": { 2024-03-04T09:25:53.168 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:53.168 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:53.168 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:53.168 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.168 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mkdir_latency": { 2024-03-04T09:25:53.168 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:53.168 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:53.169 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:53.169 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.169 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mknod_latency": { 2024-03-04T09:25:53.169 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:53.169 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:53.170 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:53.170 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.170 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mksnap_latency": { 2024-03-04T09:25:53.170 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:53.170 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:53.170 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:53.170 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.170 INFO:teuthology.orchestra.run.smithi082.stdout: "req_open_latency": { 2024-03-04T09:25:53.170 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:53.170 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:53.170 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:53.170 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.170 INFO:teuthology.orchestra.run.smithi082.stdout: "req_readdir_latency": { 2024-03-04T09:25:53.171 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:53.171 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:53.171 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:53.171 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.171 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rename_latency": { 2024-03-04T09:25:53.171 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:53.171 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:53.171 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:53.171 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.171 INFO:teuthology.orchestra.run.smithi082.stdout: "req_renamesnap_latency": { 2024-03-04T09:25:53.171 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:53.171 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:53.171 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:53.171 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.171 INFO:teuthology.orchestra.run.smithi082.stdout: "req_snapdiff_latency": { 2024-03-04T09:25:53.172 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:53.172 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:53.172 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:53.172 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.172 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmdir_latency": { 2024-03-04T09:25:53.172 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:53.172 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:53.172 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:53.172 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.172 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmsnap_latency": { 2024-03-04T09:25:53.173 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:53.173 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:53.173 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:53.173 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.173 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmxattr_latency": { 2024-03-04T09:25:53.173 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:53.173 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:53.173 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:53.173 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.173 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setattr_latency": { 2024-03-04T09:25:53.174 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:53.174 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:53.174 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:53.174 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.174 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setdirlayout_latency": { 2024-03-04T09:25:53.174 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:53.174 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:53.174 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:53.174 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.174 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setfilelock_latency": { 2024-03-04T09:25:53.174 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:53.174 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:53.174 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:53.174 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.174 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setlayout_latency": { 2024-03-04T09:25:53.175 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:53.175 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:53.175 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:53.175 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.175 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setxattr_latency": { 2024-03-04T09:25:53.175 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:53.175 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:53.175 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:53.175 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.175 INFO:teuthology.orchestra.run.smithi082.stdout: "req_symlink_latency": { 2024-03-04T09:25:53.175 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:53.175 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:53.175 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:53.175 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.176 INFO:teuthology.orchestra.run.smithi082.stdout: "req_unlink_latency": { 2024-03-04T09:25:53.176 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:53.176 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:53.176 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:53.176 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.176 INFO:teuthology.orchestra.run.smithi082.stdout: "cap_revoke_eviction": 0, 2024-03-04T09:25:53.176 INFO:teuthology.orchestra.run.smithi082.stdout: "cap_acquisition_throttle": 0, 2024-03-04T09:25:53.176 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getvxattr_latency": { 2024-03-04T09:25:53.176 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:53.176 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:53.176 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:53.176 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:53.176 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.176 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_sessions": { 2024-03-04T09:25:53.177 INFO:teuthology.orchestra.run.smithi082.stdout: "session_count": 1, 2024-03-04T09:25:53.177 INFO:teuthology.orchestra.run.smithi082.stdout: "session_add": 2, 2024-03-04T09:25:53.177 INFO:teuthology.orchestra.run.smithi082.stdout: "session_remove": 1, 2024-03-04T09:25:53.177 INFO:teuthology.orchestra.run.smithi082.stdout: "sessions_open": 2, 2024-03-04T09:25:53.177 INFO:teuthology.orchestra.run.smithi082.stdout: "sessions_stale": 0, 2024-03-04T09:25:53.177 INFO:teuthology.orchestra.run.smithi082.stdout: "total_load": 0, 2024-03-04T09:25:53.177 INFO:teuthology.orchestra.run.smithi082.stdout: "average_load": 0, 2024-03-04T09:25:53.177 INFO:teuthology.orchestra.run.smithi082.stdout: "avg_session_uptime": 2942, 2024-03-04T09:25:53.177 INFO:teuthology.orchestra.run.smithi082.stdout: "mdthresh_evicted": 0 2024-03-04T09:25:53.177 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.177 INFO:teuthology.orchestra.run.smithi082.stdout: "mempool": { 2024-03-04T09:25:53.177 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_bytes": 0, 2024-03-04T09:25:53.177 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_items": 0, 2024-03-04T09:25:53.177 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_bytes": 0, 2024-03-04T09:25:53.177 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_items": 0, 2024-03-04T09:25:53.178 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_bytes": 0, 2024-03-04T09:25:53.178 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_items": 0, 2024-03-04T09:25:53.178 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-04T09:25:53.178 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_items": 0, 2024-03-04T09:25:53.178 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-04T09:25:53.178 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_items": 0, 2024-03-04T09:25:53.178 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_bytes": 0, 2024-03-04T09:25:53.178 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_items": 0, 2024-03-04T09:25:53.178 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-04T09:25:53.178 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_items": 0, 2024-03-04T09:25:53.178 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_bytes": 0, 2024-03-04T09:25:53.178 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_items": 0, 2024-03-04T09:25:53.179 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_bytes": 0, 2024-03-04T09:25:53.179 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_items": 0, 2024-03-04T09:25:53.179 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-04T09:25:53.179 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_items": 0, 2024-03-04T09:25:53.179 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-04T09:25:53.179 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_items": 0, 2024-03-04T09:25:53.180 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_bytes": 0, 2024-03-04T09:25:53.180 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_items": 0, 2024-03-04T09:25:53.180 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_bytes": 0, 2024-03-04T09:25:53.180 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_items": 0, 2024-03-04T09:25:53.180 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-04T09:25:53.180 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_items": 0, 2024-03-04T09:25:53.180 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_bytes": 0, 2024-03-04T09:25:53.180 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_items": 0, 2024-03-04T09:25:53.181 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_bytes": 0, 2024-03-04T09:25:53.181 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_items": 0, 2024-03-04T09:25:53.181 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_bytes": 0, 2024-03-04T09:25:53.181 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_items": 0, 2024-03-04T09:25:53.181 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_bytes": 0, 2024-03-04T09:25:53.181 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_items": 0, 2024-03-04T09:25:53.181 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_bytes": 197490, 2024-03-04T09:25:53.181 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_items": 56, 2024-03-04T09:25:53.181 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_bytes": 0, 2024-03-04T09:25:53.181 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_items": 0, 2024-03-04T09:25:53.181 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_bytes": 0, 2024-03-04T09:25:53.181 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_items": 0, 2024-03-04T09:25:53.181 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_bytes": 0, 2024-03-04T09:25:53.181 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_items": 0, 2024-03-04T09:25:53.181 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_bytes": 0, 2024-03-04T09:25:53.181 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_items": 0, 2024-03-04T09:25:53.182 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_bytes": 9832, 2024-03-04T09:25:53.182 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_items": 205, 2024-03-04T09:25:53.182 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_bytes": 0, 2024-03-04T09:25:53.182 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_items": 0, 2024-03-04T09:25:53.182 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_bytes": 0, 2024-03-04T09:25:53.182 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_items": 0, 2024-03-04T09:25:53.182 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_bytes": 657787, 2024-03-04T09:25:53.182 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_items": 3967, 2024-03-04T09:25:53.182 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_bytes": 0, 2024-03-04T09:25:53.182 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_items": 0, 2024-03-04T09:25:53.182 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_bytes": 0, 2024-03-04T09:25:53.182 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_items": 0 2024-03-04T09:25:53.183 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.183 INFO:teuthology.orchestra.run.smithi082.stdout: "objecter": { 2024-03-04T09:25:53.183 INFO:teuthology.orchestra.run.smithi082.stdout: "op_active": 0, 2024-03-04T09:25:53.183 INFO:teuthology.orchestra.run.smithi082.stdout: "op_laggy": 0, 2024-03-04T09:25:53.183 INFO:teuthology.orchestra.run.smithi082.stdout: "op_send": 2145, 2024-03-04T09:25:53.183 INFO:teuthology.orchestra.run.smithi082.stdout: "op_send_bytes": 21, 2024-03-04T09:25:53.184 INFO:teuthology.orchestra.run.smithi082.stdout: "op_resend": 3, 2024-03-04T09:25:53.184 INFO:teuthology.orchestra.run.smithi082.stdout: "op_reply": 2145, 2024-03-04T09:25:53.184 INFO:teuthology.orchestra.run.smithi082.stdout: "op_latency": { 2024-03-04T09:25:53.184 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 2145, 2024-03-04T09:25:53.184 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.851983352, 2024-03-04T09:25:53.185 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000397195 2024-03-04T09:25:53.185 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.185 INFO:teuthology.orchestra.run.smithi082.stdout: "op_inflight": 0, 2024-03-04T09:25:53.185 INFO:teuthology.orchestra.run.smithi082.stdout: "oplen_avg": { 2024-03-04T09:25:53.185 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 2145, 2024-03-04T09:25:53.185 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 2146 2024-03-04T09:25:53.185 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.185 INFO:teuthology.orchestra.run.smithi082.stdout: "op": 2145, 2024-03-04T09:25:53.185 INFO:teuthology.orchestra.run.smithi082.stdout: "op_r": 2145, 2024-03-04T09:25:53.185 INFO:teuthology.orchestra.run.smithi082.stdout: "op_w": 0, 2024-03-04T09:25:53.185 INFO:teuthology.orchestra.run.smithi082.stdout: "op_rmw": 0, 2024-03-04T09:25:53.185 INFO:teuthology.orchestra.run.smithi082.stdout: "op_pg": 0, 2024-03-04T09:25:53.185 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_stat": 1356, 2024-03-04T09:25:53.185 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_create": 0, 2024-03-04T09:25:53.186 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_read": 787, 2024-03-04T09:25:53.186 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_write": 0, 2024-03-04T09:25:53.186 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_writefull": 0, 2024-03-04T09:25:53.186 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_writesame": 0, 2024-03-04T09:25:53.186 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_append": 0, 2024-03-04T09:25:53.186 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_zero": 0, 2024-03-04T09:25:53.186 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_truncate": 0, 2024-03-04T09:25:53.186 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_delete": 0, 2024-03-04T09:25:53.186 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_mapext": 0, 2024-03-04T09:25:53.186 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_sparse_read": 0, 2024-03-04T09:25:53.186 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_clonerange": 0, 2024-03-04T09:25:53.186 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_getxattr": 1, 2024-03-04T09:25:53.186 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_setxattr": 0, 2024-03-04T09:25:53.186 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_cmpxattr": 0, 2024-03-04T09:25:53.187 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_rmxattr": 0, 2024-03-04T09:25:53.187 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_resetxattrs": 0, 2024-03-04T09:25:53.187 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_call": 0, 2024-03-04T09:25:53.187 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_watch": 0, 2024-03-04T09:25:53.187 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_notify": 0, 2024-03-04T09:25:53.187 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_src_cmpxattr": 0, 2024-03-04T09:25:53.187 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_pgls": 0, 2024-03-04T09:25:53.187 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_pgls_filter": 0, 2024-03-04T09:25:53.187 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_other": 0, 2024-03-04T09:25:53.187 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_active": 0, 2024-03-04T09:25:53.187 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_send": 0, 2024-03-04T09:25:53.187 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_resend": 0, 2024-03-04T09:25:53.187 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_ping": 0, 2024-03-04T09:25:53.187 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_active": 0, 2024-03-04T09:25:53.188 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_send": 0, 2024-03-04T09:25:53.188 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_resend": 0, 2024-03-04T09:25:53.188 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_active": 0, 2024-03-04T09:25:53.188 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_send": 0, 2024-03-04T09:25:53.188 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_resend": 0, 2024-03-04T09:25:53.188 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_active": 0, 2024-03-04T09:25:53.188 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_send": 0, 2024-03-04T09:25:53.188 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_resend": 0, 2024-03-04T09:25:53.188 INFO:teuthology.orchestra.run.smithi082.stdout: "command_active": 0, 2024-03-04T09:25:53.188 INFO:teuthology.orchestra.run.smithi082.stdout: "command_send": 0, 2024-03-04T09:25:53.188 INFO:teuthology.orchestra.run.smithi082.stdout: "command_resend": 0, 2024-03-04T09:25:53.188 INFO:teuthology.orchestra.run.smithi082.stdout: "map_epoch": 104, 2024-03-04T09:25:53.188 INFO:teuthology.orchestra.run.smithi082.stdout: "map_full": 0, 2024-03-04T09:25:53.188 INFO:teuthology.orchestra.run.smithi082.stdout: "map_inc": 14, 2024-03-04T09:25:53.188 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_sessions": 6, 2024-03-04T09:25:53.189 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_session_open": 6, 2024-03-04T09:25:53.189 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_session_close": 0, 2024-03-04T09:25:53.189 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_laggy": 0, 2024-03-04T09:25:53.189 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_wr": 0, 2024-03-04T09:25:53.189 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_rd": 2, 2024-03-04T09:25:53.189 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_del": 0 2024-03-04T09:25:53.190 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.190 INFO:teuthology.orchestra.run.smithi082.stdout: "oft": { 2024-03-04T09:25:53.190 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_objs": 0, 2024-03-04T09:25:53.190 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_kv_pairs": 0, 2024-03-04T09:25:53.190 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_updates": 0, 2024-03-04T09:25:53.190 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_removes": 0 2024-03-04T09:25:53.190 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.190 INFO:teuthology.orchestra.run.smithi082.stdout: "osd-slow-ops": { 2024-03-04T09:25:53.190 INFO:teuthology.orchestra.run.smithi082.stdout: "slow_ops_count": 0 2024-03-04T09:25:53.190 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.190 INFO:teuthology.orchestra.run.smithi082.stdout: "purge_queue": { 2024-03-04T09:25:53.191 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_ops": 0, 2024-03-04T09:25:53.191 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_ops_high_water": 0, 2024-03-04T09:25:53.191 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing": 0, 2024-03-04T09:25:53.191 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_high_water": 0, 2024-03-04T09:25:53.191 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executed_ops": 0, 2024-03-04T09:25:53.191 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executed": 0, 2024-03-04T09:25:53.191 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_item_in_journal": 0 2024-03-04T09:25:53.191 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.192 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-04T09:25:53.192 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-03-04T09:25:53.192 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2024-03-04T09:25:53.192 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-03-04T09:25:53.192 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 2416, 2024-03-04T09:25:53.192 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 8772865, 2024-03-04T09:25:53.192 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-03-04T09:25:53.192 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 2416, 2024-03-04T09:25:53.192 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-03-04T09:25:53.192 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-03-04T09:25:53.192 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 2416, 2024-03-04T09:25:53.192 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 8772865, 2024-03-04T09:25:53.192 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-03-04T09:25:53.192 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:53.193 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:53.193 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:53.193 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:53.193 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.193 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-objecter_bytes": { 2024-03-04T09:25:53.193 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-03-04T09:25:53.193 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2024-03-04T09:25:53.193 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-03-04T09:25:53.194 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-03-04T09:25:53.194 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-03-04T09:25:53.194 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-03-04T09:25:53.194 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-03-04T09:25:53.194 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 2145, 2024-03-04T09:25:53.194 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 6739582, 2024-03-04T09:25:53.194 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 2145, 2024-03-04T09:25:53.194 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 6739582, 2024-03-04T09:25:53.194 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-03-04T09:25:53.194 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:53.194 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:53.194 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:53.194 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:53.194 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.195 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-objecter_ops": { 2024-03-04T09:25:53.195 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-03-04T09:25:53.195 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 1024, 2024-03-04T09:25:53.195 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-03-04T09:25:53.195 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-03-04T09:25:53.195 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-03-04T09:25:53.195 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-03-04T09:25:53.195 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-03-04T09:25:53.195 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 2145, 2024-03-04T09:25:53.195 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 2145, 2024-03-04T09:25:53.195 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 2145, 2024-03-04T09:25:53.195 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 2145, 2024-03-04T09:25:53.195 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-03-04T09:25:53.195 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:53.195 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:53.196 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:53.196 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:53.196 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.196 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-write_buf_throttle": { 2024-03-04T09:25:53.196 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-03-04T09:25:53.196 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 3758096384, 2024-03-04T09:25:53.196 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-03-04T09:25:53.196 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-03-04T09:25:53.197 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-03-04T09:25:53.197 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-03-04T09:25:53.197 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-03-04T09:25:53.197 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-03-04T09:25:53.197 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-03-04T09:25:53.197 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 0, 2024-03-04T09:25:53.197 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 0, 2024-03-04T09:25:53.197 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-03-04T09:25:53.197 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:53.197 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:53.198 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:53.198 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:53.198 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:53.198 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-write_buf_throttle-0x561e9ee26960": { 2024-03-04T09:25:53.198 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-03-04T09:25:53.198 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 3758096384, 2024-03-04T09:25:53.198 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-03-04T09:25:53.198 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-03-04T09:25:53.199 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-03-04T09:25:53.199 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-03-04T09:25:53.199 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-03-04T09:25:53.199 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-03-04T09:25:53.199 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-03-04T09:25:53.199 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 0, 2024-03-04T09:25:53.199 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 0, 2024-03-04T09:25:53.199 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-03-04T09:25:53.200 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:53.200 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:53.200 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:53.200 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:53.200 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:53.200 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-04T09:25:53.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:53 smithi082 ceph-mon[32880]: pgmap v319: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-04T09:25:53.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:53 smithi190 ceph-mon[36341]: pgmap v319: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-04T09:25:53.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:53 smithi102 ceph-mon[36220]: pgmap v319: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-04T09:25:53.985 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-03-04T09:25:53.985 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-03-04T09:25:53.985 INFO:tasks.check_counter:Daemon mds.g mds.root_rsnaps=0 2024-03-04T09:25:53.985 INFO:tasks.check_counter:Daemon mds.g mds_server.req_mksnap_latency.avgcount=0 2024-03-04T09:25:53.986 INFO:tasks.check_counter:Daemon mds.g mds_server.req_rmsnap_latency.avgcount=0 2024-03-04T09:25:53.986 DEBUG:tasks.check_counter:Getting stats from j 2024-03-04T09:25:53.986 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph daemon mds.j perf dump 2024-03-04T09:25:54.246 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.a/config 2024-03-04T09:25:54.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:54 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:25:54.924 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:54 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:25:54.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:54 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-04T09:25:56.391 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:56 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:25:56.391 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:56 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:25:56.391 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:56 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:25:56.391 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:56 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:25:56.391 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:56 smithi082 ceph-mon[32880]: pgmap v320: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 0 B/s wr, 14 op/s 2024-03-04T09:25:56.391 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:56 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:25:56.391 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:56 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:25:56.391 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:56 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:25:56.391 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:56 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:25:56.392 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:56 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:25:56.392 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:56 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:25:56.392 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:56 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:25:56.392 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:56 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:25:56.654 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-04T09:25:56.654 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-0": { 2024-03-04T09:25:56.654 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 229, 2024-03-04T09:25:56.654 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 217, 2024-03-04T09:25:56.654 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 1436128, 2024-03-04T09:25:56.654 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 129136, 2024-03-04T09:25:56.654 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 4, 2024-03-04T09:25:56.654 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 0, 2024-03-04T09:25:56.654 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.045834944, 2024-03-04T09:25:56.654 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.014479715, 2024-03-04T09:25:56.655 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.033724877, 2024-03-04T09:25:56.655 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.004351188, 2024-03-04T09:25:56.655 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-03-04T09:25:56.655 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 217, 2024-03-04T09:25:56.655 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.011544480, 2024-03-04T09:25:56.655 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000053200 2024-03-04T09:25:56.655 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:56.655 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-03-04T09:25:56.655 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:56.655 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:56.655 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:56.655 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:56.655 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 1436128, 2024-03-04T09:25:56.655 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 129136 2024-03-04T09:25:56.656 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:56.656 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-1": { 2024-03-04T09:25:56.656 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 2, 2024-03-04T09:25:56.656 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 164, 2024-03-04T09:25:56.656 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 320, 2024-03-04T09:25:56.656 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 183824, 2024-03-04T09:25:56.656 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 5, 2024-03-04T09:25:56.656 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 3, 2024-03-04T09:25:56.656 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.013723597, 2024-03-04T09:25:56.656 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.009571137, 2024-03-04T09:25:56.656 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.001723345, 2024-03-04T09:25:56.656 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-04T09:25:56.656 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-03-04T09:25:56.656 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 161, 2024-03-04T09:25:56.656 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.017190258, 2024-03-04T09:25:56.657 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000106771 2024-03-04T09:25:56.657 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:56.657 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-03-04T09:25:56.657 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:56.657 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:56.657 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:56.657 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:56.657 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 320, 2024-03-04T09:25:56.657 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 183824 2024-03-04T09:25:56.657 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:56.657 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-2": { 2024-03-04T09:25:56.657 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 0, 2024-03-04T09:25:56.657 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 2, 2024-03-04T09:25:56.657 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 0, 2024-03-04T09:25:56.657 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 0, 2024-03-04T09:25:56.658 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 2, 2024-03-04T09:25:56.658 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 1, 2024-03-04T09:25:56.658 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.000232510, 2024-03-04T09:25:56.658 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.000000000, 2024-03-04T09:25:56.658 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.000158834, 2024-03-04T09:25:56.658 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-04T09:25:56.658 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-03-04T09:25:56.658 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:56.658 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:56.658 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:56.658 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:56.658 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-03-04T09:25:56.658 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:56.658 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:56.659 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:56.659 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:56.659 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 0, 2024-03-04T09:25:56.659 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 0 2024-03-04T09:25:56.659 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:56.659 INFO:teuthology.orchestra.run.smithi082.stdout: "cct": { 2024-03-04T09:25:56.659 INFO:teuthology.orchestra.run.smithi082.stdout: "total_workers": 0, 2024-03-04T09:25:56.659 INFO:teuthology.orchestra.run.smithi082.stdout: "unhealthy_workers": 0 2024-03-04T09:25:56.659 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:56.659 INFO:teuthology.orchestra.run.smithi082.stdout: "mempool": { 2024-03-04T09:25:56.659 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_bytes": 0, 2024-03-04T09:25:56.659 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_items": 0, 2024-03-04T09:25:56.659 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_bytes": 0, 2024-03-04T09:25:56.659 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_items": 0, 2024-03-04T09:25:56.659 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_bytes": 0, 2024-03-04T09:25:56.659 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_items": 0, 2024-03-04T09:25:56.660 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-04T09:25:56.660 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_items": 0, 2024-03-04T09:25:56.660 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-04T09:25:56.660 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_items": 0, 2024-03-04T09:25:56.660 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_bytes": 0, 2024-03-04T09:25:56.660 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_items": 0, 2024-03-04T09:25:56.660 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-04T09:25:56.660 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_items": 0, 2024-03-04T09:25:56.660 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_bytes": 0, 2024-03-04T09:25:56.660 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_items": 0, 2024-03-04T09:25:56.660 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_bytes": 0, 2024-03-04T09:25:56.660 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_items": 0, 2024-03-04T09:25:56.660 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-04T09:25:56.660 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_items": 0, 2024-03-04T09:25:56.660 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-04T09:25:56.661 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_items": 0, 2024-03-04T09:25:56.661 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_bytes": 0, 2024-03-04T09:25:56.661 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_items": 0, 2024-03-04T09:25:56.661 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_bytes": 0, 2024-03-04T09:25:56.661 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_items": 0, 2024-03-04T09:25:56.661 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-04T09:25:56.661 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_items": 0, 2024-03-04T09:25:56.661 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_bytes": 0, 2024-03-04T09:25:56.661 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_items": 0, 2024-03-04T09:25:56.661 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_bytes": 0, 2024-03-04T09:25:56.661 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_items": 0, 2024-03-04T09:25:56.661 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_bytes": 0, 2024-03-04T09:25:56.661 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_items": 0, 2024-03-04T09:25:56.661 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_bytes": 0, 2024-03-04T09:25:56.661 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_items": 0, 2024-03-04T09:25:56.661 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_bytes": 148754, 2024-03-04T09:25:56.662 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_items": 31, 2024-03-04T09:25:56.662 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_bytes": 0, 2024-03-04T09:25:56.662 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_items": 0, 2024-03-04T09:25:56.662 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_bytes": 0, 2024-03-04T09:25:56.662 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_items": 0, 2024-03-04T09:25:56.662 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_bytes": 0, 2024-03-04T09:25:56.662 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_items": 0, 2024-03-04T09:25:56.662 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_bytes": 0, 2024-03-04T09:25:56.662 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_items": 0, 2024-03-04T09:25:56.662 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_bytes": 0, 2024-03-04T09:25:56.662 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_items": 0, 2024-03-04T09:25:56.662 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_bytes": 0, 2024-03-04T09:25:56.662 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_items": 0, 2024-03-04T09:25:56.662 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_bytes": 0, 2024-03-04T09:25:56.663 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_items": 0, 2024-03-04T09:25:56.663 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_bytes": 928, 2024-03-04T09:25:56.663 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_items": 2, 2024-03-04T09:25:56.663 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_bytes": 0, 2024-03-04T09:25:56.663 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_items": 0, 2024-03-04T09:25:56.663 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_bytes": 0, 2024-03-04T09:25:56.663 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_items": 0 2024-03-04T09:25:56.663 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-04T09:25:56.663 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-04T09:25:56.663 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-03-04T09:25:56.663 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2024-03-04T09:25:56.663 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-03-04T09:25:56.663 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 227, 2024-03-04T09:25:56.663 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 1401399, 2024-03-04T09:25:56.663 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-03-04T09:25:56.663 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 227, 2024-03-04T09:25:56.664 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-03-04T09:25:56.664 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-03-04T09:25:56.664 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 227, 2024-03-04T09:25:56.664 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 1401399, 2024-03-04T09:25:56.664 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-03-04T09:25:56.664 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-04T09:25:56.664 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-04T09:25:56.664 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-04T09:25:56.664 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:56.664 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-04T09:25:56.664 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-04T09:25:56.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:56 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:25:56.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:56 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:25:56.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:56 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:25:56.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:56 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:25:56.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:56 smithi190 ceph-mon[36341]: pgmap v320: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 0 B/s wr, 14 op/s 2024-03-04T09:25:56.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:56 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:25:56.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:56 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:25:56.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:56 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:25:56.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:56 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:25:56.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:56 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:25:56.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:56 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:25:56.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:56 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:25:56.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:56 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:25:56.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:56 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:25:56.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:56 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:25:56.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:56 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:25:56.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:56 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:25:56.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:56 smithi102 ceph-mon[36220]: pgmap v320: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 0 B/s wr, 14 op/s 2024-03-04T09:25:56.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:56 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:25:56.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:56 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:25:56.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:56 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:25:56.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:56 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:25:56.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:56 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:25:56.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:56 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:25:56.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:56 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:25:56.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:56 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:25:57.296 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-03-04T09:25:57.296 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-03-04T09:25:57.296 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-03-04T09:25:57.296 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-03-04T09:25:57.296 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-03-04T09:25:57.297 DEBUG:tasks.check_counter:Getting stats from b 2024-03-04T09:25:57.297 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph daemon mds.b perf dump 2024-03-04T09:25:57.543 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.b/config 2024-03-04T09:25:57.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:57 smithi082 ceph-mon[32880]: Adjusting osd_memory_target on smithi102 to 176.2M 2024-03-04T09:25:57.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:57 smithi082 ceph-mon[32880]: Unable to set osd_memory_target on smithi102 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-03-04T09:25:57.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:57 smithi082 ceph-mon[32880]: Adjusting osd_memory_target on smithi190 to 176.2M 2024-03-04T09:25:57.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:57 smithi082 ceph-mon[32880]: Unable to set osd_memory_target on smithi190 to 184792473: error parsing value: Value '184792473' is below minimum 939524096 2024-03-04T09:25:57.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:57 smithi190 ceph-mon[36341]: Adjusting osd_memory_target on smithi102 to 176.2M 2024-03-04T09:25:57.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:57 smithi190 ceph-mon[36341]: Unable to set osd_memory_target on smithi102 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-03-04T09:25:57.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:57 smithi190 ceph-mon[36341]: Adjusting osd_memory_target on smithi190 to 176.2M 2024-03-04T09:25:57.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:57 smithi190 ceph-mon[36341]: Unable to set osd_memory_target on smithi190 to 184792473: error parsing value: Value '184792473' is below minimum 939524096 2024-03-04T09:25:57.672 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:57 smithi102 ceph-mon[36220]: Adjusting osd_memory_target on smithi102 to 176.2M 2024-03-04T09:25:57.672 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:57 smithi102 ceph-mon[36220]: Unable to set osd_memory_target on smithi102 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-03-04T09:25:57.672 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:57 smithi102 ceph-mon[36220]: Adjusting osd_memory_target on smithi190 to 176.2M 2024-03-04T09:25:57.672 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:57 smithi102 ceph-mon[36220]: Unable to set osd_memory_target on smithi190 to 184792473: error parsing value: Value '184792473' is below minimum 939524096 2024-03-04T09:25:58.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:58 smithi190 ceph-mon[36341]: pgmap v321: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:25:58.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:58 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:25:58.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:58 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:25:58.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:58 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:25:58.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:58 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:25:58.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:58 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:25:58.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:58 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:25:58.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:58 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:25:58.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:58 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:25:58.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:58 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:25:58.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:58 smithi102 ceph-mon[36220]: pgmap v321: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:25:58.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:58 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:25:58.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:58 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:25:58.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:58 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:25:58.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:58 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:25:58.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:58 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:25:58.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:58 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:25:58.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:58 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:25:58.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:58 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:25:58.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:58 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:25:58.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:58 smithi082 ceph-mon[32880]: pgmap v321: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:25:58.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:58 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:25:58.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:58 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:25:58.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:58 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:25:58.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:58 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:25:58.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:58 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:25:58.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:58 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-04T09:25:58.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:58 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-04T09:25:58.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:58 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-04T09:25:58.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:58 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' 2024-03-04T09:25:59.413 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-03-04T09:25:59.413 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-0": { 2024-03-04T09:25:59.413 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 8867, 2024-03-04T09:25:59.413 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 8030, 2024-03-04T09:25:59.413 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 4722624, 2024-03-04T09:25:59.413 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 11066544, 2024-03-04T09:25:59.413 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 10, 2024-03-04T09:25:59.413 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 4, 2024-03-04T09:25:59.413 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.631137801, 2024-03-04T09:25:59.414 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.226582065, 2024-03-04T09:25:59.414 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.319622134, 2024-03-04T09:25:59.414 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.106002623, 2024-03-04T09:25:59.414 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-03-04T09:25:59.414 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 8035, 2024-03-04T09:25:59.414 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.774568747, 2024-03-04T09:25:59.414 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000096399 2024-03-04T09:25:59.414 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.414 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-03-04T09:25:59.414 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 10958, 2024-03-04T09:25:59.414 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.001836232, 2024-03-04T09:25:59.414 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000167 2024-03-04T09:25:59.414 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.415 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 1694912, 2024-03-04T09:25:59.415 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 448288 2024-03-04T09:25:59.415 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.415 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-1": { 2024-03-04T09:25:59.415 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 27283, 2024-03-04T09:25:59.415 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 40336, 2024-03-04T09:25:59.415 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 10130568, 2024-03-04T09:25:59.415 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 34398569, 2024-03-04T09:25:59.415 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 18, 2024-03-04T09:25:59.415 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 7, 2024-03-04T09:25:59.415 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 1.683144257, 2024-03-04T09:25:59.415 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.673639653, 2024-03-04T09:25:59.415 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 1.015453906, 2024-03-04T09:25:59.415 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.164018215, 2024-03-04T09:25:59.416 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-03-04T09:25:59.416 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 40336, 2024-03-04T09:25:59.416 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 1.260345649, 2024-03-04T09:25:59.416 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000031246 2024-03-04T09:25:59.416 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.416 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-03-04T09:25:59.416 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 57278, 2024-03-04T09:25:59.416 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.009407904, 2024-03-04T09:25:59.416 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000164 2024-03-04T09:25:59.416 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.416 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 403584, 2024-03-04T09:25:59.416 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 259808 2024-03-04T09:25:59.416 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.417 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-2": { 2024-03-04T09:25:59.417 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 5223, 2024-03-04T09:25:59.417 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 5312, 2024-03-04T09:25:59.417 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 1483151, 2024-03-04T09:25:59.417 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 22263742, 2024-03-04T09:25:59.417 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 15, 2024-03-04T09:25:59.417 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 10, 2024-03-04T09:25:59.417 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.527151673, 2024-03-04T09:25:59.417 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.227533286, 2024-03-04T09:25:59.417 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.130521987, 2024-03-04T09:25:59.417 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.132953912, 2024-03-04T09:25:59.417 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-03-04T09:25:59.418 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 5291, 2024-03-04T09:25:59.418 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.918953930, 2024-03-04T09:25:59.418 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000173682 2024-03-04T09:25:59.418 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.418 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-03-04T09:25:59.418 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 2089, 2024-03-04T09:25:59.418 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000388949, 2024-03-04T09:25:59.418 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000186 2024-03-04T09:25:59.418 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.418 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 4848, 2024-03-04T09:25:59.418 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 3904 2024-03-04T09:25:59.419 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.419 INFO:teuthology.orchestra.run.smithi102.stdout: "cct": { 2024-03-04T09:25:59.419 INFO:teuthology.orchestra.run.smithi102.stdout: "total_workers": 1, 2024-03-04T09:25:59.419 INFO:teuthology.orchestra.run.smithi102.stdout: "unhealthy_workers": 0 2024-03-04T09:25:59.419 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.419 INFO:teuthology.orchestra.run.smithi102.stdout: "finisher-MDSRank": { 2024-03-04T09:25:59.419 INFO:teuthology.orchestra.run.smithi102.stdout: "queue_len": 0, 2024-03-04T09:25:59.420 INFO:teuthology.orchestra.run.smithi102.stdout: "complete_latency": { 2024-03-04T09:25:59.420 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 2555, 2024-03-04T09:25:59.420 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 9.543165173, 2024-03-04T09:25:59.420 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.003735094 2024-03-04T09:25:59.420 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-03-04T09:25:59.420 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.420 INFO:teuthology.orchestra.run.smithi102.stdout: "finisher-PurgeQueue": { 2024-03-04T09:25:59.420 INFO:teuthology.orchestra.run.smithi102.stdout: "queue_len": 0, 2024-03-04T09:25:59.420 INFO:teuthology.orchestra.run.smithi102.stdout: "complete_latency": { 2024-03-04T09:25:59.420 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 6918, 2024-03-04T09:25:59.420 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 1.008032667, 2024-03-04T09:25:59.420 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000145711 2024-03-04T09:25:59.420 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-03-04T09:25:59.421 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.421 INFO:teuthology.orchestra.run.smithi102.stdout: "mds": { 2024-03-04T09:25:59.421 INFO:teuthology.orchestra.run.smithi102.stdout: "request": 10183, 2024-03-04T09:25:59.421 INFO:teuthology.orchestra.run.smithi102.stdout: "reply": 9927, 2024-03-04T09:25:59.421 INFO:teuthology.orchestra.run.smithi102.stdout: "reply_latency": { 2024-03-04T09:25:59.421 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 9927, 2024-03-04T09:25:59.421 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 33.706738130, 2024-03-04T09:25:59.421 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.003395460 2024-03-04T09:25:59.421 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.421 INFO:teuthology.orchestra.run.smithi102.stdout: "slow_reply": 0, 2024-03-04T09:25:59.421 INFO:teuthology.orchestra.run.smithi102.stdout: "forward": 256, 2024-03-04T09:25:59.422 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_fetch_complete": 0, 2024-03-04T09:25:59.422 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_fetch_keys": 0, 2024-03-04T09:25:59.422 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_commit": 75, 2024-03-04T09:25:59.422 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_split": 7, 2024-03-04T09:25:59.422 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_merge": 0, 2024-03-04T09:25:59.422 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes": 4741, 2024-03-04T09:25:59.422 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_top": 63, 2024-03-04T09:25:59.422 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_bottom": 4499, 2024-03-04T09:25:59.422 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_pin_tail": 179, 2024-03-04T09:25:59.422 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_pinned": 4649, 2024-03-04T09:25:59.422 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_expired": 918, 2024-03-04T09:25:59.422 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_with_caps": 3, 2024-03-04T09:25:59.422 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": 3, 2024-03-04T09:25:59.422 INFO:teuthology.orchestra.run.smithi102.stdout: "subtrees": 5, 2024-03-04T09:25:59.423 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse": 11359, 2024-03-04T09:25:59.423 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_hit": 10709, 2024-03-04T09:25:59.423 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_forward": 185, 2024-03-04T09:25:59.423 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_discover": 6, 2024-03-04T09:25:59.423 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_dir_fetch": 0, 2024-03-04T09:25:59.423 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_remote_ino": 0, 2024-03-04T09:25:59.423 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_lock": 0, 2024-03-04T09:25:59.423 INFO:teuthology.orchestra.run.smithi102.stdout: "load_cent": 0, 2024-03-04T09:25:59.423 INFO:teuthology.orchestra.run.smithi102.stdout: "q": 0, 2024-03-04T09:25:59.423 INFO:teuthology.orchestra.run.smithi102.stdout: "exported": 47, 2024-03-04T09:25:59.423 INFO:teuthology.orchestra.run.smithi102.stdout: "exported_inodes": 852, 2024-03-04T09:25:59.424 INFO:teuthology.orchestra.run.smithi102.stdout: "imported": 33, 2024-03-04T09:25:59.424 INFO:teuthology.orchestra.run.smithi102.stdout: "imported_inodes": 564, 2024-03-04T09:25:59.424 INFO:teuthology.orchestra.run.smithi102.stdout: "openino_dir_fetch": 0, 2024-03-04T09:25:59.424 INFO:teuthology.orchestra.run.smithi102.stdout: "openino_backtrace_fetch": 0, 2024-03-04T09:25:59.424 INFO:teuthology.orchestra.run.smithi102.stdout: "openino_peer_discover": 0, 2024-03-04T09:25:59.424 INFO:teuthology.orchestra.run.smithi102.stdout: "root_rfiles": 4, 2024-03-04T09:25:59.424 INFO:teuthology.orchestra.run.smithi102.stdout: "root_rbytes": 234, 2024-03-04T09:25:59.424 INFO:teuthology.orchestra.run.smithi102.stdout: "root_rsnaps": 6, 2024-03-04T09:25:59.424 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_backtrace_fetch": 0, 2024-03-04T09:25:59.424 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_set_tag": 0, 2024-03-04T09:25:59.424 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_backtrace_repaired": 0, 2024-03-04T09:25:59.424 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_inotable_repaired": 0, 2024-03-04T09:25:59.424 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_dir_inodes": 0, 2024-03-04T09:25:59.425 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_dir_base_inodes": 0, 2024-03-04T09:25:59.425 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_dirfrag_rstats": 0, 2024-03-04T09:25:59.425 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_file_inodes": 0, 2024-03-04T09:25:59.425 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_inode_file_caps": 0, 2024-03-04T09:25:59.425 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_revoke": 1450, 2024-03-04T09:25:59.425 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_grant": 8982, 2024-03-04T09:25:59.425 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_trunc": 0, 2024-03-04T09:25:59.425 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-03-04T09:25:59.425 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_flush_ack": 0, 2024-03-04T09:25:59.425 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_caps": 10397, 2024-03-04T09:25:59.425 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_caps_dirty": 5193, 2024-03-04T09:25:59.425 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_cap_release": 41, 2024-03-04T09:25:59.425 INFO:teuthology.orchestra.run.smithi102.stdout: "process_request_cap_release": 12705 2024-03-04T09:25:59.425 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.426 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_cache": { 2024-03-04T09:25:59.426 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_update": 0, 2024-03-04T09:25:59.426 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_update_receipt": 0, 2024-03-04T09:25:59.426 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_try_discover": 0, 2024-03-04T09:25:59.426 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_send_discover": 6, 2024-03-04T09:25:59.426 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_handle_discover": 63, 2024-03-04T09:25:59.426 INFO:teuthology.orchestra.run.smithi102.stdout: "num_strays": 163, 2024-03-04T09:25:59.426 INFO:teuthology.orchestra.run.smithi102.stdout: "num_strays_delayed": 0, 2024-03-04T09:25:59.426 INFO:teuthology.orchestra.run.smithi102.stdout: "num_strays_enqueuing": 0, 2024-03-04T09:25:59.426 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_created": 3972, 2024-03-04T09:25:59.426 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_enqueued": 3809, 2024-03-04T09:25:59.426 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_reintegrated": 0, 2024-03-04T09:25:59.426 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_migrated": 0, 2024-03-04T09:25:59.426 INFO:teuthology.orchestra.run.smithi102.stdout: "num_recovering_processing": 0, 2024-03-04T09:25:59.427 INFO:teuthology.orchestra.run.smithi102.stdout: "num_recovering_enqueued": 0, 2024-03-04T09:25:59.427 INFO:teuthology.orchestra.run.smithi102.stdout: "num_recovering_prioritized": 0, 2024-03-04T09:25:59.427 INFO:teuthology.orchestra.run.smithi102.stdout: "recovery_started": 0, 2024-03-04T09:25:59.427 INFO:teuthology.orchestra.run.smithi102.stdout: "recovery_completed": 0, 2024-03-04T09:25:59.427 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_enqueue_scrub": 0, 2024-03-04T09:25:59.427 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_exportdir": 47, 2024-03-04T09:25:59.427 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_flush": 0, 2024-03-04T09:25:59.427 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_fragmentdir": 7, 2024-03-04T09:25:59.427 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_fragstats": 0, 2024-03-04T09:25:59.427 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_inodestats": 0 2024-03-04T09:25:59.427 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.427 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_log": { 2024-03-04T09:25:59.427 INFO:teuthology.orchestra.run.smithi102.stdout: "evlrg": 0, 2024-03-04T09:25:59.427 INFO:teuthology.orchestra.run.smithi102.stdout: "evadd": 19966, 2024-03-04T09:25:59.427 INFO:teuthology.orchestra.run.smithi102.stdout: "evex": 0, 2024-03-04T09:25:59.428 INFO:teuthology.orchestra.run.smithi102.stdout: "evtrm": 0, 2024-03-04T09:25:59.428 INFO:teuthology.orchestra.run.smithi102.stdout: "ev": 19966, 2024-03-04T09:25:59.428 INFO:teuthology.orchestra.run.smithi102.stdout: "evexg": 0, 2024-03-04T09:25:59.428 INFO:teuthology.orchestra.run.smithi102.stdout: "evexd": 0, 2024-03-04T09:25:59.428 INFO:teuthology.orchestra.run.smithi102.stdout: "segadd": 27, 2024-03-04T09:25:59.428 INFO:teuthology.orchestra.run.smithi102.stdout: "segex": 0, 2024-03-04T09:25:59.428 INFO:teuthology.orchestra.run.smithi102.stdout: "segtrm": 0, 2024-03-04T09:25:59.428 INFO:teuthology.orchestra.run.smithi102.stdout: "seg": 27, 2024-03-04T09:25:59.428 INFO:teuthology.orchestra.run.smithi102.stdout: "segmjr": 3, 2024-03-04T09:25:59.428 INFO:teuthology.orchestra.run.smithi102.stdout: "segexg": 0, 2024-03-04T09:25:59.429 INFO:teuthology.orchestra.run.smithi102.stdout: "segexd": 0, 2024-03-04T09:25:59.429 INFO:teuthology.orchestra.run.smithi102.stdout: "expos": 4194304, 2024-03-04T09:25:59.429 INFO:teuthology.orchestra.run.smithi102.stdout: "wrpos": 48951837, 2024-03-04T09:25:59.429 INFO:teuthology.orchestra.run.smithi102.stdout: "rdpos": 0, 2024-03-04T09:25:59.429 INFO:teuthology.orchestra.run.smithi102.stdout: "jlat": { 2024-03-04T09:25:59.429 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 1286, 2024-03-04T09:25:59.430 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 11.032726185, 2024-03-04T09:25:59.430 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.008579102 2024-03-04T09:25:59.430 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.430 INFO:teuthology.orchestra.run.smithi102.stdout: "replayed": 0 2024-03-04T09:25:59.430 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.431 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_mem": { 2024-03-04T09:25:59.431 INFO:teuthology.orchestra.run.smithi102.stdout: "ino": 2298, 2024-03-04T09:25:59.431 INFO:teuthology.orchestra.run.smithi102.stdout: "ino+": 6947, 2024-03-04T09:25:59.431 INFO:teuthology.orchestra.run.smithi102.stdout: "ino-": 4649, 2024-03-04T09:25:59.431 INFO:teuthology.orchestra.run.smithi102.stdout: "dir": 240, 2024-03-04T09:25:59.431 INFO:teuthology.orchestra.run.smithi102.stdout: "dir+": 331, 2024-03-04T09:25:59.432 INFO:teuthology.orchestra.run.smithi102.stdout: "dir-": 91, 2024-03-04T09:25:59.432 INFO:teuthology.orchestra.run.smithi102.stdout: "dn": 4741, 2024-03-04T09:25:59.432 INFO:teuthology.orchestra.run.smithi102.stdout: "dn+": 9496, 2024-03-04T09:25:59.432 INFO:teuthology.orchestra.run.smithi102.stdout: "dn-": 4755, 2024-03-04T09:25:59.432 INFO:teuthology.orchestra.run.smithi102.stdout: "cap": 3, 2024-03-04T09:25:59.432 INFO:teuthology.orchestra.run.smithi102.stdout: "cap+": 4795, 2024-03-04T09:25:59.432 INFO:teuthology.orchestra.run.smithi102.stdout: "cap-": 4792, 2024-03-04T09:25:59.432 INFO:teuthology.orchestra.run.smithi102.stdout: "rss": 86248, 2024-03-04T09:25:59.435 INFO:teuthology.orchestra.run.smithi102.stdout: "heap": 231804 2024-03-04T09:25:59.435 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.435 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_server": { 2024-03-04T09:25:59.435 INFO:teuthology.orchestra.run.smithi102.stdout: "dispatch_client_request": 12315, 2024-03-04T09:25:59.435 INFO:teuthology.orchestra.run.smithi102.stdout: "dispatch_server_request": 552, 2024-03-04T09:25:59.435 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_request": 10183, 2024-03-04T09:25:59.436 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_session": 73, 2024-03-04T09:25:59.436 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_peer_request": 1220, 2024-03-04T09:25:59.436 INFO:teuthology.orchestra.run.smithi102.stdout: "req_create_latency": { 2024-03-04T09:25:59.436 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 4485, 2024-03-04T09:25:59.436 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 11.625446668, 2024-03-04T09:25:59.436 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.002592072 2024-03-04T09:25:59.436 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.436 INFO:teuthology.orchestra.run.smithi102.stdout: "req_getattr_latency": { 2024-03-04T09:25:59.436 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 122, 2024-03-04T09:25:59.436 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.033703669, 2024-03-04T09:25:59.437 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000276259 2024-03-04T09:25:59.437 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.437 INFO:teuthology.orchestra.run.smithi102.stdout: "req_getfilelock_latency": { 2024-03-04T09:25:59.437 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:25:59.437 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:25:59.437 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:25:59.437 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.437 INFO:teuthology.orchestra.run.smithi102.stdout: "req_link_latency": { 2024-03-04T09:25:59.437 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:25:59.437 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:25:59.437 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:25:59.437 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.437 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookup_latency": { 2024-03-04T09:25:59.437 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 670, 2024-03-04T09:25:59.437 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 10.378555046, 2024-03-04T09:25:59.438 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.015490380 2024-03-04T09:25:59.438 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.438 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookuphash_latency": { 2024-03-04T09:25:59.438 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:25:59.438 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:25:59.438 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:25:59.438 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.438 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupino_latency": { 2024-03-04T09:25:59.438 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:25:59.438 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:25:59.438 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:25:59.438 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.438 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupname_latency": { 2024-03-04T09:25:59.438 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:25:59.439 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:25:59.439 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:25:59.439 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.439 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupparent_latency": { 2024-03-04T09:25:59.439 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:25:59.439 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:25:59.439 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:25:59.439 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.439 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupsnap_latency": { 2024-03-04T09:25:59.439 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:25:59.439 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:25:59.439 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:25:59.439 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.439 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lssnap_latency": { 2024-03-04T09:25:59.439 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 10, 2024-03-04T09:25:59.440 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.001957550, 2024-03-04T09:25:59.440 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000195755 2024-03-04T09:25:59.440 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.440 INFO:teuthology.orchestra.run.smithi102.stdout: "req_mkdir_latency": { 2024-03-04T09:25:59.440 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 228, 2024-03-04T09:25:59.440 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.455581174, 2024-03-04T09:25:59.440 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.001998163 2024-03-04T09:25:59.440 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.440 INFO:teuthology.orchestra.run.smithi102.stdout: "req_mknod_latency": { 2024-03-04T09:25:59.440 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:25:59.440 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:25:59.441 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:25:59.441 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.441 INFO:teuthology.orchestra.run.smithi102.stdout: "req_mksnap_latency": { 2024-03-04T09:25:59.441 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 10, 2024-03-04T09:25:59.441 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.125492571, 2024-03-04T09:25:59.441 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.012549257 2024-03-04T09:25:59.441 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.441 INFO:teuthology.orchestra.run.smithi102.stdout: "req_open_latency": { 2024-03-04T09:25:59.441 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 1, 2024-03-04T09:25:59.442 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000282617, 2024-03-04T09:25:59.442 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000282617 2024-03-04T09:25:59.442 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.442 INFO:teuthology.orchestra.run.smithi102.stdout: "req_readdir_latency": { 2024-03-04T09:25:59.442 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 390, 2024-03-04T09:25:59.442 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.792937942, 2024-03-04T09:25:59.442 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.002033174 2024-03-04T09:25:59.442 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.442 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rename_latency": { 2024-03-04T09:25:59.442 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 2, 2024-03-04T09:25:59.442 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.002933063, 2024-03-04T09:25:59.442 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.001466531 2024-03-04T09:25:59.442 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.442 INFO:teuthology.orchestra.run.smithi102.stdout: "req_renamesnap_latency": { 2024-03-04T09:25:59.443 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:25:59.443 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:25:59.443 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:25:59.443 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.443 INFO:teuthology.orchestra.run.smithi102.stdout: "req_snapdiff_latency": { 2024-03-04T09:25:59.443 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:25:59.443 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:25:59.443 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:25:59.443 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.443 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rmdir_latency": { 2024-03-04T09:25:59.443 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 163, 2024-03-04T09:25:59.443 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 3.678595572, 2024-03-04T09:25:59.443 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.022568070 2024-03-04T09:25:59.443 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.444 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rmsnap_latency": { 2024-03-04T09:25:59.444 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 4, 2024-03-04T09:25:59.444 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.017701897, 2024-03-04T09:25:59.444 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.004425474 2024-03-04T09:25:59.444 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.444 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rmxattr_latency": { 2024-03-04T09:25:59.444 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:25:59.444 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:25:59.444 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:25:59.444 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.444 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setattr_latency": { 2024-03-04T09:25:59.444 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 24, 2024-03-04T09:25:59.444 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.112620312, 2024-03-04T09:25:59.444 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.004692513 2024-03-04T09:25:59.445 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.445 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setdirlayout_latency": { 2024-03-04T09:25:59.445 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:25:59.445 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:25:59.445 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:25:59.445 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.445 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setfilelock_latency": { 2024-03-04T09:25:59.445 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:25:59.445 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:25:59.445 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:25:59.445 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.445 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setlayout_latency": { 2024-03-04T09:25:59.445 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:25:59.445 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:25:59.446 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:25:59.446 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.446 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setxattr_latency": { 2024-03-04T09:25:59.446 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 9, 2024-03-04T09:25:59.446 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.020021309, 2024-03-04T09:25:59.446 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.002224589 2024-03-04T09:25:59.446 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.446 INFO:teuthology.orchestra.run.smithi102.stdout: "req_symlink_latency": { 2024-03-04T09:25:59.446 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:25:59.446 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:25:59.446 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:25:59.446 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.446 INFO:teuthology.orchestra.run.smithi102.stdout: "req_unlink_latency": { 2024-03-04T09:25:59.446 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 3809, 2024-03-04T09:25:59.446 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 6.460908740, 2024-03-04T09:25:59.447 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.001696221 2024-03-04T09:25:59.447 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.447 INFO:teuthology.orchestra.run.smithi102.stdout: "cap_revoke_eviction": 0, 2024-03-04T09:25:59.447 INFO:teuthology.orchestra.run.smithi102.stdout: "cap_acquisition_throttle": 0, 2024-03-04T09:25:59.447 INFO:teuthology.orchestra.run.smithi102.stdout: "req_getvxattr_latency": { 2024-03-04T09:25:59.447 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:25:59.447 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:25:59.447 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:25:59.447 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-03-04T09:25:59.447 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.447 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_sessions": { 2024-03-04T09:25:59.447 INFO:teuthology.orchestra.run.smithi102.stdout: "session_count": 2, 2024-03-04T09:25:59.447 INFO:teuthology.orchestra.run.smithi102.stdout: "session_add": 6, 2024-03-04T09:25:59.447 INFO:teuthology.orchestra.run.smithi102.stdout: "session_remove": 4, 2024-03-04T09:25:59.448 INFO:teuthology.orchestra.run.smithi102.stdout: "sessions_open": 2, 2024-03-04T09:25:59.448 INFO:teuthology.orchestra.run.smithi102.stdout: "sessions_stale": 0, 2024-03-04T09:25:59.448 INFO:teuthology.orchestra.run.smithi102.stdout: "total_load": 100, 2024-03-04T09:25:59.448 INFO:teuthology.orchestra.run.smithi102.stdout: "average_load": 50, 2024-03-04T09:25:59.448 INFO:teuthology.orchestra.run.smithi102.stdout: "avg_session_uptime": 610, 2024-03-04T09:25:59.448 INFO:teuthology.orchestra.run.smithi102.stdout: "mdthresh_evicted": 0 2024-03-04T09:25:59.448 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.448 INFO:teuthology.orchestra.run.smithi102.stdout: "mempool": { 2024-03-04T09:25:59.448 INFO:teuthology.orchestra.run.smithi102.stdout: "bloom_filter_bytes": 0, 2024-03-04T09:25:59.448 INFO:teuthology.orchestra.run.smithi102.stdout: "bloom_filter_items": 0, 2024-03-04T09:25:59.448 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_alloc_bytes": 0, 2024-03-04T09:25:59.448 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_alloc_items": 0, 2024-03-04T09:25:59.448 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_data_bytes": 0, 2024-03-04T09:25:59.448 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_data_items": 0, 2024-03-04T09:25:59.449 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-04T09:25:59.449 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_onode_items": 0, 2024-03-04T09:25:59.449 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-04T09:25:59.449 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_meta_items": 0, 2024-03-04T09:25:59.449 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_other_bytes": 0, 2024-03-04T09:25:59.449 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_other_items": 0, 2024-03-04T09:25:59.449 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-04T09:25:59.449 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_buffer_items": 0, 2024-03-04T09:25:59.449 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_extent_bytes": 0, 2024-03-04T09:25:59.449 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_extent_items": 0, 2024-03-04T09:25:59.449 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_blob_bytes": 0, 2024-03-04T09:25:59.449 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_blob_items": 0, 2024-03-04T09:25:59.449 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-04T09:25:59.450 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_shared_blob_items": 0, 2024-03-04T09:25:59.450 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-04T09:25:59.450 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_inline_bl_items": 0, 2024-03-04T09:25:59.450 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_bytes": 0, 2024-03-04T09:25:59.450 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_items": 0, 2024-03-04T09:25:59.450 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_txc_bytes": 0, 2024-03-04T09:25:59.450 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_txc_items": 0, 2024-03-04T09:25:59.450 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-04T09:25:59.450 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_deferred_items": 0, 2024-03-04T09:25:59.450 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_bytes": 0, 2024-03-04T09:25:59.450 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_items": 0, 2024-03-04T09:25:59.450 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_bytes": 0, 2024-03-04T09:25:59.451 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_items": 0, 2024-03-04T09:25:59.451 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_reader_bytes": 0, 2024-03-04T09:25:59.451 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_reader_items": 0, 2024-03-04T09:25:59.451 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_writer_bytes": 0, 2024-03-04T09:25:59.451 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_writer_items": 0, 2024-03-04T09:25:59.451 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_anon_bytes": 1622443, 2024-03-04T09:25:59.451 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_anon_items": 454, 2024-03-04T09:25:59.451 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_meta_bytes": 0, 2024-03-04T09:25:59.451 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_meta_items": 0, 2024-03-04T09:25:59.451 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_bytes": 0, 2024-03-04T09:25:59.451 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_items": 0, 2024-03-04T09:25:59.451 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mapbl_bytes": 0, 2024-03-04T09:25:59.451 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mapbl_items": 0, 2024-03-04T09:25:59.451 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pglog_bytes": 0, 2024-03-04T09:25:59.452 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pglog_items": 0, 2024-03-04T09:25:59.452 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_bytes": 9832, 2024-03-04T09:25:59.452 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_items": 205, 2024-03-04T09:25:59.452 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_mapping_bytes": 0, 2024-03-04T09:25:59.452 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_mapping_items": 0, 2024-03-04T09:25:59.452 INFO:teuthology.orchestra.run.smithi102.stdout: "pgmap_bytes": 0, 2024-03-04T09:25:59.452 INFO:teuthology.orchestra.run.smithi102.stdout: "pgmap_items": 0, 2024-03-04T09:25:59.452 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_co_bytes": 8722384, 2024-03-04T09:25:59.452 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_co_items": 93730, 2024-03-04T09:25:59.452 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_1_bytes": 0, 2024-03-04T09:25:59.452 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_1_items": 0, 2024-03-04T09:25:59.452 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_2_bytes": 0, 2024-03-04T09:25:59.452 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_2_items": 0 2024-03-04T09:25:59.452 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.453 INFO:teuthology.orchestra.run.smithi102.stdout: "objecter": { 2024-03-04T09:25:59.453 INFO:teuthology.orchestra.run.smithi102.stdout: "op_active": 0, 2024-03-04T09:25:59.453 INFO:teuthology.orchestra.run.smithi102.stdout: "op_laggy": 0, 2024-03-04T09:25:59.453 INFO:teuthology.orchestra.run.smithi102.stdout: "op_send": 9880, 2024-03-04T09:25:59.453 INFO:teuthology.orchestra.run.smithi102.stdout: "op_send_bytes": 46643105, 2024-03-04T09:25:59.453 INFO:teuthology.orchestra.run.smithi102.stdout: "op_resend": 37, 2024-03-04T09:25:59.453 INFO:teuthology.orchestra.run.smithi102.stdout: "op_reply": 9880, 2024-03-04T09:25:59.453 INFO:teuthology.orchestra.run.smithi102.stdout: "op_latency": { 2024-03-04T09:25:59.453 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 9880, 2024-03-04T09:25:59.453 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 48.885930086, 2024-03-04T09:25:59.453 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.004947968 2024-03-04T09:25:59.453 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.453 INFO:teuthology.orchestra.run.smithi102.stdout: "op_inflight": 0, 2024-03-04T09:25:59.453 INFO:teuthology.orchestra.run.smithi102.stdout: "oplen_avg": { 2024-03-04T09:25:59.453 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 9880, 2024-03-04T09:25:59.454 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 10112 2024-03-04T09:25:59.454 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.454 INFO:teuthology.orchestra.run.smithi102.stdout: "op": 9880, 2024-03-04T09:25:59.454 INFO:teuthology.orchestra.run.smithi102.stdout: "op_r": 87, 2024-03-04T09:25:59.454 INFO:teuthology.orchestra.run.smithi102.stdout: "op_w": 9793, 2024-03-04T09:25:59.454 INFO:teuthology.orchestra.run.smithi102.stdout: "op_rmw": 0, 2024-03-04T09:25:59.454 INFO:teuthology.orchestra.run.smithi102.stdout: "op_pg": 0, 2024-03-04T09:25:59.454 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_stat": 0, 2024-03-04T09:25:59.454 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_create": 11, 2024-03-04T09:25:59.454 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_read": 87, 2024-03-04T09:25:59.454 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_write": 1373, 2024-03-04T09:25:59.454 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_writefull": 67, 2024-03-04T09:25:59.454 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_writesame": 0, 2024-03-04T09:25:59.454 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_append": 0, 2024-03-04T09:25:59.454 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_zero": 0, 2024-03-04T09:25:59.455 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_truncate": 7, 2024-03-04T09:25:59.455 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_delete": 8159, 2024-03-04T09:25:59.455 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_mapext": 0, 2024-03-04T09:25:59.455 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_sparse_read": 0, 2024-03-04T09:25:59.455 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_clonerange": 0, 2024-03-04T09:25:59.455 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_getxattr": 0, 2024-03-04T09:25:59.455 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_setxattr": 22, 2024-03-04T09:25:59.455 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_cmpxattr": 0, 2024-03-04T09:25:59.455 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_rmxattr": 0, 2024-03-04T09:25:59.455 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_resetxattrs": 0, 2024-03-04T09:25:59.455 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_call": 0, 2024-03-04T09:25:59.455 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_watch": 0, 2024-03-04T09:25:59.455 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_notify": 0, 2024-03-04T09:25:59.455 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_src_cmpxattr": 0, 2024-03-04T09:25:59.455 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_pgls": 0, 2024-03-04T09:25:59.456 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_pgls_filter": 0, 2024-03-04T09:25:59.456 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_other": 0, 2024-03-04T09:25:59.456 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_active": 0, 2024-03-04T09:25:59.456 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_send": 0, 2024-03-04T09:25:59.456 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_resend": 0, 2024-03-04T09:25:59.456 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_ping": 0, 2024-03-04T09:25:59.456 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_active": 0, 2024-03-04T09:25:59.456 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_send": 0, 2024-03-04T09:25:59.456 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_resend": 0, 2024-03-04T09:25:59.456 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_active": 0, 2024-03-04T09:25:59.456 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_send": 0, 2024-03-04T09:25:59.456 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_resend": 0, 2024-03-04T09:25:59.456 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_active": 0, 2024-03-04T09:25:59.456 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_send": 0, 2024-03-04T09:25:59.457 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_resend": 0, 2024-03-04T09:25:59.457 INFO:teuthology.orchestra.run.smithi102.stdout: "command_active": 0, 2024-03-04T09:25:59.457 INFO:teuthology.orchestra.run.smithi102.stdout: "command_send": 0, 2024-03-04T09:25:59.457 INFO:teuthology.orchestra.run.smithi102.stdout: "command_resend": 0, 2024-03-04T09:25:59.457 INFO:teuthology.orchestra.run.smithi102.stdout: "map_epoch": 104, 2024-03-04T09:25:59.457 INFO:teuthology.orchestra.run.smithi102.stdout: "map_full": 0, 2024-03-04T09:25:59.457 INFO:teuthology.orchestra.run.smithi102.stdout: "map_inc": 19, 2024-03-04T09:25:59.457 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_sessions": 12, 2024-03-04T09:25:59.457 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_session_open": 12, 2024-03-04T09:25:59.457 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_session_close": 0, 2024-03-04T09:25:59.457 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_laggy": 0, 2024-03-04T09:25:59.457 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_wr": 310, 2024-03-04T09:25:59.457 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_rd": 0, 2024-03-04T09:25:59.457 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_del": 76 2024-03-04T09:25:59.458 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.458 INFO:teuthology.orchestra.run.smithi102.stdout: "oft": { 2024-03-04T09:25:59.458 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_objs": 1, 2024-03-04T09:25:59.458 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_kv_pairs": 0, 2024-03-04T09:25:59.458 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_updates": 0, 2024-03-04T09:25:59.458 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_removes": 0 2024-03-04T09:25:59.458 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.458 INFO:teuthology.orchestra.run.smithi102.stdout: "osd-slow-ops": { 2024-03-04T09:25:59.458 INFO:teuthology.orchestra.run.smithi102.stdout: "slow_ops_count": 0 2024-03-04T09:25:59.458 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.458 INFO:teuthology.orchestra.run.smithi102.stdout: "purge_queue": { 2024-03-04T09:25:59.458 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing_ops": 0, 2024-03-04T09:25:59.458 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing_ops_high_water": 27, 2024-03-04T09:25:59.458 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing": 0, 2024-03-04T09:25:59.458 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing_high_water": 5, 2024-03-04T09:25:59.459 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executed_ops": 7637, 2024-03-04T09:25:59.459 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executed": 3809, 2024-03-04T09:25:59.459 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_item_in_journal": 0 2024-03-04T09:25:59.459 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.459 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-04T09:25:59.459 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-03-04T09:25:59.459 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 104857600, 2024-03-04T09:25:59.459 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-03-04T09:25:59.459 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 41369, 2024-03-04T09:25:59.459 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 12551061, 2024-03-04T09:25:59.459 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-03-04T09:25:59.459 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 41369, 2024-03-04T09:25:59.459 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2024-03-04T09:25:59.459 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2024-03-04T09:25:59.459 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 41369, 2024-03-04T09:25:59.460 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 12551061, 2024-03-04T09:25:59.460 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-03-04T09:25:59.460 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:25:59.460 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:25:59.460 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:25:59.460 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-03-04T09:25:59.460 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.460 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-objecter_bytes": { 2024-03-04T09:25:59.460 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-03-04T09:25:59.460 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 104857600, 2024-03-04T09:25:59.460 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-03-04T09:25:59.460 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 0, 2024-03-04T09:25:59.461 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 0, 2024-03-04T09:25:59.461 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-03-04T09:25:59.461 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 0, 2024-03-04T09:25:59.461 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 9880, 2024-03-04T09:25:59.461 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 47073422, 2024-03-04T09:25:59.461 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 9880, 2024-03-04T09:25:59.461 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 47073422, 2024-03-04T09:25:59.462 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-03-04T09:25:59.462 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:25:59.462 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:25:59.462 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:25:59.462 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-03-04T09:25:59.462 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.462 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-objecter_ops": { 2024-03-04T09:25:59.462 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-03-04T09:25:59.462 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 1024, 2024-03-04T09:25:59.462 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-03-04T09:25:59.462 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 0, 2024-03-04T09:25:59.462 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 0, 2024-03-04T09:25:59.462 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-03-04T09:25:59.462 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 0, 2024-03-04T09:25:59.462 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 9880, 2024-03-04T09:25:59.463 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 9880, 2024-03-04T09:25:59.463 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 9880, 2024-03-04T09:25:59.463 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 9880, 2024-03-04T09:25:59.463 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-03-04T09:25:59.463 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:25:59.463 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:25:59.463 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:25:59.463 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-03-04T09:25:59.463 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.463 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-write_buf_throttle": { 2024-03-04T09:25:59.463 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-03-04T09:25:59.463 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 3758096384, 2024-03-04T09:25:59.463 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-03-04T09:25:59.463 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 3809, 2024-03-04T09:25:59.463 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 430317, 2024-03-04T09:25:59.464 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-03-04T09:25:59.464 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 3809, 2024-03-04T09:25:59.464 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2024-03-04T09:25:59.464 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2024-03-04T09:25:59.464 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 87, 2024-03-04T09:25:59.464 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 430317, 2024-03-04T09:25:59.464 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-03-04T09:25:59.464 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:25:59.464 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:25:59.464 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:25:59.464 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-03-04T09:25:59.464 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:25:59.464 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-write_buf_throttle-0x55c58a6026e0": { 2024-03-04T09:25:59.464 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-03-04T09:25:59.464 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 3758096384, 2024-03-04T09:25:59.465 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-03-04T09:25:59.465 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 19966, 2024-03-04T09:25:59.465 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 44757533, 2024-03-04T09:25:59.465 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-03-04T09:25:59.465 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 19966, 2024-03-04T09:25:59.465 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2024-03-04T09:25:59.465 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2024-03-04T09:25:59.465 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 1286, 2024-03-04T09:25:59.465 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 44757533, 2024-03-04T09:25:59.465 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-03-04T09:25:59.465 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:25:59.465 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:25:59.465 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:25:59.465 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-03-04T09:25:59.465 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-03-04T09:25:59.466 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-03-04T09:25:59.649 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:59 smithi102 ceph-mon[36220]: Adjusting osd_memory_target on smithi082 to 176.2M 2024-03-04T09:25:59.649 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:25:59 smithi102 ceph-mon[36220]: Unable to set osd_memory_target on smithi082 to 184763801: error parsing value: Value '184763801' is below minimum 939524096 2024-03-04T09:25:59.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:59 smithi190 ceph-mon[36341]: Adjusting osd_memory_target on smithi082 to 176.2M 2024-03-04T09:25:59.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:25:59 smithi190 ceph-mon[36341]: Unable to set osd_memory_target on smithi082 to 184763801: error parsing value: Value '184763801' is below minimum 939524096 2024-03-04T09:25:59.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:59 smithi082 ceph-mon[32880]: Adjusting osd_memory_target on smithi082 to 176.2M 2024-03-04T09:25:59.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:25:59 smithi082 ceph-mon[32880]: Unable to set osd_memory_target on smithi082 to 184763801: error parsing value: Value '184763801' is below minimum 939524096 2024-03-04T09:26:00.242 INFO:tasks.check_counter:Daemon mds.b mds.exported=47 2024-03-04T09:26:00.242 INFO:tasks.check_counter:Daemon mds.b mds.imported=33 2024-03-04T09:26:00.242 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-03-04T09:26:00.242 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=10 2024-03-04T09:26:00.242 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=4 2024-03-04T09:26:00.242 DEBUG:tasks.check_counter:Getting stats from e 2024-03-04T09:26:00.243 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph daemon mds.e perf dump 2024-03-04T09:26:00.480 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:00 smithi102 ceph-mon[36220]: pgmap v322: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:26:00.533 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.b/config 2024-03-04T09:26:00.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:00 smithi190 ceph-mon[36341]: pgmap v322: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:26:00.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:00 smithi082 ceph-mon[32880]: pgmap v322: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:26:02.312 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-03-04T09:26:02.312 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-0": { 2024-03-04T09:26:02.312 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 1500, 2024-03-04T09:26:02.312 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 1501, 2024-03-04T09:26:02.312 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 17217697, 2024-03-04T09:26:02.312 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 476692, 2024-03-04T09:26:02.312 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 7, 2024-03-04T09:26:02.313 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 3, 2024-03-04T09:26:02.313 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.105883514, 2024-03-04T09:26:02.313 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.031999128, 2024-03-04T09:26:02.313 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.031608115, 2024-03-04T09:26:02.313 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.033881221, 2024-03-04T09:26:02.313 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-03-04T09:26:02.313 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 1499, 2024-03-04T09:26:02.313 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.032543053, 2024-03-04T09:26:02.313 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000021709 2024-03-04T09:26:02.313 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.313 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-03-04T09:26:02.313 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:02.313 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:02.314 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:02.314 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.314 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 0, 2024-03-04T09:26:02.314 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 0 2024-03-04T09:26:02.314 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.314 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-1": { 2024-03-04T09:26:02.314 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 890, 2024-03-04T09:26:02.314 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 847, 2024-03-04T09:26:02.314 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 21416563, 2024-03-04T09:26:02.314 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 326638, 2024-03-04T09:26:02.314 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 5, 2024-03-04T09:26:02.314 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 4, 2024-03-04T09:26:02.314 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.084061237, 2024-03-04T09:26:02.315 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.021576167, 2024-03-04T09:26:02.315 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.055365310, 2024-03-04T09:26:02.315 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.014941709, 2024-03-04T09:26:02.315 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-03-04T09:26:02.315 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 847, 2024-03-04T09:26:02.315 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.021704071, 2024-03-04T09:26:02.315 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000025624 2024-03-04T09:26:02.315 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.315 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-03-04T09:26:02.315 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:02.315 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:02.315 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:02.315 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.316 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 1662608, 2024-03-04T09:26:02.316 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 132592 2024-03-04T09:26:02.316 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.316 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-2": { 2024-03-04T09:26:02.316 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 264, 2024-03-04T09:26:02.316 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 426, 2024-03-04T09:26:02.316 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 8453931, 2024-03-04T09:26:02.316 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 522149, 2024-03-04T09:26:02.316 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 7, 2024-03-04T09:26:02.316 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 5, 2024-03-04T09:26:02.317 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.029995467, 2024-03-04T09:26:02.317 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.009302875, 2024-03-04T09:26:02.317 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.011243441, 2024-03-04T09:26:02.317 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.006562874, 2024-03-04T09:26:02.317 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-03-04T09:26:02.317 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 423, 2024-03-04T09:26:02.317 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.014227469, 2024-03-04T09:26:02.317 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000033634 2024-03-04T09:26:02.317 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.317 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-03-04T09:26:02.317 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:02.317 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:02.318 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:02.318 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.318 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 320, 2024-03-04T09:26:02.318 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 438832 2024-03-04T09:26:02.318 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.318 INFO:teuthology.orchestra.run.smithi102.stdout: "cct": { 2024-03-04T09:26:02.318 INFO:teuthology.orchestra.run.smithi102.stdout: "total_workers": 1, 2024-03-04T09:26:02.318 INFO:teuthology.orchestra.run.smithi102.stdout: "unhealthy_workers": 0 2024-03-04T09:26:02.318 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.318 INFO:teuthology.orchestra.run.smithi102.stdout: "finisher-MDSRank": { 2024-03-04T09:26:02.318 INFO:teuthology.orchestra.run.smithi102.stdout: "queue_len": 0, 2024-03-04T09:26:02.318 INFO:teuthology.orchestra.run.smithi102.stdout: "complete_latency": { 2024-03-04T09:26:02.318 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 3918, 2024-03-04T09:26:02.319 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.076427240, 2024-03-04T09:26:02.319 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000019506 2024-03-04T09:26:02.319 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-03-04T09:26:02.319 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.319 INFO:teuthology.orchestra.run.smithi102.stdout: "finisher-PurgeQueue": { 2024-03-04T09:26:02.319 INFO:teuthology.orchestra.run.smithi102.stdout: "queue_len": 0, 2024-03-04T09:26:02.319 INFO:teuthology.orchestra.run.smithi102.stdout: "complete_latency": { 2024-03-04T09:26:02.319 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:02.319 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:02.319 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:02.319 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-03-04T09:26:02.319 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.319 INFO:teuthology.orchestra.run.smithi102.stdout: "mds": { 2024-03-04T09:26:02.319 INFO:teuthology.orchestra.run.smithi102.stdout: "request": 0, 2024-03-04T09:26:02.320 INFO:teuthology.orchestra.run.smithi102.stdout: "reply": 0, 2024-03-04T09:26:02.320 INFO:teuthology.orchestra.run.smithi102.stdout: "reply_latency": { 2024-03-04T09:26:02.320 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:02.320 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:02.320 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:02.320 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.320 INFO:teuthology.orchestra.run.smithi102.stdout: "slow_reply": 0, 2024-03-04T09:26:02.320 INFO:teuthology.orchestra.run.smithi102.stdout: "forward": 0, 2024-03-04T09:26:02.320 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_fetch_complete": 0, 2024-03-04T09:26:02.320 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_fetch_keys": 0, 2024-03-04T09:26:02.320 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_commit": 0, 2024-03-04T09:26:02.320 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_split": 0, 2024-03-04T09:26:02.321 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_merge": 0, 2024-03-04T09:26:02.321 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes": 8547, 2024-03-04T09:26:02.321 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_top": 0, 2024-03-04T09:26:02.321 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_bottom": 8547, 2024-03-04T09:26:02.321 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_pin_tail": 0, 2024-03-04T09:26:02.321 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_pinned": 8547, 2024-03-04T09:26:02.321 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_expired": 0, 2024-03-04T09:26:02.321 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_with_caps": 0, 2024-03-04T09:26:02.321 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": 0, 2024-03-04T09:26:02.321 INFO:teuthology.orchestra.run.smithi102.stdout: "subtrees": 2, 2024-03-04T09:26:02.321 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse": 0, 2024-03-04T09:26:02.321 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_hit": 0, 2024-03-04T09:26:02.321 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_forward": 0, 2024-03-04T09:26:02.322 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_discover": 0, 2024-03-04T09:26:02.322 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_dir_fetch": 0, 2024-03-04T09:26:02.322 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_remote_ino": 0, 2024-03-04T09:26:02.322 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_lock": 0, 2024-03-04T09:26:02.322 INFO:teuthology.orchestra.run.smithi102.stdout: "load_cent": 0, 2024-03-04T09:26:02.322 INFO:teuthology.orchestra.run.smithi102.stdout: "q": 0, 2024-03-04T09:26:02.322 INFO:teuthology.orchestra.run.smithi102.stdout: "exported": 0, 2024-03-04T09:26:02.322 INFO:teuthology.orchestra.run.smithi102.stdout: "exported_inodes": 0, 2024-03-04T09:26:02.322 INFO:teuthology.orchestra.run.smithi102.stdout: "imported": 0, 2024-03-04T09:26:02.322 INFO:teuthology.orchestra.run.smithi102.stdout: "imported_inodes": 0, 2024-03-04T09:26:02.322 INFO:teuthology.orchestra.run.smithi102.stdout: "openino_dir_fetch": 0, 2024-03-04T09:26:02.322 INFO:teuthology.orchestra.run.smithi102.stdout: "openino_backtrace_fetch": 0, 2024-03-04T09:26:02.322 INFO:teuthology.orchestra.run.smithi102.stdout: "openino_peer_discover": 0, 2024-03-04T09:26:02.322 INFO:teuthology.orchestra.run.smithi102.stdout: "root_rfiles": 4, 2024-03-04T09:26:02.323 INFO:teuthology.orchestra.run.smithi102.stdout: "root_rbytes": 234, 2024-03-04T09:26:02.323 INFO:teuthology.orchestra.run.smithi102.stdout: "root_rsnaps": 6, 2024-03-04T09:26:02.323 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_backtrace_fetch": 0, 2024-03-04T09:26:02.323 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_set_tag": 0, 2024-03-04T09:26:02.323 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_backtrace_repaired": 0, 2024-03-04T09:26:02.323 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_inotable_repaired": 0, 2024-03-04T09:26:02.323 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_dir_inodes": 0, 2024-03-04T09:26:02.323 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_dir_base_inodes": 0, 2024-03-04T09:26:02.323 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_dirfrag_rstats": 0, 2024-03-04T09:26:02.323 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_file_inodes": 0, 2024-03-04T09:26:02.323 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_inode_file_caps": 0, 2024-03-04T09:26:02.323 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_revoke": 0, 2024-03-04T09:26:02.323 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_grant": 0, 2024-03-04T09:26:02.324 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_trunc": 0, 2024-03-04T09:26:02.324 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-03-04T09:26:02.324 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_flush_ack": 0, 2024-03-04T09:26:02.324 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_caps": 0, 2024-03-04T09:26:02.324 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_caps_dirty": 0, 2024-03-04T09:26:02.324 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_cap_release": 0, 2024-03-04T09:26:02.324 INFO:teuthology.orchestra.run.smithi102.stdout: "process_request_cap_release": 0 2024-03-04T09:26:02.324 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.324 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_cache": { 2024-03-04T09:26:02.324 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_update": 0, 2024-03-04T09:26:02.324 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_update_receipt": 0, 2024-03-04T09:26:02.324 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_try_discover": 0, 2024-03-04T09:26:02.324 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_send_discover": 0, 2024-03-04T09:26:02.325 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_handle_discover": 0, 2024-03-04T09:26:02.325 INFO:teuthology.orchestra.run.smithi102.stdout: "num_strays": 0, 2024-03-04T09:26:02.325 INFO:teuthology.orchestra.run.smithi102.stdout: "num_strays_delayed": 0, 2024-03-04T09:26:02.325 INFO:teuthology.orchestra.run.smithi102.stdout: "num_strays_enqueuing": 0, 2024-03-04T09:26:02.325 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_created": 0, 2024-03-04T09:26:02.325 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_enqueued": 0, 2024-03-04T09:26:02.325 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_reintegrated": 0, 2024-03-04T09:26:02.325 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_migrated": 0, 2024-03-04T09:26:02.325 INFO:teuthology.orchestra.run.smithi102.stdout: "num_recovering_processing": 0, 2024-03-04T09:26:02.325 INFO:teuthology.orchestra.run.smithi102.stdout: "num_recovering_enqueued": 0, 2024-03-04T09:26:02.325 INFO:teuthology.orchestra.run.smithi102.stdout: "num_recovering_prioritized": 0, 2024-03-04T09:26:02.325 INFO:teuthology.orchestra.run.smithi102.stdout: "recovery_started": 0, 2024-03-04T09:26:02.325 INFO:teuthology.orchestra.run.smithi102.stdout: "recovery_completed": 0, 2024-03-04T09:26:02.325 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_enqueue_scrub": 0, 2024-03-04T09:26:02.325 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_exportdir": 0, 2024-03-04T09:26:02.326 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_flush": 0, 2024-03-04T09:26:02.326 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_fragmentdir": 0, 2024-03-04T09:26:02.326 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_fragstats": 0, 2024-03-04T09:26:02.326 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_inodestats": 0 2024-03-04T09:26:02.326 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.326 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_log": { 2024-03-04T09:26:02.326 INFO:teuthology.orchestra.run.smithi102.stdout: "evlrg": 0, 2024-03-04T09:26:02.326 INFO:teuthology.orchestra.run.smithi102.stdout: "evadd": 0, 2024-03-04T09:26:02.326 INFO:teuthology.orchestra.run.smithi102.stdout: "evex": 0, 2024-03-04T09:26:02.326 INFO:teuthology.orchestra.run.smithi102.stdout: "evtrm": 0, 2024-03-04T09:26:02.326 INFO:teuthology.orchestra.run.smithi102.stdout: "ev": 19972, 2024-03-04T09:26:02.326 INFO:teuthology.orchestra.run.smithi102.stdout: "evexg": 0, 2024-03-04T09:26:02.326 INFO:teuthology.orchestra.run.smithi102.stdout: "evexd": 0, 2024-03-04T09:26:02.326 INFO:teuthology.orchestra.run.smithi102.stdout: "segadd": 0, 2024-03-04T09:26:02.326 INFO:teuthology.orchestra.run.smithi102.stdout: "segex": 0, 2024-03-04T09:26:02.327 INFO:teuthology.orchestra.run.smithi102.stdout: "segtrm": 0, 2024-03-04T09:26:02.327 INFO:teuthology.orchestra.run.smithi102.stdout: "seg": 27, 2024-03-04T09:26:02.327 INFO:teuthology.orchestra.run.smithi102.stdout: "segmjr": 3, 2024-03-04T09:26:02.327 INFO:teuthology.orchestra.run.smithi102.stdout: "segexg": 0, 2024-03-04T09:26:02.327 INFO:teuthology.orchestra.run.smithi102.stdout: "segexd": 0, 2024-03-04T09:26:02.327 INFO:teuthology.orchestra.run.smithi102.stdout: "expos": 4194304, 2024-03-04T09:26:02.327 INFO:teuthology.orchestra.run.smithi102.stdout: "wrpos": 48954951, 2024-03-04T09:26:02.327 INFO:teuthology.orchestra.run.smithi102.stdout: "rdpos": 48953630, 2024-03-04T09:26:02.327 INFO:teuthology.orchestra.run.smithi102.stdout: "jlat": { 2024-03-04T09:26:02.327 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:02.327 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:02.327 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:02.327 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.327 INFO:teuthology.orchestra.run.smithi102.stdout: "replayed": 19972 2024-03-04T09:26:02.328 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.328 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_mem": { 2024-03-04T09:26:02.328 INFO:teuthology.orchestra.run.smithi102.stdout: "ino": 2294, 2024-03-04T09:26:02.328 INFO:teuthology.orchestra.run.smithi102.stdout: "ino+": 6951, 2024-03-04T09:26:02.328 INFO:teuthology.orchestra.run.smithi102.stdout: "ino-": 4657, 2024-03-04T09:26:02.328 INFO:teuthology.orchestra.run.smithi102.stdout: "dir": 230, 2024-03-04T09:26:02.328 INFO:teuthology.orchestra.run.smithi102.stdout: "dir+": 326, 2024-03-04T09:26:02.328 INFO:teuthology.orchestra.run.smithi102.stdout: "dir-": 96, 2024-03-04T09:26:02.328 INFO:teuthology.orchestra.run.smithi102.stdout: "dn": 8547, 2024-03-04T09:26:02.328 INFO:teuthology.orchestra.run.smithi102.stdout: "dn+": 9455, 2024-03-04T09:26:02.328 INFO:teuthology.orchestra.run.smithi102.stdout: "dn-": 908, 2024-03-04T09:26:02.328 INFO:teuthology.orchestra.run.smithi102.stdout: "cap": 0, 2024-03-04T09:26:02.329 INFO:teuthology.orchestra.run.smithi102.stdout: "cap+": 0, 2024-03-04T09:26:02.329 INFO:teuthology.orchestra.run.smithi102.stdout: "cap-": 0, 2024-03-04T09:26:02.329 INFO:teuthology.orchestra.run.smithi102.stdout: "rss": 67604, 2024-03-04T09:26:02.329 INFO:teuthology.orchestra.run.smithi102.stdout: "heap": 215420 2024-03-04T09:26:02.329 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.329 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_server": { 2024-03-04T09:26:02.329 INFO:teuthology.orchestra.run.smithi102.stdout: "dispatch_client_request": 0, 2024-03-04T09:26:02.329 INFO:teuthology.orchestra.run.smithi102.stdout: "dispatch_server_request": 0, 2024-03-04T09:26:02.329 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_request": 0, 2024-03-04T09:26:02.329 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_session": 0, 2024-03-04T09:26:02.329 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_peer_request": 0, 2024-03-04T09:26:02.329 INFO:teuthology.orchestra.run.smithi102.stdout: "req_create_latency": { 2024-03-04T09:26:02.329 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:02.329 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:02.330 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:02.330 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.330 INFO:teuthology.orchestra.run.smithi102.stdout: "req_getattr_latency": { 2024-03-04T09:26:02.330 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:02.330 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:02.330 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:02.330 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.330 INFO:teuthology.orchestra.run.smithi102.stdout: "req_getfilelock_latency": { 2024-03-04T09:26:02.330 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:02.330 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:02.330 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:02.330 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.330 INFO:teuthology.orchestra.run.smithi102.stdout: "req_link_latency": { 2024-03-04T09:26:02.330 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:02.330 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:02.331 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:02.331 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.331 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookup_latency": { 2024-03-04T09:26:02.331 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:02.331 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:02.331 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:02.331 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.331 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookuphash_latency": { 2024-03-04T09:26:02.331 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:02.331 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:02.331 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:02.331 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.331 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupino_latency": { 2024-03-04T09:26:02.331 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:02.331 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:02.332 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:02.332 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.332 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupname_latency": { 2024-03-04T09:26:02.332 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:02.332 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:02.332 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:02.332 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.332 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupparent_latency": { 2024-03-04T09:26:02.332 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:02.332 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:02.332 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:02.332 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.332 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupsnap_latency": { 2024-03-04T09:26:02.333 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:02.333 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:02.333 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:02.333 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.333 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lssnap_latency": { 2024-03-04T09:26:02.333 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:02.333 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:02.333 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:02.333 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.333 INFO:teuthology.orchestra.run.smithi102.stdout: "req_mkdir_latency": { 2024-03-04T09:26:02.333 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:02.333 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:02.334 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:02.334 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.334 INFO:teuthology.orchestra.run.smithi102.stdout: "req_mknod_latency": { 2024-03-04T09:26:02.334 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:02.334 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:02.334 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:02.334 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.334 INFO:teuthology.orchestra.run.smithi102.stdout: "req_mksnap_latency": { 2024-03-04T09:26:02.335 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:02.335 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:02.335 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:02.335 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.335 INFO:teuthology.orchestra.run.smithi102.stdout: "req_open_latency": { 2024-03-04T09:26:02.335 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:02.335 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:02.335 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:02.335 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.335 INFO:teuthology.orchestra.run.smithi102.stdout: "req_readdir_latency": { 2024-03-04T09:26:02.335 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:02.335 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:02.335 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:02.336 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.336 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rename_latency": { 2024-03-04T09:26:02.336 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:02.336 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:02.336 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:02.336 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.336 INFO:teuthology.orchestra.run.smithi102.stdout: "req_renamesnap_latency": { 2024-03-04T09:26:02.336 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:02.336 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:02.336 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:02.336 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.336 INFO:teuthology.orchestra.run.smithi102.stdout: "req_snapdiff_latency": { 2024-03-04T09:26:02.336 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:02.337 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:02.337 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:02.337 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.337 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rmdir_latency": { 2024-03-04T09:26:02.337 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:02.337 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:02.337 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:02.337 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.337 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rmsnap_latency": { 2024-03-04T09:26:02.337 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:02.337 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:02.337 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:02.337 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.338 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rmxattr_latency": { 2024-03-04T09:26:02.338 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:02.338 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:02.338 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:02.338 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.338 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setattr_latency": { 2024-03-04T09:26:02.338 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:02.338 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:02.338 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:02.338 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.338 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setdirlayout_latency": { 2024-03-04T09:26:02.338 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:02.338 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:02.338 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:02.339 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.339 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setfilelock_latency": { 2024-03-04T09:26:02.339 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:02.339 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:02.339 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:02.339 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.339 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setlayout_latency": { 2024-03-04T09:26:02.339 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:02.339 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:02.339 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:02.339 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.339 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setxattr_latency": { 2024-03-04T09:26:02.339 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:02.340 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:02.340 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:02.340 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.340 INFO:teuthology.orchestra.run.smithi102.stdout: "req_symlink_latency": { 2024-03-04T09:26:02.340 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:02.340 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:02.340 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:02.340 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.340 INFO:teuthology.orchestra.run.smithi102.stdout: "req_unlink_latency": { 2024-03-04T09:26:02.340 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:02.340 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:02.340 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:02.340 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.341 INFO:teuthology.orchestra.run.smithi102.stdout: "cap_revoke_eviction": 0, 2024-03-04T09:26:02.341 INFO:teuthology.orchestra.run.smithi102.stdout: "cap_acquisition_throttle": 0, 2024-03-04T09:26:02.341 INFO:teuthology.orchestra.run.smithi102.stdout: "req_getvxattr_latency": { 2024-03-04T09:26:02.341 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:02.341 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:02.341 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:02.341 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-03-04T09:26:02.341 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.341 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_sessions": { 2024-03-04T09:26:02.341 INFO:teuthology.orchestra.run.smithi102.stdout: "session_count": 2, 2024-03-04T09:26:02.341 INFO:teuthology.orchestra.run.smithi102.stdout: "session_add": 6, 2024-03-04T09:26:02.341 INFO:teuthology.orchestra.run.smithi102.stdout: "session_remove": 4, 2024-03-04T09:26:02.341 INFO:teuthology.orchestra.run.smithi102.stdout: "sessions_open": 4, 2024-03-04T09:26:02.341 INFO:teuthology.orchestra.run.smithi102.stdout: "sessions_stale": 0, 2024-03-04T09:26:02.342 INFO:teuthology.orchestra.run.smithi102.stdout: "total_load": 0, 2024-03-04T09:26:02.342 INFO:teuthology.orchestra.run.smithi102.stdout: "average_load": 0, 2024-03-04T09:26:02.342 INFO:teuthology.orchestra.run.smithi102.stdout: "avg_session_uptime": 2975, 2024-03-04T09:26:02.342 INFO:teuthology.orchestra.run.smithi102.stdout: "mdthresh_evicted": 0 2024-03-04T09:26:02.342 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.342 INFO:teuthology.orchestra.run.smithi102.stdout: "mempool": { 2024-03-04T09:26:02.342 INFO:teuthology.orchestra.run.smithi102.stdout: "bloom_filter_bytes": 0, 2024-03-04T09:26:02.342 INFO:teuthology.orchestra.run.smithi102.stdout: "bloom_filter_items": 0, 2024-03-04T09:26:02.342 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_alloc_bytes": 0, 2024-03-04T09:26:02.342 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_alloc_items": 0, 2024-03-04T09:26:02.342 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_data_bytes": 0, 2024-03-04T09:26:02.342 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_data_items": 0, 2024-03-04T09:26:02.342 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-04T09:26:02.343 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_onode_items": 0, 2024-03-04T09:26:02.343 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-04T09:26:02.343 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_meta_items": 0, 2024-03-04T09:26:02.343 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_other_bytes": 0, 2024-03-04T09:26:02.343 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_other_items": 0, 2024-03-04T09:26:02.343 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-04T09:26:02.343 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_buffer_items": 0, 2024-03-04T09:26:02.343 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_extent_bytes": 0, 2024-03-04T09:26:02.343 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_extent_items": 0, 2024-03-04T09:26:02.343 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_blob_bytes": 0, 2024-03-04T09:26:02.343 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_blob_items": 0, 2024-03-04T09:26:02.343 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-04T09:26:02.343 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_shared_blob_items": 0, 2024-03-04T09:26:02.343 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-04T09:26:02.344 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_inline_bl_items": 0, 2024-03-04T09:26:02.344 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_bytes": 0, 2024-03-04T09:26:02.344 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_items": 0, 2024-03-04T09:26:02.344 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_txc_bytes": 0, 2024-03-04T09:26:02.344 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_txc_items": 0, 2024-03-04T09:26:02.344 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-04T09:26:02.344 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_deferred_items": 0, 2024-03-04T09:26:02.344 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_bytes": 0, 2024-03-04T09:26:02.344 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_items": 0, 2024-03-04T09:26:02.344 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_bytes": 0, 2024-03-04T09:26:02.344 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_items": 0, 2024-03-04T09:26:02.344 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_reader_bytes": 0, 2024-03-04T09:26:02.344 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_reader_items": 0, 2024-03-04T09:26:02.345 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_writer_bytes": 0, 2024-03-04T09:26:02.345 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_writer_items": 0, 2024-03-04T09:26:02.345 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_anon_bytes": 214497, 2024-03-04T09:26:02.345 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_anon_items": 67, 2024-03-04T09:26:02.345 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_meta_bytes": 0, 2024-03-04T09:26:02.345 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_meta_items": 0, 2024-03-04T09:26:02.345 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_bytes": 0, 2024-03-04T09:26:02.345 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_items": 0, 2024-03-04T09:26:02.345 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mapbl_bytes": 0, 2024-03-04T09:26:02.345 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mapbl_items": 0, 2024-03-04T09:26:02.345 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pglog_bytes": 0, 2024-03-04T09:26:02.345 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pglog_items": 0, 2024-03-04T09:26:02.345 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_bytes": 9832, 2024-03-04T09:26:02.345 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_items": 205, 2024-03-04T09:26:02.346 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_mapping_bytes": 0, 2024-03-04T09:26:02.346 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_mapping_items": 0, 2024-03-04T09:26:02.346 INFO:teuthology.orchestra.run.smithi102.stdout: "pgmap_bytes": 0, 2024-03-04T09:26:02.346 INFO:teuthology.orchestra.run.smithi102.stdout: "pgmap_items": 0, 2024-03-04T09:26:02.346 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_co_bytes": 11233877, 2024-03-04T09:26:02.346 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_co_items": 93241, 2024-03-04T09:26:02.346 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_1_bytes": 0, 2024-03-04T09:26:02.346 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_1_items": 0, 2024-03-04T09:26:02.346 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_2_bytes": 0, 2024-03-04T09:26:02.346 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_2_items": 0 2024-03-04T09:26:02.346 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.346 INFO:teuthology.orchestra.run.smithi102.stdout: "objecter": { 2024-03-04T09:26:02.346 INFO:teuthology.orchestra.run.smithi102.stdout: "op_active": 0, 2024-03-04T09:26:02.346 INFO:teuthology.orchestra.run.smithi102.stdout: "op_laggy": 0, 2024-03-04T09:26:02.346 INFO:teuthology.orchestra.run.smithi102.stdout: "op_send": 2371, 2024-03-04T09:26:02.346 INFO:teuthology.orchestra.run.smithi102.stdout: "op_send_bytes": 26, 2024-03-04T09:26:02.347 INFO:teuthology.orchestra.run.smithi102.stdout: "op_resend": 4, 2024-03-04T09:26:02.347 INFO:teuthology.orchestra.run.smithi102.stdout: "op_reply": 2371, 2024-03-04T09:26:02.347 INFO:teuthology.orchestra.run.smithi102.stdout: "op_latency": { 2024-03-04T09:26:02.347 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 2371, 2024-03-04T09:26:02.347 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 2.011956115, 2024-03-04T09:26:02.347 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000848568 2024-03-04T09:26:02.347 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.347 INFO:teuthology.orchestra.run.smithi102.stdout: "op_inflight": 0, 2024-03-04T09:26:02.347 INFO:teuthology.orchestra.run.smithi102.stdout: "oplen_avg": { 2024-03-04T09:26:02.347 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 2371, 2024-03-04T09:26:02.347 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 2372 2024-03-04T09:26:02.347 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.347 INFO:teuthology.orchestra.run.smithi102.stdout: "op": 2371, 2024-03-04T09:26:02.347 INFO:teuthology.orchestra.run.smithi102.stdout: "op_r": 2371, 2024-03-04T09:26:02.348 INFO:teuthology.orchestra.run.smithi102.stdout: "op_w": 0, 2024-03-04T09:26:02.348 INFO:teuthology.orchestra.run.smithi102.stdout: "op_rmw": 0, 2024-03-04T09:26:02.348 INFO:teuthology.orchestra.run.smithi102.stdout: "op_pg": 0, 2024-03-04T09:26:02.348 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_stat": 1497, 2024-03-04T09:26:02.348 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_create": 0, 2024-03-04T09:26:02.348 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_read": 871, 2024-03-04T09:26:02.348 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_write": 0, 2024-03-04T09:26:02.348 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_writefull": 0, 2024-03-04T09:26:02.348 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_writesame": 0, 2024-03-04T09:26:02.348 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_append": 0, 2024-03-04T09:26:02.348 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_zero": 0, 2024-03-04T09:26:02.348 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_truncate": 0, 2024-03-04T09:26:02.348 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_delete": 0, 2024-03-04T09:26:02.348 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_mapext": 0, 2024-03-04T09:26:02.349 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_sparse_read": 0, 2024-03-04T09:26:02.349 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_clonerange": 0, 2024-03-04T09:26:02.349 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_getxattr": 2, 2024-03-04T09:26:02.349 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_setxattr": 0, 2024-03-04T09:26:02.349 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_cmpxattr": 0, 2024-03-04T09:26:02.349 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_rmxattr": 0, 2024-03-04T09:26:02.349 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_resetxattrs": 0, 2024-03-04T09:26:02.349 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_call": 0, 2024-03-04T09:26:02.349 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_watch": 0, 2024-03-04T09:26:02.349 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_notify": 0, 2024-03-04T09:26:02.349 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_src_cmpxattr": 0, 2024-03-04T09:26:02.349 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_pgls": 0, 2024-03-04T09:26:02.349 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_pgls_filter": 0, 2024-03-04T09:26:02.349 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_other": 0, 2024-03-04T09:26:02.349 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_active": 0, 2024-03-04T09:26:02.349 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_send": 0, 2024-03-04T09:26:02.350 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_resend": 0, 2024-03-04T09:26:02.350 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_ping": 0, 2024-03-04T09:26:02.350 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_active": 0, 2024-03-04T09:26:02.350 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_send": 0, 2024-03-04T09:26:02.350 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_resend": 0, 2024-03-04T09:26:02.350 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_active": 0, 2024-03-04T09:26:02.350 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_send": 0, 2024-03-04T09:26:02.350 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_resend": 0, 2024-03-04T09:26:02.350 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_active": 0, 2024-03-04T09:26:02.350 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_send": 0, 2024-03-04T09:26:02.350 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_resend": 0, 2024-03-04T09:26:02.350 INFO:teuthology.orchestra.run.smithi102.stdout: "command_active": 0, 2024-03-04T09:26:02.350 INFO:teuthology.orchestra.run.smithi102.stdout: "command_send": 0, 2024-03-04T09:26:02.350 INFO:teuthology.orchestra.run.smithi102.stdout: "command_resend": 0, 2024-03-04T09:26:02.350 INFO:teuthology.orchestra.run.smithi102.stdout: "map_epoch": 104, 2024-03-04T09:26:02.350 INFO:teuthology.orchestra.run.smithi102.stdout: "map_full": 0, 2024-03-04T09:26:02.351 INFO:teuthology.orchestra.run.smithi102.stdout: "map_inc": 14, 2024-03-04T09:26:02.351 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_sessions": 8, 2024-03-04T09:26:02.351 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_session_open": 8, 2024-03-04T09:26:02.351 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_session_close": 0, 2024-03-04T09:26:02.351 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_laggy": 0, 2024-03-04T09:26:02.351 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_wr": 0, 2024-03-04T09:26:02.351 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_rd": 2, 2024-03-04T09:26:02.351 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_del": 0 2024-03-04T09:26:02.351 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.351 INFO:teuthology.orchestra.run.smithi102.stdout: "oft": { 2024-03-04T09:26:02.351 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_objs": 0, 2024-03-04T09:26:02.351 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_kv_pairs": 0, 2024-03-04T09:26:02.351 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_updates": 0, 2024-03-04T09:26:02.351 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_removes": 0 2024-03-04T09:26:02.351 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.352 INFO:teuthology.orchestra.run.smithi102.stdout: "osd-slow-ops": { 2024-03-04T09:26:02.352 INFO:teuthology.orchestra.run.smithi102.stdout: "slow_ops_count": 0 2024-03-04T09:26:02.352 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.352 INFO:teuthology.orchestra.run.smithi102.stdout: "purge_queue": { 2024-03-04T09:26:02.352 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing_ops": 0, 2024-03-04T09:26:02.352 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing_ops_high_water": 0, 2024-03-04T09:26:02.352 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing": 0, 2024-03-04T09:26:02.352 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing_high_water": 0, 2024-03-04T09:26:02.352 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executed_ops": 0, 2024-03-04T09:26:02.352 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executed": 0, 2024-03-04T09:26:02.352 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_item_in_journal": 0 2024-03-04T09:26:02.352 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.352 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-04T09:26:02.352 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-03-04T09:26:02.353 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 104857600, 2024-03-04T09:26:02.353 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-03-04T09:26:02.353 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 2650, 2024-03-04T09:26:02.353 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 46832710, 2024-03-04T09:26:02.353 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-03-04T09:26:02.353 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 2650, 2024-03-04T09:26:02.353 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2024-03-04T09:26:02.353 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2024-03-04T09:26:02.353 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 2650, 2024-03-04T09:26:02.353 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 46832710, 2024-03-04T09:26:02.353 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-03-04T09:26:02.353 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:02.353 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:02.353 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:02.353 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-03-04T09:26:02.354 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.354 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-objecter_bytes": { 2024-03-04T09:26:02.354 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-03-04T09:26:02.354 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 104857600, 2024-03-04T09:26:02.354 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-03-04T09:26:02.354 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 0, 2024-03-04T09:26:02.354 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 0, 2024-03-04T09:26:02.354 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-03-04T09:26:02.354 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 0, 2024-03-04T09:26:02.354 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 2371, 2024-03-04T09:26:02.354 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 44760657, 2024-03-04T09:26:02.354 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 2371, 2024-03-04T09:26:02.354 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 44760657, 2024-03-04T09:26:02.354 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-03-04T09:26:02.355 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:02.355 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:02.355 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:02.355 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-03-04T09:26:02.355 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.355 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-objecter_ops": { 2024-03-04T09:26:02.355 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-03-04T09:26:02.355 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 1024, 2024-03-04T09:26:02.355 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-03-04T09:26:02.355 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 0, 2024-03-04T09:26:02.355 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 0, 2024-03-04T09:26:02.355 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-03-04T09:26:02.355 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 0, 2024-03-04T09:26:02.355 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 2371, 2024-03-04T09:26:02.356 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 2371, 2024-03-04T09:26:02.356 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 2371, 2024-03-04T09:26:02.356 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 2371, 2024-03-04T09:26:02.356 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-03-04T09:26:02.356 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:02.356 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:02.356 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:02.356 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-03-04T09:26:02.356 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.356 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-write_buf_throttle": { 2024-03-04T09:26:02.356 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-03-04T09:26:02.356 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 3758096384, 2024-03-04T09:26:02.356 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-03-04T09:26:02.356 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 0, 2024-03-04T09:26:02.357 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 0, 2024-03-04T09:26:02.357 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-03-04T09:26:02.357 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 0, 2024-03-04T09:26:02.357 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2024-03-04T09:26:02.357 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2024-03-04T09:26:02.357 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 0, 2024-03-04T09:26:02.357 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 0, 2024-03-04T09:26:02.357 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-03-04T09:26:02.357 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:02.357 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:02.357 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:02.357 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-03-04T09:26:02.357 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:02.357 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-write_buf_throttle-0x56090b24c960": { 2024-03-04T09:26:02.357 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-03-04T09:26:02.357 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 3758096384, 2024-03-04T09:26:02.358 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-03-04T09:26:02.358 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 0, 2024-03-04T09:26:02.358 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 0, 2024-03-04T09:26:02.358 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-03-04T09:26:02.358 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 0, 2024-03-04T09:26:02.358 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2024-03-04T09:26:02.358 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2024-03-04T09:26:02.358 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 0, 2024-03-04T09:26:02.358 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 0, 2024-03-04T09:26:02.358 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-03-04T09:26:02.358 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:02.358 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:02.358 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:02.358 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-03-04T09:26:02.358 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-03-04T09:26:02.358 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-03-04T09:26:02.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:02 smithi102 ceph-mon[36220]: pgmap v323: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:26:02.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:02 smithi082 ceph-mon[32880]: pgmap v323: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:26:02.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:02 smithi190 ceph-mon[36341]: pgmap v323: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-03-04T09:26:03.104 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-03-04T09:26:03.104 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-03-04T09:26:03.104 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=6 2024-03-04T09:26:03.105 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-03-04T09:26:03.105 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-03-04T09:26:03.105 DEBUG:tasks.check_counter:Getting stats from h 2024-03-04T09:26:03.105 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph daemon mds.h perf dump 2024-03-04T09:26:03.397 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.b/config 2024-03-04T09:26:03.806 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:03 smithi102 ceph-mon[36220]: pgmap v324: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:26:03.895 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:03 smithi082 ceph-mon[32880]: pgmap v324: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:26:03.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:03 smithi190 ceph-mon[36341]: pgmap v324: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-03-04T09:26:05.161 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-03-04T09:26:05.161 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-0": { 2024-03-04T09:26:05.161 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 32035, 2024-03-04T09:26:05.161 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 58094, 2024-03-04T09:26:05.161 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 11691396, 2024-03-04T09:26:05.161 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 44055999, 2024-03-04T09:26:05.161 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 15, 2024-03-04T09:26:05.161 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 6, 2024-03-04T09:26:05.161 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 2.316436231, 2024-03-04T09:26:05.162 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.973845369, 2024-03-04T09:26:05.162 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 1.201005940, 2024-03-04T09:26:05.162 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.207461955, 2024-03-04T09:26:05.162 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-03-04T09:26:05.162 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 58092, 2024-03-04T09:26:05.162 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 1.594070643, 2024-03-04T09:26:05.162 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000027440 2024-03-04T09:26:05.162 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.162 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-03-04T09:26:05.162 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 75203, 2024-03-04T09:26:05.162 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.013080835, 2024-03-04T09:26:05.162 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000173 2024-03-04T09:26:05.162 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.162 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 0, 2024-03-04T09:26:05.163 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 0 2024-03-04T09:26:05.163 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.163 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-1": { 2024-03-04T09:26:05.163 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 6585, 2024-03-04T09:26:05.163 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 7133, 2024-03-04T09:26:05.163 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 3325615, 2024-03-04T09:26:05.163 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 32810902, 2024-03-04T09:26:05.163 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 8, 2024-03-04T09:26:05.163 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 7, 2024-03-04T09:26:05.163 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.777688179, 2024-03-04T09:26:05.163 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.291376667, 2024-03-04T09:26:05.163 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.199800587, 2024-03-04T09:26:05.163 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.247022874, 2024-03-04T09:26:05.163 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-03-04T09:26:05.163 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 7133, 2024-03-04T09:26:05.164 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.475791485, 2024-03-04T09:26:05.164 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000066702 2024-03-04T09:26:05.164 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.164 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-03-04T09:26:05.164 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 2407, 2024-03-04T09:26:05.164 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000411145, 2024-03-04T09:26:05.164 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000170 2024-03-04T09:26:05.164 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.164 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 1676928, 2024-03-04T09:26:05.164 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 446320 2024-03-04T09:26:05.164 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.164 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-2": { 2024-03-04T09:26:05.164 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 9474, 2024-03-04T09:26:05.164 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 10866, 2024-03-04T09:26:05.165 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 3309236, 2024-03-04T09:26:05.165 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 16217974, 2024-03-04T09:26:05.165 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 12, 2024-03-04T09:26:05.165 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 9, 2024-03-04T09:26:05.165 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.919882916, 2024-03-04T09:26:05.165 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.356757235, 2024-03-04T09:26:05.165 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.323137531, 2024-03-04T09:26:05.165 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.224593906, 2024-03-04T09:26:05.165 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-03-04T09:26:05.165 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 10863, 2024-03-04T09:26:05.165 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.518586487, 2024-03-04T09:26:05.165 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000047738 2024-03-04T09:26:05.166 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.166 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-03-04T09:26:05.166 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 10433, 2024-03-04T09:26:05.166 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.001802754, 2024-03-04T09:26:05.166 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000172 2024-03-04T09:26:05.166 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.166 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 2816, 2024-03-04T09:26:05.166 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 136544 2024-03-04T09:26:05.166 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.166 INFO:teuthology.orchestra.run.smithi102.stdout: "cct": { 2024-03-04T09:26:05.166 INFO:teuthology.orchestra.run.smithi102.stdout: "total_workers": 1, 2024-03-04T09:26:05.166 INFO:teuthology.orchestra.run.smithi102.stdout: "unhealthy_workers": 0 2024-03-04T09:26:05.166 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.167 INFO:teuthology.orchestra.run.smithi102.stdout: "finisher-MDSRank": { 2024-03-04T09:26:05.167 INFO:teuthology.orchestra.run.smithi102.stdout: "queue_len": 0, 2024-03-04T09:26:05.167 INFO:teuthology.orchestra.run.smithi102.stdout: "complete_latency": { 2024-03-04T09:26:05.167 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 2565, 2024-03-04T09:26:05.167 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 12.673312212, 2024-03-04T09:26:05.167 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.004940862 2024-03-04T09:26:05.167 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-03-04T09:26:05.167 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.167 INFO:teuthology.orchestra.run.smithi102.stdout: "finisher-PurgeQueue": { 2024-03-04T09:26:05.167 INFO:teuthology.orchestra.run.smithi102.stdout: "queue_len": 0, 2024-03-04T09:26:05.167 INFO:teuthology.orchestra.run.smithi102.stdout: "complete_latency": { 2024-03-04T09:26:05.167 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 11158, 2024-03-04T09:26:05.167 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 2.011039702, 2024-03-04T09:26:05.168 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000180232 2024-03-04T09:26:05.168 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-03-04T09:26:05.168 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.168 INFO:teuthology.orchestra.run.smithi102.stdout: "mds": { 2024-03-04T09:26:05.168 INFO:teuthology.orchestra.run.smithi102.stdout: "request": 14944, 2024-03-04T09:26:05.168 INFO:teuthology.orchestra.run.smithi102.stdout: "reply": 14536, 2024-03-04T09:26:05.168 INFO:teuthology.orchestra.run.smithi102.stdout: "reply_latency": { 2024-03-04T09:26:05.168 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 14536, 2024-03-04T09:26:05.168 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 31.437826583, 2024-03-04T09:26:05.168 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.002162756 2024-03-04T09:26:05.168 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.168 INFO:teuthology.orchestra.run.smithi102.stdout: "slow_reply": 0, 2024-03-04T09:26:05.168 INFO:teuthology.orchestra.run.smithi102.stdout: "forward": 408, 2024-03-04T09:26:05.169 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_fetch_complete": 0, 2024-03-04T09:26:05.169 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_fetch_keys": 0, 2024-03-04T09:26:05.169 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_commit": 66, 2024-03-04T09:26:05.169 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_split": 6, 2024-03-04T09:26:05.169 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_merge": 1, 2024-03-04T09:26:05.169 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes": 5106, 2024-03-04T09:26:05.169 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_top": 96, 2024-03-04T09:26:05.169 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_bottom": 1365, 2024-03-04T09:26:05.169 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_pin_tail": 3645, 2024-03-04T09:26:05.169 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_pinned": 4884, 2024-03-04T09:26:05.169 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_expired": 1167, 2024-03-04T09:26:05.169 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_with_caps": 1, 2024-03-04T09:26:05.169 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": 1, 2024-03-04T09:26:05.169 INFO:teuthology.orchestra.run.smithi102.stdout: "subtrees": 10, 2024-03-04T09:26:05.170 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse": 16644, 2024-03-04T09:26:05.170 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_hit": 15165, 2024-03-04T09:26:05.170 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_forward": 312, 2024-03-04T09:26:05.170 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_discover": 23, 2024-03-04T09:26:05.170 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_dir_fetch": 0, 2024-03-04T09:26:05.170 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_remote_ino": 0, 2024-03-04T09:26:05.170 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_lock": 0, 2024-03-04T09:26:05.170 INFO:teuthology.orchestra.run.smithi102.stdout: "load_cent": 0, 2024-03-04T09:26:05.170 INFO:teuthology.orchestra.run.smithi102.stdout: "q": 0, 2024-03-04T09:26:05.170 INFO:teuthology.orchestra.run.smithi102.stdout: "exported": 63, 2024-03-04T09:26:05.170 INFO:teuthology.orchestra.run.smithi102.stdout: "exported_inodes": 1130, 2024-03-04T09:26:05.170 INFO:teuthology.orchestra.run.smithi102.stdout: "imported": 64, 2024-03-04T09:26:05.170 INFO:teuthology.orchestra.run.smithi102.stdout: "imported_inodes": 857, 2024-03-04T09:26:05.170 INFO:teuthology.orchestra.run.smithi102.stdout: "openino_dir_fetch": 0, 2024-03-04T09:26:05.171 INFO:teuthology.orchestra.run.smithi102.stdout: "openino_backtrace_fetch": 0, 2024-03-04T09:26:05.171 INFO:teuthology.orchestra.run.smithi102.stdout: "openino_peer_discover": 0, 2024-03-04T09:26:05.171 INFO:teuthology.orchestra.run.smithi102.stdout: "root_rfiles": 4, 2024-03-04T09:26:05.171 INFO:teuthology.orchestra.run.smithi102.stdout: "root_rbytes": 234, 2024-03-04T09:26:05.171 INFO:teuthology.orchestra.run.smithi102.stdout: "root_rsnaps": 0, 2024-03-04T09:26:05.171 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_backtrace_fetch": 0, 2024-03-04T09:26:05.171 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_set_tag": 0, 2024-03-04T09:26:05.171 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_backtrace_repaired": 0, 2024-03-04T09:26:05.171 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_inotable_repaired": 0, 2024-03-04T09:26:05.171 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_dir_inodes": 0, 2024-03-04T09:26:05.171 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_dir_base_inodes": 0, 2024-03-04T09:26:05.171 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_dirfrag_rstats": 0, 2024-03-04T09:26:05.171 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_file_inodes": 0, 2024-03-04T09:26:05.171 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_inode_file_caps": 10, 2024-03-04T09:26:05.171 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_revoke": 2217, 2024-03-04T09:26:05.172 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_grant": 13799, 2024-03-04T09:26:05.172 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_trunc": 0, 2024-03-04T09:26:05.172 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-03-04T09:26:05.172 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_flush_ack": 0, 2024-03-04T09:26:05.172 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_caps": 11836, 2024-03-04T09:26:05.172 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_caps_dirty": 6547, 2024-03-04T09:26:05.172 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_cap_release": 58, 2024-03-04T09:26:05.172 INFO:teuthology.orchestra.run.smithi102.stdout: "process_request_cap_release": 19705 2024-03-04T09:26:05.172 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.172 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_cache": { 2024-03-04T09:26:05.172 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_update": 0, 2024-03-04T09:26:05.172 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_update_receipt": 0, 2024-03-04T09:26:05.172 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_try_discover": 0, 2024-03-04T09:26:05.172 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_send_discover": 22, 2024-03-04T09:26:05.172 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_handle_discover": 70, 2024-03-04T09:26:05.173 INFO:teuthology.orchestra.run.smithi102.stdout: "num_strays": 178, 2024-03-04T09:26:05.173 INFO:teuthology.orchestra.run.smithi102.stdout: "num_strays_delayed": 0, 2024-03-04T09:26:05.173 INFO:teuthology.orchestra.run.smithi102.stdout: "num_strays_enqueuing": 0, 2024-03-04T09:26:05.173 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_created": 6419, 2024-03-04T09:26:05.173 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_enqueued": 6241, 2024-03-04T09:26:05.173 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_reintegrated": 0, 2024-03-04T09:26:05.173 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_migrated": 0, 2024-03-04T09:26:05.173 INFO:teuthology.orchestra.run.smithi102.stdout: "num_recovering_processing": 0, 2024-03-04T09:26:05.173 INFO:teuthology.orchestra.run.smithi102.stdout: "num_recovering_enqueued": 0, 2024-03-04T09:26:05.173 INFO:teuthology.orchestra.run.smithi102.stdout: "num_recovering_prioritized": 0, 2024-03-04T09:26:05.173 INFO:teuthology.orchestra.run.smithi102.stdout: "recovery_started": 0, 2024-03-04T09:26:05.173 INFO:teuthology.orchestra.run.smithi102.stdout: "recovery_completed": 0, 2024-03-04T09:26:05.173 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_enqueue_scrub": 0, 2024-03-04T09:26:05.173 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_exportdir": 63, 2024-03-04T09:26:05.173 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_flush": 0, 2024-03-04T09:26:05.174 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_fragmentdir": 7, 2024-03-04T09:26:05.174 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_fragstats": 0, 2024-03-04T09:26:05.174 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_inodestats": 0 2024-03-04T09:26:05.174 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.174 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_log": { 2024-03-04T09:26:05.174 INFO:teuthology.orchestra.run.smithi102.stdout: "evlrg": 0, 2024-03-04T09:26:05.174 INFO:teuthology.orchestra.run.smithi102.stdout: "evadd": 28569, 2024-03-04T09:26:05.174 INFO:teuthology.orchestra.run.smithi102.stdout: "evex": 0, 2024-03-04T09:26:05.174 INFO:teuthology.orchestra.run.smithi102.stdout: "evtrm": 0, 2024-03-04T09:26:05.174 INFO:teuthology.orchestra.run.smithi102.stdout: "ev": 28569, 2024-03-04T09:26:05.174 INFO:teuthology.orchestra.run.smithi102.stdout: "evexg": 0, 2024-03-04T09:26:05.174 INFO:teuthology.orchestra.run.smithi102.stdout: "evexd": 0, 2024-03-04T09:26:05.174 INFO:teuthology.orchestra.run.smithi102.stdout: "segadd": 39, 2024-03-04T09:26:05.174 INFO:teuthology.orchestra.run.smithi102.stdout: "segex": 0, 2024-03-04T09:26:05.174 INFO:teuthology.orchestra.run.smithi102.stdout: "segtrm": 0, 2024-03-04T09:26:05.175 INFO:teuthology.orchestra.run.smithi102.stdout: "seg": 39, 2024-03-04T09:26:05.175 INFO:teuthology.orchestra.run.smithi102.stdout: "segmjr": 4, 2024-03-04T09:26:05.175 INFO:teuthology.orchestra.run.smithi102.stdout: "segexg": 0, 2024-03-04T09:26:05.175 INFO:teuthology.orchestra.run.smithi102.stdout: "segexd": 0, 2024-03-04T09:26:05.175 INFO:teuthology.orchestra.run.smithi102.stdout: "expos": 4194304, 2024-03-04T09:26:05.175 INFO:teuthology.orchestra.run.smithi102.stdout: "wrpos": 67868941, 2024-03-04T09:26:05.175 INFO:teuthology.orchestra.run.smithi102.stdout: "rdpos": 0, 2024-03-04T09:26:05.175 INFO:teuthology.orchestra.run.smithi102.stdout: "jlat": { 2024-03-04T09:26:05.175 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 1402, 2024-03-04T09:26:05.175 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 15.227610111, 2024-03-04T09:26:05.175 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.010861348 2024-03-04T09:26:05.175 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.175 INFO:teuthology.orchestra.run.smithi102.stdout: "replayed": 0 2024-03-04T09:26:05.175 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.175 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_mem": { 2024-03-04T09:26:05.176 INFO:teuthology.orchestra.run.smithi102.stdout: "ino": 2320, 2024-03-04T09:26:05.176 INFO:teuthology.orchestra.run.smithi102.stdout: "ino+": 9637, 2024-03-04T09:26:05.176 INFO:teuthology.orchestra.run.smithi102.stdout: "ino-": 7317, 2024-03-04T09:26:05.176 INFO:teuthology.orchestra.run.smithi102.stdout: "dir": 226, 2024-03-04T09:26:05.176 INFO:teuthology.orchestra.run.smithi102.stdout: "dir+": 566, 2024-03-04T09:26:05.176 INFO:teuthology.orchestra.run.smithi102.stdout: "dir-": 340, 2024-03-04T09:26:05.176 INFO:teuthology.orchestra.run.smithi102.stdout: "dn": 5106, 2024-03-04T09:26:05.176 INFO:teuthology.orchestra.run.smithi102.stdout: "dn+": 14840, 2024-03-04T09:26:05.176 INFO:teuthology.orchestra.run.smithi102.stdout: "dn-": 9734, 2024-03-04T09:26:05.176 INFO:teuthology.orchestra.run.smithi102.stdout: "cap": 1, 2024-03-04T09:26:05.176 INFO:teuthology.orchestra.run.smithi102.stdout: "cap+": 7433, 2024-03-04T09:26:05.176 INFO:teuthology.orchestra.run.smithi102.stdout: "cap-": 7432, 2024-03-04T09:26:05.176 INFO:teuthology.orchestra.run.smithi102.stdout: "rss": 93856, 2024-03-04T09:26:05.176 INFO:teuthology.orchestra.run.smithi102.stdout: "heap": 223612 2024-03-04T09:26:05.177 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.177 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_server": { 2024-03-04T09:26:05.177 INFO:teuthology.orchestra.run.smithi102.stdout: "dispatch_client_request": 18520, 2024-03-04T09:26:05.177 INFO:teuthology.orchestra.run.smithi102.stdout: "dispatch_server_request": 227, 2024-03-04T09:26:05.177 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_request": 14944, 2024-03-04T09:26:05.177 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_session": 76, 2024-03-04T09:26:05.177 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_peer_request": 699, 2024-03-04T09:26:05.177 INFO:teuthology.orchestra.run.smithi102.stdout: "req_create_latency": { 2024-03-04T09:26:05.177 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 6423, 2024-03-04T09:26:05.177 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 9.173945278, 2024-03-04T09:26:05.177 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.001428296 2024-03-04T09:26:05.177 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.177 INFO:teuthology.orchestra.run.smithi102.stdout: "req_getattr_latency": { 2024-03-04T09:26:05.177 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 29, 2024-03-04T09:26:05.177 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.023029141, 2024-03-04T09:26:05.178 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000794108 2024-03-04T09:26:05.178 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.178 INFO:teuthology.orchestra.run.smithi102.stdout: "req_getfilelock_latency": { 2024-03-04T09:26:05.178 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:05.178 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:05.178 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:05.178 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.178 INFO:teuthology.orchestra.run.smithi102.stdout: "req_link_latency": { 2024-03-04T09:26:05.178 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:05.178 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:05.178 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:05.178 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.178 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookup_latency": { 2024-03-04T09:26:05.178 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 664, 2024-03-04T09:26:05.178 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 3.440162403, 2024-03-04T09:26:05.179 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.005180967 2024-03-04T09:26:05.179 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.179 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookuphash_latency": { 2024-03-04T09:26:05.179 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:05.179 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:05.179 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:05.179 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.179 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupino_latency": { 2024-03-04T09:26:05.179 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:05.179 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:05.179 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:05.179 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.179 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupname_latency": { 2024-03-04T09:26:05.179 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:05.179 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:05.180 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:05.180 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.180 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupparent_latency": { 2024-03-04T09:26:05.180 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:05.180 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:05.180 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:05.180 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.180 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupsnap_latency": { 2024-03-04T09:26:05.180 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:05.180 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:05.180 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:05.180 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.180 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lssnap_latency": { 2024-03-04T09:26:05.180 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:05.180 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:05.181 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:05.181 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.181 INFO:teuthology.orchestra.run.smithi102.stdout: "req_mkdir_latency": { 2024-03-04T09:26:05.181 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 395, 2024-03-04T09:26:05.182 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.487651704, 2024-03-04T09:26:05.182 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.001234561 2024-03-04T09:26:05.182 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.182 INFO:teuthology.orchestra.run.smithi102.stdout: "req_mknod_latency": { 2024-03-04T09:26:05.182 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:05.182 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:05.182 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:05.182 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.182 INFO:teuthology.orchestra.run.smithi102.stdout: "req_mksnap_latency": { 2024-03-04T09:26:05.182 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:05.182 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:05.182 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:05.182 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.182 INFO:teuthology.orchestra.run.smithi102.stdout: "req_open_latency": { 2024-03-04T09:26:05.182 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:05.183 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:05.183 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:05.183 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.183 INFO:teuthology.orchestra.run.smithi102.stdout: "req_readdir_latency": { 2024-03-04T09:26:05.183 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 590, 2024-03-04T09:26:05.183 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.976613526, 2024-03-04T09:26:05.183 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.001655277 2024-03-04T09:26:05.183 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.183 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rename_latency": { 2024-03-04T09:26:05.183 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:05.183 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:05.183 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:05.183 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.183 INFO:teuthology.orchestra.run.smithi102.stdout: "req_renamesnap_latency": { 2024-03-04T09:26:05.184 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:05.184 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:05.184 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:05.184 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.184 INFO:teuthology.orchestra.run.smithi102.stdout: "req_snapdiff_latency": { 2024-03-04T09:26:05.184 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:05.184 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:05.184 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:05.184 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.184 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rmdir_latency": { 2024-03-04T09:26:05.184 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 413, 2024-03-04T09:26:05.184 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 7.702731045, 2024-03-04T09:26:05.184 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.018650680 2024-03-04T09:26:05.184 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.185 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rmsnap_latency": { 2024-03-04T09:26:05.185 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:05.185 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:05.185 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:05.185 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.185 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rmxattr_latency": { 2024-03-04T09:26:05.185 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:05.185 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:05.185 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:05.185 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.185 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setattr_latency": { 2024-03-04T09:26:05.185 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 16, 2024-03-04T09:26:05.185 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.032525557, 2024-03-04T09:26:05.185 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.002032847 2024-03-04T09:26:05.186 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.186 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setdirlayout_latency": { 2024-03-04T09:26:05.186 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:05.186 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:05.186 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:05.186 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.186 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setfilelock_latency": { 2024-03-04T09:26:05.186 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:05.186 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:05.186 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:05.186 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.186 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setlayout_latency": { 2024-03-04T09:26:05.186 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:05.186 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:05.186 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:05.187 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.187 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setxattr_latency": { 2024-03-04T09:26:05.187 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:05.187 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:05.187 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:05.187 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.187 INFO:teuthology.orchestra.run.smithi102.stdout: "req_symlink_latency": { 2024-03-04T09:26:05.187 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:05.187 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:05.187 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:05.187 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.187 INFO:teuthology.orchestra.run.smithi102.stdout: "req_unlink_latency": { 2024-03-04T09:26:05.187 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 6006, 2024-03-04T09:26:05.187 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 9.601167929, 2024-03-04T09:26:05.188 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.001598596 2024-03-04T09:26:05.188 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.188 INFO:teuthology.orchestra.run.smithi102.stdout: "cap_revoke_eviction": 0, 2024-03-04T09:26:05.188 INFO:teuthology.orchestra.run.smithi102.stdout: "cap_acquisition_throttle": 0, 2024-03-04T09:26:05.188 INFO:teuthology.orchestra.run.smithi102.stdout: "req_getvxattr_latency": { 2024-03-04T09:26:05.188 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:05.188 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:05.188 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:05.188 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-03-04T09:26:05.188 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.188 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_sessions": { 2024-03-04T09:26:05.188 INFO:teuthology.orchestra.run.smithi102.stdout: "session_count": 2, 2024-03-04T09:26:05.188 INFO:teuthology.orchestra.run.smithi102.stdout: "session_add": 3, 2024-03-04T09:26:05.188 INFO:teuthology.orchestra.run.smithi102.stdout: "session_remove": 1, 2024-03-04T09:26:05.188 INFO:teuthology.orchestra.run.smithi102.stdout: "sessions_open": 2, 2024-03-04T09:26:05.189 INFO:teuthology.orchestra.run.smithi102.stdout: "sessions_stale": 0, 2024-03-04T09:26:05.189 INFO:teuthology.orchestra.run.smithi102.stdout: "total_load": 9348, 2024-03-04T09:26:05.189 INFO:teuthology.orchestra.run.smithi102.stdout: "average_load": 4674, 2024-03-04T09:26:05.189 INFO:teuthology.orchestra.run.smithi102.stdout: "avg_session_uptime": 618, 2024-03-04T09:26:05.189 INFO:teuthology.orchestra.run.smithi102.stdout: "mdthresh_evicted": 0 2024-03-04T09:26:05.189 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.189 INFO:teuthology.orchestra.run.smithi102.stdout: "mempool": { 2024-03-04T09:26:05.189 INFO:teuthology.orchestra.run.smithi102.stdout: "bloom_filter_bytes": 0, 2024-03-04T09:26:05.189 INFO:teuthology.orchestra.run.smithi102.stdout: "bloom_filter_items": 0, 2024-03-04T09:26:05.189 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_alloc_bytes": 0, 2024-03-04T09:26:05.189 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_alloc_items": 0, 2024-03-04T09:26:05.189 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_data_bytes": 0, 2024-03-04T09:26:05.189 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_data_items": 0, 2024-03-04T09:26:05.189 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-04T09:26:05.189 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_onode_items": 0, 2024-03-04T09:26:05.190 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-04T09:26:05.190 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_meta_items": 0, 2024-03-04T09:26:05.190 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_other_bytes": 0, 2024-03-04T09:26:05.190 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_other_items": 0, 2024-03-04T09:26:05.190 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-04T09:26:05.190 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_buffer_items": 0, 2024-03-04T09:26:05.190 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_extent_bytes": 0, 2024-03-04T09:26:05.190 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_extent_items": 0, 2024-03-04T09:26:05.190 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_blob_bytes": 0, 2024-03-04T09:26:05.190 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_blob_items": 0, 2024-03-04T09:26:05.190 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-04T09:26:05.190 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_shared_blob_items": 0, 2024-03-04T09:26:05.190 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-04T09:26:05.190 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_inline_bl_items": 0, 2024-03-04T09:26:05.190 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_bytes": 0, 2024-03-04T09:26:05.191 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_items": 0, 2024-03-04T09:26:05.191 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_txc_bytes": 0, 2024-03-04T09:26:05.191 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_txc_items": 0, 2024-03-04T09:26:05.191 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-04T09:26:05.191 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_deferred_items": 0, 2024-03-04T09:26:05.191 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_bytes": 0, 2024-03-04T09:26:05.191 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_items": 0, 2024-03-04T09:26:05.191 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_bytes": 0, 2024-03-04T09:26:05.191 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_items": 0, 2024-03-04T09:26:05.191 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_reader_bytes": 0, 2024-03-04T09:26:05.191 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_reader_items": 0, 2024-03-04T09:26:05.191 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_writer_bytes": 0, 2024-03-04T09:26:05.191 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_writer_items": 0, 2024-03-04T09:26:05.191 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_anon_bytes": 1687610, 2024-03-04T09:26:05.192 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_anon_items": 478, 2024-03-04T09:26:05.192 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_meta_bytes": 0, 2024-03-04T09:26:05.192 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_meta_items": 0, 2024-03-04T09:26:05.192 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_bytes": 0, 2024-03-04T09:26:05.192 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_items": 0, 2024-03-04T09:26:05.192 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mapbl_bytes": 0, 2024-03-04T09:26:05.192 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mapbl_items": 0, 2024-03-04T09:26:05.192 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pglog_bytes": 0, 2024-03-04T09:26:05.192 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pglog_items": 0, 2024-03-04T09:26:05.192 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_bytes": 9832, 2024-03-04T09:26:05.192 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_items": 205, 2024-03-04T09:26:05.192 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_mapping_bytes": 0, 2024-03-04T09:26:05.192 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_mapping_items": 0, 2024-03-04T09:26:05.192 INFO:teuthology.orchestra.run.smithi102.stdout: "pgmap_bytes": 0, 2024-03-04T09:26:05.192 INFO:teuthology.orchestra.run.smithi102.stdout: "pgmap_items": 0, 2024-03-04T09:26:05.193 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_co_bytes": 9027044, 2024-03-04T09:26:05.193 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_co_items": 113552, 2024-03-04T09:26:05.193 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_1_bytes": 0, 2024-03-04T09:26:05.193 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_1_items": 0, 2024-03-04T09:26:05.193 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_2_bytes": 0, 2024-03-04T09:26:05.193 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_2_items": 0 2024-03-04T09:26:05.193 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.193 INFO:teuthology.orchestra.run.smithi102.stdout: "objecter": { 2024-03-04T09:26:05.193 INFO:teuthology.orchestra.run.smithi102.stdout: "op_active": 0, 2024-03-04T09:26:05.193 INFO:teuthology.orchestra.run.smithi102.stdout: "op_laggy": 0, 2024-03-04T09:26:05.193 INFO:teuthology.orchestra.run.smithi102.stdout: "op_send": 14238, 2024-03-04T09:26:05.193 INFO:teuthology.orchestra.run.smithi102.stdout: "op_send_bytes": 65988807, 2024-03-04T09:26:05.193 INFO:teuthology.orchestra.run.smithi102.stdout: "op_resend": 33, 2024-03-04T09:26:05.193 INFO:teuthology.orchestra.run.smithi102.stdout: "op_reply": 14238, 2024-03-04T09:26:05.194 INFO:teuthology.orchestra.run.smithi102.stdout: "op_latency": { 2024-03-04T09:26:05.194 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 14238, 2024-03-04T09:26:05.194 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 50.199910745, 2024-03-04T09:26:05.194 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.003525769 2024-03-04T09:26:05.194 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.194 INFO:teuthology.orchestra.run.smithi102.stdout: "op_inflight": 0, 2024-03-04T09:26:05.194 INFO:teuthology.orchestra.run.smithi102.stdout: "oplen_avg": { 2024-03-04T09:26:05.194 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 14238, 2024-03-04T09:26:05.194 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 14471 2024-03-04T09:26:05.194 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.194 INFO:teuthology.orchestra.run.smithi102.stdout: "op": 14238, 2024-03-04T09:26:05.194 INFO:teuthology.orchestra.run.smithi102.stdout: "op_r": 138, 2024-03-04T09:26:05.194 INFO:teuthology.orchestra.run.smithi102.stdout: "op_w": 14100, 2024-03-04T09:26:05.194 INFO:teuthology.orchestra.run.smithi102.stdout: "op_rmw": 0, 2024-03-04T09:26:05.195 INFO:teuthology.orchestra.run.smithi102.stdout: "op_pg": 0, 2024-03-04T09:26:05.195 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_stat": 0, 2024-03-04T09:26:05.195 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_create": 10, 2024-03-04T09:26:05.195 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_read": 138, 2024-03-04T09:26:05.195 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_write": 1540, 2024-03-04T09:26:05.195 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_writefull": 79, 2024-03-04T09:26:05.195 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_writesame": 0, 2024-03-04T09:26:05.195 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_append": 0, 2024-03-04T09:26:05.195 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_zero": 0, 2024-03-04T09:26:05.195 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_truncate": 6, 2024-03-04T09:26:05.195 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_delete": 12299, 2024-03-04T09:26:05.195 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_mapext": 0, 2024-03-04T09:26:05.195 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_sparse_read": 0, 2024-03-04T09:26:05.195 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_clonerange": 0, 2024-03-04T09:26:05.196 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_getxattr": 0, 2024-03-04T09:26:05.196 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_setxattr": 20, 2024-03-04T09:26:05.196 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_cmpxattr": 0, 2024-03-04T09:26:05.196 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_rmxattr": 0, 2024-03-04T09:26:05.196 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_resetxattrs": 0, 2024-03-04T09:26:05.196 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_call": 0, 2024-03-04T09:26:05.196 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_watch": 0, 2024-03-04T09:26:05.196 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_notify": 0, 2024-03-04T09:26:05.196 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_src_cmpxattr": 0, 2024-03-04T09:26:05.196 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_pgls": 0, 2024-03-04T09:26:05.197 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_pgls_filter": 0, 2024-03-04T09:26:05.197 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_other": 0, 2024-03-04T09:26:05.197 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_active": 0, 2024-03-04T09:26:05.197 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_send": 0, 2024-03-04T09:26:05.197 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_resend": 0, 2024-03-04T09:26:05.197 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_ping": 0, 2024-03-04T09:26:05.197 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_active": 0, 2024-03-04T09:26:05.197 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_send": 0, 2024-03-04T09:26:05.197 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_resend": 0, 2024-03-04T09:26:05.197 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_active": 0, 2024-03-04T09:26:05.197 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_send": 0, 2024-03-04T09:26:05.197 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_resend": 0, 2024-03-04T09:26:05.197 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_active": 0, 2024-03-04T09:26:05.197 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_send": 0, 2024-03-04T09:26:05.198 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_resend": 0, 2024-03-04T09:26:05.198 INFO:teuthology.orchestra.run.smithi102.stdout: "command_active": 0, 2024-03-04T09:26:05.198 INFO:teuthology.orchestra.run.smithi102.stdout: "command_send": 0, 2024-03-04T09:26:05.198 INFO:teuthology.orchestra.run.smithi102.stdout: "command_resend": 0, 2024-03-04T09:26:05.198 INFO:teuthology.orchestra.run.smithi102.stdout: "map_epoch": 104, 2024-03-04T09:26:05.198 INFO:teuthology.orchestra.run.smithi102.stdout: "map_full": 0, 2024-03-04T09:26:05.198 INFO:teuthology.orchestra.run.smithi102.stdout: "map_inc": 14, 2024-03-04T09:26:05.198 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_sessions": 12, 2024-03-04T09:26:05.198 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_session_open": 12, 2024-03-04T09:26:05.198 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_session_close": 0, 2024-03-04T09:26:05.198 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_laggy": 0, 2024-03-04T09:26:05.198 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_wr": 294, 2024-03-04T09:26:05.198 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_rd": 0, 2024-03-04T09:26:05.198 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_del": 85 2024-03-04T09:26:05.199 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.199 INFO:teuthology.orchestra.run.smithi102.stdout: "oft": { 2024-03-04T09:26:05.199 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_objs": 1, 2024-03-04T09:26:05.199 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_kv_pairs": 0, 2024-03-04T09:26:05.199 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_updates": 0, 2024-03-04T09:26:05.199 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_removes": 0 2024-03-04T09:26:05.199 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.199 INFO:teuthology.orchestra.run.smithi102.stdout: "osd-slow-ops": { 2024-03-04T09:26:05.199 INFO:teuthology.orchestra.run.smithi102.stdout: "slow_ops_count": 0 2024-03-04T09:26:05.199 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.199 INFO:teuthology.orchestra.run.smithi102.stdout: "purge_queue": { 2024-03-04T09:26:05.199 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing_ops": 0, 2024-03-04T09:26:05.199 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing_ops_high_water": 17, 2024-03-04T09:26:05.199 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing": 0, 2024-03-04T09:26:05.199 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing_high_water": 7, 2024-03-04T09:26:05.200 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executed_ops": 12268, 2024-03-04T09:26:05.200 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executed": 6241, 2024-03-04T09:26:05.200 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_item_in_journal": 0 2024-03-04T09:26:05.200 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.200 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-04T09:26:05.200 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-03-04T09:26:05.200 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 104857600, 2024-03-04T09:26:05.200 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-03-04T09:26:05.200 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 48090, 2024-03-04T09:26:05.200 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 13979186, 2024-03-04T09:26:05.200 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-03-04T09:26:05.200 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 48090, 2024-03-04T09:26:05.200 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2024-03-04T09:26:05.201 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2024-03-04T09:26:05.201 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 48090, 2024-03-04T09:26:05.201 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 13979186, 2024-03-04T09:26:05.201 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-03-04T09:26:05.201 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:05.201 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:05.201 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:05.201 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-03-04T09:26:05.201 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.201 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-objecter_bytes": { 2024-03-04T09:26:05.201 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-03-04T09:26:05.201 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 104857600, 2024-03-04T09:26:05.201 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-03-04T09:26:05.201 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 0, 2024-03-04T09:26:05.202 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 0, 2024-03-04T09:26:05.202 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-03-04T09:26:05.202 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 0, 2024-03-04T09:26:05.202 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 14238, 2024-03-04T09:26:05.202 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 66684060, 2024-03-04T09:26:05.202 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 14238, 2024-03-04T09:26:05.202 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 66684060, 2024-03-04T09:26:05.202 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-03-04T09:26:05.202 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:05.202 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:05.202 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:05.202 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-03-04T09:26:05.202 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.203 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-objecter_ops": { 2024-03-04T09:26:05.203 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-03-04T09:26:05.203 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 1024, 2024-03-04T09:26:05.203 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-03-04T09:26:05.203 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 0, 2024-03-04T09:26:05.203 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 0, 2024-03-04T09:26:05.203 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-03-04T09:26:05.203 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 0, 2024-03-04T09:26:05.203 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 14238, 2024-03-04T09:26:05.203 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 14238, 2024-03-04T09:26:05.203 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 14238, 2024-03-04T09:26:05.203 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 14238, 2024-03-04T09:26:05.203 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-03-04T09:26:05.203 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:05.203 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:05.204 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:05.204 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-03-04T09:26:05.204 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.204 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-write_buf_throttle": { 2024-03-04T09:26:05.204 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-03-04T09:26:05.204 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 3758096384, 2024-03-04T09:26:05.204 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-03-04T09:26:05.204 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 6241, 2024-03-04T09:26:05.204 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 695253, 2024-03-04T09:26:05.204 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-03-04T09:26:05.204 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 6241, 2024-03-04T09:26:05.204 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2024-03-04T09:26:05.204 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2024-03-04T09:26:05.204 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 138, 2024-03-04T09:26:05.205 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 695253, 2024-03-04T09:26:05.205 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-03-04T09:26:05.205 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:05.205 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:05.205 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:05.205 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-03-04T09:26:05.205 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:05.205 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-write_buf_throttle-0x55e5780a06e0": { 2024-03-04T09:26:05.205 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-03-04T09:26:05.205 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 3758096384, 2024-03-04T09:26:05.205 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-03-04T09:26:05.205 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 28569, 2024-03-04T09:26:05.205 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 63674637, 2024-03-04T09:26:05.205 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-03-04T09:26:05.205 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 28569, 2024-03-04T09:26:05.206 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2024-03-04T09:26:05.206 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2024-03-04T09:26:05.206 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 1402, 2024-03-04T09:26:05.206 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 63674637, 2024-03-04T09:26:05.206 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-03-04T09:26:05.206 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:05.206 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:05.206 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:05.206 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-03-04T09:26:05.206 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-03-04T09:26:05.206 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-03-04T09:26:05.882 INFO:tasks.check_counter:Daemon mds.h mds.exported=63 2024-03-04T09:26:05.882 INFO:tasks.check_counter:Daemon mds.h mds.imported=64 2024-03-04T09:26:05.882 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=0 2024-03-04T09:26:05.882 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-03-04T09:26:05.882 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-03-04T09:26:05.882 DEBUG:tasks.check_counter:Getting stats from k 2024-03-04T09:26:05.883 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph daemon mds.k perf dump 2024-03-04T09:26:06.176 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.b/config 2024-03-04T09:26:06.553 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:06 smithi102 ceph-mon[36220]: pgmap v325: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-03-04T09:26:06.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:06 smithi082 ceph-mon[32880]: pgmap v325: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-03-04T09:26:06.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:06 smithi190 ceph-mon[36341]: pgmap v325: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-03-04T09:26:07.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:07 smithi190 ceph-mon[36341]: pgmap v326: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-03-04T09:26:07.921 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:07 smithi102 ceph-mon[36220]: pgmap v326: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-03-04T09:26:07.953 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-03-04T09:26:07.953 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-0": { 2024-03-04T09:26:07.953 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 805, 2024-03-04T09:26:07.953 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 805, 2024-03-04T09:26:07.954 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 1786758, 2024-03-04T09:26:07.954 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 255230, 2024-03-04T09:26:07.954 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 6, 2024-03-04T09:26:07.954 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 2, 2024-03-04T09:26:07.954 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.053264763, 2024-03-04T09:26:07.954 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.018629120, 2024-03-04T09:26:07.954 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.014383304, 2024-03-04T09:26:07.954 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.015537813, 2024-03-04T09:26:07.954 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-03-04T09:26:07.954 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 804, 2024-03-04T09:26:07.954 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.017982850, 2024-03-04T09:26:07.954 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000022366 2024-03-04T09:26:07.954 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.955 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-03-04T09:26:07.955 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:07.955 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:07.955 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:07.955 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.955 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-03-04T09:26:07.955 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 448 2024-03-04T09:26:07.955 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.955 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-1": { 2024-03-04T09:26:07.955 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 688, 2024-03-04T09:26:07.955 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 852, 2024-03-04T09:26:07.955 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 169098, 2024-03-04T09:26:07.956 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 658937, 2024-03-04T09:26:07.956 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 7, 2024-03-04T09:26:07.956 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 5, 2024-03-04T09:26:07.956 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.051916004, 2024-03-04T09:26:07.956 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.016932391, 2024-03-04T09:26:07.956 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.012008026, 2024-03-04T09:26:07.956 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.018113605, 2024-03-04T09:26:07.956 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-03-04T09:26:07.956 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 849, 2024-03-04T09:26:07.956 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.023159054, 2024-03-04T09:26:07.956 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000027278 2024-03-04T09:26:07.957 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.957 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-03-04T09:26:07.957 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:07.957 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:07.957 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:07.957 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.957 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 320, 2024-03-04T09:26:07.957 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 440784 2024-03-04T09:26:07.957 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.957 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-2": { 2024-03-04T09:26:07.957 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 1027, 2024-03-04T09:26:07.957 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 986, 2024-03-04T09:26:07.957 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 1911936, 2024-03-04T09:26:07.958 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 372038, 2024-03-04T09:26:07.958 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 3, 2024-03-04T09:26:07.958 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 2, 2024-03-04T09:26:07.958 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.088374021, 2024-03-04T09:26:07.958 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.024548793, 2024-03-04T09:26:07.958 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.048188902, 2024-03-04T09:26:07.958 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.021980515, 2024-03-04T09:26:07.958 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-03-04T09:26:07.958 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 985, 2024-03-04T09:26:07.958 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.027681008, 2024-03-04T09:26:07.958 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000028102 2024-03-04T09:26:07.958 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.958 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-03-04T09:26:07.958 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:07.959 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:07.959 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:07.959 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.959 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 1660272, 2024-03-04T09:26:07.959 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 133856 2024-03-04T09:26:07.959 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.959 INFO:teuthology.orchestra.run.smithi102.stdout: "cct": { 2024-03-04T09:26:07.959 INFO:teuthology.orchestra.run.smithi102.stdout: "total_workers": 1, 2024-03-04T09:26:07.959 INFO:teuthology.orchestra.run.smithi102.stdout: "unhealthy_workers": 0 2024-03-04T09:26:07.959 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.959 INFO:teuthology.orchestra.run.smithi102.stdout: "finisher-MDSRank": { 2024-03-04T09:26:07.959 INFO:teuthology.orchestra.run.smithi102.stdout: "queue_len": 0, 2024-03-04T09:26:07.959 INFO:teuthology.orchestra.run.smithi102.stdout: "complete_latency": { 2024-03-04T09:26:07.959 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 3734, 2024-03-04T09:26:07.959 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.074794818, 2024-03-04T09:26:07.960 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000020030 2024-03-04T09:26:07.960 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-03-04T09:26:07.960 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.960 INFO:teuthology.orchestra.run.smithi102.stdout: "finisher-PurgeQueue": { 2024-03-04T09:26:07.960 INFO:teuthology.orchestra.run.smithi102.stdout: "queue_len": 0, 2024-03-04T09:26:07.960 INFO:teuthology.orchestra.run.smithi102.stdout: "complete_latency": { 2024-03-04T09:26:07.960 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:07.960 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:07.960 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:07.960 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-03-04T09:26:07.960 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.960 INFO:teuthology.orchestra.run.smithi102.stdout: "mds": { 2024-03-04T09:26:07.960 INFO:teuthology.orchestra.run.smithi102.stdout: "request": 0, 2024-03-04T09:26:07.961 INFO:teuthology.orchestra.run.smithi102.stdout: "reply": 0, 2024-03-04T09:26:07.961 INFO:teuthology.orchestra.run.smithi102.stdout: "reply_latency": { 2024-03-04T09:26:07.961 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:07.961 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:07.961 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:07.961 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.961 INFO:teuthology.orchestra.run.smithi102.stdout: "slow_reply": 0, 2024-03-04T09:26:07.961 INFO:teuthology.orchestra.run.smithi102.stdout: "forward": 0, 2024-03-04T09:26:07.961 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_fetch_complete": 0, 2024-03-04T09:26:07.961 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_fetch_keys": 0, 2024-03-04T09:26:07.961 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_commit": 0, 2024-03-04T09:26:07.961 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_split": 0, 2024-03-04T09:26:07.961 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_merge": 0, 2024-03-04T09:26:07.961 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes": 257, 2024-03-04T09:26:07.961 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_top": 0, 2024-03-04T09:26:07.961 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_bottom": 257, 2024-03-04T09:26:07.962 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_pin_tail": 0, 2024-03-04T09:26:07.962 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_pinned": 257, 2024-03-04T09:26:07.962 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_expired": 0, 2024-03-04T09:26:07.962 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_with_caps": 0, 2024-03-04T09:26:07.962 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": 0, 2024-03-04T09:26:07.962 INFO:teuthology.orchestra.run.smithi102.stdout: "subtrees": 1, 2024-03-04T09:26:07.962 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse": 0, 2024-03-04T09:26:07.962 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_hit": 0, 2024-03-04T09:26:07.962 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_forward": 0, 2024-03-04T09:26:07.962 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_discover": 0, 2024-03-04T09:26:07.962 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_dir_fetch": 0, 2024-03-04T09:26:07.962 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_remote_ino": 0, 2024-03-04T09:26:07.962 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_lock": 0, 2024-03-04T09:26:07.962 INFO:teuthology.orchestra.run.smithi102.stdout: "load_cent": 0, 2024-03-04T09:26:07.962 INFO:teuthology.orchestra.run.smithi102.stdout: "q": 0, 2024-03-04T09:26:07.962 INFO:teuthology.orchestra.run.smithi102.stdout: "exported": 0, 2024-03-04T09:26:07.963 INFO:teuthology.orchestra.run.smithi102.stdout: "exported_inodes": 0, 2024-03-04T09:26:07.963 INFO:teuthology.orchestra.run.smithi102.stdout: "imported": 0, 2024-03-04T09:26:07.963 INFO:teuthology.orchestra.run.smithi102.stdout: "imported_inodes": 0, 2024-03-04T09:26:07.963 INFO:teuthology.orchestra.run.smithi102.stdout: "openino_dir_fetch": 0, 2024-03-04T09:26:07.963 INFO:teuthology.orchestra.run.smithi102.stdout: "openino_backtrace_fetch": 0, 2024-03-04T09:26:07.963 INFO:teuthology.orchestra.run.smithi102.stdout: "openino_peer_discover": 0, 2024-03-04T09:26:07.963 INFO:teuthology.orchestra.run.smithi102.stdout: "root_rfiles": 0, 2024-03-04T09:26:07.963 INFO:teuthology.orchestra.run.smithi102.stdout: "root_rbytes": 0, 2024-03-04T09:26:07.963 INFO:teuthology.orchestra.run.smithi102.stdout: "root_rsnaps": 0, 2024-03-04T09:26:07.963 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_backtrace_fetch": 0, 2024-03-04T09:26:07.963 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_set_tag": 0, 2024-03-04T09:26:07.963 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_backtrace_repaired": 0, 2024-03-04T09:26:07.963 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_inotable_repaired": 0, 2024-03-04T09:26:07.963 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_dir_inodes": 0, 2024-03-04T09:26:07.964 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_dir_base_inodes": 0, 2024-03-04T09:26:07.964 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_dirfrag_rstats": 0, 2024-03-04T09:26:07.964 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_file_inodes": 0, 2024-03-04T09:26:07.964 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_inode_file_caps": 0, 2024-03-04T09:26:07.964 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_revoke": 0, 2024-03-04T09:26:07.964 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_grant": 0, 2024-03-04T09:26:07.964 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_trunc": 0, 2024-03-04T09:26:07.964 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-03-04T09:26:07.964 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_flush_ack": 0, 2024-03-04T09:26:07.964 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_caps": 0, 2024-03-04T09:26:07.964 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_caps_dirty": 0, 2024-03-04T09:26:07.964 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_cap_release": 0, 2024-03-04T09:26:07.964 INFO:teuthology.orchestra.run.smithi102.stdout: "process_request_cap_release": 0 2024-03-04T09:26:07.964 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.965 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_cache": { 2024-03-04T09:26:07.965 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_update": 0, 2024-03-04T09:26:07.965 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_update_receipt": 0, 2024-03-04T09:26:07.965 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_try_discover": 0, 2024-03-04T09:26:07.965 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_send_discover": 0, 2024-03-04T09:26:07.965 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_handle_discover": 0, 2024-03-04T09:26:07.965 INFO:teuthology.orchestra.run.smithi102.stdout: "num_strays": 0, 2024-03-04T09:26:07.965 INFO:teuthology.orchestra.run.smithi102.stdout: "num_strays_delayed": 0, 2024-03-04T09:26:07.965 INFO:teuthology.orchestra.run.smithi102.stdout: "num_strays_enqueuing": 0, 2024-03-04T09:26:07.965 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_created": 0, 2024-03-04T09:26:07.965 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_enqueued": 0, 2024-03-04T09:26:07.965 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_reintegrated": 0, 2024-03-04T09:26:07.965 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_migrated": 0, 2024-03-04T09:26:07.965 INFO:teuthology.orchestra.run.smithi102.stdout: "num_recovering_processing": 0, 2024-03-04T09:26:07.965 INFO:teuthology.orchestra.run.smithi102.stdout: "num_recovering_enqueued": 0, 2024-03-04T09:26:07.965 INFO:teuthology.orchestra.run.smithi102.stdout: "num_recovering_prioritized": 0, 2024-03-04T09:26:07.966 INFO:teuthology.orchestra.run.smithi102.stdout: "recovery_started": 0, 2024-03-04T09:26:07.966 INFO:teuthology.orchestra.run.smithi102.stdout: "recovery_completed": 0, 2024-03-04T09:26:07.966 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_enqueue_scrub": 0, 2024-03-04T09:26:07.966 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_exportdir": 0, 2024-03-04T09:26:07.966 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_flush": 0, 2024-03-04T09:26:07.966 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_fragmentdir": 0, 2024-03-04T09:26:07.966 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_fragstats": 0, 2024-03-04T09:26:07.966 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_inodestats": 0 2024-03-04T09:26:07.966 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.966 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_log": { 2024-03-04T09:26:07.966 INFO:teuthology.orchestra.run.smithi102.stdout: "evlrg": 0, 2024-03-04T09:26:07.966 INFO:teuthology.orchestra.run.smithi102.stdout: "evadd": 0, 2024-03-04T09:26:07.966 INFO:teuthology.orchestra.run.smithi102.stdout: "evex": 0, 2024-03-04T09:26:07.966 INFO:teuthology.orchestra.run.smithi102.stdout: "evtrm": 0, 2024-03-04T09:26:07.966 INFO:teuthology.orchestra.run.smithi102.stdout: "ev": 791, 2024-03-04T09:26:07.966 INFO:teuthology.orchestra.run.smithi102.stdout: "evexg": 0, 2024-03-04T09:26:07.967 INFO:teuthology.orchestra.run.smithi102.stdout: "evexd": 0, 2024-03-04T09:26:07.967 INFO:teuthology.orchestra.run.smithi102.stdout: "segadd": 0, 2024-03-04T09:26:07.967 INFO:teuthology.orchestra.run.smithi102.stdout: "segex": 0, 2024-03-04T09:26:07.967 INFO:teuthology.orchestra.run.smithi102.stdout: "segtrm": 0, 2024-03-04T09:26:07.967 INFO:teuthology.orchestra.run.smithi102.stdout: "seg": 2, 2024-03-04T09:26:07.967 INFO:teuthology.orchestra.run.smithi102.stdout: "segmjr": 2, 2024-03-04T09:26:07.967 INFO:teuthology.orchestra.run.smithi102.stdout: "segexg": 0, 2024-03-04T09:26:07.967 INFO:teuthology.orchestra.run.smithi102.stdout: "segexd": 0, 2024-03-04T09:26:07.967 INFO:teuthology.orchestra.run.smithi102.stdout: "expos": 4194304, 2024-03-04T09:26:07.968 INFO:teuthology.orchestra.run.smithi102.stdout: "wrpos": 5768353, 2024-03-04T09:26:07.968 INFO:teuthology.orchestra.run.smithi102.stdout: "rdpos": 5761989, 2024-03-04T09:26:07.968 INFO:teuthology.orchestra.run.smithi102.stdout: "jlat": { 2024-03-04T09:26:07.968 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:07.968 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:07.968 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:07.968 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.968 INFO:teuthology.orchestra.run.smithi102.stdout: "replayed": 791 2024-03-04T09:26:07.968 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.968 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_mem": { 2024-03-04T09:26:07.968 INFO:teuthology.orchestra.run.smithi102.stdout: "ino": 36, 2024-03-04T09:26:07.968 INFO:teuthology.orchestra.run.smithi102.stdout: "ino+": 337, 2024-03-04T09:26:07.968 INFO:teuthology.orchestra.run.smithi102.stdout: "ino-": 301, 2024-03-04T09:26:07.969 INFO:teuthology.orchestra.run.smithi102.stdout: "dir": 6, 2024-03-04T09:26:07.969 INFO:teuthology.orchestra.run.smithi102.stdout: "dir+": 87, 2024-03-04T09:26:07.969 INFO:teuthology.orchestra.run.smithi102.stdout: "dir-": 81, 2024-03-04T09:26:07.969 INFO:teuthology.orchestra.run.smithi102.stdout: "dn": 257, 2024-03-04T09:26:07.969 INFO:teuthology.orchestra.run.smithi102.stdout: "dn+": 489, 2024-03-04T09:26:07.969 INFO:teuthology.orchestra.run.smithi102.stdout: "dn-": 232, 2024-03-04T09:26:07.969 INFO:teuthology.orchestra.run.smithi102.stdout: "cap": 0, 2024-03-04T09:26:07.969 INFO:teuthology.orchestra.run.smithi102.stdout: "cap+": 0, 2024-03-04T09:26:07.969 INFO:teuthology.orchestra.run.smithi102.stdout: "cap-": 0, 2024-03-04T09:26:07.969 INFO:teuthology.orchestra.run.smithi102.stdout: "rss": 51536, 2024-03-04T09:26:07.969 INFO:teuthology.orchestra.run.smithi102.stdout: "heap": 215420 2024-03-04T09:26:07.969 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.969 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_server": { 2024-03-04T09:26:07.970 INFO:teuthology.orchestra.run.smithi102.stdout: "dispatch_client_request": 0, 2024-03-04T09:26:07.970 INFO:teuthology.orchestra.run.smithi102.stdout: "dispatch_server_request": 0, 2024-03-04T09:26:07.970 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_request": 0, 2024-03-04T09:26:07.970 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_session": 0, 2024-03-04T09:26:07.970 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_peer_request": 0, 2024-03-04T09:26:07.970 INFO:teuthology.orchestra.run.smithi102.stdout: "req_create_latency": { 2024-03-04T09:26:07.970 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:07.970 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:07.970 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:07.970 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.970 INFO:teuthology.orchestra.run.smithi102.stdout: "req_getattr_latency": { 2024-03-04T09:26:07.970 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:07.970 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:07.971 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:07.971 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.971 INFO:teuthology.orchestra.run.smithi102.stdout: "req_getfilelock_latency": { 2024-03-04T09:26:07.971 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:07.971 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:07.971 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:07.971 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.971 INFO:teuthology.orchestra.run.smithi102.stdout: "req_link_latency": { 2024-03-04T09:26:07.971 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:07.971 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:07.971 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:07.971 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.971 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookup_latency": { 2024-03-04T09:26:07.972 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:07.972 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:07.972 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:07.972 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.972 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookuphash_latency": { 2024-03-04T09:26:07.972 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:07.972 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:07.972 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:07.972 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.972 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupino_latency": { 2024-03-04T09:26:07.972 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:07.972 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:07.972 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:07.973 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.973 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupname_latency": { 2024-03-04T09:26:07.973 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:07.973 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:07.973 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:07.973 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.973 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupparent_latency": { 2024-03-04T09:26:07.973 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:07.973 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:07.973 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:07.973 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.973 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupsnap_latency": { 2024-03-04T09:26:07.973 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:07.973 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:07.974 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:07.974 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.974 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lssnap_latency": { 2024-03-04T09:26:07.974 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:07.974 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:07.974 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:07.974 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.974 INFO:teuthology.orchestra.run.smithi102.stdout: "req_mkdir_latency": { 2024-03-04T09:26:07.974 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:07.974 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:07.975 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:07.975 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.975 INFO:teuthology.orchestra.run.smithi102.stdout: "req_mknod_latency": { 2024-03-04T09:26:07.975 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:07.975 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:07.975 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:07.975 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.975 INFO:teuthology.orchestra.run.smithi102.stdout: "req_mksnap_latency": { 2024-03-04T09:26:07.975 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:07.975 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:07.975 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:07.975 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.975 INFO:teuthology.orchestra.run.smithi102.stdout: "req_open_latency": { 2024-03-04T09:26:07.976 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:07.976 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:07.976 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:07.976 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.976 INFO:teuthology.orchestra.run.smithi102.stdout: "req_readdir_latency": { 2024-03-04T09:26:07.976 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:07.976 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:07.976 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:07.976 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.976 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rename_latency": { 2024-03-04T09:26:07.976 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:07.976 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:07.976 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:07.976 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.976 INFO:teuthology.orchestra.run.smithi102.stdout: "req_renamesnap_latency": { 2024-03-04T09:26:07.977 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:07.977 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:07.977 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:07.977 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.977 INFO:teuthology.orchestra.run.smithi102.stdout: "req_snapdiff_latency": { 2024-03-04T09:26:07.977 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:07.977 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:07.977 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:07.977 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.977 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rmdir_latency": { 2024-03-04T09:26:07.977 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:07.977 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:07.977 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:07.977 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.977 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rmsnap_latency": { 2024-03-04T09:26:07.978 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:07.978 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:07.978 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:07.978 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.978 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rmxattr_latency": { 2024-03-04T09:26:07.978 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:07.978 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:07.978 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:07.978 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.978 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setattr_latency": { 2024-03-04T09:26:07.978 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:07.978 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:07.978 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:07.979 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.979 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setdirlayout_latency": { 2024-03-04T09:26:07.979 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:07.979 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:07.979 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:07.979 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.979 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setfilelock_latency": { 2024-03-04T09:26:07.979 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:07.979 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:07.979 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:07.979 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.979 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setlayout_latency": { 2024-03-04T09:26:07.979 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:07.979 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:07.979 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:07.979 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.980 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setxattr_latency": { 2024-03-04T09:26:07.980 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:07.980 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:07.980 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:07.980 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.980 INFO:teuthology.orchestra.run.smithi102.stdout: "req_symlink_latency": { 2024-03-04T09:26:07.980 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:07.980 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:07.980 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:07.980 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.980 INFO:teuthology.orchestra.run.smithi102.stdout: "req_unlink_latency": { 2024-03-04T09:26:07.980 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:07.980 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:07.980 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:07.981 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.981 INFO:teuthology.orchestra.run.smithi102.stdout: "cap_revoke_eviction": 0, 2024-03-04T09:26:07.981 INFO:teuthology.orchestra.run.smithi102.stdout: "cap_acquisition_throttle": 0, 2024-03-04T09:26:07.981 INFO:teuthology.orchestra.run.smithi102.stdout: "req_getvxattr_latency": { 2024-03-04T09:26:07.981 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:07.981 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:07.981 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:07.981 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-03-04T09:26:07.981 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.981 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_sessions": { 2024-03-04T09:26:07.981 INFO:teuthology.orchestra.run.smithi102.stdout: "session_count": 1, 2024-03-04T09:26:07.981 INFO:teuthology.orchestra.run.smithi102.stdout: "session_add": 4, 2024-03-04T09:26:07.981 INFO:teuthology.orchestra.run.smithi102.stdout: "session_remove": 3, 2024-03-04T09:26:07.981 INFO:teuthology.orchestra.run.smithi102.stdout: "sessions_open": 3, 2024-03-04T09:26:07.982 INFO:teuthology.orchestra.run.smithi102.stdout: "sessions_stale": 0, 2024-03-04T09:26:07.982 INFO:teuthology.orchestra.run.smithi102.stdout: "total_load": 0, 2024-03-04T09:26:07.982 INFO:teuthology.orchestra.run.smithi102.stdout: "average_load": 0, 2024-03-04T09:26:07.982 INFO:teuthology.orchestra.run.smithi102.stdout: "avg_session_uptime": 4165, 2024-03-04T09:26:07.982 INFO:teuthology.orchestra.run.smithi102.stdout: "mdthresh_evicted": 0 2024-03-04T09:26:07.982 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.982 INFO:teuthology.orchestra.run.smithi102.stdout: "mempool": { 2024-03-04T09:26:07.982 INFO:teuthology.orchestra.run.smithi102.stdout: "bloom_filter_bytes": 0, 2024-03-04T09:26:07.982 INFO:teuthology.orchestra.run.smithi102.stdout: "bloom_filter_items": 0, 2024-03-04T09:26:07.982 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_alloc_bytes": 0, 2024-03-04T09:26:07.982 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_alloc_items": 0, 2024-03-04T09:26:07.982 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_data_bytes": 0, 2024-03-04T09:26:07.982 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_data_items": 0, 2024-03-04T09:26:07.982 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-04T09:26:07.982 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_onode_items": 0, 2024-03-04T09:26:07.983 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-04T09:26:07.983 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_meta_items": 0, 2024-03-04T09:26:07.983 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_other_bytes": 0, 2024-03-04T09:26:07.983 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_other_items": 0, 2024-03-04T09:26:07.983 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-04T09:26:07.983 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_buffer_items": 0, 2024-03-04T09:26:07.983 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_extent_bytes": 0, 2024-03-04T09:26:07.983 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_extent_items": 0, 2024-03-04T09:26:07.983 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_blob_bytes": 0, 2024-03-04T09:26:07.983 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_blob_items": 0, 2024-03-04T09:26:07.983 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-04T09:26:07.983 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_shared_blob_items": 0, 2024-03-04T09:26:07.983 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-04T09:26:07.984 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_inline_bl_items": 0, 2024-03-04T09:26:07.984 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_bytes": 0, 2024-03-04T09:26:07.984 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_items": 0, 2024-03-04T09:26:07.984 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_txc_bytes": 0, 2024-03-04T09:26:07.984 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_txc_items": 0, 2024-03-04T09:26:07.984 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-04T09:26:07.984 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_deferred_items": 0, 2024-03-04T09:26:07.984 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_bytes": 0, 2024-03-04T09:26:07.984 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_items": 0, 2024-03-04T09:26:07.984 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_bytes": 0, 2024-03-04T09:26:07.984 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_items": 0, 2024-03-04T09:26:07.984 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_reader_bytes": 0, 2024-03-04T09:26:07.984 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_reader_items": 0, 2024-03-04T09:26:07.984 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_writer_bytes": 0, 2024-03-04T09:26:07.984 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_writer_items": 0, 2024-03-04T09:26:07.985 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_anon_bytes": 190161, 2024-03-04T09:26:07.985 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_anon_items": 52, 2024-03-04T09:26:07.985 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_meta_bytes": 0, 2024-03-04T09:26:07.985 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_meta_items": 0, 2024-03-04T09:26:07.985 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_bytes": 0, 2024-03-04T09:26:07.985 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_items": 0, 2024-03-04T09:26:07.985 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mapbl_bytes": 0, 2024-03-04T09:26:07.985 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mapbl_items": 0, 2024-03-04T09:26:07.985 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pglog_bytes": 0, 2024-03-04T09:26:07.985 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pglog_items": 0, 2024-03-04T09:26:07.985 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_bytes": 9832, 2024-03-04T09:26:07.985 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_items": 205, 2024-03-04T09:26:07.985 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_mapping_bytes": 0, 2024-03-04T09:26:07.986 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_mapping_items": 0, 2024-03-04T09:26:07.986 INFO:teuthology.orchestra.run.smithi102.stdout: "pgmap_bytes": 0, 2024-03-04T09:26:07.986 INFO:teuthology.orchestra.run.smithi102.stdout: "pgmap_items": 0, 2024-03-04T09:26:07.986 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_co_bytes": 272168, 2024-03-04T09:26:07.986 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_co_items": 1801, 2024-03-04T09:26:07.986 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_1_bytes": 0, 2024-03-04T09:26:07.986 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_1_items": 0, 2024-03-04T09:26:07.986 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_2_bytes": 0, 2024-03-04T09:26:07.986 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_2_items": 0 2024-03-04T09:26:07.986 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.986 INFO:teuthology.orchestra.run.smithi102.stdout: "objecter": { 2024-03-04T09:26:07.986 INFO:teuthology.orchestra.run.smithi102.stdout: "op_active": 0, 2024-03-04T09:26:07.986 INFO:teuthology.orchestra.run.smithi102.stdout: "op_laggy": 0, 2024-03-04T09:26:07.986 INFO:teuthology.orchestra.run.smithi102.stdout: "op_send": 2236, 2024-03-04T09:26:07.987 INFO:teuthology.orchestra.run.smithi102.stdout: "op_send_bytes": 21, 2024-03-04T09:26:07.987 INFO:teuthology.orchestra.run.smithi102.stdout: "op_resend": 3, 2024-03-04T09:26:07.987 INFO:teuthology.orchestra.run.smithi102.stdout: "op_reply": 2236, 2024-03-04T09:26:07.987 INFO:teuthology.orchestra.run.smithi102.stdout: "op_latency": { 2024-03-04T09:26:07.987 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 2236, 2024-03-04T09:26:07.987 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 1.046977405, 2024-03-04T09:26:07.987 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000468236 2024-03-04T09:26:07.987 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.987 INFO:teuthology.orchestra.run.smithi102.stdout: "op_inflight": 0, 2024-03-04T09:26:07.987 INFO:teuthology.orchestra.run.smithi102.stdout: "oplen_avg": { 2024-03-04T09:26:07.987 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 2236, 2024-03-04T09:26:07.987 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 2237 2024-03-04T09:26:07.987 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.987 INFO:teuthology.orchestra.run.smithi102.stdout: "op": 2236, 2024-03-04T09:26:07.988 INFO:teuthology.orchestra.run.smithi102.stdout: "op_r": 2236, 2024-03-04T09:26:07.988 INFO:teuthology.orchestra.run.smithi102.stdout: "op_w": 0, 2024-03-04T09:26:07.988 INFO:teuthology.orchestra.run.smithi102.stdout: "op_rmw": 0, 2024-03-04T09:26:07.988 INFO:teuthology.orchestra.run.smithi102.stdout: "op_pg": 0, 2024-03-04T09:26:07.988 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_stat": 1433, 2024-03-04T09:26:07.988 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_create": 0, 2024-03-04T09:26:07.988 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_read": 801, 2024-03-04T09:26:07.988 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_write": 0, 2024-03-04T09:26:07.988 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_writefull": 0, 2024-03-04T09:26:07.988 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_writesame": 0, 2024-03-04T09:26:07.988 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_append": 0, 2024-03-04T09:26:07.988 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_zero": 0, 2024-03-04T09:26:07.988 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_truncate": 0, 2024-03-04T09:26:07.989 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_delete": 0, 2024-03-04T09:26:07.989 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_mapext": 0, 2024-03-04T09:26:07.989 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_sparse_read": 0, 2024-03-04T09:26:07.989 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_clonerange": 0, 2024-03-04T09:26:07.989 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_getxattr": 1, 2024-03-04T09:26:07.989 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_setxattr": 0, 2024-03-04T09:26:07.989 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_cmpxattr": 0, 2024-03-04T09:26:07.989 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_rmxattr": 0, 2024-03-04T09:26:07.989 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_resetxattrs": 0, 2024-03-04T09:26:07.989 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_call": 0, 2024-03-04T09:26:07.989 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_watch": 0, 2024-03-04T09:26:07.989 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_notify": 0, 2024-03-04T09:26:07.989 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_src_cmpxattr": 0, 2024-03-04T09:26:07.990 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_pgls": 0, 2024-03-04T09:26:07.990 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_pgls_filter": 0, 2024-03-04T09:26:07.990 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_other": 0, 2024-03-04T09:26:07.990 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_active": 0, 2024-03-04T09:26:07.990 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_send": 0, 2024-03-04T09:26:07.990 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_resend": 0, 2024-03-04T09:26:07.990 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_ping": 0, 2024-03-04T09:26:07.990 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_active": 0, 2024-03-04T09:26:07.990 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_send": 0, 2024-03-04T09:26:07.990 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_resend": 0, 2024-03-04T09:26:07.990 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_active": 0, 2024-03-04T09:26:07.990 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_send": 0, 2024-03-04T09:26:07.991 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_resend": 0, 2024-03-04T09:26:07.991 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_active": 0, 2024-03-04T09:26:07.991 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_send": 0, 2024-03-04T09:26:07.991 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_resend": 0, 2024-03-04T09:26:07.991 INFO:teuthology.orchestra.run.smithi102.stdout: "command_active": 0, 2024-03-04T09:26:07.991 INFO:teuthology.orchestra.run.smithi102.stdout: "command_send": 0, 2024-03-04T09:26:07.991 INFO:teuthology.orchestra.run.smithi102.stdout: "command_resend": 0, 2024-03-04T09:26:07.991 INFO:teuthology.orchestra.run.smithi102.stdout: "map_epoch": 104, 2024-03-04T09:26:07.991 INFO:teuthology.orchestra.run.smithi102.stdout: "map_full": 0, 2024-03-04T09:26:07.991 INFO:teuthology.orchestra.run.smithi102.stdout: "map_inc": 14, 2024-03-04T09:26:07.991 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_sessions": 5, 2024-03-04T09:26:07.991 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_session_open": 5, 2024-03-04T09:26:07.991 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_session_close": 0, 2024-03-04T09:26:07.991 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_laggy": 0, 2024-03-04T09:26:07.991 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_wr": 0, 2024-03-04T09:26:07.992 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_rd": 2, 2024-03-04T09:26:07.992 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_del": 0 2024-03-04T09:26:07.992 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.992 INFO:teuthology.orchestra.run.smithi102.stdout: "oft": { 2024-03-04T09:26:07.992 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_objs": 0, 2024-03-04T09:26:07.992 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_kv_pairs": 0, 2024-03-04T09:26:07.992 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_updates": 0, 2024-03-04T09:26:07.992 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_removes": 0 2024-03-04T09:26:07.992 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.992 INFO:teuthology.orchestra.run.smithi102.stdout: "osd-slow-ops": { 2024-03-04T09:26:07.992 INFO:teuthology.orchestra.run.smithi102.stdout: "slow_ops_count": 0 2024-03-04T09:26:07.992 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.992 INFO:teuthology.orchestra.run.smithi102.stdout: "purge_queue": { 2024-03-04T09:26:07.993 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing_ops": 0, 2024-03-04T09:26:07.993 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing_ops_high_water": 0, 2024-03-04T09:26:07.993 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing": 0, 2024-03-04T09:26:07.993 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing_high_water": 0, 2024-03-04T09:26:07.993 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executed_ops": 0, 2024-03-04T09:26:07.993 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executed": 0, 2024-03-04T09:26:07.993 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_item_in_journal": 0 2024-03-04T09:26:07.993 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.993 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-04T09:26:07.993 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-03-04T09:26:07.993 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 104857600, 2024-03-04T09:26:07.993 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-03-04T09:26:07.993 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 2516, 2024-03-04T09:26:07.993 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 3624261, 2024-03-04T09:26:07.994 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-03-04T09:26:07.994 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 2516, 2024-03-04T09:26:07.994 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2024-03-04T09:26:07.994 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2024-03-04T09:26:07.994 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 2516, 2024-03-04T09:26:07.994 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 3624261, 2024-03-04T09:26:07.994 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-03-04T09:26:07.994 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:07.994 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:07.994 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:07.994 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-03-04T09:26:07.994 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.994 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-objecter_bytes": { 2024-03-04T09:26:07.994 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-03-04T09:26:07.994 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 104857600, 2024-03-04T09:26:07.995 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-03-04T09:26:07.995 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 0, 2024-03-04T09:26:07.995 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 0, 2024-03-04T09:26:07.995 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-03-04T09:26:07.995 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 0, 2024-03-04T09:26:07.995 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 2236, 2024-03-04T09:26:07.995 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 1574054, 2024-03-04T09:26:07.995 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 2236, 2024-03-04T09:26:07.995 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 1574054, 2024-03-04T09:26:07.995 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-03-04T09:26:07.995 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:07.995 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:07.995 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:07.996 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-03-04T09:26:07.996 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.996 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-objecter_ops": { 2024-03-04T09:26:07.996 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-03-04T09:26:07.996 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 1024, 2024-03-04T09:26:07.996 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-03-04T09:26:07.996 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 0, 2024-03-04T09:26:07.996 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 0, 2024-03-04T09:26:07.996 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-03-04T09:26:07.996 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 0, 2024-03-04T09:26:07.996 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 2236, 2024-03-04T09:26:07.996 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 2236, 2024-03-04T09:26:07.996 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 2236, 2024-03-04T09:26:07.996 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 2236, 2024-03-04T09:26:07.996 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-03-04T09:26:07.997 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:07.997 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:07.997 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:07.997 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-03-04T09:26:07.997 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.997 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-write_buf_throttle": { 2024-03-04T09:26:07.997 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-03-04T09:26:07.997 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 3758096384, 2024-03-04T09:26:07.997 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-03-04T09:26:07.997 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 0, 2024-03-04T09:26:07.997 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 0, 2024-03-04T09:26:07.997 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-03-04T09:26:07.997 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 0, 2024-03-04T09:26:07.997 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2024-03-04T09:26:07.998 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2024-03-04T09:26:07.998 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 0, 2024-03-04T09:26:07.998 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 0, 2024-03-04T09:26:07.998 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-03-04T09:26:07.998 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:07.998 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:07.998 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:07.998 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-03-04T09:26:07.998 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-03-04T09:26:07.998 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-write_buf_throttle-0x55c44a2fc960": { 2024-03-04T09:26:07.998 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-03-04T09:26:07.998 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 3758096384, 2024-03-04T09:26:07.998 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-03-04T09:26:07.998 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 0, 2024-03-04T09:26:07.998 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 0, 2024-03-04T09:26:07.999 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-03-04T09:26:07.999 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 0, 2024-03-04T09:26:07.999 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2024-03-04T09:26:07.999 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2024-03-04T09:26:07.999 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 0, 2024-03-04T09:26:07.999 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 0, 2024-03-04T09:26:07.999 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-03-04T09:26:07.999 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-03-04T09:26:07.999 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-03-04T09:26:07.999 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-03-04T09:26:07.999 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-03-04T09:26:07.999 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-03-04T09:26:07.999 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-03-04T09:26:08.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:07 smithi082 ceph-mon[32880]: pgmap v326: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-03-04T09:26:08.723 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-03-04T09:26:08.724 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-03-04T09:26:08.724 INFO:tasks.check_counter:Daemon mds.k mds.root_rsnaps=0 2024-03-04T09:26:08.724 INFO:tasks.check_counter:Daemon mds.k mds_server.req_mksnap_latency.avgcount=0 2024-03-04T09:26:08.724 INFO:tasks.check_counter:Daemon mds.k mds_server.req_rmsnap_latency.avgcount=0 2024-03-04T09:26:08.724 DEBUG:tasks.check_counter:Getting stats from c 2024-03-04T09:26:08.724 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph daemon mds.c perf dump 2024-03-04T09:26:09.040 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.c/config 2024-03-04T09:26:10.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:10 smithi082 ceph-mon[32880]: pgmap v327: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-03-04T09:26:10.876 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:10 smithi190 ceph-mon[36341]: pgmap v327: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-03-04T09:26:10.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:10 smithi102 ceph-mon[36220]: pgmap v327: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-03-04T09:26:11.030 INFO:teuthology.orchestra.run.smithi190.stdout:{ 2024-03-04T09:26:11.030 INFO:teuthology.orchestra.run.smithi190.stdout: "AsyncMessenger::Worker-0": { 2024-03-04T09:26:11.030 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_messages": 1464, 2024-03-04T09:26:11.030 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_messages": 1506, 2024-03-04T09:26:11.030 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_bytes": 586498, 2024-03-04T09:26:11.030 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_bytes": 2385637, 2024-03-04T09:26:11.030 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_created_connections": 10, 2024-03-04T09:26:11.030 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_active_connections": 4, 2024-03-04T09:26:11.030 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_total_time": 0.099120386, 2024-03-04T09:26:11.031 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_send_time": 0.038428506, 2024-03-04T09:26:11.031 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_recv_time": 0.052345382, 2024-03-04T09:26:11.031 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_fast_dispatch_time": 0.011389610, 2024-03-04T09:26:11.031 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_messages_queue_lat": { 2024-03-04T09:26:11.031 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 1509, 2024-03-04T09:26:11.031 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.065897102, 2024-03-04T09:26:11.031 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000043669 2024-03-04T09:26:11.031 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.031 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_handle_ack_lat": { 2024-03-04T09:26:11.031 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 2127, 2024-03-04T09:26:11.031 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000355183, 2024-03-04T09:26:11.031 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000166 2024-03-04T09:26:11.031 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.031 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-03-04T09:26:11.032 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_encrypted_bytes": 313024 2024-03-04T09:26:11.032 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.032 INFO:teuthology.orchestra.run.smithi190.stdout: "AsyncMessenger::Worker-1": { 2024-03-04T09:26:11.032 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_messages": 1690, 2024-03-04T09:26:11.032 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_messages": 1263, 2024-03-04T09:26:11.032 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_bytes": 744589, 2024-03-04T09:26:11.032 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_bytes": 555254, 2024-03-04T09:26:11.032 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_created_connections": 11, 2024-03-04T09:26:11.032 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_active_connections": 6, 2024-03-04T09:26:11.032 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_total_time": 0.089883218, 2024-03-04T09:26:11.032 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_send_time": 0.031990725, 2024-03-04T09:26:11.032 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_recv_time": 0.060438934, 2024-03-04T09:26:11.032 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_fast_dispatch_time": 0.006765257, 2024-03-04T09:26:11.032 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_messages_queue_lat": { 2024-03-04T09:26:11.033 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 1260, 2024-03-04T09:26:11.033 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.046790190, 2024-03-04T09:26:11.033 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000037135 2024-03-04T09:26:11.033 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.033 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_handle_ack_lat": { 2024-03-04T09:26:11.033 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 2411, 2024-03-04T09:26:11.033 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000346598, 2024-03-04T09:26:11.033 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000143 2024-03-04T09:26:11.033 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.033 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_encrypted_bytes": 1088, 2024-03-04T09:26:11.033 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_encrypted_bytes": 132448 2024-03-04T09:26:11.033 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.033 INFO:teuthology.orchestra.run.smithi190.stdout: "AsyncMessenger::Worker-2": { 2024-03-04T09:26:11.034 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_messages": 1421, 2024-03-04T09:26:11.034 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_messages": 1958, 2024-03-04T09:26:11.034 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_bytes": 2058491, 2024-03-04T09:26:11.034 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_bytes": 978020, 2024-03-04T09:26:11.034 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_created_connections": 14, 2024-03-04T09:26:11.034 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_active_connections": 8, 2024-03-04T09:26:11.034 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_total_time": 0.122642663, 2024-03-04T09:26:11.034 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_send_time": 0.042026879, 2024-03-04T09:26:11.034 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_recv_time": 0.083678103, 2024-03-04T09:26:11.034 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_fast_dispatch_time": 0.008740256, 2024-03-04T09:26:11.034 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_messages_queue_lat": { 2024-03-04T09:26:11.034 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 1953, 2024-03-04T09:26:11.034 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.099656294, 2024-03-04T09:26:11.034 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000051027 2024-03-04T09:26:11.034 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.035 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_handle_ack_lat": { 2024-03-04T09:26:11.035 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 2257, 2024-03-04T09:26:11.035 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000411247, 2024-03-04T09:26:11.035 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000182 2024-03-04T09:26:11.035 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.035 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_encrypted_bytes": 1682736, 2024-03-04T09:26:11.035 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_encrypted_bytes": 143248 2024-03-04T09:26:11.035 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.035 INFO:teuthology.orchestra.run.smithi190.stdout: "cct": { 2024-03-04T09:26:11.035 INFO:teuthology.orchestra.run.smithi190.stdout: "total_workers": 1, 2024-03-04T09:26:11.035 INFO:teuthology.orchestra.run.smithi190.stdout: "unhealthy_workers": 0 2024-03-04T09:26:11.035 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.035 INFO:teuthology.orchestra.run.smithi190.stdout: "finisher-MDSRank": { 2024-03-04T09:26:11.035 INFO:teuthology.orchestra.run.smithi190.stdout: "queue_len": 0, 2024-03-04T09:26:11.036 INFO:teuthology.orchestra.run.smithi190.stdout: "complete_latency": { 2024-03-04T09:26:11.036 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 451, 2024-03-04T09:26:11.036 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.304369785, 2024-03-04T09:26:11.036 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000674877 2024-03-04T09:26:11.036 INFO:teuthology.orchestra.run.smithi190.stdout: } 2024-03-04T09:26:11.036 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.036 INFO:teuthology.orchestra.run.smithi190.stdout: "finisher-PurgeQueue": { 2024-03-04T09:26:11.036 INFO:teuthology.orchestra.run.smithi190.stdout: "queue_len": 0, 2024-03-04T09:26:11.036 INFO:teuthology.orchestra.run.smithi190.stdout: "complete_latency": { 2024-03-04T09:26:11.036 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 454, 2024-03-04T09:26:11.036 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.033661094, 2024-03-04T09:26:11.036 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000074143 2024-03-04T09:26:11.036 INFO:teuthology.orchestra.run.smithi190.stdout: } 2024-03-04T09:26:11.036 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.037 INFO:teuthology.orchestra.run.smithi190.stdout: "mds": { 2024-03-04T09:26:11.037 INFO:teuthology.orchestra.run.smithi190.stdout: "request": 572, 2024-03-04T09:26:11.037 INFO:teuthology.orchestra.run.smithi190.stdout: "reply": 416, 2024-03-04T09:26:11.037 INFO:teuthology.orchestra.run.smithi190.stdout: "reply_latency": { 2024-03-04T09:26:11.037 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 416, 2024-03-04T09:26:11.037 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.678038974, 2024-03-04T09:26:11.037 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.001629901 2024-03-04T09:26:11.037 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.037 INFO:teuthology.orchestra.run.smithi190.stdout: "slow_reply": 0, 2024-03-04T09:26:11.037 INFO:teuthology.orchestra.run.smithi190.stdout: "forward": 156, 2024-03-04T09:26:11.037 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_fetch_complete": 0, 2024-03-04T09:26:11.037 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_fetch_keys": 0, 2024-03-04T09:26:11.037 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_commit": 11, 2024-03-04T09:26:11.037 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_split": 0, 2024-03-04T09:26:11.038 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_merge": 0, 2024-03-04T09:26:11.038 INFO:teuthology.orchestra.run.smithi190.stdout: "inodes": 79, 2024-03-04T09:26:11.038 INFO:teuthology.orchestra.run.smithi190.stdout: "inodes_top": 2, 2024-03-04T09:26:11.038 INFO:teuthology.orchestra.run.smithi190.stdout: "inodes_bottom": 2, 2024-03-04T09:26:11.038 INFO:teuthology.orchestra.run.smithi190.stdout: "inodes_pin_tail": 75, 2024-03-04T09:26:11.038 INFO:teuthology.orchestra.run.smithi190.stdout: "inodes_pinned": 75, 2024-03-04T09:26:11.038 INFO:teuthology.orchestra.run.smithi190.stdout: "inodes_expired": 167, 2024-03-04T09:26:11.038 INFO:teuthology.orchestra.run.smithi190.stdout: "inodes_with_caps": 1, 2024-03-04T09:26:11.038 INFO:teuthology.orchestra.run.smithi190.stdout: "caps": 1, 2024-03-04T09:26:11.038 INFO:teuthology.orchestra.run.smithi190.stdout: "subtrees": 4, 2024-03-04T09:26:11.038 INFO:teuthology.orchestra.run.smithi190.stdout: "traverse": 1038, 2024-03-04T09:26:11.038 INFO:teuthology.orchestra.run.smithi190.stdout: "traverse_hit": 581, 2024-03-04T09:26:11.038 INFO:teuthology.orchestra.run.smithi190.stdout: "traverse_forward": 155, 2024-03-04T09:26:11.038 INFO:teuthology.orchestra.run.smithi190.stdout: "traverse_discover": 26, 2024-03-04T09:26:11.038 INFO:teuthology.orchestra.run.smithi190.stdout: "traverse_dir_fetch": 0, 2024-03-04T09:26:11.039 INFO:teuthology.orchestra.run.smithi190.stdout: "traverse_remote_ino": 0, 2024-03-04T09:26:11.039 INFO:teuthology.orchestra.run.smithi190.stdout: "traverse_lock": 0, 2024-03-04T09:26:11.039 INFO:teuthology.orchestra.run.smithi190.stdout: "load_cent": 0, 2024-03-04T09:26:11.039 INFO:teuthology.orchestra.run.smithi190.stdout: "q": 0, 2024-03-04T09:26:11.039 INFO:teuthology.orchestra.run.smithi190.stdout: "exported": 11, 2024-03-04T09:26:11.039 INFO:teuthology.orchestra.run.smithi190.stdout: "exported_inodes": 102, 2024-03-04T09:26:11.039 INFO:teuthology.orchestra.run.smithi190.stdout: "imported": 11, 2024-03-04T09:26:11.039 INFO:teuthology.orchestra.run.smithi190.stdout: "imported_inodes": 150, 2024-03-04T09:26:11.039 INFO:teuthology.orchestra.run.smithi190.stdout: "openino_dir_fetch": 0, 2024-03-04T09:26:11.039 INFO:teuthology.orchestra.run.smithi190.stdout: "openino_backtrace_fetch": 0, 2024-03-04T09:26:11.039 INFO:teuthology.orchestra.run.smithi190.stdout: "openino_peer_discover": 0, 2024-03-04T09:26:11.039 INFO:teuthology.orchestra.run.smithi190.stdout: "root_rfiles": 4, 2024-03-04T09:26:11.039 INFO:teuthology.orchestra.run.smithi190.stdout: "root_rbytes": 234, 2024-03-04T09:26:11.039 INFO:teuthology.orchestra.run.smithi190.stdout: "root_rsnaps": 0, 2024-03-04T09:26:11.040 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_backtrace_fetch": 0, 2024-03-04T09:26:11.040 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_set_tag": 0, 2024-03-04T09:26:11.040 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_backtrace_repaired": 0, 2024-03-04T09:26:11.040 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_inotable_repaired": 0, 2024-03-04T09:26:11.040 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_dir_inodes": 0, 2024-03-04T09:26:11.040 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_dir_base_inodes": 0, 2024-03-04T09:26:11.040 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_dirfrag_rstats": 0, 2024-03-04T09:26:11.040 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_file_inodes": 0, 2024-03-04T09:26:11.040 INFO:teuthology.orchestra.run.smithi190.stdout: "handle_inode_file_caps": 0, 2024-03-04T09:26:11.040 INFO:teuthology.orchestra.run.smithi190.stdout: "ceph_cap_op_revoke": 38, 2024-03-04T09:26:11.040 INFO:teuthology.orchestra.run.smithi190.stdout: "ceph_cap_op_grant": 265, 2024-03-04T09:26:11.040 INFO:teuthology.orchestra.run.smithi190.stdout: "ceph_cap_op_trunc": 0, 2024-03-04T09:26:11.040 INFO:teuthology.orchestra.run.smithi190.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-03-04T09:26:11.040 INFO:teuthology.orchestra.run.smithi190.stdout: "ceph_cap_op_flush_ack": 0, 2024-03-04T09:26:11.040 INFO:teuthology.orchestra.run.smithi190.stdout: "handle_client_caps": 315, 2024-03-04T09:26:11.041 INFO:teuthology.orchestra.run.smithi190.stdout: "handle_client_caps_dirty": 175, 2024-03-04T09:26:11.041 INFO:teuthology.orchestra.run.smithi190.stdout: "handle_client_cap_release": 21, 2024-03-04T09:26:11.041 INFO:teuthology.orchestra.run.smithi190.stdout: "process_request_cap_release": 445 2024-03-04T09:26:11.041 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.041 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_cache": { 2024-03-04T09:26:11.041 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_update": 0, 2024-03-04T09:26:11.041 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_update_receipt": 0, 2024-03-04T09:26:11.041 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_try_discover": 0, 2024-03-04T09:26:11.041 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_send_discover": 25, 2024-03-04T09:26:11.041 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_handle_discover": 1, 2024-03-04T09:26:11.041 INFO:teuthology.orchestra.run.smithi190.stdout: "num_strays": 4, 2024-03-04T09:26:11.041 INFO:teuthology.orchestra.run.smithi190.stdout: "num_strays_delayed": 0, 2024-03-04T09:26:11.041 INFO:teuthology.orchestra.run.smithi190.stdout: "num_strays_enqueuing": 0, 2024-03-04T09:26:11.041 INFO:teuthology.orchestra.run.smithi190.stdout: "strays_created": 198, 2024-03-04T09:26:11.041 INFO:teuthology.orchestra.run.smithi190.stdout: "strays_enqueued": 194, 2024-03-04T09:26:11.042 INFO:teuthology.orchestra.run.smithi190.stdout: "strays_reintegrated": 0, 2024-03-04T09:26:11.042 INFO:teuthology.orchestra.run.smithi190.stdout: "strays_migrated": 0, 2024-03-04T09:26:11.042 INFO:teuthology.orchestra.run.smithi190.stdout: "num_recovering_processing": 0, 2024-03-04T09:26:11.042 INFO:teuthology.orchestra.run.smithi190.stdout: "num_recovering_enqueued": 0, 2024-03-04T09:26:11.042 INFO:teuthology.orchestra.run.smithi190.stdout: "num_recovering_prioritized": 0, 2024-03-04T09:26:11.042 INFO:teuthology.orchestra.run.smithi190.stdout: "recovery_started": 0, 2024-03-04T09:26:11.042 INFO:teuthology.orchestra.run.smithi190.stdout: "recovery_completed": 0, 2024-03-04T09:26:11.042 INFO:teuthology.orchestra.run.smithi190.stdout: "ireq_enqueue_scrub": 0, 2024-03-04T09:26:11.042 INFO:teuthology.orchestra.run.smithi190.stdout: "ireq_exportdir": 11, 2024-03-04T09:26:11.042 INFO:teuthology.orchestra.run.smithi190.stdout: "ireq_flush": 0, 2024-03-04T09:26:11.042 INFO:teuthology.orchestra.run.smithi190.stdout: "ireq_fragmentdir": 0, 2024-03-04T09:26:11.042 INFO:teuthology.orchestra.run.smithi190.stdout: "ireq_fragstats": 0, 2024-03-04T09:26:11.042 INFO:teuthology.orchestra.run.smithi190.stdout: "ireq_inodestats": 0 2024-03-04T09:26:11.042 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.042 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_log": { 2024-03-04T09:26:11.043 INFO:teuthology.orchestra.run.smithi190.stdout: "evlrg": 0, 2024-03-04T09:26:11.043 INFO:teuthology.orchestra.run.smithi190.stdout: "evadd": 791, 2024-03-04T09:26:11.043 INFO:teuthology.orchestra.run.smithi190.stdout: "evex": 0, 2024-03-04T09:26:11.043 INFO:teuthology.orchestra.run.smithi190.stdout: "evtrm": 0, 2024-03-04T09:26:11.043 INFO:teuthology.orchestra.run.smithi190.stdout: "ev": 791, 2024-03-04T09:26:11.043 INFO:teuthology.orchestra.run.smithi190.stdout: "evexg": 0, 2024-03-04T09:26:11.043 INFO:teuthology.orchestra.run.smithi190.stdout: "evexd": 0, 2024-03-04T09:26:11.043 INFO:teuthology.orchestra.run.smithi190.stdout: "segadd": 2, 2024-03-04T09:26:11.043 INFO:teuthology.orchestra.run.smithi190.stdout: "segex": 0, 2024-03-04T09:26:11.043 INFO:teuthology.orchestra.run.smithi190.stdout: "segtrm": 0, 2024-03-04T09:26:11.043 INFO:teuthology.orchestra.run.smithi190.stdout: "seg": 2, 2024-03-04T09:26:11.043 INFO:teuthology.orchestra.run.smithi190.stdout: "segmjr": 2, 2024-03-04T09:26:11.043 INFO:teuthology.orchestra.run.smithi190.stdout: "segexg": 0, 2024-03-04T09:26:11.043 INFO:teuthology.orchestra.run.smithi190.stdout: "segexd": 0, 2024-03-04T09:26:11.043 INFO:teuthology.orchestra.run.smithi190.stdout: "expos": 4194304, 2024-03-04T09:26:11.043 INFO:teuthology.orchestra.run.smithi190.stdout: "wrpos": 5768353, 2024-03-04T09:26:11.044 INFO:teuthology.orchestra.run.smithi190.stdout: "rdpos": 0, 2024-03-04T09:26:11.044 INFO:teuthology.orchestra.run.smithi190.stdout: "jlat": { 2024-03-04T09:26:11.044 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 177, 2024-03-04T09:26:11.044 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.338765367, 2024-03-04T09:26:11.044 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.001913928 2024-03-04T09:26:11.044 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.044 INFO:teuthology.orchestra.run.smithi190.stdout: "replayed": 0 2024-03-04T09:26:11.044 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.044 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_mem": { 2024-03-04T09:26:11.044 INFO:teuthology.orchestra.run.smithi190.stdout: "ino": 55, 2024-03-04T09:26:11.044 INFO:teuthology.orchestra.run.smithi190.stdout: "ino+": 335, 2024-03-04T09:26:11.044 INFO:teuthology.orchestra.run.smithi190.stdout: "ino-": 280, 2024-03-04T09:26:11.044 INFO:teuthology.orchestra.run.smithi190.stdout: "dir": 25, 2024-03-04T09:26:11.044 INFO:teuthology.orchestra.run.smithi190.stdout: "dir+": 92, 2024-03-04T09:26:11.045 INFO:teuthology.orchestra.run.smithi190.stdout: "dir-": 67, 2024-03-04T09:26:11.045 INFO:teuthology.orchestra.run.smithi190.stdout: "dn": 79, 2024-03-04T09:26:11.045 INFO:teuthology.orchestra.run.smithi190.stdout: "dn+": 510, 2024-03-04T09:26:11.045 INFO:teuthology.orchestra.run.smithi190.stdout: "dn-": 431, 2024-03-04T09:26:11.045 INFO:teuthology.orchestra.run.smithi190.stdout: "cap": 1, 2024-03-04T09:26:11.045 INFO:teuthology.orchestra.run.smithi190.stdout: "cap+": 220, 2024-03-04T09:26:11.045 INFO:teuthology.orchestra.run.smithi190.stdout: "cap-": 219, 2024-03-04T09:26:11.045 INFO:teuthology.orchestra.run.smithi190.stdout: "rss": 60276, 2024-03-04T09:26:11.045 INFO:teuthology.orchestra.run.smithi190.stdout: "heap": 223612 2024-03-04T09:26:11.045 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.045 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_server": { 2024-03-04T09:26:11.045 INFO:teuthology.orchestra.run.smithi190.stdout: "dispatch_client_request": 874, 2024-03-04T09:26:11.045 INFO:teuthology.orchestra.run.smithi190.stdout: "dispatch_server_request": 15, 2024-03-04T09:26:11.045 INFO:teuthology.orchestra.run.smithi190.stdout: "handle_client_request": 572, 2024-03-04T09:26:11.045 INFO:teuthology.orchestra.run.smithi190.stdout: "handle_client_session": 21, 2024-03-04T09:26:11.046 INFO:teuthology.orchestra.run.smithi190.stdout: "handle_peer_request": 137, 2024-03-04T09:26:11.046 INFO:teuthology.orchestra.run.smithi190.stdout: "req_create_latency": { 2024-03-04T09:26:11.046 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 48, 2024-03-04T09:26:11.046 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.089972766, 2024-03-04T09:26:11.046 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.001874432 2024-03-04T09:26:11.046 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.046 INFO:teuthology.orchestra.run.smithi190.stdout: "req_getattr_latency": { 2024-03-04T09:26:11.046 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 3, 2024-03-04T09:26:11.046 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.001101597, 2024-03-04T09:26:11.046 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000367199 2024-03-04T09:26:11.046 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.046 INFO:teuthology.orchestra.run.smithi190.stdout: "req_getfilelock_latency": { 2024-03-04T09:26:11.046 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:11.046 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:11.047 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:11.047 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.047 INFO:teuthology.orchestra.run.smithi190.stdout: "req_link_latency": { 2024-03-04T09:26:11.047 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:11.047 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:11.047 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:11.047 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.047 INFO:teuthology.orchestra.run.smithi190.stdout: "req_lookup_latency": { 2024-03-04T09:26:11.047 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 150, 2024-03-04T09:26:11.047 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.119737583, 2024-03-04T09:26:11.047 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000798250 2024-03-04T09:26:11.047 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.047 INFO:teuthology.orchestra.run.smithi190.stdout: "req_lookuphash_latency": { 2024-03-04T09:26:11.047 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:11.048 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:11.048 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:11.048 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.048 INFO:teuthology.orchestra.run.smithi190.stdout: "req_lookupino_latency": { 2024-03-04T09:26:11.048 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:11.048 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:11.048 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:11.048 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.048 INFO:teuthology.orchestra.run.smithi190.stdout: "req_lookupname_latency": { 2024-03-04T09:26:11.048 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:11.048 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:11.048 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:11.048 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.048 INFO:teuthology.orchestra.run.smithi190.stdout: "req_lookupparent_latency": { 2024-03-04T09:26:11.049 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:11.049 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:11.049 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:11.049 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.049 INFO:teuthology.orchestra.run.smithi190.stdout: "req_lookupsnap_latency": { 2024-03-04T09:26:11.049 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:11.049 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:11.049 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:11.049 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.049 INFO:teuthology.orchestra.run.smithi190.stdout: "req_lssnap_latency": { 2024-03-04T09:26:11.049 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:11.049 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:11.049 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:11.049 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.049 INFO:teuthology.orchestra.run.smithi190.stdout: "req_mkdir_latency": { 2024-03-04T09:26:11.050 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:11.050 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:11.050 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:11.050 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.050 INFO:teuthology.orchestra.run.smithi190.stdout: "req_mknod_latency": { 2024-03-04T09:26:11.050 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:11.051 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:11.051 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:11.051 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.051 INFO:teuthology.orchestra.run.smithi190.stdout: "req_mksnap_latency": { 2024-03-04T09:26:11.051 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:11.051 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:11.051 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:11.051 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.051 INFO:teuthology.orchestra.run.smithi190.stdout: "req_open_latency": { 2024-03-04T09:26:11.051 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:11.051 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:11.051 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:11.051 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.051 INFO:teuthology.orchestra.run.smithi190.stdout: "req_readdir_latency": { 2024-03-04T09:26:11.051 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 17, 2024-03-04T09:26:11.052 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.011615579, 2024-03-04T09:26:11.052 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000683269 2024-03-04T09:26:11.052 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.052 INFO:teuthology.orchestra.run.smithi190.stdout: "req_rename_latency": { 2024-03-04T09:26:11.052 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:11.052 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:11.052 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:11.052 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.052 INFO:teuthology.orchestra.run.smithi190.stdout: "req_renamesnap_latency": { 2024-03-04T09:26:11.052 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:11.052 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:11.052 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:11.052 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.052 INFO:teuthology.orchestra.run.smithi190.stdout: "req_snapdiff_latency": { 2024-03-04T09:26:11.053 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:11.053 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:11.053 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:11.053 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.053 INFO:teuthology.orchestra.run.smithi190.stdout: "req_rmdir_latency": { 2024-03-04T09:26:11.053 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 4, 2024-03-04T09:26:11.053 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.059170690, 2024-03-04T09:26:11.053 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.014792672 2024-03-04T09:26:11.053 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.053 INFO:teuthology.orchestra.run.smithi190.stdout: "req_rmsnap_latency": { 2024-03-04T09:26:11.053 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:11.053 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:11.053 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:11.054 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.054 INFO:teuthology.orchestra.run.smithi190.stdout: "req_rmxattr_latency": { 2024-03-04T09:26:11.054 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:11.054 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:11.054 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:11.054 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.054 INFO:teuthology.orchestra.run.smithi190.stdout: "req_setattr_latency": { 2024-03-04T09:26:11.054 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:11.054 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:11.054 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:11.054 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.054 INFO:teuthology.orchestra.run.smithi190.stdout: "req_setdirlayout_latency": { 2024-03-04T09:26:11.054 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:11.054 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:11.054 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:11.055 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.055 INFO:teuthology.orchestra.run.smithi190.stdout: "req_setfilelock_latency": { 2024-03-04T09:26:11.055 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:11.055 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:11.055 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:11.055 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.055 INFO:teuthology.orchestra.run.smithi190.stdout: "req_setlayout_latency": { 2024-03-04T09:26:11.055 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:11.055 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:11.055 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:11.055 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.055 INFO:teuthology.orchestra.run.smithi190.stdout: "req_setxattr_latency": { 2024-03-04T09:26:11.055 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:11.055 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:11.055 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:11.056 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.056 INFO:teuthology.orchestra.run.smithi190.stdout: "req_symlink_latency": { 2024-03-04T09:26:11.056 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:11.056 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:11.056 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:11.056 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.056 INFO:teuthology.orchestra.run.smithi190.stdout: "req_unlink_latency": { 2024-03-04T09:26:11.056 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 194, 2024-03-04T09:26:11.056 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.396440759, 2024-03-04T09:26:11.056 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.002043509 2024-03-04T09:26:11.056 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.056 INFO:teuthology.orchestra.run.smithi190.stdout: "cap_revoke_eviction": 0, 2024-03-04T09:26:11.056 INFO:teuthology.orchestra.run.smithi190.stdout: "cap_acquisition_throttle": 0, 2024-03-04T09:26:11.056 INFO:teuthology.orchestra.run.smithi190.stdout: "req_getvxattr_latency": { 2024-03-04T09:26:11.057 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:11.057 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:11.057 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:11.057 INFO:teuthology.orchestra.run.smithi190.stdout: } 2024-03-04T09:26:11.057 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.057 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_sessions": { 2024-03-04T09:26:11.057 INFO:teuthology.orchestra.run.smithi190.stdout: "session_count": 1, 2024-03-04T09:26:11.057 INFO:teuthology.orchestra.run.smithi190.stdout: "session_add": 4, 2024-03-04T09:26:11.057 INFO:teuthology.orchestra.run.smithi190.stdout: "session_remove": 3, 2024-03-04T09:26:11.057 INFO:teuthology.orchestra.run.smithi190.stdout: "sessions_open": 1, 2024-03-04T09:26:11.057 INFO:teuthology.orchestra.run.smithi190.stdout: "sessions_stale": 0, 2024-03-04T09:26:11.057 INFO:teuthology.orchestra.run.smithi190.stdout: "total_load": 282, 2024-03-04T09:26:11.057 INFO:teuthology.orchestra.run.smithi190.stdout: "average_load": 282, 2024-03-04T09:26:11.057 INFO:teuthology.orchestra.run.smithi190.stdout: "avg_session_uptime": 636, 2024-03-04T09:26:11.058 INFO:teuthology.orchestra.run.smithi190.stdout: "mdthresh_evicted": 0 2024-03-04T09:26:11.058 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.058 INFO:teuthology.orchestra.run.smithi190.stdout: "mempool": { 2024-03-04T09:26:11.058 INFO:teuthology.orchestra.run.smithi190.stdout: "bloom_filter_bytes": 0, 2024-03-04T09:26:11.058 INFO:teuthology.orchestra.run.smithi190.stdout: "bloom_filter_items": 0, 2024-03-04T09:26:11.058 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_alloc_bytes": 0, 2024-03-04T09:26:11.058 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_alloc_items": 0, 2024-03-04T09:26:11.058 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_data_bytes": 0, 2024-03-04T09:26:11.058 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_data_items": 0, 2024-03-04T09:26:11.058 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-04T09:26:11.058 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_onode_items": 0, 2024-03-04T09:26:11.058 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-04T09:26:11.058 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_meta_items": 0, 2024-03-04T09:26:11.058 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_other_bytes": 0, 2024-03-04T09:26:11.058 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_other_items": 0, 2024-03-04T09:26:11.059 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-04T09:26:11.059 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_buffer_items": 0, 2024-03-04T09:26:11.059 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_extent_bytes": 0, 2024-03-04T09:26:11.059 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_extent_items": 0, 2024-03-04T09:26:11.059 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_blob_bytes": 0, 2024-03-04T09:26:11.059 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_blob_items": 0, 2024-03-04T09:26:11.059 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-04T09:26:11.059 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_shared_blob_items": 0, 2024-03-04T09:26:11.059 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-04T09:26:11.059 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_inline_bl_items": 0, 2024-03-04T09:26:11.059 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_fsck_bytes": 0, 2024-03-04T09:26:11.059 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_fsck_items": 0, 2024-03-04T09:26:11.059 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_txc_bytes": 0, 2024-03-04T09:26:11.059 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_txc_items": 0, 2024-03-04T09:26:11.059 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-04T09:26:11.060 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_writing_deferred_items": 0, 2024-03-04T09:26:11.060 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_writing_bytes": 0, 2024-03-04T09:26:11.060 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_writing_items": 0, 2024-03-04T09:26:11.060 INFO:teuthology.orchestra.run.smithi190.stdout: "bluefs_bytes": 0, 2024-03-04T09:26:11.060 INFO:teuthology.orchestra.run.smithi190.stdout: "bluefs_items": 0, 2024-03-04T09:26:11.060 INFO:teuthology.orchestra.run.smithi190.stdout: "bluefs_file_reader_bytes": 0, 2024-03-04T09:26:11.060 INFO:teuthology.orchestra.run.smithi190.stdout: "bluefs_file_reader_items": 0, 2024-03-04T09:26:11.060 INFO:teuthology.orchestra.run.smithi190.stdout: "bluefs_file_writer_bytes": 0, 2024-03-04T09:26:11.060 INFO:teuthology.orchestra.run.smithi190.stdout: "bluefs_file_writer_items": 0, 2024-03-04T09:26:11.060 INFO:teuthology.orchestra.run.smithi190.stdout: "buffer_anon_bytes": 324758, 2024-03-04T09:26:11.060 INFO:teuthology.orchestra.run.smithi190.stdout: "buffer_anon_items": 125, 2024-03-04T09:26:11.060 INFO:teuthology.orchestra.run.smithi190.stdout: "buffer_meta_bytes": 0, 2024-03-04T09:26:11.060 INFO:teuthology.orchestra.run.smithi190.stdout: "buffer_meta_items": 0, 2024-03-04T09:26:11.061 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_bytes": 0, 2024-03-04T09:26:11.061 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_items": 0, 2024-03-04T09:26:11.061 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_mapbl_bytes": 0, 2024-03-04T09:26:11.061 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_mapbl_items": 0, 2024-03-04T09:26:11.061 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_pglog_bytes": 0, 2024-03-04T09:26:11.061 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_pglog_items": 0, 2024-03-04T09:26:11.061 INFO:teuthology.orchestra.run.smithi190.stdout: "osdmap_bytes": 9832, 2024-03-04T09:26:11.061 INFO:teuthology.orchestra.run.smithi190.stdout: "osdmap_items": 205, 2024-03-04T09:26:11.061 INFO:teuthology.orchestra.run.smithi190.stdout: "osdmap_mapping_bytes": 0, 2024-03-04T09:26:11.061 INFO:teuthology.orchestra.run.smithi190.stdout: "osdmap_mapping_items": 0, 2024-03-04T09:26:11.061 INFO:teuthology.orchestra.run.smithi190.stdout: "pgmap_bytes": 0, 2024-03-04T09:26:11.061 INFO:teuthology.orchestra.run.smithi190.stdout: "pgmap_items": 0, 2024-03-04T09:26:11.061 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_co_bytes": 232013, 2024-03-04T09:26:11.061 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_co_items": 1626, 2024-03-04T09:26:11.062 INFO:teuthology.orchestra.run.smithi190.stdout: "unittest_1_bytes": 0, 2024-03-04T09:26:11.062 INFO:teuthology.orchestra.run.smithi190.stdout: "unittest_1_items": 0, 2024-03-04T09:26:11.062 INFO:teuthology.orchestra.run.smithi190.stdout: "unittest_2_bytes": 0, 2024-03-04T09:26:11.062 INFO:teuthology.orchestra.run.smithi190.stdout: "unittest_2_items": 0 2024-03-04T09:26:11.062 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.062 INFO:teuthology.orchestra.run.smithi190.stdout: "objecter": { 2024-03-04T09:26:11.062 INFO:teuthology.orchestra.run.smithi190.stdout: "op_active": 0, 2024-03-04T09:26:11.062 INFO:teuthology.orchestra.run.smithi190.stdout: "op_laggy": 0, 2024-03-04T09:26:11.062 INFO:teuthology.orchestra.run.smithi190.stdout: "op_send": 744, 2024-03-04T09:26:11.062 INFO:teuthology.orchestra.run.smithi190.stdout: "op_send_bytes": 1631911, 2024-03-04T09:26:11.062 INFO:teuthology.orchestra.run.smithi190.stdout: "op_resend": 33, 2024-03-04T09:26:11.062 INFO:teuthology.orchestra.run.smithi190.stdout: "op_reply": 744, 2024-03-04T09:26:11.062 INFO:teuthology.orchestra.run.smithi190.stdout: "op_latency": { 2024-03-04T09:26:11.062 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 744, 2024-03-04T09:26:11.062 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 2.366932445, 2024-03-04T09:26:11.063 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.003181360 2024-03-04T09:26:11.063 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.063 INFO:teuthology.orchestra.run.smithi190.stdout: "op_inflight": 0, 2024-03-04T09:26:11.063 INFO:teuthology.orchestra.run.smithi190.stdout: "oplen_avg": { 2024-03-04T09:26:11.063 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 744, 2024-03-04T09:26:11.063 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 829 2024-03-04T09:26:11.063 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.063 INFO:teuthology.orchestra.run.smithi190.stdout: "op": 744, 2024-03-04T09:26:11.063 INFO:teuthology.orchestra.run.smithi190.stdout: "op_r": 30, 2024-03-04T09:26:11.063 INFO:teuthology.orchestra.run.smithi190.stdout: "op_w": 714, 2024-03-04T09:26:11.063 INFO:teuthology.orchestra.run.smithi190.stdout: "op_rmw": 0, 2024-03-04T09:26:11.063 INFO:teuthology.orchestra.run.smithi190.stdout: "op_pg": 0, 2024-03-04T09:26:11.063 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_stat": 0, 2024-03-04T09:26:11.063 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_create": 10, 2024-03-04T09:26:11.064 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_read": 30, 2024-03-04T09:26:11.064 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_write": 207, 2024-03-04T09:26:11.064 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_writefull": 33, 2024-03-04T09:26:11.064 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_writesame": 0, 2024-03-04T09:26:11.064 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_append": 0, 2024-03-04T09:26:11.064 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_zero": 0, 2024-03-04T09:26:11.064 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_truncate": 0, 2024-03-04T09:26:11.064 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_delete": 400, 2024-03-04T09:26:11.064 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_mapext": 0, 2024-03-04T09:26:11.064 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_sparse_read": 0, 2024-03-04T09:26:11.064 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_clonerange": 0, 2024-03-04T09:26:11.064 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_getxattr": 0, 2024-03-04T09:26:11.064 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_setxattr": 20, 2024-03-04T09:26:11.065 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_cmpxattr": 0, 2024-03-04T09:26:11.065 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_rmxattr": 0, 2024-03-04T09:26:11.065 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_resetxattrs": 0, 2024-03-04T09:26:11.065 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_call": 0, 2024-03-04T09:26:11.065 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_watch": 0, 2024-03-04T09:26:11.065 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_notify": 0, 2024-03-04T09:26:11.065 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_src_cmpxattr": 0, 2024-03-04T09:26:11.065 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_pgls": 0, 2024-03-04T09:26:11.065 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_pgls_filter": 0, 2024-03-04T09:26:11.065 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_other": 0, 2024-03-04T09:26:11.065 INFO:teuthology.orchestra.run.smithi190.stdout: "linger_active": 0, 2024-03-04T09:26:11.065 INFO:teuthology.orchestra.run.smithi190.stdout: "linger_send": 0, 2024-03-04T09:26:11.065 INFO:teuthology.orchestra.run.smithi190.stdout: "linger_resend": 0, 2024-03-04T09:26:11.065 INFO:teuthology.orchestra.run.smithi190.stdout: "linger_ping": 0, 2024-03-04T09:26:11.066 INFO:teuthology.orchestra.run.smithi190.stdout: "poolop_active": 0, 2024-03-04T09:26:11.066 INFO:teuthology.orchestra.run.smithi190.stdout: "poolop_send": 0, 2024-03-04T09:26:11.066 INFO:teuthology.orchestra.run.smithi190.stdout: "poolop_resend": 0, 2024-03-04T09:26:11.066 INFO:teuthology.orchestra.run.smithi190.stdout: "poolstat_active": 0, 2024-03-04T09:26:11.066 INFO:teuthology.orchestra.run.smithi190.stdout: "poolstat_send": 0, 2024-03-04T09:26:11.066 INFO:teuthology.orchestra.run.smithi190.stdout: "poolstat_resend": 0, 2024-03-04T09:26:11.066 INFO:teuthology.orchestra.run.smithi190.stdout: "statfs_active": 0, 2024-03-04T09:26:11.066 INFO:teuthology.orchestra.run.smithi190.stdout: "statfs_send": 0, 2024-03-04T09:26:11.066 INFO:teuthology.orchestra.run.smithi190.stdout: "statfs_resend": 0, 2024-03-04T09:26:11.066 INFO:teuthology.orchestra.run.smithi190.stdout: "command_active": 0, 2024-03-04T09:26:11.066 INFO:teuthology.orchestra.run.smithi190.stdout: "command_send": 0, 2024-03-04T09:26:11.066 INFO:teuthology.orchestra.run.smithi190.stdout: "command_resend": 0, 2024-03-04T09:26:11.066 INFO:teuthology.orchestra.run.smithi190.stdout: "map_epoch": 104, 2024-03-04T09:26:11.067 INFO:teuthology.orchestra.run.smithi190.stdout: "map_full": 0, 2024-03-04T09:26:11.067 INFO:teuthology.orchestra.run.smithi190.stdout: "map_inc": 14, 2024-03-04T09:26:11.067 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_sessions": 12, 2024-03-04T09:26:11.067 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_session_open": 12, 2024-03-04T09:26:11.067 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_session_close": 0, 2024-03-04T09:26:11.067 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_laggy": 0, 2024-03-04T09:26:11.067 INFO:teuthology.orchestra.run.smithi190.stdout: "omap_wr": 94, 2024-03-04T09:26:11.067 INFO:teuthology.orchestra.run.smithi190.stdout: "omap_rd": 0, 2024-03-04T09:26:11.067 INFO:teuthology.orchestra.run.smithi190.stdout: "omap_del": 35 2024-03-04T09:26:11.067 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.067 INFO:teuthology.orchestra.run.smithi190.stdout: "oft": { 2024-03-04T09:26:11.067 INFO:teuthology.orchestra.run.smithi190.stdout: "omap_total_objs": 1, 2024-03-04T09:26:11.067 INFO:teuthology.orchestra.run.smithi190.stdout: "omap_total_kv_pairs": 0, 2024-03-04T09:26:11.067 INFO:teuthology.orchestra.run.smithi190.stdout: "omap_total_updates": 0, 2024-03-04T09:26:11.068 INFO:teuthology.orchestra.run.smithi190.stdout: "omap_total_removes": 0 2024-03-04T09:26:11.068 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.068 INFO:teuthology.orchestra.run.smithi190.stdout: "osd-slow-ops": { 2024-03-04T09:26:11.068 INFO:teuthology.orchestra.run.smithi190.stdout: "slow_ops_count": 0 2024-03-04T09:26:11.068 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.068 INFO:teuthology.orchestra.run.smithi190.stdout: "purge_queue": { 2024-03-04T09:26:11.068 INFO:teuthology.orchestra.run.smithi190.stdout: "pq_executing_ops": 0, 2024-03-04T09:26:11.068 INFO:teuthology.orchestra.run.smithi190.stdout: "pq_executing_ops_high_water": 10, 2024-03-04T09:26:11.068 INFO:teuthology.orchestra.run.smithi190.stdout: "pq_executing": 0, 2024-03-04T09:26:11.068 INFO:teuthology.orchestra.run.smithi190.stdout: "pq_executing_high_water": 5, 2024-03-04T09:26:11.068 INFO:teuthology.orchestra.run.smithi190.stdout: "pq_executed_ops": 388, 2024-03-04T09:26:11.068 INFO:teuthology.orchestra.run.smithi190.stdout: "pq_executed": 194, 2024-03-04T09:26:11.068 INFO:teuthology.orchestra.run.smithi190.stdout: "pq_item_in_journal": 0 2024-03-04T09:26:11.069 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.069 INFO:teuthology.orchestra.run.smithi190.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-04T09:26:11.069 INFO:teuthology.orchestra.run.smithi190.stdout: "val": 0, 2024-03-04T09:26:11.069 INFO:teuthology.orchestra.run.smithi190.stdout: "max": 104857600, 2024-03-04T09:26:11.069 INFO:teuthology.orchestra.run.smithi190.stdout: "get_started": 0, 2024-03-04T09:26:11.069 INFO:teuthology.orchestra.run.smithi190.stdout: "get": 4571, 2024-03-04T09:26:11.069 INFO:teuthology.orchestra.run.smithi190.stdout: "get_sum": 2958838, 2024-03-04T09:26:11.069 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_fail": 0, 2024-03-04T09:26:11.069 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_success": 4571, 2024-03-04T09:26:11.069 INFO:teuthology.orchestra.run.smithi190.stdout: "take": 0, 2024-03-04T09:26:11.069 INFO:teuthology.orchestra.run.smithi190.stdout: "take_sum": 0, 2024-03-04T09:26:11.069 INFO:teuthology.orchestra.run.smithi190.stdout: "put": 4571, 2024-03-04T09:26:11.069 INFO:teuthology.orchestra.run.smithi190.stdout: "put_sum": 2958838, 2024-03-04T09:26:11.069 INFO:teuthology.orchestra.run.smithi190.stdout: "wait": { 2024-03-04T09:26:11.070 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:11.070 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:11.070 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:11.070 INFO:teuthology.orchestra.run.smithi190.stdout: } 2024-03-04T09:26:11.070 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.070 INFO:teuthology.orchestra.run.smithi190.stdout: "throttle-objecter_bytes": { 2024-03-04T09:26:11.070 INFO:teuthology.orchestra.run.smithi190.stdout: "val": 0, 2024-03-04T09:26:11.070 INFO:teuthology.orchestra.run.smithi190.stdout: "max": 104857600, 2024-03-04T09:26:11.070 INFO:teuthology.orchestra.run.smithi190.stdout: "get_started": 0, 2024-03-04T09:26:11.070 INFO:teuthology.orchestra.run.smithi190.stdout: "get": 0, 2024-03-04T09:26:11.070 INFO:teuthology.orchestra.run.smithi190.stdout: "get_sum": 0, 2024-03-04T09:26:11.070 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_fail": 0, 2024-03-04T09:26:11.070 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_success": 0, 2024-03-04T09:26:11.071 INFO:teuthology.orchestra.run.smithi190.stdout: "take": 744, 2024-03-04T09:26:11.071 INFO:teuthology.orchestra.run.smithi190.stdout: "take_sum": 1653665, 2024-03-04T09:26:11.071 INFO:teuthology.orchestra.run.smithi190.stdout: "put": 744, 2024-03-04T09:26:11.071 INFO:teuthology.orchestra.run.smithi190.stdout: "put_sum": 1653665, 2024-03-04T09:26:11.071 INFO:teuthology.orchestra.run.smithi190.stdout: "wait": { 2024-03-04T09:26:11.071 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:11.071 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:11.071 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:11.071 INFO:teuthology.orchestra.run.smithi190.stdout: } 2024-03-04T09:26:11.071 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.071 INFO:teuthology.orchestra.run.smithi190.stdout: "throttle-objecter_ops": { 2024-03-04T09:26:11.071 INFO:teuthology.orchestra.run.smithi190.stdout: "val": 0, 2024-03-04T09:26:11.071 INFO:teuthology.orchestra.run.smithi190.stdout: "max": 1024, 2024-03-04T09:26:11.072 INFO:teuthology.orchestra.run.smithi190.stdout: "get_started": 0, 2024-03-04T09:26:11.072 INFO:teuthology.orchestra.run.smithi190.stdout: "get": 0, 2024-03-04T09:26:11.072 INFO:teuthology.orchestra.run.smithi190.stdout: "get_sum": 0, 2024-03-04T09:26:11.072 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_fail": 0, 2024-03-04T09:26:11.072 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_success": 0, 2024-03-04T09:26:11.072 INFO:teuthology.orchestra.run.smithi190.stdout: "take": 744, 2024-03-04T09:26:11.072 INFO:teuthology.orchestra.run.smithi190.stdout: "take_sum": 744, 2024-03-04T09:26:11.072 INFO:teuthology.orchestra.run.smithi190.stdout: "put": 744, 2024-03-04T09:26:11.072 INFO:teuthology.orchestra.run.smithi190.stdout: "put_sum": 744, 2024-03-04T09:26:11.072 INFO:teuthology.orchestra.run.smithi190.stdout: "wait": { 2024-03-04T09:26:11.072 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:11.072 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:11.072 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:11.073 INFO:teuthology.orchestra.run.smithi190.stdout: } 2024-03-04T09:26:11.073 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.073 INFO:teuthology.orchestra.run.smithi190.stdout: "throttle-write_buf_throttle": { 2024-03-04T09:26:11.073 INFO:teuthology.orchestra.run.smithi190.stdout: "val": 0, 2024-03-04T09:26:11.073 INFO:teuthology.orchestra.run.smithi190.stdout: "max": 3758096384, 2024-03-04T09:26:11.073 INFO:teuthology.orchestra.run.smithi190.stdout: "get_started": 0, 2024-03-04T09:26:11.073 INFO:teuthology.orchestra.run.smithi190.stdout: "get": 194, 2024-03-04T09:26:11.073 INFO:teuthology.orchestra.run.smithi190.stdout: "get_sum": 21754, 2024-03-04T09:26:11.073 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_fail": 0, 2024-03-04T09:26:11.073 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_success": 194, 2024-03-04T09:26:11.073 INFO:teuthology.orchestra.run.smithi190.stdout: "take": 0, 2024-03-04T09:26:11.073 INFO:teuthology.orchestra.run.smithi190.stdout: "take_sum": 0, 2024-03-04T09:26:11.073 INFO:teuthology.orchestra.run.smithi190.stdout: "put": 30, 2024-03-04T09:26:11.074 INFO:teuthology.orchestra.run.smithi190.stdout: "put_sum": 21754, 2024-03-04T09:26:11.074 INFO:teuthology.orchestra.run.smithi190.stdout: "wait": { 2024-03-04T09:26:11.074 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:11.074 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:11.074 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:11.074 INFO:teuthology.orchestra.run.smithi190.stdout: } 2024-03-04T09:26:11.074 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:11.074 INFO:teuthology.orchestra.run.smithi190.stdout: "throttle-write_buf_throttle-0x5561ff1586e0": { 2024-03-04T09:26:11.074 INFO:teuthology.orchestra.run.smithi190.stdout: "val": 0, 2024-03-04T09:26:11.074 INFO:teuthology.orchestra.run.smithi190.stdout: "max": 3758096384, 2024-03-04T09:26:11.074 INFO:teuthology.orchestra.run.smithi190.stdout: "get_started": 0, 2024-03-04T09:26:11.074 INFO:teuthology.orchestra.run.smithi190.stdout: "get": 791, 2024-03-04T09:26:11.074 INFO:teuthology.orchestra.run.smithi190.stdout: "get_sum": 1574049, 2024-03-04T09:26:11.075 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_fail": 0, 2024-03-04T09:26:11.075 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_success": 791, 2024-03-04T09:26:11.075 INFO:teuthology.orchestra.run.smithi190.stdout: "take": 0, 2024-03-04T09:26:11.075 INFO:teuthology.orchestra.run.smithi190.stdout: "take_sum": 0, 2024-03-04T09:26:11.075 INFO:teuthology.orchestra.run.smithi190.stdout: "put": 177, 2024-03-04T09:26:11.075 INFO:teuthology.orchestra.run.smithi190.stdout: "put_sum": 1574049, 2024-03-04T09:26:11.075 INFO:teuthology.orchestra.run.smithi190.stdout: "wait": { 2024-03-04T09:26:11.075 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:11.075 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:11.075 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:11.075 INFO:teuthology.orchestra.run.smithi190.stdout: } 2024-03-04T09:26:11.075 INFO:teuthology.orchestra.run.smithi190.stdout: } 2024-03-04T09:26:11.075 INFO:teuthology.orchestra.run.smithi190.stdout:} 2024-03-04T09:26:11.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:11 smithi082 ceph-mon[32880]: pgmap v328: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-03-04T09:26:11.823 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:11 smithi190 ceph-mon[36341]: pgmap v328: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-03-04T09:26:11.864 INFO:tasks.check_counter:Daemon mds.c mds.exported=11 2024-03-04T09:26:11.864 INFO:tasks.check_counter:Daemon mds.c mds.imported=11 2024-03-04T09:26:11.865 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=0 2024-03-04T09:26:11.865 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-03-04T09:26:11.865 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-03-04T09:26:11.865 DEBUG:tasks.check_counter:Getting stats from f 2024-03-04T09:26:11.865 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph daemon mds.f perf dump 2024-03-04T09:26:11.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:11 smithi102 ceph-mon[36220]: pgmap v328: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-03-04T09:26:12.126 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.c/config 2024-03-04T09:26:12.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:12 smithi082 ceph-mon[32880]: osdmap e105: 12 total, 12 up, 12 in 2024-03-04T09:26:12.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:12 smithi190 ceph-mon[36341]: osdmap e105: 12 total, 12 up, 12 in 2024-03-04T09:26:12.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:12 smithi102 ceph-mon[36220]: osdmap e105: 12 total, 12 up, 12 in 2024-03-04T09:26:13.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:13 smithi082 ceph-mon[32880]: pgmap v330: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-03-04T09:26:13.866 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:13 smithi190 ceph-mon[36341]: pgmap v330: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-03-04T09:26:13.867 INFO:teuthology.orchestra.run.smithi190.stdout:{ 2024-03-04T09:26:13.867 INFO:teuthology.orchestra.run.smithi190.stdout: "AsyncMessenger::Worker-0": { 2024-03-04T09:26:13.867 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_messages": 3163, 2024-03-04T09:26:13.867 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_messages": 3301, 2024-03-04T09:26:13.867 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_bytes": 1579814, 2024-03-04T09:26:13.868 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_bytes": 5618959, 2024-03-04T09:26:13.868 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_created_connections": 10, 2024-03-04T09:26:13.868 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_active_connections": 5, 2024-03-04T09:26:13.868 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_total_time": 0.193686986, 2024-03-04T09:26:13.868 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_send_time": 0.072481065, 2024-03-04T09:26:13.869 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_recv_time": 0.100757674, 2024-03-04T09:26:13.869 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_fast_dispatch_time": 0.027728698, 2024-03-04T09:26:13.869 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_messages_queue_lat": { 2024-03-04T09:26:13.869 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 3299, 2024-03-04T09:26:13.869 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.116269288, 2024-03-04T09:26:13.869 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000035243 2024-03-04T09:26:13.870 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.870 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_handle_ack_lat": { 2024-03-04T09:26:13.870 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 4693, 2024-03-04T09:26:13.870 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000707491, 2024-03-04T09:26:13.870 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000150 2024-03-04T09:26:13.871 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.871 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_encrypted_bytes": 0, 2024-03-04T09:26:13.871 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_encrypted_bytes": 0 2024-03-04T09:26:13.871 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.871 INFO:teuthology.orchestra.run.smithi190.stdout: "AsyncMessenger::Worker-1": { 2024-03-04T09:26:13.871 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_messages": 4928, 2024-03-04T09:26:13.872 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_messages": 6741, 2024-03-04T09:26:13.872 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_bytes": 2207470, 2024-03-04T09:26:13.872 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_bytes": 3486031, 2024-03-04T09:26:13.872 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_created_connections": 16, 2024-03-04T09:26:13.873 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_active_connections": 9, 2024-03-04T09:26:13.873 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_total_time": 0.307712057, 2024-03-04T09:26:13.873 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_send_time": 0.125337437, 2024-03-04T09:26:13.873 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_recv_time": 0.173713763, 2024-03-04T09:26:13.873 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_fast_dispatch_time": 0.017357899, 2024-03-04T09:26:13.873 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_messages_queue_lat": { 2024-03-04T09:26:13.874 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 6738, 2024-03-04T09:26:13.874 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.223583432, 2024-03-04T09:26:13.874 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000033182 2024-03-04T09:26:13.874 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.874 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_handle_ack_lat": { 2024-03-04T09:26:13.875 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 9349, 2024-03-04T09:26:13.875 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.001421478, 2024-03-04T09:26:13.875 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000152 2024-03-04T09:26:13.875 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.875 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_encrypted_bytes": 1088, 2024-03-04T09:26:13.876 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_encrypted_bytes": 130848 2024-03-04T09:26:13.876 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.876 INFO:teuthology.orchestra.run.smithi190.stdout: "AsyncMessenger::Worker-2": { 2024-03-04T09:26:13.876 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_messages": 1111, 2024-03-04T09:26:13.876 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_messages": 1199, 2024-03-04T09:26:13.876 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_bytes": 1877821, 2024-03-04T09:26:13.876 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_bytes": 3355073, 2024-03-04T09:26:13.877 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_created_connections": 7, 2024-03-04T09:26:13.877 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_active_connections": 6, 2024-03-04T09:26:13.877 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_total_time": 0.138159834, 2024-03-04T09:26:13.877 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_send_time": 0.059761587, 2024-03-04T09:26:13.877 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_recv_time": 0.056245111, 2024-03-04T09:26:13.877 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_fast_dispatch_time": 0.030117837, 2024-03-04T09:26:13.878 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_messages_queue_lat": { 2024-03-04T09:26:13.878 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 1199, 2024-03-04T09:26:13.878 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.099319887, 2024-03-04T09:26:13.878 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000082835 2024-03-04T09:26:13.878 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.878 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_handle_ack_lat": { 2024-03-04T09:26:13.879 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:13.879 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:13.879 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:13.879 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.879 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_encrypted_bytes": 1673184, 2024-03-04T09:26:13.879 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_encrypted_bytes": 452720 2024-03-04T09:26:13.879 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.880 INFO:teuthology.orchestra.run.smithi190.stdout: "cct": { 2024-03-04T09:26:13.880 INFO:teuthology.orchestra.run.smithi190.stdout: "total_workers": 1, 2024-03-04T09:26:13.880 INFO:teuthology.orchestra.run.smithi190.stdout: "unhealthy_workers": 0 2024-03-04T09:26:13.880 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.880 INFO:teuthology.orchestra.run.smithi190.stdout: "finisher-MDSRank": { 2024-03-04T09:26:13.880 INFO:teuthology.orchestra.run.smithi190.stdout: "queue_len": 0, 2024-03-04T09:26:13.880 INFO:teuthology.orchestra.run.smithi190.stdout: "complete_latency": { 2024-03-04T09:26:13.881 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 991, 2024-03-04T09:26:13.881 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 1.363986377, 2024-03-04T09:26:13.881 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.001376373 2024-03-04T09:26:13.881 INFO:teuthology.orchestra.run.smithi190.stdout: } 2024-03-04T09:26:13.881 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.881 INFO:teuthology.orchestra.run.smithi190.stdout: "finisher-PurgeQueue": { 2024-03-04T09:26:13.882 INFO:teuthology.orchestra.run.smithi190.stdout: "queue_len": 0, 2024-03-04T09:26:13.882 INFO:teuthology.orchestra.run.smithi190.stdout: "complete_latency": { 2024-03-04T09:26:13.882 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 1579, 2024-03-04T09:26:13.882 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.255569187, 2024-03-04T09:26:13.882 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000161855 2024-03-04T09:26:13.882 INFO:teuthology.orchestra.run.smithi190.stdout: } 2024-03-04T09:26:13.883 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.883 INFO:teuthology.orchestra.run.smithi190.stdout: "mds": { 2024-03-04T09:26:13.883 INFO:teuthology.orchestra.run.smithi190.stdout: "request": 1472, 2024-03-04T09:26:13.883 INFO:teuthology.orchestra.run.smithi190.stdout: "reply": 1444, 2024-03-04T09:26:13.883 INFO:teuthology.orchestra.run.smithi190.stdout: "reply_latency": { 2024-03-04T09:26:13.883 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 1444, 2024-03-04T09:26:13.884 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 2.932931222, 2024-03-04T09:26:13.884 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.002031115 2024-03-04T09:26:13.884 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.884 INFO:teuthology.orchestra.run.smithi190.stdout: "slow_reply": 0, 2024-03-04T09:26:13.884 INFO:teuthology.orchestra.run.smithi190.stdout: "forward": 28, 2024-03-04T09:26:13.884 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_fetch_complete": 0, 2024-03-04T09:26:13.884 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_fetch_keys": 0, 2024-03-04T09:26:13.885 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_commit": 20, 2024-03-04T09:26:13.885 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_split": 1, 2024-03-04T09:26:13.885 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_merge": 0, 2024-03-04T09:26:13.885 INFO:teuthology.orchestra.run.smithi190.stdout: "inodes": 42, 2024-03-04T09:26:13.885 INFO:teuthology.orchestra.run.smithi190.stdout: "inodes_top": 2, 2024-03-04T09:26:13.885 INFO:teuthology.orchestra.run.smithi190.stdout: "inodes_bottom": 2, 2024-03-04T09:26:13.885 INFO:teuthology.orchestra.run.smithi190.stdout: "inodes_pin_tail": 38, 2024-03-04T09:26:13.885 INFO:teuthology.orchestra.run.smithi190.stdout: "inodes_pinned": 38, 2024-03-04T09:26:13.886 INFO:teuthology.orchestra.run.smithi190.stdout: "inodes_expired": 434, 2024-03-04T09:26:13.886 INFO:teuthology.orchestra.run.smithi190.stdout: "inodes_with_caps": 0, 2024-03-04T09:26:13.886 INFO:teuthology.orchestra.run.smithi190.stdout: "caps": 0, 2024-03-04T09:26:13.886 INFO:teuthology.orchestra.run.smithi190.stdout: "subtrees": 4, 2024-03-04T09:26:13.886 INFO:teuthology.orchestra.run.smithi190.stdout: "traverse": 2805, 2024-03-04T09:26:13.886 INFO:teuthology.orchestra.run.smithi190.stdout: "traverse_hit": 1879, 2024-03-04T09:26:13.886 INFO:teuthology.orchestra.run.smithi190.stdout: "traverse_forward": 24, 2024-03-04T09:26:13.887 INFO:teuthology.orchestra.run.smithi190.stdout: "traverse_discover": 31, 2024-03-04T09:26:13.887 INFO:teuthology.orchestra.run.smithi190.stdout: "traverse_dir_fetch": 0, 2024-03-04T09:26:13.887 INFO:teuthology.orchestra.run.smithi190.stdout: "traverse_remote_ino": 0, 2024-03-04T09:26:13.887 INFO:teuthology.orchestra.run.smithi190.stdout: "traverse_lock": 0, 2024-03-04T09:26:13.887 INFO:teuthology.orchestra.run.smithi190.stdout: "load_cent": 0, 2024-03-04T09:26:13.887 INFO:teuthology.orchestra.run.smithi190.stdout: "q": 0, 2024-03-04T09:26:13.888 INFO:teuthology.orchestra.run.smithi190.stdout: "exported": 31, 2024-03-04T09:26:13.888 INFO:teuthology.orchestra.run.smithi190.stdout: "exported_inodes": 367, 2024-03-04T09:26:13.888 INFO:teuthology.orchestra.run.smithi190.stdout: "imported": 25, 2024-03-04T09:26:13.888 INFO:teuthology.orchestra.run.smithi190.stdout: "imported_inodes": 665, 2024-03-04T09:26:13.888 INFO:teuthology.orchestra.run.smithi190.stdout: "openino_dir_fetch": 0, 2024-03-04T09:26:13.888 INFO:teuthology.orchestra.run.smithi190.stdout: "openino_backtrace_fetch": 0, 2024-03-04T09:26:13.889 INFO:teuthology.orchestra.run.smithi190.stdout: "openino_peer_discover": 0, 2024-03-04T09:26:13.889 INFO:teuthology.orchestra.run.smithi190.stdout: "root_rfiles": 4, 2024-03-04T09:26:13.889 INFO:teuthology.orchestra.run.smithi190.stdout: "root_rbytes": 234, 2024-03-04T09:26:13.889 INFO:teuthology.orchestra.run.smithi190.stdout: "root_rsnaps": 0, 2024-03-04T09:26:13.889 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_backtrace_fetch": 0, 2024-03-04T09:26:13.889 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_set_tag": 0, 2024-03-04T09:26:13.890 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_backtrace_repaired": 0, 2024-03-04T09:26:13.890 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_inotable_repaired": 0, 2024-03-04T09:26:13.890 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_dir_inodes": 0, 2024-03-04T09:26:13.890 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_dir_base_inodes": 0, 2024-03-04T09:26:13.890 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_dirfrag_rstats": 0, 2024-03-04T09:26:13.890 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_file_inodes": 0, 2024-03-04T09:26:13.890 INFO:teuthology.orchestra.run.smithi190.stdout: "handle_inode_file_caps": 0, 2024-03-04T09:26:13.890 INFO:teuthology.orchestra.run.smithi190.stdout: "ceph_cap_op_revoke": 85, 2024-03-04T09:26:13.890 INFO:teuthology.orchestra.run.smithi190.stdout: "ceph_cap_op_grant": 1009, 2024-03-04T09:26:13.890 INFO:teuthology.orchestra.run.smithi190.stdout: "ceph_cap_op_trunc": 0, 2024-03-04T09:26:13.891 INFO:teuthology.orchestra.run.smithi190.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-03-04T09:26:13.891 INFO:teuthology.orchestra.run.smithi190.stdout: "ceph_cap_op_flush_ack": 0, 2024-03-04T09:26:13.891 INFO:teuthology.orchestra.run.smithi190.stdout: "handle_client_caps": 1194, 2024-03-04T09:26:13.891 INFO:teuthology.orchestra.run.smithi190.stdout: "handle_client_caps_dirty": 808, 2024-03-04T09:26:13.891 INFO:teuthology.orchestra.run.smithi190.stdout: "handle_client_cap_release": 29, 2024-03-04T09:26:13.891 INFO:teuthology.orchestra.run.smithi190.stdout: "process_request_cap_release": 1769 2024-03-04T09:26:13.891 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.892 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_cache": { 2024-03-04T09:26:13.892 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_update": 0, 2024-03-04T09:26:13.892 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_update_receipt": 0, 2024-03-04T09:26:13.892 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_try_discover": 0, 2024-03-04T09:26:13.892 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_send_discover": 34, 2024-03-04T09:26:13.892 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_handle_discover": 2, 2024-03-04T09:26:13.892 INFO:teuthology.orchestra.run.smithi190.stdout: "num_strays": 3, 2024-03-04T09:26:13.893 INFO:teuthology.orchestra.run.smithi190.stdout: "num_strays_delayed": 0, 2024-03-04T09:26:13.893 INFO:teuthology.orchestra.run.smithi190.stdout: "num_strays_enqueuing": 0, 2024-03-04T09:26:13.893 INFO:teuthology.orchestra.run.smithi190.stdout: "strays_created": 810, 2024-03-04T09:26:13.893 INFO:teuthology.orchestra.run.smithi190.stdout: "strays_enqueued": 807, 2024-03-04T09:26:13.893 INFO:teuthology.orchestra.run.smithi190.stdout: "strays_reintegrated": 0, 2024-03-04T09:26:13.893 INFO:teuthology.orchestra.run.smithi190.stdout: "strays_migrated": 0, 2024-03-04T09:26:13.893 INFO:teuthology.orchestra.run.smithi190.stdout: "num_recovering_processing": 0, 2024-03-04T09:26:13.893 INFO:teuthology.orchestra.run.smithi190.stdout: "num_recovering_enqueued": 0, 2024-03-04T09:26:13.894 INFO:teuthology.orchestra.run.smithi190.stdout: "num_recovering_prioritized": 0, 2024-03-04T09:26:13.894 INFO:teuthology.orchestra.run.smithi190.stdout: "recovery_started": 0, 2024-03-04T09:26:13.894 INFO:teuthology.orchestra.run.smithi190.stdout: "recovery_completed": 0, 2024-03-04T09:26:13.894 INFO:teuthology.orchestra.run.smithi190.stdout: "ireq_enqueue_scrub": 0, 2024-03-04T09:26:13.894 INFO:teuthology.orchestra.run.smithi190.stdout: "ireq_exportdir": 31, 2024-03-04T09:26:13.894 INFO:teuthology.orchestra.run.smithi190.stdout: "ireq_flush": 0, 2024-03-04T09:26:13.894 INFO:teuthology.orchestra.run.smithi190.stdout: "ireq_fragmentdir": 1, 2024-03-04T09:26:13.894 INFO:teuthology.orchestra.run.smithi190.stdout: "ireq_fragstats": 0, 2024-03-04T09:26:13.895 INFO:teuthology.orchestra.run.smithi190.stdout: "ireq_inodestats": 0 2024-03-04T09:26:13.895 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.895 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_log": { 2024-03-04T09:26:13.895 INFO:teuthology.orchestra.run.smithi190.stdout: "evlrg": 0, 2024-03-04T09:26:13.895 INFO:teuthology.orchestra.run.smithi190.stdout: "evadd": 4756, 2024-03-04T09:26:13.895 INFO:teuthology.orchestra.run.smithi190.stdout: "evex": 0, 2024-03-04T09:26:13.895 INFO:teuthology.orchestra.run.smithi190.stdout: "evtrm": 0, 2024-03-04T09:26:13.896 INFO:teuthology.orchestra.run.smithi190.stdout: "ev": 4756, 2024-03-04T09:26:13.896 INFO:teuthology.orchestra.run.smithi190.stdout: "evexg": 0, 2024-03-04T09:26:13.896 INFO:teuthology.orchestra.run.smithi190.stdout: "evexd": 0, 2024-03-04T09:26:13.896 INFO:teuthology.orchestra.run.smithi190.stdout: "segadd": 7, 2024-03-04T09:26:13.896 INFO:teuthology.orchestra.run.smithi190.stdout: "segex": 0, 2024-03-04T09:26:13.896 INFO:teuthology.orchestra.run.smithi190.stdout: "segtrm": 0, 2024-03-04T09:26:13.896 INFO:teuthology.orchestra.run.smithi190.stdout: "seg": 7, 2024-03-04T09:26:13.897 INFO:teuthology.orchestra.run.smithi190.stdout: "segmjr": 2, 2024-03-04T09:26:13.897 INFO:teuthology.orchestra.run.smithi190.stdout: "segexg": 0, 2024-03-04T09:26:13.897 INFO:teuthology.orchestra.run.smithi190.stdout: "segexd": 0, 2024-03-04T09:26:13.897 INFO:teuthology.orchestra.run.smithi190.stdout: "expos": 4194304, 2024-03-04T09:26:13.897 INFO:teuthology.orchestra.run.smithi190.stdout: "wrpos": 10933881, 2024-03-04T09:26:13.897 INFO:teuthology.orchestra.run.smithi190.stdout: "rdpos": 0, 2024-03-04T09:26:13.897 INFO:teuthology.orchestra.run.smithi190.stdout: "jlat": { 2024-03-04T09:26:13.897 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 441, 2024-03-04T09:26:13.898 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 1.003012306, 2024-03-04T09:26:13.898 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.002274404 2024-03-04T09:26:13.898 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.898 INFO:teuthology.orchestra.run.smithi190.stdout: "replayed": 0 2024-03-04T09:26:13.898 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.898 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_mem": { 2024-03-04T09:26:13.898 INFO:teuthology.orchestra.run.smithi190.stdout: "ino": 36, 2024-03-04T09:26:13.899 INFO:teuthology.orchestra.run.smithi190.stdout: "ino+": 1021, 2024-03-04T09:26:13.899 INFO:teuthology.orchestra.run.smithi190.stdout: "ino-": 985, 2024-03-04T09:26:13.899 INFO:teuthology.orchestra.run.smithi190.stdout: "dir": 24, 2024-03-04T09:26:13.899 INFO:teuthology.orchestra.run.smithi190.stdout: "dir+": 118, 2024-03-04T09:26:13.899 INFO:teuthology.orchestra.run.smithi190.stdout: "dir-": 94, 2024-03-04T09:26:13.899 INFO:teuthology.orchestra.run.smithi190.stdout: "dn": 42, 2024-03-04T09:26:13.899 INFO:teuthology.orchestra.run.smithi190.stdout: "dn+": 1710, 2024-03-04T09:26:13.899 INFO:teuthology.orchestra.run.smithi190.stdout: "dn-": 1668, 2024-03-04T09:26:13.900 INFO:teuthology.orchestra.run.smithi190.stdout: "cap": 0, 2024-03-04T09:26:13.900 INFO:teuthology.orchestra.run.smithi190.stdout: "cap+": 834, 2024-03-04T09:26:13.900 INFO:teuthology.orchestra.run.smithi190.stdout: "cap-": 834, 2024-03-04T09:26:13.900 INFO:teuthology.orchestra.run.smithi190.stdout: "rss": 62080, 2024-03-04T09:26:13.900 INFO:teuthology.orchestra.run.smithi190.stdout: "heap": 223612 2024-03-04T09:26:13.900 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.900 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_server": { 2024-03-04T09:26:13.901 INFO:teuthology.orchestra.run.smithi190.stdout: "dispatch_client_request": 2444, 2024-03-04T09:26:13.901 INFO:teuthology.orchestra.run.smithi190.stdout: "dispatch_server_request": 24, 2024-03-04T09:26:13.901 INFO:teuthology.orchestra.run.smithi190.stdout: "handle_client_request": 1472, 2024-03-04T09:26:13.901 INFO:teuthology.orchestra.run.smithi190.stdout: "handle_client_session": 14, 2024-03-04T09:26:13.901 INFO:teuthology.orchestra.run.smithi190.stdout: "handle_peer_request": 370, 2024-03-04T09:26:13.901 INFO:teuthology.orchestra.run.smithi190.stdout: "req_create_latency": { 2024-03-04T09:26:13.901 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 147, 2024-03-04T09:26:13.902 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.539289318, 2024-03-04T09:26:13.902 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.003668634 2024-03-04T09:26:13.902 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.902 INFO:teuthology.orchestra.run.smithi190.stdout: "req_getattr_latency": { 2024-03-04T09:26:13.903 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:13.903 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:13.903 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:13.903 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.903 INFO:teuthology.orchestra.run.smithi190.stdout: "req_getfilelock_latency": { 2024-03-04T09:26:13.903 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:13.903 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:13.904 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:13.904 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.904 INFO:teuthology.orchestra.run.smithi190.stdout: "req_link_latency": { 2024-03-04T09:26:13.904 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:13.904 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:13.904 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:13.904 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.904 INFO:teuthology.orchestra.run.smithi190.stdout: "req_lookup_latency": { 2024-03-04T09:26:13.905 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 413, 2024-03-04T09:26:13.905 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.363566690, 2024-03-04T09:26:13.905 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000880306 2024-03-04T09:26:13.905 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.905 INFO:teuthology.orchestra.run.smithi190.stdout: "req_lookuphash_latency": { 2024-03-04T09:26:13.905 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:13.905 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:13.906 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:13.906 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.906 INFO:teuthology.orchestra.run.smithi190.stdout: "req_lookupino_latency": { 2024-03-04T09:26:13.906 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:13.906 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:13.906 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:13.906 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.906 INFO:teuthology.orchestra.run.smithi190.stdout: "req_lookupname_latency": { 2024-03-04T09:26:13.907 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:13.907 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:13.907 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:13.907 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.907 INFO:teuthology.orchestra.run.smithi190.stdout: "req_lookupparent_latency": { 2024-03-04T09:26:13.907 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:13.907 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:13.908 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:13.908 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.908 INFO:teuthology.orchestra.run.smithi190.stdout: "req_lookupsnap_latency": { 2024-03-04T09:26:13.908 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:13.908 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:13.908 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:13.908 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.909 INFO:teuthology.orchestra.run.smithi190.stdout: "req_lssnap_latency": { 2024-03-04T09:26:13.909 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:13.909 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:13.909 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:13.909 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.909 INFO:teuthology.orchestra.run.smithi190.stdout: "req_mkdir_latency": { 2024-03-04T09:26:13.910 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:13.910 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:13.911 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:13.911 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.911 INFO:teuthology.orchestra.run.smithi190.stdout: "req_mknod_latency": { 2024-03-04T09:26:13.911 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:13.911 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:13.911 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:13.912 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.912 INFO:teuthology.orchestra.run.smithi190.stdout: "req_mksnap_latency": { 2024-03-04T09:26:13.912 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:13.912 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:13.912 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:13.912 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.912 INFO:teuthology.orchestra.run.smithi190.stdout: "req_open_latency": { 2024-03-04T09:26:13.913 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:13.913 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:13.913 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:13.913 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.913 INFO:teuthology.orchestra.run.smithi190.stdout: "req_readdir_latency": { 2024-03-04T09:26:13.913 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 74, 2024-03-04T09:26:13.913 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.133816293, 2024-03-04T09:26:13.913 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.001808328 2024-03-04T09:26:13.914 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.914 INFO:teuthology.orchestra.run.smithi190.stdout: "req_rename_latency": { 2024-03-04T09:26:13.914 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:13.914 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:13.914 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:13.914 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.914 INFO:teuthology.orchestra.run.smithi190.stdout: "req_renamesnap_latency": { 2024-03-04T09:26:13.915 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:13.915 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:13.915 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:13.915 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.915 INFO:teuthology.orchestra.run.smithi190.stdout: "req_snapdiff_latency": { 2024-03-04T09:26:13.915 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:13.915 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:13.916 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:13.916 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.916 INFO:teuthology.orchestra.run.smithi190.stdout: "req_rmdir_latency": { 2024-03-04T09:26:13.916 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 16, 2024-03-04T09:26:13.916 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.395859918, 2024-03-04T09:26:13.916 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.024741244 2024-03-04T09:26:13.916 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.917 INFO:teuthology.orchestra.run.smithi190.stdout: "req_rmsnap_latency": { 2024-03-04T09:26:13.917 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:13.917 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:13.917 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:13.917 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.917 INFO:teuthology.orchestra.run.smithi190.stdout: "req_rmxattr_latency": { 2024-03-04T09:26:13.917 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:13.918 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:13.918 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:13.918 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.918 INFO:teuthology.orchestra.run.smithi190.stdout: "req_setattr_latency": { 2024-03-04T09:26:13.918 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:13.918 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:13.918 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:13.918 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.919 INFO:teuthology.orchestra.run.smithi190.stdout: "req_setdirlayout_latency": { 2024-03-04T09:26:13.919 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:13.919 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:13.919 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:13.919 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.919 INFO:teuthology.orchestra.run.smithi190.stdout: "req_setfilelock_latency": { 2024-03-04T09:26:13.919 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:13.920 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:13.920 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:13.920 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.920 INFO:teuthology.orchestra.run.smithi190.stdout: "req_setlayout_latency": { 2024-03-04T09:26:13.920 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:13.920 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:13.920 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:13.920 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.921 INFO:teuthology.orchestra.run.smithi190.stdout: "req_setxattr_latency": { 2024-03-04T09:26:13.921 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:13.921 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:13.921 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:13.921 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.921 INFO:teuthology.orchestra.run.smithi190.stdout: "req_symlink_latency": { 2024-03-04T09:26:13.921 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:13.921 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:13.922 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:13.922 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.922 INFO:teuthology.orchestra.run.smithi190.stdout: "req_unlink_latency": { 2024-03-04T09:26:13.922 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 794, 2024-03-04T09:26:13.922 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 1.500399003, 2024-03-04T09:26:13.922 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.001889671 2024-03-04T09:26:13.922 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.922 INFO:teuthology.orchestra.run.smithi190.stdout: "cap_revoke_eviction": 0, 2024-03-04T09:26:13.923 INFO:teuthology.orchestra.run.smithi190.stdout: "cap_acquisition_throttle": 0, 2024-03-04T09:26:13.923 INFO:teuthology.orchestra.run.smithi190.stdout: "req_getvxattr_latency": { 2024-03-04T09:26:13.923 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:13.923 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:13.923 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:13.923 INFO:teuthology.orchestra.run.smithi190.stdout: } 2024-03-04T09:26:13.923 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.923 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_sessions": { 2024-03-04T09:26:13.924 INFO:teuthology.orchestra.run.smithi190.stdout: "session_count": 1, 2024-03-04T09:26:13.924 INFO:teuthology.orchestra.run.smithi190.stdout: "session_add": 2, 2024-03-04T09:26:13.924 INFO:teuthology.orchestra.run.smithi190.stdout: "session_remove": 1, 2024-03-04T09:26:13.924 INFO:teuthology.orchestra.run.smithi190.stdout: "sessions_open": 1, 2024-03-04T09:26:13.924 INFO:teuthology.orchestra.run.smithi190.stdout: "sessions_stale": 0, 2024-03-04T09:26:13.924 INFO:teuthology.orchestra.run.smithi190.stdout: "total_load": 1095, 2024-03-04T09:26:13.924 INFO:teuthology.orchestra.run.smithi190.stdout: "average_load": 1095, 2024-03-04T09:26:13.925 INFO:teuthology.orchestra.run.smithi190.stdout: "avg_session_uptime": 643, 2024-03-04T09:26:13.925 INFO:teuthology.orchestra.run.smithi190.stdout: "mdthresh_evicted": 0 2024-03-04T09:26:13.925 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.925 INFO:teuthology.orchestra.run.smithi190.stdout: "mempool": { 2024-03-04T09:26:13.925 INFO:teuthology.orchestra.run.smithi190.stdout: "bloom_filter_bytes": 0, 2024-03-04T09:26:13.925 INFO:teuthology.orchestra.run.smithi190.stdout: "bloom_filter_items": 0, 2024-03-04T09:26:13.925 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_alloc_bytes": 0, 2024-03-04T09:26:13.925 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_alloc_items": 0, 2024-03-04T09:26:13.926 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_data_bytes": 0, 2024-03-04T09:26:13.926 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_data_items": 0, 2024-03-04T09:26:13.926 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-04T09:26:13.926 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_onode_items": 0, 2024-03-04T09:26:13.926 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-04T09:26:13.926 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_meta_items": 0, 2024-03-04T09:26:13.926 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_other_bytes": 0, 2024-03-04T09:26:13.926 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_other_items": 0, 2024-03-04T09:26:13.927 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-04T09:26:13.927 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_buffer_items": 0, 2024-03-04T09:26:13.927 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_extent_bytes": 0, 2024-03-04T09:26:13.927 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_extent_items": 0, 2024-03-04T09:26:13.927 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_blob_bytes": 0, 2024-03-04T09:26:13.927 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_blob_items": 0, 2024-03-04T09:26:13.927 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-04T09:26:13.927 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_shared_blob_items": 0, 2024-03-04T09:26:13.928 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-04T09:26:13.928 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_inline_bl_items": 0, 2024-03-04T09:26:13.928 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_fsck_bytes": 0, 2024-03-04T09:26:13.928 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_fsck_items": 0, 2024-03-04T09:26:13.928 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_txc_bytes": 0, 2024-03-04T09:26:13.928 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_txc_items": 0, 2024-03-04T09:26:13.928 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-04T09:26:13.928 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_writing_deferred_items": 0, 2024-03-04T09:26:13.929 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_writing_bytes": 0, 2024-03-04T09:26:13.929 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_writing_items": 0, 2024-03-04T09:26:13.929 INFO:teuthology.orchestra.run.smithi190.stdout: "bluefs_bytes": 0, 2024-03-04T09:26:13.929 INFO:teuthology.orchestra.run.smithi190.stdout: "bluefs_items": 0, 2024-03-04T09:26:13.929 INFO:teuthology.orchestra.run.smithi190.stdout: "bluefs_file_reader_bytes": 0, 2024-03-04T09:26:13.929 INFO:teuthology.orchestra.run.smithi190.stdout: "bluefs_file_reader_items": 0, 2024-03-04T09:26:13.929 INFO:teuthology.orchestra.run.smithi190.stdout: "bluefs_file_writer_bytes": 0, 2024-03-04T09:26:13.930 INFO:teuthology.orchestra.run.smithi190.stdout: "bluefs_file_writer_items": 0, 2024-03-04T09:26:13.930 INFO:teuthology.orchestra.run.smithi190.stdout: "buffer_anon_bytes": 323735, 2024-03-04T09:26:13.930 INFO:teuthology.orchestra.run.smithi190.stdout: "buffer_anon_items": 129, 2024-03-04T09:26:13.930 INFO:teuthology.orchestra.run.smithi190.stdout: "buffer_meta_bytes": 0, 2024-03-04T09:26:13.930 INFO:teuthology.orchestra.run.smithi190.stdout: "buffer_meta_items": 0, 2024-03-04T09:26:13.930 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_bytes": 0, 2024-03-04T09:26:13.930 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_items": 0, 2024-03-04T09:26:13.930 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_mapbl_bytes": 0, 2024-03-04T09:26:13.931 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_mapbl_items": 0, 2024-03-04T09:26:13.931 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_pglog_bytes": 0, 2024-03-04T09:26:13.931 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_pglog_items": 0, 2024-03-04T09:26:13.931 INFO:teuthology.orchestra.run.smithi190.stdout: "osdmap_bytes": 10072, 2024-03-04T09:26:13.931 INFO:teuthology.orchestra.run.smithi190.stdout: "osdmap_items": 211, 2024-03-04T09:26:13.931 INFO:teuthology.orchestra.run.smithi190.stdout: "osdmap_mapping_bytes": 0, 2024-03-04T09:26:13.931 INFO:teuthology.orchestra.run.smithi190.stdout: "osdmap_mapping_items": 0, 2024-03-04T09:26:13.931 INFO:teuthology.orchestra.run.smithi190.stdout: "pgmap_bytes": 0, 2024-03-04T09:26:13.931 INFO:teuthology.orchestra.run.smithi190.stdout: "pgmap_items": 0, 2024-03-04T09:26:13.932 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_co_bytes": 165944, 2024-03-04T09:26:13.932 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_co_items": 1178, 2024-03-04T09:26:13.932 INFO:teuthology.orchestra.run.smithi190.stdout: "unittest_1_bytes": 0, 2024-03-04T09:26:13.932 INFO:teuthology.orchestra.run.smithi190.stdout: "unittest_1_items": 0, 2024-03-04T09:26:13.932 INFO:teuthology.orchestra.run.smithi190.stdout: "unittest_2_bytes": 0, 2024-03-04T09:26:13.932 INFO:teuthology.orchestra.run.smithi190.stdout: "unittest_2_items": 0 2024-03-04T09:26:13.932 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.933 INFO:teuthology.orchestra.run.smithi190.stdout: "objecter": { 2024-03-04T09:26:13.933 INFO:teuthology.orchestra.run.smithi190.stdout: "op_active": 0, 2024-03-04T09:26:13.933 INFO:teuthology.orchestra.run.smithi190.stdout: "op_laggy": 0, 2024-03-04T09:26:13.933 INFO:teuthology.orchestra.run.smithi190.stdout: "op_send": 2298, 2024-03-04T09:26:13.933 INFO:teuthology.orchestra.run.smithi190.stdout: "op_send_bytes": 7042566, 2024-03-04T09:26:13.933 INFO:teuthology.orchestra.run.smithi190.stdout: "op_resend": 33, 2024-03-04T09:26:13.933 INFO:teuthology.orchestra.run.smithi190.stdout: "op_reply": 2298, 2024-03-04T09:26:13.933 INFO:teuthology.orchestra.run.smithi190.stdout: "op_latency": { 2024-03-04T09:26:13.934 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 2298, 2024-03-04T09:26:13.934 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 7.519785506, 2024-03-04T09:26:13.934 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.003272317 2024-03-04T09:26:13.934 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.934 INFO:teuthology.orchestra.run.smithi190.stdout: "op_inflight": 0, 2024-03-04T09:26:13.934 INFO:teuthology.orchestra.run.smithi190.stdout: "oplen_avg": { 2024-03-04T09:26:13.934 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 2298, 2024-03-04T09:26:13.934 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 2408 2024-03-04T09:26:13.935 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.935 INFO:teuthology.orchestra.run.smithi190.stdout: "op": 2298, 2024-03-04T09:26:13.935 INFO:teuthology.orchestra.run.smithi190.stdout: "op_r": 51, 2024-03-04T09:26:13.935 INFO:teuthology.orchestra.run.smithi190.stdout: "op_w": 2247, 2024-03-04T09:26:13.935 INFO:teuthology.orchestra.run.smithi190.stdout: "op_rmw": 0, 2024-03-04T09:26:13.935 INFO:teuthology.orchestra.run.smithi190.stdout: "op_pg": 0, 2024-03-04T09:26:13.935 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_stat": 0, 2024-03-04T09:26:13.935 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_create": 10, 2024-03-04T09:26:13.936 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_read": 51, 2024-03-04T09:26:13.936 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_write": 492, 2024-03-04T09:26:13.936 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_writefull": 41, 2024-03-04T09:26:13.936 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_writesame": 0, 2024-03-04T09:26:13.936 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_append": 0, 2024-03-04T09:26:13.936 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_zero": 0, 2024-03-04T09:26:13.936 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_truncate": 1, 2024-03-04T09:26:13.936 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_delete": 1622, 2024-03-04T09:26:13.937 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_mapext": 0, 2024-03-04T09:26:13.937 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_sparse_read": 0, 2024-03-04T09:26:13.937 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_clonerange": 0, 2024-03-04T09:26:13.937 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_getxattr": 0, 2024-03-04T09:26:13.937 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_setxattr": 20, 2024-03-04T09:26:13.937 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_cmpxattr": 0, 2024-03-04T09:26:13.937 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_rmxattr": 0, 2024-03-04T09:26:13.938 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_resetxattrs": 0, 2024-03-04T09:26:13.938 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_call": 0, 2024-03-04T09:26:13.938 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_watch": 0, 2024-03-04T09:26:13.938 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_notify": 0, 2024-03-04T09:26:13.938 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_src_cmpxattr": 0, 2024-03-04T09:26:13.938 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_pgls": 0, 2024-03-04T09:26:13.938 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_pgls_filter": 0, 2024-03-04T09:26:13.938 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_other": 0, 2024-03-04T09:26:13.938 INFO:teuthology.orchestra.run.smithi190.stdout: "linger_active": 0, 2024-03-04T09:26:13.938 INFO:teuthology.orchestra.run.smithi190.stdout: "linger_send": 0, 2024-03-04T09:26:13.938 INFO:teuthology.orchestra.run.smithi190.stdout: "linger_resend": 0, 2024-03-04T09:26:13.938 INFO:teuthology.orchestra.run.smithi190.stdout: "linger_ping": 0, 2024-03-04T09:26:13.938 INFO:teuthology.orchestra.run.smithi190.stdout: "poolop_active": 0, 2024-03-04T09:26:13.938 INFO:teuthology.orchestra.run.smithi190.stdout: "poolop_send": 0, 2024-03-04T09:26:13.939 INFO:teuthology.orchestra.run.smithi190.stdout: "poolop_resend": 0, 2024-03-04T09:26:13.939 INFO:teuthology.orchestra.run.smithi190.stdout: "poolstat_active": 0, 2024-03-04T09:26:13.939 INFO:teuthology.orchestra.run.smithi190.stdout: "poolstat_send": 0, 2024-03-04T09:26:13.939 INFO:teuthology.orchestra.run.smithi190.stdout: "poolstat_resend": 0, 2024-03-04T09:26:13.939 INFO:teuthology.orchestra.run.smithi190.stdout: "statfs_active": 0, 2024-03-04T09:26:13.939 INFO:teuthology.orchestra.run.smithi190.stdout: "statfs_send": 0, 2024-03-04T09:26:13.939 INFO:teuthology.orchestra.run.smithi190.stdout: "statfs_resend": 0, 2024-03-04T09:26:13.939 INFO:teuthology.orchestra.run.smithi190.stdout: "command_active": 0, 2024-03-04T09:26:13.939 INFO:teuthology.orchestra.run.smithi190.stdout: "command_send": 0, 2024-03-04T09:26:13.939 INFO:teuthology.orchestra.run.smithi190.stdout: "command_resend": 0, 2024-03-04T09:26:13.939 INFO:teuthology.orchestra.run.smithi190.stdout: "map_epoch": 105, 2024-03-04T09:26:13.939 INFO:teuthology.orchestra.run.smithi190.stdout: "map_full": 0, 2024-03-04T09:26:13.939 INFO:teuthology.orchestra.run.smithi190.stdout: "map_inc": 15, 2024-03-04T09:26:13.939 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_sessions": 12, 2024-03-04T09:26:13.939 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_session_open": 12, 2024-03-04T09:26:13.940 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_session_close": 0, 2024-03-04T09:26:13.940 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_laggy": 0, 2024-03-04T09:26:13.940 INFO:teuthology.orchestra.run.smithi190.stdout: "omap_wr": 124, 2024-03-04T09:26:13.940 INFO:teuthology.orchestra.run.smithi190.stdout: "omap_rd": 0, 2024-03-04T09:26:13.940 INFO:teuthology.orchestra.run.smithi190.stdout: "omap_del": 47 2024-03-04T09:26:13.940 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.940 INFO:teuthology.orchestra.run.smithi190.stdout: "oft": { 2024-03-04T09:26:13.940 INFO:teuthology.orchestra.run.smithi190.stdout: "omap_total_objs": 1, 2024-03-04T09:26:13.940 INFO:teuthology.orchestra.run.smithi190.stdout: "omap_total_kv_pairs": 0, 2024-03-04T09:26:13.940 INFO:teuthology.orchestra.run.smithi190.stdout: "omap_total_updates": 0, 2024-03-04T09:26:13.940 INFO:teuthology.orchestra.run.smithi190.stdout: "omap_total_removes": 0 2024-03-04T09:26:13.940 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.940 INFO:teuthology.orchestra.run.smithi190.stdout: "osd-slow-ops": { 2024-03-04T09:26:13.940 INFO:teuthology.orchestra.run.smithi190.stdout: "slow_ops_count": 0 2024-03-04T09:26:13.940 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.941 INFO:teuthology.orchestra.run.smithi190.stdout: "purge_queue": { 2024-03-04T09:26:13.941 INFO:teuthology.orchestra.run.smithi190.stdout: "pq_executing_ops": 0, 2024-03-04T09:26:13.941 INFO:teuthology.orchestra.run.smithi190.stdout: "pq_executing_ops_high_water": 17, 2024-03-04T09:26:13.941 INFO:teuthology.orchestra.run.smithi190.stdout: "pq_executing": 0, 2024-03-04T09:26:13.941 INFO:teuthology.orchestra.run.smithi190.stdout: "pq_executing_high_water": 6, 2024-03-04T09:26:13.941 INFO:teuthology.orchestra.run.smithi190.stdout: "pq_executed_ops": 1609, 2024-03-04T09:26:13.941 INFO:teuthology.orchestra.run.smithi190.stdout: "pq_executed": 807, 2024-03-04T09:26:13.941 INFO:teuthology.orchestra.run.smithi190.stdout: "pq_item_in_journal": 0 2024-03-04T09:26:13.941 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.941 INFO:teuthology.orchestra.run.smithi190.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-04T09:26:13.941 INFO:teuthology.orchestra.run.smithi190.stdout: "val": 0, 2024-03-04T09:26:13.941 INFO:teuthology.orchestra.run.smithi190.stdout: "max": 104857600, 2024-03-04T09:26:13.941 INFO:teuthology.orchestra.run.smithi190.stdout: "get_started": 0, 2024-03-04T09:26:13.941 INFO:teuthology.orchestra.run.smithi190.stdout: "get": 9198, 2024-03-04T09:26:13.942 INFO:teuthology.orchestra.run.smithi190.stdout: "get_sum": 4818546, 2024-03-04T09:26:13.942 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_fail": 0, 2024-03-04T09:26:13.942 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_success": 9198, 2024-03-04T09:26:13.942 INFO:teuthology.orchestra.run.smithi190.stdout: "take": 0, 2024-03-04T09:26:13.942 INFO:teuthology.orchestra.run.smithi190.stdout: "take_sum": 0, 2024-03-04T09:26:13.942 INFO:teuthology.orchestra.run.smithi190.stdout: "put": 9198, 2024-03-04T09:26:13.942 INFO:teuthology.orchestra.run.smithi190.stdout: "put_sum": 4818546, 2024-03-04T09:26:13.942 INFO:teuthology.orchestra.run.smithi190.stdout: "wait": { 2024-03-04T09:26:13.942 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:13.942 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:13.942 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:13.942 INFO:teuthology.orchestra.run.smithi190.stdout: } 2024-03-04T09:26:13.942 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.942 INFO:teuthology.orchestra.run.smithi190.stdout: "throttle-objecter_bytes": { 2024-03-04T09:26:13.942 INFO:teuthology.orchestra.run.smithi190.stdout: "val": 0, 2024-03-04T09:26:13.943 INFO:teuthology.orchestra.run.smithi190.stdout: "max": 104857600, 2024-03-04T09:26:13.943 INFO:teuthology.orchestra.run.smithi190.stdout: "get_started": 0, 2024-03-04T09:26:13.943 INFO:teuthology.orchestra.run.smithi190.stdout: "get": 0, 2024-03-04T09:26:13.943 INFO:teuthology.orchestra.run.smithi190.stdout: "get_sum": 0, 2024-03-04T09:26:13.943 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_fail": 0, 2024-03-04T09:26:13.943 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_success": 0, 2024-03-04T09:26:13.943 INFO:teuthology.orchestra.run.smithi190.stdout: "take": 2298, 2024-03-04T09:26:13.943 INFO:teuthology.orchestra.run.smithi190.stdout: "take_sum": 7131617, 2024-03-04T09:26:13.943 INFO:teuthology.orchestra.run.smithi190.stdout: "put": 2298, 2024-03-04T09:26:13.943 INFO:teuthology.orchestra.run.smithi190.stdout: "put_sum": 7131617, 2024-03-04T09:26:13.943 INFO:teuthology.orchestra.run.smithi190.stdout: "wait": { 2024-03-04T09:26:13.943 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:13.943 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:13.943 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:13.944 INFO:teuthology.orchestra.run.smithi190.stdout: } 2024-03-04T09:26:13.944 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.944 INFO:teuthology.orchestra.run.smithi190.stdout: "throttle-objecter_ops": { 2024-03-04T09:26:13.944 INFO:teuthology.orchestra.run.smithi190.stdout: "val": 0, 2024-03-04T09:26:13.944 INFO:teuthology.orchestra.run.smithi190.stdout: "max": 1024, 2024-03-04T09:26:13.944 INFO:teuthology.orchestra.run.smithi190.stdout: "get_started": 0, 2024-03-04T09:26:13.944 INFO:teuthology.orchestra.run.smithi190.stdout: "get": 0, 2024-03-04T09:26:13.944 INFO:teuthology.orchestra.run.smithi190.stdout: "get_sum": 0, 2024-03-04T09:26:13.944 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_fail": 0, 2024-03-04T09:26:13.944 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_success": 0, 2024-03-04T09:26:13.944 INFO:teuthology.orchestra.run.smithi190.stdout: "take": 2298, 2024-03-04T09:26:13.944 INFO:teuthology.orchestra.run.smithi190.stdout: "take_sum": 2298, 2024-03-04T09:26:13.944 INFO:teuthology.orchestra.run.smithi190.stdout: "put": 2298, 2024-03-04T09:26:13.944 INFO:teuthology.orchestra.run.smithi190.stdout: "put_sum": 2298, 2024-03-04T09:26:13.944 INFO:teuthology.orchestra.run.smithi190.stdout: "wait": { 2024-03-04T09:26:13.945 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:13.945 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:13.945 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:13.945 INFO:teuthology.orchestra.run.smithi190.stdout: } 2024-03-04T09:26:13.945 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.945 INFO:teuthology.orchestra.run.smithi190.stdout: "throttle-write_buf_throttle": { 2024-03-04T09:26:13.945 INFO:teuthology.orchestra.run.smithi190.stdout: "val": 0, 2024-03-04T09:26:13.945 INFO:teuthology.orchestra.run.smithi190.stdout: "max": 3758096384, 2024-03-04T09:26:13.945 INFO:teuthology.orchestra.run.smithi190.stdout: "get_started": 0, 2024-03-04T09:26:13.945 INFO:teuthology.orchestra.run.smithi190.stdout: "get": 807, 2024-03-04T09:26:13.945 INFO:teuthology.orchestra.run.smithi190.stdout: "get_sum": 89051, 2024-03-04T09:26:13.945 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_fail": 0, 2024-03-04T09:26:13.945 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_success": 807, 2024-03-04T09:26:13.945 INFO:teuthology.orchestra.run.smithi190.stdout: "take": 0, 2024-03-04T09:26:13.945 INFO:teuthology.orchestra.run.smithi190.stdout: "take_sum": 0, 2024-03-04T09:26:13.946 INFO:teuthology.orchestra.run.smithi190.stdout: "put": 51, 2024-03-04T09:26:13.946 INFO:teuthology.orchestra.run.smithi190.stdout: "put_sum": 89051, 2024-03-04T09:26:13.946 INFO:teuthology.orchestra.run.smithi190.stdout: "wait": { 2024-03-04T09:26:13.946 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:13.946 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:13.946 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:13.946 INFO:teuthology.orchestra.run.smithi190.stdout: } 2024-03-04T09:26:13.946 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:13.946 INFO:teuthology.orchestra.run.smithi190.stdout: "throttle-write_buf_throttle-0x55ab672c46e0": { 2024-03-04T09:26:13.946 INFO:teuthology.orchestra.run.smithi190.stdout: "val": 0, 2024-03-04T09:26:13.946 INFO:teuthology.orchestra.run.smithi190.stdout: "max": 3758096384, 2024-03-04T09:26:13.946 INFO:teuthology.orchestra.run.smithi190.stdout: "get_started": 0, 2024-03-04T09:26:13.946 INFO:teuthology.orchestra.run.smithi190.stdout: "get": 4756, 2024-03-04T09:26:13.946 INFO:teuthology.orchestra.run.smithi190.stdout: "get_sum": 6739577, 2024-03-04T09:26:13.946 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_fail": 0, 2024-03-04T09:26:13.947 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_success": 4756, 2024-03-04T09:26:13.947 INFO:teuthology.orchestra.run.smithi190.stdout: "take": 0, 2024-03-04T09:26:13.947 INFO:teuthology.orchestra.run.smithi190.stdout: "take_sum": 0, 2024-03-04T09:26:13.947 INFO:teuthology.orchestra.run.smithi190.stdout: "put": 441, 2024-03-04T09:26:13.947 INFO:teuthology.orchestra.run.smithi190.stdout: "put_sum": 6739577, 2024-03-04T09:26:13.947 INFO:teuthology.orchestra.run.smithi190.stdout: "wait": { 2024-03-04T09:26:13.947 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:13.947 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:13.947 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:13.947 INFO:teuthology.orchestra.run.smithi190.stdout: } 2024-03-04T09:26:13.947 INFO:teuthology.orchestra.run.smithi190.stdout: } 2024-03-04T09:26:13.947 INFO:teuthology.orchestra.run.smithi190.stdout:} 2024-03-04T09:26:13.948 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:13 smithi102 ceph-mon[36220]: pgmap v330: 129 pgs: 129 active+clean; 117 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-03-04T09:26:14.875 INFO:tasks.check_counter:Daemon mds.f mds.exported=31 2024-03-04T09:26:14.876 INFO:tasks.check_counter:Daemon mds.f mds.imported=25 2024-03-04T09:26:14.876 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=0 2024-03-04T09:26:14.876 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-03-04T09:26:14.876 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-03-04T09:26:14.876 DEBUG:tasks.check_counter:Getting stats from i 2024-03-04T09:26:14.876 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph daemon mds.i perf dump 2024-03-04T09:26:15.132 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.c/config 2024-03-04T09:26:15.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:15 smithi190 ceph-mon[36341]: pgmap v331: 129 pgs: 129 active+clean; 117 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-03-04T09:26:15.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:15 smithi102 ceph-mon[36220]: pgmap v331: 129 pgs: 129 active+clean; 117 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-03-04T09:26:16.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:15 smithi082 ceph-mon[32880]: pgmap v331: 129 pgs: 129 active+clean; 117 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-03-04T09:26:16.932 INFO:teuthology.orchestra.run.smithi190.stdout:{ 2024-03-04T09:26:16.932 INFO:teuthology.orchestra.run.smithi190.stdout: "AsyncMessenger::Worker-0": { 2024-03-04T09:26:16.932 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_messages": 1853, 2024-03-04T09:26:16.932 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_messages": 2937, 2024-03-04T09:26:16.932 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_bytes": 582660, 2024-03-04T09:26:16.932 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_bytes": 4363096, 2024-03-04T09:26:16.932 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_created_connections": 15, 2024-03-04T09:26:16.932 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_active_connections": 6, 2024-03-04T09:26:16.932 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_total_time": 0.132508804, 2024-03-04T09:26:16.933 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_send_time": 0.053635697, 2024-03-04T09:26:16.933 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_recv_time": 0.065736740, 2024-03-04T09:26:16.933 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_fast_dispatch_time": 0.014982720, 2024-03-04T09:26:16.933 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_messages_queue_lat": { 2024-03-04T09:26:16.933 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 2936, 2024-03-04T09:26:16.933 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.107942152, 2024-03-04T09:26:16.933 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000036765 2024-03-04T09:26:16.933 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.933 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_handle_ack_lat": { 2024-03-04T09:26:16.933 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 3293, 2024-03-04T09:26:16.933 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000543430, 2024-03-04T09:26:16.934 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000165 2024-03-04T09:26:16.934 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.934 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_encrypted_bytes": 4720, 2024-03-04T09:26:16.934 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_encrypted_bytes": 6320 2024-03-04T09:26:16.934 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.934 INFO:teuthology.orchestra.run.smithi190.stdout: "AsyncMessenger::Worker-1": { 2024-03-04T09:26:16.934 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_messages": 3307, 2024-03-04T09:26:16.934 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_messages": 2924, 2024-03-04T09:26:16.934 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_bytes": 1559786, 2024-03-04T09:26:16.934 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_bytes": 1255869, 2024-03-04T09:26:16.934 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_created_connections": 12, 2024-03-04T09:26:16.934 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_active_connections": 9, 2024-03-04T09:26:16.934 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_total_time": 0.184480167, 2024-03-04T09:26:16.935 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_send_time": 0.073856955, 2024-03-04T09:26:16.935 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_recv_time": 0.121426297, 2024-03-04T09:26:16.935 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_fast_dispatch_time": 0.010147008, 2024-03-04T09:26:16.935 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_messages_queue_lat": { 2024-03-04T09:26:16.935 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 2921, 2024-03-04T09:26:16.935 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.085869890, 2024-03-04T09:26:16.935 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000029397 2024-03-04T09:26:16.935 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.935 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_handle_ack_lat": { 2024-03-04T09:26:16.935 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 5649, 2024-03-04T09:26:16.935 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000831831, 2024-03-04T09:26:16.936 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000147 2024-03-04T09:26:16.936 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.936 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_encrypted_bytes": 1088, 2024-03-04T09:26:16.936 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_encrypted_bytes": 132272 2024-03-04T09:26:16.936 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.936 INFO:teuthology.orchestra.run.smithi190.stdout: "AsyncMessenger::Worker-2": { 2024-03-04T09:26:16.936 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_messages": 805, 2024-03-04T09:26:16.936 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_messages": 872, 2024-03-04T09:26:16.936 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_bytes": 1875863, 2024-03-04T09:26:16.936 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_bytes": 705042, 2024-03-04T09:26:16.936 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_created_connections": 8, 2024-03-04T09:26:16.937 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_active_connections": 7, 2024-03-04T09:26:16.937 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_total_time": 0.085554813, 2024-03-04T09:26:16.937 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_send_time": 0.030191929, 2024-03-04T09:26:16.937 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_recv_time": 0.050554772, 2024-03-04T09:26:16.937 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_fast_dispatch_time": 0.015296228, 2024-03-04T09:26:16.937 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_messages_queue_lat": { 2024-03-04T09:26:16.937 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 871, 2024-03-04T09:26:16.937 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.075438650, 2024-03-04T09:26:16.937 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000086611 2024-03-04T09:26:16.937 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.937 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_handle_ack_lat": { 2024-03-04T09:26:16.937 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 110, 2024-03-04T09:26:16.938 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000026287, 2024-03-04T09:26:16.938 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000238 2024-03-04T09:26:16.938 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.938 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_encrypted_bytes": 1684576, 2024-03-04T09:26:16.938 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_encrypted_bytes": 453328 2024-03-04T09:26:16.938 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.938 INFO:teuthology.orchestra.run.smithi190.stdout: "cct": { 2024-03-04T09:26:16.938 INFO:teuthology.orchestra.run.smithi190.stdout: "total_workers": 1, 2024-03-04T09:26:16.938 INFO:teuthology.orchestra.run.smithi190.stdout: "unhealthy_workers": 0 2024-03-04T09:26:16.938 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.938 INFO:teuthology.orchestra.run.smithi190.stdout: "finisher-MDSRank": { 2024-03-04T09:26:16.938 INFO:teuthology.orchestra.run.smithi190.stdout: "queue_len": 0, 2024-03-04T09:26:16.939 INFO:teuthology.orchestra.run.smithi190.stdout: "complete_latency": { 2024-03-04T09:26:16.939 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 587, 2024-03-04T09:26:16.939 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.523833132, 2024-03-04T09:26:16.939 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000892390 2024-03-04T09:26:16.939 INFO:teuthology.orchestra.run.smithi190.stdout: } 2024-03-04T09:26:16.939 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.939 INFO:teuthology.orchestra.run.smithi190.stdout: "finisher-PurgeQueue": { 2024-03-04T09:26:16.939 INFO:teuthology.orchestra.run.smithi190.stdout: "queue_len": 0, 2024-03-04T09:26:16.939 INFO:teuthology.orchestra.run.smithi190.stdout: "complete_latency": { 2024-03-04T09:26:16.939 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 772, 2024-03-04T09:26:16.939 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.068189040, 2024-03-04T09:26:16.940 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000088327 2024-03-04T09:26:16.940 INFO:teuthology.orchestra.run.smithi190.stdout: } 2024-03-04T09:26:16.940 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.940 INFO:teuthology.orchestra.run.smithi190.stdout: "mds": { 2024-03-04T09:26:16.940 INFO:teuthology.orchestra.run.smithi190.stdout: "request": 774, 2024-03-04T09:26:16.940 INFO:teuthology.orchestra.run.smithi190.stdout: "reply": 745, 2024-03-04T09:26:16.941 INFO:teuthology.orchestra.run.smithi190.stdout: "reply_latency": { 2024-03-04T09:26:16.941 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 745, 2024-03-04T09:26:16.941 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 1.174354530, 2024-03-04T09:26:16.941 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.001576314 2024-03-04T09:26:16.941 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.941 INFO:teuthology.orchestra.run.smithi190.stdout: "slow_reply": 0, 2024-03-04T09:26:16.941 INFO:teuthology.orchestra.run.smithi190.stdout: "forward": 29, 2024-03-04T09:26:16.941 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_fetch_complete": 0, 2024-03-04T09:26:16.941 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_fetch_keys": 0, 2024-03-04T09:26:16.941 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_commit": 11, 2024-03-04T09:26:16.941 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_split": 0, 2024-03-04T09:26:16.942 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_merge": 0, 2024-03-04T09:26:16.942 INFO:teuthology.orchestra.run.smithi190.stdout: "inodes": 31, 2024-03-04T09:26:16.942 INFO:teuthology.orchestra.run.smithi190.stdout: "inodes_top": 9, 2024-03-04T09:26:16.942 INFO:teuthology.orchestra.run.smithi190.stdout: "inodes_bottom": 4, 2024-03-04T09:26:16.942 INFO:teuthology.orchestra.run.smithi190.stdout: "inodes_pin_tail": 18, 2024-03-04T09:26:16.942 INFO:teuthology.orchestra.run.smithi190.stdout: "inodes_pinned": 18, 2024-03-04T09:26:16.942 INFO:teuthology.orchestra.run.smithi190.stdout: "inodes_expired": 166, 2024-03-04T09:26:16.942 INFO:teuthology.orchestra.run.smithi190.stdout: "inodes_with_caps": 2, 2024-03-04T09:26:16.942 INFO:teuthology.orchestra.run.smithi190.stdout: "caps": 2, 2024-03-04T09:26:16.942 INFO:teuthology.orchestra.run.smithi190.stdout: "subtrees": 5, 2024-03-04T09:26:16.942 INFO:teuthology.orchestra.run.smithi190.stdout: "traverse": 1477, 2024-03-04T09:26:16.943 INFO:teuthology.orchestra.run.smithi190.stdout: "traverse_hit": 1059, 2024-03-04T09:26:16.943 INFO:teuthology.orchestra.run.smithi190.stdout: "traverse_forward": 27, 2024-03-04T09:26:16.943 INFO:teuthology.orchestra.run.smithi190.stdout: "traverse_discover": 47, 2024-03-04T09:26:16.943 INFO:teuthology.orchestra.run.smithi190.stdout: "traverse_dir_fetch": 0, 2024-03-04T09:26:16.943 INFO:teuthology.orchestra.run.smithi190.stdout: "traverse_remote_ino": 0, 2024-03-04T09:26:16.943 INFO:teuthology.orchestra.run.smithi190.stdout: "traverse_lock": 0, 2024-03-04T09:26:16.943 INFO:teuthology.orchestra.run.smithi190.stdout: "load_cent": 0, 2024-03-04T09:26:16.943 INFO:teuthology.orchestra.run.smithi190.stdout: "q": 0, 2024-03-04T09:26:16.943 INFO:teuthology.orchestra.run.smithi190.stdout: "exported": 16, 2024-03-04T09:26:16.943 INFO:teuthology.orchestra.run.smithi190.stdout: "exported_inodes": 102, 2024-03-04T09:26:16.943 INFO:teuthology.orchestra.run.smithi190.stdout: "imported": 35, 2024-03-04T09:26:16.943 INFO:teuthology.orchestra.run.smithi190.stdout: "imported_inodes": 317, 2024-03-04T09:26:16.944 INFO:teuthology.orchestra.run.smithi190.stdout: "openino_dir_fetch": 0, 2024-03-04T09:26:16.944 INFO:teuthology.orchestra.run.smithi190.stdout: "openino_backtrace_fetch": 0, 2024-03-04T09:26:16.944 INFO:teuthology.orchestra.run.smithi190.stdout: "openino_peer_discover": 0, 2024-03-04T09:26:16.944 INFO:teuthology.orchestra.run.smithi190.stdout: "root_rfiles": 4, 2024-03-04T09:26:16.944 INFO:teuthology.orchestra.run.smithi190.stdout: "root_rbytes": 234, 2024-03-04T09:26:16.944 INFO:teuthology.orchestra.run.smithi190.stdout: "root_rsnaps": 0, 2024-03-04T09:26:16.944 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_backtrace_fetch": 0, 2024-03-04T09:26:16.944 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_set_tag": 0, 2024-03-04T09:26:16.944 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_backtrace_repaired": 0, 2024-03-04T09:26:16.944 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_inotable_repaired": 0, 2024-03-04T09:26:16.944 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_dir_inodes": 0, 2024-03-04T09:26:16.944 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_dir_base_inodes": 0, 2024-03-04T09:26:16.945 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_dirfrag_rstats": 0, 2024-03-04T09:26:16.945 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_file_inodes": 0, 2024-03-04T09:26:16.945 INFO:teuthology.orchestra.run.smithi190.stdout: "handle_inode_file_caps": 6, 2024-03-04T09:26:16.945 INFO:teuthology.orchestra.run.smithi190.stdout: "ceph_cap_op_revoke": 57, 2024-03-04T09:26:16.945 INFO:teuthology.orchestra.run.smithi190.stdout: "ceph_cap_op_grant": 434, 2024-03-04T09:26:16.945 INFO:teuthology.orchestra.run.smithi190.stdout: "ceph_cap_op_trunc": 0, 2024-03-04T09:26:16.945 INFO:teuthology.orchestra.run.smithi190.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-03-04T09:26:16.945 INFO:teuthology.orchestra.run.smithi190.stdout: "ceph_cap_op_flush_ack": 0, 2024-03-04T09:26:16.945 INFO:teuthology.orchestra.run.smithi190.stdout: "handle_client_caps": 490, 2024-03-04T09:26:16.945 INFO:teuthology.orchestra.run.smithi190.stdout: "handle_client_caps_dirty": 335, 2024-03-04T09:26:16.945 INFO:teuthology.orchestra.run.smithi190.stdout: "handle_client_cap_release": 26, 2024-03-04T09:26:16.945 INFO:teuthology.orchestra.run.smithi190.stdout: "process_request_cap_release": 770 2024-03-04T09:26:16.946 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.946 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_cache": { 2024-03-04T09:26:16.946 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_update": 0, 2024-03-04T09:26:16.946 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_update_receipt": 0, 2024-03-04T09:26:16.946 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_try_discover": 0, 2024-03-04T09:26:16.946 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_send_discover": 49, 2024-03-04T09:26:16.946 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_handle_discover": 0, 2024-03-04T09:26:16.946 INFO:teuthology.orchestra.run.smithi190.stdout: "num_strays": 1, 2024-03-04T09:26:16.946 INFO:teuthology.orchestra.run.smithi190.stdout: "num_strays_delayed": 0, 2024-03-04T09:26:16.946 INFO:teuthology.orchestra.run.smithi190.stdout: "num_strays_enqueuing": 0, 2024-03-04T09:26:16.946 INFO:teuthology.orchestra.run.smithi190.stdout: "strays_created": 362, 2024-03-04T09:26:16.946 INFO:teuthology.orchestra.run.smithi190.stdout: "strays_enqueued": 361, 2024-03-04T09:26:16.946 INFO:teuthology.orchestra.run.smithi190.stdout: "strays_reintegrated": 0, 2024-03-04T09:26:16.947 INFO:teuthology.orchestra.run.smithi190.stdout: "strays_migrated": 0, 2024-03-04T09:26:16.947 INFO:teuthology.orchestra.run.smithi190.stdout: "num_recovering_processing": 0, 2024-03-04T09:26:16.947 INFO:teuthology.orchestra.run.smithi190.stdout: "num_recovering_enqueued": 0, 2024-03-04T09:26:16.947 INFO:teuthology.orchestra.run.smithi190.stdout: "num_recovering_prioritized": 0, 2024-03-04T09:26:16.947 INFO:teuthology.orchestra.run.smithi190.stdout: "recovery_started": 0, 2024-03-04T09:26:16.947 INFO:teuthology.orchestra.run.smithi190.stdout: "recovery_completed": 0, 2024-03-04T09:26:16.947 INFO:teuthology.orchestra.run.smithi190.stdout: "ireq_enqueue_scrub": 0, 2024-03-04T09:26:16.947 INFO:teuthology.orchestra.run.smithi190.stdout: "ireq_exportdir": 16, 2024-03-04T09:26:16.947 INFO:teuthology.orchestra.run.smithi190.stdout: "ireq_flush": 0, 2024-03-04T09:26:16.947 INFO:teuthology.orchestra.run.smithi190.stdout: "ireq_fragmentdir": 0, 2024-03-04T09:26:16.947 INFO:teuthology.orchestra.run.smithi190.stdout: "ireq_fragstats": 0, 2024-03-04T09:26:16.948 INFO:teuthology.orchestra.run.smithi190.stdout: "ireq_inodestats": 0 2024-03-04T09:26:16.948 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.948 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_log": { 2024-03-04T09:26:16.948 INFO:teuthology.orchestra.run.smithi190.stdout: "evlrg": 0, 2024-03-04T09:26:16.948 INFO:teuthology.orchestra.run.smithi190.stdout: "evadd": 1386, 2024-03-04T09:26:16.948 INFO:teuthology.orchestra.run.smithi190.stdout: "evex": 0, 2024-03-04T09:26:16.948 INFO:teuthology.orchestra.run.smithi190.stdout: "evtrm": 0, 2024-03-04T09:26:16.948 INFO:teuthology.orchestra.run.smithi190.stdout: "ev": 1386, 2024-03-04T09:26:16.948 INFO:teuthology.orchestra.run.smithi190.stdout: "evexg": 0, 2024-03-04T09:26:16.948 INFO:teuthology.orchestra.run.smithi190.stdout: "evexd": 0, 2024-03-04T09:26:16.948 INFO:teuthology.orchestra.run.smithi190.stdout: "segadd": 3, 2024-03-04T09:26:16.948 INFO:teuthology.orchestra.run.smithi190.stdout: "segex": 0, 2024-03-04T09:26:16.948 INFO:teuthology.orchestra.run.smithi190.stdout: "segtrm": 0, 2024-03-04T09:26:16.949 INFO:teuthology.orchestra.run.smithi190.stdout: "seg": 3, 2024-03-04T09:26:16.949 INFO:teuthology.orchestra.run.smithi190.stdout: "segmjr": 2, 2024-03-04T09:26:16.949 INFO:teuthology.orchestra.run.smithi190.stdout: "segexg": 0, 2024-03-04T09:26:16.949 INFO:teuthology.orchestra.run.smithi190.stdout: "segexd": 0, 2024-03-04T09:26:16.949 INFO:teuthology.orchestra.run.smithi190.stdout: "expos": 4194304, 2024-03-04T09:26:16.949 INFO:teuthology.orchestra.run.smithi190.stdout: "wrpos": 7062568, 2024-03-04T09:26:16.949 INFO:teuthology.orchestra.run.smithi190.stdout: "rdpos": 0, 2024-03-04T09:26:16.949 INFO:teuthology.orchestra.run.smithi190.stdout: "jlat": { 2024-03-04T09:26:16.949 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 260, 2024-03-04T09:26:16.949 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.648037416, 2024-03-04T09:26:16.949 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.002492451 2024-03-04T09:26:16.949 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.949 INFO:teuthology.orchestra.run.smithi190.stdout: "replayed": 0 2024-03-04T09:26:16.950 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.950 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_mem": { 2024-03-04T09:26:16.950 INFO:teuthology.orchestra.run.smithi190.stdout: "ino": 35, 2024-03-04T09:26:16.950 INFO:teuthology.orchestra.run.smithi190.stdout: "ino+": 473, 2024-03-04T09:26:16.950 INFO:teuthology.orchestra.run.smithi190.stdout: "ino-": 438, 2024-03-04T09:26:16.950 INFO:teuthology.orchestra.run.smithi190.stdout: "dir": 32, 2024-03-04T09:26:16.951 INFO:teuthology.orchestra.run.smithi190.stdout: "dir+": 112, 2024-03-04T09:26:16.951 INFO:teuthology.orchestra.run.smithi190.stdout: "dir-": 80, 2024-03-04T09:26:16.951 INFO:teuthology.orchestra.run.smithi190.stdout: "dn": 31, 2024-03-04T09:26:16.951 INFO:teuthology.orchestra.run.smithi190.stdout: "dn+": 815, 2024-03-04T09:26:16.951 INFO:teuthology.orchestra.run.smithi190.stdout: "dn-": 784, 2024-03-04T09:26:16.951 INFO:teuthology.orchestra.run.smithi190.stdout: "cap": 2, 2024-03-04T09:26:16.951 INFO:teuthology.orchestra.run.smithi190.stdout: "cap+": 381, 2024-03-04T09:26:16.951 INFO:teuthology.orchestra.run.smithi190.stdout: "cap-": 379, 2024-03-04T09:26:16.952 INFO:teuthology.orchestra.run.smithi190.stdout: "rss": 58916, 2024-03-04T09:26:16.952 INFO:teuthology.orchestra.run.smithi190.stdout: "heap": 223612 2024-03-04T09:26:16.952 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.952 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_server": { 2024-03-04T09:26:16.952 INFO:teuthology.orchestra.run.smithi190.stdout: "dispatch_client_request": 1241, 2024-03-04T09:26:16.952 INFO:teuthology.orchestra.run.smithi190.stdout: "dispatch_server_request": 24, 2024-03-04T09:26:16.952 INFO:teuthology.orchestra.run.smithi190.stdout: "handle_client_request": 774, 2024-03-04T09:26:16.952 INFO:teuthology.orchestra.run.smithi190.stdout: "handle_client_session": 22, 2024-03-04T09:26:16.952 INFO:teuthology.orchestra.run.smithi190.stdout: "handle_peer_request": 175, 2024-03-04T09:26:16.953 INFO:teuthology.orchestra.run.smithi190.stdout: "req_create_latency": { 2024-03-04T09:26:16.953 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 45, 2024-03-04T09:26:16.953 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.083797678, 2024-03-04T09:26:16.953 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.001862170 2024-03-04T09:26:16.953 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.953 INFO:teuthology.orchestra.run.smithi190.stdout: "req_getattr_latency": { 2024-03-04T09:26:16.953 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 2, 2024-03-04T09:26:16.953 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.002068904, 2024-03-04T09:26:16.953 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.001034452 2024-03-04T09:26:16.954 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.954 INFO:teuthology.orchestra.run.smithi190.stdout: "req_getfilelock_latency": { 2024-03-04T09:26:16.954 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:16.954 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:16.954 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:16.954 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.954 INFO:teuthology.orchestra.run.smithi190.stdout: "req_link_latency": { 2024-03-04T09:26:16.954 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:16.954 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:16.954 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:16.954 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.954 INFO:teuthology.orchestra.run.smithi190.stdout: "req_lookup_latency": { 2024-03-04T09:26:16.955 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 291, 2024-03-04T09:26:16.955 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.190265388, 2024-03-04T09:26:16.955 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000653832 2024-03-04T09:26:16.955 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.955 INFO:teuthology.orchestra.run.smithi190.stdout: "req_lookuphash_latency": { 2024-03-04T09:26:16.955 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:16.955 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:16.955 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:16.955 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.955 INFO:teuthology.orchestra.run.smithi190.stdout: "req_lookupino_latency": { 2024-03-04T09:26:16.955 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:16.955 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:16.956 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:16.956 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.956 INFO:teuthology.orchestra.run.smithi190.stdout: "req_lookupname_latency": { 2024-03-04T09:26:16.956 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:16.956 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:16.956 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:16.956 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.956 INFO:teuthology.orchestra.run.smithi190.stdout: "req_lookupparent_latency": { 2024-03-04T09:26:16.956 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:16.956 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:16.956 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:16.957 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.957 INFO:teuthology.orchestra.run.smithi190.stdout: "req_lookupsnap_latency": { 2024-03-04T09:26:16.957 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:16.957 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:16.957 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:16.957 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.957 INFO:teuthology.orchestra.run.smithi190.stdout: "req_lssnap_latency": { 2024-03-04T09:26:16.957 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:16.957 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:16.957 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:16.957 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.957 INFO:teuthology.orchestra.run.smithi190.stdout: "req_mkdir_latency": { 2024-03-04T09:26:16.958 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:16.958 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:16.958 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:16.958 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.958 INFO:teuthology.orchestra.run.smithi190.stdout: "req_mknod_latency": { 2024-03-04T09:26:16.959 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:16.959 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:16.959 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:16.959 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.959 INFO:teuthology.orchestra.run.smithi190.stdout: "req_mksnap_latency": { 2024-03-04T09:26:16.959 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:16.959 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:16.959 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:16.959 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.959 INFO:teuthology.orchestra.run.smithi190.stdout: "req_open_latency": { 2024-03-04T09:26:16.959 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:16.959 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:16.960 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:16.960 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.960 INFO:teuthology.orchestra.run.smithi190.stdout: "req_readdir_latency": { 2024-03-04T09:26:16.960 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 45, 2024-03-04T09:26:16.960 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.029777480, 2024-03-04T09:26:16.960 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000661721 2024-03-04T09:26:16.960 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.960 INFO:teuthology.orchestra.run.smithi190.stdout: "req_rename_latency": { 2024-03-04T09:26:16.960 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:16.960 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:16.961 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:16.961 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.961 INFO:teuthology.orchestra.run.smithi190.stdout: "req_renamesnap_latency": { 2024-03-04T09:26:16.961 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:16.961 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:16.961 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:16.961 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.961 INFO:teuthology.orchestra.run.smithi190.stdout: "req_snapdiff_latency": { 2024-03-04T09:26:16.961 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:16.961 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:16.961 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:16.961 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.961 INFO:teuthology.orchestra.run.smithi190.stdout: "req_rmdir_latency": { 2024-03-04T09:26:16.962 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 21, 2024-03-04T09:26:16.962 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.286345162, 2024-03-04T09:26:16.962 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.013635483 2024-03-04T09:26:16.962 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.962 INFO:teuthology.orchestra.run.smithi190.stdout: "req_rmsnap_latency": { 2024-03-04T09:26:16.962 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:16.962 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:16.962 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:16.962 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.962 INFO:teuthology.orchestra.run.smithi190.stdout: "req_rmxattr_latency": { 2024-03-04T09:26:16.962 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:16.962 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:16.963 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:16.963 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.963 INFO:teuthology.orchestra.run.smithi190.stdout: "req_setattr_latency": { 2024-03-04T09:26:16.963 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:16.963 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:16.963 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:16.963 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.963 INFO:teuthology.orchestra.run.smithi190.stdout: "req_setdirlayout_latency": { 2024-03-04T09:26:16.963 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:16.963 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:16.963 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:16.963 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.964 INFO:teuthology.orchestra.run.smithi190.stdout: "req_setfilelock_latency": { 2024-03-04T09:26:16.964 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:16.964 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:16.964 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:16.964 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.964 INFO:teuthology.orchestra.run.smithi190.stdout: "req_setlayout_latency": { 2024-03-04T09:26:16.964 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:16.964 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:16.964 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:16.964 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.964 INFO:teuthology.orchestra.run.smithi190.stdout: "req_setxattr_latency": { 2024-03-04T09:26:16.964 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:16.965 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:16.965 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:16.965 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.965 INFO:teuthology.orchestra.run.smithi190.stdout: "req_symlink_latency": { 2024-03-04T09:26:16.965 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:16.965 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:16.965 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:16.965 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.965 INFO:teuthology.orchestra.run.smithi190.stdout: "req_unlink_latency": { 2024-03-04T09:26:16.965 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 341, 2024-03-04T09:26:16.966 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.582099918, 2024-03-04T09:26:16.966 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.001707037 2024-03-04T09:26:16.966 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.966 INFO:teuthology.orchestra.run.smithi190.stdout: "cap_revoke_eviction": 0, 2024-03-04T09:26:16.966 INFO:teuthology.orchestra.run.smithi190.stdout: "cap_acquisition_throttle": 0, 2024-03-04T09:26:16.966 INFO:teuthology.orchestra.run.smithi190.stdout: "req_getvxattr_latency": { 2024-03-04T09:26:16.966 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:16.966 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:16.966 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:16.966 INFO:teuthology.orchestra.run.smithi190.stdout: } 2024-03-04T09:26:16.966 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.966 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_sessions": { 2024-03-04T09:26:16.967 INFO:teuthology.orchestra.run.smithi190.stdout: "session_count": 2, 2024-03-04T09:26:16.967 INFO:teuthology.orchestra.run.smithi190.stdout: "session_add": 3, 2024-03-04T09:26:16.967 INFO:teuthology.orchestra.run.smithi190.stdout: "session_remove": 1, 2024-03-04T09:26:16.967 INFO:teuthology.orchestra.run.smithi190.stdout: "sessions_open": 2, 2024-03-04T09:26:16.967 INFO:teuthology.orchestra.run.smithi190.stdout: "sessions_stale": 0, 2024-03-04T09:26:16.967 INFO:teuthology.orchestra.run.smithi190.stdout: "total_load": 623, 2024-03-04T09:26:16.967 INFO:teuthology.orchestra.run.smithi190.stdout: "average_load": 311, 2024-03-04T09:26:16.967 INFO:teuthology.orchestra.run.smithi190.stdout: "avg_session_uptime": 631, 2024-03-04T09:26:16.967 INFO:teuthology.orchestra.run.smithi190.stdout: "mdthresh_evicted": 0 2024-03-04T09:26:16.967 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.968 INFO:teuthology.orchestra.run.smithi190.stdout: "mempool": { 2024-03-04T09:26:16.968 INFO:teuthology.orchestra.run.smithi190.stdout: "bloom_filter_bytes": 0, 2024-03-04T09:26:16.968 INFO:teuthology.orchestra.run.smithi190.stdout: "bloom_filter_items": 0, 2024-03-04T09:26:16.968 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_alloc_bytes": 0, 2024-03-04T09:26:16.968 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_alloc_items": 0, 2024-03-04T09:26:16.968 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_data_bytes": 0, 2024-03-04T09:26:16.968 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_data_items": 0, 2024-03-04T09:26:16.968 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-04T09:26:16.968 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_onode_items": 0, 2024-03-04T09:26:16.968 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-04T09:26:16.968 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_meta_items": 0, 2024-03-04T09:26:16.969 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_other_bytes": 0, 2024-03-04T09:26:16.969 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_other_items": 0, 2024-03-04T09:26:16.969 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-04T09:26:16.969 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_buffer_items": 0, 2024-03-04T09:26:16.969 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_extent_bytes": 0, 2024-03-04T09:26:16.969 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_extent_items": 0, 2024-03-04T09:26:16.969 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_blob_bytes": 0, 2024-03-04T09:26:16.969 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_blob_items": 0, 2024-03-04T09:26:16.969 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-04T09:26:16.969 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_shared_blob_items": 0, 2024-03-04T09:26:16.969 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-04T09:26:16.969 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_inline_bl_items": 0, 2024-03-04T09:26:16.969 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_fsck_bytes": 0, 2024-03-04T09:26:16.970 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_fsck_items": 0, 2024-03-04T09:26:16.970 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_txc_bytes": 0, 2024-03-04T09:26:16.970 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_txc_items": 0, 2024-03-04T09:26:16.970 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-04T09:26:16.970 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_writing_deferred_items": 0, 2024-03-04T09:26:16.970 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_writing_bytes": 0, 2024-03-04T09:26:16.970 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_writing_items": 0, 2024-03-04T09:26:16.970 INFO:teuthology.orchestra.run.smithi190.stdout: "bluefs_bytes": 0, 2024-03-04T09:26:16.970 INFO:teuthology.orchestra.run.smithi190.stdout: "bluefs_items": 0, 2024-03-04T09:26:16.970 INFO:teuthology.orchestra.run.smithi190.stdout: "bluefs_file_reader_bytes": 0, 2024-03-04T09:26:16.970 INFO:teuthology.orchestra.run.smithi190.stdout: "bluefs_file_reader_items": 0, 2024-03-04T09:26:16.970 INFO:teuthology.orchestra.run.smithi190.stdout: "bluefs_file_writer_bytes": 0, 2024-03-04T09:26:16.971 INFO:teuthology.orchestra.run.smithi190.stdout: "bluefs_file_writer_items": 0, 2024-03-04T09:26:16.971 INFO:teuthology.orchestra.run.smithi190.stdout: "buffer_anon_bytes": 324394, 2024-03-04T09:26:16.971 INFO:teuthology.orchestra.run.smithi190.stdout: "buffer_anon_items": 135, 2024-03-04T09:26:16.971 INFO:teuthology.orchestra.run.smithi190.stdout: "buffer_meta_bytes": 0, 2024-03-04T09:26:16.971 INFO:teuthology.orchestra.run.smithi190.stdout: "buffer_meta_items": 0, 2024-03-04T09:26:16.971 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_bytes": 0, 2024-03-04T09:26:16.971 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_items": 0, 2024-03-04T09:26:16.971 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_mapbl_bytes": 0, 2024-03-04T09:26:16.971 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_mapbl_items": 0, 2024-03-04T09:26:16.971 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_pglog_bytes": 0, 2024-03-04T09:26:16.971 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_pglog_items": 0, 2024-03-04T09:26:16.971 INFO:teuthology.orchestra.run.smithi190.stdout: "osdmap_bytes": 10072, 2024-03-04T09:26:16.972 INFO:teuthology.orchestra.run.smithi190.stdout: "osdmap_items": 211, 2024-03-04T09:26:16.972 INFO:teuthology.orchestra.run.smithi190.stdout: "osdmap_mapping_bytes": 0, 2024-03-04T09:26:16.972 INFO:teuthology.orchestra.run.smithi190.stdout: "osdmap_mapping_items": 0, 2024-03-04T09:26:16.972 INFO:teuthology.orchestra.run.smithi190.stdout: "pgmap_bytes": 0, 2024-03-04T09:26:16.972 INFO:teuthology.orchestra.run.smithi190.stdout: "pgmap_items": 0, 2024-03-04T09:26:16.972 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_co_bytes": 171354, 2024-03-04T09:26:16.972 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_co_items": 768, 2024-03-04T09:26:16.972 INFO:teuthology.orchestra.run.smithi190.stdout: "unittest_1_bytes": 0, 2024-03-04T09:26:16.972 INFO:teuthology.orchestra.run.smithi190.stdout: "unittest_1_items": 0, 2024-03-04T09:26:16.972 INFO:teuthology.orchestra.run.smithi190.stdout: "unittest_2_bytes": 0, 2024-03-04T09:26:16.972 INFO:teuthology.orchestra.run.smithi190.stdout: "unittest_2_items": 0 2024-03-04T09:26:16.973 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.973 INFO:teuthology.orchestra.run.smithi190.stdout: "objecter": { 2024-03-04T09:26:16.973 INFO:teuthology.orchestra.run.smithi190.stdout: "op_active": 0, 2024-03-04T09:26:16.973 INFO:teuthology.orchestra.run.smithi190.stdout: "op_laggy": 0, 2024-03-04T09:26:16.973 INFO:teuthology.orchestra.run.smithi190.stdout: "op_send": 1182, 2024-03-04T09:26:16.973 INFO:teuthology.orchestra.run.smithi190.stdout: "op_send_bytes": 2958744, 2024-03-04T09:26:16.973 INFO:teuthology.orchestra.run.smithi190.stdout: "op_resend": 33, 2024-03-04T09:26:16.973 INFO:teuthology.orchestra.run.smithi190.stdout: "op_reply": 1182, 2024-03-04T09:26:16.973 INFO:teuthology.orchestra.run.smithi190.stdout: "op_latency": { 2024-03-04T09:26:16.973 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 1182, 2024-03-04T09:26:16.973 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 3.849890152, 2024-03-04T09:26:16.973 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.003257098 2024-03-04T09:26:16.974 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.974 INFO:teuthology.orchestra.run.smithi190.stdout: "op_inflight": 0, 2024-03-04T09:26:16.974 INFO:teuthology.orchestra.run.smithi190.stdout: "oplen_avg": { 2024-03-04T09:26:16.974 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 1182, 2024-03-04T09:26:16.974 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 1277 2024-03-04T09:26:16.974 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.974 INFO:teuthology.orchestra.run.smithi190.stdout: "op": 1182, 2024-03-04T09:26:16.974 INFO:teuthology.orchestra.run.smithi190.stdout: "op_r": 45, 2024-03-04T09:26:16.974 INFO:teuthology.orchestra.run.smithi190.stdout: "op_w": 1137, 2024-03-04T09:26:16.974 INFO:teuthology.orchestra.run.smithi190.stdout: "op_rmw": 0, 2024-03-04T09:26:16.974 INFO:teuthology.orchestra.run.smithi190.stdout: "op_pg": 0, 2024-03-04T09:26:16.975 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_stat": 0, 2024-03-04T09:26:16.975 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_create": 10, 2024-03-04T09:26:16.975 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_read": 45, 2024-03-04T09:26:16.975 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_write": 305, 2024-03-04T09:26:16.975 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_writefull": 39, 2024-03-04T09:26:16.975 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_writesame": 0, 2024-03-04T09:26:16.975 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_append": 0, 2024-03-04T09:26:16.975 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_zero": 0, 2024-03-04T09:26:16.975 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_truncate": 0, 2024-03-04T09:26:16.975 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_delete": 714, 2024-03-04T09:26:16.975 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_mapext": 0, 2024-03-04T09:26:16.975 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_sparse_read": 0, 2024-03-04T09:26:16.976 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_clonerange": 0, 2024-03-04T09:26:16.976 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_getxattr": 0, 2024-03-04T09:26:16.976 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_setxattr": 20, 2024-03-04T09:26:16.976 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_cmpxattr": 0, 2024-03-04T09:26:16.976 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_rmxattr": 0, 2024-03-04T09:26:16.976 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_resetxattrs": 0, 2024-03-04T09:26:16.976 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_call": 0, 2024-03-04T09:26:16.976 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_watch": 0, 2024-03-04T09:26:16.976 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_notify": 0, 2024-03-04T09:26:16.976 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_src_cmpxattr": 0, 2024-03-04T09:26:16.976 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_pgls": 0, 2024-03-04T09:26:16.977 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_pgls_filter": 0, 2024-03-04T09:26:16.977 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_other": 0, 2024-03-04T09:26:16.977 INFO:teuthology.orchestra.run.smithi190.stdout: "linger_active": 0, 2024-03-04T09:26:16.977 INFO:teuthology.orchestra.run.smithi190.stdout: "linger_send": 0, 2024-03-04T09:26:16.977 INFO:teuthology.orchestra.run.smithi190.stdout: "linger_resend": 0, 2024-03-04T09:26:16.977 INFO:teuthology.orchestra.run.smithi190.stdout: "linger_ping": 0, 2024-03-04T09:26:16.977 INFO:teuthology.orchestra.run.smithi190.stdout: "poolop_active": 0, 2024-03-04T09:26:16.977 INFO:teuthology.orchestra.run.smithi190.stdout: "poolop_send": 0, 2024-03-04T09:26:16.977 INFO:teuthology.orchestra.run.smithi190.stdout: "poolop_resend": 0, 2024-03-04T09:26:16.977 INFO:teuthology.orchestra.run.smithi190.stdout: "poolstat_active": 0, 2024-03-04T09:26:16.977 INFO:teuthology.orchestra.run.smithi190.stdout: "poolstat_send": 0, 2024-03-04T09:26:16.977 INFO:teuthology.orchestra.run.smithi190.stdout: "poolstat_resend": 0, 2024-03-04T09:26:16.978 INFO:teuthology.orchestra.run.smithi190.stdout: "statfs_active": 0, 2024-03-04T09:26:16.978 INFO:teuthology.orchestra.run.smithi190.stdout: "statfs_send": 0, 2024-03-04T09:26:16.978 INFO:teuthology.orchestra.run.smithi190.stdout: "statfs_resend": 0, 2024-03-04T09:26:16.978 INFO:teuthology.orchestra.run.smithi190.stdout: "command_active": 0, 2024-03-04T09:26:16.978 INFO:teuthology.orchestra.run.smithi190.stdout: "command_send": 0, 2024-03-04T09:26:16.978 INFO:teuthology.orchestra.run.smithi190.stdout: "command_resend": 0, 2024-03-04T09:26:16.978 INFO:teuthology.orchestra.run.smithi190.stdout: "map_epoch": 105, 2024-03-04T09:26:16.978 INFO:teuthology.orchestra.run.smithi190.stdout: "map_full": 0, 2024-03-04T09:26:16.978 INFO:teuthology.orchestra.run.smithi190.stdout: "map_inc": 15, 2024-03-04T09:26:16.978 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_sessions": 12, 2024-03-04T09:26:16.978 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_session_open": 12, 2024-03-04T09:26:16.978 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_session_close": 0, 2024-03-04T09:26:16.978 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_laggy": 0, 2024-03-04T09:26:16.979 INFO:teuthology.orchestra.run.smithi190.stdout: "omap_wr": 104, 2024-03-04T09:26:16.979 INFO:teuthology.orchestra.run.smithi190.stdout: "omap_rd": 0, 2024-03-04T09:26:16.979 INFO:teuthology.orchestra.run.smithi190.stdout: "omap_del": 40 2024-03-04T09:26:16.979 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.979 INFO:teuthology.orchestra.run.smithi190.stdout: "oft": { 2024-03-04T09:26:16.979 INFO:teuthology.orchestra.run.smithi190.stdout: "omap_total_objs": 1, 2024-03-04T09:26:16.979 INFO:teuthology.orchestra.run.smithi190.stdout: "omap_total_kv_pairs": 0, 2024-03-04T09:26:16.979 INFO:teuthology.orchestra.run.smithi190.stdout: "omap_total_updates": 0, 2024-03-04T09:26:16.979 INFO:teuthology.orchestra.run.smithi190.stdout: "omap_total_removes": 0 2024-03-04T09:26:16.979 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.979 INFO:teuthology.orchestra.run.smithi190.stdout: "osd-slow-ops": { 2024-03-04T09:26:16.979 INFO:teuthology.orchestra.run.smithi190.stdout: "slow_ops_count": 0 2024-03-04T09:26:16.980 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.980 INFO:teuthology.orchestra.run.smithi190.stdout: "purge_queue": { 2024-03-04T09:26:16.980 INFO:teuthology.orchestra.run.smithi190.stdout: "pq_executing_ops": 0, 2024-03-04T09:26:16.980 INFO:teuthology.orchestra.run.smithi190.stdout: "pq_executing_ops_high_water": 10, 2024-03-04T09:26:16.980 INFO:teuthology.orchestra.run.smithi190.stdout: "pq_executing": 0, 2024-03-04T09:26:16.980 INFO:teuthology.orchestra.run.smithi190.stdout: "pq_executing_high_water": 6, 2024-03-04T09:26:16.980 INFO:teuthology.orchestra.run.smithi190.stdout: "pq_executed_ops": 702, 2024-03-04T09:26:16.980 INFO:teuthology.orchestra.run.smithi190.stdout: "pq_executed": 361, 2024-03-04T09:26:16.980 INFO:teuthology.orchestra.run.smithi190.stdout: "pq_item_in_journal": 0 2024-03-04T09:26:16.980 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.980 INFO:teuthology.orchestra.run.smithi190.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-04T09:26:16.980 INFO:teuthology.orchestra.run.smithi190.stdout: "val": 0, 2024-03-04T09:26:16.981 INFO:teuthology.orchestra.run.smithi190.stdout: "max": 104857600, 2024-03-04T09:26:16.981 INFO:teuthology.orchestra.run.smithi190.stdout: "get_started": 0, 2024-03-04T09:26:16.981 INFO:teuthology.orchestra.run.smithi190.stdout: "get": 5961, 2024-03-04T09:26:16.981 INFO:teuthology.orchestra.run.smithi190.stdout: "get_sum": 3462514, 2024-03-04T09:26:16.981 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_fail": 0, 2024-03-04T09:26:16.981 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_success": 5961, 2024-03-04T09:26:16.981 INFO:teuthology.orchestra.run.smithi190.stdout: "take": 0, 2024-03-04T09:26:16.981 INFO:teuthology.orchestra.run.smithi190.stdout: "take_sum": 0, 2024-03-04T09:26:16.981 INFO:teuthology.orchestra.run.smithi190.stdout: "put": 5961, 2024-03-04T09:26:16.981 INFO:teuthology.orchestra.run.smithi190.stdout: "put_sum": 3462514, 2024-03-04T09:26:16.982 INFO:teuthology.orchestra.run.smithi190.stdout: "wait": { 2024-03-04T09:26:16.982 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:16.982 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:16.982 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:16.982 INFO:teuthology.orchestra.run.smithi190.stdout: } 2024-03-04T09:26:16.982 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.982 INFO:teuthology.orchestra.run.smithi190.stdout: "throttle-objecter_bytes": { 2024-03-04T09:26:16.982 INFO:teuthology.orchestra.run.smithi190.stdout: "val": 0, 2024-03-04T09:26:16.982 INFO:teuthology.orchestra.run.smithi190.stdout: "max": 104857600, 2024-03-04T09:26:16.982 INFO:teuthology.orchestra.run.smithi190.stdout: "get_started": 0, 2024-03-04T09:26:16.982 INFO:teuthology.orchestra.run.smithi190.stdout: "get": 0, 2024-03-04T09:26:16.983 INFO:teuthology.orchestra.run.smithi190.stdout: "get_sum": 0, 2024-03-04T09:26:16.983 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_fail": 0, 2024-03-04T09:26:16.983 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_success": 0, 2024-03-04T09:26:16.983 INFO:teuthology.orchestra.run.smithi190.stdout: "take": 1182, 2024-03-04T09:26:16.983 INFO:teuthology.orchestra.run.smithi190.stdout: "take_sum": 2998293, 2024-03-04T09:26:16.983 INFO:teuthology.orchestra.run.smithi190.stdout: "put": 1182, 2024-03-04T09:26:16.983 INFO:teuthology.orchestra.run.smithi190.stdout: "put_sum": 2998293, 2024-03-04T09:26:16.983 INFO:teuthology.orchestra.run.smithi190.stdout: "wait": { 2024-03-04T09:26:16.983 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:16.983 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:16.983 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:16.983 INFO:teuthology.orchestra.run.smithi190.stdout: } 2024-03-04T09:26:16.984 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.984 INFO:teuthology.orchestra.run.smithi190.stdout: "throttle-objecter_ops": { 2024-03-04T09:26:16.984 INFO:teuthology.orchestra.run.smithi190.stdout: "val": 0, 2024-03-04T09:26:16.984 INFO:teuthology.orchestra.run.smithi190.stdout: "max": 1024, 2024-03-04T09:26:16.984 INFO:teuthology.orchestra.run.smithi190.stdout: "get_started": 0, 2024-03-04T09:26:16.984 INFO:teuthology.orchestra.run.smithi190.stdout: "get": 0, 2024-03-04T09:26:16.984 INFO:teuthology.orchestra.run.smithi190.stdout: "get_sum": 0, 2024-03-04T09:26:16.984 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_fail": 0, 2024-03-04T09:26:16.985 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_success": 0, 2024-03-04T09:26:16.985 INFO:teuthology.orchestra.run.smithi190.stdout: "take": 1182, 2024-03-04T09:26:16.985 INFO:teuthology.orchestra.run.smithi190.stdout: "take_sum": 1182, 2024-03-04T09:26:16.985 INFO:teuthology.orchestra.run.smithi190.stdout: "put": 1182, 2024-03-04T09:26:16.985 INFO:teuthology.orchestra.run.smithi190.stdout: "put_sum": 1182, 2024-03-04T09:26:16.985 INFO:teuthology.orchestra.run.smithi190.stdout: "wait": { 2024-03-04T09:26:16.985 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:16.985 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:16.986 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:16.986 INFO:teuthology.orchestra.run.smithi190.stdout: } 2024-03-04T09:26:16.986 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.986 INFO:teuthology.orchestra.run.smithi190.stdout: "throttle-write_buf_throttle": { 2024-03-04T09:26:16.986 INFO:teuthology.orchestra.run.smithi190.stdout: "val": 0, 2024-03-04T09:26:16.986 INFO:teuthology.orchestra.run.smithi190.stdout: "max": 3758096384, 2024-03-04T09:26:16.986 INFO:teuthology.orchestra.run.smithi190.stdout: "get_started": 0, 2024-03-04T09:26:16.986 INFO:teuthology.orchestra.run.smithi190.stdout: "get": 361, 2024-03-04T09:26:16.987 INFO:teuthology.orchestra.run.smithi190.stdout: "get_sum": 39549, 2024-03-04T09:26:16.987 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_fail": 0, 2024-03-04T09:26:16.987 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_success": 361, 2024-03-04T09:26:16.987 INFO:teuthology.orchestra.run.smithi190.stdout: "take": 0, 2024-03-04T09:26:16.987 INFO:teuthology.orchestra.run.smithi190.stdout: "take_sum": 0, 2024-03-04T09:26:16.987 INFO:teuthology.orchestra.run.smithi190.stdout: "put": 45, 2024-03-04T09:26:16.987 INFO:teuthology.orchestra.run.smithi190.stdout: "put_sum": 39549, 2024-03-04T09:26:16.987 INFO:teuthology.orchestra.run.smithi190.stdout: "wait": { 2024-03-04T09:26:16.987 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:16.987 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:16.987 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:16.987 INFO:teuthology.orchestra.run.smithi190.stdout: } 2024-03-04T09:26:16.987 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:16.988 INFO:teuthology.orchestra.run.smithi190.stdout: "throttle-write_buf_throttle-0x55dcb6e446e0": { 2024-03-04T09:26:16.988 INFO:teuthology.orchestra.run.smithi190.stdout: "val": 0, 2024-03-04T09:26:16.988 INFO:teuthology.orchestra.run.smithi190.stdout: "max": 3758096384, 2024-03-04T09:26:16.988 INFO:teuthology.orchestra.run.smithi190.stdout: "get_started": 0, 2024-03-04T09:26:16.988 INFO:teuthology.orchestra.run.smithi190.stdout: "get": 1386, 2024-03-04T09:26:16.989 INFO:teuthology.orchestra.run.smithi190.stdout: "get_sum": 2868264, 2024-03-04T09:26:16.989 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_fail": 0, 2024-03-04T09:26:16.989 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_success": 1386, 2024-03-04T09:26:16.989 INFO:teuthology.orchestra.run.smithi190.stdout: "take": 0, 2024-03-04T09:26:16.989 INFO:teuthology.orchestra.run.smithi190.stdout: "take_sum": 0, 2024-03-04T09:26:16.989 INFO:teuthology.orchestra.run.smithi190.stdout: "put": 260, 2024-03-04T09:26:16.989 INFO:teuthology.orchestra.run.smithi190.stdout: "put_sum": 2868264, 2024-03-04T09:26:16.989 INFO:teuthology.orchestra.run.smithi190.stdout: "wait": { 2024-03-04T09:26:16.989 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:16.989 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:16.990 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:16.990 INFO:teuthology.orchestra.run.smithi190.stdout: } 2024-03-04T09:26:16.990 INFO:teuthology.orchestra.run.smithi190.stdout: } 2024-03-04T09:26:16.990 INFO:teuthology.orchestra.run.smithi190.stdout:} 2024-03-04T09:26:17.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:17 smithi190 ceph-mon[36341]: pgmap v332: 129 pgs: 129 active+clean; 117 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-03-04T09:26:17.723 INFO:tasks.check_counter:Daemon mds.i mds.exported=16 2024-03-04T09:26:17.723 INFO:tasks.check_counter:Daemon mds.i mds.imported=35 2024-03-04T09:26:17.723 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=0 2024-03-04T09:26:17.723 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-03-04T09:26:17.723 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-03-04T09:26:17.723 DEBUG:tasks.check_counter:Getting stats from l 2024-03-04T09:26:17.723 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd shell --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 -- ceph daemon mds.l perf dump 2024-03-04T09:26:17.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:17 smithi102 ceph-mon[36220]: pgmap v332: 129 pgs: 129 active+clean; 117 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-03-04T09:26:17.992 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/mon.c/config 2024-03-04T09:26:18.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:17 smithi082 ceph-mon[32880]: pgmap v332: 129 pgs: 129 active+clean; 117 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-03-04T09:26:19.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:19 smithi102 ceph-mon[36220]: osdmap e106: 12 total, 12 up, 12 in 2024-03-04T09:26:19.492 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:19 smithi190 ceph-mon[36341]: osdmap e106: 12 total, 12 up, 12 in 2024-03-04T09:26:19.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:19 smithi082 ceph-mon[32880]: osdmap e106: 12 total, 12 up, 12 in 2024-03-04T09:26:19.841 INFO:teuthology.orchestra.run.smithi190.stdout:{ 2024-03-04T09:26:19.841 INFO:teuthology.orchestra.run.smithi190.stdout: "AsyncMessenger::Worker-0": { 2024-03-04T09:26:19.841 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_messages": 2228, 2024-03-04T09:26:19.841 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_messages": 2230, 2024-03-04T09:26:19.841 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_bytes": 3497641, 2024-03-04T09:26:19.841 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_bytes": 708511, 2024-03-04T09:26:19.841 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_created_connections": 6, 2024-03-04T09:26:19.842 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_active_connections": 2, 2024-03-04T09:26:19.842 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_total_time": 0.131904541, 2024-03-04T09:26:19.842 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_send_time": 0.038998339, 2024-03-04T09:26:19.842 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_recv_time": 0.034332137, 2024-03-04T09:26:19.842 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_fast_dispatch_time": 0.049712706, 2024-03-04T09:26:19.842 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_messages_queue_lat": { 2024-03-04T09:26:19.842 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 2228, 2024-03-04T09:26:19.842 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.042542227, 2024-03-04T09:26:19.842 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000019094 2024-03-04T09:26:19.842 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.842 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_handle_ack_lat": { 2024-03-04T09:26:19.842 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:19.842 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:19.843 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:19.843 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.843 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_encrypted_bytes": 0, 2024-03-04T09:26:19.843 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_encrypted_bytes": 0 2024-03-04T09:26:19.843 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.843 INFO:teuthology.orchestra.run.smithi190.stdout: "AsyncMessenger::Worker-1": { 2024-03-04T09:26:19.843 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_messages": 8, 2024-03-04T09:26:19.843 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_messages": 173, 2024-03-04T09:26:19.843 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_bytes": 3868, 2024-03-04T09:26:19.843 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_bytes": 445658, 2024-03-04T09:26:19.843 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_created_connections": 6, 2024-03-04T09:26:19.843 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_active_connections": 4, 2024-03-04T09:26:19.843 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_total_time": 0.008864962, 2024-03-04T09:26:19.843 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_send_time": 0.005145953, 2024-03-04T09:26:19.844 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_recv_time": 0.002152907, 2024-03-04T09:26:19.844 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_fast_dispatch_time": 0.000061467, 2024-03-04T09:26:19.844 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_messages_queue_lat": { 2024-03-04T09:26:19.844 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 171, 2024-03-04T09:26:19.844 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.011094188, 2024-03-04T09:26:19.844 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000064878 2024-03-04T09:26:19.844 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.844 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_handle_ack_lat": { 2024-03-04T09:26:19.844 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:19.844 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:19.844 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:19.844 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.844 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-03-04T09:26:19.844 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_encrypted_bytes": 444960 2024-03-04T09:26:19.845 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.845 INFO:teuthology.orchestra.run.smithi190.stdout: "AsyncMessenger::Worker-2": { 2024-03-04T09:26:19.845 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_messages": 285, 2024-03-04T09:26:19.845 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_messages": 244, 2024-03-04T09:26:19.845 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_bytes": 1663452, 2024-03-04T09:26:19.845 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_bytes": 137022, 2024-03-04T09:26:19.845 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_created_connections": 3, 2024-03-04T09:26:19.845 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_active_connections": 2, 2024-03-04T09:26:19.845 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_total_time": 0.038625722, 2024-03-04T09:26:19.845 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_send_time": 0.009864319, 2024-03-04T09:26:19.845 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_recv_time": 0.035859554, 2024-03-04T09:26:19.845 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_running_fast_dispatch_time": 0.004188822, 2024-03-04T09:26:19.845 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_messages_queue_lat": { 2024-03-04T09:26:19.845 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 243, 2024-03-04T09:26:19.846 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.007327831, 2024-03-04T09:26:19.846 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000030155 2024-03-04T09:26:19.846 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.846 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_handle_ack_lat": { 2024-03-04T09:26:19.846 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:19.846 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:19.846 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:19.846 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.846 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_recv_encrypted_bytes": 1663184, 2024-03-04T09:26:19.846 INFO:teuthology.orchestra.run.smithi190.stdout: "msgr_send_encrypted_bytes": 136704 2024-03-04T09:26:19.846 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.846 INFO:teuthology.orchestra.run.smithi190.stdout: "cct": { 2024-03-04T09:26:19.846 INFO:teuthology.orchestra.run.smithi190.stdout: "total_workers": 1, 2024-03-04T09:26:19.846 INFO:teuthology.orchestra.run.smithi190.stdout: "unhealthy_workers": 0 2024-03-04T09:26:19.847 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.847 INFO:teuthology.orchestra.run.smithi190.stdout: "finisher-MDSRank": { 2024-03-04T09:26:19.847 INFO:teuthology.orchestra.run.smithi190.stdout: "queue_len": 0, 2024-03-04T09:26:19.847 INFO:teuthology.orchestra.run.smithi190.stdout: "complete_latency": { 2024-03-04T09:26:19.847 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 3801, 2024-03-04T09:26:19.847 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.076392547, 2024-03-04T09:26:19.847 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000020098 2024-03-04T09:26:19.847 INFO:teuthology.orchestra.run.smithi190.stdout: } 2024-03-04T09:26:19.847 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.848 INFO:teuthology.orchestra.run.smithi190.stdout: "finisher-PurgeQueue": { 2024-03-04T09:26:19.848 INFO:teuthology.orchestra.run.smithi190.stdout: "queue_len": 0, 2024-03-04T09:26:19.848 INFO:teuthology.orchestra.run.smithi190.stdout: "complete_latency": { 2024-03-04T09:26:19.848 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:19.848 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:19.849 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:19.849 INFO:teuthology.orchestra.run.smithi190.stdout: } 2024-03-04T09:26:19.849 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.849 INFO:teuthology.orchestra.run.smithi190.stdout: "mds": { 2024-03-04T09:26:19.849 INFO:teuthology.orchestra.run.smithi190.stdout: "request": 0, 2024-03-04T09:26:19.849 INFO:teuthology.orchestra.run.smithi190.stdout: "reply": 0, 2024-03-04T09:26:19.849 INFO:teuthology.orchestra.run.smithi190.stdout: "reply_latency": { 2024-03-04T09:26:19.849 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:19.849 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:19.849 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:19.849 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.850 INFO:teuthology.orchestra.run.smithi190.stdout: "slow_reply": 0, 2024-03-04T09:26:19.850 INFO:teuthology.orchestra.run.smithi190.stdout: "forward": 0, 2024-03-04T09:26:19.850 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_fetch_complete": 0, 2024-03-04T09:26:19.850 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_fetch_keys": 0, 2024-03-04T09:26:19.850 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_commit": 0, 2024-03-04T09:26:19.850 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_split": 0, 2024-03-04T09:26:19.850 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_merge": 0, 2024-03-04T09:26:19.851 INFO:teuthology.orchestra.run.smithi190.stdout: "inodes": 368, 2024-03-04T09:26:19.851 INFO:teuthology.orchestra.run.smithi190.stdout: "inodes_top": 0, 2024-03-04T09:26:19.851 INFO:teuthology.orchestra.run.smithi190.stdout: "inodes_bottom": 368, 2024-03-04T09:26:19.851 INFO:teuthology.orchestra.run.smithi190.stdout: "inodes_pin_tail": 0, 2024-03-04T09:26:19.851 INFO:teuthology.orchestra.run.smithi190.stdout: "inodes_pinned": 368, 2024-03-04T09:26:19.851 INFO:teuthology.orchestra.run.smithi190.stdout: "inodes_expired": 0, 2024-03-04T09:26:19.851 INFO:teuthology.orchestra.run.smithi190.stdout: "inodes_with_caps": 0, 2024-03-04T09:26:19.851 INFO:teuthology.orchestra.run.smithi190.stdout: "caps": 0, 2024-03-04T09:26:19.851 INFO:teuthology.orchestra.run.smithi190.stdout: "subtrees": 1, 2024-03-04T09:26:19.851 INFO:teuthology.orchestra.run.smithi190.stdout: "traverse": 0, 2024-03-04T09:26:19.851 INFO:teuthology.orchestra.run.smithi190.stdout: "traverse_hit": 0, 2024-03-04T09:26:19.851 INFO:teuthology.orchestra.run.smithi190.stdout: "traverse_forward": 0, 2024-03-04T09:26:19.852 INFO:teuthology.orchestra.run.smithi190.stdout: "traverse_discover": 0, 2024-03-04T09:26:19.852 INFO:teuthology.orchestra.run.smithi190.stdout: "traverse_dir_fetch": 0, 2024-03-04T09:26:19.852 INFO:teuthology.orchestra.run.smithi190.stdout: "traverse_remote_ino": 0, 2024-03-04T09:26:19.852 INFO:teuthology.orchestra.run.smithi190.stdout: "traverse_lock": 0, 2024-03-04T09:26:19.852 INFO:teuthology.orchestra.run.smithi190.stdout: "load_cent": 0, 2024-03-04T09:26:19.852 INFO:teuthology.orchestra.run.smithi190.stdout: "q": 0, 2024-03-04T09:26:19.852 INFO:teuthology.orchestra.run.smithi190.stdout: "exported": 0, 2024-03-04T09:26:19.852 INFO:teuthology.orchestra.run.smithi190.stdout: "exported_inodes": 0, 2024-03-04T09:26:19.852 INFO:teuthology.orchestra.run.smithi190.stdout: "imported": 0, 2024-03-04T09:26:19.852 INFO:teuthology.orchestra.run.smithi190.stdout: "imported_inodes": 0, 2024-03-04T09:26:19.852 INFO:teuthology.orchestra.run.smithi190.stdout: "openino_dir_fetch": 0, 2024-03-04T09:26:19.852 INFO:teuthology.orchestra.run.smithi190.stdout: "openino_backtrace_fetch": 0, 2024-03-04T09:26:19.852 INFO:teuthology.orchestra.run.smithi190.stdout: "openino_peer_discover": 0, 2024-03-04T09:26:19.852 INFO:teuthology.orchestra.run.smithi190.stdout: "root_rfiles": 0, 2024-03-04T09:26:19.852 INFO:teuthology.orchestra.run.smithi190.stdout: "root_rbytes": 0, 2024-03-04T09:26:19.853 INFO:teuthology.orchestra.run.smithi190.stdout: "root_rsnaps": 0, 2024-03-04T09:26:19.853 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_backtrace_fetch": 0, 2024-03-04T09:26:19.853 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_set_tag": 0, 2024-03-04T09:26:19.853 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_backtrace_repaired": 0, 2024-03-04T09:26:19.853 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_inotable_repaired": 0, 2024-03-04T09:26:19.853 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_dir_inodes": 0, 2024-03-04T09:26:19.853 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_dir_base_inodes": 0, 2024-03-04T09:26:19.853 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_dirfrag_rstats": 0, 2024-03-04T09:26:19.853 INFO:teuthology.orchestra.run.smithi190.stdout: "scrub_file_inodes": 0, 2024-03-04T09:26:19.853 INFO:teuthology.orchestra.run.smithi190.stdout: "handle_inode_file_caps": 0, 2024-03-04T09:26:19.853 INFO:teuthology.orchestra.run.smithi190.stdout: "ceph_cap_op_revoke": 0, 2024-03-04T09:26:19.853 INFO:teuthology.orchestra.run.smithi190.stdout: "ceph_cap_op_grant": 0, 2024-03-04T09:26:19.853 INFO:teuthology.orchestra.run.smithi190.stdout: "ceph_cap_op_trunc": 0, 2024-03-04T09:26:19.854 INFO:teuthology.orchestra.run.smithi190.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-03-04T09:26:19.854 INFO:teuthology.orchestra.run.smithi190.stdout: "ceph_cap_op_flush_ack": 0, 2024-03-04T09:26:19.854 INFO:teuthology.orchestra.run.smithi190.stdout: "handle_client_caps": 0, 2024-03-04T09:26:19.854 INFO:teuthology.orchestra.run.smithi190.stdout: "handle_client_caps_dirty": 0, 2024-03-04T09:26:19.854 INFO:teuthology.orchestra.run.smithi190.stdout: "handle_client_cap_release": 0, 2024-03-04T09:26:19.854 INFO:teuthology.orchestra.run.smithi190.stdout: "process_request_cap_release": 0 2024-03-04T09:26:19.854 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.854 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_cache": { 2024-03-04T09:26:19.854 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_update": 0, 2024-03-04T09:26:19.854 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_update_receipt": 0, 2024-03-04T09:26:19.855 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_try_discover": 0, 2024-03-04T09:26:19.855 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_send_discover": 0, 2024-03-04T09:26:19.855 INFO:teuthology.orchestra.run.smithi190.stdout: "dir_handle_discover": 0, 2024-03-04T09:26:19.855 INFO:teuthology.orchestra.run.smithi190.stdout: "num_strays": 0, 2024-03-04T09:26:19.855 INFO:teuthology.orchestra.run.smithi190.stdout: "num_strays_delayed": 0, 2024-03-04T09:26:19.855 INFO:teuthology.orchestra.run.smithi190.stdout: "num_strays_enqueuing": 0, 2024-03-04T09:26:19.855 INFO:teuthology.orchestra.run.smithi190.stdout: "strays_created": 0, 2024-03-04T09:26:19.855 INFO:teuthology.orchestra.run.smithi190.stdout: "strays_enqueued": 0, 2024-03-04T09:26:19.855 INFO:teuthology.orchestra.run.smithi190.stdout: "strays_reintegrated": 0, 2024-03-04T09:26:19.855 INFO:teuthology.orchestra.run.smithi190.stdout: "strays_migrated": 0, 2024-03-04T09:26:19.856 INFO:teuthology.orchestra.run.smithi190.stdout: "num_recovering_processing": 0, 2024-03-04T09:26:19.856 INFO:teuthology.orchestra.run.smithi190.stdout: "num_recovering_enqueued": 0, 2024-03-04T09:26:19.856 INFO:teuthology.orchestra.run.smithi190.stdout: "num_recovering_prioritized": 0, 2024-03-04T09:26:19.856 INFO:teuthology.orchestra.run.smithi190.stdout: "recovery_started": 0, 2024-03-04T09:26:19.856 INFO:teuthology.orchestra.run.smithi190.stdout: "recovery_completed": 0, 2024-03-04T09:26:19.856 INFO:teuthology.orchestra.run.smithi190.stdout: "ireq_enqueue_scrub": 0, 2024-03-04T09:26:19.856 INFO:teuthology.orchestra.run.smithi190.stdout: "ireq_exportdir": 0, 2024-03-04T09:26:19.856 INFO:teuthology.orchestra.run.smithi190.stdout: "ireq_flush": 0, 2024-03-04T09:26:19.856 INFO:teuthology.orchestra.run.smithi190.stdout: "ireq_fragmentdir": 0, 2024-03-04T09:26:19.856 INFO:teuthology.orchestra.run.smithi190.stdout: "ireq_fragstats": 0, 2024-03-04T09:26:19.856 INFO:teuthology.orchestra.run.smithi190.stdout: "ireq_inodestats": 0 2024-03-04T09:26:19.856 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.856 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_log": { 2024-03-04T09:26:19.857 INFO:teuthology.orchestra.run.smithi190.stdout: "evlrg": 0, 2024-03-04T09:26:19.857 INFO:teuthology.orchestra.run.smithi190.stdout: "evadd": 0, 2024-03-04T09:26:19.857 INFO:teuthology.orchestra.run.smithi190.stdout: "evex": 0, 2024-03-04T09:26:19.857 INFO:teuthology.orchestra.run.smithi190.stdout: "evtrm": 0, 2024-03-04T09:26:19.857 INFO:teuthology.orchestra.run.smithi190.stdout: "ev": 1386, 2024-03-04T09:26:19.857 INFO:teuthology.orchestra.run.smithi190.stdout: "evexg": 0, 2024-03-04T09:26:19.857 INFO:teuthology.orchestra.run.smithi190.stdout: "evexd": 0, 2024-03-04T09:26:19.857 INFO:teuthology.orchestra.run.smithi190.stdout: "segadd": 0, 2024-03-04T09:26:19.857 INFO:teuthology.orchestra.run.smithi190.stdout: "segex": 0, 2024-03-04T09:26:19.857 INFO:teuthology.orchestra.run.smithi190.stdout: "segtrm": 0, 2024-03-04T09:26:19.858 INFO:teuthology.orchestra.run.smithi190.stdout: "seg": 3, 2024-03-04T09:26:19.859 INFO:teuthology.orchestra.run.smithi190.stdout: "segmjr": 2, 2024-03-04T09:26:19.859 INFO:teuthology.orchestra.run.smithi190.stdout: "segexg": 0, 2024-03-04T09:26:19.859 INFO:teuthology.orchestra.run.smithi190.stdout: "segexd": 0, 2024-03-04T09:26:19.859 INFO:teuthology.orchestra.run.smithi190.stdout: "expos": 4194304, 2024-03-04T09:26:19.859 INFO:teuthology.orchestra.run.smithi190.stdout: "wrpos": 7062568, 2024-03-04T09:26:19.859 INFO:teuthology.orchestra.run.smithi190.stdout: "rdpos": 7059868, 2024-03-04T09:26:19.859 INFO:teuthology.orchestra.run.smithi190.stdout: "jlat": { 2024-03-04T09:26:19.859 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:19.859 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:19.859 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:19.859 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.859 INFO:teuthology.orchestra.run.smithi190.stdout: "replayed": 1386 2024-03-04T09:26:19.859 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.859 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_mem": { 2024-03-04T09:26:19.859 INFO:teuthology.orchestra.run.smithi190.stdout: "ino": 8, 2024-03-04T09:26:19.860 INFO:teuthology.orchestra.run.smithi190.stdout: "ino+": 478, 2024-03-04T09:26:19.860 INFO:teuthology.orchestra.run.smithi190.stdout: "ino-": 470, 2024-03-04T09:26:19.860 INFO:teuthology.orchestra.run.smithi190.stdout: "dir": 4, 2024-03-04T09:26:19.860 INFO:teuthology.orchestra.run.smithi190.stdout: "dir+": 112, 2024-03-04T09:26:19.860 INFO:teuthology.orchestra.run.smithi190.stdout: "dir-": 108, 2024-03-04T09:26:19.860 INFO:teuthology.orchestra.run.smithi190.stdout: "dn": 368, 2024-03-04T09:26:19.860 INFO:teuthology.orchestra.run.smithi190.stdout: "dn+": 798, 2024-03-04T09:26:19.860 INFO:teuthology.orchestra.run.smithi190.stdout: "dn-": 430, 2024-03-04T09:26:19.860 INFO:teuthology.orchestra.run.smithi190.stdout: "cap": 0, 2024-03-04T09:26:19.860 INFO:teuthology.orchestra.run.smithi190.stdout: "cap+": 0, 2024-03-04T09:26:19.860 INFO:teuthology.orchestra.run.smithi190.stdout: "cap-": 0, 2024-03-04T09:26:19.860 INFO:teuthology.orchestra.run.smithi190.stdout: "rss": 55292, 2024-03-04T09:26:19.860 INFO:teuthology.orchestra.run.smithi190.stdout: "heap": 215420 2024-03-04T09:26:19.860 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.861 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_server": { 2024-03-04T09:26:19.861 INFO:teuthology.orchestra.run.smithi190.stdout: "dispatch_client_request": 0, 2024-03-04T09:26:19.861 INFO:teuthology.orchestra.run.smithi190.stdout: "dispatch_server_request": 0, 2024-03-04T09:26:19.861 INFO:teuthology.orchestra.run.smithi190.stdout: "handle_client_request": 0, 2024-03-04T09:26:19.861 INFO:teuthology.orchestra.run.smithi190.stdout: "handle_client_session": 0, 2024-03-04T09:26:19.861 INFO:teuthology.orchestra.run.smithi190.stdout: "handle_peer_request": 0, 2024-03-04T09:26:19.861 INFO:teuthology.orchestra.run.smithi190.stdout: "req_create_latency": { 2024-03-04T09:26:19.861 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:19.861 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:19.861 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:19.861 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.861 INFO:teuthology.orchestra.run.smithi190.stdout: "req_getattr_latency": { 2024-03-04T09:26:19.861 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:19.861 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:19.861 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:19.862 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.862 INFO:teuthology.orchestra.run.smithi190.stdout: "req_getfilelock_latency": { 2024-03-04T09:26:19.862 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:19.862 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:19.862 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:19.862 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.862 INFO:teuthology.orchestra.run.smithi190.stdout: "req_link_latency": { 2024-03-04T09:26:19.862 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:19.862 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:19.862 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:19.862 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.862 INFO:teuthology.orchestra.run.smithi190.stdout: "req_lookup_latency": { 2024-03-04T09:26:19.862 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:19.862 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:19.862 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:19.863 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.863 INFO:teuthology.orchestra.run.smithi190.stdout: "req_lookuphash_latency": { 2024-03-04T09:26:19.863 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:19.863 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:19.863 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:19.863 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.863 INFO:teuthology.orchestra.run.smithi190.stdout: "req_lookupino_latency": { 2024-03-04T09:26:19.863 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:19.863 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:19.863 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:19.863 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.863 INFO:teuthology.orchestra.run.smithi190.stdout: "req_lookupname_latency": { 2024-03-04T09:26:19.863 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:19.863 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:19.863 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:19.864 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.864 INFO:teuthology.orchestra.run.smithi190.stdout: "req_lookupparent_latency": { 2024-03-04T09:26:19.864 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:19.864 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:19.864 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:19.864 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.864 INFO:teuthology.orchestra.run.smithi190.stdout: "req_lookupsnap_latency": { 2024-03-04T09:26:19.864 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:19.864 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:19.864 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:19.864 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.864 INFO:teuthology.orchestra.run.smithi190.stdout: "req_lssnap_latency": { 2024-03-04T09:26:19.864 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:19.864 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:19.865 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:19.865 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.865 INFO:teuthology.orchestra.run.smithi190.stdout: "req_mkdir_latency": { 2024-03-04T09:26:19.865 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:19.865 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:19.865 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:19.866 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.866 INFO:teuthology.orchestra.run.smithi190.stdout: "req_mknod_latency": { 2024-03-04T09:26:19.866 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:19.866 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:19.866 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:19.866 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.866 INFO:teuthology.orchestra.run.smithi190.stdout: "req_mksnap_latency": { 2024-03-04T09:26:19.866 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:19.866 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:19.866 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:19.866 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.866 INFO:teuthology.orchestra.run.smithi190.stdout: "req_open_latency": { 2024-03-04T09:26:19.866 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:19.866 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:19.866 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:19.867 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.867 INFO:teuthology.orchestra.run.smithi190.stdout: "req_readdir_latency": { 2024-03-04T09:26:19.867 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:19.867 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:19.867 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:19.867 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.867 INFO:teuthology.orchestra.run.smithi190.stdout: "req_rename_latency": { 2024-03-04T09:26:19.867 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:19.867 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:19.867 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:19.867 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.867 INFO:teuthology.orchestra.run.smithi190.stdout: "req_renamesnap_latency": { 2024-03-04T09:26:19.867 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:19.867 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:19.868 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:19.868 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.868 INFO:teuthology.orchestra.run.smithi190.stdout: "req_snapdiff_latency": { 2024-03-04T09:26:19.868 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:19.868 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:19.868 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:19.868 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.868 INFO:teuthology.orchestra.run.smithi190.stdout: "req_rmdir_latency": { 2024-03-04T09:26:19.868 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:19.868 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:19.868 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:19.868 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.868 INFO:teuthology.orchestra.run.smithi190.stdout: "req_rmsnap_latency": { 2024-03-04T09:26:19.868 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:19.869 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:19.869 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:19.869 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.869 INFO:teuthology.orchestra.run.smithi190.stdout: "req_rmxattr_latency": { 2024-03-04T09:26:19.869 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:19.869 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:19.869 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:19.869 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.869 INFO:teuthology.orchestra.run.smithi190.stdout: "req_setattr_latency": { 2024-03-04T09:26:19.869 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:19.869 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:19.869 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:19.869 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.869 INFO:teuthology.orchestra.run.smithi190.stdout: "req_setdirlayout_latency": { 2024-03-04T09:26:19.869 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:19.870 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:19.870 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:19.870 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.870 INFO:teuthology.orchestra.run.smithi190.stdout: "req_setfilelock_latency": { 2024-03-04T09:26:19.870 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:19.870 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:19.870 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:19.870 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.870 INFO:teuthology.orchestra.run.smithi190.stdout: "req_setlayout_latency": { 2024-03-04T09:26:19.870 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:19.870 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:19.870 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:19.870 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.870 INFO:teuthology.orchestra.run.smithi190.stdout: "req_setxattr_latency": { 2024-03-04T09:26:19.870 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:19.871 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:19.871 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:19.871 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.871 INFO:teuthology.orchestra.run.smithi190.stdout: "req_symlink_latency": { 2024-03-04T09:26:19.871 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:19.871 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:19.871 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:19.871 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.871 INFO:teuthology.orchestra.run.smithi190.stdout: "req_unlink_latency": { 2024-03-04T09:26:19.871 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:19.871 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:19.871 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:19.871 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.871 INFO:teuthology.orchestra.run.smithi190.stdout: "cap_revoke_eviction": 0, 2024-03-04T09:26:19.872 INFO:teuthology.orchestra.run.smithi190.stdout: "cap_acquisition_throttle": 0, 2024-03-04T09:26:19.872 INFO:teuthology.orchestra.run.smithi190.stdout: "req_getvxattr_latency": { 2024-03-04T09:26:19.872 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:19.872 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:19.872 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:19.872 INFO:teuthology.orchestra.run.smithi190.stdout: } 2024-03-04T09:26:19.872 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.872 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_sessions": { 2024-03-04T09:26:19.872 INFO:teuthology.orchestra.run.smithi190.stdout: "session_count": 2, 2024-03-04T09:26:19.872 INFO:teuthology.orchestra.run.smithi190.stdout: "session_add": 3, 2024-03-04T09:26:19.872 INFO:teuthology.orchestra.run.smithi190.stdout: "session_remove": 1, 2024-03-04T09:26:19.872 INFO:teuthology.orchestra.run.smithi190.stdout: "sessions_open": 3, 2024-03-04T09:26:19.872 INFO:teuthology.orchestra.run.smithi190.stdout: "sessions_stale": 0, 2024-03-04T09:26:19.872 INFO:teuthology.orchestra.run.smithi190.stdout: "total_load": 0, 2024-03-04T09:26:19.873 INFO:teuthology.orchestra.run.smithi190.stdout: "average_load": 0, 2024-03-04T09:26:19.873 INFO:teuthology.orchestra.run.smithi190.stdout: "avg_session_uptime": 2399, 2024-03-04T09:26:19.873 INFO:teuthology.orchestra.run.smithi190.stdout: "mdthresh_evicted": 0 2024-03-04T09:26:19.873 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.873 INFO:teuthology.orchestra.run.smithi190.stdout: "mempool": { 2024-03-04T09:26:19.873 INFO:teuthology.orchestra.run.smithi190.stdout: "bloom_filter_bytes": 0, 2024-03-04T09:26:19.873 INFO:teuthology.orchestra.run.smithi190.stdout: "bloom_filter_items": 0, 2024-03-04T09:26:19.873 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_alloc_bytes": 0, 2024-03-04T09:26:19.873 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_alloc_items": 0, 2024-03-04T09:26:19.873 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_data_bytes": 0, 2024-03-04T09:26:19.873 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_data_items": 0, 2024-03-04T09:26:19.873 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-04T09:26:19.873 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_onode_items": 0, 2024-03-04T09:26:19.873 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-04T09:26:19.873 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_meta_items": 0, 2024-03-04T09:26:19.874 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_other_bytes": 0, 2024-03-04T09:26:19.874 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_other_items": 0, 2024-03-04T09:26:19.874 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-04T09:26:19.874 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_cache_buffer_items": 0, 2024-03-04T09:26:19.874 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_extent_bytes": 0, 2024-03-04T09:26:19.874 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_extent_items": 0, 2024-03-04T09:26:19.874 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_blob_bytes": 0, 2024-03-04T09:26:19.874 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_blob_items": 0, 2024-03-04T09:26:19.874 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-04T09:26:19.874 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_shared_blob_items": 0, 2024-03-04T09:26:19.874 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-04T09:26:19.874 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_inline_bl_items": 0, 2024-03-04T09:26:19.874 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_fsck_bytes": 0, 2024-03-04T09:26:19.874 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_fsck_items": 0, 2024-03-04T09:26:19.874 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_txc_bytes": 0, 2024-03-04T09:26:19.875 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_txc_items": 0, 2024-03-04T09:26:19.875 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-04T09:26:19.875 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_writing_deferred_items": 0, 2024-03-04T09:26:19.875 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_writing_bytes": 0, 2024-03-04T09:26:19.875 INFO:teuthology.orchestra.run.smithi190.stdout: "bluestore_writing_items": 0, 2024-03-04T09:26:19.875 INFO:teuthology.orchestra.run.smithi190.stdout: "bluefs_bytes": 0, 2024-03-04T09:26:19.875 INFO:teuthology.orchestra.run.smithi190.stdout: "bluefs_items": 0, 2024-03-04T09:26:19.875 INFO:teuthology.orchestra.run.smithi190.stdout: "bluefs_file_reader_bytes": 0, 2024-03-04T09:26:19.875 INFO:teuthology.orchestra.run.smithi190.stdout: "bluefs_file_reader_items": 0, 2024-03-04T09:26:19.875 INFO:teuthology.orchestra.run.smithi190.stdout: "bluefs_file_writer_bytes": 0, 2024-03-04T09:26:19.875 INFO:teuthology.orchestra.run.smithi190.stdout: "bluefs_file_writer_items": 0, 2024-03-04T09:26:19.875 INFO:teuthology.orchestra.run.smithi190.stdout: "buffer_anon_bytes": 182098, 2024-03-04T09:26:19.875 INFO:teuthology.orchestra.run.smithi190.stdout: "buffer_anon_items": 49, 2024-03-04T09:26:19.875 INFO:teuthology.orchestra.run.smithi190.stdout: "buffer_meta_bytes": 0, 2024-03-04T09:26:19.875 INFO:teuthology.orchestra.run.smithi190.stdout: "buffer_meta_items": 0, 2024-03-04T09:26:19.876 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_bytes": 0, 2024-03-04T09:26:19.876 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_items": 0, 2024-03-04T09:26:19.876 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_mapbl_bytes": 0, 2024-03-04T09:26:19.876 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_mapbl_items": 0, 2024-03-04T09:26:19.876 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_pglog_bytes": 0, 2024-03-04T09:26:19.876 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_pglog_items": 0, 2024-03-04T09:26:19.876 INFO:teuthology.orchestra.run.smithi190.stdout: "osdmap_bytes": 9832, 2024-03-04T09:26:19.876 INFO:teuthology.orchestra.run.smithi190.stdout: "osdmap_items": 205, 2024-03-04T09:26:19.876 INFO:teuthology.orchestra.run.smithi190.stdout: "osdmap_mapping_bytes": 0, 2024-03-04T09:26:19.876 INFO:teuthology.orchestra.run.smithi190.stdout: "osdmap_mapping_items": 0, 2024-03-04T09:26:19.876 INFO:teuthology.orchestra.run.smithi190.stdout: "pgmap_bytes": 0, 2024-03-04T09:26:19.876 INFO:teuthology.orchestra.run.smithi190.stdout: "pgmap_items": 0, 2024-03-04T09:26:19.876 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_co_bytes": 286821, 2024-03-04T09:26:19.876 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_co_items": 1689, 2024-03-04T09:26:19.876 INFO:teuthology.orchestra.run.smithi190.stdout: "unittest_1_bytes": 0, 2024-03-04T09:26:19.877 INFO:teuthology.orchestra.run.smithi190.stdout: "unittest_1_items": 0, 2024-03-04T09:26:19.877 INFO:teuthology.orchestra.run.smithi190.stdout: "unittest_2_bytes": 0, 2024-03-04T09:26:19.877 INFO:teuthology.orchestra.run.smithi190.stdout: "unittest_2_items": 0 2024-03-04T09:26:19.877 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.877 INFO:teuthology.orchestra.run.smithi190.stdout: "objecter": { 2024-03-04T09:26:19.877 INFO:teuthology.orchestra.run.smithi190.stdout: "op_active": 0, 2024-03-04T09:26:19.877 INFO:teuthology.orchestra.run.smithi190.stdout: "op_laggy": 0, 2024-03-04T09:26:19.877 INFO:teuthology.orchestra.run.smithi190.stdout: "op_send": 2231, 2024-03-04T09:26:19.877 INFO:teuthology.orchestra.run.smithi190.stdout: "op_send_bytes": 21, 2024-03-04T09:26:19.877 INFO:teuthology.orchestra.run.smithi190.stdout: "op_resend": 3, 2024-03-04T09:26:19.877 INFO:teuthology.orchestra.run.smithi190.stdout: "op_reply": 2231, 2024-03-04T09:26:19.877 INFO:teuthology.orchestra.run.smithi190.stdout: "op_latency": { 2024-03-04T09:26:19.877 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 2231, 2024-03-04T09:26:19.877 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.995972069, 2024-03-04T09:26:19.877 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000446424 2024-03-04T09:26:19.878 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.878 INFO:teuthology.orchestra.run.smithi190.stdout: "op_inflight": 0, 2024-03-04T09:26:19.878 INFO:teuthology.orchestra.run.smithi190.stdout: "oplen_avg": { 2024-03-04T09:26:19.878 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 2231, 2024-03-04T09:26:19.878 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 2232 2024-03-04T09:26:19.878 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.878 INFO:teuthology.orchestra.run.smithi190.stdout: "op": 2231, 2024-03-04T09:26:19.878 INFO:teuthology.orchestra.run.smithi190.stdout: "op_r": 2231, 2024-03-04T09:26:19.878 INFO:teuthology.orchestra.run.smithi190.stdout: "op_w": 0, 2024-03-04T09:26:19.878 INFO:teuthology.orchestra.run.smithi190.stdout: "op_rmw": 0, 2024-03-04T09:26:19.878 INFO:teuthology.orchestra.run.smithi190.stdout: "op_pg": 0, 2024-03-04T09:26:19.878 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_stat": 1410, 2024-03-04T09:26:19.878 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_create": 0, 2024-03-04T09:26:19.878 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_read": 819, 2024-03-04T09:26:19.879 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_write": 0, 2024-03-04T09:26:19.879 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_writefull": 0, 2024-03-04T09:26:19.879 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_writesame": 0, 2024-03-04T09:26:19.879 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_append": 0, 2024-03-04T09:26:19.879 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_zero": 0, 2024-03-04T09:26:19.879 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_truncate": 0, 2024-03-04T09:26:19.879 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_delete": 0, 2024-03-04T09:26:19.879 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_mapext": 0, 2024-03-04T09:26:19.879 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_sparse_read": 0, 2024-03-04T09:26:19.879 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_clonerange": 0, 2024-03-04T09:26:19.879 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_getxattr": 1, 2024-03-04T09:26:19.879 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_setxattr": 0, 2024-03-04T09:26:19.879 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_cmpxattr": 0, 2024-03-04T09:26:19.879 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_rmxattr": 0, 2024-03-04T09:26:19.879 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_resetxattrs": 0, 2024-03-04T09:26:19.880 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_call": 0, 2024-03-04T09:26:19.880 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_watch": 0, 2024-03-04T09:26:19.880 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_notify": 0, 2024-03-04T09:26:19.880 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_src_cmpxattr": 0, 2024-03-04T09:26:19.880 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_pgls": 0, 2024-03-04T09:26:19.880 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_pgls_filter": 0, 2024-03-04T09:26:19.880 INFO:teuthology.orchestra.run.smithi190.stdout: "osdop_other": 0, 2024-03-04T09:26:19.880 INFO:teuthology.orchestra.run.smithi190.stdout: "linger_active": 0, 2024-03-04T09:26:19.880 INFO:teuthology.orchestra.run.smithi190.stdout: "linger_send": 0, 2024-03-04T09:26:19.880 INFO:teuthology.orchestra.run.smithi190.stdout: "linger_resend": 0, 2024-03-04T09:26:19.880 INFO:teuthology.orchestra.run.smithi190.stdout: "linger_ping": 0, 2024-03-04T09:26:19.880 INFO:teuthology.orchestra.run.smithi190.stdout: "poolop_active": 0, 2024-03-04T09:26:19.880 INFO:teuthology.orchestra.run.smithi190.stdout: "poolop_send": 0, 2024-03-04T09:26:19.880 INFO:teuthology.orchestra.run.smithi190.stdout: "poolop_resend": 0, 2024-03-04T09:26:19.881 INFO:teuthology.orchestra.run.smithi190.stdout: "poolstat_active": 0, 2024-03-04T09:26:19.881 INFO:teuthology.orchestra.run.smithi190.stdout: "poolstat_send": 0, 2024-03-04T09:26:19.881 INFO:teuthology.orchestra.run.smithi190.stdout: "poolstat_resend": 0, 2024-03-04T09:26:19.881 INFO:teuthology.orchestra.run.smithi190.stdout: "statfs_active": 0, 2024-03-04T09:26:19.881 INFO:teuthology.orchestra.run.smithi190.stdout: "statfs_send": 0, 2024-03-04T09:26:19.881 INFO:teuthology.orchestra.run.smithi190.stdout: "statfs_resend": 0, 2024-03-04T09:26:19.881 INFO:teuthology.orchestra.run.smithi190.stdout: "command_active": 0, 2024-03-04T09:26:19.881 INFO:teuthology.orchestra.run.smithi190.stdout: "command_send": 0, 2024-03-04T09:26:19.881 INFO:teuthology.orchestra.run.smithi190.stdout: "command_resend": 0, 2024-03-04T09:26:19.881 INFO:teuthology.orchestra.run.smithi190.stdout: "map_epoch": 106, 2024-03-04T09:26:19.881 INFO:teuthology.orchestra.run.smithi190.stdout: "map_full": 0, 2024-03-04T09:26:19.881 INFO:teuthology.orchestra.run.smithi190.stdout: "map_inc": 16, 2024-03-04T09:26:19.881 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_sessions": 4, 2024-03-04T09:26:19.881 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_session_open": 4, 2024-03-04T09:26:19.881 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_session_close": 0, 2024-03-04T09:26:19.882 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_laggy": 0, 2024-03-04T09:26:19.882 INFO:teuthology.orchestra.run.smithi190.stdout: "omap_wr": 0, 2024-03-04T09:26:19.882 INFO:teuthology.orchestra.run.smithi190.stdout: "omap_rd": 2, 2024-03-04T09:26:19.882 INFO:teuthology.orchestra.run.smithi190.stdout: "omap_del": 0 2024-03-04T09:26:19.882 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.882 INFO:teuthology.orchestra.run.smithi190.stdout: "oft": { 2024-03-04T09:26:19.882 INFO:teuthology.orchestra.run.smithi190.stdout: "omap_total_objs": 0, 2024-03-04T09:26:19.882 INFO:teuthology.orchestra.run.smithi190.stdout: "omap_total_kv_pairs": 0, 2024-03-04T09:26:19.882 INFO:teuthology.orchestra.run.smithi190.stdout: "omap_total_updates": 0, 2024-03-04T09:26:19.882 INFO:teuthology.orchestra.run.smithi190.stdout: "omap_total_removes": 0 2024-03-04T09:26:19.882 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.882 INFO:teuthology.orchestra.run.smithi190.stdout: "osd-slow-ops": { 2024-03-04T09:26:19.882 INFO:teuthology.orchestra.run.smithi190.stdout: "slow_ops_count": 0 2024-03-04T09:26:19.882 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.882 INFO:teuthology.orchestra.run.smithi190.stdout: "purge_queue": { 2024-03-04T09:26:19.883 INFO:teuthology.orchestra.run.smithi190.stdout: "pq_executing_ops": 0, 2024-03-04T09:26:19.883 INFO:teuthology.orchestra.run.smithi190.stdout: "pq_executing_ops_high_water": 0, 2024-03-04T09:26:19.883 INFO:teuthology.orchestra.run.smithi190.stdout: "pq_executing": 0, 2024-03-04T09:26:19.883 INFO:teuthology.orchestra.run.smithi190.stdout: "pq_executing_high_water": 0, 2024-03-04T09:26:19.883 INFO:teuthology.orchestra.run.smithi190.stdout: "pq_executed_ops": 0, 2024-03-04T09:26:19.883 INFO:teuthology.orchestra.run.smithi190.stdout: "pq_executed": 0, 2024-03-04T09:26:19.883 INFO:teuthology.orchestra.run.smithi190.stdout: "pq_item_in_journal": 0 2024-03-04T09:26:19.883 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.883 INFO:teuthology.orchestra.run.smithi190.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-04T09:26:19.883 INFO:teuthology.orchestra.run.smithi190.stdout: "val": 0, 2024-03-04T09:26:19.883 INFO:teuthology.orchestra.run.smithi190.stdout: "max": 104857600, 2024-03-04T09:26:19.883 INFO:teuthology.orchestra.run.smithi190.stdout: "get_started": 0, 2024-03-04T09:26:19.883 INFO:teuthology.orchestra.run.smithi190.stdout: "get": 2517, 2024-03-04T09:26:19.883 INFO:teuthology.orchestra.run.smithi190.stdout: "get_sum": 4921036, 2024-03-04T09:26:19.883 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_fail": 0, 2024-03-04T09:26:19.884 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_success": 2517, 2024-03-04T09:26:19.884 INFO:teuthology.orchestra.run.smithi190.stdout: "take": 0, 2024-03-04T09:26:19.884 INFO:teuthology.orchestra.run.smithi190.stdout: "take_sum": 0, 2024-03-04T09:26:19.884 INFO:teuthology.orchestra.run.smithi190.stdout: "put": 2517, 2024-03-04T09:26:19.884 INFO:teuthology.orchestra.run.smithi190.stdout: "put_sum": 4921036, 2024-03-04T09:26:19.884 INFO:teuthology.orchestra.run.smithi190.stdout: "wait": { 2024-03-04T09:26:19.884 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:19.884 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:19.884 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:19.884 INFO:teuthology.orchestra.run.smithi190.stdout: } 2024-03-04T09:26:19.884 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.884 INFO:teuthology.orchestra.run.smithi190.stdout: "throttle-objecter_bytes": { 2024-03-04T09:26:19.884 INFO:teuthology.orchestra.run.smithi190.stdout: "val": 0, 2024-03-04T09:26:19.884 INFO:teuthology.orchestra.run.smithi190.stdout: "max": 104857600, 2024-03-04T09:26:19.885 INFO:teuthology.orchestra.run.smithi190.stdout: "get_started": 0, 2024-03-04T09:26:19.885 INFO:teuthology.orchestra.run.smithi190.stdout: "get": 0, 2024-03-04T09:26:19.885 INFO:teuthology.orchestra.run.smithi190.stdout: "get_sum": 0, 2024-03-04T09:26:19.885 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_fail": 0, 2024-03-04T09:26:19.885 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_success": 0, 2024-03-04T09:26:19.885 INFO:teuthology.orchestra.run.smithi190.stdout: "take": 2231, 2024-03-04T09:26:19.885 INFO:teuthology.orchestra.run.smithi190.stdout: "take_sum": 2868269, 2024-03-04T09:26:19.885 INFO:teuthology.orchestra.run.smithi190.stdout: "put": 2231, 2024-03-04T09:26:19.885 INFO:teuthology.orchestra.run.smithi190.stdout: "put_sum": 2868269, 2024-03-04T09:26:19.885 INFO:teuthology.orchestra.run.smithi190.stdout: "wait": { 2024-03-04T09:26:19.885 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:19.885 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:19.885 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:19.885 INFO:teuthology.orchestra.run.smithi190.stdout: } 2024-03-04T09:26:19.886 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.886 INFO:teuthology.orchestra.run.smithi190.stdout: "throttle-objecter_ops": { 2024-03-04T09:26:19.886 INFO:teuthology.orchestra.run.smithi190.stdout: "val": 0, 2024-03-04T09:26:19.886 INFO:teuthology.orchestra.run.smithi190.stdout: "max": 1024, 2024-03-04T09:26:19.886 INFO:teuthology.orchestra.run.smithi190.stdout: "get_started": 0, 2024-03-04T09:26:19.886 INFO:teuthology.orchestra.run.smithi190.stdout: "get": 0, 2024-03-04T09:26:19.886 INFO:teuthology.orchestra.run.smithi190.stdout: "get_sum": 0, 2024-03-04T09:26:19.886 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_fail": 0, 2024-03-04T09:26:19.886 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_success": 0, 2024-03-04T09:26:19.886 INFO:teuthology.orchestra.run.smithi190.stdout: "take": 2231, 2024-03-04T09:26:19.886 INFO:teuthology.orchestra.run.smithi190.stdout: "take_sum": 2231, 2024-03-04T09:26:19.886 INFO:teuthology.orchestra.run.smithi190.stdout: "put": 2231, 2024-03-04T09:26:19.886 INFO:teuthology.orchestra.run.smithi190.stdout: "put_sum": 2231, 2024-03-04T09:26:19.886 INFO:teuthology.orchestra.run.smithi190.stdout: "wait": { 2024-03-04T09:26:19.887 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:19.887 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:19.887 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:19.887 INFO:teuthology.orchestra.run.smithi190.stdout: } 2024-03-04T09:26:19.887 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.887 INFO:teuthology.orchestra.run.smithi190.stdout: "throttle-write_buf_throttle": { 2024-03-04T09:26:19.887 INFO:teuthology.orchestra.run.smithi190.stdout: "val": 0, 2024-03-04T09:26:19.887 INFO:teuthology.orchestra.run.smithi190.stdout: "max": 3758096384, 2024-03-04T09:26:19.887 INFO:teuthology.orchestra.run.smithi190.stdout: "get_started": 0, 2024-03-04T09:26:19.887 INFO:teuthology.orchestra.run.smithi190.stdout: "get": 0, 2024-03-04T09:26:19.887 INFO:teuthology.orchestra.run.smithi190.stdout: "get_sum": 0, 2024-03-04T09:26:19.887 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_fail": 0, 2024-03-04T09:26:19.887 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_success": 0, 2024-03-04T09:26:19.887 INFO:teuthology.orchestra.run.smithi190.stdout: "take": 0, 2024-03-04T09:26:19.887 INFO:teuthology.orchestra.run.smithi190.stdout: "take_sum": 0, 2024-03-04T09:26:19.888 INFO:teuthology.orchestra.run.smithi190.stdout: "put": 0, 2024-03-04T09:26:19.888 INFO:teuthology.orchestra.run.smithi190.stdout: "put_sum": 0, 2024-03-04T09:26:19.888 INFO:teuthology.orchestra.run.smithi190.stdout: "wait": { 2024-03-04T09:26:19.888 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:19.888 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:19.888 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:19.888 INFO:teuthology.orchestra.run.smithi190.stdout: } 2024-03-04T09:26:19.888 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-03-04T09:26:19.888 INFO:teuthology.orchestra.run.smithi190.stdout: "throttle-write_buf_throttle-0x559d7a59a960": { 2024-03-04T09:26:19.888 INFO:teuthology.orchestra.run.smithi190.stdout: "val": 0, 2024-03-04T09:26:19.888 INFO:teuthology.orchestra.run.smithi190.stdout: "max": 3758096384, 2024-03-04T09:26:19.888 INFO:teuthology.orchestra.run.smithi190.stdout: "get_started": 0, 2024-03-04T09:26:19.888 INFO:teuthology.orchestra.run.smithi190.stdout: "get": 0, 2024-03-04T09:26:19.888 INFO:teuthology.orchestra.run.smithi190.stdout: "get_sum": 0, 2024-03-04T09:26:19.888 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_fail": 0, 2024-03-04T09:26:19.889 INFO:teuthology.orchestra.run.smithi190.stdout: "get_or_fail_success": 0, 2024-03-04T09:26:19.889 INFO:teuthology.orchestra.run.smithi190.stdout: "take": 0, 2024-03-04T09:26:19.889 INFO:teuthology.orchestra.run.smithi190.stdout: "take_sum": 0, 2024-03-04T09:26:19.889 INFO:teuthology.orchestra.run.smithi190.stdout: "put": 0, 2024-03-04T09:26:19.889 INFO:teuthology.orchestra.run.smithi190.stdout: "put_sum": 0, 2024-03-04T09:26:19.889 INFO:teuthology.orchestra.run.smithi190.stdout: "wait": { 2024-03-04T09:26:19.889 INFO:teuthology.orchestra.run.smithi190.stdout: "avgcount": 0, 2024-03-04T09:26:19.889 INFO:teuthology.orchestra.run.smithi190.stdout: "sum": 0.000000000, 2024-03-04T09:26:19.889 INFO:teuthology.orchestra.run.smithi190.stdout: "avgtime": 0.000000000 2024-03-04T09:26:19.889 INFO:teuthology.orchestra.run.smithi190.stdout: } 2024-03-04T09:26:19.889 INFO:teuthology.orchestra.run.smithi190.stdout: } 2024-03-04T09:26:19.889 INFO:teuthology.orchestra.run.smithi190.stdout:} 2024-03-04T09:26:20.451 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:20 smithi190 ceph-mon[36341]: pgmap v334: 129 pgs: 129 active+clean; 117 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2024-03-04T09:26:20.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:20 smithi082 ceph-mon[32880]: pgmap v334: 129 pgs: 129 active+clean; 117 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2024-03-04T09:26:20.637 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-03-04T09:26:20.637 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-03-04T09:26:20.637 INFO:tasks.check_counter:Daemon mds.l mds.root_rsnaps=0 2024-03-04T09:26:20.637 INFO:tasks.check_counter:Daemon mds.l mds_server.req_mksnap_latency.avgcount=0 2024-03-04T09:26:20.637 INFO:tasks.check_counter:Daemon mds.l mds_server.req_rmsnap_latency.avgcount=0 2024-03-04T09:26:20.637 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-03-04T09:26:20.650 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-03-04T09:26:20.650 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-03-04T09:26:20.650 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-04T09:26:20.671 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-03-04T09:26:20.671 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-04T09:26:20.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:20 smithi102 ceph-mon[36220]: pgmap v334: 129 pgs: 129 active+clean; 117 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 6 op/s 2024-03-04T09:26:20.730 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T09:26:20.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:20.887+0000 7f6f95fb6640 1 -- 172.21.15.82:0/2128187310 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f90100e90 msgr2=0x7f6f9010d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:20.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:20.887+0000 7f6f95fb6640 1 --2- 172.21.15.82:0/2128187310 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f90100e90 0x7f6f9010d370 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6f88009930 tx=0x7f6f8802bc30 comp rx=0 tx=0).stop 2024-03-04T09:26:20.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:20.887+0000 7f6f95fb6640 1 -- 172.21.15.82:0/2128187310 shutdown_connections 2024-03-04T09:26:20.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:20.887+0000 7f6f95fb6640 1 --2- 172.21.15.82:0/2128187310 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f90100e90 0x7f6f9010d370 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:20.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:20.887+0000 7f6f95fb6640 1 --2- 172.21.15.82:0/2128187310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f901004d0 0x7f6f90100950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:20.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:20.887+0000 7f6f95fb6640 1 --2- 172.21.15.82:0/2128187310 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f90106660 0x7f6f90106a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:20.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:20.887+0000 7f6f95fb6640 1 -- 172.21.15.82:0/2128187310 >> 172.21.15.82:0/2128187310 conn(0x7f6f900775d0 msgr2=0x7f6f900779e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:26:20.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:20.887+0000 7f6f95fb6640 1 -- 172.21.15.82:0/2128187310 shutdown_connections 2024-03-04T09:26:20.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:20.887+0000 7f6f95fb6640 1 -- 172.21.15.82:0/2128187310 wait complete. 2024-03-04T09:26:20.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:20.888+0000 7f6f95fb6640 1 Processor -- start 2024-03-04T09:26:20.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:20.888+0000 7f6f95fb6640 1 -- start start 2024-03-04T09:26:20.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:20.888+0000 7f6f95fb6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f901004d0 0x7f6f9019ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:20.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:20.888+0000 7f6f95fb6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f90100e90 0x7f6f9019cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:20.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:20.888+0000 7f6f95fb6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f90106660 0x7f6f90196b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:20.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:20.888+0000 7f6f95fb6640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f90110880 con 0x7f6f90100e90 2024-03-04T09:26:20.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:20.888+0000 7f6f95fb6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f90110700 con 0x7f6f90106660 2024-03-04T09:26:20.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:20.888+0000 7f6f95fb6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f90110a00 con 0x7f6f901004d0 2024-03-04T09:26:20.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:20.888+0000 7f6f8effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f90100e90 0x7f6f9019cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:20.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:20.888+0000 7f6f8f7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f901004d0 0x7f6f9019ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:20.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:20.888+0000 7f6f8f7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f901004d0 0x7f6f9019ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.82:51834/0 (socket says 172.21.15.82:51834) 2024-03-04T09:26:20.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:20.888+0000 7f6f8effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f90100e90 0x7f6f9019cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35302/0 (socket says 172.21.15.82:35302) 2024-03-04T09:26:20.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:20.888+0000 7f6f8f7fe640 1 -- 172.21.15.82:0/1711791641 learned_addr learned my addr 172.21.15.82:0/1711791641 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:26:20.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:20.888+0000 7f6f8ffff640 1 --2- 172.21.15.82:0/1711791641 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f90106660 0x7f6f90196b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:20.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:20.888+0000 7f6f8effd640 1 -- 172.21.15.82:0/1711791641 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f901004d0 msgr2=0x7f6f9019ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:20.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:20.888+0000 7f6f8effd640 1 --2- 172.21.15.82:0/1711791641 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f901004d0 0x7f6f9019ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:20.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:20.888+0000 7f6f8effd640 1 -- 172.21.15.82:0/1711791641 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f90106660 msgr2=0x7f6f90196b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:20.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:20.888+0000 7f6f8effd640 1 --2- 172.21.15.82:0/1711791641 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f90106660 0x7f6f90196b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:20.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:20.888+0000 7f6f8effd640 1 -- 172.21.15.82:0/1711791641 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f90197420 con 0x7f6f90100e90 2024-03-04T09:26:20.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:20.888+0000 7f6f8ffff640 1 --2- 172.21.15.82:0/1711791641 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f90106660 0x7f6f90196b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:26:20.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:20.888+0000 7f6f8f7fe640 1 --2- 172.21.15.82:0/1711791641 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f901004d0 0x7f6f9019ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:26:20.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:20.889+0000 7f6f8effd640 1 --2- 172.21.15.82:0/1711791641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f90100e90 0x7f6f9019cf90 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f6f7800e9f0 tx=0x7f6f7800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:26:20.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:20.889+0000 7f6f8cff9640 1 -- 172.21.15.82:0/1711791641 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7800ccc0 con 0x7f6f90100e90 2024-03-04T09:26:20.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:20.889+0000 7f6f8cff9640 1 -- 172.21.15.82:0/1711791641 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f6f78010900 con 0x7f6f90100e90 2024-03-04T09:26:20.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:20.889+0000 7f6f95fb6640 1 -- 172.21.15.82:0/1711791641 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f90197710 con 0x7f6f90100e90 2024-03-04T09:26:20.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:20.889+0000 7f6f8cff9640 1 -- 172.21.15.82:0/1711791641 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f78018960 con 0x7f6f90100e90 2024-03-04T09:26:20.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:20.889+0000 7f6f95fb6640 1 -- 172.21.15.82:0/1711791641 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f901a39d0 con 0x7f6f90100e90 2024-03-04T09:26:20.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:20.890+0000 7f6f95fb6640 1 -- 172.21.15.82:0/1711791641 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f90101c10 con 0x7f6f90100e90 2024-03-04T09:26:20.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:20.891+0000 7f6f8cff9640 1 -- 172.21.15.82:0/1711791641 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 136887+0+0 (secure 0 0 0) 0x7f6f78010ab0 con 0x7f6f90100e90 2024-03-04T09:26:20.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:20.892+0000 7f6f8cff9640 1 --2- 172.21.15.82:0/1711791641 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f6f7c0a1ef0 0x7f6f7c0a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:20.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:20.892+0000 7f6f8f7fe640 1 --2- 172.21.15.82:0/1711791641 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f6f7c0a1ef0 0x7f6f7c0a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:20.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:20.892+0000 7f6f8cff9640 1 -- 172.21.15.82:0/1711791641 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 9568+0+0 (secure 0 0 0) 0x7f6f780ce8b0 con 0x7f6f90100e90 2024-03-04T09:26:20.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:20.892+0000 7f6f8f7fe640 1 --2- 172.21.15.82:0/1711791641 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f6f7c0a1ef0 0x7f6f7c0a43b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6f800049d0 tx=0x7f6f80009500 comp rx=0 tx=0).ready entity=mgr.15543 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:26:20.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:20.896+0000 7f6f8cff9640 1 -- 172.21.15.82:0/1711791641 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f6f7809af40 con 0x7f6f90100e90 2024-03-04T09:26:21.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.071+0000 7f6f95fb6640 1 -- 172.21.15.82:0/1711791641 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f901089c0 con 0x7f6f90100e90 2024-03-04T09:26:21.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.073+0000 7f6f8cff9640 1 -- 172.21.15.82:0/1711791641 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) v1 ==== 74+0+25384 (secure 0 0 0) 0x7f6f7809efe0 con 0x7f6f90100e90 2024-03-04T09:26:21.070 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:26:21.070 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":106,"fsid":"2e533fc8-da06-11ee-95c6-87774f69a715","created":"2024-03-04T09:05:16.488249+0000","modified":"2024-03-04T09:26:18.179584+0000","last_up_change":"2024-03-04T09:12:22.308711+0000","last_in_change":"2024-03-04T09:12:02.548212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T09:08:36.508257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T09:13:07.981726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T09:13:09.289799+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":105,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-04T09:13:13.008516+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":105,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"085b5c4b-ede9-4d0d-b994-50c89d991012","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6803","nonce":709655235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6805","nonce":709655235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6809","nonce":709655235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6807","nonce":709655235}]},"public_addr":"172.21.15.82:6803/709655235","cluster_addr":"172.21.15.82:6805/709655235","heartbeat_back_addr":"172.21.15.82:6809/709655235","heartbeat_front_addr":"172.21.15.82:6807/709655235","state":["exists","up"]},{"osd":1,"uuid":"e4dd7079-333e-4bcf-b3af-11fb082a5af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6801","nonce":270721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6803","nonce":270721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6807","nonce":270721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6805","nonce":270721212}]},"public_addr":"172.21.15.102:6801/270721212","cluster_addr":"172.21.15.102:6803/270721212","heartbeat_back_addr":"172.21.15.102:6807/270721212","heartbeat_front_addr":"172.21.15.102:6805/270721212","state":["exists","up"]},{"osd":2,"uuid":"6fed5fd6-dc82-497f-9d69-c10a5e5802da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6801","nonce":946410459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6803","nonce":946410459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6807","nonce":946410459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6805","nonce":946410459}]},"public_addr":"172.21.15.190:6801/946410459","cluster_addr":"172.21.15.190:6803/946410459","heartbeat_back_addr":"172.21.15.190:6807/946410459","heartbeat_front_addr":"172.21.15.190:6805/946410459","state":["exists","up"]},{"osd":3,"uuid":"91ccbdc3-3da6-4d39-8a89-3a7b7bb4adc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6811","nonce":980870924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6813","nonce":980870924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6817","nonce":980870924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6815","nonce":980870924}]},"public_addr":"172.21.15.82:6811/980870924","cluster_addr":"172.21.15.82:6813/980870924","heartbeat_back_addr":"172.21.15.82:6817/980870924","heartbeat_front_addr":"172.21.15.82:6815/980870924","state":["exists","up"]},{"osd":4,"uuid":"dbb9d486-5daa-4819-bbed-04fc76ca473e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6809","nonce":1229627753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6811","nonce":1229627753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6815","nonce":1229627753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6813","nonce":1229627753}]},"public_addr":"172.21.15.102:6809/1229627753","cluster_addr":"172.21.15.102:6811/1229627753","heartbeat_back_addr":"172.21.15.102:6815/1229627753","heartbeat_front_addr":"172.21.15.102:6813/1229627753","state":["exists","up"]},{"osd":5,"uuid":"6b50127b-df2b-4c95-8e53-9d42b40273fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6809","nonce":2171194148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6811","nonce":2171194148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6815","nonce":2171194148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6813","nonce":2171194148}]},"public_addr":"172.21.15.190:6809/2171194148","cluster_addr":"172.21.15.190:6811/2171194148","heartbeat_back_addr":"172.21.15.190:6815/2171194148","heartbeat_front_addr":"172.21.15.190:6813/2171194148","state":["exists","up"]},{"osd":6,"uuid":"e72bebb0-5939-4210-950a-41c25c23c62f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6819","nonce":454436959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6821","nonce":454436959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6825","nonce":454436959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6823","nonce":454436959}]},"public_addr":"172.21.15.82:6819/454436959","cluster_addr":"172.21.15.82:6821/454436959","heartbeat_back_addr":"172.21.15.82:6825/454436959","heartbeat_front_addr":"172.21.15.82:6823/454436959","state":["exists","up"]},{"osd":7,"uuid":"72f83f97-f496-4503-8284-6a7b8f99a6f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6817","nonce":2745057274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6819","nonce":2745057274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6823","nonce":2745057274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6821","nonce":2745057274}]},"public_addr":"172.21.15.102:6817/2745057274","cluster_addr":"172.21.15.102:6819/2745057274","heartbeat_back_addr":"172.21.15.102:6823/2745057274","heartbeat_front_addr":"172.21.15.102:6821/2745057274","state":["exists","up"]},{"osd":8,"uuid":"92c9109d-6ebb-4c50-9944-28cd7b2f9c0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6817","nonce":1679683516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6819","nonce":1679683516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6823","nonce":1679683516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6821","nonce":1679683516}]},"public_addr":"172.21.15.190:6817/1679683516","cluster_addr":"172.21.15.190:6819/1679683516","heartbeat_back_addr":"172.21.15.190:6823/1679683516","heartbeat_front_addr":"172.21.15.190:6821/1679683516","state":["exists","up"]},{"osd":9,"uuid":"a3cfce03-0148-475d-bf55-b8284ae1cad2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6827","nonce":1777272933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6829","nonce":1777272933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6833","nonce":1777272933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6831","nonce":1777272933}]},"public_addr":"172.21.15.82:6827/1777272933","cluster_addr":"172.21.15.82:6829/1777272933","heartbeat_back_addr":"172.21.15.82:6833/1777272933","heartbeat_front_addr":"172.21.15.82:6831/1777272933","state":["exists","up"]},{"osd":10,"uuid":"db156ccf-4396-43cb-b69a-bb9095b94b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6825","nonce":1012784035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6827","nonce":1012784035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6831","nonce":1012784035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6829","nonce":1012784035}]},"public_addr":"172.21.15.102:6825/1012784035","cluster_addr":"172.21.15.102:6827/1012784035","heartbeat_back_addr":"172.21.15.102:6831/1012784035","heartbeat_front_addr":"172.21.15.102:6829/1012784035","state":["exists","up"]},{"osd":11,"uuid":"b4d52576-f5b4-479f-8ff6-8fdba4635ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6825","nonce":144700355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6827","nonce":144700355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6831","nonce":144700355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6829","nonce":144700355}]},"public_addr":"172.21.15.190:6825/144700355","cluster_addr":"172.21.15.190:6827/144700355","heartbeat_back_addr":"172.21.15.190:6831/144700355","heartbeat_front_addr":"172.21.15.190:6829/144700355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:07:47.007772+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:09.944738+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:33.183567+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:58.302023+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:09:23.042488+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:09:47.616009+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:10:13.122887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:10:38.584530+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:03.473453+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:29.847105+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:55.152195+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:12:20.401765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/984630078":"2024-03-05T09:06:12.169231+0000","172.21.15.82:6800/3291527077":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/3757201752":"2024-03-05T09:06:12.169231+0000","172.21.15.82:0/1846720385":"2024-03-05T09:05:44.913099+0000","172.21.15.82:6801/3291527077":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/2402774828":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/2876711373":"2024-03-05T09:15:39.302003+0000","172.21.15.82:0/735262841":"2024-03-05T09:05:44.913099+0000","172.21.15.82:6801/1901539016":"2024-03-05T09:06:12.169231+0000","172.21.15.82:0/1124105204":"2024-03-05T09:06:12.169231+0000","172.21.15.82:6800/1901539016":"2024-03-05T09:06:12.169231+0000","172.21.15.82:0/566891801":"2024-03-05T09:15:39.302003+0000","172.21.15.82:0/3558395162":"2024-03-05T09:15:39.302003+0000","172.21.15.82:0/406948853":"2024-03-04T10:20:35.560456+0000","172.21.15.82:6800/1278635224":"2024-03-05T09:15:39.302003+0000","172.21.15.82:6801/1278635224":"2024-03-05T09:15:39.302003+0000","172.21.15.82:0/2438787300":"2024-03-05T09:15:39.302003+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]},{"pool":4,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T09:26:21.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.075+0000 7f6f95fb6640 1 -- 172.21.15.82:0/1711791641 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f6f7c0a1ef0 msgr2=0x7f6f7c0a43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:21.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.075+0000 7f6f95fb6640 1 --2- 172.21.15.82:0/1711791641 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f6f7c0a1ef0 0x7f6f7c0a43b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6f800049d0 tx=0x7f6f80009500 comp rx=0 tx=0).stop 2024-03-04T09:26:21.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.075+0000 7f6f95fb6640 1 -- 172.21.15.82:0/1711791641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f90100e90 msgr2=0x7f6f9019cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:21.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.075+0000 7f6f95fb6640 1 --2- 172.21.15.82:0/1711791641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f90100e90 0x7f6f9019cf90 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f6f7800e9f0 tx=0x7f6f7800eeb0 comp rx=0 tx=0).stop 2024-03-04T09:26:21.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.075+0000 7f6f95fb6640 1 -- 172.21.15.82:0/1711791641 shutdown_connections 2024-03-04T09:26:21.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.075+0000 7f6f95fb6640 1 --2- 172.21.15.82:0/1711791641 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f6f7c0a1ef0 0x7f6f7c0a43b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:21.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.075+0000 7f6f95fb6640 1 --2- 172.21.15.82:0/1711791641 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f90106660 0x7f6f90196b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:21.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.075+0000 7f6f95fb6640 1 --2- 172.21.15.82:0/1711791641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f90100e90 0x7f6f9019cf90 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:21.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.075+0000 7f6f95fb6640 1 --2- 172.21.15.82:0/1711791641 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f901004d0 0x7f6f9019ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:21.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.075+0000 7f6f95fb6640 1 -- 172.21.15.82:0/1711791641 >> 172.21.15.82:0/1711791641 conn(0x7f6f900775d0 msgr2=0x7f6f900ff070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:26:21.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.075+0000 7f6f95fb6640 1 -- 172.21.15.82:0/1711791641 shutdown_connections 2024-03-04T09:26:21.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.075+0000 7f6f95fb6640 1 -- 172.21.15.82:0/1711791641 wait complete. 2024-03-04T09:26:21.083 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T09:08:36.508257+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-04T09:13:07.981726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-04T09:13:09.289799+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '105', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 17, 'snap_epoch': 105, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-04T09:13:13.008516+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '105', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 17, 'snap_epoch': 105, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-04T09:26:21.084 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-04T09:26:21.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.192+0000 7ff349d72640 1 -- 172.21.15.82:0/475704493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff34410bc10 msgr2=0x7ff34410e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:21.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.192+0000 7ff349d72640 1 --2- 172.21.15.82:0/475704493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff34410bc10 0x7ff34410e080 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff33c009ca0 tx=0x7ff33c02c180 comp rx=0 tx=0).stop 2024-03-04T09:26:21.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.192+0000 7ff349d72640 1 -- 172.21.15.82:0/475704493 shutdown_connections 2024-03-04T09:26:21.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.192+0000 7ff349d72640 1 --2- 172.21.15.82:0/475704493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff34410bc10 0x7ff34410e080 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:21.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.192+0000 7ff349d72640 1 --2- 172.21.15.82:0/475704493 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff344103160 0x7ff34410b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:21.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.192+0000 7ff349d72640 1 --2- 172.21.15.82:0/475704493 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff344102840 0x7ff344102c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:21.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.192+0000 7ff349d72640 1 -- 172.21.15.82:0/475704493 >> 172.21.15.82:0/475704493 conn(0x7ff344077630 msgr2=0x7ff344077a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:26:21.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.192+0000 7ff349d72640 1 -- 172.21.15.82:0/475704493 shutdown_connections 2024-03-04T09:26:21.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.192+0000 7ff349d72640 1 -- 172.21.15.82:0/475704493 wait complete. 2024-03-04T09:26:21.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.193+0000 7ff349d72640 1 Processor -- start 2024-03-04T09:26:21.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.193+0000 7ff349d72640 1 -- start start 2024-03-04T09:26:21.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.193+0000 7ff349d72640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff344102840 0x7ff344100490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:21.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.193+0000 7ff349d72640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff344103160 0x7ff3441009d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:21.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.193+0000 7ff349d72640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff34410bc10 0x7ff344100f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:21.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.193+0000 7ff349d72640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3441119b0 con 0x7ff344102840 2024-03-04T09:26:21.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.193+0000 7ff349d72640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff344111830 con 0x7ff34410bc10 2024-03-04T09:26:21.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.193+0000 7ff349d72640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff344111b30 con 0x7ff344103160 2024-03-04T09:26:21.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.194+0000 7ff3437fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff344102840 0x7ff344100490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:21.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.194+0000 7ff3437fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff344102840 0x7ff344100490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35324/0 (socket says 172.21.15.82:35324) 2024-03-04T09:26:21.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.194+0000 7ff3437fe640 1 -- 172.21.15.82:0/1361918048 learned_addr learned my addr 172.21.15.82:0/1361918048 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:26:21.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.194+0000 7ff342ffd640 1 --2- 172.21.15.82:0/1361918048 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff344103160 0x7ff3441009d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:21.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.194+0000 7ff343fff640 1 --2- 172.21.15.82:0/1361918048 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff34410bc10 0x7ff344100f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:21.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.194+0000 7ff3437fe640 1 -- 172.21.15.82:0/1361918048 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff344103160 msgr2=0x7ff3441009d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:21.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.194+0000 7ff3437fe640 1 --2- 172.21.15.82:0/1361918048 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff344103160 0x7ff3441009d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:21.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.194+0000 7ff3437fe640 1 -- 172.21.15.82:0/1361918048 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff34410bc10 msgr2=0x7ff344100f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:21.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.194+0000 7ff3437fe640 1 --2- 172.21.15.82:0/1361918048 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff34410bc10 0x7ff344100f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:21.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.194+0000 7ff3437fe640 1 -- 172.21.15.82:0/1361918048 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3441a6350 con 0x7ff344102840 2024-03-04T09:26:21.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.194+0000 7ff3437fe640 1 --2- 172.21.15.82:0/1361918048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff344102840 0x7ff344100490 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ff33400e9f0 tx=0x7ff33400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:26:21.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.194+0000 7ff340ff9640 1 -- 172.21.15.82:0/1361918048 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33400cd80 con 0x7ff344102840 2024-03-04T09:26:21.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.194+0000 7ff349d72640 1 -- 172.21.15.82:0/1361918048 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3441a6640 con 0x7ff344102840 2024-03-04T09:26:21.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.194+0000 7ff340ff9640 1 -- 172.21.15.82:0/1361918048 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7ff334010900 con 0x7ff344102840 2024-03-04T09:26:21.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.194+0000 7ff340ff9640 1 -- 172.21.15.82:0/1361918048 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3340189e0 con 0x7ff344102840 2024-03-04T09:26:21.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.194+0000 7ff349d72640 1 -- 172.21.15.82:0/1361918048 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3441a6be0 con 0x7ff344102840 2024-03-04T09:26:21.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.195+0000 7ff349d72640 1 -- 172.21.15.82:0/1361918048 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff344068810 con 0x7ff344102840 2024-03-04T09:26:21.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.196+0000 7ff340ff9640 1 -- 172.21.15.82:0/1361918048 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 136887+0+0 (secure 0 0 0) 0x7ff334010ab0 con 0x7ff344102840 2024-03-04T09:26:21.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.197+0000 7ff340ff9640 1 --2- 172.21.15.82:0/1361918048 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7ff32c0a1ef0 0x7ff32c0a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:21.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.197+0000 7ff342ffd640 1 --2- 172.21.15.82:0/1361918048 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7ff32c0a1ef0 0x7ff32c0a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:21.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.197+0000 7ff340ff9640 1 -- 172.21.15.82:0/1361918048 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 9568+0+0 (secure 0 0 0) 0x7ff3340ce880 con 0x7ff344102840 2024-03-04T09:26:21.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.197+0000 7ff342ffd640 1 --2- 172.21.15.82:0/1361918048 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7ff32c0a1ef0 0x7ff32c0a43b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff3380095f0 tx=0x7ff338005f90 comp rx=0 tx=0).ready entity=mgr.15543 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:26:21.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.201+0000 7ff340ff9640 1 -- 172.21.15.82:0/1361918048 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7ff33409af10 con 0x7ff344102840 2024-03-04T09:26:21.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.374+0000 7ff349d72640 1 -- 172.21.15.82:0/1361918048 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff344106d00 con 0x7ff344102840 2024-03-04T09:26:21.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.375+0000 7ff340ff9640 1 -- 172.21.15.82:0/1361918048 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v106) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff33409efb0 con 0x7ff344102840 2024-03-04T09:26:21.372 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-03-04T09:26:21.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.377+0000 7ff349d72640 1 -- 172.21.15.82:0/1361918048 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7ff32c0a1ef0 msgr2=0x7ff32c0a43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:21.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.377+0000 7ff349d72640 1 --2- 172.21.15.82:0/1361918048 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7ff32c0a1ef0 0x7ff32c0a43b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff3380095f0 tx=0x7ff338005f90 comp rx=0 tx=0).stop 2024-03-04T09:26:21.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.377+0000 7ff349d72640 1 -- 172.21.15.82:0/1361918048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff344102840 msgr2=0x7ff344100490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:21.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.377+0000 7ff349d72640 1 --2- 172.21.15.82:0/1361918048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff344102840 0x7ff344100490 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ff33400e9f0 tx=0x7ff33400eeb0 comp rx=0 tx=0).stop 2024-03-04T09:26:21.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.377+0000 7ff349d72640 1 -- 172.21.15.82:0/1361918048 shutdown_connections 2024-03-04T09:26:21.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.377+0000 7ff349d72640 1 --2- 172.21.15.82:0/1361918048 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7ff32c0a1ef0 0x7ff32c0a43b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:21.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.377+0000 7ff349d72640 1 --2- 172.21.15.82:0/1361918048 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff34410bc10 0x7ff344100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:21.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.377+0000 7ff349d72640 1 --2- 172.21.15.82:0/1361918048 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff344103160 0x7ff3441009d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:21.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.377+0000 7ff349d72640 1 --2- 172.21.15.82:0/1361918048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff344102840 0x7ff344100490 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:21.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.377+0000 7ff349d72640 1 -- 172.21.15.82:0/1361918048 >> 172.21.15.82:0/1361918048 conn(0x7ff344077630 msgr2=0x7ff3440fd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:26:21.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.377+0000 7ff349d72640 1 -- 172.21.15.82:0/1361918048 shutdown_connections 2024-03-04T09:26:21.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.377+0000 7ff349d72640 1 -- 172.21.15.82:0/1361918048 wait complete. 2024-03-04T09:26:21.383 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:21 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/1711791641' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:26:21.384 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-04T09:26:21.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.492+0000 7fcc6fab5640 1 -- 172.21.15.82:0/1992957855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc68101560 msgr2=0x7fcc681019e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:21.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.492+0000 7fcc6fab5640 1 --2- 172.21.15.82:0/1992957855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc68101560 0x7fcc681019e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fcc58009900 tx=0x7fcc5802bc30 comp rx=0 tx=0).stop 2024-03-04T09:26:21.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.492+0000 7fcc6fab5640 1 -- 172.21.15.82:0/1992957855 shutdown_connections 2024-03-04T09:26:21.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.492+0000 7fcc6fab5640 1 --2- 172.21.15.82:0/1992957855 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc68101f20 0x7fcc6810e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:21.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.492+0000 7fcc6fab5640 1 --2- 172.21.15.82:0/1992957855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc68101560 0x7fcc681019e0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:21.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.492+0000 7fcc6fab5640 1 --2- 172.21.15.82:0/1992957855 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc68107620 0x7fcc68107a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:21.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.492+0000 7fcc6fab5640 1 -- 172.21.15.82:0/1992957855 >> 172.21.15.82:0/1992957855 conn(0x7fcc680fd030 msgr2=0x7fcc680ff450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:26:21.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.492+0000 7fcc6fab5640 1 -- 172.21.15.82:0/1992957855 shutdown_connections 2024-03-04T09:26:21.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.492+0000 7fcc6fab5640 1 -- 172.21.15.82:0/1992957855 wait complete. 2024-03-04T09:26:21.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.493+0000 7fcc6fab5640 1 Processor -- start 2024-03-04T09:26:21.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.493+0000 7fcc6fab5640 1 -- start start 2024-03-04T09:26:21.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.493+0000 7fcc6fab5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc68101560 0x7fcc68197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:21.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.493+0000 7fcc6fab5640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc68101f20 0x7fcc68198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:21.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.493+0000 7fcc6fab5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc68107620 0x7fcc6819c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:21.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.493+0000 7fcc6fab5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc681118f0 con 0x7fcc68101560 2024-03-04T09:26:21.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.493+0000 7fcc6fab5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc68111770 con 0x7fcc68107620 2024-03-04T09:26:21.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.493+0000 7fcc6fab5640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc68111a70 con 0x7fcc68101f20 2024-03-04T09:26:21.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.493+0000 7fcc6d851640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc68101560 0x7fcc68197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:21.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.493+0000 7fcc6d851640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc68101560 0x7fcc68197df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35352/0 (socket says 172.21.15.82:35352) 2024-03-04T09:26:21.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.493+0000 7fcc6d851640 1 -- 172.21.15.82:0/3467682253 learned_addr learned my addr 172.21.15.82:0/3467682253 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:26:21.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.493+0000 7fcc6d050640 1 --2- 172.21.15.82:0/3467682253 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc68101f20 0x7fcc68198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:21.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.493+0000 7fcc6e052640 1 --2- 172.21.15.82:0/3467682253 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc68107620 0x7fcc6819c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:21.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.493+0000 7fcc6d851640 1 -- 172.21.15.82:0/3467682253 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc68101f20 msgr2=0x7fcc68198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:21.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.493+0000 7fcc6d851640 1 --2- 172.21.15.82:0/3467682253 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc68101f20 0x7fcc68198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:21.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.493+0000 7fcc6d851640 1 -- 172.21.15.82:0/3467682253 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc68107620 msgr2=0x7fcc6819c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:21.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.493+0000 7fcc6d851640 1 --2- 172.21.15.82:0/3467682253 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc68107620 0x7fcc6819c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:21.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.493+0000 7fcc6d851640 1 -- 172.21.15.82:0/3467682253 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc6819cde0 con 0x7fcc68101560 2024-03-04T09:26:21.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.493+0000 7fcc6d851640 1 --2- 172.21.15.82:0/3467682253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc68101560 0x7fcc68197df0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fcc6400e9f0 tx=0x7fcc6400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:26:21.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.494+0000 7fcc5effd640 1 -- 172.21.15.82:0/3467682253 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6400cd80 con 0x7fcc68101560 2024-03-04T09:26:21.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.494+0000 7fcc5effd640 1 -- 172.21.15.82:0/3467682253 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fcc640054f0 con 0x7fcc68101560 2024-03-04T09:26:21.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.494+0000 7fcc6fab5640 1 -- 172.21.15.82:0/3467682253 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc6819d0d0 con 0x7fcc68101560 2024-03-04T09:26:21.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.494+0000 7fcc5effd640 1 -- 172.21.15.82:0/3467682253 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc64010690 con 0x7fcc68101560 2024-03-04T09:26:21.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.494+0000 7fcc6fab5640 1 -- 172.21.15.82:0/3467682253 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc681a4960 con 0x7fcc68101560 2024-03-04T09:26:21.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.495+0000 7fcc6fab5640 1 -- 172.21.15.82:0/3467682253 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc68068810 con 0x7fcc68101560 2024-03-04T09:26:21.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.496+0000 7fcc5effd640 1 -- 172.21.15.82:0/3467682253 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 136887+0+0 (secure 0 0 0) 0x7fcc64004f00 con 0x7fcc68101560 2024-03-04T09:26:21.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.496+0000 7fcc5effd640 1 --2- 172.21.15.82:0/3467682253 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7fcc540a1ef0 0x7fcc540a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:21.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.496+0000 7fcc6d050640 1 --2- 172.21.15.82:0/3467682253 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7fcc540a1ef0 0x7fcc540a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:21.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.496+0000 7fcc5effd640 1 -- 172.21.15.82:0/3467682253 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 9568+0+0 (secure 0 0 0) 0x7fcc640ceb50 con 0x7fcc68101560 2024-03-04T09:26:21.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.497+0000 7fcc6d050640 1 --2- 172.21.15.82:0/3467682253 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7fcc540a1ef0 0x7fcc540a43b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcc58006010 tx=0x7fcc58005dd0 comp rx=0 tx=0).ready entity=mgr.15543 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:26:21.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.500+0000 7fcc5effd640 1 -- 172.21.15.82:0/3467682253 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fcc64053280 con 0x7fcc68101560 2024-03-04T09:26:21.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.674+0000 7fcc6fab5640 1 -- 172.21.15.82:0/3467682253 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcc6802cff0 con 0x7fcc68101560 2024-03-04T09:26:21.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:21 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/1711791641' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:26:21.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.675+0000 7fcc5effd640 1 -- 172.21.15.82:0/3467682253 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v106) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcc6409b830 con 0x7fcc68101560 2024-03-04T09:26:21.672 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-03-04T09:26:21.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.676+0000 7fcc6fab5640 1 -- 172.21.15.82:0/3467682253 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7fcc540a1ef0 msgr2=0x7fcc540a43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:21.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.676+0000 7fcc6fab5640 1 --2- 172.21.15.82:0/3467682253 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7fcc540a1ef0 0x7fcc540a43b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcc58006010 tx=0x7fcc58005dd0 comp rx=0 tx=0).stop 2024-03-04T09:26:21.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.676+0000 7fcc6fab5640 1 -- 172.21.15.82:0/3467682253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc68101560 msgr2=0x7fcc68197df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:21.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.676+0000 7fcc6fab5640 1 --2- 172.21.15.82:0/3467682253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc68101560 0x7fcc68197df0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fcc6400e9f0 tx=0x7fcc6400edf0 comp rx=0 tx=0).stop 2024-03-04T09:26:21.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.676+0000 7fcc6fab5640 1 -- 172.21.15.82:0/3467682253 shutdown_connections 2024-03-04T09:26:21.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.676+0000 7fcc6fab5640 1 --2- 172.21.15.82:0/3467682253 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7fcc540a1ef0 0x7fcc540a43b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:21.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.676+0000 7fcc6fab5640 1 --2- 172.21.15.82:0/3467682253 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc68107620 0x7fcc6819c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:21.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.676+0000 7fcc6fab5640 1 --2- 172.21.15.82:0/3467682253 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc68101f20 0x7fcc68198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:21.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.676+0000 7fcc6fab5640 1 --2- 172.21.15.82:0/3467682253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc68101560 0x7fcc68197df0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:21.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.676+0000 7fcc6fab5640 1 -- 172.21.15.82:0/3467682253 >> 172.21.15.82:0/3467682253 conn(0x7fcc680fd030 msgr2=0x7fcc680fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:26:21.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.677+0000 7fcc6fab5640 1 -- 172.21.15.82:0/3467682253 shutdown_connections 2024-03-04T09:26:21.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.677+0000 7fcc6fab5640 1 -- 172.21.15.82:0/3467682253 wait complete. 2024-03-04T09:26:21.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:21 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/1711791641' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:26:21.684 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-04T09:26:21.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.794+0000 7f5774f81640 1 -- 172.21.15.82:0/3239863071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5770101f40 msgr2=0x7f577010e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:21.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.794+0000 7f5774f81640 1 --2- 172.21.15.82:0/3239863071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5770101f40 0x7f577010e400 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f5768009ca0 tx=0x7f576802c0f0 comp rx=0 tx=0).stop 2024-03-04T09:26:21.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.794+0000 7f5774f81640 1 -- 172.21.15.82:0/3239863071 shutdown_connections 2024-03-04T09:26:21.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.794+0000 7f5774f81640 1 --2- 172.21.15.82:0/3239863071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5770101f40 0x7f577010e400 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:21.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.794+0000 7f5774f81640 1 --2- 172.21.15.82:0/3239863071 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5770101580 0x7f5770101a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:21.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.794+0000 7f5774f81640 1 --2- 172.21.15.82:0/3239863071 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5770107640 0x7f5770107a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:21.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.794+0000 7f5774f81640 1 -- 172.21.15.82:0/3239863071 >> 172.21.15.82:0/3239863071 conn(0x7f57700789d0 msgr2=0x7f5770078de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:26:21.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.794+0000 7f5774f81640 1 -- 172.21.15.82:0/3239863071 shutdown_connections 2024-03-04T09:26:21.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.794+0000 7f5774f81640 1 -- 172.21.15.82:0/3239863071 wait complete. 2024-03-04T09:26:21.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.795+0000 7f5774f81640 1 Processor -- start 2024-03-04T09:26:21.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.795+0000 7f5774f81640 1 -- start start 2024-03-04T09:26:21.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.795+0000 7f5774f81640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5770101580 0x7f5770197d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:21.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.795+0000 7f5774f81640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5770101f40 0x7f57701982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:21.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.795+0000 7f5774f81640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5770107640 0x7f577019c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:21.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.795+0000 7f5774f81640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5770111910 con 0x7f5770107640 2024-03-04T09:26:21.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.795+0000 7f5774f81640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5770111790 con 0x7f5770101580 2024-03-04T09:26:21.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.795+0000 7f5774f81640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5770111a90 con 0x7f5770101f40 2024-03-04T09:26:21.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.795+0000 7f576ed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5770107640 0x7f577019c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:21.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.795+0000 7f576ed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5770107640 0x7f577019c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35368/0 (socket says 172.21.15.82:35368) 2024-03-04T09:26:21.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.795+0000 7f576ed9d640 1 -- 172.21.15.82:0/3309400416 learned_addr learned my addr 172.21.15.82:0/3309400416 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:26:21.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.795+0000 7f576e59c640 1 --2- 172.21.15.82:0/3309400416 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5770101580 0x7f5770197d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:21.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.795+0000 7f5767fff640 1 --2- 172.21.15.82:0/3309400416 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5770101f40 0x7f57701982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:21.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.795+0000 7f576ed9d640 1 -- 172.21.15.82:0/3309400416 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5770101f40 msgr2=0x7f57701982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:21.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.795+0000 7f576ed9d640 1 --2- 172.21.15.82:0/3309400416 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5770101f40 0x7f57701982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:21.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.795+0000 7f576ed9d640 1 -- 172.21.15.82:0/3309400416 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5770101580 msgr2=0x7f5770197d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:21.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.795+0000 7f576ed9d640 1 --2- 172.21.15.82:0/3309400416 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5770101580 0x7f5770197d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:21.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.795+0000 7f576ed9d640 1 -- 172.21.15.82:0/3309400416 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f577019cd30 con 0x7f5770107640 2024-03-04T09:26:21.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.796+0000 7f576ed9d640 1 --2- 172.21.15.82:0/3309400416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5770107640 0x7f577019c600 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f5768005cc0 tx=0x7f5768034ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:26:21.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.796+0000 7f57677fe640 1 -- 172.21.15.82:0/3309400416 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5768039050 con 0x7f5770107640 2024-03-04T09:26:21.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.796+0000 7f57677fe640 1 -- 172.21.15.82:0/3309400416 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f576803a040 con 0x7f5770107640 2024-03-04T09:26:21.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.796+0000 7f57677fe640 1 -- 172.21.15.82:0/3309400416 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5768004590 con 0x7f5770107640 2024-03-04T09:26:21.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.796+0000 7f5774f81640 1 -- 172.21.15.82:0/3309400416 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f577019cfc0 con 0x7f5770107640 2024-03-04T09:26:21.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.796+0000 7f5774f81640 1 -- 172.21.15.82:0/3309400416 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57701a48b0 con 0x7f5770107640 2024-03-04T09:26:21.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.797+0000 7f5774f81640 1 -- 172.21.15.82:0/3309400416 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5770199090 con 0x7f5770107640 2024-03-04T09:26:21.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.798+0000 7f57677fe640 1 -- 172.21.15.82:0/3309400416 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 136887+0+0 (secure 0 0 0) 0x7f5768003970 con 0x7f5770107640 2024-03-04T09:26:21.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.798+0000 7f57677fe640 1 --2- 172.21.15.82:0/3309400416 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f575c0a1ef0 0x7f575c0a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:21.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.798+0000 7f576e59c640 1 --2- 172.21.15.82:0/3309400416 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f575c0a1ef0 0x7f575c0a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:21.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.798+0000 7f57677fe640 1 -- 172.21.15.82:0/3309400416 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 9568+0+0 (secure 0 0 0) 0x7f57680f0b90 con 0x7f5770107640 2024-03-04T09:26:21.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.799+0000 7f576e59c640 1 --2- 172.21.15.82:0/3309400416 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f575c0a1ef0 0x7f575c0a43b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5760009bd0 tx=0x7f5760005f90 comp rx=0 tx=0).ready entity=mgr.15543 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:26:21.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.803+0000 7f57677fe640 1 -- 172.21.15.82:0/3309400416 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f57680bd980 con 0x7f5770107640 2024-03-04T09:26:21.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.978+0000 7f5774f81640 1 -- 172.21.15.82:0/3309400416 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5770109990 con 0x7f5770107640 2024-03-04T09:26:21.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.978+0000 7f57677fe640 1 -- 172.21.15.82:0/3309400416 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v106) v1 ==== 100+0+11 (secure 0 0 0) 0x7f57680bd280 con 0x7f5770107640 2024-03-04T09:26:21.975 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2024-03-04T09:26:21.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.980+0000 7f5774f81640 1 -- 172.21.15.82:0/3309400416 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f575c0a1ef0 msgr2=0x7f575c0a43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:21.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.980+0000 7f5774f81640 1 --2- 172.21.15.82:0/3309400416 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f575c0a1ef0 0x7f575c0a43b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5760009bd0 tx=0x7f5760005f90 comp rx=0 tx=0).stop 2024-03-04T09:26:21.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.980+0000 7f5774f81640 1 -- 172.21.15.82:0/3309400416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5770107640 msgr2=0x7f577019c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:21.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.980+0000 7f5774f81640 1 --2- 172.21.15.82:0/3309400416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5770107640 0x7f577019c600 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f5768005cc0 tx=0x7f5768034ac0 comp rx=0 tx=0).stop 2024-03-04T09:26:21.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.980+0000 7f5774f81640 1 -- 172.21.15.82:0/3309400416 shutdown_connections 2024-03-04T09:26:21.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.980+0000 7f5774f81640 1 --2- 172.21.15.82:0/3309400416 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f575c0a1ef0 0x7f575c0a43b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:21.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.980+0000 7f5774f81640 1 --2- 172.21.15.82:0/3309400416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5770107640 0x7f577019c600 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:21.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.980+0000 7f5774f81640 1 --2- 172.21.15.82:0/3309400416 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5770101f40 0x7f57701982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:21.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.980+0000 7f5774f81640 1 --2- 172.21.15.82:0/3309400416 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5770101580 0x7f5770197d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:21.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.980+0000 7f5774f81640 1 -- 172.21.15.82:0/3309400416 >> 172.21.15.82:0/3309400416 conn(0x7f57700789d0 msgr2=0x7f5770100200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:26:21.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.980+0000 7f5774f81640 1 -- 172.21.15.82:0/3309400416 shutdown_connections 2024-03-04T09:26:21.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:21.980+0000 7f5774f81640 1 -- 172.21.15.82:0/3309400416 wait complete. 2024-03-04T09:26:21.988 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-04T09:26:22.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.097+0000 7f42fb702640 1 -- 172.21.15.82:0/3237139492 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f42f4101f40 msgr2=0x7f42f410e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:22.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.097+0000 7f42fb702640 1 --2- 172.21.15.82:0/3237139492 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f42f4101f40 0x7f42f410e400 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f42ec009cd0 tx=0x7f42ec02c0f0 comp rx=0 tx=0).stop 2024-03-04T09:26:22.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.097+0000 7f42fb702640 1 -- 172.21.15.82:0/3237139492 shutdown_connections 2024-03-04T09:26:22.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.097+0000 7f42fb702640 1 --2- 172.21.15.82:0/3237139492 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f42f4101f40 0x7f42f410e400 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:22.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.097+0000 7f42fb702640 1 --2- 172.21.15.82:0/3237139492 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42f4101580 0x7f42f4101a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:22.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.097+0000 7f42fb702640 1 --2- 172.21.15.82:0/3237139492 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42f4107640 0x7f42f4107a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:22.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.097+0000 7f42fb702640 1 -- 172.21.15.82:0/3237139492 >> 172.21.15.82:0/3237139492 conn(0x7f42f40fd070 msgr2=0x7f42f40ff490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:26:22.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.097+0000 7f42fb702640 1 -- 172.21.15.82:0/3237139492 shutdown_connections 2024-03-04T09:26:22.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.097+0000 7f42fb702640 1 -- 172.21.15.82:0/3237139492 wait complete. 2024-03-04T09:26:22.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.097+0000 7f42fb702640 1 Processor -- start 2024-03-04T09:26:22.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.097+0000 7f42fb702640 1 -- start start 2024-03-04T09:26:22.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.097+0000 7f42fb702640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42f4101580 0x7f42f40738d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:22.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.098+0000 7f42fb702640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42f4101f40 0x7f42f4073e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:22.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.098+0000 7f42fb702640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f42f4107640 0x7f42f4074350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:22.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.098+0000 7f42fb702640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f41118f0 con 0x7f42f4101f40 2024-03-04T09:26:22.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.098+0000 7f42fb702640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f4111770 con 0x7f42f4107640 2024-03-04T09:26:22.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.098+0000 7f42fb702640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f4111a70 con 0x7f42f4101580 2024-03-04T09:26:22.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.098+0000 7f42f8c9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42f4101f40 0x7f42f4073e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:22.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.098+0000 7f42f8c9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42f4101f40 0x7f42f4073e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35386/0 (socket says 172.21.15.82:35386) 2024-03-04T09:26:22.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.098+0000 7f42f8c9d640 1 -- 172.21.15.82:0/2746984440 learned_addr learned my addr 172.21.15.82:0/2746984440 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:26:22.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.098+0000 7f42f949e640 1 --2- 172.21.15.82:0/2746984440 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42f4101580 0x7f42f40738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:22.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.098+0000 7f42f9c9f640 1 --2- 172.21.15.82:0/2746984440 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f42f4107640 0x7f42f4074350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:22.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.098+0000 7f42f8c9d640 1 -- 172.21.15.82:0/2746984440 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42f4101580 msgr2=0x7f42f40738d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:22.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.098+0000 7f42f8c9d640 1 --2- 172.21.15.82:0/2746984440 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42f4101580 0x7f42f40738d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:22.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.098+0000 7f42f8c9d640 1 -- 172.21.15.82:0/2746984440 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f42f4107640 msgr2=0x7f42f4074350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:22.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.098+0000 7f42f8c9d640 1 --2- 172.21.15.82:0/2746984440 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f42f4107640 0x7f42f4074350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:22.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.098+0000 7f42f8c9d640 1 -- 172.21.15.82:0/2746984440 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f41a62b0 con 0x7f42f4101f40 2024-03-04T09:26:22.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.098+0000 7f42f8c9d640 1 --2- 172.21.15.82:0/2746984440 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42f4101f40 0x7f42f4073e10 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f42e400e9f0 tx=0x7f42e400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:26:22.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.098+0000 7f42ea7fc640 1 -- 172.21.15.82:0/2746984440 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e400cd80 con 0x7f42f4101f40 2024-03-04T09:26:22.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.098+0000 7f42fb702640 1 -- 172.21.15.82:0/2746984440 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42f41a65a0 con 0x7f42f4101f40 2024-03-04T09:26:22.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.098+0000 7f42ea7fc640 1 -- 172.21.15.82:0/2746984440 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f42e4010900 con 0x7f42f4101f40 2024-03-04T09:26:22.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.098+0000 7f42ea7fc640 1 -- 172.21.15.82:0/2746984440 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e40189e0 con 0x7f42f4101f40 2024-03-04T09:26:22.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.098+0000 7f42fb702640 1 -- 172.21.15.82:0/2746984440 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42f41a6af0 con 0x7f42f4101f40 2024-03-04T09:26:22.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.099+0000 7f42fb702640 1 -- 172.21.15.82:0/2746984440 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42f40683c0 con 0x7f42f4101f40 2024-03-04T09:26:22.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.100+0000 7f42ea7fc640 1 -- 172.21.15.82:0/2746984440 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 136887+0+0 (secure 0 0 0) 0x7f42e4010ab0 con 0x7f42f4101f40 2024-03-04T09:26:22.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.101+0000 7f42ea7fc640 1 --2- 172.21.15.82:0/2746984440 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f42e00a1ef0 0x7f42e00a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:22.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.101+0000 7f42f949e640 1 --2- 172.21.15.82:0/2746984440 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f42e00a1ef0 0x7f42e00a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:22.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.101+0000 7f42ea7fc640 1 -- 172.21.15.82:0/2746984440 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 9568+0+0 (secure 0 0 0) 0x7f42e40ce8c0 con 0x7f42f4101f40 2024-03-04T09:26:22.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.102+0000 7f42f949e640 1 --2- 172.21.15.82:0/2746984440 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f42e00a1ef0 0x7f42e00a43b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f42f0009b50 tx=0x7f42f0005f90 comp rx=0 tx=0).ready entity=mgr.15543 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:26:22.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.106+0000 7f42ea7fc640 1 -- 172.21.15.82:0/2746984440 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f42e409af50 con 0x7f42f4101f40 2024-03-04T09:26:22.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.281+0000 7f42fb702640 1 -- 172.21.15.82:0/2746984440 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f42f402cff0 con 0x7f42f4101f40 2024-03-04T09:26:22.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.282+0000 7f42ea7fc640 1 -- 172.21.15.82:0/2746984440 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v106) v1 ==== 103+0+11 (secure 0 0 0) 0x7f42e409eff0 con 0x7f42f4101f40 2024-03-04T09:26:22.279 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-03-04T09:26:22.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.284+0000 7f42fb702640 1 -- 172.21.15.82:0/2746984440 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f42e00a1ef0 msgr2=0x7f42e00a43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:22.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.284+0000 7f42fb702640 1 --2- 172.21.15.82:0/2746984440 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f42e00a1ef0 0x7f42e00a43b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f42f0009b50 tx=0x7f42f0005f90 comp rx=0 tx=0).stop 2024-03-04T09:26:22.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.284+0000 7f42fb702640 1 -- 172.21.15.82:0/2746984440 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42f4101f40 msgr2=0x7f42f4073e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:22.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.284+0000 7f42fb702640 1 --2- 172.21.15.82:0/2746984440 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42f4101f40 0x7f42f4073e10 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f42e400e9f0 tx=0x7f42e400eeb0 comp rx=0 tx=0).stop 2024-03-04T09:26:22.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.284+0000 7f42fb702640 1 -- 172.21.15.82:0/2746984440 shutdown_connections 2024-03-04T09:26:22.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.284+0000 7f42fb702640 1 --2- 172.21.15.82:0/2746984440 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f42e00a1ef0 0x7f42e00a43b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:22.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.284+0000 7f42fb702640 1 --2- 172.21.15.82:0/2746984440 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f42f4107640 0x7f42f4074350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:22.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.284+0000 7f42fb702640 1 --2- 172.21.15.82:0/2746984440 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42f4101f40 0x7f42f4073e10 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:22.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.284+0000 7f42fb702640 1 --2- 172.21.15.82:0/2746984440 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42f4101580 0x7f42f40738d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:22.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.284+0000 7f42fb702640 1 -- 172.21.15.82:0/2746984440 >> 172.21.15.82:0/2746984440 conn(0x7f42f40fd070 msgr2=0x7f42f40fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:26:22.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.284+0000 7f42fb702640 1 -- 172.21.15.82:0/2746984440 shutdown_connections 2024-03-04T09:26:22.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.284+0000 7f42fb702640 1 -- 172.21.15.82:0/2746984440 wait complete. 2024-03-04T09:26:22.290 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:22 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/1361918048' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-04T09:26:22.290 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:22 smithi082 ceph-mon[32880]: pgmap v335: 129 pgs: 129 active+clean; 117 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 205 B/s wr, 10 op/s 2024-03-04T09:26:22.290 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:22 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/3467682253' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-04T09:26:22.290 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:22 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/3309400416' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-04T09:26:22.292 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-04T09:26:22.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.397+0000 7f8e9f484640 1 -- 172.21.15.82:0/3067987000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e98101f20 msgr2=0x7f8e9810e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:22.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.397+0000 7f8e9f484640 1 --2- 172.21.15.82:0/3067987000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e98101f20 0x7f8e9810e3e0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f8e90009ca0 tx=0x7f8e9002c0f0 comp rx=0 tx=0).stop 2024-03-04T09:26:22.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.397+0000 7f8e9f484640 1 -- 172.21.15.82:0/3067987000 shutdown_connections 2024-03-04T09:26:22.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.397+0000 7f8e9f484640 1 --2- 172.21.15.82:0/3067987000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e98101f20 0x7f8e9810e3e0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:22.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.397+0000 7f8e9f484640 1 --2- 172.21.15.82:0/3067987000 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e98101560 0x7f8e981019e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:22.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.397+0000 7f8e9f484640 1 --2- 172.21.15.82:0/3067987000 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e98107620 0x7f8e98107a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:22.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.397+0000 7f8e9f484640 1 -- 172.21.15.82:0/3067987000 >> 172.21.15.82:0/3067987000 conn(0x7f8e980fd030 msgr2=0x7f8e980ff450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:26:22.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.397+0000 7f8e9f484640 1 -- 172.21.15.82:0/3067987000 shutdown_connections 2024-03-04T09:26:22.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.397+0000 7f8e9f484640 1 -- 172.21.15.82:0/3067987000 wait complete. 2024-03-04T09:26:22.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.398+0000 7f8e9f484640 1 Processor -- start 2024-03-04T09:26:22.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.398+0000 7f8e9f484640 1 -- start start 2024-03-04T09:26:22.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.398+0000 7f8e9f484640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e98101560 0x7f8e98197d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:22.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.398+0000 7f8e9f484640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e98101f20 0x7f8e981982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:22.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.398+0000 7f8e9f484640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e98107620 0x7f8e9819c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:22.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.398+0000 7f8e9f484640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e981118f0 con 0x7f8e98101560 2024-03-04T09:26:22.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.398+0000 7f8e9f484640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e98111770 con 0x7f8e98107620 2024-03-04T09:26:22.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.398+0000 7f8e9f484640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e98111a70 con 0x7f8e98101f20 2024-03-04T09:26:22.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.398+0000 7f8e9d220640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e98101560 0x7f8e98197d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:22.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.398+0000 7f8e9d220640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e98101560 0x7f8e98197d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35412/0 (socket says 172.21.15.82:35412) 2024-03-04T09:26:22.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.398+0000 7f8e9d220640 1 -- 172.21.15.82:0/3297435920 learned_addr learned my addr 172.21.15.82:0/3297435920 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:26:22.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.398+0000 7f8e9ca1f640 1 --2- 172.21.15.82:0/3297435920 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e98101f20 0x7f8e981982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:22.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.398+0000 7f8e9da21640 1 --2- 172.21.15.82:0/3297435920 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e98107620 0x7f8e9819c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:22.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.398+0000 7f8e9d220640 1 -- 172.21.15.82:0/3297435920 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e98101f20 msgr2=0x7f8e981982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:22.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.398+0000 7f8e9d220640 1 --2- 172.21.15.82:0/3297435920 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e98101f20 0x7f8e981982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:22.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.398+0000 7f8e9d220640 1 -- 172.21.15.82:0/3297435920 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e98107620 msgr2=0x7f8e9819c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:22.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.398+0000 7f8e9d220640 1 --2- 172.21.15.82:0/3297435920 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e98107620 0x7f8e9819c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:22.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.398+0000 7f8e9d220640 1 -- 172.21.15.82:0/3297435920 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e9819cd60 con 0x7f8e98101560 2024-03-04T09:26:22.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.398+0000 7f8e9d220640 1 --2- 172.21.15.82:0/3297435920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e98101560 0x7f8e98197d70 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8e9400e9f0 tx=0x7f8e9400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:26:22.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.398+0000 7f8e8e7fc640 1 -- 172.21.15.82:0/3297435920 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9400cd80 con 0x7f8e98101560 2024-03-04T09:26:22.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.399+0000 7f8e8e7fc640 1 -- 172.21.15.82:0/3297435920 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f8e94010900 con 0x7f8e98101560 2024-03-04T09:26:22.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.399+0000 7f8e9f484640 1 -- 172.21.15.82:0/3297435920 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e9819d050 con 0x7f8e98101560 2024-03-04T09:26:22.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.399+0000 7f8e8e7fc640 1 -- 172.21.15.82:0/3297435920 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e940189e0 con 0x7f8e98101560 2024-03-04T09:26:22.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.399+0000 7f8e9f484640 1 -- 172.21.15.82:0/3297435920 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e981a48e0 con 0x7f8e98101560 2024-03-04T09:26:22.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.399+0000 7f8e9f484640 1 -- 172.21.15.82:0/3297435920 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e98068810 con 0x7f8e98101560 2024-03-04T09:26:22.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.401+0000 7f8e8e7fc640 1 -- 172.21.15.82:0/3297435920 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 136887+0+0 (secure 0 0 0) 0x7f8e94010ab0 con 0x7f8e98101560 2024-03-04T09:26:22.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.401+0000 7f8e8e7fc640 1 --2- 172.21.15.82:0/3297435920 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f8e840a1ef0 0x7f8e840a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:22.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.401+0000 7f8e8e7fc640 1 -- 172.21.15.82:0/3297435920 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 9568+0+0 (secure 0 0 0) 0x7f8e940cedd0 con 0x7f8e98101560 2024-03-04T09:26:22.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.401+0000 7f8e9ca1f640 1 --2- 172.21.15.82:0/3297435920 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f8e840a1ef0 0x7f8e840a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:22.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.402+0000 7f8e9ca1f640 1 --2- 172.21.15.82:0/3297435920 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f8e840a1ef0 0x7f8e840a43b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8e980fe100 tx=0x7f8e88005f90 comp rx=0 tx=0).ready entity=mgr.15543 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:26:22.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.405+0000 7f8e8e7fc640 1 -- 172.21.15.82:0/3297435920 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f8e9409b460 con 0x7f8e98101560 2024-03-04T09:26:22.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.593+0000 7f8e9f484640 1 -- 172.21.15.82:0/3297435920 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8e981990c0 con 0x7f8e98101560 2024-03-04T09:26:22.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.594+0000 7f8e8e7fc640 1 -- 172.21.15.82:0/3297435920 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 17 entries v106) v1 ==== 81+0+1000 (secure 0 0 0) 0x7f8e9409f500 con 0x7f8e98101560 2024-03-04T09:26:22.590 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/984630078 2024-03-05T09:06:12.169231+0000 2024-03-04T09:26:22.591 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/3291527077 2024-03-05T09:05:44.913099+0000 2024-03-04T09:26:22.591 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3757201752 2024-03-05T09:06:12.169231+0000 2024-03-04T09:26:22.591 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1846720385 2024-03-05T09:05:44.913099+0000 2024-03-04T09:26:22.591 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/3291527077 2024-03-05T09:05:44.913099+0000 2024-03-04T09:26:22.591 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/2402774828 2024-03-05T09:05:44.913099+0000 2024-03-04T09:26:22.591 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/2876711373 2024-03-05T09:15:39.302003+0000 2024-03-04T09:26:22.591 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/735262841 2024-03-05T09:05:44.913099+0000 2024-03-04T09:26:22.591 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/1901539016 2024-03-05T09:06:12.169231+0000 2024-03-04T09:26:22.591 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1124105204 2024-03-05T09:06:12.169231+0000 2024-03-04T09:26:22.591 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/1901539016 2024-03-05T09:06:12.169231+0000 2024-03-04T09:26:22.591 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/566891801 2024-03-05T09:15:39.302003+0000 2024-03-04T09:26:22.591 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3558395162 2024-03-05T09:15:39.302003+0000 2024-03-04T09:26:22.591 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/406948853 2024-03-04T10:20:35.560456+0000 2024-03-04T09:26:22.592 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/1278635224 2024-03-05T09:15:39.302003+0000 2024-03-04T09:26:22.592 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/1278635224 2024-03-05T09:15:39.302003+0000 2024-03-04T09:26:22.592 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/2438787300 2024-03-05T09:15:39.302003+0000 2024-03-04T09:26:22.593 INFO:teuthology.orchestra.run.smithi082.stderr:listed 17 entries 2024-03-04T09:26:22.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.595+0000 7f8e9f484640 1 -- 172.21.15.82:0/3297435920 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f8e840a1ef0 msgr2=0x7f8e840a43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:22.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.596+0000 7f8e9f484640 1 --2- 172.21.15.82:0/3297435920 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f8e840a1ef0 0x7f8e840a43b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8e980fe100 tx=0x7f8e88005f90 comp rx=0 tx=0).stop 2024-03-04T09:26:22.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.596+0000 7f8e9f484640 1 -- 172.21.15.82:0/3297435920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e98101560 msgr2=0x7f8e98197d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:22.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.596+0000 7f8e9f484640 1 --2- 172.21.15.82:0/3297435920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e98101560 0x7f8e98197d70 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8e9400e9f0 tx=0x7f8e9400eeb0 comp rx=0 tx=0).stop 2024-03-04T09:26:22.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.596+0000 7f8e9f484640 1 -- 172.21.15.82:0/3297435920 shutdown_connections 2024-03-04T09:26:22.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.596+0000 7f8e9f484640 1 --2- 172.21.15.82:0/3297435920 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f8e840a1ef0 0x7f8e840a43b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:22.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.596+0000 7f8e9f484640 1 --2- 172.21.15.82:0/3297435920 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e98107620 0x7f8e9819c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:22.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.596+0000 7f8e9f484640 1 --2- 172.21.15.82:0/3297435920 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e98101f20 0x7f8e981982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:22.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.596+0000 7f8e9f484640 1 --2- 172.21.15.82:0/3297435920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e98101560 0x7f8e98197d70 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:22.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.596+0000 7f8e9f484640 1 -- 172.21.15.82:0/3297435920 >> 172.21.15.82:0/3297435920 conn(0x7f8e980fd030 msgr2=0x7f8e980fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:26:22.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.596+0000 7f8e9f484640 1 -- 172.21.15.82:0/3297435920 shutdown_connections 2024-03-04T09:26:22.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.596+0000 7f8e9f484640 1 -- 172.21.15.82:0/3297435920 wait complete. 2024-03-04T09:26:22.603 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-03-04T09:26:22.603 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-04T09:26:22.620 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T09:26:22.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:22 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/1361918048' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-04T09:26:22.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:22 smithi190 ceph-mon[36341]: pgmap v335: 129 pgs: 129 active+clean; 117 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 205 B/s wr, 10 op/s 2024-03-04T09:26:22.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:22 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/3467682253' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-04T09:26:22.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:22 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/3309400416' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-04T09:26:22.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:22 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/1361918048' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-04T09:26:22.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:22 smithi102 ceph-mon[36220]: pgmap v335: 129 pgs: 129 active+clean; 117 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 205 B/s wr, 10 op/s 2024-03-04T09:26:22.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:22 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/3467682253' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-04T09:26:22.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:22 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/3309400416' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-04T09:26:22.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.764+0000 7f125433a640 1 -- 172.21.15.82:0/908769899 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f124c101f40 msgr2=0x7f124c10e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:22.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.764+0000 7f125433a640 1 --2- 172.21.15.82:0/908769899 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f124c101f40 0x7f124c10e400 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f1244009ca0 tx=0x7f124402c0f0 comp rx=0 tx=0).stop 2024-03-04T09:26:22.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.764+0000 7f125433a640 1 -- 172.21.15.82:0/908769899 shutdown_connections 2024-03-04T09:26:22.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.764+0000 7f125433a640 1 --2- 172.21.15.82:0/908769899 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f124c101f40 0x7f124c10e400 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:22.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.764+0000 7f125433a640 1 --2- 172.21.15.82:0/908769899 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f124c101580 0x7f124c101a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:22.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.764+0000 7f125433a640 1 --2- 172.21.15.82:0/908769899 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f124c107640 0x7f124c107a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:22.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.764+0000 7f125433a640 1 -- 172.21.15.82:0/908769899 >> 172.21.15.82:0/908769899 conn(0x7f124c0789d0 msgr2=0x7f124c078de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:26:22.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.764+0000 7f125433a640 1 -- 172.21.15.82:0/908769899 shutdown_connections 2024-03-04T09:26:22.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.764+0000 7f125433a640 1 -- 172.21.15.82:0/908769899 wait complete. 2024-03-04T09:26:22.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.765+0000 7f125433a640 1 Processor -- start 2024-03-04T09:26:22.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.765+0000 7f125433a640 1 -- start start 2024-03-04T09:26:22.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.765+0000 7f125433a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f124c101580 0x7f124c197d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:22.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.765+0000 7f125433a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f124c101f40 0x7f124c198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:22.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.765+0000 7f125433a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f124c107640 0x7f124c19c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:22.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.765+0000 7f125433a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124c1118f0 con 0x7f124c101580 2024-03-04T09:26:22.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.765+0000 7f125433a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124c111770 con 0x7f124c101f40 2024-03-04T09:26:22.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.765+0000 7f125433a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124c111a70 con 0x7f124c107640 2024-03-04T09:26:22.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.765+0000 7f12520d6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f124c101580 0x7f124c197d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:22.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.765+0000 7f12520d6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f124c101580 0x7f124c197d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35426/0 (socket says 172.21.15.82:35426) 2024-03-04T09:26:22.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.765+0000 7f12520d6640 1 -- 172.21.15.82:0/1003106145 learned_addr learned my addr 172.21.15.82:0/1003106145 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:26:22.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.765+0000 7f12518d5640 1 --2- 172.21.15.82:0/1003106145 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f124c101f40 0x7f124c198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:22.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.765+0000 7f12528d7640 1 --2- 172.21.15.82:0/1003106145 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f124c107640 0x7f124c19c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:22.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.765+0000 7f12520d6640 1 -- 172.21.15.82:0/1003106145 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f124c107640 msgr2=0x7f124c19c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:22.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.765+0000 7f12520d6640 1 --2- 172.21.15.82:0/1003106145 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f124c107640 0x7f124c19c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:22.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.765+0000 7f12520d6640 1 -- 172.21.15.82:0/1003106145 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f124c101f40 msgr2=0x7f124c198270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:22.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.765+0000 7f12520d6640 1 --2- 172.21.15.82:0/1003106145 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f124c101f40 0x7f124c198270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:22.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.765+0000 7f12520d6640 1 -- 172.21.15.82:0/1003106145 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f124c19cd20 con 0x7f124c101580 2024-03-04T09:26:22.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.766+0000 7f12520d6640 1 --2- 172.21.15.82:0/1003106145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f124c101580 0x7f124c197d30 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f124800ea60 tx=0x7f124800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:26:22.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.766+0000 7f12437fe640 1 -- 172.21.15.82:0/1003106145 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124800cde0 con 0x7f124c101580 2024-03-04T09:26:22.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.766+0000 7f125433a640 1 -- 172.21.15.82:0/1003106145 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f124c19d010 con 0x7f124c101580 2024-03-04T09:26:22.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.766+0000 7f12437fe640 1 -- 172.21.15.82:0/1003106145 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f12480035f0 con 0x7f124c101580 2024-03-04T09:26:22.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.766+0000 7f12437fe640 1 -- 172.21.15.82:0/1003106145 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1248010690 con 0x7f124c101580 2024-03-04T09:26:22.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.766+0000 7f125433a640 1 -- 172.21.15.82:0/1003106145 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f124c1a48a0 con 0x7f124c101580 2024-03-04T09:26:22.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.767+0000 7f125433a640 1 -- 172.21.15.82:0/1003106145 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f124c068810 con 0x7f124c101580 2024-03-04T09:26:22.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.768+0000 7f12437fe640 1 -- 172.21.15.82:0/1003106145 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 136887+0+0 (secure 0 0 0) 0x7f12480037a0 con 0x7f124c101580 2024-03-04T09:26:22.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.768+0000 7f12437fe640 1 --2- 172.21.15.82:0/1003106145 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f12380a1ef0 0x7f12380a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:22.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.769+0000 7f12518d5640 1 --2- 172.21.15.82:0/1003106145 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f12380a1ef0 0x7f12380a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:22.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.769+0000 7f12437fe640 1 -- 172.21.15.82:0/1003106145 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 9568+0+0 (secure 0 0 0) 0x7f12480ce9a0 con 0x7f124c101580 2024-03-04T09:26:22.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.769+0000 7f12518d5640 1 --2- 172.21.15.82:0/1003106145 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f12380a1ef0 0x7f12380a43b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f124c0ff9b0 tx=0x7f123c005f90 comp rx=0 tx=0).ready entity=mgr.15543 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:26:22.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.773+0000 7f12437fe640 1 -- 172.21.15.82:0/1003106145 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f124809b710 con 0x7f124c101580 2024-03-04T09:26:22.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.949+0000 7f125433a640 1 -- 172.21.15.82:0/1003106145 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f124c199080 con 0x7f124c101580 2024-03-04T09:26:22.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.951+0000 7f12437fe640 1 -- 172.21.15.82:0/1003106145 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) v1 ==== 74+0+25384 (secure 0 0 0) 0x7f124809b010 con 0x7f124c101580 2024-03-04T09:26:22.948 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:26:22.948 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":106,"fsid":"2e533fc8-da06-11ee-95c6-87774f69a715","created":"2024-03-04T09:05:16.488249+0000","modified":"2024-03-04T09:26:18.179584+0000","last_up_change":"2024-03-04T09:12:22.308711+0000","last_in_change":"2024-03-04T09:12:02.548212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T09:08:36.508257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T09:13:07.981726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T09:13:09.289799+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":105,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-04T09:13:13.008516+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":105,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"085b5c4b-ede9-4d0d-b994-50c89d991012","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6803","nonce":709655235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6805","nonce":709655235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6809","nonce":709655235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6807","nonce":709655235}]},"public_addr":"172.21.15.82:6803/709655235","cluster_addr":"172.21.15.82:6805/709655235","heartbeat_back_addr":"172.21.15.82:6809/709655235","heartbeat_front_addr":"172.21.15.82:6807/709655235","state":["exists","up"]},{"osd":1,"uuid":"e4dd7079-333e-4bcf-b3af-11fb082a5af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6801","nonce":270721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6803","nonce":270721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6807","nonce":270721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6805","nonce":270721212}]},"public_addr":"172.21.15.102:6801/270721212","cluster_addr":"172.21.15.102:6803/270721212","heartbeat_back_addr":"172.21.15.102:6807/270721212","heartbeat_front_addr":"172.21.15.102:6805/270721212","state":["exists","up"]},{"osd":2,"uuid":"6fed5fd6-dc82-497f-9d69-c10a5e5802da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6801","nonce":946410459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6803","nonce":946410459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6807","nonce":946410459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6805","nonce":946410459}]},"public_addr":"172.21.15.190:6801/946410459","cluster_addr":"172.21.15.190:6803/946410459","heartbeat_back_addr":"172.21.15.190:6807/946410459","heartbeat_front_addr":"172.21.15.190:6805/946410459","state":["exists","up"]},{"osd":3,"uuid":"91ccbdc3-3da6-4d39-8a89-3a7b7bb4adc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6811","nonce":980870924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6813","nonce":980870924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6817","nonce":980870924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6815","nonce":980870924}]},"public_addr":"172.21.15.82:6811/980870924","cluster_addr":"172.21.15.82:6813/980870924","heartbeat_back_addr":"172.21.15.82:6817/980870924","heartbeat_front_addr":"172.21.15.82:6815/980870924","state":["exists","up"]},{"osd":4,"uuid":"dbb9d486-5daa-4819-bbed-04fc76ca473e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6809","nonce":1229627753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6811","nonce":1229627753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6815","nonce":1229627753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6813","nonce":1229627753}]},"public_addr":"172.21.15.102:6809/1229627753","cluster_addr":"172.21.15.102:6811/1229627753","heartbeat_back_addr":"172.21.15.102:6815/1229627753","heartbeat_front_addr":"172.21.15.102:6813/1229627753","state":["exists","up"]},{"osd":5,"uuid":"6b50127b-df2b-4c95-8e53-9d42b40273fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6809","nonce":2171194148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6811","nonce":2171194148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6815","nonce":2171194148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6813","nonce":2171194148}]},"public_addr":"172.21.15.190:6809/2171194148","cluster_addr":"172.21.15.190:6811/2171194148","heartbeat_back_addr":"172.21.15.190:6815/2171194148","heartbeat_front_addr":"172.21.15.190:6813/2171194148","state":["exists","up"]},{"osd":6,"uuid":"e72bebb0-5939-4210-950a-41c25c23c62f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6819","nonce":454436959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6821","nonce":454436959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6825","nonce":454436959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6823","nonce":454436959}]},"public_addr":"172.21.15.82:6819/454436959","cluster_addr":"172.21.15.82:6821/454436959","heartbeat_back_addr":"172.21.15.82:6825/454436959","heartbeat_front_addr":"172.21.15.82:6823/454436959","state":["exists","up"]},{"osd":7,"uuid":"72f83f97-f496-4503-8284-6a7b8f99a6f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6817","nonce":2745057274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6819","nonce":2745057274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6823","nonce":2745057274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6821","nonce":2745057274}]},"public_addr":"172.21.15.102:6817/2745057274","cluster_addr":"172.21.15.102:6819/2745057274","heartbeat_back_addr":"172.21.15.102:6823/2745057274","heartbeat_front_addr":"172.21.15.102:6821/2745057274","state":["exists","up"]},{"osd":8,"uuid":"92c9109d-6ebb-4c50-9944-28cd7b2f9c0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6817","nonce":1679683516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6819","nonce":1679683516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6823","nonce":1679683516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6821","nonce":1679683516}]},"public_addr":"172.21.15.190:6817/1679683516","cluster_addr":"172.21.15.190:6819/1679683516","heartbeat_back_addr":"172.21.15.190:6823/1679683516","heartbeat_front_addr":"172.21.15.190:6821/1679683516","state":["exists","up"]},{"osd":9,"uuid":"a3cfce03-0148-475d-bf55-b8284ae1cad2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6827","nonce":1777272933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6829","nonce":1777272933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6833","nonce":1777272933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6831","nonce":1777272933}]},"public_addr":"172.21.15.82:6827/1777272933","cluster_addr":"172.21.15.82:6829/1777272933","heartbeat_back_addr":"172.21.15.82:6833/1777272933","heartbeat_front_addr":"172.21.15.82:6831/1777272933","state":["exists","up"]},{"osd":10,"uuid":"db156ccf-4396-43cb-b69a-bb9095b94b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6825","nonce":1012784035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6827","nonce":1012784035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6831","nonce":1012784035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6829","nonce":1012784035}]},"public_addr":"172.21.15.102:6825/1012784035","cluster_addr":"172.21.15.102:6827/1012784035","heartbeat_back_addr":"172.21.15.102:6831/1012784035","heartbeat_front_addr":"172.21.15.102:6829/1012784035","state":["exists","up"]},{"osd":11,"uuid":"b4d52576-f5b4-479f-8ff6-8fdba4635ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6825","nonce":144700355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6827","nonce":144700355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6831","nonce":144700355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6829","nonce":144700355}]},"public_addr":"172.21.15.190:6825/144700355","cluster_addr":"172.21.15.190:6827/144700355","heartbeat_back_addr":"172.21.15.190:6831/144700355","heartbeat_front_addr":"172.21.15.190:6829/144700355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:07:47.007772+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:09.944738+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:33.183567+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:58.302023+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:09:23.042488+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:09:47.616009+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:10:13.122887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:10:38.584530+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:03.473453+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:29.847105+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:55.152195+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:12:20.401765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/984630078":"2024-03-05T09:06:12.169231+0000","172.21.15.82:6800/3291527077":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/3757201752":"2024-03-05T09:06:12.169231+0000","172.21.15.82:0/1846720385":"2024-03-05T09:05:44.913099+0000","172.21.15.82:6801/3291527077":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/2402774828":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/2876711373":"2024-03-05T09:15:39.302003+0000","172.21.15.82:0/735262841":"2024-03-05T09:05:44.913099+0000","172.21.15.82:6801/1901539016":"2024-03-05T09:06:12.169231+0000","172.21.15.82:0/1124105204":"2024-03-05T09:06:12.169231+0000","172.21.15.82:6800/1901539016":"2024-03-05T09:06:12.169231+0000","172.21.15.82:0/566891801":"2024-03-05T09:15:39.302003+0000","172.21.15.82:0/3558395162":"2024-03-05T09:15:39.302003+0000","172.21.15.82:0/406948853":"2024-03-04T10:20:35.560456+0000","172.21.15.82:6800/1278635224":"2024-03-05T09:15:39.302003+0000","172.21.15.82:6801/1278635224":"2024-03-05T09:15:39.302003+0000","172.21.15.82:0/2438787300":"2024-03-05T09:15:39.302003+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]},{"pool":4,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T09:26:22.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.953+0000 7f125433a640 1 -- 172.21.15.82:0/1003106145 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f12380a1ef0 msgr2=0x7f12380a43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:22.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.953+0000 7f125433a640 1 --2- 172.21.15.82:0/1003106145 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f12380a1ef0 0x7f12380a43b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f124c0ff9b0 tx=0x7f123c005f90 comp rx=0 tx=0).stop 2024-03-04T09:26:22.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.953+0000 7f125433a640 1 -- 172.21.15.82:0/1003106145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f124c101580 msgr2=0x7f124c197d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:22.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.953+0000 7f125433a640 1 --2- 172.21.15.82:0/1003106145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f124c101580 0x7f124c197d30 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f124800ea60 tx=0x7f124800ef20 comp rx=0 tx=0).stop 2024-03-04T09:26:22.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.953+0000 7f125433a640 1 -- 172.21.15.82:0/1003106145 shutdown_connections 2024-03-04T09:26:22.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.953+0000 7f125433a640 1 --2- 172.21.15.82:0/1003106145 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f12380a1ef0 0x7f12380a43b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:22.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.953+0000 7f125433a640 1 --2- 172.21.15.82:0/1003106145 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f124c107640 0x7f124c19c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:22.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.953+0000 7f125433a640 1 --2- 172.21.15.82:0/1003106145 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f124c101f40 0x7f124c198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:22.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.953+0000 7f125433a640 1 --2- 172.21.15.82:0/1003106145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f124c101580 0x7f124c197d30 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:22.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.953+0000 7f125433a640 1 -- 172.21.15.82:0/1003106145 >> 172.21.15.82:0/1003106145 conn(0x7f124c0789d0 msgr2=0x7f124c100190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:26:22.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.953+0000 7f125433a640 1 -- 172.21.15.82:0/1003106145 shutdown_connections 2024-03-04T09:26:22.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:22.953+0000 7f125433a640 1 -- 172.21.15.82:0/1003106145 wait complete. 2024-03-04T09:26:22.961 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-04T09:08:36.508257+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-04T09:13:07.981726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-04T09:13:09.289799+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '105', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 17, 'snap_epoch': 105, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-04T09:13:13.008516+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '105', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 17, 'snap_epoch': 105, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-04T09:26:22.962 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-04T09:26:23.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.069+0000 7f5e3c5f6640 1 -- 172.21.15.82:0/3932893737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e3410bc10 msgr2=0x7f5e3410e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:23.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.069+0000 7f5e3c5f6640 1 --2- 172.21.15.82:0/3932893737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e3410bc10 0x7f5e3410e080 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c009ca0 tx=0x7f5e2c02c180 comp rx=0 tx=0).stop 2024-03-04T09:26:23.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.069+0000 7f5e3c5f6640 1 -- 172.21.15.82:0/3932893737 shutdown_connections 2024-03-04T09:26:23.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.069+0000 7f5e3c5f6640 1 --2- 172.21.15.82:0/3932893737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e3410bc10 0x7f5e3410e080 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:23.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.069+0000 7f5e3c5f6640 1 --2- 172.21.15.82:0/3932893737 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e34103160 0x7f5e3410b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:23.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.069+0000 7f5e3c5f6640 1 --2- 172.21.15.82:0/3932893737 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5e34102840 0x7f5e34102c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:23.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.069+0000 7f5e3c5f6640 1 -- 172.21.15.82:0/3932893737 >> 172.21.15.82:0/3932893737 conn(0x7f5e34077630 msgr2=0x7f5e34077a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:26:23.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.069+0000 7f5e3c5f6640 1 -- 172.21.15.82:0/3932893737 shutdown_connections 2024-03-04T09:26:23.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.069+0000 7f5e3c5f6640 1 -- 172.21.15.82:0/3932893737 wait complete. 2024-03-04T09:26:23.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.070+0000 7f5e3c5f6640 1 Processor -- start 2024-03-04T09:26:23.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.070+0000 7f5e3c5f6640 1 -- start start 2024-03-04T09:26:23.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.070+0000 7f5e3c5f6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e34102840 0x7f5e34197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:23.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.070+0000 7f5e3c5f6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5e34103160 0x7f5e34198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:23.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.070+0000 7f5e3c5f6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e3410bc10 0x7f5e3419c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:23.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.070+0000 7f5e3c5f6640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e341119b0 con 0x7f5e3410bc10 2024-03-04T09:26:23.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.070+0000 7f5e3c5f6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e34111830 con 0x7f5e34102840 2024-03-04T09:26:23.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.070+0000 7f5e3c5f6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e34111b30 con 0x7f5e34103160 2024-03-04T09:26:23.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.070+0000 7f5e3ab93640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e3410bc10 0x7f5e3419c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:23.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.070+0000 7f5e3ab93640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e3410bc10 0x7f5e3419c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35434/0 (socket says 172.21.15.82:35434) 2024-03-04T09:26:23.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.070+0000 7f5e3ab93640 1 -- 172.21.15.82:0/4280052450 learned_addr learned my addr 172.21.15.82:0/4280052450 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:26:23.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.070+0000 7f5e3a392640 1 --2- 172.21.15.82:0/4280052450 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e34102840 0x7f5e34197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:23.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.070+0000 7f5e39b91640 1 --2- 172.21.15.82:0/4280052450 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5e34103160 0x7f5e34198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:23.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.070+0000 7f5e3ab93640 1 -- 172.21.15.82:0/4280052450 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5e34103160 msgr2=0x7f5e34198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:23.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.070+0000 7f5e3ab93640 1 --2- 172.21.15.82:0/4280052450 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5e34103160 0x7f5e34198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:23.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.070+0000 7f5e3ab93640 1 -- 172.21.15.82:0/4280052450 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e34102840 msgr2=0x7f5e34197e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:23.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.070+0000 7f5e3ab93640 1 --2- 172.21.15.82:0/4280052450 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e34102840 0x7f5e34197e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:23.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.070+0000 7f5e3ab93640 1 -- 172.21.15.82:0/4280052450 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e3419ce20 con 0x7f5e3410bc10 2024-03-04T09:26:23.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.071+0000 7f5e3ab93640 1 --2- 172.21.15.82:0/4280052450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e3410bc10 0x7f5e3419c6f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c005cc0 tx=0x7f5e2c034de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:26:23.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.071+0000 7f5e2b7fe640 1 -- 172.21.15.82:0/4280052450 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c039050 con 0x7f5e3410bc10 2024-03-04T09:26:23.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.071+0000 7f5e3c5f6640 1 -- 172.21.15.82:0/4280052450 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e3419d0b0 con 0x7f5e3410bc10 2024-03-04T09:26:23.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.071+0000 7f5e2b7fe640 1 -- 172.21.15.82:0/4280052450 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f5e2c045070 con 0x7f5e3410bc10 2024-03-04T09:26:23.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.071+0000 7f5e2b7fe640 1 -- 172.21.15.82:0/4280052450 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c032ab0 con 0x7f5e3410bc10 2024-03-04T09:26:23.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.071+0000 7f5e3c5f6640 1 -- 172.21.15.82:0/4280052450 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e341a49a0 con 0x7f5e3410bc10 2024-03-04T09:26:23.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.072+0000 7f5e3c5f6640 1 -- 172.21.15.82:0/4280052450 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e34068810 con 0x7f5e3410bc10 2024-03-04T09:26:23.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.073+0000 7f5e2b7fe640 1 -- 172.21.15.82:0/4280052450 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 136887+0+0 (secure 0 0 0) 0x7f5e2c032c50 con 0x7f5e3410bc10 2024-03-04T09:26:23.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.074+0000 7f5e2b7fe640 1 --2- 172.21.15.82:0/4280052450 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f5e200a1ef0 0x7f5e200a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:23.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.074+0000 7f5e3a392640 1 --2- 172.21.15.82:0/4280052450 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f5e200a1ef0 0x7f5e200a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:23.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.074+0000 7f5e2b7fe640 1 -- 172.21.15.82:0/4280052450 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 9568+0+0 (secure 0 0 0) 0x7f5e2c0f17a0 con 0x7f5e3410bc10 2024-03-04T09:26:23.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.074+0000 7f5e3a392640 1 --2- 172.21.15.82:0/4280052450 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f5e200a1ef0 0x7f5e200a43b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5e30009bd0 tx=0x7f5e30005f90 comp rx=0 tx=0).ready entity=mgr.15543 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:26:23.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.078+0000 7f5e2b7fe640 1 -- 172.21.15.82:0/4280052450 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f5e2c0be590 con 0x7f5e3410bc10 2024-03-04T09:26:23.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.253+0000 7f5e3c5f6640 1 -- 172.21.15.82:0/4280052450 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5e34106d00 con 0x7f5e3410bc10 2024-03-04T09:26:23.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.254+0000 7f5e2b7fe640 1 -- 172.21.15.82:0/4280052450 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v106) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5e2c0bde90 con 0x7f5e3410bc10 2024-03-04T09:26:23.251 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-03-04T09:26:23.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.256+0000 7f5e3c5f6640 1 -- 172.21.15.82:0/4280052450 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f5e200a1ef0 msgr2=0x7f5e200a43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:23.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.256+0000 7f5e3c5f6640 1 --2- 172.21.15.82:0/4280052450 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f5e200a1ef0 0x7f5e200a43b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5e30009bd0 tx=0x7f5e30005f90 comp rx=0 tx=0).stop 2024-03-04T09:26:23.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.256+0000 7f5e3c5f6640 1 -- 172.21.15.82:0/4280052450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e3410bc10 msgr2=0x7f5e3419c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:23.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.256+0000 7f5e3c5f6640 1 --2- 172.21.15.82:0/4280052450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e3410bc10 0x7f5e3419c6f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c005cc0 tx=0x7f5e2c034de0 comp rx=0 tx=0).stop 2024-03-04T09:26:23.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.256+0000 7f5e3c5f6640 1 -- 172.21.15.82:0/4280052450 shutdown_connections 2024-03-04T09:26:23.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.256+0000 7f5e3c5f6640 1 --2- 172.21.15.82:0/4280052450 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f5e200a1ef0 0x7f5e200a43b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:23.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.256+0000 7f5e3c5f6640 1 --2- 172.21.15.82:0/4280052450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e3410bc10 0x7f5e3419c6f0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:23.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.256+0000 7f5e3c5f6640 1 --2- 172.21.15.82:0/4280052450 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5e34103160 0x7f5e34198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:23.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.256+0000 7f5e3c5f6640 1 --2- 172.21.15.82:0/4280052450 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e34102840 0x7f5e34197e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:23.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.256+0000 7f5e3c5f6640 1 -- 172.21.15.82:0/4280052450 >> 172.21.15.82:0/4280052450 conn(0x7f5e34077630 msgr2=0x7f5e340fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:26:23.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.256+0000 7f5e3c5f6640 1 -- 172.21.15.82:0/4280052450 shutdown_connections 2024-03-04T09:26:23.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.256+0000 7f5e3c5f6640 1 -- 172.21.15.82:0/4280052450 wait complete. 2024-03-04T09:26:23.262 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:23 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/2746984440' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-04T09:26:23.262 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:23 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/3297435920' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-04T09:26:23.262 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:23 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/1003106145' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:26:23.263 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-04T09:26:23.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.370+0000 7f4761895640 1 -- 172.21.15.82:0/3022443538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f475c100ed0 msgr2=0x7f475c10d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:23.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.370+0000 7f4761895640 1 --2- 172.21.15.82:0/3022443538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f475c100ed0 0x7f475c10d390 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f4754009ca0 tx=0x7f475402c0f0 comp rx=0 tx=0).stop 2024-03-04T09:26:23.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.370+0000 7f4761895640 1 -- 172.21.15.82:0/3022443538 shutdown_connections 2024-03-04T09:26:23.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.370+0000 7f4761895640 1 --2- 172.21.15.82:0/3022443538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f475c100ed0 0x7f475c10d390 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:23.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.370+0000 7f4761895640 1 --2- 172.21.15.82:0/3022443538 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f475c100510 0x7f475c100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:23.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.370+0000 7f4761895640 1 --2- 172.21.15.82:0/3022443538 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f475c1065d0 0x7f475c1069b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:23.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.370+0000 7f4761895640 1 -- 172.21.15.82:0/3022443538 >> 172.21.15.82:0/3022443538 conn(0x7f475c077630 msgr2=0x7f475c077a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:26:23.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.370+0000 7f4761895640 1 -- 172.21.15.82:0/3022443538 shutdown_connections 2024-03-04T09:26:23.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.370+0000 7f4761895640 1 -- 172.21.15.82:0/3022443538 wait complete. 2024-03-04T09:26:23.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.371+0000 7f4761895640 1 Processor -- start 2024-03-04T09:26:23.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.371+0000 7f4761895640 1 -- start start 2024-03-04T09:26:23.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.371+0000 7f4761895640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f475c100510 0x7f475c198c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:23.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.371+0000 7f4761895640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f475c100ed0 0x7f475c199180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:23.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.371+0000 7f4761895640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f475c1065d0 0x7f475c1a3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:23.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.371+0000 7f4761895640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475c1108a0 con 0x7f475c1065d0 2024-03-04T09:26:23.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.371+0000 7f4761895640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475c110720 con 0x7f475c100ed0 2024-03-04T09:26:23.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.371+0000 7f4761895640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475c110a20 con 0x7f475c100510 2024-03-04T09:26:23.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.371+0000 7f475b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f475c1065d0 0x7f475c1a3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:23.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.371+0000 7f475affd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f475c100510 0x7f475c198c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:23.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.371+0000 7f475b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f475c1065d0 0x7f475c1a3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35454/0 (socket says 172.21.15.82:35454) 2024-03-04T09:26:23.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.371+0000 7f475b7fe640 1 -- 172.21.15.82:0/526460006 learned_addr learned my addr 172.21.15.82:0/526460006 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:26:23.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.371+0000 7f475a7fc640 1 --2- 172.21.15.82:0/526460006 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f475c100ed0 0x7f475c199180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:23.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.372+0000 7f475b7fe640 1 -- 172.21.15.82:0/526460006 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f475c100510 msgr2=0x7f475c198c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:23.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.372+0000 7f475b7fe640 1 --2- 172.21.15.82:0/526460006 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f475c100510 0x7f475c198c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:23.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.372+0000 7f475b7fe640 1 -- 172.21.15.82:0/526460006 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f475c100ed0 msgr2=0x7f475c199180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:23.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.372+0000 7f475b7fe640 1 --2- 172.21.15.82:0/526460006 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f475c100ed0 0x7f475c199180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:23.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.372+0000 7f475b7fe640 1 -- 172.21.15.82:0/526460006 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f475c1a4200 con 0x7f475c1065d0 2024-03-04T09:26:23.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.372+0000 7f475affd640 1 --2- 172.21.15.82:0/526460006 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f475c100510 0x7f475c198c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:26:23.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.372+0000 7f475a7fc640 1 --2- 172.21.15.82:0/526460006 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f475c100ed0 0x7f475c199180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-04T09:26:23.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.372+0000 7f475b7fe640 1 --2- 172.21.15.82:0/526460006 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f475c1065d0 0x7f475c1a3cc0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f4754005cc0 tx=0x7f4754034ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:26:23.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.372+0000 7f4760893640 1 -- 172.21.15.82:0/526460006 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4754039050 con 0x7f475c1065d0 2024-03-04T09:26:23.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.372+0000 7f4760893640 1 -- 172.21.15.82:0/526460006 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f475403a040 con 0x7f475c1065d0 2024-03-04T09:26:23.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.372+0000 7f4761895640 1 -- 172.21.15.82:0/526460006 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f475c1a43d0 con 0x7f475c1065d0 2024-03-04T09:26:23.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.372+0000 7f4760893640 1 -- 172.21.15.82:0/526460006 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4754004590 con 0x7f475c1065d0 2024-03-04T09:26:23.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.372+0000 7f4761895640 1 -- 172.21.15.82:0/526460006 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f475c1a4890 con 0x7f475c1065d0 2024-03-04T09:26:23.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.373+0000 7f4761895640 1 -- 172.21.15.82:0/526460006 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f475c068810 con 0x7f475c1065d0 2024-03-04T09:26:23.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.374+0000 7f4760893640 1 -- 172.21.15.82:0/526460006 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 136887+0+0 (secure 0 0 0) 0x7f4754003970 con 0x7f475c1065d0 2024-03-04T09:26:23.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.374+0000 7f4760893640 1 --2- 172.21.15.82:0/526460006 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f47440a1f70 0x7f47440a4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:23.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.375+0000 7f4760893640 1 -- 172.21.15.82:0/526460006 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 9568+0+0 (secure 0 0 0) 0x7f47540f0b20 con 0x7f475c1065d0 2024-03-04T09:26:23.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.375+0000 7f475affd640 1 --2- 172.21.15.82:0/526460006 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f47440a1f70 0x7f47440a4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:23.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.375+0000 7f475affd640 1 --2- 172.21.15.82:0/526460006 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f47440a1f70 0x7f47440a4430 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f474c009f40 tx=0x7f474c005f90 comp rx=0 tx=0).ready entity=mgr.15543 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:26:23.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.379+0000 7f4760893640 1 -- 172.21.15.82:0/526460006 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f47540bd910 con 0x7f475c1065d0 2024-03-04T09:26:23.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.552+0000 7f4761895640 1 -- 172.21.15.82:0/526460006 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f475c1089c0 con 0x7f475c1065d0 2024-03-04T09:26:23.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.552+0000 7f4760893640 1 -- 172.21.15.82:0/526460006 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v106) v1 ==== 104+0+11 (secure 0 0 0) 0x7f47540bd210 con 0x7f475c1065d0 2024-03-04T09:26:23.549 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-03-04T09:26:23.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.554+0000 7f4761895640 1 -- 172.21.15.82:0/526460006 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f47440a1f70 msgr2=0x7f47440a4430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:23.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.554+0000 7f4761895640 1 --2- 172.21.15.82:0/526460006 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f47440a1f70 0x7f47440a4430 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f474c009f40 tx=0x7f474c005f90 comp rx=0 tx=0).stop 2024-03-04T09:26:23.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.554+0000 7f4761895640 1 -- 172.21.15.82:0/526460006 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f475c1065d0 msgr2=0x7f475c1a3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:23.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.554+0000 7f4761895640 1 --2- 172.21.15.82:0/526460006 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f475c1065d0 0x7f475c1a3cc0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f4754005cc0 tx=0x7f4754034ac0 comp rx=0 tx=0).stop 2024-03-04T09:26:23.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.554+0000 7f4761895640 1 -- 172.21.15.82:0/526460006 shutdown_connections 2024-03-04T09:26:23.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.554+0000 7f4761895640 1 --2- 172.21.15.82:0/526460006 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f47440a1f70 0x7f47440a4430 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:23.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.554+0000 7f4761895640 1 --2- 172.21.15.82:0/526460006 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f475c1065d0 0x7f475c1a3cc0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:23.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.554+0000 7f4761895640 1 --2- 172.21.15.82:0/526460006 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f475c100ed0 0x7f475c199180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:23.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.554+0000 7f4761895640 1 --2- 172.21.15.82:0/526460006 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f475c100510 0x7f475c198c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:23.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.554+0000 7f4761895640 1 -- 172.21.15.82:0/526460006 >> 172.21.15.82:0/526460006 conn(0x7f475c077630 msgr2=0x7f475c0ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:26:23.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.555+0000 7f4761895640 1 -- 172.21.15.82:0/526460006 shutdown_connections 2024-03-04T09:26:23.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.555+0000 7f4761895640 1 -- 172.21.15.82:0/526460006 wait complete. 2024-03-04T09:26:23.562 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-04T09:26:23.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.670+0000 7f11e02c9640 1 -- 172.21.15.82:0/1484870126 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11d81077d0 msgr2=0x7f11d8107bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:23.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.670+0000 7f11e02c9640 1 --2- 172.21.15.82:0/1484870126 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11d81077d0 0x7f11d8107bb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f11d4009960 tx=0x7f11d402bca0 comp rx=0 tx=0).stop 2024-03-04T09:26:23.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.670+0000 7f11e02c9640 1 -- 172.21.15.82:0/1484870126 shutdown_connections 2024-03-04T09:26:23.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.670+0000 7f11e02c9640 1 --2- 172.21.15.82:0/1484870126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11d8100850 0x7f11d810e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:23.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.670+0000 7f11e02c9640 1 --2- 172.21.15.82:0/1484870126 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11d80ffe90 0x7f11d8100310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:23.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.670+0000 7f11e02c9640 1 --2- 172.21.15.82:0/1484870126 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11d81077d0 0x7f11d8107bb0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:23.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.670+0000 7f11e02c9640 1 -- 172.21.15.82:0/1484870126 >> 172.21.15.82:0/1484870126 conn(0x7f11d8075810 msgr2=0x7f11d8075c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:26:23.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.670+0000 7f11e02c9640 1 -- 172.21.15.82:0/1484870126 shutdown_connections 2024-03-04T09:26:23.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.670+0000 7f11e02c9640 1 -- 172.21.15.82:0/1484870126 wait complete. 2024-03-04T09:26:23.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.671+0000 7f11e02c9640 1 Processor -- start 2024-03-04T09:26:23.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.671+0000 7f11e02c9640 1 -- start start 2024-03-04T09:26:23.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.671+0000 7f11e02c9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11d80ffe90 0x7f11d8197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:23.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.671+0000 7f11e02c9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11d8100850 0x7f11d8198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:23.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.671+0000 7f11e02c9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11d81077d0 0x7f11d819c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:23.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.671+0000 7f11e02c9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d8111a00 con 0x7f11d80ffe90 2024-03-04T09:26:23.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.671+0000 7f11e02c9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d8111880 con 0x7f11d8100850 2024-03-04T09:26:23.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.671+0000 7f11e02c9640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d8111b80 con 0x7f11d81077d0 2024-03-04T09:26:23.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.671+0000 7f11de065640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11d80ffe90 0x7f11d8197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:23.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.671+0000 7f11de065640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11d80ffe90 0x7f11d8197ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35472/0 (socket says 172.21.15.82:35472) 2024-03-04T09:26:23.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.671+0000 7f11de065640 1 -- 172.21.15.82:0/1518686731 learned_addr learned my addr 172.21.15.82:0/1518686731 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:26:23.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.671+0000 7f11dd864640 1 --2- 172.21.15.82:0/1518686731 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11d8100850 0x7f11d8198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:23.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.671+0000 7f11de866640 1 --2- 172.21.15.82:0/1518686731 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11d81077d0 0x7f11d819c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:23.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.671+0000 7f11de065640 1 -- 172.21.15.82:0/1518686731 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11d81077d0 msgr2=0x7f11d819c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:23.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.671+0000 7f11de065640 1 --2- 172.21.15.82:0/1518686731 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11d81077d0 0x7f11d819c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:23.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.671+0000 7f11de065640 1 -- 172.21.15.82:0/1518686731 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11d8100850 msgr2=0x7f11d8198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:23.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.671+0000 7f11de065640 1 --2- 172.21.15.82:0/1518686731 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11d8100850 0x7f11d8198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:23.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.671+0000 7f11de065640 1 -- 172.21.15.82:0/1518686731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d819ced0 con 0x7f11d80ffe90 2024-03-04T09:26:23.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.672+0000 7f11de065640 1 --2- 172.21.15.82:0/1518686731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11d80ffe90 0x7f11d8197ee0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f11d4005ab0 tx=0x7f11d4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:26:23.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.672+0000 7f11cf7fe640 1 -- 172.21.15.82:0/1518686731 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d4043020 con 0x7f11d80ffe90 2024-03-04T09:26:23.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.672+0000 7f11e02c9640 1 -- 172.21.15.82:0/1518686731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11d819d160 con 0x7f11d80ffe90 2024-03-04T09:26:23.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.672+0000 7f11cf7fe640 1 -- 172.21.15.82:0/1518686731 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f11d402c640 con 0x7f11d80ffe90 2024-03-04T09:26:23.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.672+0000 7f11cf7fe640 1 -- 172.21.15.82:0/1518686731 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d4003a50 con 0x7f11d80ffe90 2024-03-04T09:26:23.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.672+0000 7f11e02c9640 1 -- 172.21.15.82:0/1518686731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11d81a4a50 con 0x7f11d80ffe90 2024-03-04T09:26:23.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.673+0000 7f11e02c9640 1 -- 172.21.15.82:0/1518686731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11d80696e0 con 0x7f11d80ffe90 2024-03-04T09:26:23.673 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:23 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/2746984440' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-04T09:26:23.673 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:23 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/3297435920' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-04T09:26:23.673 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:23 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/1003106145' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:26:23.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.674+0000 7f11cf7fe640 1 -- 172.21.15.82:0/1518686731 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 136887+0+0 (secure 0 0 0) 0x7f11d4046020 con 0x7f11d80ffe90 2024-03-04T09:26:23.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.674+0000 7f11cf7fe640 1 --2- 172.21.15.82:0/1518686731 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f11c40a1ef0 0x7f11c40a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:23.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.674+0000 7f11dd864640 1 --2- 172.21.15.82:0/1518686731 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f11c40a1ef0 0x7f11c40a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:23.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.675+0000 7f11cf7fe640 1 -- 172.21.15.82:0/1518686731 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 9568+0+0 (secure 0 0 0) 0x7f11d40f0a80 con 0x7f11d80ffe90 2024-03-04T09:26:23.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.675+0000 7f11dd864640 1 --2- 172.21.15.82:0/1518686731 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f11c40a1ef0 0x7f11c40a43b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f11d8075e50 tx=0x7f11c8005f90 comp rx=0 tx=0).ready entity=mgr.15543 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:26:23.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.678+0000 7f11cf7fe640 1 -- 172.21.15.82:0/1518686731 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f11d404d020 con 0x7f11d80ffe90 2024-03-04T09:26:23.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:23 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/2746984440' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-04T09:26:23.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:23 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/3297435920' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-04T09:26:23.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:23 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/1003106145' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:26:23.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.851+0000 7f11e02c9640 1 -- 172.21.15.82:0/1518686731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f11d8109b10 con 0x7f11d80ffe90 2024-03-04T09:26:23.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.851+0000 7f11cf7fe640 1 -- 172.21.15.82:0/1518686731 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v106) v1 ==== 100+0+11 (secure 0 0 0) 0x7f11d40bd870 con 0x7f11d80ffe90 2024-03-04T09:26:23.848 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2024-03-04T09:26:23.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.853+0000 7f11e02c9640 1 -- 172.21.15.82:0/1518686731 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f11c40a1ef0 msgr2=0x7f11c40a43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:23.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.853+0000 7f11e02c9640 1 --2- 172.21.15.82:0/1518686731 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f11c40a1ef0 0x7f11c40a43b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f11d8075e50 tx=0x7f11c8005f90 comp rx=0 tx=0).stop 2024-03-04T09:26:23.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.853+0000 7f11e02c9640 1 -- 172.21.15.82:0/1518686731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11d80ffe90 msgr2=0x7f11d8197ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:23.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.853+0000 7f11e02c9640 1 --2- 172.21.15.82:0/1518686731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11d80ffe90 0x7f11d8197ee0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f11d4005ab0 tx=0x7f11d4004600 comp rx=0 tx=0).stop 2024-03-04T09:26:23.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.853+0000 7f11e02c9640 1 -- 172.21.15.82:0/1518686731 shutdown_connections 2024-03-04T09:26:23.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.853+0000 7f11e02c9640 1 --2- 172.21.15.82:0/1518686731 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f11c40a1ef0 0x7f11c40a43b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:23.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.853+0000 7f11e02c9640 1 --2- 172.21.15.82:0/1518686731 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11d81077d0 0x7f11d819c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:23.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.853+0000 7f11e02c9640 1 --2- 172.21.15.82:0/1518686731 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11d8100850 0x7f11d8198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:23.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.853+0000 7f11e02c9640 1 --2- 172.21.15.82:0/1518686731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11d80ffe90 0x7f11d8197ee0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:23.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.853+0000 7f11e02c9640 1 -- 172.21.15.82:0/1518686731 >> 172.21.15.82:0/1518686731 conn(0x7f11d8075810 msgr2=0x7f11d80fea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:26:23.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.853+0000 7f11e02c9640 1 -- 172.21.15.82:0/1518686731 shutdown_connections 2024-03-04T09:26:23.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.853+0000 7f11e02c9640 1 -- 172.21.15.82:0/1518686731 wait complete. 2024-03-04T09:26:23.861 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-04T09:26:23.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.968+0000 7f8be55a0640 1 -- 172.21.15.82:0/2111952804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8be01005a0 msgr2=0x7f8be0100980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:23.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.968+0000 7f8be55a0640 1 --2- 172.21.15.82:0/2111952804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8be01005a0 0x7f8be0100980 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4009900 tx=0x7f8bd402bc30 comp rx=0 tx=0).stop 2024-03-04T09:26:23.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.968+0000 7f8be55a0640 1 -- 172.21.15.82:0/2111952804 shutdown_connections 2024-03-04T09:26:23.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.968+0000 7f8be55a0640 1 --2- 172.21.15.82:0/2111952804 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8be0105670 0x7f8be010d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:23.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.968+0000 7f8be55a0640 1 --2- 172.21.15.82:0/2111952804 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8be0100f50 0x7f8be0104f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:23.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.968+0000 7f8be55a0640 1 --2- 172.21.15.82:0/2111952804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8be01005a0 0x7f8be0100980 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:23.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.968+0000 7f8be55a0640 1 -- 172.21.15.82:0/2111952804 >> 172.21.15.82:0/2111952804 conn(0x7f8be00fbe20 msgr2=0x7f8be00fe240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:26:23.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.968+0000 7f8be55a0640 1 -- 172.21.15.82:0/2111952804 shutdown_connections 2024-03-04T09:26:23.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.968+0000 7f8be55a0640 1 -- 172.21.15.82:0/2111952804 wait complete. 2024-03-04T09:26:23.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.969+0000 7f8be55a0640 1 Processor -- start 2024-03-04T09:26:23.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.969+0000 7f8be55a0640 1 -- start start 2024-03-04T09:26:23.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.969+0000 7f8be55a0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8be01005a0 0x7f8be019c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:23.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.969+0000 7f8be55a0640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8be0105670 0x7f8be019ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:23.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.969+0000 7f8be55a0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8be0196b30 0x7f8be0196fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:23.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.969+0000 7f8be55a0640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be0110710 con 0x7f8be01005a0 2024-03-04T09:26:23.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.969+0000 7f8be55a0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be0110590 con 0x7f8be0196b30 2024-03-04T09:26:23.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.969+0000 7f8be55a0640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be0110890 con 0x7f8be0105670 2024-03-04T09:26:23.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.969+0000 7f8bdffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8be01005a0 0x7f8be019c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:23.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.970+0000 7f8bdffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8be01005a0 0x7f8be019c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35500/0 (socket says 172.21.15.82:35500) 2024-03-04T09:26:23.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.970+0000 7f8bdffff640 1 -- 172.21.15.82:0/1273552351 learned_addr learned my addr 172.21.15.82:0/1273552351 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:26:23.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.970+0000 7f8bdf7fe640 1 --2- 172.21.15.82:0/1273552351 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8be0105670 0x7f8be019ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:23.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.970+0000 7f8be4d9f640 1 --2- 172.21.15.82:0/1273552351 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8be0196b30 0x7f8be0196fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:23.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.970+0000 7f8bdffff640 1 -- 172.21.15.82:0/1273552351 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8be0105670 msgr2=0x7f8be019ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:23.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.970+0000 7f8bdffff640 1 --2- 172.21.15.82:0/1273552351 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8be0105670 0x7f8be019ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:23.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.970+0000 7f8bdffff640 1 -- 172.21.15.82:0/1273552351 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8be0196b30 msgr2=0x7f8be0196fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:23.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.970+0000 7f8bdffff640 1 --2- 172.21.15.82:0/1273552351 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8be0196b30 0x7f8be0196fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:23.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.970+0000 7f8bdffff640 1 -- 172.21.15.82:0/1273552351 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be0197650 con 0x7f8be01005a0 2024-03-04T09:26:23.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.970+0000 7f8be4d9f640 1 --2- 172.21.15.82:0/1273552351 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8be0196b30 0x7f8be0196fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T09:26:23.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.970+0000 7f8bdffff640 1 --2- 172.21.15.82:0/1273552351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8be01005a0 0x7f8be019c930 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4005940 tx=0x7f8bd40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:26:23.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.970+0000 7f8bdd7fa640 1 -- 172.21.15.82:0/1273552351 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd4043020 con 0x7f8be01005a0 2024-03-04T09:26:23.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.970+0000 7f8be55a0640 1 -- 172.21.15.82:0/1273552351 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8be01978e0 con 0x7f8be01005a0 2024-03-04T09:26:23.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.970+0000 7f8bdd7fa640 1 -- 172.21.15.82:0/1273552351 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f8bd402c5d0 con 0x7f8be01005a0 2024-03-04T09:26:23.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.970+0000 7f8bdd7fa640 1 -- 172.21.15.82:0/1273552351 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd4003a10 con 0x7f8be01005a0 2024-03-04T09:26:23.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.970+0000 7f8be55a0640 1 -- 172.21.15.82:0/1273552351 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8be01a3ae0 con 0x7f8be01005a0 2024-03-04T09:26:23.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.971+0000 7f8be55a0640 1 -- 172.21.15.82:0/1273552351 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8be00682e0 con 0x7f8be01005a0 2024-03-04T09:26:23.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.972+0000 7f8bdd7fa640 1 -- 172.21.15.82:0/1273552351 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 136887+0+0 (secure 0 0 0) 0x7f8bd4046020 con 0x7f8be01005a0 2024-03-04T09:26:23.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.973+0000 7f8bdd7fa640 1 --2- 172.21.15.82:0/1273552351 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f8bc80a1ef0 0x7f8bc80a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:23.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.973+0000 7f8bdf7fe640 1 --2- 172.21.15.82:0/1273552351 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f8bc80a1ef0 0x7f8bc80a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:23.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.973+0000 7f8bdd7fa640 1 -- 172.21.15.82:0/1273552351 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 9568+0+0 (secure 0 0 0) 0x7f8bd40f0550 con 0x7f8be01005a0 2024-03-04T09:26:23.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.973+0000 7f8bdf7fe640 1 --2- 172.21.15.82:0/1273552351 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f8bc80a1ef0 0x7f8bc80a43b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8be0106cd0 tx=0x7f8bd0005f90 comp rx=0 tx=0).ready entity=mgr.15543 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:26:23.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:23.976+0000 7f8bdd7fa640 1 -- 172.21.15.82:0/1273552351 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f8bd404d070 con 0x7f8be01005a0 2024-03-04T09:26:24.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.151+0000 7f8be55a0640 1 -- 172.21.15.82:0/1273552351 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f8be01088a0 con 0x7f8be01005a0 2024-03-04T09:26:24.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.152+0000 7f8bdd7fa640 1 -- 172.21.15.82:0/1273552351 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v106) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8bd40bd340 con 0x7f8be01005a0 2024-03-04T09:26:24.148 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-03-04T09:26:24.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.154+0000 7f8be55a0640 1 -- 172.21.15.82:0/1273552351 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f8bc80a1ef0 msgr2=0x7f8bc80a43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:24.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.154+0000 7f8be55a0640 1 --2- 172.21.15.82:0/1273552351 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f8bc80a1ef0 0x7f8bc80a43b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8be0106cd0 tx=0x7f8bd0005f90 comp rx=0 tx=0).stop 2024-03-04T09:26:24.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.154+0000 7f8be55a0640 1 -- 172.21.15.82:0/1273552351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8be01005a0 msgr2=0x7f8be019c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:24.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.154+0000 7f8be55a0640 1 --2- 172.21.15.82:0/1273552351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8be01005a0 0x7f8be019c930 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4005940 tx=0x7f8bd40045e0 comp rx=0 tx=0).stop 2024-03-04T09:26:24.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.154+0000 7f8be55a0640 1 -- 172.21.15.82:0/1273552351 shutdown_connections 2024-03-04T09:26:24.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.154+0000 7f8be55a0640 1 --2- 172.21.15.82:0/1273552351 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f8bc80a1ef0 0x7f8bc80a43b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:24.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.154+0000 7f8be55a0640 1 --2- 172.21.15.82:0/1273552351 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8be0196b30 0x7f8be0196fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:24.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.154+0000 7f8be55a0640 1 --2- 172.21.15.82:0/1273552351 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8be0105670 0x7f8be019ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:24.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.154+0000 7f8be55a0640 1 --2- 172.21.15.82:0/1273552351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8be01005a0 0x7f8be019c930 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:24.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.154+0000 7f8be55a0640 1 -- 172.21.15.82:0/1273552351 >> 172.21.15.82:0/1273552351 conn(0x7f8be00fbe20 msgr2=0x7f8be00fd150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:26:24.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.154+0000 7f8be55a0640 1 -- 172.21.15.82:0/1273552351 shutdown_connections 2024-03-04T09:26:24.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.154+0000 7f8be55a0640 1 -- 172.21.15.82:0/1273552351 wait complete. 2024-03-04T09:26:24.162 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-04T09:26:24.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.268+0000 7f714d447640 1 -- 172.21.15.82:0/3227535474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7148101210 msgr2=0x7f71481015f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:24.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.268+0000 7f714d447640 1 --2- 172.21.15.82:0/3227535474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7148101210 0x7f71481015f0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f713c009900 tx=0x7f713c02bc30 comp rx=0 tx=0).stop 2024-03-04T09:26:24.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.268+0000 7f714d447640 1 -- 172.21.15.82:0/3227535474 shutdown_connections 2024-03-04T09:26:24.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.268+0000 7f714d447640 1 --2- 172.21.15.82:0/3227535474 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7148105890 0x7f714810d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:24.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.268+0000 7f714d447640 1 --2- 172.21.15.82:0/3227535474 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7148101bc0 0x7f7148105160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:24.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.268+0000 7f714d447640 1 --2- 172.21.15.82:0/3227535474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7148101210 0x7f71481015f0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:24.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.268+0000 7f714d447640 1 -- 172.21.15.82:0/3227535474 >> 172.21.15.82:0/3227535474 conn(0x7f7148075810 msgr2=0x7f7148075c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:26:24.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.268+0000 7f714d447640 1 -- 172.21.15.82:0/3227535474 shutdown_connections 2024-03-04T09:26:24.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.268+0000 7f714d447640 1 -- 172.21.15.82:0/3227535474 wait complete. 2024-03-04T09:26:24.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.269+0000 7f714d447640 1 Processor -- start 2024-03-04T09:26:24.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.269+0000 7f714d447640 1 -- start start 2024-03-04T09:26:24.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.269+0000 7f714d447640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7148101210 0x7f714810dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:24.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.269+0000 7f714d447640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7148105890 0x7f714810e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:24.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.269+0000 7f714d447640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f714810e7e0 0x7f71481a6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:24.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.269+0000 7f714d447640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71481119a0 con 0x7f714810e7e0 2024-03-04T09:26:24.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.269+0000 7f714d447640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7148111820 con 0x7f7148101210 2024-03-04T09:26:24.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.269+0000 7f714d447640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7148111b20 con 0x7f7148105890 2024-03-04T09:26:24.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.269+0000 7f71477fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f714810e7e0 0x7f71481a6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:24.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.269+0000 7f71477fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f714810e7e0 0x7f71481a6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35508/0 (socket says 172.21.15.82:35508) 2024-03-04T09:26:24.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.269+0000 7f71477fe640 1 -- 172.21.15.82:0/368542707 learned_addr learned my addr 172.21.15.82:0/368542707 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:26:24.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.269+0000 7f7146ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7148101210 0x7f714810dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:24.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.269+0000 7f71467fc640 1 --2- 172.21.15.82:0/368542707 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7148105890 0x7f714810e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:24.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.269+0000 7f71477fe640 1 -- 172.21.15.82:0/368542707 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7148105890 msgr2=0x7f714810e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:24.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.269+0000 7f71477fe640 1 --2- 172.21.15.82:0/368542707 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7148105890 0x7f714810e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:24.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.269+0000 7f71477fe640 1 -- 172.21.15.82:0/368542707 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7148101210 msgr2=0x7f714810dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:24.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.269+0000 7f71477fe640 1 --2- 172.21.15.82:0/368542707 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7148101210 0x7f714810dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:24.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.269+0000 7f71477fe640 1 -- 172.21.15.82:0/368542707 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71481a6710 con 0x7f714810e7e0 2024-03-04T09:26:24.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.269+0000 7f71477fe640 1 --2- 172.21.15.82:0/368542707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f714810e7e0 0x7f71481a6010 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f714000eb10 tx=0x7f714000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:26:24.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.270+0000 7f712ffff640 1 -- 172.21.15.82:0/368542707 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7140004b20 con 0x7f714810e7e0 2024-03-04T09:26:24.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.270+0000 7f714d447640 1 -- 172.21.15.82:0/368542707 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71481a6a00 con 0x7f714810e7e0 2024-03-04T09:26:24.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.270+0000 7f712ffff640 1 -- 172.21.15.82:0/368542707 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f7140004cc0 con 0x7f714810e7e0 2024-03-04T09:26:24.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.270+0000 7f712ffff640 1 -- 172.21.15.82:0/368542707 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71400106a0 con 0x7f714810e7e0 2024-03-04T09:26:24.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.270+0000 7f714d447640 1 -- 172.21.15.82:0/368542707 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71481a6f50 con 0x7f714810e7e0 2024-03-04T09:26:24.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.271+0000 7f714d447640 1 -- 172.21.15.82:0/368542707 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7148068810 con 0x7f714810e7e0 2024-03-04T09:26:24.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.272+0000 7f712ffff640 1 -- 172.21.15.82:0/368542707 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 136887+0+0 (secure 0 0 0) 0x7f7140004e70 con 0x7f714810e7e0 2024-03-04T09:26:24.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.272+0000 7f712ffff640 1 --2- 172.21.15.82:0/368542707 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f71300a1f20 0x7f71300a43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:24.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.272+0000 7f7146ffd640 1 --2- 172.21.15.82:0/368542707 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f71300a1f20 0x7f71300a43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:24.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.272+0000 7f712ffff640 1 -- 172.21.15.82:0/368542707 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 9568+0+0 (secure 0 0 0) 0x7f71400ceb80 con 0x7f714810e7e0 2024-03-04T09:26:24.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.273+0000 7f7146ffd640 1 --2- 172.21.15.82:0/368542707 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f71300a1f20 0x7f71300a43e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f713c005ab0 tx=0x7f713c005fd0 comp rx=0 tx=0).ready entity=mgr.15543 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:26:24.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.277+0000 7f712ffff640 1 -- 172.21.15.82:0/368542707 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f714009b860 con 0x7f714810e7e0 2024-03-04T09:26:24.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.464+0000 7f714d447640 1 -- 172.21.15.82:0/368542707 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f714810f290 con 0x7f714810e7e0 2024-03-04T09:26:24.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.464+0000 7f712ffff640 1 -- 172.21.15.82:0/368542707 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 17 entries v106) v1 ==== 81+0+1000 (secure 0 0 0) 0x7f714810f290 con 0x7f714810e7e0 2024-03-04T09:26:24.461 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/984630078 2024-03-05T09:06:12.169231+0000 2024-03-04T09:26:24.461 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/3291527077 2024-03-05T09:05:44.913099+0000 2024-03-04T09:26:24.461 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3757201752 2024-03-05T09:06:12.169231+0000 2024-03-04T09:26:24.462 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1846720385 2024-03-05T09:05:44.913099+0000 2024-03-04T09:26:24.462 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/3291527077 2024-03-05T09:05:44.913099+0000 2024-03-04T09:26:24.462 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/2402774828 2024-03-05T09:05:44.913099+0000 2024-03-04T09:26:24.462 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/2876711373 2024-03-05T09:15:39.302003+0000 2024-03-04T09:26:24.462 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/735262841 2024-03-05T09:05:44.913099+0000 2024-03-04T09:26:24.462 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/1901539016 2024-03-05T09:06:12.169231+0000 2024-03-04T09:26:24.462 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1124105204 2024-03-05T09:06:12.169231+0000 2024-03-04T09:26:24.462 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/1901539016 2024-03-05T09:06:12.169231+0000 2024-03-04T09:26:24.462 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/566891801 2024-03-05T09:15:39.302003+0000 2024-03-04T09:26:24.462 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3558395162 2024-03-05T09:15:39.302003+0000 2024-03-04T09:26:24.462 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/406948853 2024-03-04T10:20:35.560456+0000 2024-03-04T09:26:24.462 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/1278635224 2024-03-05T09:15:39.302003+0000 2024-03-04T09:26:24.462 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/1278635224 2024-03-05T09:15:39.302003+0000 2024-03-04T09:26:24.462 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/2438787300 2024-03-05T09:15:39.302003+0000 2024-03-04T09:26:24.463 INFO:teuthology.orchestra.run.smithi082.stderr:listed 17 entries 2024-03-04T09:26:24.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.466+0000 7f714d447640 1 -- 172.21.15.82:0/368542707 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f71300a1f20 msgr2=0x7f71300a43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:24.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.466+0000 7f714d447640 1 --2- 172.21.15.82:0/368542707 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f71300a1f20 0x7f71300a43e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f713c005ab0 tx=0x7f713c005fd0 comp rx=0 tx=0).stop 2024-03-04T09:26:24.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.466+0000 7f714d447640 1 -- 172.21.15.82:0/368542707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f714810e7e0 msgr2=0x7f71481a6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:24.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.466+0000 7f714d447640 1 --2- 172.21.15.82:0/368542707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f714810e7e0 0x7f71481a6010 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f714000eb10 tx=0x7f714000c2d0 comp rx=0 tx=0).stop 2024-03-04T09:26:24.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.466+0000 7f714d447640 1 -- 172.21.15.82:0/368542707 shutdown_connections 2024-03-04T09:26:24.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.466+0000 7f714d447640 1 --2- 172.21.15.82:0/368542707 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f71300a1f20 0x7f71300a43e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:24.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.466+0000 7f714d447640 1 --2- 172.21.15.82:0/368542707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f714810e7e0 0x7f71481a6010 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:24.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.466+0000 7f714d447640 1 --2- 172.21.15.82:0/368542707 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7148105890 0x7f714810e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:24.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.466+0000 7f714d447640 1 --2- 172.21.15.82:0/368542707 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7148101210 0x7f714810dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:24.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.466+0000 7f714d447640 1 -- 172.21.15.82:0/368542707 >> 172.21.15.82:0/368542707 conn(0x7f7148075810 msgr2=0x7f71480fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:26:24.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.466+0000 7f714d447640 1 -- 172.21.15.82:0/368542707 shutdown_connections 2024-03-04T09:26:24.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:24.467+0000 7f714d447640 1 -- 172.21.15.82:0/368542707 wait complete. 2024-03-04T09:26:24.473 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:24 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/4280052450' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-04T09:26:24.473 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:24 smithi082 ceph-mon[32880]: pgmap v336: 129 pgs: 129 active+clean; 117 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2024-03-04T09:26:24.473 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:24 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/526460006' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-04T09:26:24.473 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:24 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/1518686731' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-04T09:26:24.473 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:24 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/1273552351' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-04T09:26:24.474 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi082.front.sepia.ceph.com... 2024-03-04T09:26:24.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T09:26:24.474 DEBUG:teuthology.orchestra.run.smithi082:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-03-04T09:26:24.501 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:ceph-fuse[86598]: fuse finished with error 0 and tester_r 0 2024-03-04T09:26:24.502 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T09:26:24.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:24 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/4280052450' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-04T09:26:24.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:24 smithi190 ceph-mon[36341]: pgmap v336: 129 pgs: 129 active+clean; 117 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2024-03-04T09:26:24.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:24 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/526460006' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-04T09:26:24.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:24 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/1518686731' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-04T09:26:24.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:24 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/1273552351' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-04T09:26:24.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:24 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/4280052450' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-04T09:26:24.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:24 smithi102 ceph-mon[36220]: pgmap v336: 129 pgs: 129 active+clean; 117 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2024-03-04T09:26:24.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:24 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/526460006' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-04T09:26:24.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:24 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/1518686731' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-04T09:26:24.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:24 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/1273552351' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-03-04T09:26:25.317 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:25 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/368542707' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-04T09:26:25.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:25 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/368542707' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-04T09:26:25.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:25 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/368542707' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-04T09:26:26.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:26 smithi082 ceph-mon[32880]: pgmap v337: 129 pgs: 129 active+clean; 117 MiB data, 891 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-03-04T09:26:26.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:26 smithi190 ceph-mon[36341]: pgmap v337: 129 pgs: 129 active+clean; 117 MiB data, 891 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-03-04T09:26:26.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:26 smithi102 ceph-mon[36220]: pgmap v337: 129 pgs: 129 active+clean; 117 MiB data, 891 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-03-04T09:26:27.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:27 smithi190 ceph-mon[36341]: pgmap v338: 129 pgs: 129 active+clean; 117 MiB data, 891 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-03-04T09:26:27.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:27 smithi102 ceph-mon[36220]: pgmap v338: 129 pgs: 129 active+clean; 117 MiB data, 891 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-03-04T09:26:28.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:27 smithi082 ceph-mon[32880]: pgmap v338: 129 pgs: 129 active+clean; 117 MiB data, 891 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-03-04T09:26:29.921 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:29 smithi190 ceph-mon[36341]: pgmap v339: 129 pgs: 129 active+clean; 117 MiB data, 891 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-03-04T09:26:29.929 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:29 smithi102 ceph-mon[36220]: pgmap v339: 129 pgs: 129 active+clean; 117 MiB data, 891 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-03-04T09:26:30.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:29 smithi082 ceph-mon[32880]: pgmap v339: 129 pgs: 129 active+clean; 117 MiB data, 891 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-03-04T09:26:30.603 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2024-03-04T09:26:30.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T09:26:30.603 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-04T09:26:30.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T09:26:30.623 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-03-04T09:26:30.680 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-04T09:26:30.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T09:26:30.681 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-04T09:26:30.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-04T09:26:30.752 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link delete ceph-brx 2024-03-04T09:26:30.853 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-03-04T09:26:30.864 INFO:tasks.cephadm:Teardown begin 2024-03-04T09:26:30.864 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-04T09:26:30.864 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T09:26:30.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:30.973+0000 7f4f6331e640 1 -- 172.21.15.82:0/4206938400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f5c100450 msgr2=0x7f4f5c10e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:30.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:30.973+0000 7f4f6331e640 1 --2- 172.21.15.82:0/4206938400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f5c100450 0x7f4f5c10e450 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f4f54009cd0 tx=0x7f4f5402c0f0 comp rx=0 tx=0).stop 2024-03-04T09:26:30.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:30.973+0000 7f4f6331e640 1 -- 172.21.15.82:0/4206938400 shutdown_connections 2024-03-04T09:26:30.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:30.973+0000 7f4f6331e640 1 --2- 172.21.15.82:0/4206938400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f5c100450 0x7f4f5c10e450 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:30.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:30.973+0000 7f4f6331e640 1 --2- 172.21.15.82:0/4206938400 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4f5c0ffad0 0x7f4f5c0fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:30.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:30.973+0000 7f4f6331e640 1 --2- 172.21.15.82:0/4206938400 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f5c107590 0x7f4f5c107970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:30.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:30.973+0000 7f4f6331e640 1 -- 172.21.15.82:0/4206938400 >> 172.21.15.82:0/4206938400 conn(0x7f4f5c076a60 msgr2=0x7f4f5c0fdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:26:30.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:30.973+0000 7f4f6331e640 1 -- 172.21.15.82:0/4206938400 shutdown_connections 2024-03-04T09:26:30.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:30.973+0000 7f4f6331e640 1 -- 172.21.15.82:0/4206938400 wait complete. 2024-03-04T09:26:30.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:30.973+0000 7f4f6331e640 1 Processor -- start 2024-03-04T09:26:30.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:30.974+0000 7f4f6331e640 1 -- start start 2024-03-04T09:26:30.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:30.974+0000 7f4f6331e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f5c0ffad0 0x7f4f5c197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:30.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:30.974+0000 7f4f6331e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4f5c100450 0x7f4f5c198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:30.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:30.974+0000 7f4f6331e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f5c107590 0x7f4f5c19c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:30.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:30.974+0000 7f4f6331e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5c111960 con 0x7f4f5c0ffad0 2024-03-04T09:26:30.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:30.974+0000 7f4f6331e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5c1117e0 con 0x7f4f5c107590 2024-03-04T09:26:30.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:30.974+0000 7f4f6331e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5c111ae0 con 0x7f4f5c100450 2024-03-04T09:26:30.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:30.974+0000 7f4f610ba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f5c0ffad0 0x7f4f5c197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:30.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:30.974+0000 7f4f610ba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f5c0ffad0 0x7f4f5c197e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57114/0 (socket says 172.21.15.82:57114) 2024-03-04T09:26:30.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:30.974+0000 7f4f610ba640 1 -- 172.21.15.82:0/1879046118 learned_addr learned my addr 172.21.15.82:0/1879046118 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:26:30.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:30.974+0000 7f4f608b9640 1 --2- 172.21.15.82:0/1879046118 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4f5c100450 0x7f4f5c198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:30.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:30.974+0000 7f4f618bb640 1 --2- 172.21.15.82:0/1879046118 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f5c107590 0x7f4f5c19c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:30.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:30.974+0000 7f4f610ba640 1 -- 172.21.15.82:0/1879046118 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4f5c100450 msgr2=0x7f4f5c198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:30.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:30.974+0000 7f4f610ba640 1 --2- 172.21.15.82:0/1879046118 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4f5c100450 0x7f4f5c198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:30.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:30.974+0000 7f4f610ba640 1 -- 172.21.15.82:0/1879046118 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f5c107590 msgr2=0x7f4f5c19c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:30.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:30.974+0000 7f4f610ba640 1 --2- 172.21.15.82:0/1879046118 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f5c107590 0x7f4f5c19c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:30.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:30.974+0000 7f4f610ba640 1 -- 172.21.15.82:0/1879046118 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f5c19ce30 con 0x7f4f5c0ffad0 2024-03-04T09:26:30.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:30.974+0000 7f4f610ba640 1 --2- 172.21.15.82:0/1879046118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f5c0ffad0 0x7f4f5c197e40 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f4f5800ea60 tx=0x7f4f5800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:26:30.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:30.974+0000 7f4f527fc640 1 -- 172.21.15.82:0/1879046118 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5800cde0 con 0x7f4f5c0ffad0 2024-03-04T09:26:30.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:30.974+0000 7f4f527fc640 1 -- 172.21.15.82:0/1879046118 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f4f580035f0 con 0x7f4f5c0ffad0 2024-03-04T09:26:30.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:30.974+0000 7f4f6331e640 1 -- 172.21.15.82:0/1879046118 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f5c19d120 con 0x7f4f5c0ffad0 2024-03-04T09:26:30.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:30.974+0000 7f4f527fc640 1 -- 172.21.15.82:0/1879046118 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f58010690 con 0x7f4f5c0ffad0 2024-03-04T09:26:30.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:30.974+0000 7f4f6331e640 1 -- 172.21.15.82:0/1879046118 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f5c1a49b0 con 0x7f4f5c0ffad0 2024-03-04T09:26:30.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:30.975+0000 7f4f6331e640 1 -- 172.21.15.82:0/1879046118 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f5c068810 con 0x7f4f5c0ffad0 2024-03-04T09:26:30.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:30.976+0000 7f4f527fc640 1 -- 172.21.15.82:0/1879046118 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 136887+0+0 (secure 0 0 0) 0x7f4f580037a0 con 0x7f4f5c0ffad0 2024-03-04T09:26:30.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:30.977+0000 7f4f527fc640 1 --2- 172.21.15.82:0/1879046118 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f4f480a1ef0 0x7f4f480a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:30.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:30.977+0000 7f4f608b9640 1 --2- 172.21.15.82:0/1879046118 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f4f480a1ef0 0x7f4f480a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:30.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:30.977+0000 7f4f527fc640 1 -- 172.21.15.82:0/1879046118 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 9568+0+0 (secure 0 0 0) 0x7f4f580ce820 con 0x7f4f5c0ffad0 2024-03-04T09:26:30.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:30.977+0000 7f4f608b9640 1 --2- 172.21.15.82:0/1879046118 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f4f480a1ef0 0x7f4f480a43b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c0fda30 tx=0x7f4f4c005f90 comp rx=0 tx=0).ready entity=mgr.15543 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:26:30.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:30.981+0000 7f4f527fc640 1 -- 172.21.15.82:0/1879046118 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f4f5809b500 con 0x7f4f5c0ffad0 2024-03-04T09:26:31.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.193+0000 7f4f6331e640 1 -- 172.21.15.82:0/1879046118 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4f5c199190 con 0x7f4f5c0ffad0 2024-03-04T09:26:31.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.194+0000 7f4f527fc640 1 -- 172.21.15.82:0/1879046118 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+11462 (secure 0 0 0) 0x7f4f5809ae00 con 0x7f4f5c0ffad0 2024-03-04T09:26:31.191 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:26:31.191 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":58,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3123844705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3123844705},{"type":"v1","addr":"172.21.15.82:6835","nonce":3123844705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2620634252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2620634252},{"type":"v1","addr":"172.21.15.82:6837","nonce":2620634252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":58,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-04T09:13:10.076732+0000","modified":"2024-03-04T09:21:43.455764+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24476,"mds_1":24469,"mds_2":24451,"mds_3":24449,"mds_4":24439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14613":{"gid":14613,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/1240838024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1240838024},{"type":"v1","addr":"172.21.15.82:6839","nonce":1240838024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14625":{"gid":14625,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/213594267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":213594267},{"type":"v1","addr":"172.21.15.82:6841","nonce":213594267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24398":{"gid":24398,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/1142302200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":1142302200},{"type":"v1","addr":"172.21.15.102:6833","nonce":1142302200}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24403":{"gid":24403,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6833/3023382814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":3023382814},{"type":"v1","addr":"172.21.15.190:6833","nonce":3023382814}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24422":{"gid":24422,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6835/2134310473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":2134310473},{"type":"v1","addr":"172.21.15.102:6835","nonce":2134310473}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24439":{"gid":24439,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":14,"addr":"172.21.15.190:6835/3183532624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3183532624},{"type":"v1","addr":"172.21.15.190:6835","nonce":3183532624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24449":{"gid":24449,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":12,"addr":"172.21.15.102:6837/1210579527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1210579527},{"type":"v1","addr":"172.21.15.102:6837","nonce":1210579527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24451":{"gid":24451,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.190:6837/1198639527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":1198639527},{"type":"v1","addr":"172.21.15.190:6837","nonce":1198639527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.190:6839/878555510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":878555510},{"type":"v1","addr":"172.21.15.190:6839","nonce":878555510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6839/35424130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":35424130},{"type":"v1","addr":"172.21.15.102:6839","nonce":35424130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476,24469,24451,24439,24449]},"id":1}]} 2024-03-04T09:26:31.191 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 58 2024-03-04T09:26:31.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.196+0000 7f4f6331e640 1 -- 172.21.15.82:0/1879046118 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f4f480a1ef0 msgr2=0x7f4f480a43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:31.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.196+0000 7f4f6331e640 1 --2- 172.21.15.82:0/1879046118 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f4f480a1ef0 0x7f4f480a43b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c0fda30 tx=0x7f4f4c005f90 comp rx=0 tx=0).stop 2024-03-04T09:26:31.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.196+0000 7f4f6331e640 1 -- 172.21.15.82:0/1879046118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f5c0ffad0 msgr2=0x7f4f5c197e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:31.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.196+0000 7f4f6331e640 1 --2- 172.21.15.82:0/1879046118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f5c0ffad0 0x7f4f5c197e40 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f4f5800ea60 tx=0x7f4f5800ef20 comp rx=0 tx=0).stop 2024-03-04T09:26:31.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.197+0000 7f4f6331e640 1 -- 172.21.15.82:0/1879046118 shutdown_connections 2024-03-04T09:26:31.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.197+0000 7f4f6331e640 1 --2- 172.21.15.82:0/1879046118 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f4f480a1ef0 0x7f4f480a43b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:31.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.197+0000 7f4f6331e640 1 --2- 172.21.15.82:0/1879046118 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f5c107590 0x7f4f5c19c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:31.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.197+0000 7f4f6331e640 1 --2- 172.21.15.82:0/1879046118 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4f5c100450 0x7f4f5c198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:31.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.197+0000 7f4f6331e640 1 --2- 172.21.15.82:0/1879046118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f5c0ffad0 0x7f4f5c197e40 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:31.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.197+0000 7f4f6331e640 1 -- 172.21.15.82:0/1879046118 >> 172.21.15.82:0/1879046118 conn(0x7f4f5c076a60 msgr2=0x7f4f5c0fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:26:31.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.197+0000 7f4f6331e640 1 -- 172.21.15.82:0/1879046118 shutdown_connections 2024-03-04T09:26:31.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.197+0000 7f4f6331e640 1 -- 172.21.15.82:0/1879046118 wait complete. 2024-03-04T09:26:31.205 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-04T09:26:31.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.312+0000 7f71a05bf640 1 -- 172.21.15.82:0/3038978326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7198100e90 msgr2=0x7f719810d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:31.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.312+0000 7f71a05bf640 1 --2- 172.21.15.82:0/3038978326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7198100e90 0x7f719810d370 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f7190009ca0 tx=0x7f719002c0f0 comp rx=0 tx=0).stop 2024-03-04T09:26:31.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.313+0000 7f71a05bf640 1 -- 172.21.15.82:0/3038978326 shutdown_connections 2024-03-04T09:26:31.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.313+0000 7f71a05bf640 1 --2- 172.21.15.82:0/3038978326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7198100e90 0x7f719810d370 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:31.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.313+0000 7f71a05bf640 1 --2- 172.21.15.82:0/3038978326 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f71981004d0 0x7f7198100950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:31.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.313+0000 7f71a05bf640 1 --2- 172.21.15.82:0/3038978326 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7198106660 0x7f7198106a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:31.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.313+0000 7f71a05bf640 1 -- 172.21.15.82:0/3038978326 >> 172.21.15.82:0/3038978326 conn(0x7f71980775d0 msgr2=0x7f71980779e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:26:31.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.313+0000 7f71a05bf640 1 -- 172.21.15.82:0/3038978326 shutdown_connections 2024-03-04T09:26:31.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.313+0000 7f71a05bf640 1 -- 172.21.15.82:0/3038978326 wait complete. 2024-03-04T09:26:31.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.313+0000 7f71a05bf640 1 Processor -- start 2024-03-04T09:26:31.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.313+0000 7f71a05bf640 1 -- start start 2024-03-04T09:26:31.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.313+0000 7f71a05bf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71981004d0 0x7f7198197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:31.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.313+0000 7f71a05bf640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7198100e90 0x7f7198198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:31.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.313+0000 7f71a05bf640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7198106660 0x7f719819c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:31.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.313+0000 7f71a05bf640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7198110880 con 0x7f7198100e90 2024-03-04T09:26:31.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.313+0000 7f71a05bf640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7198110700 con 0x7f71981004d0 2024-03-04T09:26:31.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.313+0000 7f71a05bf640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7198110a00 con 0x7f7198106660 2024-03-04T09:26:31.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.313+0000 7f719db5a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7198100e90 0x7f7198198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:31.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.313+0000 7f719db5a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7198100e90 0x7f7198198310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57136/0 (socket says 172.21.15.82:57136) 2024-03-04T09:26:31.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.313+0000 7f719db5a640 1 -- 172.21.15.82:0/3398346097 learned_addr learned my addr 172.21.15.82:0/3398346097 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:26:31.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.314+0000 7f719e35b640 1 --2- 172.21.15.82:0/3398346097 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71981004d0 0x7f7198197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:31.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.314+0000 7f719eb5c640 1 --2- 172.21.15.82:0/3398346097 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7198106660 0x7f719819c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:31.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.314+0000 7f719db5a640 1 -- 172.21.15.82:0/3398346097 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7198106660 msgr2=0x7f719819c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:31.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.314+0000 7f719db5a640 1 --2- 172.21.15.82:0/3398346097 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7198106660 0x7f719819c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:31.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.314+0000 7f719db5a640 1 -- 172.21.15.82:0/3398346097 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71981004d0 msgr2=0x7f7198197dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:31.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.314+0000 7f719db5a640 1 --2- 172.21.15.82:0/3398346097 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71981004d0 0x7f7198197dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:31.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.314+0000 7f719db5a640 1 -- 172.21.15.82:0/3398346097 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f719819cdc0 con 0x7f7198100e90 2024-03-04T09:26:31.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.314+0000 7f719db5a640 1 --2- 172.21.15.82:0/3398346097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7198100e90 0x7f7198198310 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f718800e9f0 tx=0x7f718800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:26:31.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.314+0000 7f718f7fe640 1 -- 172.21.15.82:0/3398346097 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718800cd80 con 0x7f7198100e90 2024-03-04T09:26:31.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.314+0000 7f718f7fe640 1 -- 172.21.15.82:0/3398346097 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f71880054f0 con 0x7f7198100e90 2024-03-04T09:26:31.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.314+0000 7f71a05bf640 1 -- 172.21.15.82:0/3398346097 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f719819d0b0 con 0x7f7198100e90 2024-03-04T09:26:31.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.314+0000 7f718f7fe640 1 -- 172.21.15.82:0/3398346097 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7188010690 con 0x7f7198100e90 2024-03-04T09:26:31.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.314+0000 7f71a05bf640 1 -- 172.21.15.82:0/3398346097 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71981a4940 con 0x7f7198100e90 2024-03-04T09:26:31.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.315+0000 7f71a05bf640 1 -- 172.21.15.82:0/3398346097 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71980683c0 con 0x7f7198100e90 2024-03-04T09:26:31.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.316+0000 7f718f7fe640 1 -- 172.21.15.82:0/3398346097 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 136887+0+0 (secure 0 0 0) 0x7f7188004f20 con 0x7f7198100e90 2024-03-04T09:26:31.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.316+0000 7f718f7fe640 1 --2- 172.21.15.82:0/3398346097 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f71840a1ef0 0x7f71840a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:31.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.317+0000 7f719e35b640 1 --2- 172.21.15.82:0/3398346097 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f71840a1ef0 0x7f71840a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:31.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.317+0000 7f718f7fe640 1 -- 172.21.15.82:0/3398346097 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 9568+0+0 (secure 0 0 0) 0x7f71880ce9b0 con 0x7f7198100e90 2024-03-04T09:26:31.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.317+0000 7f719e35b640 1 --2- 172.21.15.82:0/3398346097 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f71840a1ef0 0x7f71840a43b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7194009bd0 tx=0x7f7194005f90 comp rx=0 tx=0).ready entity=mgr.15543 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:26:31.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.321+0000 7f718f7fe640 1 -- 172.21.15.82:0/3398346097 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f718809b690 con 0x7f7198100e90 2024-03-04T09:26:31.421 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:31 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/1879046118' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:26:31.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:31 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/1879046118' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:26:31.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.534+0000 7f71a05bf640 1 -- 172.21.15.82:0/3398346097 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f71981a4b70 con 0x7f7198100e90 2024-03-04T09:26:31.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.535+0000 7f718f7fe640 1 -- 172.21.15.82:0/3398346097 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+11462 (secure 0 0 0) 0x7f718809af90 con 0x7f7198100e90 2024-03-04T09:26:31.531 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:26:31.531 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":58,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3123844705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3123844705},{"type":"v1","addr":"172.21.15.82:6835","nonce":3123844705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2620634252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2620634252},{"type":"v1","addr":"172.21.15.82:6837","nonce":2620634252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":58,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-04T09:13:10.076732+0000","modified":"2024-03-04T09:21:43.455764+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24476,"mds_1":24469,"mds_2":24451,"mds_3":24449,"mds_4":24439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14613":{"gid":14613,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/1240838024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1240838024},{"type":"v1","addr":"172.21.15.82:6839","nonce":1240838024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14625":{"gid":14625,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/213594267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":213594267},{"type":"v1","addr":"172.21.15.82:6841","nonce":213594267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24398":{"gid":24398,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/1142302200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":1142302200},{"type":"v1","addr":"172.21.15.102:6833","nonce":1142302200}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24403":{"gid":24403,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.190:6833/3023382814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":3023382814},{"type":"v1","addr":"172.21.15.190:6833","nonce":3023382814}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24422":{"gid":24422,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6835/2134310473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":2134310473},{"type":"v1","addr":"172.21.15.102:6835","nonce":2134310473}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24439":{"gid":24439,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":14,"addr":"172.21.15.190:6835/3183532624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":3183532624},{"type":"v1","addr":"172.21.15.190:6835","nonce":3183532624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24449":{"gid":24449,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":12,"addr":"172.21.15.102:6837/1210579527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1210579527},{"type":"v1","addr":"172.21.15.102:6837","nonce":1210579527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24451":{"gid":24451,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.190:6837/1198639527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":1198639527},{"type":"v1","addr":"172.21.15.190:6837","nonce":1198639527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.190:6839/878555510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6838","nonce":878555510},{"type":"v1","addr":"172.21.15.190:6839","nonce":878555510}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6839/35424130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":35424130},{"type":"v1","addr":"172.21.15.102:6839","nonce":35424130}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476,24469,24451,24439,24449]},"id":1}]} 2024-03-04T09:26:31.532 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 58 2024-03-04T09:26:31.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.536+0000 7f71a05bf640 1 -- 172.21.15.82:0/3398346097 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f71840a1ef0 msgr2=0x7f71840a43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:31.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.536+0000 7f71a05bf640 1 --2- 172.21.15.82:0/3398346097 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f71840a1ef0 0x7f71840a43b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7194009bd0 tx=0x7f7194005f90 comp rx=0 tx=0).stop 2024-03-04T09:26:31.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.536+0000 7f71a05bf640 1 -- 172.21.15.82:0/3398346097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7198100e90 msgr2=0x7f7198198310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:31.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.536+0000 7f71a05bf640 1 --2- 172.21.15.82:0/3398346097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7198100e90 0x7f7198198310 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f718800e9f0 tx=0x7f718800edf0 comp rx=0 tx=0).stop 2024-03-04T09:26:31.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.536+0000 7f71a05bf640 1 -- 172.21.15.82:0/3398346097 shutdown_connections 2024-03-04T09:26:31.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.536+0000 7f71a05bf640 1 --2- 172.21.15.82:0/3398346097 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f71840a1ef0 0x7f71840a43b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:31.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.536+0000 7f71a05bf640 1 --2- 172.21.15.82:0/3398346097 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7198106660 0x7f719819c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:31.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.536+0000 7f71a05bf640 1 --2- 172.21.15.82:0/3398346097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7198100e90 0x7f7198198310 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:31.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.536+0000 7f71a05bf640 1 --2- 172.21.15.82:0/3398346097 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71981004d0 0x7f7198197dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:31.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.536+0000 7f71a05bf640 1 -- 172.21.15.82:0/3398346097 >> 172.21.15.82:0/3398346097 conn(0x7f71980775d0 msgr2=0x7f71980ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:26:31.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.537+0000 7f71a05bf640 1 -- 172.21.15.82:0/3398346097 shutdown_connections 2024-03-04T09:26:31.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.537+0000 7f71a05bf640 1 -- 172.21.15.82:0/3398346097 wait complete. 2024-03-04T09:26:31.543 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:31 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/1879046118' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:26:31.545 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T09:26:31.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.649+0000 7f255a7e2640 1 -- 172.21.15.82:0/2923438352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2554107640 msgr2=0x7f2554107a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:31.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.649+0000 7f255a7e2640 1 --2- 172.21.15.82:0/2923438352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2554107640 0x7f2554107a20 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f2544009900 tx=0x7f254402bc30 comp rx=0 tx=0).stop 2024-03-04T09:26:31.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.649+0000 7f255a7e2640 1 -- 172.21.15.82:0/2923438352 shutdown_connections 2024-03-04T09:26:31.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.649+0000 7f255a7e2640 1 --2- 172.21.15.82:0/2923438352 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2554101f40 0x7f255410e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:31.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.649+0000 7f255a7e2640 1 --2- 172.21.15.82:0/2923438352 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2554101580 0x7f2554101a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:31.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.649+0000 7f255a7e2640 1 --2- 172.21.15.82:0/2923438352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2554107640 0x7f2554107a20 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:31.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.649+0000 7f255a7e2640 1 -- 172.21.15.82:0/2923438352 >> 172.21.15.82:0/2923438352 conn(0x7f25540fd070 msgr2=0x7f25540ff490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:26:31.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.649+0000 7f255a7e2640 1 -- 172.21.15.82:0/2923438352 shutdown_connections 2024-03-04T09:26:31.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.649+0000 7f255a7e2640 1 -- 172.21.15.82:0/2923438352 wait complete. 2024-03-04T09:26:31.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.649+0000 7f255a7e2640 1 Processor -- start 2024-03-04T09:26:31.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.649+0000 7f255a7e2640 1 -- start start 2024-03-04T09:26:31.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.650+0000 7f255a7e2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2554101580 0x7f25540738d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:31.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.650+0000 7f255a7e2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2554101f40 0x7f2554073e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:31.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.650+0000 7f255a7e2640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2554107640 0x7f2554074350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:31.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.650+0000 7f255a7e2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2554111910 con 0x7f2554101f40 2024-03-04T09:26:31.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.650+0000 7f255a7e2640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2554111790 con 0x7f2554101580 2024-03-04T09:26:31.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.650+0000 7f255a7e2640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2554111a90 con 0x7f2554107640 2024-03-04T09:26:31.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.650+0000 7f25537fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2554101f40 0x7f2554073e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:31.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.650+0000 7f25537fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2554101f40 0x7f2554073e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57156/0 (socket says 172.21.15.82:57156) 2024-03-04T09:26:31.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.650+0000 7f25537fe640 1 -- 172.21.15.82:0/1177500009 learned_addr learned my addr 172.21.15.82:0/1177500009 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:26:31.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.650+0000 7f2558d7f640 1 --2- 172.21.15.82:0/1177500009 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2554107640 0x7f2554074350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:31.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.650+0000 7f2553fff640 1 --2- 172.21.15.82:0/1177500009 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2554101580 0x7f25540738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:31.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.650+0000 7f25537fe640 1 -- 172.21.15.82:0/1177500009 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2554107640 msgr2=0x7f2554074350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:31.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.650+0000 7f25537fe640 1 --2- 172.21.15.82:0/1177500009 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2554107640 0x7f2554074350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:31.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.650+0000 7f25537fe640 1 -- 172.21.15.82:0/1177500009 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2554101580 msgr2=0x7f25540738d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:31.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.650+0000 7f25537fe640 1 --2- 172.21.15.82:0/1177500009 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2554101580 0x7f25540738d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:31.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.650+0000 7f25537fe640 1 -- 172.21.15.82:0/1177500009 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25541a6290 con 0x7f2554101f40 2024-03-04T09:26:31.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.650+0000 7f25537fe640 1 --2- 172.21.15.82:0/1177500009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2554101f40 0x7f2554073e10 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f253c00ea60 tx=0x7f253c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:26:31.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.650+0000 7f25517fa640 1 -- 172.21.15.82:0/1177500009 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f253c00cde0 con 0x7f2554101f40 2024-03-04T09:26:31.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.650+0000 7f25517fa640 1 -- 172.21.15.82:0/1177500009 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f253c0035f0 con 0x7f2554101f40 2024-03-04T09:26:31.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.650+0000 7f255a7e2640 1 -- 172.21.15.82:0/1177500009 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25541a6580 con 0x7f2554101f40 2024-03-04T09:26:31.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.650+0000 7f25517fa640 1 -- 172.21.15.82:0/1177500009 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f253c010690 con 0x7f2554101f40 2024-03-04T09:26:31.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.651+0000 7f255a7e2640 1 -- 172.21.15.82:0/1177500009 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25541a6ad0 con 0x7f2554101f40 2024-03-04T09:26:31.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.651+0000 7f255a7e2640 1 -- 172.21.15.82:0/1177500009 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2554068810 con 0x7f2554101f40 2024-03-04T09:26:31.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.653+0000 7f25517fa640 1 -- 172.21.15.82:0/1177500009 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 136887+0+0 (secure 0 0 0) 0x7f253c0037a0 con 0x7f2554101f40 2024-03-04T09:26:31.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.653+0000 7f25517fa640 1 --2- 172.21.15.82:0/1177500009 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f25400a1f20 0x7f25400a43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:31.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.653+0000 7f2553fff640 1 --2- 172.21.15.82:0/1177500009 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f25400a1f20 0x7f25400a43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:31.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.653+0000 7f25517fa640 1 -- 172.21.15.82:0/1177500009 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 9568+0+0 (secure 0 0 0) 0x7f253c0ce960 con 0x7f2554101f40 2024-03-04T09:26:31.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.654+0000 7f2553fff640 1 --2- 172.21.15.82:0/1177500009 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f25400a1f20 0x7f25400a43e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2544006010 tx=0x7f2544005dd0 comp rx=0 tx=0).ready entity=mgr.15543 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:26:31.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.657+0000 7f25517fa640 1 -- 172.21.15.82:0/1177500009 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f253c09b6d0 con 0x7f2554101f40 2024-03-04T09:26:31.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.831+0000 7f255a7e2640 1 -- 172.21.15.82:0/1177500009 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2554074db0 con 0x7f2554101f40 2024-03-04T09:26:31.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.833+0000 7f25517fa640 1 -- 172.21.15.82:0/1177500009 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) v1 ==== 74+0+25384 (secure 0 0 0) 0x7f2554074db0 con 0x7f2554101f40 2024-03-04T09:26:31.830 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-04T09:26:31.830 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":106,"fsid":"2e533fc8-da06-11ee-95c6-87774f69a715","created":"2024-03-04T09:05:16.488249+0000","modified":"2024-03-04T09:26:18.179584+0000","last_up_change":"2024-03-04T09:12:22.308711+0000","last_in_change":"2024-03-04T09:12:02.548212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T09:08:36.508257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-04T09:13:07.981726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-04T09:13:09.289799+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":105,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-04T09:13:13.008516+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":105,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"085b5c4b-ede9-4d0d-b994-50c89d991012","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6803","nonce":709655235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6805","nonce":709655235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6809","nonce":709655235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":709655235},{"type":"v1","addr":"172.21.15.82:6807","nonce":709655235}]},"public_addr":"172.21.15.82:6803/709655235","cluster_addr":"172.21.15.82:6805/709655235","heartbeat_back_addr":"172.21.15.82:6809/709655235","heartbeat_front_addr":"172.21.15.82:6807/709655235","state":["exists","up"]},{"osd":1,"uuid":"e4dd7079-333e-4bcf-b3af-11fb082a5af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6801","nonce":270721212}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6803","nonce":270721212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6807","nonce":270721212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":270721212},{"type":"v1","addr":"172.21.15.102:6805","nonce":270721212}]},"public_addr":"172.21.15.102:6801/270721212","cluster_addr":"172.21.15.102:6803/270721212","heartbeat_back_addr":"172.21.15.102:6807/270721212","heartbeat_front_addr":"172.21.15.102:6805/270721212","state":["exists","up"]},{"osd":2,"uuid":"6fed5fd6-dc82-497f-9d69-c10a5e5802da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6801","nonce":946410459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6803","nonce":946410459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6807","nonce":946410459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":946410459},{"type":"v1","addr":"172.21.15.190:6805","nonce":946410459}]},"public_addr":"172.21.15.190:6801/946410459","cluster_addr":"172.21.15.190:6803/946410459","heartbeat_back_addr":"172.21.15.190:6807/946410459","heartbeat_front_addr":"172.21.15.190:6805/946410459","state":["exists","up"]},{"osd":3,"uuid":"91ccbdc3-3da6-4d39-8a89-3a7b7bb4adc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6811","nonce":980870924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6813","nonce":980870924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6817","nonce":980870924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":980870924},{"type":"v1","addr":"172.21.15.82:6815","nonce":980870924}]},"public_addr":"172.21.15.82:6811/980870924","cluster_addr":"172.21.15.82:6813/980870924","heartbeat_back_addr":"172.21.15.82:6817/980870924","heartbeat_front_addr":"172.21.15.82:6815/980870924","state":["exists","up"]},{"osd":4,"uuid":"dbb9d486-5daa-4819-bbed-04fc76ca473e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6809","nonce":1229627753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6811","nonce":1229627753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6815","nonce":1229627753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1229627753},{"type":"v1","addr":"172.21.15.102:6813","nonce":1229627753}]},"public_addr":"172.21.15.102:6809/1229627753","cluster_addr":"172.21.15.102:6811/1229627753","heartbeat_back_addr":"172.21.15.102:6815/1229627753","heartbeat_front_addr":"172.21.15.102:6813/1229627753","state":["exists","up"]},{"osd":5,"uuid":"6b50127b-df2b-4c95-8e53-9d42b40273fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6809","nonce":2171194148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6811","nonce":2171194148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6815","nonce":2171194148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2171194148},{"type":"v1","addr":"172.21.15.190:6813","nonce":2171194148}]},"public_addr":"172.21.15.190:6809/2171194148","cluster_addr":"172.21.15.190:6811/2171194148","heartbeat_back_addr":"172.21.15.190:6815/2171194148","heartbeat_front_addr":"172.21.15.190:6813/2171194148","state":["exists","up"]},{"osd":6,"uuid":"e72bebb0-5939-4210-950a-41c25c23c62f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6819","nonce":454436959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6821","nonce":454436959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6825","nonce":454436959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":454436959},{"type":"v1","addr":"172.21.15.82:6823","nonce":454436959}]},"public_addr":"172.21.15.82:6819/454436959","cluster_addr":"172.21.15.82:6821/454436959","heartbeat_back_addr":"172.21.15.82:6825/454436959","heartbeat_front_addr":"172.21.15.82:6823/454436959","state":["exists","up"]},{"osd":7,"uuid":"72f83f97-f496-4503-8284-6a7b8f99a6f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6817","nonce":2745057274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6819","nonce":2745057274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6823","nonce":2745057274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2745057274},{"type":"v1","addr":"172.21.15.102:6821","nonce":2745057274}]},"public_addr":"172.21.15.102:6817/2745057274","cluster_addr":"172.21.15.102:6819/2745057274","heartbeat_back_addr":"172.21.15.102:6823/2745057274","heartbeat_front_addr":"172.21.15.102:6821/2745057274","state":["exists","up"]},{"osd":8,"uuid":"92c9109d-6ebb-4c50-9944-28cd7b2f9c0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6817","nonce":1679683516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6819","nonce":1679683516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6823","nonce":1679683516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":1679683516},{"type":"v1","addr":"172.21.15.190:6821","nonce":1679683516}]},"public_addr":"172.21.15.190:6817/1679683516","cluster_addr":"172.21.15.190:6819/1679683516","heartbeat_back_addr":"172.21.15.190:6823/1679683516","heartbeat_front_addr":"172.21.15.190:6821/1679683516","state":["exists","up"]},{"osd":9,"uuid":"a3cfce03-0148-475d-bf55-b8284ae1cad2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6827","nonce":1777272933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6829","nonce":1777272933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6833","nonce":1777272933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1777272933},{"type":"v1","addr":"172.21.15.82:6831","nonce":1777272933}]},"public_addr":"172.21.15.82:6827/1777272933","cluster_addr":"172.21.15.82:6829/1777272933","heartbeat_back_addr":"172.21.15.82:6833/1777272933","heartbeat_front_addr":"172.21.15.82:6831/1777272933","state":["exists","up"]},{"osd":10,"uuid":"db156ccf-4396-43cb-b69a-bb9095b94b40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6825","nonce":1012784035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6827","nonce":1012784035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6831","nonce":1012784035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1012784035},{"type":"v1","addr":"172.21.15.102:6829","nonce":1012784035}]},"public_addr":"172.21.15.102:6825/1012784035","cluster_addr":"172.21.15.102:6827/1012784035","heartbeat_back_addr":"172.21.15.102:6831/1012784035","heartbeat_front_addr":"172.21.15.102:6829/1012784035","state":["exists","up"]},{"osd":11,"uuid":"b4d52576-f5b4-479f-8ff6-8fdba4635ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6825","nonce":144700355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6827","nonce":144700355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6831","nonce":144700355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":144700355},{"type":"v1","addr":"172.21.15.190:6829","nonce":144700355}]},"public_addr":"172.21.15.190:6825/144700355","cluster_addr":"172.21.15.190:6827/144700355","heartbeat_back_addr":"172.21.15.190:6831/144700355","heartbeat_front_addr":"172.21.15.190:6829/144700355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:07:47.007772+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:09.944738+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:33.183567+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:08:58.302023+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:09:23.042488+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:09:47.616009+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:10:13.122887+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:10:38.584530+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:03.473453+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:29.847105+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:11:55.152195+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T09:12:20.401765+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/984630078":"2024-03-05T09:06:12.169231+0000","172.21.15.82:6800/3291527077":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/3757201752":"2024-03-05T09:06:12.169231+0000","172.21.15.82:0/1846720385":"2024-03-05T09:05:44.913099+0000","172.21.15.82:6801/3291527077":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/2402774828":"2024-03-05T09:05:44.913099+0000","172.21.15.82:0/2876711373":"2024-03-05T09:15:39.302003+0000","172.21.15.82:0/735262841":"2024-03-05T09:05:44.913099+0000","172.21.15.82:6801/1901539016":"2024-03-05T09:06:12.169231+0000","172.21.15.82:0/1124105204":"2024-03-05T09:06:12.169231+0000","172.21.15.82:6800/1901539016":"2024-03-05T09:06:12.169231+0000","172.21.15.82:0/566891801":"2024-03-05T09:15:39.302003+0000","172.21.15.82:0/3558395162":"2024-03-05T09:15:39.302003+0000","172.21.15.82:0/406948853":"2024-03-04T10:20:35.560456+0000","172.21.15.82:6800/1278635224":"2024-03-05T09:15:39.302003+0000","172.21.15.82:6801/1278635224":"2024-03-05T09:15:39.302003+0000","172.21.15.82:0/2438787300":"2024-03-05T09:15:39.302003+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]},{"pool":4,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T09:26:31.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.835+0000 7f255a7e2640 1 -- 172.21.15.82:0/1177500009 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f25400a1f20 msgr2=0x7f25400a43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:31.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.835+0000 7f255a7e2640 1 --2- 172.21.15.82:0/1177500009 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f25400a1f20 0x7f25400a43e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2544006010 tx=0x7f2544005dd0 comp rx=0 tx=0).stop 2024-03-04T09:26:31.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.835+0000 7f255a7e2640 1 -- 172.21.15.82:0/1177500009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2554101f40 msgr2=0x7f2554073e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:31.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.835+0000 7f255a7e2640 1 --2- 172.21.15.82:0/1177500009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2554101f40 0x7f2554073e10 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f253c00ea60 tx=0x7f253c00ef20 comp rx=0 tx=0).stop 2024-03-04T09:26:31.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.835+0000 7f255a7e2640 1 -- 172.21.15.82:0/1177500009 shutdown_connections 2024-03-04T09:26:31.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.835+0000 7f255a7e2640 1 --2- 172.21.15.82:0/1177500009 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f25400a1f20 0x7f25400a43e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:31.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.835+0000 7f255a7e2640 1 --2- 172.21.15.82:0/1177500009 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2554107640 0x7f2554074350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:31.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.835+0000 7f255a7e2640 1 --2- 172.21.15.82:0/1177500009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2554101f40 0x7f2554073e10 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:31.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.835+0000 7f255a7e2640 1 --2- 172.21.15.82:0/1177500009 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2554101580 0x7f25540738d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:31.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.835+0000 7f255a7e2640 1 -- 172.21.15.82:0/1177500009 >> 172.21.15.82:0/1177500009 conn(0x7f25540fd070 msgr2=0x7f25540fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:26:31.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.835+0000 7f255a7e2640 1 -- 172.21.15.82:0/1177500009 shutdown_connections 2024-03-04T09:26:31.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.835+0000 7f255a7e2640 1 -- 172.21.15.82:0/1177500009 wait complete. 2024-03-04T09:26:31.843 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-04T09:26:31.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.949+0000 7fc840a15640 1 -- 172.21.15.82:0/1434526243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc83c1075d0 msgr2=0x7fc83c1079b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:31.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.949+0000 7fc840a15640 1 --2- 172.21.15.82:0/1434526243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc83c1075d0 0x7fc83c1079b0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fc82c009cd0 tx=0x7fc82c02c0f0 comp rx=0 tx=0).stop 2024-03-04T09:26:31.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.950+0000 7fc840a15640 1 -- 172.21.15.82:0/1434526243 shutdown_connections 2024-03-04T09:26:31.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.950+0000 7fc840a15640 1 --2- 172.21.15.82:0/1434526243 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc83c069190 0x7fc83c10e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:31.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.950+0000 7fc840a15640 1 --2- 172.21.15.82:0/1434526243 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc83c0687d0 0x7fc83c068c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:31.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.950+0000 7fc840a15640 1 --2- 172.21.15.82:0/1434526243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc83c1075d0 0x7fc83c1079b0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:31.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.950+0000 7fc840a15640 1 -- 172.21.15.82:0/1434526243 >> 172.21.15.82:0/1434526243 conn(0x7fc83c0775d0 msgr2=0x7fc83c0779e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:26:31.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.950+0000 7fc840a15640 1 -- 172.21.15.82:0/1434526243 shutdown_connections 2024-03-04T09:26:31.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.950+0000 7fc840a15640 1 -- 172.21.15.82:0/1434526243 wait complete. 2024-03-04T09:26:31.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.950+0000 7fc840a15640 1 Processor -- start 2024-03-04T09:26:31.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.950+0000 7fc840a15640 1 -- start start 2024-03-04T09:26:31.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.951+0000 7fc840a15640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc83c0687d0 0x7fc83c197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:31.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.951+0000 7fc840a15640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc83c069190 0x7fc83c198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:31.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.951+0000 7fc840a15640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc83c1075d0 0x7fc83c19c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:31.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.951+0000 7fc840a15640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c1118f0 con 0x7fc83c069190 2024-03-04T09:26:31.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.951+0000 7fc840a15640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c111770 con 0x7fc83c1075d0 2024-03-04T09:26:31.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.951+0000 7fc840a15640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c111a70 con 0x7fc83c0687d0 2024-03-04T09:26:31.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.951+0000 7fc839d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc83c069190 0x7fc83c198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:31.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.951+0000 7fc839d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc83c069190 0x7fc83c198350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57176/0 (socket says 172.21.15.82:57176) 2024-03-04T09:26:31.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.951+0000 7fc839d9b640 1 -- 172.21.15.82:0/1133946292 learned_addr learned my addr 172.21.15.82:0/1133946292 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:26:31.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.951+0000 7fc83ad9d640 1 --2- 172.21.15.82:0/1133946292 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc83c1075d0 0x7fc83c19c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:31.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.951+0000 7fc83a59c640 1 --2- 172.21.15.82:0/1133946292 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc83c0687d0 0x7fc83c197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:31.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.951+0000 7fc839d9b640 1 -- 172.21.15.82:0/1133946292 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc83c0687d0 msgr2=0x7fc83c197e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:31.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.951+0000 7fc839d9b640 1 --2- 172.21.15.82:0/1133946292 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc83c0687d0 0x7fc83c197e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:31.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.951+0000 7fc839d9b640 1 -- 172.21.15.82:0/1133946292 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc83c1075d0 msgr2=0x7fc83c19c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:31.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.951+0000 7fc839d9b640 1 --2- 172.21.15.82:0/1133946292 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc83c1075d0 0x7fc83c19c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:31.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.951+0000 7fc839d9b640 1 -- 172.21.15.82:0/1133946292 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc83c19ce00 con 0x7fc83c069190 2024-03-04T09:26:31.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.951+0000 7fc839d9b640 1 --2- 172.21.15.82:0/1133946292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc83c069190 0x7fc83c198350 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fc82400e9f0 tx=0x7fc82400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:26:31.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.951+0000 7fc8337fe640 1 -- 172.21.15.82:0/1133946292 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82400cd80 con 0x7fc83c069190 2024-03-04T09:26:31.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.951+0000 7fc8337fe640 1 -- 172.21.15.82:0/1133946292 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fc824010900 con 0x7fc83c069190 2024-03-04T09:26:31.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.951+0000 7fc840a15640 1 -- 172.21.15.82:0/1133946292 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc83c19d0f0 con 0x7fc83c069190 2024-03-04T09:26:31.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.951+0000 7fc8337fe640 1 -- 172.21.15.82:0/1133946292 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8240189e0 con 0x7fc83c069190 2024-03-04T09:26:31.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.951+0000 7fc840a15640 1 -- 172.21.15.82:0/1133946292 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc83c1a4980 con 0x7fc83c069190 2024-03-04T09:26:31.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.952+0000 7fc840a15640 1 -- 172.21.15.82:0/1133946292 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc83c0683c0 con 0x7fc83c069190 2024-03-04T09:26:31.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.953+0000 7fc8337fe640 1 -- 172.21.15.82:0/1133946292 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 136887+0+0 (secure 0 0 0) 0x7fc824010ab0 con 0x7fc83c069190 2024-03-04T09:26:31.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.954+0000 7fc8337fe640 1 --2- 172.21.15.82:0/1133946292 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7fc8280a1ef0 0x7fc8280a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:31.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.954+0000 7fc83a59c640 1 --2- 172.21.15.82:0/1133946292 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7fc8280a1ef0 0x7fc8280a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:31.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.954+0000 7fc8337fe640 1 -- 172.21.15.82:0/1133946292 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 9568+0+0 (secure 0 0 0) 0x7fc8240ce8b0 con 0x7fc83c069190 2024-03-04T09:26:31.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.954+0000 7fc83a59c640 1 --2- 172.21.15.82:0/1133946292 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7fc8280a1ef0 0x7fc8280a43b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc82c005cc0 tx=0x7fc82c005c50 comp rx=0 tx=0).ready entity=mgr.15543 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:26:31.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:31.958+0000 7fc8337fe640 1 -- 172.21.15.82:0/1133946292 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fc82409af40 con 0x7fc83c069190 2024-03-04T09:26:32.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.172+0000 7fc840a15640 1 -- 172.21.15.82:0/1133946292 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc83c1094c0 con 0x7fc83c069190 2024-03-04T09:26:32.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.174+0000 7fc8337fe640 1 -- 172.21.15.82:0/1133946292 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v59) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc82409efe0 con 0x7fc83c069190 2024-03-04T09:26:32.171 INFO:teuthology.orchestra.run.smithi082.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-04T09:26:32.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.178+0000 7fc840a15640 1 -- 172.21.15.82:0/1133946292 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7fc8280a1ef0 msgr2=0x7fc8280a43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:32.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.178+0000 7fc840a15640 1 --2- 172.21.15.82:0/1133946292 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7fc8280a1ef0 0x7fc8280a43b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc82c005cc0 tx=0x7fc82c005c50 comp rx=0 tx=0).stop 2024-03-04T09:26:32.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.178+0000 7fc840a15640 1 -- 172.21.15.82:0/1133946292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc83c069190 msgr2=0x7fc83c198350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:32.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.178+0000 7fc840a15640 1 --2- 172.21.15.82:0/1133946292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc83c069190 0x7fc83c198350 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fc82400e9f0 tx=0x7fc82400eeb0 comp rx=0 tx=0).stop 2024-03-04T09:26:32.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.178+0000 7fc840a15640 1 -- 172.21.15.82:0/1133946292 shutdown_connections 2024-03-04T09:26:32.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.178+0000 7fc840a15640 1 --2- 172.21.15.82:0/1133946292 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7fc8280a1ef0 0x7fc8280a43b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:32.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.178+0000 7fc840a15640 1 --2- 172.21.15.82:0/1133946292 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc83c1075d0 0x7fc83c19c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:32.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.178+0000 7fc840a15640 1 --2- 172.21.15.82:0/1133946292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc83c069190 0x7fc83c198350 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:32.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.178+0000 7fc840a15640 1 --2- 172.21.15.82:0/1133946292 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc83c0687d0 0x7fc83c197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:32.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.178+0000 7fc840a15640 1 -- 172.21.15.82:0/1133946292 >> 172.21.15.82:0/1133946292 conn(0x7fc83c0775d0 msgr2=0x7fc83c0ff0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:26:32.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.178+0000 7fc840a15640 1 -- 172.21.15.82:0/1133946292 shutdown_connections 2024-03-04T09:26:32.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.179+0000 7fc840a15640 1 -- 172.21.15.82:0/1133946292 wait complete. 2024-03-04T09:26:32.192 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-04T09:26:32.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.308+0000 7f4114b0c640 1 -- 172.21.15.82:0/4294339666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4110100e00 msgr2=0x7f411010d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:32.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.308+0000 7f4114b0c640 1 --2- 172.21.15.82:0/4294339666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4110100e00 0x7f411010d310 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f4108009cd0 tx=0x7f410802c0f0 comp rx=0 tx=0).stop 2024-03-04T09:26:32.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.308+0000 7f4114b0c640 1 -- 172.21.15.82:0/4294339666 shutdown_connections 2024-03-04T09:26:32.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.308+0000 7f4114b0c640 1 --2- 172.21.15.82:0/4294339666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4110100e00 0x7f411010d310 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:32.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.308+0000 7f4114b0c640 1 --2- 172.21.15.82:0/4294339666 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4110100440 0x7f41101008c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:32.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.308+0000 7f4114b0c640 1 --2- 172.21.15.82:0/4294339666 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f41101064e0 0x7f41101068c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:32.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.308+0000 7f4114b0c640 1 -- 172.21.15.82:0/4294339666 >> 172.21.15.82:0/4294339666 conn(0x7f41100775d0 msgr2=0x7f41100779e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:26:32.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.308+0000 7f4114b0c640 1 -- 172.21.15.82:0/4294339666 shutdown_connections 2024-03-04T09:26:32.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.308+0000 7f4114b0c640 1 -- 172.21.15.82:0/4294339666 wait complete. 2024-03-04T09:26:32.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.309+0000 7f4114b0c640 1 Processor -- start 2024-03-04T09:26:32.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.309+0000 7f4114b0c640 1 -- start start 2024-03-04T09:26:32.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.309+0000 7f4114b0c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4110100440 0x7f4110198c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:32.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.309+0000 7f4114b0c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4110100e00 0x7f41101991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:32.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.309+0000 7f4114b0c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f41101064e0 0x7f41101a3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:32.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.309+0000 7f4114b0c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4110110830 con 0x7f4110100e00 2024-03-04T09:26:32.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.309+0000 7f4114b0c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41101106b0 con 0x7f41101064e0 2024-03-04T09:26:32.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.309+0000 7f4114b0c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41101109b0 con 0x7f4110100440 2024-03-04T09:26:32.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.309+0000 7f410dd9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4110100e00 0x7f41101991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:32.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.309+0000 7f410dd9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4110100e00 0x7f41101991d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57222/0 (socket says 172.21.15.82:57222) 2024-03-04T09:26:32.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.309+0000 7f410dd9b640 1 -- 172.21.15.82:0/1880288389 learned_addr learned my addr 172.21.15.82:0/1880288389 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:26:32.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.309+0000 7f410e59c640 1 --2- 172.21.15.82:0/1880288389 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4110100440 0x7f4110198c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:32.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.309+0000 7f410dd9b640 1 -- 172.21.15.82:0/1880288389 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4110100440 msgr2=0x7f4110198c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:32.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.309+0000 7f410ed9d640 1 --2- 172.21.15.82:0/1880288389 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f41101064e0 0x7f41101a3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:32.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.309+0000 7f410dd9b640 1 --2- 172.21.15.82:0/1880288389 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4110100440 0x7f4110198c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:32.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.309+0000 7f410dd9b640 1 -- 172.21.15.82:0/1880288389 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f41101064e0 msgr2=0x7f41101a3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:32.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.309+0000 7f410dd9b640 1 --2- 172.21.15.82:0/1880288389 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f41101064e0 0x7f41101a3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:32.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.309+0000 7f410dd9b640 1 -- 172.21.15.82:0/1880288389 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41101a4250 con 0x7f4110100e00 2024-03-04T09:26:32.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.309+0000 7f410ed9d640 1 --2- 172.21.15.82:0/1880288389 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f41101064e0 0x7f41101a3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T09:26:32.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.310+0000 7f410dd9b640 1 --2- 172.21.15.82:0/1880288389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4110100e00 0x7f41101991d0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f410000e9f0 tx=0x7f410000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:26:32.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.310+0000 7f40ff7fe640 1 -- 172.21.15.82:0/1880288389 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f410000cd80 con 0x7f4110100e00 2024-03-04T09:26:32.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.310+0000 7f4114b0c640 1 -- 172.21.15.82:0/1880288389 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41101a4420 con 0x7f4110100e00 2024-03-04T09:26:32.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.310+0000 7f40ff7fe640 1 -- 172.21.15.82:0/1880288389 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f41000054f0 con 0x7f4110100e00 2024-03-04T09:26:32.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.310+0000 7f40ff7fe640 1 -- 172.21.15.82:0/1880288389 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4100010690 con 0x7f4110100e00 2024-03-04T09:26:32.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.310+0000 7f4114b0c640 1 -- 172.21.15.82:0/1880288389 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41101a48f0 con 0x7f4110100e00 2024-03-04T09:26:32.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.311+0000 7f4114b0c640 1 -- 172.21.15.82:0/1880288389 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41100683c0 con 0x7f4110100e00 2024-03-04T09:26:32.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.312+0000 7f40ff7fe640 1 -- 172.21.15.82:0/1880288389 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 136887+0+0 (secure 0 0 0) 0x7f4100004f00 con 0x7f4110100e00 2024-03-04T09:26:32.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.312+0000 7f40ff7fe640 1 --2- 172.21.15.82:0/1880288389 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f40f80a1ef0 0x7f40f80a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:32.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.313+0000 7f410e59c640 1 --2- 172.21.15.82:0/1880288389 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f40f80a1ef0 0x7f40f80a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:32.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.313+0000 7f40ff7fe640 1 -- 172.21.15.82:0/1880288389 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 9910+0+0 (secure 0 0 0) 0x7f41000cee50 con 0x7f4110100e00 2024-03-04T09:26:32.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.313+0000 7f410e59c640 1 --2- 172.21.15.82:0/1880288389 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f40f80a1ef0 0x7f40f80a43b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4104009ae0 tx=0x7f4104005f90 comp rx=0 tx=0).ready entity=mgr.15543 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:26:32.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.316+0000 7f40ff7fe640 1 -- 172.21.15.82:0/1880288389 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f4100053280 con 0x7f4110100e00 2024-03-04T09:26:32.477 INFO:journalctl@ceph.mds.a.smithi082.stdout:Mar 04 09:26:32 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-a[74295]: ignoring --setuser ceph since I am not root 2024-03-04T09:26:32.477 INFO:journalctl@ceph.mds.a.smithi082.stdout:Mar 04 09:26:32 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-a[74295]: ignoring --setgroup ceph since I am not root 2024-03-04T09:26:32.477 INFO:journalctl@ceph.mds.a.smithi082.stdout:Mar 04 09:26:32 smithi082 ceph-mds[74299]: -- 172.21.15.82:0/2018912693 <== mon.0 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55601c495a40 con 0x55601c468c00 2024-03-04T09:26:32.477 INFO:journalctl@ceph.mds.a.smithi082.stdout:Mar 04 09:26:32 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-a[74295]: starting mds.a at 2024-03-04T09:26:32.477 INFO:journalctl@ceph.mds.g.smithi082.stdout:Mar 04 09:26:32 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-g[73939]: ignoring --setuser ceph since I am not root 2024-03-04T09:26:32.478 INFO:journalctl@ceph.mds.g.smithi082.stdout:Mar 04 09:26:32 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-g[73939]: ignoring --setgroup ceph since I am not root 2024-03-04T09:26:32.478 INFO:journalctl@ceph.mds.g.smithi082.stdout:Mar 04 09:26:32 smithi082 ceph-mds[73943]: -- 172.21.15.82:0/1798448456 <== mon.0 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e638f31a40 con 0x55e638f04c00 2024-03-04T09:26:32.478 INFO:journalctl@ceph.mds.g.smithi082.stdout:Mar 04 09:26:32 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-g[73939]: starting mds.g at 2024-03-04T09:26:32.478 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:32 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mon-a[32876]: 2024-03-04T09:26:32.173+0000 7fbab96d7700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-04T09:26:32.478 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:32 smithi082 ceph-mon[32880]: pgmap v340: 129 pgs: 129 active+clean; 117 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-03-04T09:26:32.478 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:32 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/3398346097' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:26:32.478 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:32 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/1177500009' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:26:32.478 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:32 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/1133946292' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-03-04T09:26:32.478 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:32 smithi082 ceph-mon[32880]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-04T09:26:32.478 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:32 smithi082 ceph-mon[32880]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-04T09:26:32.478 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:32 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/1133946292' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-03-04T09:26:32.479 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:32 smithi082 ceph-mon[32880]: osdmap e107: 12 total, 12 up, 12 in 2024-03-04T09:26:32.479 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:32 smithi082 ceph-mon[32880]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-03-04T09:26:32.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:32.540+0000 7f4114b0c640 1 -- 172.21.15.82:0/1880288389 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f41101089d0 con 0x7f4110100e00 2024-03-04T09:26:32.671 INFO:journalctl@ceph.mds.l.smithi190.stdout:Mar 04 09:26:32 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-l[66661]: ignoring --setuser ceph since I am not root 2024-03-04T09:26:32.672 INFO:journalctl@ceph.mds.l.smithi190.stdout:Mar 04 09:26:32 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-l[66661]: ignoring --setgroup ceph since I am not root 2024-03-04T09:26:32.672 INFO:journalctl@ceph.mds.l.smithi190.stdout:Mar 04 09:26:32 smithi190 ceph-mds[66665]: -- 172.21.15.190:0/3867355645 <== mon.1 v2:172.21.15.190:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55756128da40 con 0x557561260800 2024-03-04T09:26:32.672 INFO:journalctl@ceph.mds.l.smithi190.stdout:Mar 04 09:26:32 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-l[66661]: starting mds.l at 2024-03-04T09:26:32.672 INFO:journalctl@ceph.mds.l.smithi190.stdout:Mar 04 09:26:32 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-l[66661]: 2024-03-04T09:26:32.230+0000 7fb0538bd700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-03-04T09:26:32.673 INFO:journalctl@ceph.mds.c.smithi190.stdout:Mar 04 09:26:32 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-c[67278]: ignoring --setuser ceph since I am not root 2024-03-04T09:26:32.673 INFO:journalctl@ceph.mds.c.smithi190.stdout:Mar 04 09:26:32 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-c[67278]: ignoring --setgroup ceph since I am not root 2024-03-04T09:26:32.673 INFO:journalctl@ceph.mds.c.smithi190.stdout:Mar 04 09:26:32 smithi190 ceph-mds[67282]: -- 172.21.15.190:0/1319497075 <== mon.1 v2:172.21.15.190:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ac3ecb1a40 con 0x55ac3ec84800 2024-03-04T09:26:32.673 INFO:journalctl@ceph.mds.c.smithi190.stdout:Mar 04 09:26:32 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-c[67278]: starting mds.c at 2024-03-04T09:26:32.674 INFO:journalctl@ceph.mds.f.smithi190.stdout:Mar 04 09:26:32 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-f[66973]: ignoring --setuser ceph since I am not root 2024-03-04T09:26:32.674 INFO:journalctl@ceph.mds.f.smithi190.stdout:Mar 04 09:26:32 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-f[66973]: ignoring --setgroup ceph since I am not root 2024-03-04T09:26:32.674 INFO:journalctl@ceph.mds.f.smithi190.stdout:Mar 04 09:26:32 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-f[66973]: starting mds.f at 2024-03-04T09:26:32.675 INFO:journalctl@ceph.mds.i.smithi190.stdout:Mar 04 09:26:32 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-i[67597]: ignoring --setuser ceph since I am not root 2024-03-04T09:26:32.675 INFO:journalctl@ceph.mds.i.smithi190.stdout:Mar 04 09:26:32 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-i[67597]: ignoring --setgroup ceph since I am not root 2024-03-04T09:26:32.675 INFO:journalctl@ceph.mds.i.smithi190.stdout:Mar 04 09:26:32 smithi190 ceph-mds[67601]: -- 172.21.15.190:0/1301696895 <== mon.1 v2:172.21.15.190:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x563efc1f7a40 con 0x563efc1cb000 2024-03-04T09:26:32.675 INFO:journalctl@ceph.mds.i.smithi190.stdout:Mar 04 09:26:32 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-i[67597]: starting mds.i at 2024-03-04T09:26:32.676 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:32 smithi190 ceph-mon[36341]: pgmap v340: 129 pgs: 129 active+clean; 117 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-03-04T09:26:32.676 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:32 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/3398346097' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:26:32.676 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:32 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/1177500009' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:26:32.676 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:32 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/1133946292' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-03-04T09:26:32.676 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:32 smithi190 ceph-mon[36341]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-04T09:26:32.676 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:32 smithi190 ceph-mon[36341]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-04T09:26:32.677 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:32 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/1133946292' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-03-04T09:26:32.677 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:32 smithi190 ceph-mon[36341]: osdmap e107: 12 total, 12 up, 12 in 2024-03-04T09:26:32.677 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:32 smithi190 ceph-mon[36341]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-03-04T09:26:32.679 INFO:journalctl@ceph.mds.e.smithi102.stdout:Mar 04 09:26:32 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-e[65334]: ignoring --setuser ceph since I am not root 2024-03-04T09:26:32.680 INFO:journalctl@ceph.mds.e.smithi102.stdout:Mar 04 09:26:32 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-e[65334]: ignoring --setgroup ceph since I am not root 2024-03-04T09:26:32.680 INFO:journalctl@ceph.mds.e.smithi102.stdout:Mar 04 09:26:32 smithi102 ceph-mds[65338]: -- 172.21.15.102:0/66942560 <== mon.1 v2:172.21.15.190:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x559ac38f7a40 con 0x559ac38ca800 2024-03-04T09:26:32.680 INFO:journalctl@ceph.mds.e.smithi102.stdout:Mar 04 09:26:32 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-e[65334]: starting mds.e at 2024-03-04T09:26:32.681 INFO:journalctl@ceph.mds.h.smithi102.stdout:Mar 04 09:26:32 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-h[65643]: ignoring --setuser ceph since I am not root 2024-03-04T09:26:32.681 INFO:journalctl@ceph.mds.h.smithi102.stdout:Mar 04 09:26:32 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-h[65643]: ignoring --setgroup ceph since I am not root 2024-03-04T09:26:32.681 INFO:journalctl@ceph.mds.h.smithi102.stdout:Mar 04 09:26:32 smithi102 ceph-mds[65647]: -- 172.21.15.102:0/3297923370 <== mon.2 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560034b324e0 con 0x560034b08c00 2024-03-04T09:26:32.681 INFO:journalctl@ceph.mds.h.smithi102.stdout:Mar 04 09:26:32 smithi102 ceph-mds[65647]: -- 172.21.15.102:0/3297923370 <== mon.2 v2:172.21.15.102:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x560034b35a40 con 0x560034b08c00 2024-03-04T09:26:32.681 INFO:journalctl@ceph.mds.h.smithi102.stdout:Mar 04 09:26:32 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-h[65643]: starting mds.h at 2024-03-04T09:26:32.682 INFO:journalctl@ceph.mds.k.smithi102.stdout:Mar 04 09:26:32 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-k[65014]: ignoring --setuser ceph since I am not root 2024-03-04T09:26:32.682 INFO:journalctl@ceph.mds.k.smithi102.stdout:Mar 04 09:26:32 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-k[65014]: ignoring --setgroup ceph since I am not root 2024-03-04T09:26:32.682 INFO:journalctl@ceph.mds.k.smithi102.stdout:Mar 04 09:26:32 smithi102 ceph-mds[65018]: -- 172.21.15.102:0/689805315 <== mon.2 v2:172.21.15.102:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5652e7e1da40 con 0x5652e7df1000 2024-03-04T09:26:32.682 INFO:journalctl@ceph.mds.k.smithi102.stdout:Mar 04 09:26:32 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-k[65014]: starting mds.k at 2024-03-04T09:26:32.683 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:32 smithi102 ceph-mon[36220]: pgmap v340: 129 pgs: 129 active+clean; 117 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-03-04T09:26:32.683 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:32 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/3398346097' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-04T09:26:32.683 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:32 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/1177500009' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-04T09:26:32.683 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:32 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/1133946292' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-03-04T09:26:32.684 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:32 smithi102 ceph-mon[36220]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-04T09:26:32.684 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:32 smithi102 ceph-mon[36220]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-04T09:26:32.684 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:32 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/1133946292' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-03-04T09:26:32.684 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:32 smithi102 ceph-mon[36220]: osdmap e107: 12 total, 12 up, 12 in 2024-03-04T09:26:32.684 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:32 smithi102 ceph-mon[36220]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-03-04T09:26:32.685 INFO:journalctl@ceph.mds.b.smithi102.stdout:Mar 04 09:26:32 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-b[65969]: ignoring --setuser ceph since I am not root 2024-03-04T09:26:32.685 INFO:journalctl@ceph.mds.b.smithi102.stdout:Mar 04 09:26:32 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-b[65969]: ignoring --setgroup ceph since I am not root 2024-03-04T09:26:32.685 INFO:journalctl@ceph.mds.b.smithi102.stdout:Mar 04 09:26:32 smithi102 ceph-mds[65974]: -- 172.21.15.102:0/768574438 <== mon.1 v2:172.21.15.190:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x559536007a40 con 0x559535fdb000 2024-03-04T09:26:32.685 INFO:journalctl@ceph.mds.b.smithi102.stdout:Mar 04 09:26:32 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-b[65969]: starting mds.b at 2024-03-04T09:26:33.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:33.175+0000 7f40ff7fe640 1 -- 172.21.15.82:0/1880288389 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v60) v1 ==== 104+0+0 (secure 0 0 0) 0x7f410009b9d0 con 0x7f4110100e00 2024-03-04T09:26:33.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:33.178+0000 7f4114b0c640 1 -- 172.21.15.82:0/1880288389 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f40f80a1ef0 msgr2=0x7f40f80a43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:33.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:33.178+0000 7f4114b0c640 1 --2- 172.21.15.82:0/1880288389 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f40f80a1ef0 0x7f40f80a43b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4104009ae0 tx=0x7f4104005f90 comp rx=0 tx=0).stop 2024-03-04T09:26:33.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:33.178+0000 7f4114b0c640 1 -- 172.21.15.82:0/1880288389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4110100e00 msgr2=0x7f41101991d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:33.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:33.178+0000 7f4114b0c640 1 --2- 172.21.15.82:0/1880288389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4110100e00 0x7f41101991d0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f410000e9f0 tx=0x7f410000edf0 comp rx=0 tx=0).stop 2024-03-04T09:26:33.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:33.178+0000 7f4114b0c640 1 -- 172.21.15.82:0/1880288389 shutdown_connections 2024-03-04T09:26:33.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:33.178+0000 7f4114b0c640 1 --2- 172.21.15.82:0/1880288389 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f40f80a1ef0 0x7f40f80a43b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:33.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:33.178+0000 7f4114b0c640 1 --2- 172.21.15.82:0/1880288389 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f41101064e0 0x7f41101a3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:33.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:33.178+0000 7f4114b0c640 1 --2- 172.21.15.82:0/1880288389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4110100e00 0x7f41101991d0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:33.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:33.178+0000 7f4114b0c640 1 --2- 172.21.15.82:0/1880288389 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4110100440 0x7f4110198c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:33.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:33.178+0000 7f4114b0c640 1 -- 172.21.15.82:0/1880288389 >> 172.21.15.82:0/1880288389 conn(0x7f41100775d0 msgr2=0x7f4110102c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:26:33.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:33.178+0000 7f4114b0c640 1 -- 172.21.15.82:0/1880288389 shutdown_connections 2024-03-04T09:26:33.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:33.178+0000 7f4114b0c640 1 -- 172.21.15.82:0/1880288389 wait complete. 2024-03-04T09:26:33.189 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-04T09:26:33.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:33.301+0000 7ff8d3932640 1 -- 172.21.15.82:0/2149854408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8cc100440 msgr2=0x7ff8cc1008c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:33.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:33.301+0000 7ff8d3932640 1 --2- 172.21.15.82:0/2149854408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8cc100440 0x7ff8cc1008c0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8009930 tx=0x7ff8c802bc20 comp rx=0 tx=0).stop 2024-03-04T09:26:33.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:33.301+0000 7ff8d3932640 1 -- 172.21.15.82:0/2149854408 shutdown_connections 2024-03-04T09:26:33.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:33.301+0000 7ff8d3932640 1 --2- 172.21.15.82:0/2149854408 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8cc100e00 0x7ff8cc10d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:33.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:33.301+0000 7ff8d3932640 1 --2- 172.21.15.82:0/2149854408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8cc100440 0x7ff8cc1008c0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:33.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:33.301+0000 7ff8d3932640 1 --2- 172.21.15.82:0/2149854408 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff8cc1064e0 0x7ff8cc1068c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:33.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:33.301+0000 7ff8d3932640 1 -- 172.21.15.82:0/2149854408 >> 172.21.15.82:0/2149854408 conn(0x7ff8cc0775d0 msgr2=0x7ff8cc0779e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:26:33.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:33.301+0000 7ff8d3932640 1 -- 172.21.15.82:0/2149854408 shutdown_connections 2024-03-04T09:26:33.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:33.301+0000 7ff8d3932640 1 -- 172.21.15.82:0/2149854408 wait complete. 2024-03-04T09:26:33.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:33.301+0000 7ff8d3932640 1 Processor -- start 2024-03-04T09:26:33.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:33.301+0000 7ff8d3932640 1 -- start start 2024-03-04T09:26:33.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:33.301+0000 7ff8d3932640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff8cc100440 0x7ff8cc198bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:33.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:33.301+0000 7ff8d3932640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8cc100e00 0x7ff8cc199130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:33.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:33.301+0000 7ff8d3932640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8cc1064e0 0x7ff8cc1a3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:33.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:33.301+0000 7ff8d3932640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc110830 con 0x7ff8cc100e00 2024-03-04T09:26:33.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:33.301+0000 7ff8d3932640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc1106b0 con 0x7ff8cc1064e0 2024-03-04T09:26:33.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:33.301+0000 7ff8d3932640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc1109b0 con 0x7ff8cc100440 2024-03-04T09:26:33.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:33.302+0000 7ff8d0ecd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8cc100e00 0x7ff8cc199130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:33.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:33.302+0000 7ff8d0ecd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8cc100e00 0x7ff8cc199130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57242/0 (socket says 172.21.15.82:57242) 2024-03-04T09:26:33.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:33.302+0000 7ff8d0ecd640 1 -- 172.21.15.82:0/2877660653 learned_addr learned my addr 172.21.15.82:0/2877660653 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:26:33.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:33.302+0000 7ff8d16ce640 1 --2- 172.21.15.82:0/2877660653 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff8cc100440 0x7ff8cc198bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:33.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:33.302+0000 7ff8d1ecf640 1 --2- 172.21.15.82:0/2877660653 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8cc1064e0 0x7ff8cc1a3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:33.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:33.302+0000 7ff8d0ecd640 1 -- 172.21.15.82:0/2877660653 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff8cc100440 msgr2=0x7ff8cc198bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:33.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:33.302+0000 7ff8d0ecd640 1 --2- 172.21.15.82:0/2877660653 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff8cc100440 0x7ff8cc198bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:33.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:33.302+0000 7ff8d0ecd640 1 -- 172.21.15.82:0/2877660653 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8cc1064e0 msgr2=0x7ff8cc1a3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:33.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:33.302+0000 7ff8d0ecd640 1 --2- 172.21.15.82:0/2877660653 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8cc1064e0 0x7ff8cc1a3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:33.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:33.302+0000 7ff8d0ecd640 1 -- 172.21.15.82:0/2877660653 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8cc1a41b0 con 0x7ff8cc100e00 2024-03-04T09:26:33.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:33.302+0000 7ff8d0ecd640 1 --2- 172.21.15.82:0/2877660653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8cc100e00 0x7ff8cc199130 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8000c00 tx=0x7ff8c8005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:26:33.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:33.302+0000 7ff8c27fc640 1 -- 172.21.15.82:0/2877660653 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c8043020 con 0x7ff8cc100e00 2024-03-04T09:26:33.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:33.302+0000 7ff8c27fc640 1 -- 172.21.15.82:0/2877660653 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7ff8c8005420 con 0x7ff8cc100e00 2024-03-04T09:26:33.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:33.302+0000 7ff8c27fc640 1 -- 172.21.15.82:0/2877660653 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c8003ae0 con 0x7ff8cc100e00 2024-03-04T09:26:33.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:33.302+0000 7ff8d3932640 1 -- 172.21.15.82:0/2877660653 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8cc1a4380 con 0x7ff8cc100e00 2024-03-04T09:26:33.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:33.302+0000 7ff8d3932640 1 -- 172.21.15.82:0/2877660653 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8cc1a48a0 con 0x7ff8cc100e00 2024-03-04T09:26:33.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:33.303+0000 7ff8d3932640 1 -- 172.21.15.82:0/2877660653 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8cc0683c0 con 0x7ff8cc100e00 2024-03-04T09:26:33.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:33.305+0000 7ff8c27fc640 1 -- 172.21.15.82:0/2877660653 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 136887+0+0 (secure 0 0 0) 0x7ff8c8046020 con 0x7ff8cc100e00 2024-03-04T09:26:33.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:33.306+0000 7ff8c27fc640 1 --2- 172.21.15.82:0/2877660653 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7ff8b80a1ef0 0x7ff8b80a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:33.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:33.306+0000 7ff8d16ce640 1 --2- 172.21.15.82:0/2877660653 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7ff8b80a1ef0 0x7ff8b80a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:33.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:33.306+0000 7ff8c27fc640 1 -- 172.21.15.82:0/2877660653 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 9910+0+0 (secure 0 0 0) 0x7ff8c80f0c40 con 0x7ff8cc100e00 2024-03-04T09:26:33.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:33.306+0000 7ff8d16ce640 1 --2- 172.21.15.82:0/2877660653 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7ff8b80a1ef0 0x7ff8b80a43b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc00ab60 tx=0x7ff8bc00a2d0 comp rx=0 tx=0).ready entity=mgr.15543 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:26:33.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:33.309+0000 7ff8c27fc640 1 -- 172.21.15.82:0/2877660653 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7ff8c804d020 con 0x7ff8cc100e00 2024-03-04T09:26:33.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:33 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/1880288389' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-03-04T09:26:33.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:33 smithi082 ceph-mon[32880]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-04T09:26:33.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:33 smithi082 ceph-mon[32880]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-03-04T09:26:33.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:33 smithi082 ceph-mon[32880]: Cluster is now healthy 2024-03-04T09:26:33.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:33 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/1880288389' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-03-04T09:26:33.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:33 smithi082 ceph-mon[32880]: mds.? [v2:172.21.15.82:6838/3185635954,v1:172.21.15.82:6839/3185635954] up:boot 2024-03-04T09:26:33.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:33 smithi082 ceph-mon[32880]: mds.? [v2:172.21.15.102:6834/3901789769,v1:172.21.15.102:6838/3901789769] up:boot 2024-03-04T09:26:33.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:33 smithi082 ceph-mon[32880]: mds.? [v2:172.21.15.102:6835/540567247,v1:172.21.15.102:6839/540567247] up:boot 2024-03-04T09:26:33.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:33 smithi082 ceph-mon[32880]: mds.? [v2:172.21.15.102:6833/3252138030,v1:172.21.15.102:6837/3252138030] up:boot 2024-03-04T09:26:33.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:33 smithi082 ceph-mon[32880]: mds.? [v2:172.21.15.190:6836/505815490,v1:172.21.15.190:6838/505815490] up:boot 2024-03-04T09:26:33.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:33 smithi082 ceph-mon[32880]: mds.? [v2:172.21.15.190:6837/1770439223,v1:172.21.15.190:6839/1770439223] up:boot 2024-03-04T09:26:33.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:33 smithi082 ceph-mon[32880]: mds.? [v2:172.21.15.82:6840/3823002089,v1:172.21.15.82:6841/3823002089] up:boot 2024-03-04T09:26:33.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:33 smithi082 ceph-mon[32880]: mds.? [v2:172.21.15.190:6832/1767134539,v1:172.21.15.190:6834/1767134539] up:boot 2024-03-04T09:26:33.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:33 smithi082 ceph-mon[32880]: mds.? [v2:172.21.15.102:6832/2314622254,v1:172.21.15.102:6836/2314622254] up:boot 2024-03-04T09:26:33.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:33 smithi082 ceph-mon[32880]: mds.? [v2:172.21.15.190:6833/248553370,v1:172.21.15.190:6835/248553370] up:boot 2024-03-04T09:26:33.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:33 smithi082 ceph-mon[32880]: fsmap 12 up:standby 2024-03-04T09:26:33.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:33 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-04T09:26:33.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:33 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-03-04T09:26:33.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:33 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-04T09:26:33.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:33 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-04T09:26:33.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:33 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-04T09:26:33.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:33 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-04T09:26:33.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:33 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-04T09:26:33.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:33 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-03-04T09:26:33.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:33 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-03-04T09:26:33.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:33 smithi082 ceph-mon[32880]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-04T09:26:33.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:33.491+0000 7ff8d3932640 1 -- 172.21.15.82:0/2877660653 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff8cc1089b0 con 0x7ff8cc100e00 2024-03-04T09:26:33.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:33 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/1880288389' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-03-04T09:26:33.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:33 smithi190 ceph-mon[36341]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-04T09:26:33.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:33 smithi190 ceph-mon[36341]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-03-04T09:26:33.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:33 smithi190 ceph-mon[36341]: Cluster is now healthy 2024-03-04T09:26:33.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:33 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/1880288389' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-03-04T09:26:33.672 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:33 smithi190 ceph-mon[36341]: mds.? [v2:172.21.15.82:6838/3185635954,v1:172.21.15.82:6839/3185635954] up:boot 2024-03-04T09:26:33.673 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:33 smithi190 ceph-mon[36341]: mds.? [v2:172.21.15.102:6834/3901789769,v1:172.21.15.102:6838/3901789769] up:boot 2024-03-04T09:26:33.673 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:33 smithi190 ceph-mon[36341]: mds.? [v2:172.21.15.102:6835/540567247,v1:172.21.15.102:6839/540567247] up:boot 2024-03-04T09:26:33.673 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:33 smithi190 ceph-mon[36341]: mds.? [v2:172.21.15.102:6833/3252138030,v1:172.21.15.102:6837/3252138030] up:boot 2024-03-04T09:26:33.673 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:33 smithi190 ceph-mon[36341]: mds.? [v2:172.21.15.190:6836/505815490,v1:172.21.15.190:6838/505815490] up:boot 2024-03-04T09:26:33.673 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:33 smithi190 ceph-mon[36341]: mds.? [v2:172.21.15.190:6837/1770439223,v1:172.21.15.190:6839/1770439223] up:boot 2024-03-04T09:26:33.673 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:33 smithi190 ceph-mon[36341]: mds.? [v2:172.21.15.82:6840/3823002089,v1:172.21.15.82:6841/3823002089] up:boot 2024-03-04T09:26:33.674 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:33 smithi190 ceph-mon[36341]: mds.? [v2:172.21.15.190:6832/1767134539,v1:172.21.15.190:6834/1767134539] up:boot 2024-03-04T09:26:33.674 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:33 smithi190 ceph-mon[36341]: mds.? [v2:172.21.15.102:6832/2314622254,v1:172.21.15.102:6836/2314622254] up:boot 2024-03-04T09:26:33.674 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:33 smithi190 ceph-mon[36341]: mds.? [v2:172.21.15.190:6833/248553370,v1:172.21.15.190:6835/248553370] up:boot 2024-03-04T09:26:33.674 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:33 smithi190 ceph-mon[36341]: fsmap 12 up:standby 2024-03-04T09:26:33.674 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:33 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-04T09:26:33.674 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:33 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-03-04T09:26:33.675 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:33 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-04T09:26:33.675 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:33 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-04T09:26:33.675 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:33 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-04T09:26:33.675 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:33 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-04T09:26:33.675 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:33 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-04T09:26:33.675 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:33 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-03-04T09:26:33.675 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:33 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-03-04T09:26:33.676 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:33 smithi190 ceph-mon[36341]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-04T09:26:33.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:33 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/1880288389' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-03-04T09:26:33.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:33 smithi102 ceph-mon[36220]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-04T09:26:33.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:33 smithi102 ceph-mon[36220]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-03-04T09:26:33.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:33 smithi102 ceph-mon[36220]: Cluster is now healthy 2024-03-04T09:26:33.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:33 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/1880288389' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-03-04T09:26:33.680 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:33 smithi102 ceph-mon[36220]: mds.? [v2:172.21.15.82:6838/3185635954,v1:172.21.15.82:6839/3185635954] up:boot 2024-03-04T09:26:33.681 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:33 smithi102 ceph-mon[36220]: mds.? [v2:172.21.15.102:6834/3901789769,v1:172.21.15.102:6838/3901789769] up:boot 2024-03-04T09:26:33.681 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:33 smithi102 ceph-mon[36220]: mds.? [v2:172.21.15.102:6835/540567247,v1:172.21.15.102:6839/540567247] up:boot 2024-03-04T09:26:33.681 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:33 smithi102 ceph-mon[36220]: mds.? [v2:172.21.15.102:6833/3252138030,v1:172.21.15.102:6837/3252138030] up:boot 2024-03-04T09:26:33.681 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:33 smithi102 ceph-mon[36220]: mds.? [v2:172.21.15.190:6836/505815490,v1:172.21.15.190:6838/505815490] up:boot 2024-03-04T09:26:33.681 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:33 smithi102 ceph-mon[36220]: mds.? [v2:172.21.15.190:6837/1770439223,v1:172.21.15.190:6839/1770439223] up:boot 2024-03-04T09:26:33.681 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:33 smithi102 ceph-mon[36220]: mds.? [v2:172.21.15.82:6840/3823002089,v1:172.21.15.82:6841/3823002089] up:boot 2024-03-04T09:26:33.682 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:33 smithi102 ceph-mon[36220]: mds.? [v2:172.21.15.190:6832/1767134539,v1:172.21.15.190:6834/1767134539] up:boot 2024-03-04T09:26:33.682 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:33 smithi102 ceph-mon[36220]: mds.? [v2:172.21.15.102:6832/2314622254,v1:172.21.15.102:6836/2314622254] up:boot 2024-03-04T09:26:33.682 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:33 smithi102 ceph-mon[36220]: mds.? [v2:172.21.15.190:6833/248553370,v1:172.21.15.190:6835/248553370] up:boot 2024-03-04T09:26:33.682 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:33 smithi102 ceph-mon[36220]: fsmap 12 up:standby 2024-03-04T09:26:33.682 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:33 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-04T09:26:33.682 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:33 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-03-04T09:26:33.683 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:33 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-04T09:26:33.683 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:33 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-04T09:26:33.683 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:33 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-04T09:26:33.683 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:33 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-04T09:26:33.683 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:33 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-04T09:26:33.683 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:33 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-03-04T09:26:33.684 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:33 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-03-04T09:26:33.684 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:33 smithi102 ceph-mon[36220]: from='mgr.15543 172.21.15.82:0/1423137922' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-04T09:26:34.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.270+0000 7ff8c27fc640 1 -- 172.21.15.82:0/2877660653 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v108) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff8c80bd8d0 con 0x7ff8cc100e00 2024-03-04T09:26:34.267 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' removed 2024-03-04T09:26:34.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.272+0000 7ff8d3932640 1 -- 172.21.15.82:0/2877660653 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7ff8b80a1ef0 msgr2=0x7ff8b80a43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:34.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.272+0000 7ff8d3932640 1 --2- 172.21.15.82:0/2877660653 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7ff8b80a1ef0 0x7ff8b80a43b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc00ab60 tx=0x7ff8bc00a2d0 comp rx=0 tx=0).stop 2024-03-04T09:26:34.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.272+0000 7ff8d3932640 1 -- 172.21.15.82:0/2877660653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8cc100e00 msgr2=0x7ff8cc199130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:34.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.272+0000 7ff8d3932640 1 --2- 172.21.15.82:0/2877660653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8cc100e00 0x7ff8cc199130 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8000c00 tx=0x7ff8c8005020 comp rx=0 tx=0).stop 2024-03-04T09:26:34.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.273+0000 7ff8d3932640 1 -- 172.21.15.82:0/2877660653 shutdown_connections 2024-03-04T09:26:34.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.273+0000 7ff8d3932640 1 --2- 172.21.15.82:0/2877660653 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7ff8b80a1ef0 0x7ff8b80a43b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:34.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.273+0000 7ff8d3932640 1 --2- 172.21.15.82:0/2877660653 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8cc1064e0 0x7ff8cc1a3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:34.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.273+0000 7ff8d3932640 1 --2- 172.21.15.82:0/2877660653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8cc100e00 0x7ff8cc199130 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:34.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.273+0000 7ff8d3932640 1 --2- 172.21.15.82:0/2877660653 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff8cc100440 0x7ff8cc198bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:34.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.273+0000 7ff8d3932640 1 -- 172.21.15.82:0/2877660653 >> 172.21.15.82:0/2877660653 conn(0x7ff8cc0775d0 msgr2=0x7ff8cc102b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:26:34.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.273+0000 7ff8d3932640 1 -- 172.21.15.82:0/2877660653 shutdown_connections 2024-03-04T09:26:34.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.273+0000 7ff8d3932640 1 -- 172.21.15.82:0/2877660653 wait complete. 2024-03-04T09:26:34.286 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-04T09:26:34.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.400+0000 7fdab47c7640 1 -- 172.21.15.82:0/2190082473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaac100510 msgr2=0x7fdaac100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:34.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.400+0000 7fdab47c7640 1 --2- 172.21.15.82:0/2190082473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaac100510 0x7fdaac100990 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fdaa0009900 tx=0x7fdaa002bc30 comp rx=0 tx=0).stop 2024-03-04T09:26:34.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.400+0000 7fdab47c7640 1 -- 172.21.15.82:0/2190082473 shutdown_connections 2024-03-04T09:26:34.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.400+0000 7fdab47c7640 1 --2- 172.21.15.82:0/2190082473 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdaac100ed0 0x7fdaac10d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:34.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.400+0000 7fdab47c7640 1 --2- 172.21.15.82:0/2190082473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaac100510 0x7fdaac100990 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:34.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.400+0000 7fdab47c7640 1 --2- 172.21.15.82:0/2190082473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdaac1065d0 0x7fdaac1069b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:34.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.400+0000 7fdab47c7640 1 -- 172.21.15.82:0/2190082473 >> 172.21.15.82:0/2190082473 conn(0x7fdaac077630 msgr2=0x7fdaac077a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:26:34.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.400+0000 7fdab47c7640 1 -- 172.21.15.82:0/2190082473 shutdown_connections 2024-03-04T09:26:34.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.400+0000 7fdab47c7640 1 -- 172.21.15.82:0/2190082473 wait complete. 2024-03-04T09:26:34.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.401+0000 7fdab47c7640 1 Processor -- start 2024-03-04T09:26:34.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.401+0000 7fdab47c7640 1 -- start start 2024-03-04T09:26:34.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.401+0000 7fdab47c7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaac100510 0x7fdaac197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:34.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.401+0000 7fdab47c7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdaac100ed0 0x7fdaac198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:34.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.401+0000 7fdab47c7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdaac1065d0 0x7fdaac19c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:34.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.401+0000 7fdab47c7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac110900 con 0x7fdaac100510 2024-03-04T09:26:34.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.401+0000 7fdab47c7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac110780 con 0x7fdaac100ed0 2024-03-04T09:26:34.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.401+0000 7fdab47c7640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac110a80 con 0x7fdaac1065d0 2024-03-04T09:26:34.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.401+0000 7fdab2563640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaac100510 0x7fdaac197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:34.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.401+0000 7fdab2563640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaac100510 0x7fdaac197ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57262/0 (socket says 172.21.15.82:57262) 2024-03-04T09:26:34.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.401+0000 7fdab2563640 1 -- 172.21.15.82:0/2338195093 learned_addr learned my addr 172.21.15.82:0/2338195093 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:26:34.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.401+0000 7fdab1d62640 1 --2- 172.21.15.82:0/2338195093 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdaac100ed0 0x7fdaac198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:34.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.401+0000 7fdab2d64640 1 --2- 172.21.15.82:0/2338195093 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdaac1065d0 0x7fdaac19c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:34.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.401+0000 7fdab2563640 1 -- 172.21.15.82:0/2338195093 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdaac1065d0 msgr2=0x7fdaac19c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:34.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.401+0000 7fdab2563640 1 --2- 172.21.15.82:0/2338195093 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdaac1065d0 0x7fdaac19c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:34.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.401+0000 7fdab2563640 1 -- 172.21.15.82:0/2338195093 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdaac100ed0 msgr2=0x7fdaac198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:34.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.401+0000 7fdab2563640 1 --2- 172.21.15.82:0/2338195093 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdaac100ed0 0x7fdaac198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:34.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.401+0000 7fdab2563640 1 -- 172.21.15.82:0/2338195093 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaac19ceb0 con 0x7fdaac100510 2024-03-04T09:26:34.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.401+0000 7fdab2d64640 1 --2- 172.21.15.82:0/2338195093 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdaac1065d0 0x7fdaac19c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-04T09:26:34.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.401+0000 7fdab1d62640 1 --2- 172.21.15.82:0/2338195093 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdaac100ed0 0x7fdaac198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-04T09:26:34.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.401+0000 7fdab2563640 1 --2- 172.21.15.82:0/2338195093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaac100510 0x7fdaac197ec0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fdaa400c890 tx=0x7fdaa400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:26:34.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.401+0000 7fdaab7fe640 1 -- 172.21.15.82:0/2338195093 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa4004220 con 0x7fdaac100510 2024-03-04T09:26:34.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.402+0000 7fdaab7fe640 1 -- 172.21.15.82:0/2338195093 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7fdaa40043c0 con 0x7fdaac100510 2024-03-04T09:26:34.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.402+0000 7fdaab7fe640 1 -- 172.21.15.82:0/2338195093 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa4004a00 con 0x7fdaac100510 2024-03-04T09:26:34.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.402+0000 7fdab47c7640 1 -- 172.21.15.82:0/2338195093 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaac19d1a0 con 0x7fdaac100510 2024-03-04T09:26:34.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.402+0000 7fdab47c7640 1 -- 172.21.15.82:0/2338195093 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaac1a4a30 con 0x7fdaac100510 2024-03-04T09:26:34.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.402+0000 7fdab47c7640 1 -- 172.21.15.82:0/2338195093 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaac068810 con 0x7fdaac100510 2024-03-04T09:26:34.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.404+0000 7fdaab7fe640 1 -- 172.21.15.82:0/2338195093 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 136887+0+0 (secure 0 0 0) 0x7fdaa4004ba0 con 0x7fdaac100510 2024-03-04T09:26:34.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.404+0000 7fdaab7fe640 1 --2- 172.21.15.82:0/2338195093 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7fda940a1f70 0x7fda940a4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:34.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.404+0000 7fdab1d62640 1 --2- 172.21.15.82:0/2338195093 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7fda940a1f70 0x7fda940a4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:34.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.404+0000 7fdaab7fe640 1 -- 172.21.15.82:0/2338195093 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 9356+0+0 (secure 0 0 0) 0x7fdaa40ce6a0 con 0x7fdaac100510 2024-03-04T09:26:34.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.405+0000 7fdab1d62640 1 --2- 172.21.15.82:0/2338195093 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7fda940a1f70 0x7fda940a4430 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdaac077c30 tx=0x7fdaa0000bc0 comp rx=0 tx=0).ready entity=mgr.15543 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:26:34.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.408+0000 7fdaab7fe640 1 -- 172.21.15.82:0/2338195093 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fdaa4014030 con 0x7fdaac100510 2024-03-04T09:26:34.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:34 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/2877660653' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-04T09:26:34.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:34 smithi082 ceph-mon[32880]: pgmap v342: 129 pgs: 129 active+clean; 117 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-03-04T09:26:34.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:34.585+0000 7fdab47c7640 1 -- 172.21.15.82:0/2338195093 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdaac199210 con 0x7fdaac100510 2024-03-04T09:26:34.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:34 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/2877660653' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-04T09:26:34.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:34 smithi190 ceph-mon[36341]: pgmap v342: 129 pgs: 129 active+clean; 117 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-03-04T09:26:34.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:34 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/2877660653' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-04T09:26:34.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:34 smithi102 ceph-mon[36220]: pgmap v342: 129 pgs: 129 active+clean; 117 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-03-04T09:26:35.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:35.271+0000 7fdaab7fe640 1 -- 172.21.15.82:0/2338195093 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v109) v1 ==== 169+0+0 (secure 0 0 0) 0x7fdaa409b4d0 con 0x7fdaac100510 2024-03-04T09:26:35.268 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' removed 2024-03-04T09:26:35.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:35.274+0000 7fdab47c7640 1 -- 172.21.15.82:0/2338195093 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7fda940a1f70 msgr2=0x7fda940a4430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:35.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:35.274+0000 7fdab47c7640 1 --2- 172.21.15.82:0/2338195093 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7fda940a1f70 0x7fda940a4430 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdaac077c30 tx=0x7fdaa0000bc0 comp rx=0 tx=0).stop 2024-03-04T09:26:35.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:35.274+0000 7fdab47c7640 1 -- 172.21.15.82:0/2338195093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaac100510 msgr2=0x7fdaac197ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:35.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:35.274+0000 7fdab47c7640 1 --2- 172.21.15.82:0/2338195093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaac100510 0x7fdaac197ec0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fdaa400c890 tx=0x7fdaa400cd50 comp rx=0 tx=0).stop 2024-03-04T09:26:35.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:35.275+0000 7fdab47c7640 1 -- 172.21.15.82:0/2338195093 shutdown_connections 2024-03-04T09:26:35.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:35.275+0000 7fdab47c7640 1 --2- 172.21.15.82:0/2338195093 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7fda940a1f70 0x7fda940a4430 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:35.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:35.275+0000 7fdab47c7640 1 --2- 172.21.15.82:0/2338195093 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdaac1065d0 0x7fdaac19c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:35.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:35.275+0000 7fdab47c7640 1 --2- 172.21.15.82:0/2338195093 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdaac100ed0 0x7fdaac198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:35.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:35.275+0000 7fdab47c7640 1 --2- 172.21.15.82:0/2338195093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdaac100510 0x7fdaac197ec0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:35.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:35.275+0000 7fdab47c7640 1 -- 172.21.15.82:0/2338195093 >> 172.21.15.82:0/2338195093 conn(0x7fdaac077630 msgr2=0x7fdaac069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:26:35.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:35.275+0000 7fdab47c7640 1 -- 172.21.15.82:0/2338195093 shutdown_connections 2024-03-04T09:26:35.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:35.276+0000 7fdab47c7640 1 -- 172.21.15.82:0/2338195093 wait complete. 2024-03-04T09:26:35.291 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-03-04T09:26:35.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:35.409+0000 7f63747d7640 1 -- 172.21.15.82:0/1363089972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f636c069c80 msgr2=0x7f636c06a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:35.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:35.409+0000 7f63747d7640 1 --2- 172.21.15.82:0/1363089972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f636c069c80 0x7f636c06a100 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f635c009900 tx=0x7f635c02bc30 comp rx=0 tx=0).stop 2024-03-04T09:26:35.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:35.409+0000 7f63747d7640 1 -- 172.21.15.82:0/1363089972 shutdown_connections 2024-03-04T09:26:35.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:35.409+0000 7f63747d7640 1 --2- 172.21.15.82:0/1363089972 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f636c06a640 0x7f636c10e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:35.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:35.409+0000 7f63747d7640 1 --2- 172.21.15.82:0/1363089972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f636c069c80 0x7f636c06a100 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:35.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:35.409+0000 7f63747d7640 1 --2- 172.21.15.82:0/1363089972 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f636c107640 0x7f636c107a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:35.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:35.409+0000 7f63747d7640 1 -- 172.21.15.82:0/1363089972 >> 172.21.15.82:0/1363089972 conn(0x7f636c0775a0 msgr2=0x7f636c0779b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:26:35.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:35.410+0000 7f63747d7640 1 -- 172.21.15.82:0/1363089972 shutdown_connections 2024-03-04T09:26:35.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:35.410+0000 7f63747d7640 1 -- 172.21.15.82:0/1363089972 wait complete. 2024-03-04T09:26:35.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:35.410+0000 7f63747d7640 1 Processor -- start 2024-03-04T09:26:35.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:35.410+0000 7f63747d7640 1 -- start start 2024-03-04T09:26:35.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:35.410+0000 7f63747d7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f636c069c80 0x7f636c197d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:35.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:35.410+0000 7f63747d7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f636c06a640 0x7f636c1982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:35.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:35.410+0000 7f63747d7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f636c107640 0x7f636c19c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:35.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:35.410+0000 7f63747d7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f636c1118f0 con 0x7f636c107640 2024-03-04T09:26:35.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:35.410+0000 7f63747d7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f636c111770 con 0x7f636c069c80 2024-03-04T09:26:35.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:35.410+0000 7f63747d7640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f636c111a70 con 0x7f636c06a640 2024-03-04T09:26:35.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:35.410+0000 7f6372d74640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f636c107640 0x7f636c19c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:35.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:35.410+0000 7f6372d74640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f636c107640 0x7f636c19c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57294/0 (socket says 172.21.15.82:57294) 2024-03-04T09:26:35.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:35.410+0000 7f6372d74640 1 -- 172.21.15.82:0/4214797824 learned_addr learned my addr 172.21.15.82:0/4214797824 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-04T09:26:35.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:35.411+0000 7f6371d72640 1 --2- 172.21.15.82:0/4214797824 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f636c06a640 0x7f636c1982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:35.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:35.411+0000 7f6372573640 1 --2- 172.21.15.82:0/4214797824 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f636c069c80 0x7f636c197d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:35.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:35.411+0000 7f6372d74640 1 -- 172.21.15.82:0/4214797824 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f636c06a640 msgr2=0x7f636c1982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:35.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:35.411+0000 7f6372d74640 1 --2- 172.21.15.82:0/4214797824 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f636c06a640 0x7f636c1982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:35.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:35.411+0000 7f6372d74640 1 -- 172.21.15.82:0/4214797824 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f636c069c80 msgr2=0x7f636c197d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:35.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:35.411+0000 7f6372d74640 1 --2- 172.21.15.82:0/4214797824 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f636c069c80 0x7f636c197d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:35.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:35.411+0000 7f6372d74640 1 -- 172.21.15.82:0/4214797824 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f636c19cd80 con 0x7f636c107640 2024-03-04T09:26:35.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:35.411+0000 7f6372d74640 1 --2- 172.21.15.82:0/4214797824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f636c107640 0x7f636c19c650 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f636400eaa0 tx=0x7f636400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:26:35.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:35.411+0000 7f63637fe640 1 -- 172.21.15.82:0/4214797824 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636400cdb0 con 0x7f636c107640 2024-03-04T09:26:35.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:35.411+0000 7f63747d7640 1 -- 172.21.15.82:0/4214797824 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f636c19d070 con 0x7f636c107640 2024-03-04T09:26:35.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:35.411+0000 7f63637fe640 1 -- 172.21.15.82:0/4214797824 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1136+0+0 (secure 0 0 0) 0x7f6364005020 con 0x7f636c107640 2024-03-04T09:26:35.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:35.411+0000 7f63637fe640 1 -- 172.21.15.82:0/4214797824 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63640116b0 con 0x7f636c107640 2024-03-04T09:26:35.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:35.411+0000 7f63747d7640 1 -- 172.21.15.82:0/4214797824 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f636c1a4900 con 0x7f636c107640 2024-03-04T09:26:35.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:35.412+0000 7f63747d7640 1 -- 172.21.15.82:0/4214797824 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f636c102ca0 con 0x7f636c107640 2024-03-04T09:26:35.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:35.413+0000 7f63637fe640 1 -- 172.21.15.82:0/4214797824 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 136887+0+0 (secure 0 0 0) 0x7f63640051d0 con 0x7f636c107640 2024-03-04T09:26:35.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:35.414+0000 7f63637fe640 1 --2- 172.21.15.82:0/4214797824 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f63580a1ef0 0x7f63580a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-04T09:26:35.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:35.414+0000 7f6372573640 1 --2- 172.21.15.82:0/4214797824 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f63580a1ef0 0x7f63580a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-04T09:26:35.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:35.414+0000 7f63637fe640 1 -- 172.21.15.82:0/4214797824 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 8797+0+0 (secure 0 0 0) 0x7f63640ce450 con 0x7f636c107640 2024-03-04T09:26:35.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:35.414+0000 7f6372573640 1 --2- 172.21.15.82:0/4214797824 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f63580a1ef0 0x7f63580a43b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f636800bbe0 tx=0x7f636800b390 comp rx=0 tx=0).ready entity=mgr.15543 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-04T09:26:35.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:35.419+0000 7f63637fe640 1 -- 172.21.15.82:0/4214797824 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f6364016030 con 0x7f636c107640 2024-03-04T09:26:35.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:35 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/2877660653' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-03-04T09:26:35.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:35 smithi082 ceph-mon[32880]: osdmap e108: 12 total, 12 up, 12 in 2024-03-04T09:26:35.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:35 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/2338195093' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-04T09:26:35.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:35.594+0000 7f63747d7640 1 -- 172.21.15.82:0/4214797824 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f636c109400 con 0x7f636c107640 2024-03-04T09:26:35.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:35 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/2877660653' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-03-04T09:26:35.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:35 smithi190 ceph-mon[36341]: osdmap e108: 12 total, 12 up, 12 in 2024-03-04T09:26:35.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:35 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/2338195093' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-04T09:26:35.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:35 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/2877660653' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-03-04T09:26:35.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:35 smithi102 ceph-mon[36220]: osdmap e108: 12 total, 12 up, 12 in 2024-03-04T09:26:35.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:35 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/2338195093' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-04T09:26:36.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:36.279+0000 7f63637fe640 1 -- 172.21.15.82:0/4214797824 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v110) v1 ==== 178+0+0 (secure 0 0 0) 0x7f636409ade0 con 0x7f636c107640 2024-03-04T09:26:36.276 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data_ec' removed 2024-03-04T09:26:36.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:36.283+0000 7f63747d7640 1 -- 172.21.15.82:0/4214797824 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f63580a1ef0 msgr2=0x7f63580a43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:36.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:36.283+0000 7f63747d7640 1 --2- 172.21.15.82:0/4214797824 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f63580a1ef0 0x7f63580a43b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f636800bbe0 tx=0x7f636800b390 comp rx=0 tx=0).stop 2024-03-04T09:26:36.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:36.283+0000 7f63747d7640 1 -- 172.21.15.82:0/4214797824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f636c107640 msgr2=0x7f636c19c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-04T09:26:36.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:36.283+0000 7f63747d7640 1 --2- 172.21.15.82:0/4214797824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f636c107640 0x7f636c19c650 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f636400eaa0 tx=0x7f636400ef60 comp rx=0 tx=0).stop 2024-03-04T09:26:36.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:36.283+0000 7f63747d7640 1 -- 172.21.15.82:0/4214797824 shutdown_connections 2024-03-04T09:26:36.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:36.283+0000 7f63747d7640 1 --2- 172.21.15.82:0/4214797824 >> [v2:172.21.15.82:6800/662455866,v1:172.21.15.82:6801/662455866] conn(0x7f63580a1ef0 0x7f63580a43b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:36.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:36.283+0000 7f63747d7640 1 --2- 172.21.15.82:0/4214797824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f636c107640 0x7f636c19c650 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:36.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:36.283+0000 7f63747d7640 1 --2- 172.21.15.82:0/4214797824 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f636c06a640 0x7f636c1982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:36.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:36.283+0000 7f63747d7640 1 --2- 172.21.15.82:0/4214797824 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f636c069c80 0x7f636c197d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-04T09:26:36.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:36.283+0000 7f63747d7640 1 -- 172.21.15.82:0/4214797824 >> 172.21.15.82:0/4214797824 conn(0x7f636c0775a0 msgr2=0x7f636c0ff150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-04T09:26:36.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:36.283+0000 7f63747d7640 1 -- 172.21.15.82:0/4214797824 shutdown_connections 2024-03-04T09:26:36.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-04T09:26:36.283+0000 7f63747d7640 1 -- 172.21.15.82:0/4214797824 wait complete. 2024-03-04T09:26:36.297 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-04T09:26:36.328 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-04T09:26:36.361 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-04T09:26:36.394 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-03-04T09:26:36.394 DEBUG:teuthology.orchestra.run.smithi082:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-03-04T09:26:36.410 DEBUG:teuthology.orchestra.run.smithi102:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-03-04T09:26:36.426 DEBUG:teuthology.orchestra.run.smithi190:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-03-04T09:26:36.450 INFO:tasks.cephadm:Stopping all daemons... 2024-03-04T09:26:36.450 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-03-04T09:26:36.450 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mon.a 2024-03-04T09:26:36.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:36 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/2338195093' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-03-04T09:26:36.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:36 smithi082 ceph-mon[32880]: osdmap e109: 12 total, 12 up, 12 in 2024-03-04T09:26:36.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:36 smithi082 ceph-mon[32880]: pgmap v345: 33 pgs: 33 active+clean; 577 KiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:26:36.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:36 smithi082 ceph-mon[32880]: from='client.? 172.21.15.82:0/4214797824' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-04T09:26:36.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:36 smithi082 systemd[1]: Stopping Ceph mon.a for 2e533fc8-da06-11ee-95c6-87774f69a715... 2024-03-04T09:26:36.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:36 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/2338195093' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-03-04T09:26:36.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:36 smithi190 ceph-mon[36341]: osdmap e109: 12 total, 12 up, 12 in 2024-03-04T09:26:36.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:36 smithi190 ceph-mon[36341]: pgmap v345: 33 pgs: 33 active+clean; 577 KiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:26:36.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:36 smithi190 ceph-mon[36341]: from='client.? 172.21.15.82:0/4214797824' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-04T09:26:36.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:36 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/2338195093' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-03-04T09:26:36.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:36 smithi102 ceph-mon[36220]: osdmap e109: 12 total, 12 up, 12 in 2024-03-04T09:26:36.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:36 smithi102 ceph-mon[36220]: pgmap v345: 33 pgs: 33 active+clean; 577 KiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-04T09:26:36.679 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:36 smithi102 ceph-mon[36220]: from='client.? 172.21.15.82:0/4214797824' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-04T09:26:37.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:36 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mon-a[32876]: 2024-03-04T09:26:36.763+0000 7fbabeee2700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T09:26:37.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:36 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mon-a[32876]: 2024-03-04T09:26:36.763+0000 7fbabeee2700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-03-04T09:26:37.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:36 smithi082 podman[93070]: 2024-03-04 09:26:36.927374357 +0000 UTC m=+0.283462063 container died 938c8db3694aaa7fc4a1414b02079a2e6b04d42e0b295ad381b2be9e145d3544 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8) 2024-03-04T09:26:37.567 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:37 smithi082 podman[93070]: 2024-03-04 09:26:37.33933663 +0000 UTC m=+0.695424343 container cleanup 938c8db3694aaa7fc4a1414b02079a2e6b04d42e0b295ad381b2be9e145d3544 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mon-a, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240222, ceph=True, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-04T09:26:37.568 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 04 09:26:37 smithi082 bash[93070]: ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mon-a 2024-03-04T09:26:37.743 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mon.a.service' 2024-03-04T09:26:37.795 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-04T09:26:37.795 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-03-04T09:26:37.795 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-03-04T09:26:37.795 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mon.b 2024-03-04T09:26:38.114 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:37 smithi102 systemd[1]: Stopping Ceph mon.b for 2e533fc8-da06-11ee-95c6-87774f69a715... 2024-03-04T09:26:38.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:38 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mon-b[36216]: 2024-03-04T09:26:38.117+0000 7f108510e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T09:26:38.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:38 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mon-b[36216]: 2024-03-04T09:26:38.117+0000 7f108510e700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-03-04T09:26:38.429 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:38 smithi102 podman[71491]: 2024-03-04 09:26:38.179294648 +0000 UTC m=+0.176231299 container died 2bb2d29e7dd5af952ea5a8634c91ef7e26ab9002c5b4a2f0894e756eefdb5267 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mon-b, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS) 2024-03-04T09:26:38.733 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:38 smithi102 podman[71491]: 2024-03-04 09:26:38.51835979 +0000 UTC m=+0.515296442 container cleanup 2bb2d29e7dd5af952ea5a8634c91ef7e26ab9002c5b4a2f0894e756eefdb5267 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mon-b, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-03-04T09:26:38.733 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:38 smithi102 bash[71491]: ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mon-b 2024-03-04T09:26:38.975 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mon.b.service' 2024-03-04T09:26:38.999 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:38 smithi102 podman[71505]: 2024-03-04 09:26:38.73689348 +0000 UTC m=+0.559633942 container remove 2bb2d29e7dd5af952ea5a8634c91ef7e26ab9002c5b4a2f0894e756eefdb5267 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mon-b, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-lusov-qdb-1bc250c, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-03-04T09:26:38.999 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:38 smithi102 systemd[1]: ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mon.b.service: Deactivated successfully. 2024-03-04T09:26:38.999 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:38 smithi102 systemd[1]: Stopped Ceph mon.b for 2e533fc8-da06-11ee-95c6-87774f69a715. 2024-03-04T09:26:38.999 INFO:journalctl@ceph.mon.b.smithi102.stdout:Mar 04 09:26:38 smithi102 systemd[1]: ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mon.b.service: Consumed 10.837s CPU time. 2024-03-04T09:26:39.029 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-04T09:26:39.029 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-03-04T09:26:39.029 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-03-04T09:26:39.030 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mon.c 2024-03-04T09:26:39.343 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:39 smithi190 systemd[1]: Stopping Ceph mon.c for 2e533fc8-da06-11ee-95c6-87774f69a715... 2024-03-04T09:26:39.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:39 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mon-c[36322]: 2024-03-04T09:26:39.346+0000 7fd32eb72700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T09:26:39.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:39 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mon-c[36322]: 2024-03-04T09:26:39.346+0000 7fd32eb72700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-03-04T09:26:39.671 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:39 smithi190 podman[72967]: 2024-03-04 09:26:39.561101049 +0000 UTC m=+0.333041625 container died 2d0032eabe8cf09c7b4b60007aec1ac1b6c04aa723d6b762472e9803b02c2116 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mon-c, RELEASE=wip-lusov-qdb-1bc250c, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2) 2024-03-04T09:26:40.127 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:39 smithi190 podman[72967]: 2024-03-04 09:26:39.938280364 +0000 UTC m=+0.710220915 container cleanup 2d0032eabe8cf09c7b4b60007aec1ac1b6c04aa723d6b762472e9803b02c2116 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mon-c, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-qdb-1bc250c, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-04T09:26:40.127 INFO:journalctl@ceph.mon.c.smithi190.stdout:Mar 04 09:26:39 smithi190 bash[72967]: ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mon-c 2024-03-04T09:26:40.344 DEBUG:teuthology.orchestra.run.smithi190:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mon.c.service' 2024-03-04T09:26:40.393 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-04T09:26:40.393 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-03-04T09:26:40.393 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-03-04T09:26:40.393 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mgr.x 2024-03-04T09:26:40.723 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:26:40 smithi082 systemd[1]: Stopping Ceph mgr.x for 2e533fc8-da06-11ee-95c6-87774f69a715... 2024-03-04T09:26:41.031 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:26:40 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x[33112]: 2024-03-04T09:26:40.725+0000 7fa7d5824700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T09:26:41.032 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:26:40 smithi082 podman[93193]: 2024-03-04 09:26:40.757459766 +0000 UTC m=+0.160829735 container died c589e7f2c2f708af2718a20fbbd859f4afddae904101842bb45e4f10354b8427 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.vendor=CentOS, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD) 2024-03-04T09:26:41.317 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:26:41 smithi082 podman[93193]: 2024-03-04 09:26:41.126857422 +0000 UTC m=+0.530227379 container cleanup c589e7f2c2f708af2718a20fbbd859f4afddae904101842bb45e4f10354b8427 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1bc250c71294e65f0a1e8e3ebd8b2a618c6b57bd, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240222, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, RELEASE=wip-lusov-qdb-1bc250c) 2024-03-04T09:26:41.317 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 04 09:26:41 smithi082 bash[93193]: ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-x 2024-03-04T09:26:41.492 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mgr.x.service' 2024-03-04T09:26:41.529 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-04T09:26:41.530 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-03-04T09:26:41.530 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-03-04T09:26:41.530 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mgr.y 2024-03-04T09:26:41.865 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:26:41 smithi102 systemd[1]: Stopping Ceph mgr.y for 2e533fc8-da06-11ee-95c6-87774f69a715... 2024-03-04T09:26:42.154 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:26:41 smithi102 podman[71619]: 2024-03-04 09:26:41.869431476 +0000 UTC m=+0.145697450 container died 3b58c026fa62444db59b95502021cb181e8850a74919e5320668cff83de6edde (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-y, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, RELEASE=wip-lusov-qdb-1bc250c, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True) 2024-03-04T09:26:42.429 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:26:42 smithi102 podman[71619]: 2024-03-04 09:26:42.240766809 +0000 UTC m=+0.517032791 container cleanup 3b58c026fa62444db59b95502021cb181e8850a74919e5320668cff83de6edde (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-y, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-qdb-1bc250c, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-03-04T09:26:42.429 INFO:journalctl@ceph.mgr.y.smithi102.stdout:Mar 04 09:26:42 smithi102 bash[71619]: ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-y 2024-03-04T09:26:42.675 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mgr.y.service' 2024-03-04T09:26:42.711 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-04T09:26:42.711 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-03-04T09:26:42.711 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-03-04T09:26:42.712 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mgr.z 2024-03-04T09:26:43.051 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:26:42 smithi190 systemd[1]: Stopping Ceph mgr.z for 2e533fc8-da06-11ee-95c6-87774f69a715... 2024-03-04T09:26:43.372 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:26:43 smithi190 podman[73090]: 2024-03-04 09:26:43.055292693 +0000 UTC m=+0.148057746 container died 63f707160b8610f0907073c3d9a50c63e9505a3a6888ffba554551c937e6d31f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-qdb-1bc250c, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.build-date=20240222) 2024-03-04T09:26:43.624 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:26:43 smithi190 podman[73090]: 2024-03-04 09:26:43.376513265 +0000 UTC m=+0.469278319 container cleanup 63f707160b8610f0907073c3d9a50c63e9505a3a6888ffba554551c937e6d31f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, ceph=True, maintainer=Guillaume Abrioux ) 2024-03-04T09:26:43.625 INFO:journalctl@ceph.mgr.z.smithi190.stdout:Mar 04 09:26:43 smithi190 bash[73090]: ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mgr-z 2024-03-04T09:26:43.726 DEBUG:teuthology.orchestra.run.smithi190:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mgr.z.service' 2024-03-04T09:26:43.764 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-04T09:26:43.765 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-03-04T09:26:43.765 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-03-04T09:26:43.765 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-2e533fc8-da06-11ee-95c6-87774f69a715@osd.0 2024-03-04T09:26:44.067 INFO:journalctl@ceph.osd.0.smithi082.stdout:Mar 04 09:26:43 smithi082 systemd[1]: Stopping Ceph osd.0 for 2e533fc8-da06-11ee-95c6-87774f69a715... 2024-03-04T09:26:44.567 INFO:journalctl@ceph.osd.0.smithi082.stdout:Mar 04 09:26:44 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-0[47395]: 2024-03-04T09:26:44.080+0000 7fcadc9de700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T09:26:44.567 INFO:journalctl@ceph.osd.0.smithi082.stdout:Mar 04 09:26:44 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-0[47395]: 2024-03-04T09:26:44.080+0000 7fcadc9de700 -1 osd.0 110 *** Got signal Terminated *** 2024-03-04T09:26:44.567 INFO:journalctl@ceph.osd.0.smithi082.stdout:Mar 04 09:26:44 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-0[47395]: 2024-03-04T09:26:44.080+0000 7fcadc9de700 -1 osd.0 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-04T09:26:49.936 INFO:journalctl@ceph.osd.0.smithi082.stdout:Mar 04 09:26:49 smithi082 podman[93314]: 2024-03-04 09:26:49.626959056 +0000 UTC m=+5.663642653 container died 50e75a8dd32a4dff9a003769cc5322025759fe306b4093a95f934715f76eaf13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-0, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, ceph=True, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-qdb-1bc250c) 2024-03-04T09:26:50.244 INFO:journalctl@ceph.osd.0.smithi082.stdout:Mar 04 09:26:50 smithi082 podman[93314]: 2024-03-04 09:26:50.039322617 +0000 UTC m=+6.076006272 container cleanup 50e75a8dd32a4dff9a003769cc5322025759fe306b4093a95f934715f76eaf13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-0, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-03-04T09:26:50.244 INFO:journalctl@ceph.osd.0.smithi082.stdout:Mar 04 09:26:50 smithi082 bash[93314]: ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-0 2024-03-04T09:26:50.567 INFO:journalctl@ceph.osd.0.smithi082.stdout:Mar 04 09:26:50 smithi082 podman[93331]: 2024-03-04 09:26:50.248774316 +0000 UTC m=+0.619818830 container remove 50e75a8dd32a4dff9a003769cc5322025759fe306b4093a95f934715f76eaf13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-0, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-03-04T09:26:50.866 INFO:journalctl@ceph.osd.0.smithi082.stdout:Mar 04 09:26:50 smithi082 podman[93421]: 2024-03-04 09:26:50.48183417 +0000 UTC m=+0.018896892 image pull f88ffb32aa6a7d5dfdc954d9f096f0c9cc47981d05ec8d117ba859a22d8185ba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5 2024-03-04T09:26:50.866 INFO:journalctl@ceph.osd.0.smithi082.stdout:Mar 04 09:26:50 smithi082 podman[93421]: 2024-03-04 09:26:50.591304415 +0000 UTC m=+0.128367137 container create d29c47c456660e04357d83409abddb29afda1c24f385f57f76cda65b5d50dda2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-0-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-03-04T09:26:51.255 INFO:journalctl@ceph.osd.0.smithi082.stdout:Mar 04 09:26:50 smithi082 podman[93421]: 2024-03-04 09:26:50.961208376 +0000 UTC m=+0.498271101 container init d29c47c456660e04357d83409abddb29afda1c24f385f57f76cda65b5d50dda2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-0-deactivate, ceph=True, GIT_CLEAN=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-04T09:26:51.255 INFO:journalctl@ceph.osd.0.smithi082.stdout:Mar 04 09:26:50 smithi082 podman[93421]: 2024-03-04 09:26:50.964687568 +0000 UTC m=+0.501750290 container start d29c47c456660e04357d83409abddb29afda1c24f385f57f76cda65b5d50dda2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, ceph=True, RELEASE=wip-lusov-qdb-1bc250c, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-03-04T09:26:51.255 INFO:journalctl@ceph.osd.0.smithi082.stdout:Mar 04 09:26:51 smithi082 podman[93421]: 2024-03-04 09:26:51.061086558 +0000 UTC m=+0.598149286 container attach d29c47c456660e04357d83409abddb29afda1c24f385f57f76cda65b5d50dda2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-0-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-04T09:26:51.567 INFO:journalctl@ceph.osd.0.smithi082.stdout:Mar 04 09:26:51 smithi082 podman[93421]: 2024-03-04 09:26:51.25905576 +0000 UTC m=+0.796118494 container died d29c47c456660e04357d83409abddb29afda1c24f385f57f76cda65b5d50dda2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-0-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-lusov-qdb-1bc250c, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240222) 2024-03-04T09:26:51.953 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@osd.0.service' 2024-03-04T09:26:51.996 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-04T09:26:51.997 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-03-04T09:26:51.997 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-03-04T09:26:51.997 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-2e533fc8-da06-11ee-95c6-87774f69a715@osd.1 2024-03-04T09:26:52.300 INFO:journalctl@ceph.osd.1.smithi102.stdout:Mar 04 09:26:52 smithi102 systemd[1]: Stopping Ceph osd.1 for 2e533fc8-da06-11ee-95c6-87774f69a715... 2024-03-04T09:26:52.679 INFO:journalctl@ceph.osd.1.smithi102.stdout:Mar 04 09:26:52 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-1[40784]: 2024-03-04T09:26:52.303+0000 7f8cac63c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T09:26:52.679 INFO:journalctl@ceph.osd.1.smithi102.stdout:Mar 04 09:26:52 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-1[40784]: 2024-03-04T09:26:52.303+0000 7f8cac63c700 -1 osd.1 110 *** Got signal Terminated *** 2024-03-04T09:26:52.679 INFO:journalctl@ceph.osd.1.smithi102.stdout:Mar 04 09:26:52 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-1[40784]: 2024-03-04T09:26:52.303+0000 7f8cac63c700 -1 osd.1 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-04T09:26:57.918 INFO:journalctl@ceph.osd.1.smithi102.stdout:Mar 04 09:26:57 smithi102 podman[71743]: 2024-03-04 09:26:57.64365659 +0000 UTC m=+5.458955496 container died 4fb7ba18bed9488af8855d49b913b84f5769b35562f2f9f34cfd031568334c7c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-1, ceph=True, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240222, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-03-04T09:26:58.179 INFO:journalctl@ceph.osd.1.smithi102.stdout:Mar 04 09:26:58 smithi102 podman[71743]: 2024-03-04 09:26:58.012598236 +0000 UTC m=+5.827897141 container cleanup 4fb7ba18bed9488af8855d49b913b84f5769b35562f2f9f34cfd031568334c7c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-1, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-qdb-1bc250c, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-03-04T09:26:58.180 INFO:journalctl@ceph.osd.1.smithi102.stdout:Mar 04 09:26:58 smithi102 bash[71743]: ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-1 2024-03-04T09:26:58.665 INFO:journalctl@ceph.osd.1.smithi102.stdout:Mar 04 09:26:58 smithi102 podman[71760]: 2024-03-04 09:26:58.314284564 +0000 UTC m=+0.667972751 container remove 4fb7ba18bed9488af8855d49b913b84f5769b35562f2f9f34cfd031568334c7c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-1, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-qdb-1bc250c, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-03-04T09:26:58.929 INFO:journalctl@ceph.osd.1.smithi102.stdout:Mar 04 09:26:58 smithi102 podman[71852]: 2024-03-04 09:26:58.572545946 +0000 UTC m=+0.018913338 image pull f88ffb32aa6a7d5dfdc954d9f096f0c9cc47981d05ec8d117ba859a22d8185ba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5 2024-03-04T09:26:58.930 INFO:journalctl@ceph.osd.1.smithi102.stdout:Mar 04 09:26:58 smithi102 podman[71852]: 2024-03-04 09:26:58.690260118 +0000 UTC m=+0.136627538 container create eee68195a543a0cb44346324b8303693ba98630dca1b9c9122ca3ba31e2e50d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-1-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-lusov-qdb-1bc250c) 2024-03-04T09:26:59.241 INFO:journalctl@ceph.osd.1.smithi102.stdout:Mar 04 09:26:58 smithi102 podman[71852]: 2024-03-04 09:26:58.951541948 +0000 UTC m=+0.397909326 container init eee68195a543a0cb44346324b8303693ba98630dca1b9c9122ca3ba31e2e50d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-1-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-lusov-qdb-1bc250c, GIT_BRANCH=HEAD, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-03-04T09:26:59.241 INFO:journalctl@ceph.osd.1.smithi102.stdout:Mar 04 09:26:58 smithi102 podman[71852]: 2024-03-04 09:26:58.954616973 +0000 UTC m=+0.400984350 container start eee68195a543a0cb44346324b8303693ba98630dca1b9c9122ca3ba31e2e50d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-1-deactivate, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-lusov-qdb-1bc250c, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-04T09:26:59.241 INFO:journalctl@ceph.osd.1.smithi102.stdout:Mar 04 09:26:59 smithi102 podman[71852]: 2024-03-04 09:26:59.051571179 +0000 UTC m=+0.497938563 container attach eee68195a543a0cb44346324b8303693ba98630dca1b9c9122ca3ba31e2e50d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-1-deactivate, RELEASE=wip-lusov-qdb-1bc250c, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-03-04T09:26:59.515 INFO:journalctl@ceph.osd.1.smithi102.stdout:Mar 04 09:26:59 smithi102 podman[71852]: 2024-03-04 09:26:59.245285142 +0000 UTC m=+0.691652517 container died eee68195a543a0cb44346324b8303693ba98630dca1b9c9122ca3ba31e2e50d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-1-deactivate, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-qdb-1bc250c, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-04T09:26:59.916 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@osd.1.service' 2024-03-04T09:26:59.957 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-04T09:26:59.958 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-03-04T09:26:59.958 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-03-04T09:26:59.958 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ceph-2e533fc8-da06-11ee-95c6-87774f69a715@osd.2 2024-03-04T09:27:00.252 INFO:journalctl@ceph.osd.2.smithi190.stdout:Mar 04 09:27:00 smithi190 systemd[1]: Stopping Ceph osd.2 for 2e533fc8-da06-11ee-95c6-87774f69a715... 2024-03-04T09:27:00.512 INFO:journalctl@ceph.osd.2.smithi190.stdout:Mar 04 09:27:00 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-2[41494]: 2024-03-04T09:27:00.254+0000 7f223f260700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T09:27:00.512 INFO:journalctl@ceph.osd.2.smithi190.stdout:Mar 04 09:27:00 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-2[41494]: 2024-03-04T09:27:00.254+0000 7f223f260700 -1 osd.2 110 *** Got signal Terminated *** 2024-03-04T09:27:00.513 INFO:journalctl@ceph.osd.2.smithi190.stdout:Mar 04 09:27:00 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-2[41494]: 2024-03-04T09:27:00.254+0000 7f223f260700 -1 osd.2 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-04T09:27:05.895 INFO:journalctl@ceph.osd.2.smithi190.stdout:Mar 04 09:27:05 smithi190 podman[73214]: 2024-03-04 09:27:05.602230259 +0000 UTC m=+5.447885482 container died 1a52d98e73411257412e6cb6a0d6f3de0d4d207a6b948c7c0bf586c0adb997b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, RELEASE=wip-lusov-qdb-1bc250c, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-03-04T09:27:06.171 INFO:journalctl@ceph.osd.2.smithi190.stdout:Mar 04 09:27:05 smithi190 podman[73214]: 2024-03-04 09:27:05.997022352 +0000 UTC m=+5.842677585 container cleanup 1a52d98e73411257412e6cb6a0d6f3de0d4d207a6b948c7c0bf586c0adb997b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-2, org.label-schema.build-date=20240222, RELEASE=wip-lusov-qdb-1bc250c, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-03-04T09:27:06.171 INFO:journalctl@ceph.osd.2.smithi190.stdout:Mar 04 09:27:05 smithi190 bash[73214]: ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-2 2024-03-04T09:27:06.562 INFO:journalctl@ceph.osd.2.smithi190.stdout:Mar 04 09:27:06 smithi190 podman[73243]: 2024-03-04 09:27:06.257072058 +0000 UTC m=+0.651849729 container remove 1a52d98e73411257412e6cb6a0d6f3de0d4d207a6b948c7c0bf586c0adb997b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, RELEASE=wip-lusov-qdb-1bc250c, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=) 2024-03-04T09:27:06.857 INFO:journalctl@ceph.osd.2.smithi190.stdout:Mar 04 09:27:06 smithi190 podman[73334]: 2024-03-04 09:27:06.469607942 +0000 UTC m=+0.017822496 image pull f88ffb32aa6a7d5dfdc954d9f096f0c9cc47981d05ec8d117ba859a22d8185ba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5 2024-03-04T09:27:06.857 INFO:journalctl@ceph.osd.2.smithi190.stdout:Mar 04 09:27:06 smithi190 podman[73334]: 2024-03-04 09:27:06.60015808 +0000 UTC m=+0.148372622 container create 2bc774eb9f919b51d2ac76d3b0603322fe0c0c06f5d20e5478d5a80357b20057 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-2-deactivate, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-03-04T09:27:07.146 INFO:journalctl@ceph.osd.2.smithi190.stdout:Mar 04 09:27:06 smithi190 podman[73334]: 2024-03-04 09:27:06.861172057 +0000 UTC m=+0.409386619 container init 2bc774eb9f919b51d2ac76d3b0603322fe0c0c06f5d20e5478d5a80357b20057 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-2-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-qdb-1bc250c) 2024-03-04T09:27:07.147 INFO:journalctl@ceph.osd.2.smithi190.stdout:Mar 04 09:27:06 smithi190 podman[73334]: 2024-03-04 09:27:06.864618815 +0000 UTC m=+0.412833364 container start 2bc774eb9f919b51d2ac76d3b0603322fe0c0c06f5d20e5478d5a80357b20057 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-2-deactivate, io.buildah.version=1.33.5, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.build-date=20240222, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-03-04T09:27:07.147 INFO:journalctl@ceph.osd.2.smithi190.stdout:Mar 04 09:27:06 smithi190 podman[73334]: 2024-03-04 09:27:06.952915895 +0000 UTC m=+0.501130446 container attach 2bc774eb9f919b51d2ac76d3b0603322fe0c0c06f5d20e5478d5a80357b20057 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-2-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, ceph=True, RELEASE=wip-lusov-qdb-1bc250c, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-03-04T09:27:07.421 INFO:journalctl@ceph.osd.2.smithi190.stdout:Mar 04 09:27:07 smithi190 podman[73334]: 2024-03-04 09:27:07.150704055 +0000 UTC m=+0.698918607 container died 2bc774eb9f919b51d2ac76d3b0603322fe0c0c06f5d20e5478d5a80357b20057 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-2-deactivate, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=wip-lusov-qdb-1bc250c, CEPH_POINT_RELEASE=, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-03-04T09:27:07.818 DEBUG:teuthology.orchestra.run.smithi190:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@osd.2.service' 2024-03-04T09:27:07.859 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-04T09:27:07.859 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-03-04T09:27:07.859 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-03-04T09:27:07.860 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-2e533fc8-da06-11ee-95c6-87774f69a715@osd.3 2024-03-04T09:27:08.178 INFO:journalctl@ceph.osd.3.smithi082.stdout:Mar 04 09:27:07 smithi082 systemd[1]: Stopping Ceph osd.3 for 2e533fc8-da06-11ee-95c6-87774f69a715... 2024-03-04T09:27:08.434 INFO:journalctl@ceph.osd.3.smithi082.stdout:Mar 04 09:27:08 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-3[54369]: 2024-03-04T09:27:08.181+0000 7f654363a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T09:27:08.435 INFO:journalctl@ceph.osd.3.smithi082.stdout:Mar 04 09:27:08 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-3[54369]: 2024-03-04T09:27:08.181+0000 7f654363a700 -1 osd.3 110 *** Got signal Terminated *** 2024-03-04T09:27:08.435 INFO:journalctl@ceph.osd.3.smithi082.stdout:Mar 04 09:27:08 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-3[54369]: 2024-03-04T09:27:08.181+0000 7f654363a700 -1 osd.3 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-04T09:27:11.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:10 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:10.660+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:46.763438+0000 front 2024-03-04T09:26:46.763484+0000 (oldest deadline 2024-03-04T09:27:10.263514+0000) 2024-03-04T09:27:11.421 INFO:journalctl@ceph.osd.5.smithi190.stdout:Mar 04 09:27:11 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-5[48439]: 2024-03-04T09:27:11.152+0000 7f264840f700 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.582617+0000 front 2024-03-04T09:26:47.582762+0000 (oldest deadline 2024-03-04T09:27:11.082773+0000) 2024-03-04T09:27:11.421 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:10 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:10.926+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:27:11.817 INFO:journalctl@ceph.osd.3.smithi082.stdout:Mar 04 09:27:11 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-3[54369]: 2024-03-04T09:27:11.418+0000 7f653bc26700 -1 osd.3 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:45.681139+0000 front 2024-03-04T09:26:45.681171+0000 (oldest deadline 2024-03-04T09:27:10.981246+0000) 2024-03-04T09:27:11.817 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:11 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:11.650+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:46.763438+0000 front 2024-03-04T09:26:46.763484+0000 (oldest deadline 2024-03-04T09:27:10.263514+0000) 2024-03-04T09:27:12.421 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:11 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:11.970+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:27:12.421 INFO:journalctl@ceph.osd.5.smithi190.stdout:Mar 04 09:27:12 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-5[48439]: 2024-03-04T09:27:12.191+0000 7f264840f700 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.582617+0000 front 2024-03-04T09:26:47.582762+0000 (oldest deadline 2024-03-04T09:27:11.082773+0000) 2024-03-04T09:27:12.817 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:12 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:12.639+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:46.763438+0000 front 2024-03-04T09:26:46.763484+0000 (oldest deadline 2024-03-04T09:27:10.263514+0000) 2024-03-04T09:27:12.817 INFO:journalctl@ceph.osd.3.smithi082.stdout:Mar 04 09:27:12 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-3[54369]: 2024-03-04T09:27:12.412+0000 7f653bc26700 -1 osd.3 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:45.681139+0000 front 2024-03-04T09:26:45.681171+0000 (oldest deadline 2024-03-04T09:27:10.981246+0000) 2024-03-04T09:27:13.421 INFO:journalctl@ceph.osd.5.smithi190.stdout:Mar 04 09:27:13 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-5[48439]: 2024-03-04T09:27:13.217+0000 7f264840f700 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.582617+0000 front 2024-03-04T09:26:47.582762+0000 (oldest deadline 2024-03-04T09:27:11.082773+0000) 2024-03-04T09:27:13.421 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:12 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:12.983+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:27:13.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:13 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:13.289+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:27:13.970 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:13 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:13.650+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:46.763438+0000 front 2024-03-04T09:26:46.763484+0000 (oldest deadline 2024-03-04T09:27:10.263514+0000) 2024-03-04T09:27:13.970 INFO:journalctl@ceph.osd.3.smithi082.stdout:Mar 04 09:27:13 smithi082 podman[93529]: 2024-03-04 09:27:13.678997743 +0000 UTC m=+5.626558881 container died 9d0e973651d6ad0c6203fa545f46d586ea83c0d5cc24b9bc8a1c3d31b34ec179 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-qdb-1bc250c, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8) 2024-03-04T09:27:14.317 INFO:journalctl@ceph.osd.3.smithi082.stdout:Mar 04 09:27:14 smithi082 podman[93529]: 2024-03-04 09:27:14.065051011 +0000 UTC m=+6.012612148 container cleanup 9d0e973651d6ad0c6203fa545f46d586ea83c0d5cc24b9bc8a1c3d31b34ec179 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-3, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-qdb-1bc250c, ceph=True, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-04T09:27:14.317 INFO:journalctl@ceph.osd.3.smithi082.stdout:Mar 04 09:27:14 smithi082 bash[93529]: ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-3 2024-03-04T09:27:14.421 INFO:journalctl@ceph.osd.5.smithi190.stdout:Mar 04 09:27:14 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-5[48439]: 2024-03-04T09:27:14.225+0000 7f264840f700 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.582617+0000 front 2024-03-04T09:26:47.582762+0000 (oldest deadline 2024-03-04T09:27:11.082773+0000) 2024-03-04T09:27:14.421 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:14 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:14.002+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:27:14.659 INFO:journalctl@ceph.osd.3.smithi082.stdout:Mar 04 09:27:14 smithi082 podman[93559]: 2024-03-04 09:27:14.349937359 +0000 UTC m=+0.667069112 container remove 9d0e973651d6ad0c6203fa545f46d586ea83c0d5cc24b9bc8a1c3d31b34ec179 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-3, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.vendor=CentOS, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-03-04T09:27:14.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:14 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:14.273+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:27:14.974 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:14 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:14.663+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:46.763438+0000 front 2024-03-04T09:26:46.763484+0000 (oldest deadline 2024-03-04T09:27:10.263514+0000) 2024-03-04T09:27:14.974 INFO:journalctl@ceph.osd.3.smithi082.stdout:Mar 04 09:27:14 smithi082 podman[93652]: 2024-03-04 09:27:14.582160849 +0000 UTC m=+0.018186512 image pull f88ffb32aa6a7d5dfdc954d9f096f0c9cc47981d05ec8d117ba859a22d8185ba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5 2024-03-04T09:27:14.974 INFO:journalctl@ceph.osd.3.smithi082.stdout:Mar 04 09:27:14 smithi082 podman[93652]: 2024-03-04 09:27:14.709165511 +0000 UTC m=+0.145191215 container create 60f561c11901c0291f57fe18f5102f747b70c1f30a52c27d13f5680c0c11695e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-3-deactivate, ceph=True, org.label-schema.build-date=20240222, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-qdb-1bc250c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-03-04T09:27:14.974 INFO:journalctl@ceph.osd.3.smithi082.stdout:Mar 04 09:27:14 smithi082 podman[93652]: 2024-03-04 09:27:14.978345002 +0000 UTC m=+0.414370665 container init 60f561c11901c0291f57fe18f5102f747b70c1f30a52c27d13f5680c0c11695e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-3-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.build-date=20240222) 2024-03-04T09:27:15.268 INFO:journalctl@ceph.osd.3.smithi082.stdout:Mar 04 09:27:14 smithi082 podman[93652]: 2024-03-04 09:27:14.981904805 +0000 UTC m=+0.417930472 container start 60f561c11901c0291f57fe18f5102f747b70c1f30a52c27d13f5680c0c11695e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-3-deactivate, org.label-schema.build-date=20240222, GIT_CLEAN=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-03-04T09:27:15.268 INFO:journalctl@ceph.osd.3.smithi082.stdout:Mar 04 09:27:15 smithi082 podman[93652]: 2024-03-04 09:27:15.078291828 +0000 UTC m=+0.514317503 container attach 60f561c11901c0291f57fe18f5102f747b70c1f30a52c27d13f5680c0c11695e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-3-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-qdb-1bc250c, maintainer=Guillaume Abrioux , GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True) 2024-03-04T09:27:15.421 INFO:journalctl@ceph.osd.5.smithi190.stdout:Mar 04 09:27:15 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-5[48439]: 2024-03-04T09:27:15.219+0000 7f264840f700 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.582617+0000 front 2024-03-04T09:26:47.582762+0000 (oldest deadline 2024-03-04T09:27:11.082773+0000) 2024-03-04T09:27:15.421 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:15 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:15.035+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:27:15.567 INFO:journalctl@ceph.osd.3.smithi082.stdout:Mar 04 09:27:15 smithi082 podman[93652]: 2024-03-04 09:27:15.271857399 +0000 UTC m=+0.707883064 container died 60f561c11901c0291f57fe18f5102f747b70c1f30a52c27d13f5680c0c11695e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-3-deactivate, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-03-04T09:27:15.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:15 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:15.319+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:27:15.909 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:15 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:15.615+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:46.763438+0000 front 2024-03-04T09:26:46.763484+0000 (oldest deadline 2024-03-04T09:27:10.263514+0000) 2024-03-04T09:27:15.935 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@osd.3.service' 2024-03-04T09:27:15.977 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-04T09:27:15.977 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-03-04T09:27:15.977 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-03-04T09:27:15.978 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-2e533fc8-da06-11ee-95c6-87774f69a715@osd.4 2024-03-04T09:27:16.288 INFO:journalctl@ceph.osd.4.smithi102.stdout:Mar 04 09:27:16 smithi102 systemd[1]: Stopping Ceph osd.4 for 2e533fc8-da06-11ee-95c6-87774f69a715... 2024-03-04T09:27:16.421 INFO:journalctl@ceph.osd.5.smithi190.stdout:Mar 04 09:27:16 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-5[48439]: 2024-03-04T09:27:16.184+0000 7f264840f700 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.582617+0000 front 2024-03-04T09:26:47.582762+0000 (oldest deadline 2024-03-04T09:27:11.082773+0000) 2024-03-04T09:27:16.421 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:16 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:16.070+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:27:16.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:16 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:16.305+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:27:16.680 INFO:journalctl@ceph.osd.4.smithi102.stdout:Mar 04 09:27:16 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-4[47584]: 2024-03-04T09:27:16.291+0000 7f61cf3bf700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T09:27:16.680 INFO:journalctl@ceph.osd.4.smithi102.stdout:Mar 04 09:27:16 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-4[47584]: 2024-03-04T09:27:16.291+0000 7f61cf3bf700 -1 osd.4 110 *** Got signal Terminated *** 2024-03-04T09:27:16.680 INFO:journalctl@ceph.osd.4.smithi102.stdout:Mar 04 09:27:16 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-4[47584]: 2024-03-04T09:27:16.291+0000 7f61cf3bf700 -1 osd.4 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-04T09:27:17.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:16 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:16.573+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:46.763438+0000 front 2024-03-04T09:26:46.763484+0000 (oldest deadline 2024-03-04T09:27:10.263514+0000) 2024-03-04T09:27:17.421 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:17 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:17.062+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:27:17.421 INFO:journalctl@ceph.osd.5.smithi190.stdout:Mar 04 09:27:17 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-5[48439]: 2024-03-04T09:27:17.155+0000 7f264840f700 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.582617+0000 front 2024-03-04T09:26:47.582762+0000 (oldest deadline 2024-03-04T09:27:11.082773+0000) 2024-03-04T09:27:17.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:17 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:17.348+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:27:17.817 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:17 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:17.535+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:46.763438+0000 front 2024-03-04T09:26:46.763484+0000 (oldest deadline 2024-03-04T09:27:10.263514+0000) 2024-03-04T09:27:18.421 INFO:journalctl@ceph.osd.5.smithi190.stdout:Mar 04 09:27:18 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-5[48439]: 2024-03-04T09:27:18.148+0000 7f264840f700 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.582617+0000 front 2024-03-04T09:26:47.582762+0000 (oldest deadline 2024-03-04T09:27:11.082773+0000) 2024-03-04T09:27:18.421 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:18 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:18.051+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:27:18.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:18 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:18.334+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:27:18.817 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:18 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:18.521+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:46.763438+0000 front 2024-03-04T09:26:46.763484+0000 (oldest deadline 2024-03-04T09:27:10.263514+0000) 2024-03-04T09:27:18.817 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:18 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:18.521+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.065154+0000 front 2024-03-04T09:26:56.065278+0000 (oldest deadline 2024-03-04T09:27:17.765282+0000) 2024-03-04T09:27:19.421 INFO:journalctl@ceph.osd.5.smithi190.stdout:Mar 04 09:27:19 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-5[48439]: 2024-03-04T09:27:19.114+0000 7f264840f700 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.582617+0000 front 2024-03-04T09:26:47.582762+0000 (oldest deadline 2024-03-04T09:27:11.082773+0000) 2024-03-04T09:27:19.422 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:18 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:18.966+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.432694+0000 front 2024-03-04T09:26:56.432842+0000 (oldest deadline 2024-03-04T09:27:18.732822+0000) 2024-03-04T09:27:19.422 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:19 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:19.094+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:27:19.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:19 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:19.359+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:27:19.680 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:19 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:19.359+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.858704+0000 front 2024-03-04T09:26:56.858604+0000 (oldest deadline 2024-03-04T09:27:18.459284+0000) 2024-03-04T09:27:19.817 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:19 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:19.473+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:46.763438+0000 front 2024-03-04T09:26:46.763484+0000 (oldest deadline 2024-03-04T09:27:10.263514+0000) 2024-03-04T09:27:19.817 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:19 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:19.473+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.065154+0000 front 2024-03-04T09:26:56.065278+0000 (oldest deadline 2024-03-04T09:27:17.765282+0000) 2024-03-04T09:27:20.421 INFO:journalctl@ceph.osd.5.smithi190.stdout:Mar 04 09:27:20 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-5[48439]: 2024-03-04T09:27:20.157+0000 7f264840f700 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.582617+0000 front 2024-03-04T09:26:47.582762+0000 (oldest deadline 2024-03-04T09:27:11.082773+0000) 2024-03-04T09:27:20.421 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:19 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:19.982+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.432694+0000 front 2024-03-04T09:26:56.432842+0000 (oldest deadline 2024-03-04T09:27:18.732822+0000) 2024-03-04T09:27:20.422 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:20 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:20.103+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:27:20.665 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:20 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:20.347+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:27:20.665 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:20 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:20.347+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.858704+0000 front 2024-03-04T09:26:56.858604+0000 (oldest deadline 2024-03-04T09:27:18.459284+0000) 2024-03-04T09:27:20.817 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:20 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:20.449+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:46.763438+0000 front 2024-03-04T09:26:46.763484+0000 (oldest deadline 2024-03-04T09:27:10.263514+0000) 2024-03-04T09:27:20.817 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:20 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:20.449+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.065154+0000 front 2024-03-04T09:26:56.065278+0000 (oldest deadline 2024-03-04T09:27:17.765282+0000) 2024-03-04T09:27:20.929 INFO:journalctl@ceph.osd.4.smithi102.stdout:Mar 04 09:27:20 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-4[47584]: 2024-03-04T09:27:20.668+0000 7f61cb9b3700 -1 osd.4 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:53.841458+0000 front 2024-03-04T09:26:53.841489+0000 (oldest deadline 2024-03-04T09:27:19.741704+0000) 2024-03-04T09:27:20.929 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:20 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:20.876+0000 7f8d11047700 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:54.939746+0000 front 2024-03-04T09:26:54.939716+0000 (oldest deadline 2024-03-04T09:27:20.839902+0000) 2024-03-04T09:27:21.421 INFO:journalctl@ceph.osd.5.smithi190.stdout:Mar 04 09:27:21 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-5[48439]: 2024-03-04T09:27:21.163+0000 7f264840f700 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.582617+0000 front 2024-03-04T09:26:47.582762+0000 (oldest deadline 2024-03-04T09:27:11.082773+0000) 2024-03-04T09:27:21.421 INFO:journalctl@ceph.osd.5.smithi190.stdout:Mar 04 09:27:21 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-5[48439]: 2024-03-04T09:27:21.163+0000 7f264840f700 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:54.584154+0000 front 2024-03-04T09:26:54.583875+0000 (oldest deadline 2024-03-04T09:27:20.984531+0000) 2024-03-04T09:27:21.422 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:20 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:20.954+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.432694+0000 front 2024-03-04T09:26:56.432842+0000 (oldest deadline 2024-03-04T09:27:18.732822+0000) 2024-03-04T09:27:21.422 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:21 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:21.111+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:27:21.619 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:21 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:21.345+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:27:21.619 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:21 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:21.345+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.858704+0000 front 2024-03-04T09:26:56.858604+0000 (oldest deadline 2024-03-04T09:27:18.459284+0000) 2024-03-04T09:27:21.817 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:21 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:21.476+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:46.763438+0000 front 2024-03-04T09:26:46.763484+0000 (oldest deadline 2024-03-04T09:27:10.263514+0000) 2024-03-04T09:27:21.817 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:21 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:21.476+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.065154+0000 front 2024-03-04T09:26:56.065278+0000 (oldest deadline 2024-03-04T09:27:17.765282+0000) 2024-03-04T09:27:21.914 INFO:journalctl@ceph.osd.4.smithi102.stdout:Mar 04 09:27:21 smithi102 podman[71970]: 2024-03-04 09:27:21.623496685 +0000 UTC m=+5.451763483 container died f8a02f7d0d9ddb764c7be6bb759407e5a2b88ab5995ee8e4c66954e1aac624ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-4, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-lusov-qdb-1bc250c, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-04T09:27:22.155 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:21 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:21.905+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.432694+0000 front 2024-03-04T09:26:56.432842+0000 (oldest deadline 2024-03-04T09:27:18.732822+0000) 2024-03-04T09:27:22.156 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:22 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:22.120+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:27:22.156 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:22 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:22.120+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:57.035521+0000 front 2024-03-04T09:26:57.035337+0000 (oldest deadline 2024-03-04T09:27:21.735439+0000) 2024-03-04T09:27:22.179 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:21 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:21.917+0000 7f8d11047700 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:54.939746+0000 front 2024-03-04T09:26:54.939716+0000 (oldest deadline 2024-03-04T09:27:20.839902+0000) 2024-03-04T09:27:22.179 INFO:journalctl@ceph.osd.4.smithi102.stdout:Mar 04 09:27:22 smithi102 podman[71970]: 2024-03-04 09:27:22.017460166 +0000 UTC m=+5.845726973 container cleanup f8a02f7d0d9ddb764c7be6bb759407e5a2b88ab5995ee8e4c66954e1aac624ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, RELEASE=wip-lusov-qdb-1bc250c, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-03-04T09:27:22.179 INFO:journalctl@ceph.osd.4.smithi102.stdout:Mar 04 09:27:22 smithi102 bash[71970]: ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-4 2024-03-04T09:27:22.421 INFO:journalctl@ceph.osd.5.smithi190.stdout:Mar 04 09:27:22 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-5[48439]: 2024-03-04T09:27:22.158+0000 7f264840f700 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.582617+0000 front 2024-03-04T09:26:47.582762+0000 (oldest deadline 2024-03-04T09:27:11.082773+0000) 2024-03-04T09:27:22.421 INFO:journalctl@ceph.osd.5.smithi190.stdout:Mar 04 09:27:22 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-5[48439]: 2024-03-04T09:27:22.158+0000 7f264840f700 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:54.584154+0000 front 2024-03-04T09:26:54.583875+0000 (oldest deadline 2024-03-04T09:27:20.984531+0000) 2024-03-04T09:27:22.634 INFO:journalctl@ceph.osd.4.smithi102.stdout:Mar 04 09:27:22 smithi102 podman[71987]: 2024-03-04 09:27:22.285431461 +0000 UTC m=+0.651744445 container remove f8a02f7d0d9ddb764c7be6bb759407e5a2b88ab5995ee8e4c66954e1aac624ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-04T09:27:22.634 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:22 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:22.316+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:27:22.635 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:22 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:22.316+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.858704+0000 front 2024-03-04T09:26:56.858604+0000 (oldest deadline 2024-03-04T09:27:18.459284+0000) 2024-03-04T09:27:22.817 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:22 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:22.445+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:46.763438+0000 front 2024-03-04T09:26:46.763484+0000 (oldest deadline 2024-03-04T09:27:10.263514+0000) 2024-03-04T09:27:22.817 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:22 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:22.445+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.065154+0000 front 2024-03-04T09:26:56.065278+0000 (oldest deadline 2024-03-04T09:27:17.765282+0000) 2024-03-04T09:27:22.901 INFO:journalctl@ceph.osd.4.smithi102.stdout:Mar 04 09:27:22 smithi102 podman[72079]: 2024-03-04 09:27:22.541536371 +0000 UTC m=+0.018192344 image pull f88ffb32aa6a7d5dfdc954d9f096f0c9cc47981d05ec8d117ba859a22d8185ba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5 2024-03-04T09:27:22.902 INFO:journalctl@ceph.osd.4.smithi102.stdout:Mar 04 09:27:22 smithi102 podman[72079]: 2024-03-04 09:27:22.664954738 +0000 UTC m=+0.141610696 container create 229893a433497a514c998b27a19e93aca766ad9210f89db080a20c1d3021868e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-4-deactivate, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-03-04T09:27:22.902 INFO:journalctl@ceph.osd.4.smithi102.stdout:Mar 04 09:27:22 smithi102 podman[72079]: 2024-03-04 09:27:22.905592623 +0000 UTC m=+0.382248580 container init 229893a433497a514c998b27a19e93aca766ad9210f89db080a20c1d3021868e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-4-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-qdb-1bc250c, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-03-04T09:27:23.157 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:22 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:22.857+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.432694+0000 front 2024-03-04T09:26:56.432842+0000 (oldest deadline 2024-03-04T09:27:18.732822+0000) 2024-03-04T09:27:23.179 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:22 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:22.963+0000 7f8d11047700 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:54.939746+0000 front 2024-03-04T09:26:54.939716+0000 (oldest deadline 2024-03-04T09:27:20.839902+0000) 2024-03-04T09:27:23.179 INFO:journalctl@ceph.osd.4.smithi102.stdout:Mar 04 09:27:22 smithi102 podman[72079]: 2024-03-04 09:27:22.908720476 +0000 UTC m=+0.385376437 container start 229893a433497a514c998b27a19e93aca766ad9210f89db080a20c1d3021868e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-4-deactivate, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8) 2024-03-04T09:27:23.180 INFO:journalctl@ceph.osd.4.smithi102.stdout:Mar 04 09:27:22 smithi102 podman[72079]: 2024-03-04 09:27:22.98060915 +0000 UTC m=+0.457265114 container attach 229893a433497a514c998b27a19e93aca766ad9210f89db080a20c1d3021868e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-4-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, RELEASE=wip-lusov-qdb-1bc250c, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-04T09:27:23.421 INFO:journalctl@ceph.osd.5.smithi190.stdout:Mar 04 09:27:23 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-5[48439]: 2024-03-04T09:27:23.184+0000 7f264840f700 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.582617+0000 front 2024-03-04T09:26:47.582762+0000 (oldest deadline 2024-03-04T09:27:11.082773+0000) 2024-03-04T09:27:23.421 INFO:journalctl@ceph.osd.5.smithi190.stdout:Mar 04 09:27:23 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-5[48439]: 2024-03-04T09:27:23.184+0000 7f264840f700 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:54.584154+0000 front 2024-03-04T09:26:54.583875+0000 (oldest deadline 2024-03-04T09:27:20.984531+0000) 2024-03-04T09:27:23.421 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:23 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:23.160+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:27:23.421 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:23 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:23.160+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:57.035521+0000 front 2024-03-04T09:26:57.035337+0000 (oldest deadline 2024-03-04T09:27:21.735439+0000) 2024-03-04T09:27:23.506 INFO:journalctl@ceph.osd.4.smithi102.stdout:Mar 04 09:27:23 smithi102 podman[72079]: 2024-03-04 09:27:23.199981628 +0000 UTC m=+0.676637577 container died 229893a433497a514c998b27a19e93aca766ad9210f89db080a20c1d3021868e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-4-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, io.buildah.version=1.33.5, RELEASE=wip-lusov-qdb-1bc250c, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-03-04T09:27:23.506 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:23 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:23.309+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:27:23.506 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:23 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:23.309+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.858704+0000 front 2024-03-04T09:26:56.858604+0000 (oldest deadline 2024-03-04T09:27:18.459284+0000) 2024-03-04T09:27:23.817 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:23 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:23.452+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:46.763438+0000 front 2024-03-04T09:26:46.763484+0000 (oldest deadline 2024-03-04T09:27:10.263514+0000) 2024-03-04T09:27:23.817 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:23 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:23.452+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.065154+0000 front 2024-03-04T09:26:56.065278+0000 (oldest deadline 2024-03-04T09:27:17.765282+0000) 2024-03-04T09:27:23.817 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 04 09:27:23 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-6[61078]: 2024-03-04T09:27:23.572+0000 7f3b082b5700 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.688639+0000 front 2024-03-04T09:26:56.688845+0000 (oldest deadline 2024-03-04T09:27:22.588795+0000) 2024-03-04T09:27:23.819 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@osd.4.service' 2024-03-04T09:27:23.860 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-04T09:27:23.861 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-03-04T09:27:23.861 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-03-04T09:27:23.861 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ceph-2e533fc8-da06-11ee-95c6-87774f69a715@osd.5 2024-03-04T09:27:24.146 INFO:journalctl@ceph.osd.5.smithi190.stdout:Mar 04 09:27:23 smithi190 systemd[1]: Stopping Ceph osd.5 for 2e533fc8-da06-11ee-95c6-87774f69a715... 2024-03-04T09:27:24.147 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:23 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:23.847+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.432694+0000 front 2024-03-04T09:26:56.432842+0000 (oldest deadline 2024-03-04T09:27:18.732822+0000) 2024-03-04T09:27:24.179 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:23 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:23.918+0000 7f8d11047700 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:54.939746+0000 front 2024-03-04T09:26:54.939716+0000 (oldest deadline 2024-03-04T09:27:20.839902+0000) 2024-03-04T09:27:24.421 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:24 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:24.149+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:27:24.421 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:24 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:24.149+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:57.035521+0000 front 2024-03-04T09:26:57.035337+0000 (oldest deadline 2024-03-04T09:27:21.735439+0000) 2024-03-04T09:27:24.421 INFO:journalctl@ceph.osd.5.smithi190.stdout:Mar 04 09:27:24 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-5[48439]: 2024-03-04T09:27:24.174+0000 7f264840f700 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.582617+0000 front 2024-03-04T09:26:47.582762+0000 (oldest deadline 2024-03-04T09:27:11.082773+0000) 2024-03-04T09:27:24.421 INFO:journalctl@ceph.osd.5.smithi190.stdout:Mar 04 09:27:24 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-5[48439]: 2024-03-04T09:27:24.174+0000 7f264840f700 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:54.584154+0000 front 2024-03-04T09:26:54.583875+0000 (oldest deadline 2024-03-04T09:27:20.984531+0000) 2024-03-04T09:27:24.421 INFO:journalctl@ceph.osd.5.smithi190.stdout:Mar 04 09:27:24 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-5[48439]: 2024-03-04T09:27:24.186+0000 7f264be1b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T09:27:24.422 INFO:journalctl@ceph.osd.5.smithi190.stdout:Mar 04 09:27:24 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-5[48439]: 2024-03-04T09:27:24.186+0000 7f264be1b700 -1 osd.5 110 *** Got signal Terminated *** 2024-03-04T09:27:24.422 INFO:journalctl@ceph.osd.5.smithi190.stdout:Mar 04 09:27:24 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-5[48439]: 2024-03-04T09:27:24.186+0000 7f264be1b700 -1 osd.5 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-04T09:27:24.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:24 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:24.289+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:27:24.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:24 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:24.289+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.858704+0000 front 2024-03-04T09:26:56.858604+0000 (oldest deadline 2024-03-04T09:27:18.459284+0000) 2024-03-04T09:27:24.817 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 04 09:27:24 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-6[61078]: 2024-03-04T09:27:24.523+0000 7f3b082b5700 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.688639+0000 front 2024-03-04T09:26:56.688845+0000 (oldest deadline 2024-03-04T09:27:22.588795+0000) 2024-03-04T09:27:24.817 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:24 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:24.502+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:46.763438+0000 front 2024-03-04T09:26:46.763484+0000 (oldest deadline 2024-03-04T09:27:10.263514+0000) 2024-03-04T09:27:24.817 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:24 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:24.502+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.065154+0000 front 2024-03-04T09:26:56.065278+0000 (oldest deadline 2024-03-04T09:27:17.765282+0000) 2024-03-04T09:27:25.099 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:24 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:24.828+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.432694+0000 front 2024-03-04T09:26:56.432842+0000 (oldest deadline 2024-03-04T09:27:18.732822+0000) 2024-03-04T09:27:25.179 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:24 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:24.909+0000 7f8d11047700 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:54.939746+0000 front 2024-03-04T09:26:54.939716+0000 (oldest deadline 2024-03-04T09:27:20.839902+0000) 2024-03-04T09:27:25.421 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:25 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:25.102+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:27:25.421 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:25 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:25.102+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:57.035521+0000 front 2024-03-04T09:26:57.035337+0000 (oldest deadline 2024-03-04T09:27:21.735439+0000) 2024-03-04T09:27:25.421 INFO:journalctl@ceph.osd.5.smithi190.stdout:Mar 04 09:27:25 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-5[48439]: 2024-03-04T09:27:25.224+0000 7f264840f700 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.582617+0000 front 2024-03-04T09:26:47.582762+0000 (oldest deadline 2024-03-04T09:27:11.082773+0000) 2024-03-04T09:27:25.421 INFO:journalctl@ceph.osd.5.smithi190.stdout:Mar 04 09:27:25 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-5[48439]: 2024-03-04T09:27:25.224+0000 7f264840f700 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:54.584154+0000 front 2024-03-04T09:26:54.583875+0000 (oldest deadline 2024-03-04T09:27:20.984531+0000) 2024-03-04T09:27:25.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:25 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:25.291+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:27:25.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:25 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:25.291+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.858704+0000 front 2024-03-04T09:26:56.858604+0000 (oldest deadline 2024-03-04T09:27:18.459284+0000) 2024-03-04T09:27:25.817 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 04 09:27:25 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-6[61078]: 2024-03-04T09:27:25.519+0000 7f3b082b5700 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.688639+0000 front 2024-03-04T09:26:56.688845+0000 (oldest deadline 2024-03-04T09:27:22.588795+0000) 2024-03-04T09:27:25.817 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:25 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:25.506+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:46.763438+0000 front 2024-03-04T09:26:46.763484+0000 (oldest deadline 2024-03-04T09:27:10.263514+0000) 2024-03-04T09:27:25.817 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:25 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:25.506+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.065154+0000 front 2024-03-04T09:26:56.065278+0000 (oldest deadline 2024-03-04T09:27:17.765282+0000) 2024-03-04T09:27:26.130 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:25 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:25.802+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.432694+0000 front 2024-03-04T09:26:56.432842+0000 (oldest deadline 2024-03-04T09:27:18.732822+0000) 2024-03-04T09:27:26.179 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:25 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:25.885+0000 7f8d11047700 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:54.939746+0000 front 2024-03-04T09:26:54.939716+0000 (oldest deadline 2024-03-04T09:27:20.839902+0000) 2024-03-04T09:27:26.421 INFO:journalctl@ceph.osd.5.smithi190.stdout:Mar 04 09:27:26 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-5[48439]: 2024-03-04T09:27:26.268+0000 7f264840f700 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.582617+0000 front 2024-03-04T09:26:47.582762+0000 (oldest deadline 2024-03-04T09:27:11.082773+0000) 2024-03-04T09:27:26.421 INFO:journalctl@ceph.osd.5.smithi190.stdout:Mar 04 09:27:26 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-5[48439]: 2024-03-04T09:27:26.268+0000 7f264840f700 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:54.584154+0000 front 2024-03-04T09:26:54.583875+0000 (oldest deadline 2024-03-04T09:27:20.984531+0000) 2024-03-04T09:27:26.421 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:26 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:26.133+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:27:26.421 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:26 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:26.133+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:57.035521+0000 front 2024-03-04T09:26:57.035337+0000 (oldest deadline 2024-03-04T09:27:21.735439+0000) 2024-03-04T09:27:26.421 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:26 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:26.133+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:04.036279+0000 front 2024-03-04T09:27:04.036372+0000 (oldest deadline 2024-03-04T09:27:25.736393+0000) 2024-03-04T09:27:26.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:26 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:26.260+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:27:26.680 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:26 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:26.260+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.858704+0000 front 2024-03-04T09:26:56.858604+0000 (oldest deadline 2024-03-04T09:27:18.459284+0000) 2024-03-04T09:27:26.817 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 04 09:27:26 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-6[61078]: 2024-03-04T09:27:26.486+0000 7f3b082b5700 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.688639+0000 front 2024-03-04T09:26:56.688845+0000 (oldest deadline 2024-03-04T09:27:22.588795+0000) 2024-03-04T09:27:26.817 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:26 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:26.528+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:46.763438+0000 front 2024-03-04T09:26:46.763484+0000 (oldest deadline 2024-03-04T09:27:10.263514+0000) 2024-03-04T09:27:26.817 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:26 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:26.528+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.065154+0000 front 2024-03-04T09:26:56.065278+0000 (oldest deadline 2024-03-04T09:27:17.765282+0000) 2024-03-04T09:27:27.155 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:26 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:26.837+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.432694+0000 front 2024-03-04T09:26:56.432842+0000 (oldest deadline 2024-03-04T09:27:18.732822+0000) 2024-03-04T09:27:27.155 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:26 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:26.837+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:03.135303+0000 front 2024-03-04T09:27:03.135534+0000 (oldest deadline 2024-03-04T09:27:26.635408+0000) 2024-03-04T09:27:27.179 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:26 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:26.916+0000 7f8d11047700 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:54.939746+0000 front 2024-03-04T09:26:54.939716+0000 (oldest deadline 2024-03-04T09:27:20.839902+0000) 2024-03-04T09:27:27.421 INFO:journalctl@ceph.osd.5.smithi190.stdout:Mar 04 09:27:27 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-5[48439]: 2024-03-04T09:27:27.246+0000 7f264840f700 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.582617+0000 front 2024-03-04T09:26:47.582762+0000 (oldest deadline 2024-03-04T09:27:11.082773+0000) 2024-03-04T09:27:27.421 INFO:journalctl@ceph.osd.5.smithi190.stdout:Mar 04 09:27:27 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-5[48439]: 2024-03-04T09:27:27.246+0000 7f264840f700 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:54.584154+0000 front 2024-03-04T09:26:54.583875+0000 (oldest deadline 2024-03-04T09:27:20.984531+0000) 2024-03-04T09:27:27.421 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:27 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:27.158+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:27:27.422 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:27 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:27.158+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:57.035521+0000 front 2024-03-04T09:26:57.035337+0000 (oldest deadline 2024-03-04T09:27:21.735439+0000) 2024-03-04T09:27:27.422 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:27 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:27.158+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:04.036279+0000 front 2024-03-04T09:27:04.036372+0000 (oldest deadline 2024-03-04T09:27:25.736393+0000) 2024-03-04T09:27:27.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:27 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:27.229+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:27:27.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:27 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:27.229+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.858704+0000 front 2024-03-04T09:26:56.858604+0000 (oldest deadline 2024-03-04T09:27:18.459284+0000) 2024-03-04T09:27:27.817 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 04 09:27:27 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-6[61078]: 2024-03-04T09:27:27.476+0000 7f3b082b5700 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.688639+0000 front 2024-03-04T09:26:56.688845+0000 (oldest deadline 2024-03-04T09:27:22.588795+0000) 2024-03-04T09:27:27.817 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 04 09:27:27 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-6[61078]: 2024-03-04T09:27:27.476+0000 7f3b082b5700 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:02.589481+0000 front 2024-03-04T09:27:02.589470+0000 (oldest deadline 2024-03-04T09:27:27.289348+0000) 2024-03-04T09:27:27.817 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:27 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:27.551+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:46.763438+0000 front 2024-03-04T09:26:46.763484+0000 (oldest deadline 2024-03-04T09:27:10.263514+0000) 2024-03-04T09:27:27.818 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:27 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:27.551+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.065154+0000 front 2024-03-04T09:26:56.065278+0000 (oldest deadline 2024-03-04T09:27:17.765282+0000) 2024-03-04T09:27:28.129 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:27 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:27.874+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.432694+0000 front 2024-03-04T09:26:56.432842+0000 (oldest deadline 2024-03-04T09:27:18.732822+0000) 2024-03-04T09:27:28.129 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:27 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:27.874+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:03.135303+0000 front 2024-03-04T09:27:03.135534+0000 (oldest deadline 2024-03-04T09:27:26.635408+0000) 2024-03-04T09:27:28.202 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:27 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:27.933+0000 7f8d11047700 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:54.939746+0000 front 2024-03-04T09:26:54.939716+0000 (oldest deadline 2024-03-04T09:27:20.839902+0000) 2024-03-04T09:27:28.421 INFO:journalctl@ceph.osd.5.smithi190.stdout:Mar 04 09:27:28 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-5[48439]: 2024-03-04T09:27:28.240+0000 7f264840f700 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.582617+0000 front 2024-03-04T09:26:47.582762+0000 (oldest deadline 2024-03-04T09:27:11.082773+0000) 2024-03-04T09:27:28.421 INFO:journalctl@ceph.osd.5.smithi190.stdout:Mar 04 09:27:28 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-5[48439]: 2024-03-04T09:27:28.240+0000 7f264840f700 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:54.584154+0000 front 2024-03-04T09:26:54.583875+0000 (oldest deadline 2024-03-04T09:27:20.984531+0000) 2024-03-04T09:27:28.421 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:28 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:28.132+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:27:28.422 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:28 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:28.132+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:57.035521+0000 front 2024-03-04T09:26:57.035337+0000 (oldest deadline 2024-03-04T09:27:21.735439+0000) 2024-03-04T09:27:28.422 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:28 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:28.132+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:04.036279+0000 front 2024-03-04T09:27:04.036372+0000 (oldest deadline 2024-03-04T09:27:25.736393+0000) 2024-03-04T09:27:28.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:28 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:28.206+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:27:28.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:28 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:28.206+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.858704+0000 front 2024-03-04T09:26:56.858604+0000 (oldest deadline 2024-03-04T09:27:18.459284+0000) 2024-03-04T09:27:28.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:28 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:28.206+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:01.960225+0000 front 2024-03-04T09:27:01.960271+0000 (oldest deadline 2024-03-04T09:27:27.260135+0000) 2024-03-04T09:27:28.817 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 04 09:27:28 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-6[61078]: 2024-03-04T09:27:28.510+0000 7f3b082b5700 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.688639+0000 front 2024-03-04T09:26:56.688845+0000 (oldest deadline 2024-03-04T09:27:22.588795+0000) 2024-03-04T09:27:28.817 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 04 09:27:28 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-6[61078]: 2024-03-04T09:27:28.510+0000 7f3b082b5700 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:02.589481+0000 front 2024-03-04T09:27:02.589470+0000 (oldest deadline 2024-03-04T09:27:27.289348+0000) 2024-03-04T09:27:28.817 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:28 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:28.580+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:46.763438+0000 front 2024-03-04T09:26:46.763484+0000 (oldest deadline 2024-03-04T09:27:10.263514+0000) 2024-03-04T09:27:28.817 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:28 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:28.580+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.065154+0000 front 2024-03-04T09:26:56.065278+0000 (oldest deadline 2024-03-04T09:27:17.765282+0000) 2024-03-04T09:27:28.818 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:28 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:28.580+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:02.466239+0000 front 2024-03-04T09:27:02.466314+0000 (oldest deadline 2024-03-04T09:27:27.766338+0000) 2024-03-04T09:27:29.171 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:28 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:28.921+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.432694+0000 front 2024-03-04T09:26:56.432842+0000 (oldest deadline 2024-03-04T09:27:18.732822+0000) 2024-03-04T09:27:29.171 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:28 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:28.921+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:03.135303+0000 front 2024-03-04T09:27:03.135534+0000 (oldest deadline 2024-03-04T09:27:26.635408+0000) 2024-03-04T09:27:29.179 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:28 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:28.931+0000 7f8d11047700 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:54.939746+0000 front 2024-03-04T09:26:54.939716+0000 (oldest deadline 2024-03-04T09:27:20.839902+0000) 2024-03-04T09:27:29.179 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:28 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:28.931+0000 7f8d11047700 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:00.840348+0000 front 2024-03-04T09:27:00.840309+0000 (oldest deadline 2024-03-04T09:27:28.440998+0000) 2024-03-04T09:27:29.179 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:29 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:29.175+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:27:29.180 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:29 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:29.175+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.858704+0000 front 2024-03-04T09:26:56.858604+0000 (oldest deadline 2024-03-04T09:27:18.459284+0000) 2024-03-04T09:27:29.180 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:29 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:29.175+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:01.960225+0000 front 2024-03-04T09:27:01.960271+0000 (oldest deadline 2024-03-04T09:27:27.260135+0000) 2024-03-04T09:27:29.615 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:29 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:29.181+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:27:29.615 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:29 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:29.181+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:57.035521+0000 front 2024-03-04T09:26:57.035337+0000 (oldest deadline 2024-03-04T09:27:21.735439+0000) 2024-03-04T09:27:29.615 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:29 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:29.181+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:04.036279+0000 front 2024-03-04T09:27:04.036372+0000 (oldest deadline 2024-03-04T09:27:25.736393+0000) 2024-03-04T09:27:29.817 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 04 09:27:29 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-6[61078]: 2024-03-04T09:27:29.491+0000 7f3b082b5700 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.688639+0000 front 2024-03-04T09:26:56.688845+0000 (oldest deadline 2024-03-04T09:27:22.588795+0000) 2024-03-04T09:27:29.817 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 04 09:27:29 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-6[61078]: 2024-03-04T09:27:29.491+0000 7f3b082b5700 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:02.589481+0000 front 2024-03-04T09:27:02.589470+0000 (oldest deadline 2024-03-04T09:27:27.289348+0000) 2024-03-04T09:27:29.818 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:29 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:29.627+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:46.763438+0000 front 2024-03-04T09:26:46.763484+0000 (oldest deadline 2024-03-04T09:27:10.263514+0000) 2024-03-04T09:27:29.818 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:29 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:29.627+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.065154+0000 front 2024-03-04T09:26:56.065278+0000 (oldest deadline 2024-03-04T09:27:17.765282+0000) 2024-03-04T09:27:29.818 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:29 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:29.627+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:02.466239+0000 front 2024-03-04T09:27:02.466314+0000 (oldest deadline 2024-03-04T09:27:27.766338+0000) 2024-03-04T09:27:29.901 INFO:journalctl@ceph.osd.5.smithi190.stdout:Mar 04 09:27:29 smithi190 podman[73440]: 2024-03-04 09:27:29.618762017 +0000 UTC m=+5.555609730 container died 7abe748fbf23827f9e6ba7bdd10853464778359b239fbed8aceb093bc0b22398 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-5, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, RELEASE=wip-lusov-qdb-1bc250c, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-03-04T09:27:30.171 INFO:journalctl@ceph.osd.5.smithi190.stdout:Mar 04 09:27:29 smithi190 podman[73440]: 2024-03-04 09:27:29.995517613 +0000 UTC m=+5.932365320 container cleanup 7abe748fbf23827f9e6ba7bdd10853464778359b239fbed8aceb093bc0b22398 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-qdb-1bc250c, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_CLEAN=True, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-03-04T09:27:30.171 INFO:journalctl@ceph.osd.5.smithi190.stdout:Mar 04 09:27:29 smithi190 bash[73440]: ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-5 2024-03-04T09:27:30.171 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:29 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:29.910+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.432694+0000 front 2024-03-04T09:26:56.432842+0000 (oldest deadline 2024-03-04T09:27:18.732822+0000) 2024-03-04T09:27:30.171 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:29 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:29.910+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:03.135303+0000 front 2024-03-04T09:27:03.135534+0000 (oldest deadline 2024-03-04T09:27:26.635408+0000) 2024-03-04T09:27:30.179 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:29 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:29.906+0000 7f8d11047700 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:54.939746+0000 front 2024-03-04T09:26:54.939716+0000 (oldest deadline 2024-03-04T09:27:20.839902+0000) 2024-03-04T09:27:30.179 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:29 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:29.906+0000 7f8d11047700 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:00.840348+0000 front 2024-03-04T09:27:00.840309+0000 (oldest deadline 2024-03-04T09:27:28.440998+0000) 2024-03-04T09:27:30.179 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:30 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:30.151+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:27:30.180 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:30 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:30.151+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.858704+0000 front 2024-03-04T09:26:56.858604+0000 (oldest deadline 2024-03-04T09:27:18.459284+0000) 2024-03-04T09:27:30.180 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:30 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:30.151+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:01.960225+0000 front 2024-03-04T09:27:01.960271+0000 (oldest deadline 2024-03-04T09:27:27.260135+0000) 2024-03-04T09:27:30.559 INFO:journalctl@ceph.osd.5.smithi190.stdout:Mar 04 09:27:30 smithi190 podman[73457]: 2024-03-04 09:27:30.247149243 +0000 UTC m=+0.632125693 container remove 7abe748fbf23827f9e6ba7bdd10853464778359b239fbed8aceb093bc0b22398 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-5, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-qdb-1bc250c, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-03-04T09:27:30.560 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:30 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:30.216+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:27:30.560 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:30 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:30.216+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:57.035521+0000 front 2024-03-04T09:26:57.035337+0000 (oldest deadline 2024-03-04T09:27:21.735439+0000) 2024-03-04T09:27:30.560 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:30 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:30.216+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:04.036279+0000 front 2024-03-04T09:27:04.036372+0000 (oldest deadline 2024-03-04T09:27:25.736393+0000) 2024-03-04T09:27:30.817 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 04 09:27:30 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-6[61078]: 2024-03-04T09:27:30.512+0000 7f3b082b5700 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.688639+0000 front 2024-03-04T09:26:56.688845+0000 (oldest deadline 2024-03-04T09:27:22.588795+0000) 2024-03-04T09:27:30.817 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 04 09:27:30 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-6[61078]: 2024-03-04T09:27:30.512+0000 7f3b082b5700 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:02.589481+0000 front 2024-03-04T09:27:02.589470+0000 (oldest deadline 2024-03-04T09:27:27.289348+0000) 2024-03-04T09:27:30.817 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:30 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:30.601+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:46.763438+0000 front 2024-03-04T09:26:46.763484+0000 (oldest deadline 2024-03-04T09:27:10.263514+0000) 2024-03-04T09:27:30.817 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:30 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:30.601+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.065154+0000 front 2024-03-04T09:26:56.065278+0000 (oldest deadline 2024-03-04T09:27:17.765282+0000) 2024-03-04T09:27:30.818 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:30 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:30.601+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:02.466239+0000 front 2024-03-04T09:27:02.466314+0000 (oldest deadline 2024-03-04T09:27:27.766338+0000) 2024-03-04T09:27:30.888 INFO:journalctl@ceph.osd.5.smithi190.stdout:Mar 04 09:27:30 smithi190 podman[73548]: 2024-03-04 09:27:30.465924639 +0000 UTC m=+0.017598363 image pull f88ffb32aa6a7d5dfdc954d9f096f0c9cc47981d05ec8d117ba859a22d8185ba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5 2024-03-04T09:27:30.888 INFO:journalctl@ceph.osd.5.smithi190.stdout:Mar 04 09:27:30 smithi190 podman[73548]: 2024-03-04 09:27:30.564402001 +0000 UTC m=+0.116075722 container create 18067b6a749b7c36c31a502fe8bb6d56c2520841406623bed2b4eacdd453afce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-5-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-qdb-1bc250c) 2024-03-04T09:27:30.888 INFO:journalctl@ceph.osd.5.smithi190.stdout:Mar 04 09:27:30 smithi190 podman[73548]: 2024-03-04 09:27:30.808629995 +0000 UTC m=+0.360303721 container init 18067b6a749b7c36c31a502fe8bb6d56c2520841406623bed2b4eacdd453afce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-5-deactivate, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-lusov-qdb-1bc250c, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-03-04T09:27:30.888 INFO:journalctl@ceph.osd.5.smithi190.stdout:Mar 04 09:27:30 smithi190 podman[73548]: 2024-03-04 09:27:30.811608914 +0000 UTC m=+0.363282628 container start 18067b6a749b7c36c31a502fe8bb6d56c2520841406623bed2b4eacdd453afce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-5-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-qdb-1bc250c, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-03-04T09:27:31.114 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:30 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:30.858+0000 7f8d11047700 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:54.939746+0000 front 2024-03-04T09:26:54.939716+0000 (oldest deadline 2024-03-04T09:27:20.839902+0000) 2024-03-04T09:27:31.115 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:30 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:30.858+0000 7f8d11047700 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:00.840348+0000 front 2024-03-04T09:27:00.840309+0000 (oldest deadline 2024-03-04T09:27:28.440998+0000) 2024-03-04T09:27:31.171 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:30 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:30.890+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.432694+0000 front 2024-03-04T09:26:56.432842+0000 (oldest deadline 2024-03-04T09:27:18.732822+0000) 2024-03-04T09:27:31.171 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:30 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:30.890+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:03.135303+0000 front 2024-03-04T09:27:03.135534+0000 (oldest deadline 2024-03-04T09:27:26.635408+0000) 2024-03-04T09:27:31.171 INFO:journalctl@ceph.osd.5.smithi190.stdout:Mar 04 09:27:30 smithi190 podman[73548]: 2024-03-04 09:27:30.891988833 +0000 UTC m=+0.443662548 container attach 18067b6a749b7c36c31a502fe8bb6d56c2520841406623bed2b4eacdd453afce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-5-deactivate, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-03-04T09:27:31.171 INFO:journalctl@ceph.osd.5.smithi190.stdout:Mar 04 09:27:31 smithi190 podman[73548]: 2024-03-04 09:27:31.098722091 +0000 UTC m=+0.650395795 container died 18067b6a749b7c36c31a502fe8bb6d56c2520841406623bed2b4eacdd453afce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-5-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, RELEASE=wip-lusov-qdb-1bc250c, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-03-04T09:27:31.429 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:31 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:31.117+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:27:31.429 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:31 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:31.117+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.858704+0000 front 2024-03-04T09:26:56.858604+0000 (oldest deadline 2024-03-04T09:27:18.459284+0000) 2024-03-04T09:27:31.429 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:31 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:31.117+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:01.960225+0000 front 2024-03-04T09:27:01.960271+0000 (oldest deadline 2024-03-04T09:27:27.260135+0000) 2024-03-04T09:27:31.541 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:31 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:31.230+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:27:31.541 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:31 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:31.230+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:57.035521+0000 front 2024-03-04T09:26:57.035337+0000 (oldest deadline 2024-03-04T09:27:21.735439+0000) 2024-03-04T09:27:31.541 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:31 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:31.230+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:04.036279+0000 front 2024-03-04T09:27:04.036372+0000 (oldest deadline 2024-03-04T09:27:25.736393+0000) 2024-03-04T09:27:31.704 DEBUG:teuthology.orchestra.run.smithi190:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@osd.5.service' 2024-03-04T09:27:31.745 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-04T09:27:31.745 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-03-04T09:27:31.745 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-03-04T09:27:31.745 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-2e533fc8-da06-11ee-95c6-87774f69a715@osd.6 2024-03-04T09:27:31.775 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 04 09:27:31 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-6[61078]: 2024-03-04T09:27:31.469+0000 7f3b082b5700 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.688639+0000 front 2024-03-04T09:26:56.688845+0000 (oldest deadline 2024-03-04T09:27:22.588795+0000) 2024-03-04T09:27:31.775 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 04 09:27:31 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-6[61078]: 2024-03-04T09:27:31.469+0000 7f3b082b5700 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:02.589481+0000 front 2024-03-04T09:27:02.589470+0000 (oldest deadline 2024-03-04T09:27:27.289348+0000) 2024-03-04T09:27:31.775 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:31 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:31.566+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:46.763438+0000 front 2024-03-04T09:26:46.763484+0000 (oldest deadline 2024-03-04T09:27:10.263514+0000) 2024-03-04T09:27:31.776 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:31 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:31.566+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.065154+0000 front 2024-03-04T09:26:56.065278+0000 (oldest deadline 2024-03-04T09:27:17.765282+0000) 2024-03-04T09:27:31.776 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:31 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:31.566+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:02.466239+0000 front 2024-03-04T09:27:02.466314+0000 (oldest deadline 2024-03-04T09:27:27.766338+0000) 2024-03-04T09:27:32.036 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 04 09:27:31 smithi082 systemd[1]: Stopping Ceph osd.6 for 2e533fc8-da06-11ee-95c6-87774f69a715... 2024-03-04T09:27:32.165 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:31 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:31.830+0000 7f8d11047700 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:54.939746+0000 front 2024-03-04T09:26:54.939716+0000 (oldest deadline 2024-03-04T09:27:20.839902+0000) 2024-03-04T09:27:32.165 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:31 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:31.830+0000 7f8d11047700 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:00.840348+0000 front 2024-03-04T09:27:00.840309+0000 (oldest deadline 2024-03-04T09:27:28.440998+0000) 2024-03-04T09:27:32.171 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:31 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:31.913+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.432694+0000 front 2024-03-04T09:26:56.432842+0000 (oldest deadline 2024-03-04T09:27:18.732822+0000) 2024-03-04T09:27:32.171 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:31 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:31.913+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:03.135303+0000 front 2024-03-04T09:27:03.135534+0000 (oldest deadline 2024-03-04T09:27:26.635408+0000) 2024-03-04T09:27:32.318 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 04 09:27:32 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-6[61078]: 2024-03-04T09:27:32.039+0000 7f3b0bcc1700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T09:27:32.318 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 04 09:27:32 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-6[61078]: 2024-03-04T09:27:32.039+0000 7f3b0bcc1700 -1 osd.6 110 *** Got signal Terminated *** 2024-03-04T09:27:32.318 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 04 09:27:32 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-6[61078]: 2024-03-04T09:27:32.039+0000 7f3b0bcc1700 -1 osd.6 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-04T09:27:32.432 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:32 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:32.168+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:27:32.432 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:32 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:32.168+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.858704+0000 front 2024-03-04T09:26:56.858604+0000 (oldest deadline 2024-03-04T09:27:18.459284+0000) 2024-03-04T09:27:32.432 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:32 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:32.168+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:01.960225+0000 front 2024-03-04T09:27:01.960271+0000 (oldest deadline 2024-03-04T09:27:27.260135+0000) 2024-03-04T09:27:32.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:32 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:32.197+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:27:32.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:32 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:32.197+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:57.035521+0000 front 2024-03-04T09:26:57.035337+0000 (oldest deadline 2024-03-04T09:27:21.735439+0000) 2024-03-04T09:27:32.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:32 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:32.197+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:04.036279+0000 front 2024-03-04T09:27:04.036372+0000 (oldest deadline 2024-03-04T09:27:25.736393+0000) 2024-03-04T09:27:32.817 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 04 09:27:32 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-6[61078]: 2024-03-04T09:27:32.509+0000 7f3b082b5700 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.688639+0000 front 2024-03-04T09:26:56.688845+0000 (oldest deadline 2024-03-04T09:27:22.588795+0000) 2024-03-04T09:27:32.817 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 04 09:27:32 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-6[61078]: 2024-03-04T09:27:32.509+0000 7f3b082b5700 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:02.589481+0000 front 2024-03-04T09:27:02.589470+0000 (oldest deadline 2024-03-04T09:27:27.289348+0000) 2024-03-04T09:27:32.817 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:32 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:32.611+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:46.763438+0000 front 2024-03-04T09:26:46.763484+0000 (oldest deadline 2024-03-04T09:27:10.263514+0000) 2024-03-04T09:27:32.817 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:32 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:32.611+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.065154+0000 front 2024-03-04T09:26:56.065278+0000 (oldest deadline 2024-03-04T09:27:17.765282+0000) 2024-03-04T09:27:32.818 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:32 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:32.611+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:02.466239+0000 front 2024-03-04T09:27:02.466314+0000 (oldest deadline 2024-03-04T09:27:27.766338+0000) 2024-03-04T09:27:33.142 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:32 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:32.851+0000 7f8d11047700 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:54.939746+0000 front 2024-03-04T09:26:54.939716+0000 (oldest deadline 2024-03-04T09:27:20.839902+0000) 2024-03-04T09:27:33.142 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:32 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:32.851+0000 7f8d11047700 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:00.840348+0000 front 2024-03-04T09:27:00.840309+0000 (oldest deadline 2024-03-04T09:27:28.440998+0000) 2024-03-04T09:27:33.232 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:32 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:32.954+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.432694+0000 front 2024-03-04T09:26:56.432842+0000 (oldest deadline 2024-03-04T09:27:18.732822+0000) 2024-03-04T09:27:33.232 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:32 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:32.954+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:03.135303+0000 front 2024-03-04T09:27:03.135534+0000 (oldest deadline 2024-03-04T09:27:26.635408+0000) 2024-03-04T09:27:33.429 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:33 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:33.145+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:27:33.429 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:33 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:33.145+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.858704+0000 front 2024-03-04T09:26:56.858604+0000 (oldest deadline 2024-03-04T09:27:18.459284+0000) 2024-03-04T09:27:33.429 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:33 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:33.145+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:01.960225+0000 front 2024-03-04T09:27:01.960271+0000 (oldest deadline 2024-03-04T09:27:27.260135+0000) 2024-03-04T09:27:33.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:33 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:33.235+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:27:33.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:33 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:33.235+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:57.035521+0000 front 2024-03-04T09:26:57.035337+0000 (oldest deadline 2024-03-04T09:27:21.735439+0000) 2024-03-04T09:27:33.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:33 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:33.235+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:04.036279+0000 front 2024-03-04T09:27:04.036372+0000 (oldest deadline 2024-03-04T09:27:25.736393+0000) 2024-03-04T09:27:33.817 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 04 09:27:33 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-6[61078]: 2024-03-04T09:27:33.482+0000 7f3b082b5700 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.688639+0000 front 2024-03-04T09:26:56.688845+0000 (oldest deadline 2024-03-04T09:27:22.588795+0000) 2024-03-04T09:27:33.817 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 04 09:27:33 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-6[61078]: 2024-03-04T09:27:33.482+0000 7f3b082b5700 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:02.589481+0000 front 2024-03-04T09:27:02.589470+0000 (oldest deadline 2024-03-04T09:27:27.289348+0000) 2024-03-04T09:27:33.818 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:33 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:33.618+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:46.763438+0000 front 2024-03-04T09:26:46.763484+0000 (oldest deadline 2024-03-04T09:27:10.263514+0000) 2024-03-04T09:27:33.818 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:33 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:33.618+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.065154+0000 front 2024-03-04T09:26:56.065278+0000 (oldest deadline 2024-03-04T09:27:17.765282+0000) 2024-03-04T09:27:33.818 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:33 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:33.618+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:02.466239+0000 front 2024-03-04T09:27:02.466314+0000 (oldest deadline 2024-03-04T09:27:27.766338+0000) 2024-03-04T09:27:34.162 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:33 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:33.879+0000 7f8d11047700 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:54.939746+0000 front 2024-03-04T09:26:54.939716+0000 (oldest deadline 2024-03-04T09:27:20.839902+0000) 2024-03-04T09:27:34.162 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:33 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:33.879+0000 7f8d11047700 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:00.840348+0000 front 2024-03-04T09:27:00.840309+0000 (oldest deadline 2024-03-04T09:27:28.440998+0000) 2024-03-04T09:27:34.245 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:33 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:33.958+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.432694+0000 front 2024-03-04T09:26:56.432842+0000 (oldest deadline 2024-03-04T09:27:18.732822+0000) 2024-03-04T09:27:34.245 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:33 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:33.958+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:03.135303+0000 front 2024-03-04T09:27:03.135534+0000 (oldest deadline 2024-03-04T09:27:26.635408+0000) 2024-03-04T09:27:34.429 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:34 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:34.165+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:27:34.429 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:34 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:34.165+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.858704+0000 front 2024-03-04T09:26:56.858604+0000 (oldest deadline 2024-03-04T09:27:18.459284+0000) 2024-03-04T09:27:34.429 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:34 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:34.165+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:01.960225+0000 front 2024-03-04T09:27:01.960271+0000 (oldest deadline 2024-03-04T09:27:27.260135+0000) 2024-03-04T09:27:34.430 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:34 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:34.165+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:13.061584+0000 front 2024-03-04T09:27:13.061603+0000 (oldest deadline 2024-03-04T09:27:34.161481+0000) 2024-03-04T09:27:34.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:34 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:34.248+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:27:34.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:34 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:34.248+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:57.035521+0000 front 2024-03-04T09:26:57.035337+0000 (oldest deadline 2024-03-04T09:27:21.735439+0000) 2024-03-04T09:27:34.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:34 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:34.248+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:04.036279+0000 front 2024-03-04T09:27:04.036372+0000 (oldest deadline 2024-03-04T09:27:25.736393+0000) 2024-03-04T09:27:34.817 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 04 09:27:34 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-6[61078]: 2024-03-04T09:27:34.515+0000 7f3b082b5700 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.688639+0000 front 2024-03-04T09:26:56.688845+0000 (oldest deadline 2024-03-04T09:27:22.588795+0000) 2024-03-04T09:27:34.817 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 04 09:27:34 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-6[61078]: 2024-03-04T09:27:34.515+0000 7f3b082b5700 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:02.589481+0000 front 2024-03-04T09:27:02.589470+0000 (oldest deadline 2024-03-04T09:27:27.289348+0000) 2024-03-04T09:27:34.818 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:34 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:34.582+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:46.763438+0000 front 2024-03-04T09:26:46.763484+0000 (oldest deadline 2024-03-04T09:27:10.263514+0000) 2024-03-04T09:27:34.818 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:34 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:34.582+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.065154+0000 front 2024-03-04T09:26:56.065278+0000 (oldest deadline 2024-03-04T09:27:17.765282+0000) 2024-03-04T09:27:34.818 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:34 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:34.582+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:02.466239+0000 front 2024-03-04T09:27:02.466314+0000 (oldest deadline 2024-03-04T09:27:27.766338+0000) 2024-03-04T09:27:35.179 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:34 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:34.852+0000 7f8d11047700 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:54.939746+0000 front 2024-03-04T09:26:54.939716+0000 (oldest deadline 2024-03-04T09:27:20.839902+0000) 2024-03-04T09:27:35.180 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:34 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:34.852+0000 7f8d11047700 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:00.840348+0000 front 2024-03-04T09:27:00.840309+0000 (oldest deadline 2024-03-04T09:27:28.440998+0000) 2024-03-04T09:27:35.293 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:34 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:34.983+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.432694+0000 front 2024-03-04T09:26:56.432842+0000 (oldest deadline 2024-03-04T09:27:18.732822+0000) 2024-03-04T09:27:35.294 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:34 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:34.983+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:03.135303+0000 front 2024-03-04T09:27:03.135534+0000 (oldest deadline 2024-03-04T09:27:26.635408+0000) 2024-03-04T09:27:35.294 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:34 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:34.983+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:12.437091+0000 front 2024-03-04T09:27:12.437166+0000 (oldest deadline 2024-03-04T09:27:34.737044+0000) 2024-03-04T09:27:35.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:35 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:35.297+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:27:35.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:35 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:35.297+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:57.035521+0000 front 2024-03-04T09:26:57.035337+0000 (oldest deadline 2024-03-04T09:27:21.735439+0000) 2024-03-04T09:27:35.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:35 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:35.297+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:04.036279+0000 front 2024-03-04T09:27:04.036372+0000 (oldest deadline 2024-03-04T09:27:25.736393+0000) 2024-03-04T09:27:35.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:35 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:35.199+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:27:35.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:35 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:35.199+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.858704+0000 front 2024-03-04T09:26:56.858604+0000 (oldest deadline 2024-03-04T09:27:18.459284+0000) 2024-03-04T09:27:35.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:35 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:35.199+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:01.960225+0000 front 2024-03-04T09:27:01.960271+0000 (oldest deadline 2024-03-04T09:27:27.260135+0000) 2024-03-04T09:27:35.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:35 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:35.199+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:13.061584+0000 front 2024-03-04T09:27:13.061603+0000 (oldest deadline 2024-03-04T09:27:34.161481+0000) 2024-03-04T09:27:35.817 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 04 09:27:35 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-6[61078]: 2024-03-04T09:27:35.523+0000 7f3b082b5700 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.688639+0000 front 2024-03-04T09:26:56.688845+0000 (oldest deadline 2024-03-04T09:27:22.588795+0000) 2024-03-04T09:27:35.818 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 04 09:27:35 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-6[61078]: 2024-03-04T09:27:35.523+0000 7f3b082b5700 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:02.589481+0000 front 2024-03-04T09:27:02.589470+0000 (oldest deadline 2024-03-04T09:27:27.289348+0000) 2024-03-04T09:27:35.818 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:35 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:35.612+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:46.763438+0000 front 2024-03-04T09:26:46.763484+0000 (oldest deadline 2024-03-04T09:27:10.263514+0000) 2024-03-04T09:27:35.818 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:35 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:35.612+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.065154+0000 front 2024-03-04T09:26:56.065278+0000 (oldest deadline 2024-03-04T09:27:17.765282+0000) 2024-03-04T09:27:35.818 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:35 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:35.612+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:02.466239+0000 front 2024-03-04T09:27:02.466314+0000 (oldest deadline 2024-03-04T09:27:27.766338+0000) 2024-03-04T09:27:35.818 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:35 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:35.612+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:10.067296+0000 front 2024-03-04T09:27:10.067271+0000 (oldest deadline 2024-03-04T09:27:34.767410+0000) 2024-03-04T09:27:36.181 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:35 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:35.821+0000 7f8d11047700 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:54.939746+0000 front 2024-03-04T09:26:54.939716+0000 (oldest deadline 2024-03-04T09:27:20.839902+0000) 2024-03-04T09:27:36.181 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:35 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:35.821+0000 7f8d11047700 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:00.840348+0000 front 2024-03-04T09:27:00.840309+0000 (oldest deadline 2024-03-04T09:27:28.440998+0000) 2024-03-04T09:27:36.280 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:36 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:36.011+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.432694+0000 front 2024-03-04T09:26:56.432842+0000 (oldest deadline 2024-03-04T09:27:18.732822+0000) 2024-03-04T09:27:36.280 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:36 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:36.011+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:03.135303+0000 front 2024-03-04T09:27:03.135534+0000 (oldest deadline 2024-03-04T09:27:26.635408+0000) 2024-03-04T09:27:36.280 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:36 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:36.011+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:12.437091+0000 front 2024-03-04T09:27:12.437166+0000 (oldest deadline 2024-03-04T09:27:34.737044+0000) 2024-03-04T09:27:36.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:36 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:36.283+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:27:36.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:36 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:36.283+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:57.035521+0000 front 2024-03-04T09:26:57.035337+0000 (oldest deadline 2024-03-04T09:27:21.735439+0000) 2024-03-04T09:27:36.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:36 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:36.283+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:04.036279+0000 front 2024-03-04T09:27:04.036372+0000 (oldest deadline 2024-03-04T09:27:25.736393+0000) 2024-03-04T09:27:36.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:36 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:36.246+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:27:36.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:36 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:36.246+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.858704+0000 front 2024-03-04T09:26:56.858604+0000 (oldest deadline 2024-03-04T09:27:18.459284+0000) 2024-03-04T09:27:36.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:36 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:36.246+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:01.960225+0000 front 2024-03-04T09:27:01.960271+0000 (oldest deadline 2024-03-04T09:27:27.260135+0000) 2024-03-04T09:27:36.680 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:36 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:36.246+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:13.061584+0000 front 2024-03-04T09:27:13.061603+0000 (oldest deadline 2024-03-04T09:27:34.161481+0000) 2024-03-04T09:27:36.817 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 04 09:27:36 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-6[61078]: 2024-03-04T09:27:36.524+0000 7f3b082b5700 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.688639+0000 front 2024-03-04T09:26:56.688845+0000 (oldest deadline 2024-03-04T09:27:22.588795+0000) 2024-03-04T09:27:36.817 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 04 09:27:36 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-6[61078]: 2024-03-04T09:27:36.524+0000 7f3b082b5700 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:02.589481+0000 front 2024-03-04T09:27:02.589470+0000 (oldest deadline 2024-03-04T09:27:27.289348+0000) 2024-03-04T09:27:36.817 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:36 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:36.659+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:46.763438+0000 front 2024-03-04T09:26:46.763484+0000 (oldest deadline 2024-03-04T09:27:10.263514+0000) 2024-03-04T09:27:36.818 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:36 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:36.659+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.065154+0000 front 2024-03-04T09:26:56.065278+0000 (oldest deadline 2024-03-04T09:27:17.765282+0000) 2024-03-04T09:27:36.818 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:36 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:36.659+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:02.466239+0000 front 2024-03-04T09:27:02.466314+0000 (oldest deadline 2024-03-04T09:27:27.766338+0000) 2024-03-04T09:27:36.818 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:36 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:36.659+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:10.067296+0000 front 2024-03-04T09:27:10.067271+0000 (oldest deadline 2024-03-04T09:27:34.767410+0000) 2024-03-04T09:27:37.179 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:36 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:36.795+0000 7f8d11047700 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:54.939746+0000 front 2024-03-04T09:26:54.939716+0000 (oldest deadline 2024-03-04T09:27:20.839902+0000) 2024-03-04T09:27:37.179 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:36 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:36.795+0000 7f8d11047700 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:00.840348+0000 front 2024-03-04T09:27:00.840309+0000 (oldest deadline 2024-03-04T09:27:28.440998+0000) 2024-03-04T09:27:37.179 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:36 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:36.795+0000 7f8d11047700 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:11.942095+0000 front 2024-03-04T09:27:11.942132+0000 (oldest deadline 2024-03-04T09:27:36.642161+0000) 2024-03-04T09:27:37.292 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:36 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:36.961+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.432694+0000 front 2024-03-04T09:26:56.432842+0000 (oldest deadline 2024-03-04T09:27:18.732822+0000) 2024-03-04T09:27:37.292 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:36 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:36.961+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:03.135303+0000 front 2024-03-04T09:27:03.135534+0000 (oldest deadline 2024-03-04T09:27:26.635408+0000) 2024-03-04T09:27:37.292 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:36 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:36.961+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:12.437091+0000 front 2024-03-04T09:27:12.437166+0000 (oldest deadline 2024-03-04T09:27:34.737044+0000) 2024-03-04T09:27:37.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:37 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:37.296+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:27:37.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:37 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:37.296+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:57.035521+0000 front 2024-03-04T09:26:57.035337+0000 (oldest deadline 2024-03-04T09:27:21.735439+0000) 2024-03-04T09:27:37.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:37 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:37.296+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:04.036279+0000 front 2024-03-04T09:27:04.036372+0000 (oldest deadline 2024-03-04T09:27:25.736393+0000) 2024-03-04T09:27:37.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:37 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:37.250+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:27:37.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:37 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:37.250+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.858704+0000 front 2024-03-04T09:26:56.858604+0000 (oldest deadline 2024-03-04T09:27:18.459284+0000) 2024-03-04T09:27:37.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:37 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:37.250+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:01.960225+0000 front 2024-03-04T09:27:01.960271+0000 (oldest deadline 2024-03-04T09:27:27.260135+0000) 2024-03-04T09:27:37.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:37 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:37.250+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:13.061584+0000 front 2024-03-04T09:27:13.061603+0000 (oldest deadline 2024-03-04T09:27:34.161481+0000) 2024-03-04T09:27:37.753 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 04 09:27:37 smithi082 podman[93758]: 2024-03-04 09:27:37.444196171 +0000 UTC m=+5.506277430 container died a53c08516f5bd545630ea47c3fc24c0bba90091b9210c60fa015c92fd1fee094 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-6, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=wip-lusov-qdb-1bc250c, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0) 2024-03-04T09:27:37.753 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:37 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:37.646+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:46.763438+0000 front 2024-03-04T09:26:46.763484+0000 (oldest deadline 2024-03-04T09:27:10.263514+0000) 2024-03-04T09:27:37.753 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:37 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:37.646+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.065154+0000 front 2024-03-04T09:26:56.065278+0000 (oldest deadline 2024-03-04T09:27:17.765282+0000) 2024-03-04T09:27:37.754 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:37 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:37.646+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:02.466239+0000 front 2024-03-04T09:27:02.466314+0000 (oldest deadline 2024-03-04T09:27:27.766338+0000) 2024-03-04T09:27:37.754 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:37 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:37.646+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:10.067296+0000 front 2024-03-04T09:27:10.067271+0000 (oldest deadline 2024-03-04T09:27:34.767410+0000) 2024-03-04T09:27:38.053 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 04 09:27:37 smithi082 podman[93758]: 2024-03-04 09:27:37.847548871 +0000 UTC m=+5.909630118 container cleanup a53c08516f5bd545630ea47c3fc24c0bba90091b9210c60fa015c92fd1fee094 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-6, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.license=GPLv2, RELEASE=wip-lusov-qdb-1bc250c, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-03-04T09:27:38.054 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 04 09:27:37 smithi082 bash[93758]: ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-6 2024-03-04T09:27:38.179 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:37 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:37.810+0000 7f8d11047700 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:54.939746+0000 front 2024-03-04T09:26:54.939716+0000 (oldest deadline 2024-03-04T09:27:20.839902+0000) 2024-03-04T09:27:38.179 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:37 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:37.810+0000 7f8d11047700 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:00.840348+0000 front 2024-03-04T09:27:00.840309+0000 (oldest deadline 2024-03-04T09:27:28.440998+0000) 2024-03-04T09:27:38.180 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:37 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:37.810+0000 7f8d11047700 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:11.942095+0000 front 2024-03-04T09:27:11.942132+0000 (oldest deadline 2024-03-04T09:27:36.642161+0000) 2024-03-04T09:27:38.248 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:37 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:37.980+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.432694+0000 front 2024-03-04T09:26:56.432842+0000 (oldest deadline 2024-03-04T09:27:18.732822+0000) 2024-03-04T09:27:38.249 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:37 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:37.980+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:03.135303+0000 front 2024-03-04T09:27:03.135534+0000 (oldest deadline 2024-03-04T09:27:26.635408+0000) 2024-03-04T09:27:38.249 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:37 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:37.980+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:12.437091+0000 front 2024-03-04T09:27:12.437166+0000 (oldest deadline 2024-03-04T09:27:34.737044+0000) 2024-03-04T09:27:38.317 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 04 09:27:38 smithi082 podman[93774]: 2024-03-04 09:27:38.057396391 +0000 UTC m=+0.613173964 container remove a53c08516f5bd545630ea47c3fc24c0bba90091b9210c60fa015c92fd1fee094 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-6, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, RELEASE=wip-lusov-qdb-1bc250c, CEPH_POINT_RELEASE=) 2024-03-04T09:27:38.640 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 04 09:27:38 smithi082 podman[93864]: 2024-03-04 09:27:38.283976053 +0000 UTC m=+0.018293310 image pull f88ffb32aa6a7d5dfdc954d9f096f0c9cc47981d05ec8d117ba859a22d8185ba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5 2024-03-04T09:27:38.640 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 04 09:27:38 smithi082 podman[93864]: 2024-03-04 09:27:38.408660425 +0000 UTC m=+0.142977719 container create 4cd13d41fa70d8b796d8c727e6a7ea516350cac134e2c16b692e19bbb235424f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-6-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.license=GPLv2, RELEASE=wip-lusov-qdb-1bc250c, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-03-04T09:27:38.641 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 04 09:27:38 smithi082 podman[93864]: 2024-03-04 09:27:38.644691561 +0000 UTC m=+0.379008820 container init 4cd13d41fa70d8b796d8c727e6a7ea516350cac134e2c16b692e19bbb235424f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-6-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-lusov-qdb-1bc250c, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-04T09:27:38.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:38 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:38.251+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:27:38.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:38 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:38.251+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:57.035521+0000 front 2024-03-04T09:26:57.035337+0000 (oldest deadline 2024-03-04T09:27:21.735439+0000) 2024-03-04T09:27:38.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:38 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:38.251+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:04.036279+0000 front 2024-03-04T09:27:04.036372+0000 (oldest deadline 2024-03-04T09:27:25.736393+0000) 2024-03-04T09:27:38.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:38 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:38.294+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:27:38.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:38 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:38.294+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.858704+0000 front 2024-03-04T09:26:56.858604+0000 (oldest deadline 2024-03-04T09:27:18.459284+0000) 2024-03-04T09:27:38.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:38 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:38.294+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:01.960225+0000 front 2024-03-04T09:27:01.960271+0000 (oldest deadline 2024-03-04T09:27:27.260135+0000) 2024-03-04T09:27:38.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:38 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:38.294+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:13.061584+0000 front 2024-03-04T09:27:13.061603+0000 (oldest deadline 2024-03-04T09:27:34.161481+0000) 2024-03-04T09:27:38.926 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 04 09:27:38 smithi082 podman[93864]: 2024-03-04 09:27:38.64782604 +0000 UTC m=+0.382143294 container start 4cd13d41fa70d8b796d8c727e6a7ea516350cac134e2c16b692e19bbb235424f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-6-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-qdb-1bc250c, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, ceph=True) 2024-03-04T09:27:38.926 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 04 09:27:38 smithi082 podman[93864]: 2024-03-04 09:27:38.727710352 +0000 UTC m=+0.462027613 container attach 4cd13d41fa70d8b796d8c727e6a7ea516350cac134e2c16b692e19bbb235424f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-6-deactivate, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-03-04T09:27:38.926 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:38 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:38.690+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:46.763438+0000 front 2024-03-04T09:26:46.763484+0000 (oldest deadline 2024-03-04T09:27:10.263514+0000) 2024-03-04T09:27:38.926 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:38 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:38.690+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.065154+0000 front 2024-03-04T09:26:56.065278+0000 (oldest deadline 2024-03-04T09:27:17.765282+0000) 2024-03-04T09:27:38.927 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:38 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:38.690+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:02.466239+0000 front 2024-03-04T09:27:02.466314+0000 (oldest deadline 2024-03-04T09:27:27.766338+0000) 2024-03-04T09:27:38.927 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:38 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:38.690+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:10.067296+0000 front 2024-03-04T09:27:10.067271+0000 (oldest deadline 2024-03-04T09:27:34.767410+0000) 2024-03-04T09:27:39.179 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:38 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:38.854+0000 7f8d11047700 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:54.939746+0000 front 2024-03-04T09:26:54.939716+0000 (oldest deadline 2024-03-04T09:27:20.839902+0000) 2024-03-04T09:27:39.179 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:38 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:38.854+0000 7f8d11047700 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:00.840348+0000 front 2024-03-04T09:27:00.840309+0000 (oldest deadline 2024-03-04T09:27:28.440998+0000) 2024-03-04T09:27:39.179 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:38 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:38.854+0000 7f8d11047700 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:11.942095+0000 front 2024-03-04T09:27:11.942132+0000 (oldest deadline 2024-03-04T09:27:36.642161+0000) 2024-03-04T09:27:39.226 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 04 09:27:38 smithi082 podman[93864]: 2024-03-04 09:27:38.930003428 +0000 UTC m=+0.664320687 container died 4cd13d41fa70d8b796d8c727e6a7ea516350cac134e2c16b692e19bbb235424f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-03-04T09:27:39.291 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:38 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:38.968+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.432694+0000 front 2024-03-04T09:26:56.432842+0000 (oldest deadline 2024-03-04T09:27:18.732822+0000) 2024-03-04T09:27:39.291 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:38 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:38.968+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:03.135303+0000 front 2024-03-04T09:27:03.135534+0000 (oldest deadline 2024-03-04T09:27:26.635408+0000) 2024-03-04T09:27:39.291 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:38 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:38.968+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:12.437091+0000 front 2024-03-04T09:27:12.437166+0000 (oldest deadline 2024-03-04T09:27:34.737044+0000) 2024-03-04T09:27:39.483 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 04 09:27:39 smithi082 podman[93890]: 2024-03-04 09:27:39.464450625 +0000 UTC m=+0.529150288 container remove 4cd13d41fa70d8b796d8c727e6a7ea516350cac134e2c16b692e19bbb235424f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8) 2024-03-04T09:27:39.488 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@osd.6.service' 2024-03-04T09:27:39.570 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-04T09:27:39.570 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-03-04T09:27:39.570 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-03-04T09:27:39.570 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-2e533fc8-da06-11ee-95c6-87774f69a715@osd.7 2024-03-04T09:27:39.600 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:39 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:39.247+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:27:39.600 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:39 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:39.247+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.858704+0000 front 2024-03-04T09:26:56.858604+0000 (oldest deadline 2024-03-04T09:27:18.459284+0000) 2024-03-04T09:27:39.600 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:39 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:39.247+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:01.960225+0000 front 2024-03-04T09:27:01.960271+0000 (oldest deadline 2024-03-04T09:27:27.260135+0000) 2024-03-04T09:27:39.600 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:39 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:39.247+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:13.061584+0000 front 2024-03-04T09:27:13.061603+0000 (oldest deadline 2024-03-04T09:27:34.161481+0000) 2024-03-04T09:27:39.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:39 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:39.294+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:27:39.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:39 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:39.294+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:57.035521+0000 front 2024-03-04T09:26:57.035337+0000 (oldest deadline 2024-03-04T09:27:21.735439+0000) 2024-03-04T09:27:39.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:39 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:39.294+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:04.036279+0000 front 2024-03-04T09:27:04.036372+0000 (oldest deadline 2024-03-04T09:27:25.736393+0000) 2024-03-04T09:27:39.817 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:39 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:39.729+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:46.763438+0000 front 2024-03-04T09:26:46.763484+0000 (oldest deadline 2024-03-04T09:27:10.263514+0000) 2024-03-04T09:27:39.817 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:39 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:39.729+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.065154+0000 front 2024-03-04T09:26:56.065278+0000 (oldest deadline 2024-03-04T09:27:17.765282+0000) 2024-03-04T09:27:39.817 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:39 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:39.729+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:02.466239+0000 front 2024-03-04T09:27:02.466314+0000 (oldest deadline 2024-03-04T09:27:27.766338+0000) 2024-03-04T09:27:39.817 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:39 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:39.729+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:10.067296+0000 front 2024-03-04T09:27:10.067271+0000 (oldest deadline 2024-03-04T09:27:34.767410+0000) 2024-03-04T09:27:39.883 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:39 smithi102 systemd[1]: Stopping Ceph osd.7 for 2e533fc8-da06-11ee-95c6-87774f69a715... 2024-03-04T09:27:39.883 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:39 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:39.839+0000 7f8d11047700 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:54.939746+0000 front 2024-03-04T09:26:54.939716+0000 (oldest deadline 2024-03-04T09:27:20.839902+0000) 2024-03-04T09:27:39.883 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:39 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:39.839+0000 7f8d11047700 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:00.840348+0000 front 2024-03-04T09:27:00.840309+0000 (oldest deadline 2024-03-04T09:27:28.440998+0000) 2024-03-04T09:27:39.883 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:39 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:39.839+0000 7f8d11047700 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:11.942095+0000 front 2024-03-04T09:27:11.942132+0000 (oldest deadline 2024-03-04T09:27:36.642161+0000) 2024-03-04T09:27:40.179 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:39 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:39.895+0000 7f8d14a53700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T09:27:40.179 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:39 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:39.895+0000 7f8d14a53700 -1 osd.7 110 *** Got signal Terminated *** 2024-03-04T09:27:40.179 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:39 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:39.895+0000 7f8d14a53700 -1 osd.7 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-04T09:27:40.332 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:39 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:39.984+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.432694+0000 front 2024-03-04T09:26:56.432842+0000 (oldest deadline 2024-03-04T09:27:18.732822+0000) 2024-03-04T09:27:40.333 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:39 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:39.984+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:03.135303+0000 front 2024-03-04T09:27:03.135534+0000 (oldest deadline 2024-03-04T09:27:26.635408+0000) 2024-03-04T09:27:40.333 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:39 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:39.984+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:12.437091+0000 front 2024-03-04T09:27:12.437166+0000 (oldest deadline 2024-03-04T09:27:34.737044+0000) 2024-03-04T09:27:40.448 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:40 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:40.201+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:27:40.448 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:40 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:40.201+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.858704+0000 front 2024-03-04T09:26:56.858604+0000 (oldest deadline 2024-03-04T09:27:18.459284+0000) 2024-03-04T09:27:40.448 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:40 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:40.201+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:01.960225+0000 front 2024-03-04T09:27:01.960271+0000 (oldest deadline 2024-03-04T09:27:27.260135+0000) 2024-03-04T09:27:40.448 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:40 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:40.201+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:13.061584+0000 front 2024-03-04T09:27:13.061603+0000 (oldest deadline 2024-03-04T09:27:34.161481+0000) 2024-03-04T09:27:40.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:40 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:40.335+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:27:40.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:40 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:40.335+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:57.035521+0000 front 2024-03-04T09:26:57.035337+0000 (oldest deadline 2024-03-04T09:27:21.735439+0000) 2024-03-04T09:27:40.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:40 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:40.335+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:04.036279+0000 front 2024-03-04T09:27:04.036372+0000 (oldest deadline 2024-03-04T09:27:25.736393+0000) 2024-03-04T09:27:41.068 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:40 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:40.753+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:46.763438+0000 front 2024-03-04T09:26:46.763484+0000 (oldest deadline 2024-03-04T09:27:10.263514+0000) 2024-03-04T09:27:41.068 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:40 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:40.753+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.065154+0000 front 2024-03-04T09:26:56.065278+0000 (oldest deadline 2024-03-04T09:27:17.765282+0000) 2024-03-04T09:27:41.068 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:40 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:40.753+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:02.466239+0000 front 2024-03-04T09:27:02.466314+0000 (oldest deadline 2024-03-04T09:27:27.766338+0000) 2024-03-04T09:27:41.068 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:40 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:40.753+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:10.067296+0000 front 2024-03-04T09:27:10.067271+0000 (oldest deadline 2024-03-04T09:27:34.767410+0000) 2024-03-04T09:27:41.179 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:40 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:40.833+0000 7f8d11047700 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:54.939746+0000 front 2024-03-04T09:26:54.939716+0000 (oldest deadline 2024-03-04T09:27:20.839902+0000) 2024-03-04T09:27:41.179 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:40 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:40.833+0000 7f8d11047700 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:00.840348+0000 front 2024-03-04T09:27:00.840309+0000 (oldest deadline 2024-03-04T09:27:28.440998+0000) 2024-03-04T09:27:41.180 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:40 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:40.833+0000 7f8d11047700 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:11.942095+0000 front 2024-03-04T09:27:11.942132+0000 (oldest deadline 2024-03-04T09:27:36.642161+0000) 2024-03-04T09:27:41.345 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:40 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:40.984+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.432694+0000 front 2024-03-04T09:26:56.432842+0000 (oldest deadline 2024-03-04T09:27:18.732822+0000) 2024-03-04T09:27:41.346 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:40 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:40.984+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:03.135303+0000 front 2024-03-04T09:27:03.135534+0000 (oldest deadline 2024-03-04T09:27:26.635408+0000) 2024-03-04T09:27:41.346 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:40 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:40.984+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:12.437091+0000 front 2024-03-04T09:27:12.437166+0000 (oldest deadline 2024-03-04T09:27:34.737044+0000) 2024-03-04T09:27:41.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:41 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:41.348+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:27:41.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:41 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:41.348+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:57.035521+0000 front 2024-03-04T09:26:57.035337+0000 (oldest deadline 2024-03-04T09:27:21.735439+0000) 2024-03-04T09:27:41.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:41 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:41.348+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:04.036279+0000 front 2024-03-04T09:27:04.036372+0000 (oldest deadline 2024-03-04T09:27:25.736393+0000) 2024-03-04T09:27:41.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:41 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:41.199+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:27:41.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:41 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:41.200+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.858704+0000 front 2024-03-04T09:26:56.858604+0000 (oldest deadline 2024-03-04T09:27:18.459284+0000) 2024-03-04T09:27:41.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:41 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:41.200+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:01.960225+0000 front 2024-03-04T09:27:01.960271+0000 (oldest deadline 2024-03-04T09:27:27.260135+0000) 2024-03-04T09:27:41.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:41 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:41.200+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:13.061584+0000 front 2024-03-04T09:27:13.061603+0000 (oldest deadline 2024-03-04T09:27:34.161481+0000) 2024-03-04T09:27:42.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:41 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:41.758+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:46.763438+0000 front 2024-03-04T09:26:46.763484+0000 (oldest deadline 2024-03-04T09:27:10.263514+0000) 2024-03-04T09:27:42.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:41 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:41.758+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.065154+0000 front 2024-03-04T09:26:56.065278+0000 (oldest deadline 2024-03-04T09:27:17.765282+0000) 2024-03-04T09:27:42.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:41 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:41.758+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:02.466239+0000 front 2024-03-04T09:27:02.466314+0000 (oldest deadline 2024-03-04T09:27:27.766338+0000) 2024-03-04T09:27:42.068 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:41 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:41.758+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:10.067296+0000 front 2024-03-04T09:27:10.067271+0000 (oldest deadline 2024-03-04T09:27:34.767410+0000) 2024-03-04T09:27:42.068 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:41 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:41.758+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:19.369079+0000 front 2024-03-04T09:27:19.369094+0000 (oldest deadline 2024-03-04T09:27:41.668724+0000) 2024-03-04T09:27:42.171 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:41 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:41.965+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.432694+0000 front 2024-03-04T09:26:56.432842+0000 (oldest deadline 2024-03-04T09:27:18.732822+0000) 2024-03-04T09:27:42.171 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:41 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:41.965+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:03.135303+0000 front 2024-03-04T09:27:03.135534+0000 (oldest deadline 2024-03-04T09:27:26.635408+0000) 2024-03-04T09:27:42.171 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:41 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:41.965+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:12.437091+0000 front 2024-03-04T09:27:12.437166+0000 (oldest deadline 2024-03-04T09:27:34.737044+0000) 2024-03-04T09:27:42.179 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:41 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:41.808+0000 7f8d11047700 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:54.939746+0000 front 2024-03-04T09:26:54.939716+0000 (oldest deadline 2024-03-04T09:27:20.839902+0000) 2024-03-04T09:27:42.179 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:41 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:41.808+0000 7f8d11047700 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:00.840348+0000 front 2024-03-04T09:27:00.840309+0000 (oldest deadline 2024-03-04T09:27:28.440998+0000) 2024-03-04T09:27:42.179 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:41 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:41.808+0000 7f8d11047700 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:11.942095+0000 front 2024-03-04T09:27:11.942132+0000 (oldest deadline 2024-03-04T09:27:36.642161+0000) 2024-03-04T09:27:42.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:42 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:42.342+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:27:42.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:42 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:42.342+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:57.035521+0000 front 2024-03-04T09:26:57.035337+0000 (oldest deadline 2024-03-04T09:27:21.735439+0000) 2024-03-04T09:27:42.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:42 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:42.342+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:04.036279+0000 front 2024-03-04T09:27:04.036372+0000 (oldest deadline 2024-03-04T09:27:25.736393+0000) 2024-03-04T09:27:42.672 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:42 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:42.342+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:17.438406+0000 front 2024-03-04T09:27:17.438387+0000 (oldest deadline 2024-03-04T09:27:42.138476+0000) 2024-03-04T09:27:42.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:42 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:42.226+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:27:42.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:42 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:42.226+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.858704+0000 front 2024-03-04T09:26:56.858604+0000 (oldest deadline 2024-03-04T09:27:18.459284+0000) 2024-03-04T09:27:42.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:42 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:42.226+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:01.960225+0000 front 2024-03-04T09:27:01.960271+0000 (oldest deadline 2024-03-04T09:27:27.260135+0000) 2024-03-04T09:27:42.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:42 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:42.226+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:13.061584+0000 front 2024-03-04T09:27:13.061603+0000 (oldest deadline 2024-03-04T09:27:34.161481+0000) 2024-03-04T09:27:43.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:42 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:42.779+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:46.763438+0000 front 2024-03-04T09:26:46.763484+0000 (oldest deadline 2024-03-04T09:27:10.263514+0000) 2024-03-04T09:27:43.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:42 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:42.779+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.065154+0000 front 2024-03-04T09:26:56.065278+0000 (oldest deadline 2024-03-04T09:27:17.765282+0000) 2024-03-04T09:27:43.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:42 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:42.779+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:02.466239+0000 front 2024-03-04T09:27:02.466314+0000 (oldest deadline 2024-03-04T09:27:27.766338+0000) 2024-03-04T09:27:43.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:42 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:42.779+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:10.067296+0000 front 2024-03-04T09:27:10.067271+0000 (oldest deadline 2024-03-04T09:27:34.767410+0000) 2024-03-04T09:27:43.068 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:42 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:42.779+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:19.369079+0000 front 2024-03-04T09:27:19.369094+0000 (oldest deadline 2024-03-04T09:27:41.668724+0000) 2024-03-04T09:27:43.179 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:42 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:42.799+0000 7f8d11047700 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:54.939746+0000 front 2024-03-04T09:26:54.939716+0000 (oldest deadline 2024-03-04T09:27:20.839902+0000) 2024-03-04T09:27:43.179 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:42 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:42.799+0000 7f8d11047700 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:00.840348+0000 front 2024-03-04T09:27:00.840309+0000 (oldest deadline 2024-03-04T09:27:28.440998+0000) 2024-03-04T09:27:43.180 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:42 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:42.799+0000 7f8d11047700 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:11.942095+0000 front 2024-03-04T09:27:11.942132+0000 (oldest deadline 2024-03-04T09:27:36.642161+0000) 2024-03-04T09:27:43.373 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:42 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:42.934+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.432694+0000 front 2024-03-04T09:26:56.432842+0000 (oldest deadline 2024-03-04T09:27:18.732822+0000) 2024-03-04T09:27:43.373 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:42 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:42.934+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:03.135303+0000 front 2024-03-04T09:27:03.135534+0000 (oldest deadline 2024-03-04T09:27:26.635408+0000) 2024-03-04T09:27:43.373 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:42 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:42.934+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:12.437091+0000 front 2024-03-04T09:27:12.437166+0000 (oldest deadline 2024-03-04T09:27:34.737044+0000) 2024-03-04T09:27:43.373 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:42 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:42.934+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:18.738708+0000 front 2024-03-04T09:27:18.738678+0000 (oldest deadline 2024-03-04T09:27:42.238556+0000) 2024-03-04T09:27:43.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:43 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:43.375+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:27:43.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:43 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:43.375+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:57.035521+0000 front 2024-03-04T09:26:57.035337+0000 (oldest deadline 2024-03-04T09:27:21.735439+0000) 2024-03-04T09:27:43.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:43 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:43.375+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:04.036279+0000 front 2024-03-04T09:27:04.036372+0000 (oldest deadline 2024-03-04T09:27:25.736393+0000) 2024-03-04T09:27:43.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:43 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:43.375+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:17.438406+0000 front 2024-03-04T09:27:17.438387+0000 (oldest deadline 2024-03-04T09:27:42.138476+0000) 2024-03-04T09:27:43.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:43 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:43.267+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:27:43.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:43 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:43.267+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.858704+0000 front 2024-03-04T09:26:56.858604+0000 (oldest deadline 2024-03-04T09:27:18.459284+0000) 2024-03-04T09:27:43.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:43 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:43.267+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:01.960225+0000 front 2024-03-04T09:27:01.960271+0000 (oldest deadline 2024-03-04T09:27:27.260135+0000) 2024-03-04T09:27:43.680 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:43 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:43.267+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:13.061584+0000 front 2024-03-04T09:27:13.061603+0000 (oldest deadline 2024-03-04T09:27:34.161481+0000) 2024-03-04T09:27:44.179 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:43 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:43.799+0000 7f8d11047700 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:54.939746+0000 front 2024-03-04T09:26:54.939716+0000 (oldest deadline 2024-03-04T09:27:20.839902+0000) 2024-03-04T09:27:44.179 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:43 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:43.799+0000 7f8d11047700 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:00.840348+0000 front 2024-03-04T09:27:00.840309+0000 (oldest deadline 2024-03-04T09:27:28.440998+0000) 2024-03-04T09:27:44.179 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:43 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:43.799+0000 7f8d11047700 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:11.942095+0000 front 2024-03-04T09:27:11.942132+0000 (oldest deadline 2024-03-04T09:27:36.642161+0000) 2024-03-04T09:27:44.317 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:43 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:43.828+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:46.763438+0000 front 2024-03-04T09:26:46.763484+0000 (oldest deadline 2024-03-04T09:27:10.263514+0000) 2024-03-04T09:27:44.317 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:43 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:43.828+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.065154+0000 front 2024-03-04T09:26:56.065278+0000 (oldest deadline 2024-03-04T09:27:17.765282+0000) 2024-03-04T09:27:44.317 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:43 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:43.828+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:02.466239+0000 front 2024-03-04T09:27:02.466314+0000 (oldest deadline 2024-03-04T09:27:27.766338+0000) 2024-03-04T09:27:44.317 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:43 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:43.828+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:10.067296+0000 front 2024-03-04T09:27:10.067271+0000 (oldest deadline 2024-03-04T09:27:34.767410+0000) 2024-03-04T09:27:44.317 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:43 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:43.828+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:19.369079+0000 front 2024-03-04T09:27:19.369094+0000 (oldest deadline 2024-03-04T09:27:41.668724+0000) 2024-03-04T09:27:44.330 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:43 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:43.925+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.432694+0000 front 2024-03-04T09:26:56.432842+0000 (oldest deadline 2024-03-04T09:27:18.732822+0000) 2024-03-04T09:27:44.330 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:43 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:43.925+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:03.135303+0000 front 2024-03-04T09:27:03.135534+0000 (oldest deadline 2024-03-04T09:27:26.635408+0000) 2024-03-04T09:27:44.330 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:43 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:43.925+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:12.437091+0000 front 2024-03-04T09:27:12.437166+0000 (oldest deadline 2024-03-04T09:27:34.737044+0000) 2024-03-04T09:27:44.330 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:43 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:43.925+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:18.738708+0000 front 2024-03-04T09:27:18.738678+0000 (oldest deadline 2024-03-04T09:27:42.238556+0000) 2024-03-04T09:27:44.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:44 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:44.333+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:27:44.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:44 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:44.333+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:57.035521+0000 front 2024-03-04T09:26:57.035337+0000 (oldest deadline 2024-03-04T09:27:21.735439+0000) 2024-03-04T09:27:44.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:44 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:44.333+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:04.036279+0000 front 2024-03-04T09:27:04.036372+0000 (oldest deadline 2024-03-04T09:27:25.736393+0000) 2024-03-04T09:27:44.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:44 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:44.333+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:17.438406+0000 front 2024-03-04T09:27:17.438387+0000 (oldest deadline 2024-03-04T09:27:42.138476+0000) 2024-03-04T09:27:44.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:44 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:44.262+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:27:44.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:44 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:44.262+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.858704+0000 front 2024-03-04T09:26:56.858604+0000 (oldest deadline 2024-03-04T09:27:18.459284+0000) 2024-03-04T09:27:44.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:44 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:44.262+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:01.960225+0000 front 2024-03-04T09:27:01.960271+0000 (oldest deadline 2024-03-04T09:27:27.260135+0000) 2024-03-04T09:27:44.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:44 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:44.262+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:13.061584+0000 front 2024-03-04T09:27:13.061603+0000 (oldest deadline 2024-03-04T09:27:34.161481+0000) 2024-03-04T09:27:45.179 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:44 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:44.835+0000 7f8d11047700 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:54.939746+0000 front 2024-03-04T09:26:54.939716+0000 (oldest deadline 2024-03-04T09:27:20.839902+0000) 2024-03-04T09:27:45.179 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:44 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:44.835+0000 7f8d11047700 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:00.840348+0000 front 2024-03-04T09:27:00.840309+0000 (oldest deadline 2024-03-04T09:27:28.440998+0000) 2024-03-04T09:27:45.180 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:44 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:44.835+0000 7f8d11047700 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:11.942095+0000 front 2024-03-04T09:27:11.942132+0000 (oldest deadline 2024-03-04T09:27:36.642161+0000) 2024-03-04T09:27:45.180 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:44 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7[54133]: 2024-03-04T09:27:44.835+0000 7f8d11047700 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:20.143130+0000 front 2024-03-04T09:27:20.143203+0000 (oldest deadline 2024-03-04T09:27:44.243233+0000) 2024-03-04T09:27:45.317 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:44 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:44.863+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:46.763438+0000 front 2024-03-04T09:26:46.763484+0000 (oldest deadline 2024-03-04T09:27:10.263514+0000) 2024-03-04T09:27:45.317 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:44 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:44.863+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.065154+0000 front 2024-03-04T09:26:56.065278+0000 (oldest deadline 2024-03-04T09:27:17.765282+0000) 2024-03-04T09:27:45.317 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:44 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:44.863+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:02.466239+0000 front 2024-03-04T09:27:02.466314+0000 (oldest deadline 2024-03-04T09:27:27.766338+0000) 2024-03-04T09:27:45.317 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:44 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:44.863+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:10.067296+0000 front 2024-03-04T09:27:10.067271+0000 (oldest deadline 2024-03-04T09:27:34.767410+0000) 2024-03-04T09:27:45.318 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:44 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:44.863+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:19.369079+0000 front 2024-03-04T09:27:19.369094+0000 (oldest deadline 2024-03-04T09:27:41.668724+0000) 2024-03-04T09:27:45.366 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:44 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:44.973+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.432694+0000 front 2024-03-04T09:26:56.432842+0000 (oldest deadline 2024-03-04T09:27:18.732822+0000) 2024-03-04T09:27:45.366 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:44 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:44.973+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:03.135303+0000 front 2024-03-04T09:27:03.135534+0000 (oldest deadline 2024-03-04T09:27:26.635408+0000) 2024-03-04T09:27:45.366 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:44 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:44.973+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:12.437091+0000 front 2024-03-04T09:27:12.437166+0000 (oldest deadline 2024-03-04T09:27:34.737044+0000) 2024-03-04T09:27:45.366 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:44 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:44.973+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:18.738708+0000 front 2024-03-04T09:27:18.738678+0000 (oldest deadline 2024-03-04T09:27:42.238556+0000) 2024-03-04T09:27:45.544 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:45 smithi102 podman[72196]: 2024-03-04 09:27:45.300017981 +0000 UTC m=+5.527815855 container died dfdb679ed8838e5221ae41c1d279eda91f1aa5451b5ce67b0d55f9b06c197cd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-lusov-qdb-1bc250c, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-03-04T09:27:45.544 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:45 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:45.272+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:27:45.544 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:45 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:45.272+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.858704+0000 front 2024-03-04T09:26:56.858604+0000 (oldest deadline 2024-03-04T09:27:18.459284+0000) 2024-03-04T09:27:45.544 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:45 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:45.272+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:01.960225+0000 front 2024-03-04T09:27:01.960271+0000 (oldest deadline 2024-03-04T09:27:27.260135+0000) 2024-03-04T09:27:45.545 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:45 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:45.272+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:13.061584+0000 front 2024-03-04T09:27:13.061603+0000 (oldest deadline 2024-03-04T09:27:34.161481+0000) 2024-03-04T09:27:45.545 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:45 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:45.272+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:21.162580+0000 front 2024-03-04T09:27:21.162631+0000 (oldest deadline 2024-03-04T09:27:44.662746+0000) 2024-03-04T09:27:45.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:45 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:45.369+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:27:45.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:45 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:45.369+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:57.035521+0000 front 2024-03-04T09:26:57.035337+0000 (oldest deadline 2024-03-04T09:27:21.735439+0000) 2024-03-04T09:27:45.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:45 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:45.369+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:04.036279+0000 front 2024-03-04T09:27:04.036372+0000 (oldest deadline 2024-03-04T09:27:25.736393+0000) 2024-03-04T09:27:45.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:45 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:45.369+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:17.438406+0000 front 2024-03-04T09:27:17.438387+0000 (oldest deadline 2024-03-04T09:27:42.138476+0000) 2024-03-04T09:27:45.843 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:45 smithi102 podman[72196]: 2024-03-04 09:27:45.63774771 +0000 UTC m=+5.865545591 container cleanup dfdb679ed8838e5221ae41c1d279eda91f1aa5451b5ce67b0d55f9b06c197cd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-qdb-1bc250c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, io.buildah.version=1.33.5) 2024-03-04T09:27:45.843 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:45 smithi102 bash[72196]: ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7 2024-03-04T09:27:46.179 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:45 smithi102 podman[72213]: 2024-03-04 09:27:45.847288416 +0000 UTC m=+0.547807598 container remove dfdb679ed8838e5221ae41c1d279eda91f1aa5451b5ce67b0d55f9b06c197cd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-04T09:27:46.317 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:45 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:45.828+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:46.763438+0000 front 2024-03-04T09:26:46.763484+0000 (oldest deadline 2024-03-04T09:27:10.263514+0000) 2024-03-04T09:27:46.317 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:45 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:45.828+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.065154+0000 front 2024-03-04T09:26:56.065278+0000 (oldest deadline 2024-03-04T09:27:17.765282+0000) 2024-03-04T09:27:46.317 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:45 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:45.828+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:02.466239+0000 front 2024-03-04T09:27:02.466314+0000 (oldest deadline 2024-03-04T09:27:27.766338+0000) 2024-03-04T09:27:46.317 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:45 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:45.828+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:10.067296+0000 front 2024-03-04T09:27:10.067271+0000 (oldest deadline 2024-03-04T09:27:34.767410+0000) 2024-03-04T09:27:46.317 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:45 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:45.828+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:19.369079+0000 front 2024-03-04T09:27:19.369094+0000 (oldest deadline 2024-03-04T09:27:41.668724+0000) 2024-03-04T09:27:46.414 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:45 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:45.940+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.432694+0000 front 2024-03-04T09:26:56.432842+0000 (oldest deadline 2024-03-04T09:27:18.732822+0000) 2024-03-04T09:27:46.414 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:45 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:45.940+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:03.135303+0000 front 2024-03-04T09:27:03.135534+0000 (oldest deadline 2024-03-04T09:27:26.635408+0000) 2024-03-04T09:27:46.414 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:45 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:45.940+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:12.437091+0000 front 2024-03-04T09:27:12.437166+0000 (oldest deadline 2024-03-04T09:27:34.737044+0000) 2024-03-04T09:27:46.414 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:45 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:45.940+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:18.738708+0000 front 2024-03-04T09:27:18.738678+0000 (oldest deadline 2024-03-04T09:27:42.238556+0000) 2024-03-04T09:27:46.555 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:46 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:46.320+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:27:46.555 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:46 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:46.320+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.858704+0000 front 2024-03-04T09:26:56.858604+0000 (oldest deadline 2024-03-04T09:27:18.459284+0000) 2024-03-04T09:27:46.555 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:46 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:46.320+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:01.960225+0000 front 2024-03-04T09:27:01.960271+0000 (oldest deadline 2024-03-04T09:27:27.260135+0000) 2024-03-04T09:27:46.555 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:46 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:46.320+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:13.061584+0000 front 2024-03-04T09:27:13.061603+0000 (oldest deadline 2024-03-04T09:27:34.161481+0000) 2024-03-04T09:27:46.555 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:46 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:46.320+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:21.162580+0000 front 2024-03-04T09:27:21.162631+0000 (oldest deadline 2024-03-04T09:27:44.662746+0000) 2024-03-04T09:27:46.555 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:46 smithi102 podman[72306]: 2024-03-04 09:27:46.148653128 +0000 UTC m=+0.017901064 image pull f88ffb32aa6a7d5dfdc954d9f096f0c9cc47981d05ec8d117ba859a22d8185ba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5 2024-03-04T09:27:46.555 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:46 smithi102 podman[72306]: 2024-03-04 09:27:46.248112715 +0000 UTC m=+0.117360638 container create cc7d6199349e98de723ff7d0b797bd37794e9a1cf39d743e532fea3ed821bd77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-qdb-1bc250c, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222) 2024-03-04T09:27:46.555 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:46 smithi102 podman[72306]: 2024-03-04 09:27:46.480942721 +0000 UTC m=+0.350190644 container init cc7d6199349e98de723ff7d0b797bd37794e9a1cf39d743e532fea3ed821bd77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7-deactivate, RELEASE=wip-lusov-qdb-1bc250c, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux ) 2024-03-04T09:27:46.555 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:46 smithi102 podman[72306]: 2024-03-04 09:27:46.484703812 +0000 UTC m=+0.353951738 container start cc7d6199349e98de723ff7d0b797bd37794e9a1cf39d743e532fea3ed821bd77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, RELEASE=wip-lusov-qdb-1bc250c) 2024-03-04T09:27:46.556 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:46 smithi102 podman[72306]: 2024-03-04 09:27:46.558853785 +0000 UTC m=+0.428101721 container attach cc7d6199349e98de723ff7d0b797bd37794e9a1cf39d743e532fea3ed821bd77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7-deactivate, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-qdb-1bc250c, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD) 2024-03-04T09:27:46.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:46 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:46.417+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:27:46.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:46 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:46.417+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:57.035521+0000 front 2024-03-04T09:26:57.035337+0000 (oldest deadline 2024-03-04T09:27:21.735439+0000) 2024-03-04T09:27:46.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:46 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:46.417+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:04.036279+0000 front 2024-03-04T09:27:04.036372+0000 (oldest deadline 2024-03-04T09:27:25.736393+0000) 2024-03-04T09:27:46.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:46 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:46.417+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:17.438406+0000 front 2024-03-04T09:27:17.438387+0000 (oldest deadline 2024-03-04T09:27:42.138476+0000) 2024-03-04T09:27:46.929 INFO:journalctl@ceph.osd.7.smithi102.stdout:Mar 04 09:27:46 smithi102 podman[72306]: 2024-03-04 09:27:46.776042362 +0000 UTC m=+0.645290286 container died cc7d6199349e98de723ff7d0b797bd37794e9a1cf39d743e532fea3ed821bd77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-7-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, io.buildah.version=1.33.5, RELEASE=wip-lusov-qdb-1bc250c) 2024-03-04T09:27:47.317 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:46 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:46.862+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:46.763438+0000 front 2024-03-04T09:26:46.763484+0000 (oldest deadline 2024-03-04T09:27:10.263514+0000) 2024-03-04T09:27:47.317 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:46 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:46.862+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.065154+0000 front 2024-03-04T09:26:56.065278+0000 (oldest deadline 2024-03-04T09:27:17.765282+0000) 2024-03-04T09:27:47.317 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:46 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:46.862+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:02.466239+0000 front 2024-03-04T09:27:02.466314+0000 (oldest deadline 2024-03-04T09:27:27.766338+0000) 2024-03-04T09:27:47.317 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:46 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:46.862+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:10.067296+0000 front 2024-03-04T09:27:10.067271+0000 (oldest deadline 2024-03-04T09:27:34.767410+0000) 2024-03-04T09:27:47.317 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:46 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:46.862+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:19.369079+0000 front 2024-03-04T09:27:19.369094+0000 (oldest deadline 2024-03-04T09:27:41.668724+0000) 2024-03-04T09:27:47.331 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@osd.7.service' 2024-03-04T09:27:47.414 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-04T09:27:47.415 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-03-04T09:27:47.415 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-03-04T09:27:47.415 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ceph-2e533fc8-da06-11ee-95c6-87774f69a715@osd.8 2024-03-04T09:27:47.421 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:46 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:46.963+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.432694+0000 front 2024-03-04T09:26:56.432842+0000 (oldest deadline 2024-03-04T09:27:18.732822+0000) 2024-03-04T09:27:47.421 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:46 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:46.963+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:03.135303+0000 front 2024-03-04T09:27:03.135534+0000 (oldest deadline 2024-03-04T09:27:26.635408+0000) 2024-03-04T09:27:47.421 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:46 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:46.963+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:12.437091+0000 front 2024-03-04T09:27:12.437166+0000 (oldest deadline 2024-03-04T09:27:34.737044+0000) 2024-03-04T09:27:47.421 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:46 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:46.963+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:18.738708+0000 front 2024-03-04T09:27:18.738678+0000 (oldest deadline 2024-03-04T09:27:42.238556+0000) 2024-03-04T09:27:47.587 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:47 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:47.370+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:27:47.587 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:47 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:47.370+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.858704+0000 front 2024-03-04T09:26:56.858604+0000 (oldest deadline 2024-03-04T09:27:18.459284+0000) 2024-03-04T09:27:47.587 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:47 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:47.370+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:01.960225+0000 front 2024-03-04T09:27:01.960271+0000 (oldest deadline 2024-03-04T09:27:27.260135+0000) 2024-03-04T09:27:47.587 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:47 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:47.370+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:13.061584+0000 front 2024-03-04T09:27:13.061603+0000 (oldest deadline 2024-03-04T09:27:34.161481+0000) 2024-03-04T09:27:47.588 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:47 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:47.370+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:21.162580+0000 front 2024-03-04T09:27:21.162631+0000 (oldest deadline 2024-03-04T09:27:44.662746+0000) 2024-03-04T09:27:47.738 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:47 smithi190 systemd[1]: Stopping Ceph osd.8 for 2e533fc8-da06-11ee-95c6-87774f69a715... 2024-03-04T09:27:47.738 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:47 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:47.428+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:27:47.738 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:47 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:47.428+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:57.035521+0000 front 2024-03-04T09:26:57.035337+0000 (oldest deadline 2024-03-04T09:27:21.735439+0000) 2024-03-04T09:27:47.738 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:47 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:47.428+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:04.036279+0000 front 2024-03-04T09:27:04.036372+0000 (oldest deadline 2024-03-04T09:27:25.736393+0000) 2024-03-04T09:27:47.738 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:47 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:47.428+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:17.438406+0000 front 2024-03-04T09:27:17.438387+0000 (oldest deadline 2024-03-04T09:27:42.138476+0000) 2024-03-04T09:27:48.171 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:47 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:47.740+0000 7f30d7807700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T09:27:48.171 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:47 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:47.740+0000 7f30d7807700 -1 osd.8 110 *** Got signal Terminated *** 2024-03-04T09:27:48.171 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:47 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:47.740+0000 7f30d7807700 -1 osd.8 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-04T09:27:48.171 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:47 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:47.973+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.432694+0000 front 2024-03-04T09:26:56.432842+0000 (oldest deadline 2024-03-04T09:27:18.732822+0000) 2024-03-04T09:27:48.171 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:47 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:47.973+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:03.135303+0000 front 2024-03-04T09:27:03.135534+0000 (oldest deadline 2024-03-04T09:27:26.635408+0000) 2024-03-04T09:27:48.172 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:47 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:47.973+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:12.437091+0000 front 2024-03-04T09:27:12.437166+0000 (oldest deadline 2024-03-04T09:27:34.737044+0000) 2024-03-04T09:27:48.172 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:47 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:47.973+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:18.738708+0000 front 2024-03-04T09:27:18.738678+0000 (oldest deadline 2024-03-04T09:27:42.238556+0000) 2024-03-04T09:27:48.317 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:47 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:47.827+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:46.763438+0000 front 2024-03-04T09:26:46.763484+0000 (oldest deadline 2024-03-04T09:27:10.263514+0000) 2024-03-04T09:27:48.317 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:47 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:47.827+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.065154+0000 front 2024-03-04T09:26:56.065278+0000 (oldest deadline 2024-03-04T09:27:17.765282+0000) 2024-03-04T09:27:48.317 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:47 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:47.827+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:02.466239+0000 front 2024-03-04T09:27:02.466314+0000 (oldest deadline 2024-03-04T09:27:27.766338+0000) 2024-03-04T09:27:48.317 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:47 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:47.827+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:10.067296+0000 front 2024-03-04T09:27:10.067271+0000 (oldest deadline 2024-03-04T09:27:34.767410+0000) 2024-03-04T09:27:48.317 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:47 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:47.827+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:19.369079+0000 front 2024-03-04T09:27:19.369094+0000 (oldest deadline 2024-03-04T09:27:41.668724+0000) 2024-03-04T09:27:48.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:48 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:48.418+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:27:48.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:48 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:48.418+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:57.035521+0000 front 2024-03-04T09:26:57.035337+0000 (oldest deadline 2024-03-04T09:27:21.735439+0000) 2024-03-04T09:27:48.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:48 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:48.418+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:04.036279+0000 front 2024-03-04T09:27:04.036372+0000 (oldest deadline 2024-03-04T09:27:25.736393+0000) 2024-03-04T09:27:48.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:48 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:48.418+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:17.438406+0000 front 2024-03-04T09:27:17.438387+0000 (oldest deadline 2024-03-04T09:27:42.138476+0000) 2024-03-04T09:27:48.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:48 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:48.415+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:27:48.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:48 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:48.415+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.858704+0000 front 2024-03-04T09:26:56.858604+0000 (oldest deadline 2024-03-04T09:27:18.459284+0000) 2024-03-04T09:27:48.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:48 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:48.415+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:01.960225+0000 front 2024-03-04T09:27:01.960271+0000 (oldest deadline 2024-03-04T09:27:27.260135+0000) 2024-03-04T09:27:48.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:48 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:48.415+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:13.061584+0000 front 2024-03-04T09:27:13.061603+0000 (oldest deadline 2024-03-04T09:27:34.161481+0000) 2024-03-04T09:27:48.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:48 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:48.415+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:21.162580+0000 front 2024-03-04T09:27:21.162631+0000 (oldest deadline 2024-03-04T09:27:44.662746+0000) 2024-03-04T09:27:49.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:48 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:48.819+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:46.763438+0000 front 2024-03-04T09:26:46.763484+0000 (oldest deadline 2024-03-04T09:27:10.263514+0000) 2024-03-04T09:27:49.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:48 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:48.819+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.065154+0000 front 2024-03-04T09:26:56.065278+0000 (oldest deadline 2024-03-04T09:27:17.765282+0000) 2024-03-04T09:27:49.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:48 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:48.819+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:02.466239+0000 front 2024-03-04T09:27:02.466314+0000 (oldest deadline 2024-03-04T09:27:27.766338+0000) 2024-03-04T09:27:49.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:48 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:48.819+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:10.067296+0000 front 2024-03-04T09:27:10.067271+0000 (oldest deadline 2024-03-04T09:27:34.767410+0000) 2024-03-04T09:27:49.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:48 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:48.819+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:19.369079+0000 front 2024-03-04T09:27:19.369094+0000 (oldest deadline 2024-03-04T09:27:41.668724+0000) 2024-03-04T09:27:49.415 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:48 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:48.955+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.432694+0000 front 2024-03-04T09:26:56.432842+0000 (oldest deadline 2024-03-04T09:27:18.732822+0000) 2024-03-04T09:27:49.415 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:48 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:48.955+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:03.135303+0000 front 2024-03-04T09:27:03.135534+0000 (oldest deadline 2024-03-04T09:27:26.635408+0000) 2024-03-04T09:27:49.415 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:48 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:48.955+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:12.437091+0000 front 2024-03-04T09:27:12.437166+0000 (oldest deadline 2024-03-04T09:27:34.737044+0000) 2024-03-04T09:27:49.416 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:48 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:48.955+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:18.738708+0000 front 2024-03-04T09:27:18.738678+0000 (oldest deadline 2024-03-04T09:27:42.238556+0000) 2024-03-04T09:27:49.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:49 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:49.418+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:27:49.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:49 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:49.418+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:57.035521+0000 front 2024-03-04T09:26:57.035337+0000 (oldest deadline 2024-03-04T09:27:21.735439+0000) 2024-03-04T09:27:49.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:49 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:49.418+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:04.036279+0000 front 2024-03-04T09:27:04.036372+0000 (oldest deadline 2024-03-04T09:27:25.736393+0000) 2024-03-04T09:27:49.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:49 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:49.418+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:17.438406+0000 front 2024-03-04T09:27:17.438387+0000 (oldest deadline 2024-03-04T09:27:42.138476+0000) 2024-03-04T09:27:49.929 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:49 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:49.465+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:27:49.930 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:49 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:49.465+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.858704+0000 front 2024-03-04T09:26:56.858604+0000 (oldest deadline 2024-03-04T09:27:18.459284+0000) 2024-03-04T09:27:49.930 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:49 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:49.465+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:01.960225+0000 front 2024-03-04T09:27:01.960271+0000 (oldest deadline 2024-03-04T09:27:27.260135+0000) 2024-03-04T09:27:49.930 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:49 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:49.465+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:13.061584+0000 front 2024-03-04T09:27:13.061603+0000 (oldest deadline 2024-03-04T09:27:34.161481+0000) 2024-03-04T09:27:49.930 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:49 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:49.465+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:21.162580+0000 front 2024-03-04T09:27:21.162631+0000 (oldest deadline 2024-03-04T09:27:44.662746+0000) 2024-03-04T09:27:50.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:49 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:49.780+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:46.763438+0000 front 2024-03-04T09:26:46.763484+0000 (oldest deadline 2024-03-04T09:27:10.263514+0000) 2024-03-04T09:27:50.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:49 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:49.780+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.065154+0000 front 2024-03-04T09:26:56.065278+0000 (oldest deadline 2024-03-04T09:27:17.765282+0000) 2024-03-04T09:27:50.068 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:49 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:49.780+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:02.466239+0000 front 2024-03-04T09:27:02.466314+0000 (oldest deadline 2024-03-04T09:27:27.766338+0000) 2024-03-04T09:27:50.068 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:49 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:49.780+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:10.067296+0000 front 2024-03-04T09:27:10.067271+0000 (oldest deadline 2024-03-04T09:27:34.767410+0000) 2024-03-04T09:27:50.068 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:49 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:49.780+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:19.369079+0000 front 2024-03-04T09:27:19.369094+0000 (oldest deadline 2024-03-04T09:27:41.668724+0000) 2024-03-04T09:27:50.401 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:49 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:49.924+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.432694+0000 front 2024-03-04T09:26:56.432842+0000 (oldest deadline 2024-03-04T09:27:18.732822+0000) 2024-03-04T09:27:50.401 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:49 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:49.924+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:03.135303+0000 front 2024-03-04T09:27:03.135534+0000 (oldest deadline 2024-03-04T09:27:26.635408+0000) 2024-03-04T09:27:50.401 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:49 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:49.924+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:12.437091+0000 front 2024-03-04T09:27:12.437166+0000 (oldest deadline 2024-03-04T09:27:34.737044+0000) 2024-03-04T09:27:50.401 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:49 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:49.924+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:18.738708+0000 front 2024-03-04T09:27:18.738678+0000 (oldest deadline 2024-03-04T09:27:42.238556+0000) 2024-03-04T09:27:50.402 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:49 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:49.924+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:26.839726+0000 front 2024-03-04T09:27:26.840056+0000 (oldest deadline 2024-03-04T09:27:49.739891+0000) 2024-03-04T09:27:50.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:50 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:50.403+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:27:50.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:50 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:50.403+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:57.035521+0000 front 2024-03-04T09:26:57.035337+0000 (oldest deadline 2024-03-04T09:27:21.735439+0000) 2024-03-04T09:27:50.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:50 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:50.403+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:04.036279+0000 front 2024-03-04T09:27:04.036372+0000 (oldest deadline 2024-03-04T09:27:25.736393+0000) 2024-03-04T09:27:50.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:50 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:50.403+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:17.438406+0000 front 2024-03-04T09:27:17.438387+0000 (oldest deadline 2024-03-04T09:27:42.138476+0000) 2024-03-04T09:27:50.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:50 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:50.403+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:26.839388+0000 front 2024-03-04T09:27:26.839426+0000 (oldest deadline 2024-03-04T09:27:50.339500+0000) 2024-03-04T09:27:50.929 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:50 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:50.461+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:27:50.930 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:50 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:50.461+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.858704+0000 front 2024-03-04T09:26:56.858604+0000 (oldest deadline 2024-03-04T09:27:18.459284+0000) 2024-03-04T09:27:50.930 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:50 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:50.461+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:01.960225+0000 front 2024-03-04T09:27:01.960271+0000 (oldest deadline 2024-03-04T09:27:27.260135+0000) 2024-03-04T09:27:50.930 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:50 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:50.461+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:13.061584+0000 front 2024-03-04T09:27:13.061603+0000 (oldest deadline 2024-03-04T09:27:34.161481+0000) 2024-03-04T09:27:50.930 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:50 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:50.461+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:21.162580+0000 front 2024-03-04T09:27:21.162631+0000 (oldest deadline 2024-03-04T09:27:44.662746+0000) 2024-03-04T09:27:51.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:50 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:50.732+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:46.763438+0000 front 2024-03-04T09:26:46.763484+0000 (oldest deadline 2024-03-04T09:27:10.263514+0000) 2024-03-04T09:27:51.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:50 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:50.732+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.065154+0000 front 2024-03-04T09:26:56.065278+0000 (oldest deadline 2024-03-04T09:27:17.765282+0000) 2024-03-04T09:27:51.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:50 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:50.732+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:02.466239+0000 front 2024-03-04T09:27:02.466314+0000 (oldest deadline 2024-03-04T09:27:27.766338+0000) 2024-03-04T09:27:51.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:50 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:50.732+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:10.067296+0000 front 2024-03-04T09:27:10.067271+0000 (oldest deadline 2024-03-04T09:27:34.767410+0000) 2024-03-04T09:27:51.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:50 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:50.732+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:19.369079+0000 front 2024-03-04T09:27:19.369094+0000 (oldest deadline 2024-03-04T09:27:41.668724+0000) 2024-03-04T09:27:51.171 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:50 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:50.876+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.432694+0000 front 2024-03-04T09:26:56.432842+0000 (oldest deadline 2024-03-04T09:27:18.732822+0000) 2024-03-04T09:27:51.172 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:50 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:50.876+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:03.135303+0000 front 2024-03-04T09:27:03.135534+0000 (oldest deadline 2024-03-04T09:27:26.635408+0000) 2024-03-04T09:27:51.172 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:50 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:50.876+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:12.437091+0000 front 2024-03-04T09:27:12.437166+0000 (oldest deadline 2024-03-04T09:27:34.737044+0000) 2024-03-04T09:27:51.172 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:50 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:50.876+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:18.738708+0000 front 2024-03-04T09:27:18.738678+0000 (oldest deadline 2024-03-04T09:27:42.238556+0000) 2024-03-04T09:27:51.172 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:50 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:50.876+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:26.839726+0000 front 2024-03-04T09:27:26.840056+0000 (oldest deadline 2024-03-04T09:27:49.739891+0000) 2024-03-04T09:27:51.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:51 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:51.360+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:27:51.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:51 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:51.360+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:57.035521+0000 front 2024-03-04T09:26:57.035337+0000 (oldest deadline 2024-03-04T09:27:21.735439+0000) 2024-03-04T09:27:51.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:51 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:51.360+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:04.036279+0000 front 2024-03-04T09:27:04.036372+0000 (oldest deadline 2024-03-04T09:27:25.736393+0000) 2024-03-04T09:27:51.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:51 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:51.360+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:17.438406+0000 front 2024-03-04T09:27:17.438387+0000 (oldest deadline 2024-03-04T09:27:42.138476+0000) 2024-03-04T09:27:51.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:51 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:51.360+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:26.839388+0000 front 2024-03-04T09:27:26.839426+0000 (oldest deadline 2024-03-04T09:27:50.339500+0000) 2024-03-04T09:27:51.929 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:51 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:51.476+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:27:51.929 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:51 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:51.476+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.858704+0000 front 2024-03-04T09:26:56.858604+0000 (oldest deadline 2024-03-04T09:27:18.459284+0000) 2024-03-04T09:27:51.930 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:51 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:51.476+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:01.960225+0000 front 2024-03-04T09:27:01.960271+0000 (oldest deadline 2024-03-04T09:27:27.260135+0000) 2024-03-04T09:27:51.930 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:51 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:51.476+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:13.061584+0000 front 2024-03-04T09:27:13.061603+0000 (oldest deadline 2024-03-04T09:27:34.161481+0000) 2024-03-04T09:27:51.930 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:51 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:51.476+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:21.162580+0000 front 2024-03-04T09:27:21.162631+0000 (oldest deadline 2024-03-04T09:27:44.662746+0000) 2024-03-04T09:27:51.930 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:51 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:51.476+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:27.464544+0000 front 2024-03-04T09:27:27.464495+0000 (oldest deadline 2024-03-04T09:27:50.964281+0000) 2024-03-04T09:27:52.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:51 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:51.772+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:46.763438+0000 front 2024-03-04T09:26:46.763484+0000 (oldest deadline 2024-03-04T09:27:10.263514+0000) 2024-03-04T09:27:52.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:51 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:51.772+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.065154+0000 front 2024-03-04T09:26:56.065278+0000 (oldest deadline 2024-03-04T09:27:17.765282+0000) 2024-03-04T09:27:52.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:51 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:51.772+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:02.466239+0000 front 2024-03-04T09:27:02.466314+0000 (oldest deadline 2024-03-04T09:27:27.766338+0000) 2024-03-04T09:27:52.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:51 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:51.772+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:10.067296+0000 front 2024-03-04T09:27:10.067271+0000 (oldest deadline 2024-03-04T09:27:34.767410+0000) 2024-03-04T09:27:52.068 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:51 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:51.772+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:19.369079+0000 front 2024-03-04T09:27:19.369094+0000 (oldest deadline 2024-03-04T09:27:41.668724+0000) 2024-03-04T09:27:52.171 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:51 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:51.838+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.432694+0000 front 2024-03-04T09:26:56.432842+0000 (oldest deadline 2024-03-04T09:27:18.732822+0000) 2024-03-04T09:27:52.171 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:51 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:51.838+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:03.135303+0000 front 2024-03-04T09:27:03.135534+0000 (oldest deadline 2024-03-04T09:27:26.635408+0000) 2024-03-04T09:27:52.172 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:51 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:51.838+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:12.437091+0000 front 2024-03-04T09:27:12.437166+0000 (oldest deadline 2024-03-04T09:27:34.737044+0000) 2024-03-04T09:27:52.172 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:51 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:51.838+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:18.738708+0000 front 2024-03-04T09:27:18.738678+0000 (oldest deadline 2024-03-04T09:27:42.238556+0000) 2024-03-04T09:27:52.172 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:51 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8[54996]: 2024-03-04T09:27:51.838+0000 7f30cfdf3700 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:26.839726+0000 front 2024-03-04T09:27:26.840056+0000 (oldest deadline 2024-03-04T09:27:49.739891+0000) 2024-03-04T09:27:52.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:52 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:52.381+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:27:52.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:52 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:52.381+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:57.035521+0000 front 2024-03-04T09:26:57.035337+0000 (oldest deadline 2024-03-04T09:27:21.735439+0000) 2024-03-04T09:27:52.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:52 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:52.381+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:04.036279+0000 front 2024-03-04T09:27:04.036372+0000 (oldest deadline 2024-03-04T09:27:25.736393+0000) 2024-03-04T09:27:52.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:52 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:52.381+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:17.438406+0000 front 2024-03-04T09:27:17.438387+0000 (oldest deadline 2024-03-04T09:27:42.138476+0000) 2024-03-04T09:27:52.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:52 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:52.381+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:26.839388+0000 front 2024-03-04T09:27:26.839426+0000 (oldest deadline 2024-03-04T09:27:50.339500+0000) 2024-03-04T09:27:52.929 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:52 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:52.509+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:27:53.647 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:52 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:52.509+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.858704+0000 front 2024-03-04T09:26:56.858604+0000 (oldest deadline 2024-03-04T09:27:18.459284+0000) 2024-03-04T09:27:53.648 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:52 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:52.509+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:01.960225+0000 front 2024-03-04T09:27:01.960271+0000 (oldest deadline 2024-03-04T09:27:27.260135+0000) 2024-03-04T09:27:53.648 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:52 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:52.509+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:13.061584+0000 front 2024-03-04T09:27:13.061603+0000 (oldest deadline 2024-03-04T09:27:34.161481+0000) 2024-03-04T09:27:53.648 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:52 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:52.509+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:21.162580+0000 front 2024-03-04T09:27:21.162631+0000 (oldest deadline 2024-03-04T09:27:44.662746+0000) 2024-03-04T09:27:53.648 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:52 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:52.509+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:27.464544+0000 front 2024-03-04T09:27:27.464495+0000 (oldest deadline 2024-03-04T09:27:50.964281+0000) 2024-03-04T09:27:53.649 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:53 smithi190 podman[73665]: 2024-03-04 09:27:53.260993393 +0000 UTC m=+5.651303517 container died dba5cb37e82bc12f322dcc5b69b557ca005b83cbbb7ee92842362f3634084ad9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240222) 2024-03-04T09:27:53.649 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:52 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:52.818+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:46.763438+0000 front 2024-03-04T09:26:46.763484+0000 (oldest deadline 2024-03-04T09:27:10.263514+0000) 2024-03-04T09:27:53.649 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:52 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:52.818+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.065154+0000 front 2024-03-04T09:26:56.065278+0000 (oldest deadline 2024-03-04T09:27:17.765282+0000) 2024-03-04T09:27:53.649 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:52 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:52.818+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:02.466239+0000 front 2024-03-04T09:27:02.466314+0000 (oldest deadline 2024-03-04T09:27:27.766338+0000) 2024-03-04T09:27:53.649 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:52 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:52.818+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:10.067296+0000 front 2024-03-04T09:27:10.067271+0000 (oldest deadline 2024-03-04T09:27:34.767410+0000) 2024-03-04T09:27:53.649 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:52 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:52.818+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:19.369079+0000 front 2024-03-04T09:27:19.369094+0000 (oldest deadline 2024-03-04T09:27:41.668724+0000) 2024-03-04T09:27:53.649 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:52 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:52.818+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:28.670601+0000 front 2024-03-04T09:27:28.670681+0000 (oldest deadline 2024-03-04T09:27:52.170497+0000) 2024-03-04T09:27:53.649 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:53 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:53.333+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:27:53.650 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:53 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:53.333+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:57.035521+0000 front 2024-03-04T09:26:57.035337+0000 (oldest deadline 2024-03-04T09:27:21.735439+0000) 2024-03-04T09:27:53.650 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:53 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:53.333+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:04.036279+0000 front 2024-03-04T09:27:04.036372+0000 (oldest deadline 2024-03-04T09:27:25.736393+0000) 2024-03-04T09:27:53.650 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:53 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:53.333+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:17.438406+0000 front 2024-03-04T09:27:17.438387+0000 (oldest deadline 2024-03-04T09:27:42.138476+0000) 2024-03-04T09:27:53.650 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:53 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:53.333+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:26.839388+0000 front 2024-03-04T09:27:26.839426+0000 (oldest deadline 2024-03-04T09:27:50.339500+0000) 2024-03-04T09:27:53.913 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:53 smithi190 podman[73665]: 2024-03-04 09:27:53.632927721 +0000 UTC m=+6.023237848 container cleanup dba5cb37e82bc12f322dcc5b69b557ca005b83cbbb7ee92842362f3634084ad9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-qdb-1bc250c, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-03-04T09:27:53.914 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:53 smithi190 bash[73665]: ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8 2024-03-04T09:27:53.929 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:53 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:53.520+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:27:53.930 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:53 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:53.520+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.858704+0000 front 2024-03-04T09:26:56.858604+0000 (oldest deadline 2024-03-04T09:27:18.459284+0000) 2024-03-04T09:27:53.930 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:53 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:53.520+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:01.960225+0000 front 2024-03-04T09:27:01.960271+0000 (oldest deadline 2024-03-04T09:27:27.260135+0000) 2024-03-04T09:27:53.930 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:53 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:53.520+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:13.061584+0000 front 2024-03-04T09:27:13.061603+0000 (oldest deadline 2024-03-04T09:27:34.161481+0000) 2024-03-04T09:27:53.930 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:53 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:53.520+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:21.162580+0000 front 2024-03-04T09:27:21.162631+0000 (oldest deadline 2024-03-04T09:27:44.662746+0000) 2024-03-04T09:27:53.930 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:53 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:53.520+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:27.464544+0000 front 2024-03-04T09:27:27.464495+0000 (oldest deadline 2024-03-04T09:27:50.964281+0000) 2024-03-04T09:27:54.171 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:53 smithi190 podman[73682]: 2024-03-04 09:27:53.917271275 +0000 UTC m=+0.652627584 container remove dba5cb37e82bc12f322dcc5b69b557ca005b83cbbb7ee92842362f3634084ad9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, RELEASE=wip-lusov-qdb-1bc250c, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-03-04T09:27:54.317 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:53 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:53.846+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:46.763438+0000 front 2024-03-04T09:26:46.763484+0000 (oldest deadline 2024-03-04T09:27:10.263514+0000) 2024-03-04T09:27:54.317 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:53 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:53.846+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.065154+0000 front 2024-03-04T09:26:56.065278+0000 (oldest deadline 2024-03-04T09:27:17.765282+0000) 2024-03-04T09:27:54.317 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:53 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:53.846+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:02.466239+0000 front 2024-03-04T09:27:02.466314+0000 (oldest deadline 2024-03-04T09:27:27.766338+0000) 2024-03-04T09:27:54.317 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:53 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:53.846+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:10.067296+0000 front 2024-03-04T09:27:10.067271+0000 (oldest deadline 2024-03-04T09:27:34.767410+0000) 2024-03-04T09:27:54.317 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:53 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:53.846+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:19.369079+0000 front 2024-03-04T09:27:19.369094+0000 (oldest deadline 2024-03-04T09:27:41.668724+0000) 2024-03-04T09:27:54.317 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:53 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:53.846+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:28.670601+0000 front 2024-03-04T09:27:28.670681+0000 (oldest deadline 2024-03-04T09:27:52.170497+0000) 2024-03-04T09:27:54.535 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:54 smithi190 podman[73773]: 2024-03-04 09:27:54.14592156 +0000 UTC m=+0.017533836 image pull f88ffb32aa6a7d5dfdc954d9f096f0c9cc47981d05ec8d117ba859a22d8185ba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5 2024-03-04T09:27:54.535 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:54 smithi190 podman[73773]: 2024-03-04 09:27:54.25159978 +0000 UTC m=+0.123212055 container create e4b04701e07b3a9c6b501a17c6d9220e3cba0bde7b348f67e8f0e517964018b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240222, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-03-04T09:27:54.535 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:54 smithi190 podman[73773]: 2024-03-04 09:27:54.463161817 +0000 UTC m=+0.334774105 container init e4b04701e07b3a9c6b501a17c6d9220e3cba0bde7b348f67e8f0e517964018b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-qdb-1bc250c, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-04T09:27:54.535 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:54 smithi190 podman[73773]: 2024-03-04 09:27:54.466142954 +0000 UTC m=+0.337755231 container start e4b04701e07b3a9c6b501a17c6d9220e3cba0bde7b348f67e8f0e517964018b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-04T09:27:54.535 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:54 smithi190 podman[73773]: 2024-03-04 09:27:54.538084241 +0000 UTC m=+0.409696522 container attach e4b04701e07b3a9c6b501a17c6d9220e3cba0bde7b348f67e8f0e517964018b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240222, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8) 2024-03-04T09:27:54.535 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:54 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:54.288+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:27:54.536 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:54 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:54.288+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:57.035521+0000 front 2024-03-04T09:26:57.035337+0000 (oldest deadline 2024-03-04T09:27:21.735439+0000) 2024-03-04T09:27:54.536 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:54 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:54.288+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:04.036279+0000 front 2024-03-04T09:27:04.036372+0000 (oldest deadline 2024-03-04T09:27:25.736393+0000) 2024-03-04T09:27:54.536 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:54 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:54.288+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:17.438406+0000 front 2024-03-04T09:27:17.438387+0000 (oldest deadline 2024-03-04T09:27:42.138476+0000) 2024-03-04T09:27:54.536 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:54 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:54.288+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:26.839388+0000 front 2024-03-04T09:27:26.839426+0000 (oldest deadline 2024-03-04T09:27:50.339500+0000) 2024-03-04T09:27:54.921 INFO:journalctl@ceph.osd.8.smithi190.stdout:Mar 04 09:27:54 smithi190 podman[73773]: 2024-03-04 09:27:54.757686686 +0000 UTC m=+0.629298973 container died e4b04701e07b3a9c6b501a17c6d9220e3cba0bde7b348f67e8f0e517964018b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-8-deactivate, RELEASE=wip-lusov-qdb-1bc250c, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_CLEAN=True, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-04T09:27:54.929 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:54 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:54.509+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:27:54.929 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:54 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:54.509+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.858704+0000 front 2024-03-04T09:26:56.858604+0000 (oldest deadline 2024-03-04T09:27:18.459284+0000) 2024-03-04T09:27:54.929 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:54 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:54.509+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:01.960225+0000 front 2024-03-04T09:27:01.960271+0000 (oldest deadline 2024-03-04T09:27:27.260135+0000) 2024-03-04T09:27:54.930 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:54 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:54.509+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:13.061584+0000 front 2024-03-04T09:27:13.061603+0000 (oldest deadline 2024-03-04T09:27:34.161481+0000) 2024-03-04T09:27:54.930 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:54 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:54.509+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:21.162580+0000 front 2024-03-04T09:27:21.162631+0000 (oldest deadline 2024-03-04T09:27:44.662746+0000) 2024-03-04T09:27:54.930 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:54 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:54.509+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:27.464544+0000 front 2024-03-04T09:27:27.464495+0000 (oldest deadline 2024-03-04T09:27:50.964281+0000) 2024-03-04T09:27:55.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:54 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:54.798+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:46.763438+0000 front 2024-03-04T09:26:46.763484+0000 (oldest deadline 2024-03-04T09:27:10.263514+0000) 2024-03-04T09:27:55.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:54 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:54.798+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.065154+0000 front 2024-03-04T09:26:56.065278+0000 (oldest deadline 2024-03-04T09:27:17.765282+0000) 2024-03-04T09:27:55.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:54 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:54.798+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:02.466239+0000 front 2024-03-04T09:27:02.466314+0000 (oldest deadline 2024-03-04T09:27:27.766338+0000) 2024-03-04T09:27:55.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:54 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:54.798+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:10.067296+0000 front 2024-03-04T09:27:10.067271+0000 (oldest deadline 2024-03-04T09:27:34.767410+0000) 2024-03-04T09:27:55.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:54 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:54.798+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:19.369079+0000 front 2024-03-04T09:27:19.369094+0000 (oldest deadline 2024-03-04T09:27:41.668724+0000) 2024-03-04T09:27:55.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:54 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:54.798+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:28.670601+0000 front 2024-03-04T09:27:28.670681+0000 (oldest deadline 2024-03-04T09:27:52.170497+0000) 2024-03-04T09:27:55.362 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:55 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:55.331+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:27:55.362 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:55 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:55.331+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:57.035521+0000 front 2024-03-04T09:26:57.035337+0000 (oldest deadline 2024-03-04T09:27:21.735439+0000) 2024-03-04T09:27:55.363 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:55 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:55.331+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:04.036279+0000 front 2024-03-04T09:27:04.036372+0000 (oldest deadline 2024-03-04T09:27:25.736393+0000) 2024-03-04T09:27:55.363 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:55 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:55.331+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:17.438406+0000 front 2024-03-04T09:27:17.438387+0000 (oldest deadline 2024-03-04T09:27:42.138476+0000) 2024-03-04T09:27:55.363 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:55 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:55.331+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:26.839388+0000 front 2024-03-04T09:27:26.839426+0000 (oldest deadline 2024-03-04T09:27:50.339500+0000) 2024-03-04T09:27:55.384 DEBUG:teuthology.orchestra.run.smithi190:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@osd.8.service' 2024-03-04T09:27:55.466 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-04T09:27:55.466 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-03-04T09:27:55.466 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-03-04T09:27:55.466 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-2e533fc8-da06-11ee-95c6-87774f69a715@osd.9 2024-03-04T09:27:55.778 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:55 smithi082 systemd[1]: Stopping Ceph osd.9 for 2e533fc8-da06-11ee-95c6-87774f69a715... 2024-03-04T09:27:55.929 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:55 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:55.469+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:27:55.930 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:55 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:55.469+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.858704+0000 front 2024-03-04T09:26:56.858604+0000 (oldest deadline 2024-03-04T09:27:18.459284+0000) 2024-03-04T09:27:55.930 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:55 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:55.469+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:01.960225+0000 front 2024-03-04T09:27:01.960271+0000 (oldest deadline 2024-03-04T09:27:27.260135+0000) 2024-03-04T09:27:55.930 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:55 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:55.469+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:13.061584+0000 front 2024-03-04T09:27:13.061603+0000 (oldest deadline 2024-03-04T09:27:34.161481+0000) 2024-03-04T09:27:55.930 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:55 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:55.469+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:21.162580+0000 front 2024-03-04T09:27:21.162631+0000 (oldest deadline 2024-03-04T09:27:44.662746+0000) 2024-03-04T09:27:55.930 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:55 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:55.469+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:27.464544+0000 front 2024-03-04T09:27:27.464495+0000 (oldest deadline 2024-03-04T09:27:50.964281+0000) 2024-03-04T09:27:56.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:55 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:55.781+0000 7fc0e777b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T09:27:56.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:55 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:55.781+0000 7fc0e777b700 -1 osd.9 110 *** Got signal Terminated *** 2024-03-04T09:27:56.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:55 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:55.781+0000 7fc0e777b700 -1 osd.9 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-04T09:27:56.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:55 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:55.818+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:46.763438+0000 front 2024-03-04T09:26:46.763484+0000 (oldest deadline 2024-03-04T09:27:10.263514+0000) 2024-03-04T09:27:56.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:55 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:55.818+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.065154+0000 front 2024-03-04T09:26:56.065278+0000 (oldest deadline 2024-03-04T09:27:17.765282+0000) 2024-03-04T09:27:56.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:55 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:55.818+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:02.466239+0000 front 2024-03-04T09:27:02.466314+0000 (oldest deadline 2024-03-04T09:27:27.766338+0000) 2024-03-04T09:27:56.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:55 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:55.818+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:10.067296+0000 front 2024-03-04T09:27:10.067271+0000 (oldest deadline 2024-03-04T09:27:34.767410+0000) 2024-03-04T09:27:56.068 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:55 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:55.818+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:19.369079+0000 front 2024-03-04T09:27:19.369094+0000 (oldest deadline 2024-03-04T09:27:41.668724+0000) 2024-03-04T09:27:56.068 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:55 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:55.818+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:28.670601+0000 front 2024-03-04T09:27:28.670681+0000 (oldest deadline 2024-03-04T09:27:52.170497+0000) 2024-03-04T09:27:56.672 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:56 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:56.358+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:27:56.672 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:56 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:56.358+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:57.035521+0000 front 2024-03-04T09:26:57.035337+0000 (oldest deadline 2024-03-04T09:27:21.735439+0000) 2024-03-04T09:27:56.672 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:56 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:56.358+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:04.036279+0000 front 2024-03-04T09:27:04.036372+0000 (oldest deadline 2024-03-04T09:27:25.736393+0000) 2024-03-04T09:27:56.672 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:56 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:56.358+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:17.438406+0000 front 2024-03-04T09:27:17.438387+0000 (oldest deadline 2024-03-04T09:27:42.138476+0000) 2024-03-04T09:27:56.672 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:56 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:56.358+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:26.839388+0000 front 2024-03-04T09:27:26.839426+0000 (oldest deadline 2024-03-04T09:27:50.339500+0000) 2024-03-04T09:27:56.929 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:56 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:56.465+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:27:56.930 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:56 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:56.465+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.858704+0000 front 2024-03-04T09:26:56.858604+0000 (oldest deadline 2024-03-04T09:27:18.459284+0000) 2024-03-04T09:27:56.930 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:56 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:56.465+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:01.960225+0000 front 2024-03-04T09:27:01.960271+0000 (oldest deadline 2024-03-04T09:27:27.260135+0000) 2024-03-04T09:27:56.930 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:56 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:56.465+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:13.061584+0000 front 2024-03-04T09:27:13.061603+0000 (oldest deadline 2024-03-04T09:27:34.161481+0000) 2024-03-04T09:27:56.930 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:56 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:56.465+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:21.162580+0000 front 2024-03-04T09:27:21.162631+0000 (oldest deadline 2024-03-04T09:27:44.662746+0000) 2024-03-04T09:27:56.930 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:56 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:56.465+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:27.464544+0000 front 2024-03-04T09:27:27.464495+0000 (oldest deadline 2024-03-04T09:27:50.964281+0000) 2024-03-04T09:27:57.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:56 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:56.808+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:46.763438+0000 front 2024-03-04T09:26:46.763484+0000 (oldest deadline 2024-03-04T09:27:10.263514+0000) 2024-03-04T09:27:57.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:56 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:56.808+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.065154+0000 front 2024-03-04T09:26:56.065278+0000 (oldest deadline 2024-03-04T09:27:17.765282+0000) 2024-03-04T09:27:57.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:56 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:56.808+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:02.466239+0000 front 2024-03-04T09:27:02.466314+0000 (oldest deadline 2024-03-04T09:27:27.766338+0000) 2024-03-04T09:27:57.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:56 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:56.808+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:10.067296+0000 front 2024-03-04T09:27:10.067271+0000 (oldest deadline 2024-03-04T09:27:34.767410+0000) 2024-03-04T09:27:57.068 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:56 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:56.808+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:19.369079+0000 front 2024-03-04T09:27:19.369094+0000 (oldest deadline 2024-03-04T09:27:41.668724+0000) 2024-03-04T09:27:57.068 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:56 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:56.808+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:28.670601+0000 front 2024-03-04T09:27:28.670681+0000 (oldest deadline 2024-03-04T09:27:52.170497+0000) 2024-03-04T09:27:57.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:57 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:57.387+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:27:57.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:57 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:57.387+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:57.035521+0000 front 2024-03-04T09:26:57.035337+0000 (oldest deadline 2024-03-04T09:27:21.735439+0000) 2024-03-04T09:27:57.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:57 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:57.387+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:04.036279+0000 front 2024-03-04T09:27:04.036372+0000 (oldest deadline 2024-03-04T09:27:25.736393+0000) 2024-03-04T09:27:57.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:57 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:57.387+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:17.438406+0000 front 2024-03-04T09:27:17.438387+0000 (oldest deadline 2024-03-04T09:27:42.138476+0000) 2024-03-04T09:27:57.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:57 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:57.387+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:26.839388+0000 front 2024-03-04T09:27:26.839426+0000 (oldest deadline 2024-03-04T09:27:50.339500+0000) 2024-03-04T09:27:57.929 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:57 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:57.451+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:27:57.929 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:57 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:57.451+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.858704+0000 front 2024-03-04T09:26:56.858604+0000 (oldest deadline 2024-03-04T09:27:18.459284+0000) 2024-03-04T09:27:57.930 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:57 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:57.451+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:01.960225+0000 front 2024-03-04T09:27:01.960271+0000 (oldest deadline 2024-03-04T09:27:27.260135+0000) 2024-03-04T09:27:57.930 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:57 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:57.451+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:13.061584+0000 front 2024-03-04T09:27:13.061603+0000 (oldest deadline 2024-03-04T09:27:34.161481+0000) 2024-03-04T09:27:57.930 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:57 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:57.451+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:21.162580+0000 front 2024-03-04T09:27:21.162631+0000 (oldest deadline 2024-03-04T09:27:44.662746+0000) 2024-03-04T09:27:57.930 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:57 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:57.451+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:27.464544+0000 front 2024-03-04T09:27:27.464495+0000 (oldest deadline 2024-03-04T09:27:50.964281+0000) 2024-03-04T09:27:58.317 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:57 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:57.834+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:46.763438+0000 front 2024-03-04T09:26:46.763484+0000 (oldest deadline 2024-03-04T09:27:10.263514+0000) 2024-03-04T09:27:58.317 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:57 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:57.834+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.065154+0000 front 2024-03-04T09:26:56.065278+0000 (oldest deadline 2024-03-04T09:27:17.765282+0000) 2024-03-04T09:27:58.317 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:57 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:57.834+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:02.466239+0000 front 2024-03-04T09:27:02.466314+0000 (oldest deadline 2024-03-04T09:27:27.766338+0000) 2024-03-04T09:27:58.317 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:57 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:57.834+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:10.067296+0000 front 2024-03-04T09:27:10.067271+0000 (oldest deadline 2024-03-04T09:27:34.767410+0000) 2024-03-04T09:27:58.317 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:57 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:57.834+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:19.369079+0000 front 2024-03-04T09:27:19.369094+0000 (oldest deadline 2024-03-04T09:27:41.668724+0000) 2024-03-04T09:27:58.318 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:57 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:57.834+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:28.670601+0000 front 2024-03-04T09:27:28.670681+0000 (oldest deadline 2024-03-04T09:27:52.170497+0000) 2024-03-04T09:27:58.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:58 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:58.379+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:27:58.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:58 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:58.379+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:57.035521+0000 front 2024-03-04T09:26:57.035337+0000 (oldest deadline 2024-03-04T09:27:21.735439+0000) 2024-03-04T09:27:58.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:58 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:58.379+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:04.036279+0000 front 2024-03-04T09:27:04.036372+0000 (oldest deadline 2024-03-04T09:27:25.736393+0000) 2024-03-04T09:27:58.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:58 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:58.379+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:17.438406+0000 front 2024-03-04T09:27:17.438387+0000 (oldest deadline 2024-03-04T09:27:42.138476+0000) 2024-03-04T09:27:58.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:58 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:58.379+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:26.839388+0000 front 2024-03-04T09:27:26.839426+0000 (oldest deadline 2024-03-04T09:27:50.339500+0000) 2024-03-04T09:27:58.929 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:58 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:58.480+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:27:58.929 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:58 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:58.480+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.858704+0000 front 2024-03-04T09:26:56.858604+0000 (oldest deadline 2024-03-04T09:27:18.459284+0000) 2024-03-04T09:27:58.930 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:58 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:58.480+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:01.960225+0000 front 2024-03-04T09:27:01.960271+0000 (oldest deadline 2024-03-04T09:27:27.260135+0000) 2024-03-04T09:27:58.930 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:58 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:58.480+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:13.061584+0000 front 2024-03-04T09:27:13.061603+0000 (oldest deadline 2024-03-04T09:27:34.161481+0000) 2024-03-04T09:27:58.930 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:58 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:58.480+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:21.162580+0000 front 2024-03-04T09:27:21.162631+0000 (oldest deadline 2024-03-04T09:27:44.662746+0000) 2024-03-04T09:27:58.930 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:58 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:58.480+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:27.464544+0000 front 2024-03-04T09:27:27.464495+0000 (oldest deadline 2024-03-04T09:27:50.964281+0000) 2024-03-04T09:27:58.930 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:58 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:58.480+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-03-04T09:27:32.665381+0000 front 2024-03-04T09:27:32.665309+0000 (oldest deadline 2024-03-04T09:27:57.965166+0000) 2024-03-04T09:27:59.317 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:58 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:58.828+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:46.763438+0000 front 2024-03-04T09:26:46.763484+0000 (oldest deadline 2024-03-04T09:27:10.263514+0000) 2024-03-04T09:27:59.317 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:58 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:58.828+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.065154+0000 front 2024-03-04T09:26:56.065278+0000 (oldest deadline 2024-03-04T09:27:17.765282+0000) 2024-03-04T09:27:59.317 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:58 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:58.828+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:02.466239+0000 front 2024-03-04T09:27:02.466314+0000 (oldest deadline 2024-03-04T09:27:27.766338+0000) 2024-03-04T09:27:59.317 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:58 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:58.828+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:10.067296+0000 front 2024-03-04T09:27:10.067271+0000 (oldest deadline 2024-03-04T09:27:34.767410+0000) 2024-03-04T09:27:59.317 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:58 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:58.828+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:19.369079+0000 front 2024-03-04T09:27:19.369094+0000 (oldest deadline 2024-03-04T09:27:41.668724+0000) 2024-03-04T09:27:59.317 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:58 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:58.828+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:28.670601+0000 front 2024-03-04T09:27:28.670681+0000 (oldest deadline 2024-03-04T09:27:52.170497+0000) 2024-03-04T09:27:59.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:59 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:59.361+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:27:59.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:59 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:59.361+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:57.035521+0000 front 2024-03-04T09:26:57.035337+0000 (oldest deadline 2024-03-04T09:27:21.735439+0000) 2024-03-04T09:27:59.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:59 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:59.361+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:04.036279+0000 front 2024-03-04T09:27:04.036372+0000 (oldest deadline 2024-03-04T09:27:25.736393+0000) 2024-03-04T09:27:59.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:59 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:59.361+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:17.438406+0000 front 2024-03-04T09:27:17.438387+0000 (oldest deadline 2024-03-04T09:27:42.138476+0000) 2024-03-04T09:27:59.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:59 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:59.361+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:26.839388+0000 front 2024-03-04T09:27:26.839426+0000 (oldest deadline 2024-03-04T09:27:50.339500+0000) 2024-03-04T09:27:59.672 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:27:59 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:27:59.361+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-03-04T09:27:36.240660+0000 front 2024-03-04T09:27:36.240544+0000 (oldest deadline 2024-03-04T09:27:59.140314+0000) 2024-03-04T09:27:59.832 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:59 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:59.530+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:27:59.832 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:59 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:59.530+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.858704+0000 front 2024-03-04T09:26:56.858604+0000 (oldest deadline 2024-03-04T09:27:18.459284+0000) 2024-03-04T09:27:59.832 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:59 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:59.530+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:01.960225+0000 front 2024-03-04T09:27:01.960271+0000 (oldest deadline 2024-03-04T09:27:27.260135+0000) 2024-03-04T09:27:59.832 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:59 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:59.530+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:13.061584+0000 front 2024-03-04T09:27:13.061603+0000 (oldest deadline 2024-03-04T09:27:34.161481+0000) 2024-03-04T09:27:59.832 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:59 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:59.530+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:21.162580+0000 front 2024-03-04T09:27:21.162631+0000 (oldest deadline 2024-03-04T09:27:44.662746+0000) 2024-03-04T09:27:59.832 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:59 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:59.530+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:27.464544+0000 front 2024-03-04T09:27:27.464495+0000 (oldest deadline 2024-03-04T09:27:50.964281+0000) 2024-03-04T09:27:59.832 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:27:59 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:27:59.530+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-03-04T09:27:32.665381+0000 front 2024-03-04T09:27:32.665309+0000 (oldest deadline 2024-03-04T09:27:57.965166+0000) 2024-03-04T09:28:00.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:59 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:59.802+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:46.763438+0000 front 2024-03-04T09:26:46.763484+0000 (oldest deadline 2024-03-04T09:27:10.263514+0000) 2024-03-04T09:28:00.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:59 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:59.802+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.065154+0000 front 2024-03-04T09:26:56.065278+0000 (oldest deadline 2024-03-04T09:27:17.765282+0000) 2024-03-04T09:28:00.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:59 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:59.802+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:02.466239+0000 front 2024-03-04T09:27:02.466314+0000 (oldest deadline 2024-03-04T09:27:27.766338+0000) 2024-03-04T09:28:00.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:59 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:59.802+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:10.067296+0000 front 2024-03-04T09:27:10.067271+0000 (oldest deadline 2024-03-04T09:27:34.767410+0000) 2024-03-04T09:28:00.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:59 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:59.802+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:19.369079+0000 front 2024-03-04T09:27:19.369094+0000 (oldest deadline 2024-03-04T09:27:41.668724+0000) 2024-03-04T09:28:00.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:27:59 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:27:59.802+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:28.670601+0000 front 2024-03-04T09:27:28.670681+0000 (oldest deadline 2024-03-04T09:27:52.170497+0000) 2024-03-04T09:28:00.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:00 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:00.371+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:28:00.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:00 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:00.371+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:57.035521+0000 front 2024-03-04T09:26:57.035337+0000 (oldest deadline 2024-03-04T09:27:21.735439+0000) 2024-03-04T09:28:00.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:00 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:00.371+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:04.036279+0000 front 2024-03-04T09:27:04.036372+0000 (oldest deadline 2024-03-04T09:27:25.736393+0000) 2024-03-04T09:28:00.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:00 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:00.371+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:17.438406+0000 front 2024-03-04T09:27:17.438387+0000 (oldest deadline 2024-03-04T09:27:42.138476+0000) 2024-03-04T09:28:00.672 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:00 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:00.371+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:26.839388+0000 front 2024-03-04T09:27:26.839426+0000 (oldest deadline 2024-03-04T09:27:50.339500+0000) 2024-03-04T09:28:00.672 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:00 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:00.371+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-03-04T09:27:36.240660+0000 front 2024-03-04T09:27:36.240544+0000 (oldest deadline 2024-03-04T09:27:59.140314+0000) 2024-03-04T09:28:00.930 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:00 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:00.498+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:28:00.930 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:00 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:00.498+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.858704+0000 front 2024-03-04T09:26:56.858604+0000 (oldest deadline 2024-03-04T09:27:18.459284+0000) 2024-03-04T09:28:00.930 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:00 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:00.498+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:01.960225+0000 front 2024-03-04T09:27:01.960271+0000 (oldest deadline 2024-03-04T09:27:27.260135+0000) 2024-03-04T09:28:00.930 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:00 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:00.498+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:13.061584+0000 front 2024-03-04T09:27:13.061603+0000 (oldest deadline 2024-03-04T09:27:34.161481+0000) 2024-03-04T09:28:00.930 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:00 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:00.498+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:21.162580+0000 front 2024-03-04T09:27:21.162631+0000 (oldest deadline 2024-03-04T09:27:44.662746+0000) 2024-03-04T09:28:00.930 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:00 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:00.498+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:27.464544+0000 front 2024-03-04T09:27:27.464495+0000 (oldest deadline 2024-03-04T09:27:50.964281+0000) 2024-03-04T09:28:00.930 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:00 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:00.498+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-03-04T09:27:32.665381+0000 front 2024-03-04T09:27:32.665309+0000 (oldest deadline 2024-03-04T09:27:57.965166+0000) 2024-03-04T09:28:01.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:28:00 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:28:00.752+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:46.763438+0000 front 2024-03-04T09:26:46.763484+0000 (oldest deadline 2024-03-04T09:27:10.263514+0000) 2024-03-04T09:28:01.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:28:00 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:28:00.752+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.065154+0000 front 2024-03-04T09:26:56.065278+0000 (oldest deadline 2024-03-04T09:27:17.765282+0000) 2024-03-04T09:28:01.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:28:00 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:28:00.752+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:02.466239+0000 front 2024-03-04T09:27:02.466314+0000 (oldest deadline 2024-03-04T09:27:27.766338+0000) 2024-03-04T09:28:01.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:28:00 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:28:00.752+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:10.067296+0000 front 2024-03-04T09:27:10.067271+0000 (oldest deadline 2024-03-04T09:27:34.767410+0000) 2024-03-04T09:28:01.068 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:28:00 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:28:00.752+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:19.369079+0000 front 2024-03-04T09:27:19.369094+0000 (oldest deadline 2024-03-04T09:27:41.668724+0000) 2024-03-04T09:28:01.068 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:28:00 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9[67641]: 2024-03-04T09:28:00.752+0000 7fc0dfd67700 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:28.670601+0000 front 2024-03-04T09:27:28.670681+0000 (oldest deadline 2024-03-04T09:27:52.170497+0000) 2024-03-04T09:28:01.567 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:28:01 smithi082 podman[93970]: 2024-03-04 09:28:01.268866021 +0000 UTC m=+5.596368726 container died 28c2b8b6f9000dadf63e1f8c447846494ec50e50899f7bc6e9b2fb36a5313e70 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, RELEASE=wip-lusov-qdb-1bc250c, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-03-04T09:28:01.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:01 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:01.399+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:28:01.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:01 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:01.399+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:57.035521+0000 front 2024-03-04T09:26:57.035337+0000 (oldest deadline 2024-03-04T09:27:21.735439+0000) 2024-03-04T09:28:01.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:01 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:01.399+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:04.036279+0000 front 2024-03-04T09:27:04.036372+0000 (oldest deadline 2024-03-04T09:27:25.736393+0000) 2024-03-04T09:28:01.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:01 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:01.399+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:17.438406+0000 front 2024-03-04T09:27:17.438387+0000 (oldest deadline 2024-03-04T09:27:42.138476+0000) 2024-03-04T09:28:01.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:01 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:01.399+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:26.839388+0000 front 2024-03-04T09:27:26.839426+0000 (oldest deadline 2024-03-04T09:27:50.339500+0000) 2024-03-04T09:28:01.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:01 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:01.399+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-03-04T09:27:36.240660+0000 front 2024-03-04T09:27:36.240544+0000 (oldest deadline 2024-03-04T09:27:59.140314+0000) 2024-03-04T09:28:01.929 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:01 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:01.456+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:28:01.930 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:01 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:01.456+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.858704+0000 front 2024-03-04T09:26:56.858604+0000 (oldest deadline 2024-03-04T09:27:18.459284+0000) 2024-03-04T09:28:01.930 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:01 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:01.456+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:01.960225+0000 front 2024-03-04T09:27:01.960271+0000 (oldest deadline 2024-03-04T09:27:27.260135+0000) 2024-03-04T09:28:01.930 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:01 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:01.456+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:13.061584+0000 front 2024-03-04T09:27:13.061603+0000 (oldest deadline 2024-03-04T09:27:34.161481+0000) 2024-03-04T09:28:01.930 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:01 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:01.456+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:21.162580+0000 front 2024-03-04T09:27:21.162631+0000 (oldest deadline 2024-03-04T09:27:44.662746+0000) 2024-03-04T09:28:01.930 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:01 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:01.456+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:27.464544+0000 front 2024-03-04T09:27:27.464495+0000 (oldest deadline 2024-03-04T09:27:50.964281+0000) 2024-03-04T09:28:01.930 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:01 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:01.456+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-03-04T09:27:32.665381+0000 front 2024-03-04T09:27:32.665309+0000 (oldest deadline 2024-03-04T09:27:57.965166+0000) 2024-03-04T09:28:02.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:28:01 smithi082 podman[93970]: 2024-03-04 09:28:01.580801532 +0000 UTC m=+5.908304228 container cleanup 28c2b8b6f9000dadf63e1f8c447846494ec50e50899f7bc6e9b2fb36a5313e70 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-lusov-qdb-1bc250c, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8) 2024-03-04T09:28:02.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:28:01 smithi082 bash[93970]: ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9 2024-03-04T09:28:02.067 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:28:01 smithi082 podman[93987]: 2024-03-04 09:28:01.815290998 +0000 UTC m=+0.542594326 container remove 28c2b8b6f9000dadf63e1f8c447846494ec50e50899f7bc6e9b2fb36a5313e70 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, RELEASE=wip-lusov-qdb-1bc250c) 2024-03-04T09:28:02.548 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:28:02 smithi082 podman[94077]: 2024-03-04 09:28:02.15941277 +0000 UTC m=+0.017727033 image pull f88ffb32aa6a7d5dfdc954d9f096f0c9cc47981d05ec8d117ba859a22d8185ba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5 2024-03-04T09:28:02.548 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:28:02 smithi082 podman[94077]: 2024-03-04 09:28:02.25762818 +0000 UTC m=+0.115942438 container create 1d34fa2f6fd403c863f20d80c5dfc1da9e0ea314940a946cf7c825ea9e63d1e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9-deactivate, ceph=True, RELEASE=wip-lusov-qdb-1bc250c, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD) 2024-03-04T09:28:02.548 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:28:02 smithi082 podman[94077]: 2024-03-04 09:28:02.477229309 +0000 UTC m=+0.335543568 container init 1d34fa2f6fd403c863f20d80c5dfc1da9e0ea314940a946cf7c825ea9e63d1e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-qdb-1bc250c, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS) 2024-03-04T09:28:02.548 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:28:02 smithi082 podman[94077]: 2024-03-04 09:28:02.48042399 +0000 UTC m=+0.338738252 container start 1d34fa2f6fd403c863f20d80c5dfc1da9e0ea314940a946cf7c825ea9e63d1e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-qdb-1bc250c, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-03-04T09:28:02.548 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:28:02 smithi082 podman[94077]: 2024-03-04 09:28:02.552207374 +0000 UTC m=+0.410521648 container attach 1d34fa2f6fd403c863f20d80c5dfc1da9e0ea314940a946cf7c825ea9e63d1e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9-deactivate, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-lusov-qdb-1bc250c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-03-04T09:28:02.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:02 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:02.390+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:28:02.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:02 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:02.390+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:57.035521+0000 front 2024-03-04T09:26:57.035337+0000 (oldest deadline 2024-03-04T09:27:21.735439+0000) 2024-03-04T09:28:02.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:02 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:02.390+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:04.036279+0000 front 2024-03-04T09:27:04.036372+0000 (oldest deadline 2024-03-04T09:27:25.736393+0000) 2024-03-04T09:28:02.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:02 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:02.390+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:17.438406+0000 front 2024-03-04T09:27:17.438387+0000 (oldest deadline 2024-03-04T09:27:42.138476+0000) 2024-03-04T09:28:02.672 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:02 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:02.390+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:26.839388+0000 front 2024-03-04T09:27:26.839426+0000 (oldest deadline 2024-03-04T09:27:50.339500+0000) 2024-03-04T09:28:02.672 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:02 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:02.390+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-03-04T09:27:36.240660+0000 front 2024-03-04T09:27:36.240544+0000 (oldest deadline 2024-03-04T09:27:59.140314+0000) 2024-03-04T09:28:02.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:02 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:02.420+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:28:02.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:02 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:02.420+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.858704+0000 front 2024-03-04T09:26:56.858604+0000 (oldest deadline 2024-03-04T09:27:18.459284+0000) 2024-03-04T09:28:02.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:02 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:02.420+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:01.960225+0000 front 2024-03-04T09:27:01.960271+0000 (oldest deadline 2024-03-04T09:27:27.260135+0000) 2024-03-04T09:28:02.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:02 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:02.420+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:13.061584+0000 front 2024-03-04T09:27:13.061603+0000 (oldest deadline 2024-03-04T09:27:34.161481+0000) 2024-03-04T09:28:02.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:02 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:02.420+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:21.162580+0000 front 2024-03-04T09:27:21.162631+0000 (oldest deadline 2024-03-04T09:27:44.662746+0000) 2024-03-04T09:28:02.680 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:02 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:02.420+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:27.464544+0000 front 2024-03-04T09:27:27.464495+0000 (oldest deadline 2024-03-04T09:27:50.964281+0000) 2024-03-04T09:28:02.680 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:02 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:02.420+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-03-04T09:27:32.665381+0000 front 2024-03-04T09:27:32.665309+0000 (oldest deadline 2024-03-04T09:27:57.965166+0000) 2024-03-04T09:28:02.817 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 04 09:28:02 smithi082 podman[94077]: 2024-03-04 09:28:02.766166278 +0000 UTC m=+0.624480531 container died 1d34fa2f6fd403c863f20d80c5dfc1da9e0ea314940a946cf7c825ea9e63d1e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-9-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-qdb-1bc250c, GIT_BRANCH=HEAD, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-03-04T09:28:03.371 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@osd.9.service' 2024-03-04T09:28:03.413 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-04T09:28:03.413 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-03-04T09:28:03.414 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-03-04T09:28:03.414 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-2e533fc8-da06-11ee-95c6-87774f69a715@osd.10 2024-03-04T09:28:03.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:03 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:03.422+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:28:03.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:03 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:03.422+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:57.035521+0000 front 2024-03-04T09:26:57.035337+0000 (oldest deadline 2024-03-04T09:27:21.735439+0000) 2024-03-04T09:28:03.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:03 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:03.422+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:04.036279+0000 front 2024-03-04T09:27:04.036372+0000 (oldest deadline 2024-03-04T09:27:25.736393+0000) 2024-03-04T09:28:03.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:03 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:03.422+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:17.438406+0000 front 2024-03-04T09:27:17.438387+0000 (oldest deadline 2024-03-04T09:27:42.138476+0000) 2024-03-04T09:28:03.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:03 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:03.422+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:26.839388+0000 front 2024-03-04T09:27:26.839426+0000 (oldest deadline 2024-03-04T09:27:50.339500+0000) 2024-03-04T09:28:03.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:03 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:03.422+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-03-04T09:27:36.240660+0000 front 2024-03-04T09:27:36.240544+0000 (oldest deadline 2024-03-04T09:27:59.140314+0000) 2024-03-04T09:28:03.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:03 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:03.383+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:28:03.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:03 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:03.383+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.858704+0000 front 2024-03-04T09:26:56.858604+0000 (oldest deadline 2024-03-04T09:27:18.459284+0000) 2024-03-04T09:28:03.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:03 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:03.383+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:01.960225+0000 front 2024-03-04T09:27:01.960271+0000 (oldest deadline 2024-03-04T09:27:27.260135+0000) 2024-03-04T09:28:03.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:03 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:03.383+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:13.061584+0000 front 2024-03-04T09:27:13.061603+0000 (oldest deadline 2024-03-04T09:27:34.161481+0000) 2024-03-04T09:28:03.680 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:03 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:03.383+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:21.162580+0000 front 2024-03-04T09:27:21.162631+0000 (oldest deadline 2024-03-04T09:27:44.662746+0000) 2024-03-04T09:28:03.680 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:03 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:03.383+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:27.464544+0000 front 2024-03-04T09:27:27.464495+0000 (oldest deadline 2024-03-04T09:27:50.964281+0000) 2024-03-04T09:28:03.680 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:03 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:03.383+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-03-04T09:27:32.665381+0000 front 2024-03-04T09:27:32.665309+0000 (oldest deadline 2024-03-04T09:27:57.965166+0000) 2024-03-04T09:28:03.680 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:03 smithi102 systemd[1]: Stopping Ceph osd.10 for 2e533fc8-da06-11ee-95c6-87774f69a715... 2024-03-04T09:28:04.179 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:03 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:03.706+0000 7f6d3d79e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T09:28:04.179 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:03 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:03.706+0000 7f6d3d79e700 -1 osd.10 110 *** Got signal Terminated *** 2024-03-04T09:28:04.180 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:03 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:03.706+0000 7f6d3d79e700 -1 osd.10 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-04T09:28:04.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:04 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:04.412+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:28:04.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:04 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:04.412+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:57.035521+0000 front 2024-03-04T09:26:57.035337+0000 (oldest deadline 2024-03-04T09:27:21.735439+0000) 2024-03-04T09:28:04.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:04 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:04.412+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:04.036279+0000 front 2024-03-04T09:27:04.036372+0000 (oldest deadline 2024-03-04T09:27:25.736393+0000) 2024-03-04T09:28:04.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:04 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:04.412+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:17.438406+0000 front 2024-03-04T09:27:17.438387+0000 (oldest deadline 2024-03-04T09:27:42.138476+0000) 2024-03-04T09:28:04.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:04 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:04.412+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:26.839388+0000 front 2024-03-04T09:27:26.839426+0000 (oldest deadline 2024-03-04T09:27:50.339500+0000) 2024-03-04T09:28:04.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:04 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:04.412+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-03-04T09:27:36.240660+0000 front 2024-03-04T09:27:36.240544+0000 (oldest deadline 2024-03-04T09:27:59.140314+0000) 2024-03-04T09:28:04.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:04 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:04.342+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:28:04.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:04 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:04.342+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.858704+0000 front 2024-03-04T09:26:56.858604+0000 (oldest deadline 2024-03-04T09:27:18.459284+0000) 2024-03-04T09:28:04.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:04 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:04.342+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:01.960225+0000 front 2024-03-04T09:27:01.960271+0000 (oldest deadline 2024-03-04T09:27:27.260135+0000) 2024-03-04T09:28:04.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:04 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:04.342+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:13.061584+0000 front 2024-03-04T09:27:13.061603+0000 (oldest deadline 2024-03-04T09:27:34.161481+0000) 2024-03-04T09:28:04.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:04 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:04.342+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:21.162580+0000 front 2024-03-04T09:27:21.162631+0000 (oldest deadline 2024-03-04T09:27:44.662746+0000) 2024-03-04T09:28:04.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:04 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:04.342+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:27.464544+0000 front 2024-03-04T09:27:27.464495+0000 (oldest deadline 2024-03-04T09:27:50.964281+0000) 2024-03-04T09:28:04.680 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:04 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:04.342+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-03-04T09:27:32.665381+0000 front 2024-03-04T09:27:32.665309+0000 (oldest deadline 2024-03-04T09:27:57.965166+0000) 2024-03-04T09:28:05.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:05 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:05.373+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:28:05.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:05 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:05.373+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:57.035521+0000 front 2024-03-04T09:26:57.035337+0000 (oldest deadline 2024-03-04T09:27:21.735439+0000) 2024-03-04T09:28:05.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:05 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:05.373+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:04.036279+0000 front 2024-03-04T09:27:04.036372+0000 (oldest deadline 2024-03-04T09:27:25.736393+0000) 2024-03-04T09:28:05.672 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:05 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:05.374+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:17.438406+0000 front 2024-03-04T09:27:17.438387+0000 (oldest deadline 2024-03-04T09:27:42.138476+0000) 2024-03-04T09:28:05.672 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:05 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:05.374+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:26.839388+0000 front 2024-03-04T09:27:26.839426+0000 (oldest deadline 2024-03-04T09:27:50.339500+0000) 2024-03-04T09:28:05.672 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:05 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:05.374+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-03-04T09:27:36.240660+0000 front 2024-03-04T09:27:36.240544+0000 (oldest deadline 2024-03-04T09:27:59.140314+0000) 2024-03-04T09:28:05.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:05 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:05.319+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:28:05.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:05 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:05.319+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.858704+0000 front 2024-03-04T09:26:56.858604+0000 (oldest deadline 2024-03-04T09:27:18.459284+0000) 2024-03-04T09:28:05.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:05 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:05.319+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:01.960225+0000 front 2024-03-04T09:27:01.960271+0000 (oldest deadline 2024-03-04T09:27:27.260135+0000) 2024-03-04T09:28:05.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:05 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:05.319+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:13.061584+0000 front 2024-03-04T09:27:13.061603+0000 (oldest deadline 2024-03-04T09:27:34.161481+0000) 2024-03-04T09:28:05.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:05 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:05.319+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:21.162580+0000 front 2024-03-04T09:27:21.162631+0000 (oldest deadline 2024-03-04T09:27:44.662746+0000) 2024-03-04T09:28:05.680 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:05 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:05.319+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:27.464544+0000 front 2024-03-04T09:27:27.464495+0000 (oldest deadline 2024-03-04T09:27:50.964281+0000) 2024-03-04T09:28:05.680 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:05 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:05.319+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-03-04T09:27:32.665381+0000 front 2024-03-04T09:27:32.665309+0000 (oldest deadline 2024-03-04T09:27:57.965166+0000) 2024-03-04T09:28:06.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:06 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:06.383+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:28:06.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:06 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:06.383+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:57.035521+0000 front 2024-03-04T09:26:57.035337+0000 (oldest deadline 2024-03-04T09:27:21.735439+0000) 2024-03-04T09:28:06.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:06 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:06.383+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:04.036279+0000 front 2024-03-04T09:27:04.036372+0000 (oldest deadline 2024-03-04T09:27:25.736393+0000) 2024-03-04T09:28:06.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:06 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:06.383+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:17.438406+0000 front 2024-03-04T09:27:17.438387+0000 (oldest deadline 2024-03-04T09:27:42.138476+0000) 2024-03-04T09:28:06.672 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:06 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:06.383+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:26.839388+0000 front 2024-03-04T09:27:26.839426+0000 (oldest deadline 2024-03-04T09:27:50.339500+0000) 2024-03-04T09:28:06.672 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:06 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:06.383+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-03-04T09:27:36.240660+0000 front 2024-03-04T09:27:36.240544+0000 (oldest deadline 2024-03-04T09:27:59.140314+0000) 2024-03-04T09:28:06.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:06 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:06.296+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:28:06.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:06 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:06.296+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.858704+0000 front 2024-03-04T09:26:56.858604+0000 (oldest deadline 2024-03-04T09:27:18.459284+0000) 2024-03-04T09:28:06.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:06 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:06.296+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:01.960225+0000 front 2024-03-04T09:27:01.960271+0000 (oldest deadline 2024-03-04T09:27:27.260135+0000) 2024-03-04T09:28:06.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:06 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:06.296+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:13.061584+0000 front 2024-03-04T09:27:13.061603+0000 (oldest deadline 2024-03-04T09:27:34.161481+0000) 2024-03-04T09:28:06.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:06 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:06.296+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:21.162580+0000 front 2024-03-04T09:27:21.162631+0000 (oldest deadline 2024-03-04T09:27:44.662746+0000) 2024-03-04T09:28:06.680 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:06 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:06.296+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:27.464544+0000 front 2024-03-04T09:27:27.464495+0000 (oldest deadline 2024-03-04T09:27:50.964281+0000) 2024-03-04T09:28:06.680 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:06 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:06.296+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-03-04T09:27:32.665381+0000 front 2024-03-04T09:27:32.665309+0000 (oldest deadline 2024-03-04T09:27:57.965166+0000) 2024-03-04T09:28:07.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:07 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:07.281+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:28:07.680 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:07 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:07.281+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.858704+0000 front 2024-03-04T09:26:56.858604+0000 (oldest deadline 2024-03-04T09:27:18.459284+0000) 2024-03-04T09:28:07.680 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:07 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:07.281+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:01.960225+0000 front 2024-03-04T09:27:01.960271+0000 (oldest deadline 2024-03-04T09:27:27.260135+0000) 2024-03-04T09:28:07.680 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:07 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:07.281+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:13.061584+0000 front 2024-03-04T09:27:13.061603+0000 (oldest deadline 2024-03-04T09:27:34.161481+0000) 2024-03-04T09:28:07.680 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:07 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:07.281+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:21.162580+0000 front 2024-03-04T09:27:21.162631+0000 (oldest deadline 2024-03-04T09:27:44.662746+0000) 2024-03-04T09:28:07.680 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:07 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:07.281+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:27.464544+0000 front 2024-03-04T09:27:27.464495+0000 (oldest deadline 2024-03-04T09:27:50.964281+0000) 2024-03-04T09:28:07.680 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:07 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:07.281+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-03-04T09:27:32.665381+0000 front 2024-03-04T09:27:32.665309+0000 (oldest deadline 2024-03-04T09:27:57.965166+0000) 2024-03-04T09:28:07.921 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:07 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:07.431+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:28:07.921 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:07 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:07.431+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:57.035521+0000 front 2024-03-04T09:26:57.035337+0000 (oldest deadline 2024-03-04T09:27:21.735439+0000) 2024-03-04T09:28:07.921 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:07 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:07.431+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:04.036279+0000 front 2024-03-04T09:27:04.036372+0000 (oldest deadline 2024-03-04T09:27:25.736393+0000) 2024-03-04T09:28:07.921 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:07 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:07.431+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:17.438406+0000 front 2024-03-04T09:27:17.438387+0000 (oldest deadline 2024-03-04T09:27:42.138476+0000) 2024-03-04T09:28:07.921 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:07 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:07.431+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:26.839388+0000 front 2024-03-04T09:27:26.839426+0000 (oldest deadline 2024-03-04T09:27:50.339500+0000) 2024-03-04T09:28:07.921 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:07 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:07.431+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-03-04T09:27:36.240660+0000 front 2024-03-04T09:27:36.240544+0000 (oldest deadline 2024-03-04T09:27:59.140314+0000) 2024-03-04T09:28:08.673 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:08 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:08.422+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:28:08.673 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:08 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:08.422+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:57.035521+0000 front 2024-03-04T09:26:57.035337+0000 (oldest deadline 2024-03-04T09:27:21.735439+0000) 2024-03-04T09:28:08.673 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:08 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:08.422+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:04.036279+0000 front 2024-03-04T09:27:04.036372+0000 (oldest deadline 2024-03-04T09:27:25.736393+0000) 2024-03-04T09:28:08.673 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:08 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:08.422+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:17.438406+0000 front 2024-03-04T09:27:17.438387+0000 (oldest deadline 2024-03-04T09:27:42.138476+0000) 2024-03-04T09:28:08.673 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:08 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:08.422+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:26.839388+0000 front 2024-03-04T09:27:26.839426+0000 (oldest deadline 2024-03-04T09:27:50.339500+0000) 2024-03-04T09:28:08.673 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:08 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:08.422+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-03-04T09:27:36.240660+0000 front 2024-03-04T09:27:36.240544+0000 (oldest deadline 2024-03-04T09:27:59.140314+0000) 2024-03-04T09:28:08.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:08 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:08.287+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:48.256919+0000 front 2024-03-04T09:26:48.256926+0000 (oldest deadline 2024-03-04T09:27:12.356919+0000) 2024-03-04T09:28:08.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:08 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:08.287+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:56.858704+0000 front 2024-03-04T09:26:56.858604+0000 (oldest deadline 2024-03-04T09:27:18.459284+0000) 2024-03-04T09:28:08.680 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:08 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:08.287+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:01.960225+0000 front 2024-03-04T09:27:01.960271+0000 (oldest deadline 2024-03-04T09:27:27.260135+0000) 2024-03-04T09:28:08.680 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:08 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:08.287+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-04T09:27:13.061584+0000 front 2024-03-04T09:27:13.061603+0000 (oldest deadline 2024-03-04T09:27:34.161481+0000) 2024-03-04T09:28:08.680 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:08 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:08.287+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:21.162580+0000 front 2024-03-04T09:27:21.162631+0000 (oldest deadline 2024-03-04T09:27:44.662746+0000) 2024-03-04T09:28:08.680 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:08 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:08.287+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:27.464544+0000 front 2024-03-04T09:27:27.464495+0000 (oldest deadline 2024-03-04T09:27:50.964281+0000) 2024-03-04T09:28:08.680 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:08 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10[60721]: 2024-03-04T09:28:08.287+0000 7f6d39d92700 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-03-04T09:27:32.665381+0000 front 2024-03-04T09:27:32.665309+0000 (oldest deadline 2024-03-04T09:27:57.965166+0000) 2024-03-04T09:28:09.386 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:09 smithi102 podman[72435]: 2024-03-04 09:28:09.081504737 +0000 UTC m=+5.472740493 container died 7034f921d8fc0b0e18e71d5aa1610307470d6ea9d0c4e058b8f4c030625548d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.license=GPLv2, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux ) 2024-03-04T09:28:09.386 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:09 smithi102 podman[72435]: 2024-03-04 09:28:09.389848013 +0000 UTC m=+5.781083778 container cleanup 7034f921d8fc0b0e18e71d5aa1610307470d6ea9d0c4e058b8f4c030625548d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10, RELEASE=wip-lusov-qdb-1bc250c, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True) 2024-03-04T09:28:09.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:09 smithi102 bash[72435]: ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10 2024-03-04T09:28:09.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:09 smithi102 podman[72455]: 2024-03-04 09:28:09.616077808 +0000 UTC m=+0.529289704 container remove 7034f921d8fc0b0e18e71d5aa1610307470d6ea9d0c4e058b8f4c030625548d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-qdb-1bc250c, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=) 2024-03-04T09:28:09.921 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:09 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:09.466+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:28:09.921 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:09 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:09.466+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:57.035521+0000 front 2024-03-04T09:26:57.035337+0000 (oldest deadline 2024-03-04T09:27:21.735439+0000) 2024-03-04T09:28:09.921 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:09 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:09.466+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:04.036279+0000 front 2024-03-04T09:27:04.036372+0000 (oldest deadline 2024-03-04T09:27:25.736393+0000) 2024-03-04T09:28:09.921 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:09 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:09.466+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:17.438406+0000 front 2024-03-04T09:27:17.438387+0000 (oldest deadline 2024-03-04T09:27:42.138476+0000) 2024-03-04T09:28:09.921 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:09 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:09.466+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:26.839388+0000 front 2024-03-04T09:27:26.839426+0000 (oldest deadline 2024-03-04T09:27:50.339500+0000) 2024-03-04T09:28:09.922 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:09 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:09.466+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-03-04T09:27:36.240660+0000 front 2024-03-04T09:27:36.240544+0000 (oldest deadline 2024-03-04T09:27:59.140314+0000) 2024-03-04T09:28:09.922 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:09 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:09.466+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6820 osd.7 since back 2024-03-04T09:27:43.742046+0000 front 2024-03-04T09:27:43.741938+0000 (oldest deadline 2024-03-04T09:28:08.441802+0000) 2024-03-04T09:28:10.290 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:10 smithi102 podman[72544]: 2024-03-04 09:28:10.008367999 +0000 UTC m=+0.114182245 container create 8720d59d0f42c4e40b214fa73f227a76a1be28c1dda633d1f6107de29a30efc3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.license=GPLv2) 2024-03-04T09:28:10.290 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:10 smithi102 podman[72544]: 2024-03-04 09:28:09.912209872 +0000 UTC m=+0.018024130 image pull f88ffb32aa6a7d5dfdc954d9f096f0c9cc47981d05ec8d117ba859a22d8185ba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5 2024-03-04T09:28:10.290 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:10 smithi102 podman[72544]: 2024-03-04 09:28:10.211722239 +0000 UTC m=+0.317536488 container init 8720d59d0f42c4e40b214fa73f227a76a1be28c1dda633d1f6107de29a30efc3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10-deactivate, RELEASE=wip-lusov-qdb-1bc250c, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0) 2024-03-04T09:28:10.290 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:10 smithi102 podman[72544]: 2024-03-04 09:28:10.214762685 +0000 UTC m=+0.320576932 container start 8720d59d0f42c4e40b214fa73f227a76a1be28c1dda633d1f6107de29a30efc3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10-deactivate, RELEASE=wip-lusov-qdb-1bc250c, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True) 2024-03-04T09:28:10.290 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:10 smithi102 podman[72544]: 2024-03-04 09:28:10.294121835 +0000 UTC m=+0.399936096 container attach 8720d59d0f42c4e40b214fa73f227a76a1be28c1dda633d1f6107de29a30efc3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10-deactivate, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=wip-lusov-qdb-1bc250c, GIT_CLEAN=True, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-03-04T09:28:10.679 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:10 smithi102 podman[72544]: 2024-03-04 09:28:10.510282149 +0000 UTC m=+0.616096396 container died 8720d59d0f42c4e40b214fa73f227a76a1be28c1dda633d1f6107de29a30efc3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10-deactivate, GIT_CLEAN=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, RELEASE=wip-lusov-qdb-1bc250c) 2024-03-04T09:28:10.921 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:10 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:10.499+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:28:10.921 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:10 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:10.499+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:57.035521+0000 front 2024-03-04T09:26:57.035337+0000 (oldest deadline 2024-03-04T09:27:21.735439+0000) 2024-03-04T09:28:10.921 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:10 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:10.499+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:04.036279+0000 front 2024-03-04T09:27:04.036372+0000 (oldest deadline 2024-03-04T09:27:25.736393+0000) 2024-03-04T09:28:10.921 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:10 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:10.499+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:17.438406+0000 front 2024-03-04T09:27:17.438387+0000 (oldest deadline 2024-03-04T09:27:42.138476+0000) 2024-03-04T09:28:10.921 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:10 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:10.499+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:26.839388+0000 front 2024-03-04T09:27:26.839426+0000 (oldest deadline 2024-03-04T09:27:50.339500+0000) 2024-03-04T09:28:10.921 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:10 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:10.499+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-03-04T09:27:36.240660+0000 front 2024-03-04T09:27:36.240544+0000 (oldest deadline 2024-03-04T09:27:59.140314+0000) 2024-03-04T09:28:10.921 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:10 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:10.499+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6820 osd.7 since back 2024-03-04T09:27:43.742046+0000 front 2024-03-04T09:27:43.741938+0000 (oldest deadline 2024-03-04T09:28:08.441802+0000) 2024-03-04T09:28:11.044 INFO:journalctl@ceph.osd.10.smithi102.stdout:Mar 04 09:28:11 smithi102 podman[72570]: 2024-03-04 09:28:11.030748191 +0000 UTC m=+0.514988346 container remove 8720d59d0f42c4e40b214fa73f227a76a1be28c1dda633d1f6107de29a30efc3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-10-deactivate, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-03-04T09:28:11.048 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@osd.10.service' 2024-03-04T09:28:11.093 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-04T09:28:11.093 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-03-04T09:28:11.093 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-03-04T09:28:11.094 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ceph-2e533fc8-da06-11ee-95c6-87774f69a715@osd.11 2024-03-04T09:28:11.407 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:11 smithi190 systemd[1]: Stopping Ceph osd.11 for 2e533fc8-da06-11ee-95c6-87774f69a715... 2024-03-04T09:28:11.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:11 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:11.410+0000 7f24d25ba700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T09:28:11.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:11 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:11.410+0000 7f24d25ba700 -1 osd.11 110 *** Got signal Terminated *** 2024-03-04T09:28:11.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:11 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:11.410+0000 7f24d25ba700 -1 osd.11 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-04T09:28:11.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:11 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:11.451+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:28:11.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:11 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:11.451+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:57.035521+0000 front 2024-03-04T09:26:57.035337+0000 (oldest deadline 2024-03-04T09:27:21.735439+0000) 2024-03-04T09:28:11.672 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:11 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:11.451+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:04.036279+0000 front 2024-03-04T09:27:04.036372+0000 (oldest deadline 2024-03-04T09:27:25.736393+0000) 2024-03-04T09:28:11.672 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:11 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:11.451+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:17.438406+0000 front 2024-03-04T09:27:17.438387+0000 (oldest deadline 2024-03-04T09:27:42.138476+0000) 2024-03-04T09:28:11.672 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:11 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:11.451+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:26.839388+0000 front 2024-03-04T09:27:26.839426+0000 (oldest deadline 2024-03-04T09:27:50.339500+0000) 2024-03-04T09:28:11.672 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:11 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:11.451+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-03-04T09:27:36.240660+0000 front 2024-03-04T09:27:36.240544+0000 (oldest deadline 2024-03-04T09:27:59.140314+0000) 2024-03-04T09:28:11.672 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:11 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:11.451+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6820 osd.7 since back 2024-03-04T09:27:43.742046+0000 front 2024-03-04T09:27:43.741938+0000 (oldest deadline 2024-03-04T09:28:08.441802+0000) 2024-03-04T09:28:12.921 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:12 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:12.439+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:28:12.921 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:12 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:12.439+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:57.035521+0000 front 2024-03-04T09:26:57.035337+0000 (oldest deadline 2024-03-04T09:27:21.735439+0000) 2024-03-04T09:28:12.921 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:12 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:12.439+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:04.036279+0000 front 2024-03-04T09:27:04.036372+0000 (oldest deadline 2024-03-04T09:27:25.736393+0000) 2024-03-04T09:28:12.921 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:12 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:12.439+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:17.438406+0000 front 2024-03-04T09:27:17.438387+0000 (oldest deadline 2024-03-04T09:27:42.138476+0000) 2024-03-04T09:28:12.922 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:12 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:12.439+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:26.839388+0000 front 2024-03-04T09:27:26.839426+0000 (oldest deadline 2024-03-04T09:27:50.339500+0000) 2024-03-04T09:28:12.922 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:12 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:12.439+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-03-04T09:27:36.240660+0000 front 2024-03-04T09:27:36.240544+0000 (oldest deadline 2024-03-04T09:27:59.140314+0000) 2024-03-04T09:28:12.922 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:12 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:12.439+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6820 osd.7 since back 2024-03-04T09:27:43.742046+0000 front 2024-03-04T09:27:43.741938+0000 (oldest deadline 2024-03-04T09:28:08.441802+0000) 2024-03-04T09:28:13.921 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:13 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:13.480+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:28:13.921 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:13 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:13.480+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:57.035521+0000 front 2024-03-04T09:26:57.035337+0000 (oldest deadline 2024-03-04T09:27:21.735439+0000) 2024-03-04T09:28:13.921 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:13 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:13.480+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:04.036279+0000 front 2024-03-04T09:27:04.036372+0000 (oldest deadline 2024-03-04T09:27:25.736393+0000) 2024-03-04T09:28:13.921 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:13 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:13.480+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:17.438406+0000 front 2024-03-04T09:27:17.438387+0000 (oldest deadline 2024-03-04T09:27:42.138476+0000) 2024-03-04T09:28:13.921 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:13 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:13.480+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:26.839388+0000 front 2024-03-04T09:27:26.839426+0000 (oldest deadline 2024-03-04T09:27:50.339500+0000) 2024-03-04T09:28:13.921 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:13 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:13.480+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-03-04T09:27:36.240660+0000 front 2024-03-04T09:27:36.240544+0000 (oldest deadline 2024-03-04T09:27:59.140314+0000) 2024-03-04T09:28:13.921 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:13 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:13.480+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6820 osd.7 since back 2024-03-04T09:27:43.742046+0000 front 2024-03-04T09:27:43.741938+0000 (oldest deadline 2024-03-04T09:28:08.441802+0000) 2024-03-04T09:28:14.921 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:14 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:14.456+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:28:14.921 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:14 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:14.456+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:57.035521+0000 front 2024-03-04T09:26:57.035337+0000 (oldest deadline 2024-03-04T09:27:21.735439+0000) 2024-03-04T09:28:14.921 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:14 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:14.456+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:04.036279+0000 front 2024-03-04T09:27:04.036372+0000 (oldest deadline 2024-03-04T09:27:25.736393+0000) 2024-03-04T09:28:14.921 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:14 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:14.456+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:17.438406+0000 front 2024-03-04T09:27:17.438387+0000 (oldest deadline 2024-03-04T09:27:42.138476+0000) 2024-03-04T09:28:14.921 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:14 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:14.456+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:26.839388+0000 front 2024-03-04T09:27:26.839426+0000 (oldest deadline 2024-03-04T09:27:50.339500+0000) 2024-03-04T09:28:14.921 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:14 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:14.456+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-03-04T09:27:36.240660+0000 front 2024-03-04T09:27:36.240544+0000 (oldest deadline 2024-03-04T09:27:59.140314+0000) 2024-03-04T09:28:14.922 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:14 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:14.456+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6820 osd.7 since back 2024-03-04T09:27:43.742046+0000 front 2024-03-04T09:27:43.741938+0000 (oldest deadline 2024-03-04T09:28:08.441802+0000) 2024-03-04T09:28:15.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:15 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:15.414+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-04T09:26:47.133625+0000 front 2024-03-04T09:26:47.133699+0000 (oldest deadline 2024-03-04T09:27:10.033521+0000) 2024-03-04T09:28:15.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:15 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:15.414+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6804 osd.1 since back 2024-03-04T09:26:57.035521+0000 front 2024-03-04T09:26:57.035337+0000 (oldest deadline 2024-03-04T09:27:21.735439+0000) 2024-03-04T09:28:15.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:15 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:15.414+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6804 osd.2 since back 2024-03-04T09:27:04.036279+0000 front 2024-03-04T09:27:04.036372+0000 (oldest deadline 2024-03-04T09:27:25.736393+0000) 2024-03-04T09:28:15.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:15 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:15.414+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6812 osd.4 since back 2024-03-04T09:27:17.438406+0000 front 2024-03-04T09:27:17.438387+0000 (oldest deadline 2024-03-04T09:27:42.138476+0000) 2024-03-04T09:28:15.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:15 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:15.414+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6812 osd.5 since back 2024-03-04T09:27:26.839388+0000 front 2024-03-04T09:27:26.839426+0000 (oldest deadline 2024-03-04T09:27:50.339500+0000) 2024-03-04T09:28:15.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:15 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:15.414+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-03-04T09:27:36.240660+0000 front 2024-03-04T09:27:36.240544+0000 (oldest deadline 2024-03-04T09:27:59.140314+0000) 2024-03-04T09:28:15.672 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:15 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:15.414+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.102:6820 osd.7 since back 2024-03-04T09:27:43.742046+0000 front 2024-03-04T09:27:43.741938+0000 (oldest deadline 2024-03-04T09:28:08.441802+0000) 2024-03-04T09:28:15.672 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:15 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11[62022]: 2024-03-04T09:28:15.414+0000 7f24cebae700 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.190:6820 osd.8 since back 2024-03-04T09:27:52.542706+0000 front 2024-03-04T09:27:52.542742+0000 (oldest deadline 2024-03-04T09:28:14.842704+0000) 2024-03-04T09:28:16.991 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:16 smithi190 podman[73890]: 2024-03-04 09:28:16.740359905 +0000 UTC m=+5.448324556 container died ea729f7ff4fab0a1d065ec21a9db1db9c3ae9c62674f602a023cd88f655d8555 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.build-date=20240222, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-03-04T09:28:17.357 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:17 smithi190 podman[73890]: 2024-03-04 09:28:17.093313085 +0000 UTC m=+5.801277745 container cleanup ea729f7ff4fab0a1d065ec21a9db1db9c3ae9c62674f602a023cd88f655d8555 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11, GIT_CLEAN=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-lusov-qdb-1bc250c, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-03-04T09:28:17.357 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:17 smithi190 bash[73890]: ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11 2024-03-04T09:28:17.671 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:17 smithi190 podman[73907]: 2024-03-04 09:28:17.361014654 +0000 UTC m=+0.622869770 container remove ea729f7ff4fab0a1d065ec21a9db1db9c3ae9c62674f602a023cd88f655d8555 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-qdb-1bc250c, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-03-04T09:28:17.968 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:17 smithi190 podman[73995]: 2024-03-04 09:28:17.614088165 +0000 UTC m=+0.018194946 image pull f88ffb32aa6a7d5dfdc954d9f096f0c9cc47981d05ec8d117ba859a22d8185ba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5 2024-03-04T09:28:17.968 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:17 smithi190 podman[73995]: 2024-03-04 09:28:17.711697503 +0000 UTC m=+0.115804281 container create 75d2f5c6d9ba8750fb4aa4e79ade2e55662261caf536bcfa4dd6bcd71b2af8f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11-deactivate, org.label-schema.license=GPLv2, RELEASE=wip-lusov-qdb-1bc250c, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8) 2024-03-04T09:28:17.968 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:17 smithi190 podman[73995]: 2024-03-04 09:28:17.897289362 +0000 UTC m=+0.301396138 container init 75d2f5c6d9ba8750fb4aa4e79ade2e55662261caf536bcfa4dd6bcd71b2af8f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-lusov-qdb-1bc250c, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True) 2024-03-04T09:28:17.968 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:17 smithi190 podman[73995]: 2024-03-04 09:28:17.900321006 +0000 UTC m=+0.304427788 container start 75d2f5c6d9ba8750fb4aa4e79ade2e55662261caf536bcfa4dd6bcd71b2af8f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11-deactivate, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, RELEASE=wip-lusov-qdb-1bc250c, ceph=True) 2024-03-04T09:28:17.969 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:17 smithi190 podman[73995]: 2024-03-04 09:28:17.972269633 +0000 UTC m=+0.376376422 container attach 75d2f5c6d9ba8750fb4aa4e79ade2e55662261caf536bcfa4dd6bcd71b2af8f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11-deactivate, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-qdb-1bc250c, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8) 2024-03-04T09:28:18.421 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:18 smithi190 podman[73995]: 2024-03-04 09:28:18.184781477 +0000 UTC m=+0.588888253 container died 75d2f5c6d9ba8750fb4aa4e79ade2e55662261caf536bcfa4dd6bcd71b2af8f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240222, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, RELEASE=wip-lusov-qdb-1bc250c, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-03-04T09:28:18.711 DEBUG:teuthology.orchestra.run.smithi190:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@osd.11.service' 2024-03-04T09:28:18.736 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:18 smithi190 podman[74021]: 2024-03-04 09:28:18.692160676 +0000 UTC m=+0.497946640 container remove 75d2f5c6d9ba8750fb4aa4e79ade2e55662261caf536bcfa4dd6bcd71b2af8f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-osd-11-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.license=GPLv2, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, io.buildah.version=1.33.5) 2024-03-04T09:28:18.736 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:18 smithi190 systemd[1]: ceph-2e533fc8-da06-11ee-95c6-87774f69a715@osd.11.service: Deactivated successfully. 2024-03-04T09:28:18.737 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:18 smithi190 systemd[1]: Stopped Ceph osd.11 for 2e533fc8-da06-11ee-95c6-87774f69a715. 2024-03-04T09:28:18.737 INFO:journalctl@ceph.osd.11.smithi190.stdout:Mar 04 09:28:18 smithi190 systemd[1]: ceph-2e533fc8-da06-11ee-95c6-87774f69a715@osd.11.service: Consumed 29.805s CPU time. 2024-03-04T09:28:18.751 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-04T09:28:18.751 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-03-04T09:28:18.752 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-03-04T09:28:18.752 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mds.a 2024-03-04T09:28:19.067 INFO:journalctl@ceph.mds.a.smithi082.stdout:Mar 04 09:28:18 smithi082 systemd[1]: Stopping Ceph mds.a for 2e533fc8-da06-11ee-95c6-87774f69a715... 2024-03-04T09:28:19.567 INFO:journalctl@ceph.mds.a.smithi082.stdout:Mar 04 09:28:19 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-a[74295]: 2024-03-04T09:28:19.080+0000 7f46e9971700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T09:28:19.567 INFO:journalctl@ceph.mds.a.smithi082.stdout:Mar 04 09:28:19 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-a[74295]: 2024-03-04T09:28:19.080+0000 7f46e9971700 -1 mds.a *** got signal Terminated *** 2024-03-04T09:28:20.493 INFO:journalctl@ceph.mds.a.smithi082.stdout:Mar 04 09:28:20 smithi082 podman[94195]: 2024-03-04 09:28:20.237991099 +0000 UTC m=+1.281463251 container died e7eed8ee517d59bd308e1bd32480d84f5e970ca440c59bfe62b639040dbb9fee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-a, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, ceph=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-lusov-qdb-1bc250c) 2024-03-04T09:28:20.777 INFO:journalctl@ceph.mds.a.smithi082.stdout:Mar 04 09:28:20 smithi082 podman[94195]: 2024-03-04 09:28:20.580078246 +0000 UTC m=+1.623550397 container cleanup e7eed8ee517d59bd308e1bd32480d84f5e970ca440c59bfe62b639040dbb9fee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-a, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-lusov-qdb-1bc250c) 2024-03-04T09:28:20.778 INFO:journalctl@ceph.mds.a.smithi082.stdout:Mar 04 09:28:20 smithi082 bash[94195]: ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-a 2024-03-04T09:28:20.998 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mds.a.service' 2024-03-04T09:28:21.035 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-04T09:28:21.036 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-03-04T09:28:21.036 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-03-04T09:28:21.036 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mds.d 2024-03-04T09:28:21.317 INFO:journalctl@ceph.mds.d.smithi082.stdout:Mar 04 09:28:21 smithi082 systemd[1]: Stopping Ceph mds.d for 2e533fc8-da06-11ee-95c6-87774f69a715... 2024-03-04T09:28:21.817 INFO:journalctl@ceph.mds.d.smithi082.stdout:Mar 04 09:28:21 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-d[73340]: 2024-03-04T09:28:21.350+0000 7f7cb43fb700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T09:28:21.817 INFO:journalctl@ceph.mds.d.smithi082.stdout:Mar 04 09:28:21 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-d[73340]: 2024-03-04T09:28:21.350+0000 7f7cb43fb700 -1 mds.d *** got signal Terminated *** 2024-03-04T09:28:23.430 INFO:journalctl@ceph.mds.d.smithi082.stdout:Mar 04 09:28:23 smithi082 podman[94314]: 2024-03-04 09:28:23.163921167 +0000 UTC m=+1.912138937 container died dc6d2245f297a9f35ea455f113bc2ab1b3aca3b457dbe223ef84b0cedb192ed7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-d, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-lusov-qdb-1bc250c, CEPH_POINT_RELEASE=, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-03-04T09:28:23.781 INFO:journalctl@ceph.mds.d.smithi082.stdout:Mar 04 09:28:23 smithi082 podman[94314]: 2024-03-04 09:28:23.533999429 +0000 UTC m=+2.282217199 container cleanup dc6d2245f297a9f35ea455f113bc2ab1b3aca3b457dbe223ef84b0cedb192ed7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-d, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, io.buildah.version=1.33.5) 2024-03-04T09:28:23.781 INFO:journalctl@ceph.mds.d.smithi082.stdout:Mar 04 09:28:23 smithi082 bash[94314]: ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-d 2024-03-04T09:28:23.898 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mds.d.service' 2024-03-04T09:28:23.933 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-04T09:28:23.933 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-03-04T09:28:23.933 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-03-04T09:28:23.934 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mds.g 2024-03-04T09:28:24.067 INFO:journalctl@ceph.mds.g.smithi082.stdout:Mar 04 09:28:24 smithi082 systemd[1]: Stopping Ceph mds.g for 2e533fc8-da06-11ee-95c6-87774f69a715... 2024-03-04T09:28:24.567 INFO:journalctl@ceph.mds.g.smithi082.stdout:Mar 04 09:28:24 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-g[73939]: 2024-03-04T09:28:24.253+0000 7fccd7bde700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T09:28:24.567 INFO:journalctl@ceph.mds.g.smithi082.stdout:Mar 04 09:28:24 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-g[73939]: 2024-03-04T09:28:24.253+0000 7fccd7bde700 -1 mds.g *** got signal Terminated *** 2024-03-04T09:28:28.558 INFO:journalctl@ceph.mds.g.smithi082.stdout:Mar 04 09:28:28 smithi082 podman[94436]: 2024-03-04 09:28:28.238304394 +0000 UTC m=+4.085931817 container died 2d46f426b5af844f37ebca2506e250519df05ccee58f76a68866f737d4a9b6bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-g, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222) 2024-03-04T09:28:28.817 INFO:journalctl@ceph.mds.g.smithi082.stdout:Mar 04 09:28:28 smithi082 podman[94436]: 2024-03-04 09:28:28.562104728 +0000 UTC m=+4.409732150 container cleanup 2d46f426b5af844f37ebca2506e250519df05ccee58f76a68866f737d4a9b6bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-g, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-qdb-1bc250c, CEPH_POINT_RELEASE=, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-03-04T09:28:28.817 INFO:journalctl@ceph.mds.g.smithi082.stdout:Mar 04 09:28:28 smithi082 bash[94436]: ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-g 2024-03-04T09:28:28.817 INFO:journalctl@ceph.mds.g.smithi082.stdout:Mar 04 09:28:28 smithi082 podman[94448]: 2024-03-04 09:28:28.763190165 +0000 UTC m=+0.518895640 container remove 2d46f426b5af844f37ebca2506e250519df05ccee58f76a68866f737d4a9b6bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-g, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8) 2024-03-04T09:28:28.979 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mds.g.service' 2024-03-04T09:28:29.013 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-04T09:28:29.014 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-03-04T09:28:29.014 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-03-04T09:28:29.014 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mds.j 2024-03-04T09:28:29.317 INFO:journalctl@ceph.mds.j.smithi082.stdout:Mar 04 09:28:29 smithi082 systemd[1]: Stopping Ceph mds.j for 2e533fc8-da06-11ee-95c6-87774f69a715... 2024-03-04T09:28:29.817 INFO:journalctl@ceph.mds.j.smithi082.stdout:Mar 04 09:28:29 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-j[72992]: 2024-03-04T09:28:29.373+0000 7f1209034700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T09:28:29.817 INFO:journalctl@ceph.mds.j.smithi082.stdout:Mar 04 09:28:29 smithi082 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-j[72992]: 2024-03-04T09:28:29.373+0000 7f1209034700 -1 mds.j *** got signal Terminated *** 2024-03-04T09:28:32.595 INFO:journalctl@ceph.mds.j.smithi082.stdout:Mar 04 09:28:32 smithi082 podman[94557]: 2024-03-04 09:28:32.324099969 +0000 UTC m=+3.083206992 container died 915a00d14ff39821a1617410d0397f999ed6e11ffe89f02ee4eb806104794234 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-j, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-03-04T09:28:32.954 INFO:journalctl@ceph.mds.j.smithi082.stdout:Mar 04 09:28:32 smithi082 podman[94557]: 2024-03-04 09:28:32.682250119 +0000 UTC m=+3.441357144 container cleanup 915a00d14ff39821a1617410d0397f999ed6e11ffe89f02ee4eb806104794234 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-j, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, RELEASE=wip-lusov-qdb-1bc250c, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-03-04T09:28:32.954 INFO:journalctl@ceph.mds.j.smithi082.stdout:Mar 04 09:28:32 smithi082 bash[94557]: ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-j 2024-03-04T09:28:33.105 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mds.j.service' 2024-03-04T09:28:33.139 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-04T09:28:33.140 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-03-04T09:28:33.140 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-03-04T09:28:33.140 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mds.b 2024-03-04T09:28:33.429 INFO:journalctl@ceph.mds.b.smithi102.stdout:Mar 04 09:28:33 smithi102 systemd[1]: Stopping Ceph mds.b for 2e533fc8-da06-11ee-95c6-87774f69a715... 2024-03-04T09:28:33.429 INFO:journalctl@ceph.mds.b.smithi102.stdout:Mar 04 09:28:33 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-b[65969]: 2024-03-04T09:28:33.414+0000 7f00c6a96700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T09:28:33.430 INFO:journalctl@ceph.mds.b.smithi102.stdout:Mar 04 09:28:33 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-b[65969]: 2024-03-04T09:28:33.414+0000 7f00c6a96700 -1 mds.b *** got signal Terminated *** 2024-03-04T09:28:36.521 INFO:journalctl@ceph.mds.b.smithi102.stdout:Mar 04 09:28:36 smithi102 podman[72649]: 2024-03-04 09:28:36.248249223 +0000 UTC m=+2.917915110 container died c6738d754c0d7c82462374028d92b4cf8ed831ef3e25bca0a9b6791adac5acf1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-b, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-03-04T09:28:36.879 INFO:journalctl@ceph.mds.b.smithi102.stdout:Mar 04 09:28:36 smithi102 podman[72649]: 2024-03-04 09:28:36.615194455 +0000 UTC m=+3.284860351 container cleanup c6738d754c0d7c82462374028d92b4cf8ed831ef3e25bca0a9b6791adac5acf1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-b, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, RELEASE=wip-lusov-qdb-1bc250c, ceph=True, GIT_CLEAN=True) 2024-03-04T09:28:36.879 INFO:journalctl@ceph.mds.b.smithi102.stdout:Mar 04 09:28:36 smithi102 bash[72649]: ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-b 2024-03-04T09:28:37.029 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mds.b.service' 2024-03-04T09:28:37.067 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-04T09:28:37.067 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-03-04T09:28:37.067 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-03-04T09:28:37.068 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mds.e 2024-03-04T09:28:37.429 INFO:journalctl@ceph.mds.e.smithi102.stdout:Mar 04 09:28:37 smithi102 systemd[1]: Stopping Ceph mds.e for 2e533fc8-da06-11ee-95c6-87774f69a715... 2024-03-04T09:28:37.430 INFO:journalctl@ceph.mds.e.smithi102.stdout:Mar 04 09:28:37 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-e[65334]: 2024-03-04T09:28:37.376+0000 7f5d4de89700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T09:28:37.430 INFO:journalctl@ceph.mds.e.smithi102.stdout:Mar 04 09:28:37 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-e[65334]: 2024-03-04T09:28:37.376+0000 7f5d4de89700 -1 mds.e *** got signal Terminated *** 2024-03-04T09:28:40.516 INFO:journalctl@ceph.mds.e.smithi102.stdout:Mar 04 09:28:40 smithi102 podman[72783]: 2024-03-04 09:28:40.246103267 +0000 UTC m=+2.963970644 container died e3feb706fe2ebc7388283fbb317e157c109ab2243eb23ddf23014af4abb1eb6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-e, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, RELEASE=wip-lusov-qdb-1bc250c, ceph=True) 2024-03-04T09:28:40.869 INFO:journalctl@ceph.mds.e.smithi102.stdout:Mar 04 09:28:40 smithi102 podman[72783]: 2024-03-04 09:28:40.618803239 +0000 UTC m=+3.336670612 container cleanup e3feb706fe2ebc7388283fbb317e157c109ab2243eb23ddf23014af4abb1eb6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-e, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-lusov-qdb-1bc250c, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-04T09:28:40.869 INFO:journalctl@ceph.mds.e.smithi102.stdout:Mar 04 09:28:40 smithi102 bash[72783]: ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-e 2024-03-04T09:28:41.050 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mds.e.service' 2024-03-04T09:28:41.105 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-04T09:28:41.105 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-03-04T09:28:41.106 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-03-04T09:28:41.106 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mds.h 2024-03-04T09:28:41.431 INFO:journalctl@ceph.mds.h.smithi102.stdout:Mar 04 09:28:41 smithi102 systemd[1]: Stopping Ceph mds.h for 2e533fc8-da06-11ee-95c6-87774f69a715... 2024-03-04T09:28:41.431 INFO:journalctl@ceph.mds.h.smithi102.stdout:Mar 04 09:28:41 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-h[65643]: 2024-03-04T09:28:41.430+0000 7f0541a7e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T09:28:41.431 INFO:journalctl@ceph.mds.h.smithi102.stdout:Mar 04 09:28:41 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-h[65643]: 2024-03-04T09:28:41.430+0000 7f0541a7e700 -1 mds.h *** got signal Terminated *** 2024-03-04T09:28:44.429 INFO:journalctl@ceph.mds.h.smithi102.stdout:Mar 04 09:28:44 smithi102 podman[72903]: 2024-03-04 09:28:44.246598507 +0000 UTC m=+2.909753053 container died 2ef4424c49d9eff146fd4cc76271c355969003740ea74cfbb5c542a6d04bb5ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-h, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.license=GPLv2) 2024-03-04T09:28:44.795 INFO:journalctl@ceph.mds.h.smithi102.stdout:Mar 04 09:28:44 smithi102 podman[72903]: 2024-03-04 09:28:44.597730143 +0000 UTC m=+3.260884689 container cleanup 2ef4424c49d9eff146fd4cc76271c355969003740ea74cfbb5c542a6d04bb5ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-h, GIT_BRANCH=HEAD, RELEASE=wip-lusov-qdb-1bc250c, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=) 2024-03-04T09:28:44.795 INFO:journalctl@ceph.mds.h.smithi102.stdout:Mar 04 09:28:44 smithi102 bash[72903]: ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-h 2024-03-04T09:28:45.004 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mds.h.service' 2024-03-04T09:28:45.039 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-04T09:28:45.039 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-03-04T09:28:45.039 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-03-04T09:28:45.040 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mds.k 2024-03-04T09:28:45.429 INFO:journalctl@ceph.mds.k.smithi102.stdout:Mar 04 09:28:45 smithi102 systemd[1]: Stopping Ceph mds.k for 2e533fc8-da06-11ee-95c6-87774f69a715... 2024-03-04T09:28:45.429 INFO:journalctl@ceph.mds.k.smithi102.stdout:Mar 04 09:28:45 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-k[65014]: 2024-03-04T09:28:45.350+0000 7fc43140e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T09:28:45.429 INFO:journalctl@ceph.mds.k.smithi102.stdout:Mar 04 09:28:45 smithi102 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-k[65014]: 2024-03-04T09:28:45.350+0000 7fc43140e700 -1 mds.k *** got signal Terminated *** 2024-03-04T09:28:48.631 INFO:journalctl@ceph.mds.k.smithi102.stdout:Mar 04 09:28:48 smithi102 podman[73025]: 2024-03-04 09:28:48.251163453 +0000 UTC m=+2.994192618 container died 1650eab41f0d876b04dad939e1cf98553b8241f71d69350568828071e3f5c49c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-k, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, RELEASE=wip-lusov-qdb-1bc250c, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.vendor=CentOS) 2024-03-04T09:28:48.929 INFO:journalctl@ceph.mds.k.smithi102.stdout:Mar 04 09:28:48 smithi102 podman[73025]: 2024-03-04 09:28:48.734483281 +0000 UTC m=+3.477512446 container cleanup 1650eab41f0d876b04dad939e1cf98553b8241f71d69350568828071e3f5c49c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-k, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-qdb-1bc250c, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, ceph=True) 2024-03-04T09:28:48.929 INFO:journalctl@ceph.mds.k.smithi102.stdout:Mar 04 09:28:48 smithi102 bash[73025]: ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-k 2024-03-04T09:28:49.091 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mds.k.service' 2024-03-04T09:28:49.125 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-04T09:28:49.125 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-03-04T09:28:49.125 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-03-04T09:28:49.126 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mds.c 2024-03-04T09:28:49.421 INFO:journalctl@ceph.mds.c.smithi190.stdout:Mar 04 09:28:49 smithi190 systemd[1]: Stopping Ceph mds.c for 2e533fc8-da06-11ee-95c6-87774f69a715... 2024-03-04T09:28:49.679 INFO:journalctl@ceph.mds.c.smithi190.stdout:Mar 04 09:28:49 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-c[67278]: 2024-03-04T09:28:49.424+0000 7f63731e2700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T09:28:49.679 INFO:journalctl@ceph.mds.c.smithi190.stdout:Mar 04 09:28:49 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-c[67278]: 2024-03-04T09:28:49.424+0000 7f63731e2700 -1 mds.c *** got signal Terminated *** 2024-03-04T09:28:52.497 INFO:journalctl@ceph.mds.c.smithi190.stdout:Mar 04 09:28:52 smithi190 podman[74103]: 2024-03-04 09:28:52.24436642 +0000 UTC m=+2.921108356 container died b8ad6f518f396ff20ccd5408b2c249db9be04b9f455da66590e929b8b70466e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-qdb-1bc250c, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8) 2024-03-04T09:28:52.755 INFO:journalctl@ceph.mds.c.smithi190.stdout:Mar 04 09:28:52 smithi190 podman[74103]: 2024-03-04 09:28:52.591284733 +0000 UTC m=+3.268026667 container cleanup b8ad6f518f396ff20ccd5408b2c249db9be04b9f455da66590e929b8b70466e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-c, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.build-date=20240222, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-04T09:28:52.755 INFO:journalctl@ceph.mds.c.smithi190.stdout:Mar 04 09:28:52 smithi190 bash[74103]: ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-c 2024-03-04T09:28:53.003 DEBUG:teuthology.orchestra.run.smithi190:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mds.c.service' 2024-03-04T09:28:53.027 INFO:journalctl@ceph.mds.c.smithi190.stdout:Mar 04 09:28:52 smithi190 podman[74129]: 2024-03-04 09:28:52.758945003 +0000 UTC m=+0.507710638 container remove b8ad6f518f396ff20ccd5408b2c249db9be04b9f455da66590e929b8b70466e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-c, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-qdb-1bc250c, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-04T09:28:53.027 INFO:journalctl@ceph.mds.c.smithi190.stdout:Mar 04 09:28:53 smithi190 systemd[1]: ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mds.c.service: Deactivated successfully. 2024-03-04T09:28:53.028 INFO:journalctl@ceph.mds.c.smithi190.stdout:Mar 04 09:28:53 smithi190 systemd[1]: Stopped Ceph mds.c for 2e533fc8-da06-11ee-95c6-87774f69a715. 2024-03-04T09:28:53.028 INFO:journalctl@ceph.mds.c.smithi190.stdout:Mar 04 09:28:53 smithi190 systemd[1]: ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mds.c.service: Consumed 4min 10.588s CPU time. 2024-03-04T09:28:53.041 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-04T09:28:53.041 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-03-04T09:28:53.041 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-03-04T09:28:53.041 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mds.f 2024-03-04T09:28:53.358 INFO:journalctl@ceph.mds.f.smithi190.stdout:Mar 04 09:28:53 smithi190 systemd[1]: Stopping Ceph mds.f for 2e533fc8-da06-11ee-95c6-87774f69a715... 2024-03-04T09:28:53.672 INFO:journalctl@ceph.mds.f.smithi190.stdout:Mar 04 09:28:53 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-f[66973]: 2024-03-04T09:28:53.361+0000 7f2759c72700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T09:28:53.672 INFO:journalctl@ceph.mds.f.smithi190.stdout:Mar 04 09:28:53 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-f[66973]: 2024-03-04T09:28:53.361+0000 7f2759c72700 -1 mds.f *** got signal Terminated *** 2024-03-04T09:28:56.541 INFO:journalctl@ceph.mds.f.smithi190.stdout:Mar 04 09:28:56 smithi190 podman[74236]: 2024-03-04 09:28:56.253217322 +0000 UTC m=+2.996792914 container died f653b0cd9cbbfe05c2a46e6e3db4f9b7c099259bcc0109610b9d7e0bc2dd41d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-f, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.schema-version=1.0, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-03-04T09:28:56.849 INFO:journalctl@ceph.mds.f.smithi190.stdout:Mar 04 09:28:56 smithi190 podman[74236]: 2024-03-04 09:28:56.627978686 +0000 UTC m=+3.371554254 container cleanup f653b0cd9cbbfe05c2a46e6e3db4f9b7c099259bcc0109610b9d7e0bc2dd41d7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-f, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, RELEASE=wip-lusov-qdb-1bc250c) 2024-03-04T09:28:56.849 INFO:journalctl@ceph.mds.f.smithi190.stdout:Mar 04 09:28:56 smithi190 bash[74236]: ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-f 2024-03-04T09:28:56.975 DEBUG:teuthology.orchestra.run.smithi190:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mds.f.service' 2024-03-04T09:28:57.013 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-04T09:28:57.013 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-03-04T09:28:57.013 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-03-04T09:28:57.014 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mds.i 2024-03-04T09:28:57.171 INFO:journalctl@ceph.mds.i.smithi190.stdout:Mar 04 09:28:57 smithi190 systemd[1]: Stopping Ceph mds.i for 2e533fc8-da06-11ee-95c6-87774f69a715... 2024-03-04T09:28:57.671 INFO:journalctl@ceph.mds.i.smithi190.stdout:Mar 04 09:28:57 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-i[67597]: 2024-03-04T09:28:57.355+0000 7fce3d6a8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T09:28:57.671 INFO:journalctl@ceph.mds.i.smithi190.stdout:Mar 04 09:28:57 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-i[67597]: 2024-03-04T09:28:57.355+0000 7fce3d6a8700 -1 mds.i *** got signal Terminated *** 2024-03-04T09:29:00.424 INFO:journalctl@ceph.mds.i.smithi190.stdout:Mar 04 09:29:00 smithi190 podman[74356]: 2024-03-04 09:29:00.253368001 +0000 UTC m=+3.019849385 container died 6cd20d28ba89f5c3dcafc453f0f5a3029b455d120ebd270b9d0a36e2c2f8346d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-i, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-03-04T09:29:00.803 INFO:journalctl@ceph.mds.i.smithi190.stdout:Mar 04 09:29:00 smithi190 podman[74356]: 2024-03-04 09:29:00.597923948 +0000 UTC m=+3.364405339 container cleanup 6cd20d28ba89f5c3dcafc453f0f5a3029b455d120ebd270b9d0a36e2c2f8346d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-i, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-qdb-1bc250c, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD) 2024-03-04T09:29:00.803 INFO:journalctl@ceph.mds.i.smithi190.stdout:Mar 04 09:29:00 smithi190 bash[74356]: ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-i 2024-03-04T09:29:00.999 DEBUG:teuthology.orchestra.run.smithi190:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mds.i.service' 2024-03-04T09:29:01.034 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-04T09:29:01.034 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-03-04T09:29:01.035 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-03-04T09:29:01.035 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mds.l 2024-03-04T09:29:01.364 INFO:journalctl@ceph.mds.l.smithi190.stdout:Mar 04 09:29:01 smithi190 systemd[1]: Stopping Ceph mds.l for 2e533fc8-da06-11ee-95c6-87774f69a715... 2024-03-04T09:29:01.671 INFO:journalctl@ceph.mds.l.smithi190.stdout:Mar 04 09:29:01 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-l[66661]: 2024-03-04T09:29:01.367+0000 7fb0518b9700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-04T09:29:01.671 INFO:journalctl@ceph.mds.l.smithi190.stdout:Mar 04 09:29:01 smithi190 ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-l[66661]: 2024-03-04T09:29:01.367+0000 7fb0518b9700 -1 mds.l *** got signal Terminated *** 2024-03-04T09:29:04.508 INFO:journalctl@ceph.mds.l.smithi190.stdout:Mar 04 09:29:04 smithi190 podman[74478]: 2024-03-04 09:29:04.248035087 +0000 UTC m=+2.989588058 container died a8098d38027e9e7748d6d16cd38df20a9b14994c2443409ac3f33c5ca010912b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-qdb-1bc250c, ceph=True, org.label-schema.vendor=CentOS) 2024-03-04T09:29:04.765 INFO:journalctl@ceph.mds.l.smithi190.stdout:Mar 04 09:29:04 smithi190 podman[74478]: 2024-03-04 09:29:04.576298821 +0000 UTC m=+3.317851787 container cleanup a8098d38027e9e7748d6d16cd38df20a9b14994c2443409ac3f33c5ca010912b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-l, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-03-04T09:29:04.765 INFO:journalctl@ceph.mds.l.smithi190.stdout:Mar 04 09:29:04 smithi190 bash[74478]: ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-l 2024-03-04T09:29:04.991 DEBUG:teuthology.orchestra.run.smithi190:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mds.l.service' 2024-03-04T09:29:05.016 INFO:journalctl@ceph.mds.l.smithi190.stdout:Mar 04 09:29:04 smithi190 podman[74491]: 2024-03-04 09:29:04.768820912 +0000 UTC m=+0.516731334 container remove a8098d38027e9e7748d6d16cd38df20a9b14994c2443409ac3f33c5ca010912b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3011ef4e883c5a20dd92da8f81055baaa8abf2682670e25e08f983b156727fe5, name=ceph-2e533fc8-da06-11ee-95c6-87774f69a715-mds-l, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=918ebec1af6f745255c974e3941e386838a94fd8, org.label-schema.license=GPLv2, RELEASE=wip-lusov-qdb-1bc250c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222) 2024-03-04T09:29:05.016 INFO:journalctl@ceph.mds.l.smithi190.stdout:Mar 04 09:29:04 smithi190 systemd[1]: ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mds.l.service: Deactivated successfully. 2024-03-04T09:29:05.016 INFO:journalctl@ceph.mds.l.smithi190.stdout:Mar 04 09:29:04 smithi190 systemd[1]: Stopped Ceph mds.l for 2e533fc8-da06-11ee-95c6-87774f69a715. 2024-03-04T09:29:05.016 INFO:journalctl@ceph.mds.l.smithi190.stdout:Mar 04 09:29:04 smithi190 systemd[1]: ceph-2e533fc8-da06-11ee-95c6-87774f69a715@mds.l.service: Consumed 2.096s CPU time. 2024-03-04T09:29:05.026 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-04T09:29:05.026 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-03-04T09:29:05.026 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 --force --keep-logs 2024-03-04T09:29:05.221 INFO:teuthology.orchestra.run.smithi082.stdout:Deleting cluster with fsid: 2e533fc8-da06-11ee-95c6-87774f69a715 2024-03-04T09:29:07.665 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 --force --keep-logs 2024-03-04T09:29:07.858 INFO:teuthology.orchestra.run.smithi102.stdout:Deleting cluster with fsid: 2e533fc8-da06-11ee-95c6-87774f69a715 2024-03-04T09:29:10.243 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 --force --keep-logs 2024-03-04T09:29:10.436 INFO:teuthology.orchestra.run.smithi190.stdout:Deleting cluster with fsid: 2e533fc8-da06-11ee-95c6-87774f69a715 2024-03-04T09:29:12.785 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-04T09:29:12.821 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-04T09:29:12.855 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-04T09:29:12.884 INFO:tasks.cephadm:Archiving crash dumps... 2024-03-04T09:29:12.888 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/crash to /home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580833/remote/smithi082/crash 2024-03-04T09:29:12.888 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/crash -- . 2024-03-04T09:29:12.918 INFO:teuthology.orchestra.run.smithi082.stderr:tar: /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/crash: Cannot open: No such file or directory 2024-03-04T09:29:12.918 INFO:teuthology.orchestra.run.smithi082.stderr:tar: Error is not recoverable: exiting now 2024-03-04T09:29:12.920 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/crash to /home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580833/remote/smithi102/crash 2024-03-04T09:29:12.921 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/crash -- . 2024-03-04T09:29:13.030 INFO:teuthology.orchestra.run.smithi102.stderr:tar: /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/crash: Cannot open: No such file or directory 2024-03-04T09:29:13.030 INFO:teuthology.orchestra.run.smithi102.stderr:tar: Error is not recoverable: exiting now 2024-03-04T09:29:13.032 DEBUG:teuthology.misc:Transferring archived files from smithi190:/var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/crash to /home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580833/remote/smithi190/crash 2024-03-04T09:29:13.033 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar c -f - -C /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/crash -- . 2024-03-04T09:29:13.074 INFO:teuthology.orchestra.run.smithi190.stderr:tar: /var/lib/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/crash: Cannot open: No such file or directory 2024-03-04T09:29:13.074 INFO:teuthology.orchestra.run.smithi190.stderr:tar: Error is not recoverable: exiting now 2024-03-04T09:29:13.075 INFO:tasks.cephadm:Checking cluster log for badness... 2024-03-04T09:29:13.075 DEBUG:teuthology.orchestra.run.smithi082:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-03-04T09:29:13.112 INFO:teuthology.orchestra.run.smithi082.stdout:2024-03-04T09:07:11.614369+0000 mon.a (mon.0) 189 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-03-04T09:29:13.112 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-03-04T09:29:13.113 DEBUG:teuthology.orchestra.run.smithi082:> sudo egrep '\[SEC\]' /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-03-04T09:29:13.187 DEBUG:teuthology.orchestra.run.smithi082:> sudo egrep '\[ERR\]' /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-03-04T09:29:13.262 DEBUG:teuthology.orchestra.run.smithi082:> sudo egrep '\[WRN\]' /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-03-04T09:29:13.337 INFO:teuthology.orchestra.run.smithi082.stdout:2024-03-04T09:07:11.614369+0000 mon.a (mon.0) 189 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-03-04T09:29:13.337 INFO:tasks.cephadm:Compressing logs... 2024-03-04T09:29:13.338 DEBUG:teuthology.orchestra.run.smithi082:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-04T09:29:13.380 DEBUG:teuthology.orchestra.run.smithi102:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-04T09:29:13.382 DEBUG:teuthology.orchestra.run.smithi190:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-04T09:29:13.405 INFO:teuthology.orchestra.run.smithi082.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-03-04T09:29:13.405 INFO:teuthology.orchestra.run.smithi082.stderr:: No such file or directory 2024-03-04T09:29:13.405 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-03-04T09:29:13.405 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-osd.6.log 2024-03-04T09:29:13.406 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-mon.a.log 2024-03-04T09:29:13.408 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph.audit.log 2024-03-04T09:29:13.408 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-mds.g.log 2024-03-04T09:29:13.408 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-mon.a.log: /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-mds.j.log 2024-03-04T09:29:13.408 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-osd.3.log 2024-03-04T09:29:13.408 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-mgr.x.log 2024-03-04T09:29:13.408 INFO:teuthology.orchestra.run.smithi190.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-03-04T09:29:13.409 INFO:teuthology.orchestra.run.smithi190.stderr:: No such file or directory 2024-03-04T09:29:13.410 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-mds.l.log 2024-03-04T09:29:13.410 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph.audit.log 2024-03-04T09:29:13.410 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-mds.i.log 2024-03-04T09:29:13.417 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-osd.3.log: 90.0% -- replaced with /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph.audit.log.gz 2024-03-04T09:29:13.417 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-osd.0.log 2024-03-04T09:29:13.417 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-mgr.x.log: 94.6% -- replaced with /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-mds.j.log.gz 2024-03-04T09:29:13.417 INFO:teuthology.orchestra.run.smithi082.stderr: 93.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-03-04T09:29:13.418 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph.cephadm.log 2024-03-04T09:29:13.418 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph.log 2024-03-04T09:29:13.418 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph.cephadm.log: 84.2% -- replaced with /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph.cephadm.log.gz 2024-03-04T09:29:13.420 INFO:teuthology.orchestra.run.smithi102.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-03-04T09:29:13.420 INFO:teuthology.orchestra.run.smithi102.stderr:: No such file or directory 2024-03-04T09:29:13.420 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-osd.10.log 2024-03-04T09:29:13.420 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph.audit.log 2024-03-04T09:29:13.420 INFO:teuthology.orchestra.run.smithi102.stderr:gzip/var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-osd.10.log: -5 --verbose -- /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-mds.b.log 2024-03-04T09:29:13.421 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-osd.4.log 2024-03-04T09:29:13.421 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-osd.1.log 2024-03-04T09:29:13.421 INFO:teuthology.orchestra.run.smithi102.stderr: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-03-04T09:29:13.421 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-mds.k.log 2024-03-04T09:29:13.421 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-mds.h.log 2024-03-04T09:29:13.421 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-osd.7.log 2024-03-04T09:29:13.421 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-mds.e.log 2024-03-04T09:29:13.421 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-osd.7.log: 90.1% -- replaced with /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph.audit.log.gz 2024-03-04T09:29:13.421 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-mgr.y.log 2024-03-04T09:29:13.423 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-mds.l.log: /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-osd.11.log 2024-03-04T09:29:13.423 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-mgr.z.log 2024-03-04T09:29:13.424 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-mds.i.log: /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-osd.8.log 2024-03-04T09:29:13.424 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-mgr.z.log: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-03-04T09:29:13.424 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-osd.5.log 2024-03-04T09:29:13.424 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-mds.f.log 2024-03-04T09:29:13.424 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph.cephadm.log 2024-03-04T09:29:13.424 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-mds.f.log: 90.2% -- replaced with /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph.audit.log.gz 2024-03-04T09:29:13.424 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph.log 2024-03-04T09:29:13.424 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph.cephadm.log: 84.0% -- replaced with /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph.cephadm.log.gz 2024-03-04T09:29:13.424 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-osd.2.log 2024-03-04T09:29:13.424 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph.log: 91.9% -- replaced with /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-mgr.z.log.gz 2024-03-04T09:29:13.424 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-mds.c.log 2024-03-04T09:29:13.424 INFO:teuthology.orchestra.run.smithi190.stderr: 87.2% -- replaced with /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph.log.gz/var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-osd.2.log: 2024-03-04T09:29:13.424 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-volume.log 2024-03-04T09:29:13.425 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-volume.log 2024-03-04T09:29:13.426 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph.log: 87.2% -- replaced with /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph.log.gz 2024-03-04T09:29:13.428 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph.cephadm.log 2024-03-04T09:29:13.429 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-mon.c.log 2024-03-04T09:29:13.437 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-osd.9.log 2024-03-04T09:29:13.438 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph.log 2024-03-04T09:29:13.447 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph.cephadm.log: 91.8%gzip -5 --verbose -- /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-volume.log 2024-03-04T09:29:13.450 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-mds.d.log 2024-03-04T09:29:13.451 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph.log: 84.1% -- replaced with /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph.cephadm.log.gz 2024-03-04T09:29:13.452 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-osd.9.log: 91.0% -- replaced with /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-volume.log.gz 2024-03-04T09:29:13.453 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-mgr.y.log.gz 2024-03-04T09:29:13.456 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-mon.b.log 2024-03-04T09:29:13.459 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-mds.a.log 2024-03-04T09:29:13.462 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-volume.log: 87.2% -- replaced with /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph.log.gz 2024-03-04T09:29:13.463 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-volume.log: /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-mon.c.log: 91.0% -- replaced with /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-volume.log.gz 2024-03-04T09:29:13.471 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-mds.d.log: 94.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-03-04T09:29:13.477 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-mds.a.log: -- replaced with /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-mds.d.log.gz 2024-03-04T09:29:13.492 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.log: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-03-04T09:29:13.495 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-mon.b.log: 91.0% -- replaced with /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-volume.log.gz 2024-03-04T09:29:13.556 INFO:teuthology.orchestra.run.smithi102.stderr: 94.2% -- replaced with /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-mds.k.log.gz 2024-03-04T09:29:13.613 INFO:teuthology.orchestra.run.smithi190.stderr: 94.4% -- replaced with /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-mds.l.log.gz 2024-03-04T09:29:13.737 INFO:teuthology.orchestra.run.smithi082.stderr: 89.9% -- replaced with /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-mgr.x.log.gz 2024-03-04T09:29:13.758 INFO:teuthology.orchestra.run.smithi082.stderr: 95.0% -- replaced with /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-mds.g.log.gz 2024-03-04T09:29:13.924 INFO:teuthology.orchestra.run.smithi102.stderr: 92.2% -- replaced with /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-mon.b.log.gz 2024-03-04T09:29:13.950 INFO:teuthology.orchestra.run.smithi190.stderr: 91.9% -- replaced with /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-mon.c.log.gz 2024-03-04T09:29:14.254 INFO:teuthology.orchestra.run.smithi190.stderr: 93.8% -- replaced with /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-mds.c.log.gz 2024-03-04T09:29:14.596 INFO:teuthology.orchestra.run.smithi082.stderr: 90.4% -- replaced with /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-mon.a.log.gz 2024-03-04T09:29:14.821 INFO:teuthology.orchestra.run.smithi190.stderr: 93.9% -- replaced with /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-mds.i.log.gz 2024-03-04T09:29:15.083 INFO:teuthology.orchestra.run.smithi102.stderr: 95.6% -- replaced with /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-mds.e.log.gz 2024-03-04T09:29:15.930 INFO:teuthology.orchestra.run.smithi082.stderr: 95.7% -- replaced with /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-mds.a.log.gz 2024-03-04T09:29:16.407 INFO:teuthology.orchestra.run.smithi190.stderr: 93.9% -- replaced with /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-mds.f.log.gz 2024-03-04T09:29:17.707 INFO:teuthology.orchestra.run.smithi102.stderr: 92.0% -- replaced with /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-osd.10.log.gz 2024-03-04T09:29:18.890 INFO:teuthology.orchestra.run.smithi190.stderr: 91.8% -- replaced with /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-osd.8.log.gz 2024-03-04T09:29:19.255 INFO:teuthology.orchestra.run.smithi082.stderr: 91.6% -- replaced with /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-osd.0.log.gz 2024-03-04T09:29:19.418 INFO:teuthology.orchestra.run.smithi190.stderr: 91.5% -- replaced with /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-osd.11.log.gz 2024-03-04T09:29:20.020 INFO:teuthology.orchestra.run.smithi190.stderr: 91.5% -- replaced with /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-osd.2.log.gz 2024-03-04T09:29:20.028 INFO:teuthology.orchestra.run.smithi082.stderr: 91.5% -- replaced with /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-osd.6.log.gz 2024-03-04T09:29:21.329 INFO:teuthology.orchestra.run.smithi102.stderr: 91.5% -- replaced with /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-osd.4.log.gz 2024-03-04T09:29:21.602 INFO:teuthology.orchestra.run.smithi102.stderr: 91.9% -- replaced with /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-osd.1.log.gz 2024-03-04T09:29:21.850 INFO:teuthology.orchestra.run.smithi082.stderr: 91.7% -- replaced with /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-osd.9.log.gz 2024-03-04T09:29:21.958 INFO:teuthology.orchestra.run.smithi102.stderr: 91.6% -- replaced with /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-osd.7.log.gz 2024-03-04T09:29:21.976 INFO:teuthology.orchestra.run.smithi190.stderr: 91.4% -- replaced with /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-osd.5.log.gz 2024-03-04T09:29:21.978 INFO:teuthology.orchestra.run.smithi190.stderr: 2024-03-04T09:29:21.978 INFO:teuthology.orchestra.run.smithi190.stderr:real 0m8.582s 2024-03-04T09:29:21.978 INFO:teuthology.orchestra.run.smithi190.stderr:user 0m31.415s 2024-03-04T09:29:21.978 INFO:teuthology.orchestra.run.smithi190.stderr:sys 0m0.996s 2024-03-04T09:29:22.330 INFO:teuthology.orchestra.run.smithi082.stderr: 91.8% -- replaced with /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-osd.3.log.gz 2024-03-04T09:29:27.043 INFO:teuthology.orchestra.run.smithi082.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-03-04T09:29:27.045 INFO:teuthology.orchestra.run.smithi082.stderr: 2024-03-04T09:29:27.045 INFO:teuthology.orchestra.run.smithi082.stderr:real 0m13.653s 2024-03-04T09:29:27.045 INFO:teuthology.orchestra.run.smithi082.stderr:user 0m45.991s 2024-03-04T09:29:27.045 INFO:teuthology.orchestra.run.smithi082.stderr:sys 0m1.431s 2024-03-04T09:29:27.932 INFO:teuthology.orchestra.run.smithi102.stderr: 93.4% -- replaced with /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-mds.b.log.gz 2024-03-04T09:29:32.850 INFO:teuthology.orchestra.run.smithi102.stderr: 93.4% -- replaced with /var/log/ceph/2e533fc8-da06-11ee-95c6-87774f69a715/ceph-mds.h.log.gz 2024-03-04T09:29:32.852 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-03-04T09:29:32.852 INFO:teuthology.orchestra.run.smithi102.stderr:real 0m19.455s 2024-03-04T09:29:32.852 INFO:teuthology.orchestra.run.smithi102.stderr:user 1m3.118s 2024-03-04T09:29:32.852 INFO:teuthology.orchestra.run.smithi102.stderr:sys 0m1.862s 2024-03-04T09:29:32.852 INFO:tasks.cephadm:Archiving logs... 2024-03-04T09:29:32.852 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580833/remote/smithi082/log 2024-03-04T09:29:32.853 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-04T09:29:39.500 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580833/remote/smithi102/log 2024-03-04T09:29:39.706 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-04T09:29:49.376 DEBUG:teuthology.misc:Transferring archived files from smithi190:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580833/remote/smithi190/log 2024-03-04T09:29:49.377 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-04T09:29:54.168 INFO:tasks.cephadm:Removing cluster... 2024-03-04T09:29:54.168 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 --force 2024-03-04T09:29:54.361 INFO:teuthology.orchestra.run.smithi082.stdout:Deleting cluster with fsid: 2e533fc8-da06-11ee-95c6-87774f69a715 2024-03-04T09:29:54.735 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 --force 2024-03-04T09:29:54.936 INFO:teuthology.orchestra.run.smithi102.stdout:Deleting cluster with fsid: 2e533fc8-da06-11ee-95c6-87774f69a715 2024-03-04T09:29:55.267 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 2e533fc8-da06-11ee-95c6-87774f69a715 --force 2024-03-04T09:29:55.458 INFO:teuthology.orchestra.run.smithi190.stdout:Deleting cluster with fsid: 2e533fc8-da06-11ee-95c6-87774f69a715 2024-03-04T09:29:55.745 INFO:tasks.cephadm:Removing cephadm ... 2024-03-04T09:29:55.745 DEBUG:teuthology.orchestra.run.smithi082:> rm -rf /home/ubuntu/cephtest/cephadm 2024-03-04T09:29:55.764 DEBUG:teuthology.orchestra.run.smithi102:> rm -rf /home/ubuntu/cephtest/cephadm 2024-03-04T09:29:55.781 DEBUG:teuthology.orchestra.run.smithi190:> rm -rf /home/ubuntu/cephtest/cephadm 2024-03-04T09:29:55.797 INFO:tasks.cephadm:Teardown complete 2024-03-04T09:29:55.797 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-03-04T09:29:55.812 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-03-04T09:29:55.812 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-04T09:29:55.815 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-04T09:29:55.824 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-04T09:29:55.967 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-04T09:29:55.978 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-04T09:29:55.978 DEBUG:teuthology.orchestra.run.smithi082:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-04T09:29:55.980 DEBUG:teuthology.orchestra.run.smithi102:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-04T09:29:55.983 DEBUG:teuthology.orchestra.run.smithi190:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-04T09:29:55.994 INFO:teuthology.orchestra.run.smithi082.stderr:bash: line 1: ntpq: command not found 2024-03-04T09:29:55.995 INFO:teuthology.orchestra.run.smithi102.stderr:bash: line 1: ntpq: command not found 2024-03-04T09:29:55.997 INFO:teuthology.orchestra.run.smithi190.stderr:bash: line 1: ntpq: command not found 2024-03-04T09:29:56.000 INFO:teuthology.orchestra.run.smithi082.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-04T09:29:56.000 INFO:teuthology.orchestra.run.smithi082.stdout:=============================================================================== 2024-03-04T09:29:56.000 INFO:teuthology.orchestra.run.smithi082.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 34 +569us[ +569us] +/- 100ms 2024-03-04T09:29:56.000 INFO:teuthology.orchestra.run.smithi082.stdout:^* hv02.front.sepia.ceph.com 3 6 377 37 -1103us[-1037us] +/- 53ms 2024-03-04T09:29:56.000 INFO:teuthology.orchestra.run.smithi082.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 35 +1008us[+1008us] +/- 64ms 2024-03-04T09:29:56.000 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T09:29:56.002 INFO:teuthology.orchestra.run.smithi190.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-04T09:29:56.002 INFO:teuthology.orchestra.run.smithi190.stdout:=============================================================================== 2024-03-04T09:29:56.002 INFO:teuthology.orchestra.run.smithi190.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 36 +594us[ +594us] +/- 100ms 2024-03-04T09:29:56.002 INFO:teuthology.orchestra.run.smithi190.stdout:^* hv02.front.sepia.ceph.com 3 6 377 36 -1082us[-1030us] +/- 53ms 2024-03-04T09:29:56.002 INFO:teuthology.orchestra.run.smithi190.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 34 +1013us[+1013us] +/- 64ms 2024-03-04T09:29:56.003 INFO:teuthology.orchestra.run.smithi190.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T09:29:56.003 INFO:teuthology.orchestra.run.smithi102.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-04T09:29:56.003 INFO:teuthology.orchestra.run.smithi102.stdout:=============================================================================== 2024-03-04T09:29:56.003 INFO:teuthology.orchestra.run.smithi102.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 36 +569us[ +569us] +/- 100ms 2024-03-04T09:29:56.003 INFO:teuthology.orchestra.run.smithi102.stdout:^* hv02.front.sepia.ceph.com 3 6 377 38 -1108us[-1062us] +/- 53ms 2024-03-04T09:29:56.003 INFO:teuthology.orchestra.run.smithi102.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 37 +1002us[+1002us] +/- 64ms 2024-03-04T09:29:56.003 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T09:29:56.003 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-04T09:29:56.013 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-04T09:29:56.014 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-04T09:29:56.024 DEBUG:teuthology.orchestra.run.smithi082:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-04T09:29:56.126 DEBUG:teuthology.orchestra.run.smithi102:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-04T09:29:56.200 DEBUG:teuthology.orchestra.run.smithi190:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-04T09:29:56.270 DEBUG:teuthology.orchestra.run.smithi082:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-04T09:29:56.302 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T09:29:56.302 DEBUG:teuthology.orchestra.run.smithi102:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-04T09:29:56.334 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T09:29:56.335 DEBUG:teuthology.orchestra.run.smithi190:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-04T09:29:56.364 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T09:29:56.365 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-04T09:29:56.376 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-04T09:29:56.412 INFO:teuthology.task.internal:Duration was 1979.442085 seconds 2024-03-04T09:29:56.412 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-04T09:29:56.440 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-04T09:29:56.440 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-04T09:29:56.443 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-04T09:29:56.445 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-04T09:29:56.485 INFO:teuthology.orchestra.run.smithi082.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-04T09:29:56.485 INFO:teuthology.orchestra.run.smithi102.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-04T09:29:56.488 INFO:teuthology.orchestra.run.smithi190.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-04T09:29:56.972 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-04T09:29:56.973 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi082.front.sepia.ceph.com 2024-03-04T09:29:56.973 DEBUG:teuthology.orchestra.run.smithi082:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-04T09:29:56.994 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi102.front.sepia.ceph.com 2024-03-04T09:29:56.995 DEBUG:teuthology.orchestra.run.smithi102:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-04T09:29:57.037 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi190.front.sepia.ceph.com 2024-03-04T09:29:57.038 DEBUG:teuthology.orchestra.run.smithi190:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-04T09:29:57.073 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-04T09:29:57.074 DEBUG:teuthology.orchestra.run.smithi082:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-04T09:29:57.076 DEBUG:teuthology.orchestra.run.smithi102:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-04T09:29:57.080 DEBUG:teuthology.orchestra.run.smithi190:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-04T09:29:57.143 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-04T09:29:57.144 DEBUG:teuthology.orchestra.run.smithi082:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-04T09:29:57.147 DEBUG:teuthology.orchestra.run.smithi102:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-04T09:29:57.149 DEBUG:teuthology.orchestra.run.smithi190:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-04T09:29:57.546 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-04T09:29:57.557 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-04T09:29:57.558 DEBUG:teuthology.orchestra.run.smithi082:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-04T09:29:57.585 DEBUG:teuthology.orchestra.run.smithi102:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-04T09:29:57.613 DEBUG:teuthology.orchestra.run.smithi190:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-04T09:29:57.641 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-04T09:29:57.656 DEBUG:teuthology.orchestra.run.smithi082:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-04T09:29:57.658 DEBUG:teuthology.orchestra.run.smithi102:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-04T09:29:57.661 DEBUG:teuthology.orchestra.run.smithi190:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-04T09:29:57.681 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = core 2024-03-04T09:29:57.684 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern = core 2024-03-04T09:29:57.707 INFO:teuthology.orchestra.run.smithi190.stdout:kernel.core_pattern = core 2024-03-04T09:29:57.733 DEBUG:teuthology.orchestra.run.smithi082:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-04T09:29:57.751 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T09:29:57.752 DEBUG:teuthology.orchestra.run.smithi102:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-04T09:29:57.774 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T09:29:57.775 DEBUG:teuthology.orchestra.run.smithi190:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-04T09:29:57.789 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T09:29:57.789 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-04T09:29:57.801 INFO:teuthology.task.internal:Transferring archived files... 2024-03-04T09:29:57.802 DEBUG:teuthology.misc:Transferring archived files from smithi082:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580833/remote/smithi082 2024-03-04T09:29:57.802 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-04T09:29:57.857 DEBUG:teuthology.misc:Transferring archived files from smithi102:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580833/remote/smithi102 2024-03-04T09:29:57.858 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-04T09:29:57.908 DEBUG:teuthology.misc:Transferring archived files from smithi190:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580833/remote/smithi190 2024-03-04T09:29:57.908 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-04T09:29:57.948 INFO:teuthology.task.internal:Removing archive directory... 2024-03-04T09:29:57.952 DEBUG:teuthology.orchestra.run.smithi082:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-04T09:29:57.954 DEBUG:teuthology.orchestra.run.smithi102:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-04T09:29:57.956 DEBUG:teuthology.orchestra.run.smithi190:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-04T09:29:57.996 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-04T09:29:58.010 INFO:teuthology.task.internal:Not uploading archives. 2024-03-04T09:29:58.010 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-04T09:29:58.059 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-04T09:29:58.060 DEBUG:teuthology.orchestra.run.smithi082:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-04T09:29:58.062 DEBUG:teuthology.orchestra.run.smithi102:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-04T09:29:58.064 DEBUG:teuthology.orchestra.run.smithi190:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-04T09:29:58.074 INFO:teuthology.orchestra.run.smithi082.stdout: 265301 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 4 09:29 /home/ubuntu/cephtest 2024-03-04T09:29:58.076 INFO:teuthology.orchestra.run.smithi102.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 4 09:29 /home/ubuntu/cephtest 2024-03-04T09:29:58.078 INFO:teuthology.orchestra.run.smithi190.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 4 09:29 /home/ubuntu/cephtest 2024-03-04T09:29:58.079 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-04T09:29:58.092 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-04T09:29:58.149 INFO:teuthology.nuke:Checking targets against current locks 2024-03-04T09:29:58.184 DEBUG:teuthology.nuke:shortname: smithi082 2024-03-04T09:29:58.185 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-04T09:29:58.224 DEBUG:teuthology.nuke:shortname: smithi102 2024-03-04T09:29:58.224 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-04T09:29:58.246 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi082.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580833', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-04 08:48:31.609026', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNkJl6qKdFFd+hCetNTz+Sj09O2DX4EqS+OHaEacWiPnT5+78BLMcS0HR3p1weM/7T2D244a8dmBx4cPws00I20='} 2024-03-04T09:29:58.267 DEBUG:teuthology.nuke:shortname: smithi190 2024-03-04T09:29:58.268 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-04T09:29:58.280 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580833', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-04 08:48:31.611589', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCw3z+3rETOuzwHAuJv9tIIu+rKlRGjmjmXVAqg3nLWIC2ucVtRc1Ohz9FWVzVCh6PKe8e520t/u5QiTHULmPNc='} 2024-03-04T09:29:58.338 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi190.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-03-04_07:05:03-fs-wip-lusov-qdb-distro-default-smithi/7580833', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-04 08:48:31.610380', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHotIUDfKIbXUI+k9LibLRlp8ZVxj/0vbN4SDOhUzVpEqe1KgExTqhV066NtxATEbsmQ7cIndRH64gf/kXQifZU='} 2024-03-04T09:29:58.360 INFO:teuthology.orchestra.console.smithi082:Power off 2024-03-04T09:29:58.361 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-04T09:29:58.425 INFO:teuthology.orchestra.console.smithi102:Power off 2024-03-04T09:29:58.426 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-04T09:29:58.438 DEBUG:teuthology.orchestra.console.smithi082:power off output: Chassis Power Control: Down/Off 2024-03-04T09:29:58.439 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T09:29:58.466 INFO:teuthology.orchestra.console.smithi190:Power off 2024-03-04T09:29:58.466 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-04T09:29:58.475 DEBUG:teuthology.orchestra.console.smithi102:power off output: Chassis Power Control: Down/Off 2024-03-04T09:29:58.476 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T09:29:58.495 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is on 2024-03-04T09:29:58.520 DEBUG:teuthology.orchestra.console.smithi190:power off output: Chassis Power Control: Down/Off 2024-03-04T09:29:58.520 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T09:29:58.532 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2024-03-04T09:29:58.571 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2024-03-04T09:30:02.496 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T09:30:02.533 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T09:30:02.572 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T09:30:02.614 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is on 2024-03-04T09:30:02.644 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2024-03-04T09:30:02.687 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2024-03-04T09:30:06.616 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T09:30:06.645 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T09:30:06.688 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T09:30:06.729 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is on 2024-03-04T09:30:06.755 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2024-03-04T09:30:06.797 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2024-03-04T09:30:06.857 INFO:teuthology.orchestra.console.smithi102:Power off completed 2024-03-04T09:30:10.732 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T09:30:10.798 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T09:30:10.844 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is off 2024-03-04T09:30:10.909 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2024-03-04T09:30:10.944 INFO:teuthology.orchestra.console.smithi082:Power off completed 2024-03-04T09:30:11.010 INFO:teuthology.orchestra.console.smithi190:Power off completed 2024-03-04T09:30:11.115 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-workunit/fs/norstats}} duration: 1979.4420845508575 failure_reason: '"2024-03-04T09:07:11.614369+0000 mon.a (mon.0) 189 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,c" in cluster log' flavor: default owner: scheduled_leonidus@teuthology success: false 2024-03-04T09:30:11.115 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T09:30:11.273 INFO:teuthology.run:FAIL